성능 미달로 다른 모델로 교체
1회차
Epoch 1/50 - Loss: 0.6015043711112864 - Accuracy: 68.56768558951966% Validation - Loss: 0.5793341911255978 - Accuracy: 71.82870993805548% Epoch 2/50 - Loss: 0.4392847554581292 - Accuracy: 80.41048034934498% Validation - Loss: 0.4086538789006422 - Accuracy: 84.1368165903582% Epoch 3/50 - Loss: 0.29262441980480813 - Accuracy: 88.3056768558952% Validation - Loss: 0.2625072044245459 - Accuracy: 90.78911931053057% Epoch 4/50 - Loss: 0.21642073026114253 - Accuracy: 91.82532751091703% Validation - Loss: 0.2508420253618692 - Accuracy: 89.76568812281174% Epoch 5/50 - Loss: 0.17434236280653917 - Accuracy: 93.72052401746726% Validation - Loss: 0.24734874939211357 - Accuracy: 92.02800969566388% Epoch 6/50 - Loss: 0.1333207672721363 - Accuracy: 95.23144104803494% Validation - Loss: 0.2000077326842163 - Accuracy: 93.2669000807972% Epoch 7/50 - Loss: 0.1237322992857223 - Accuracy: 95.37991266375546% Validation - Loss: 0.16562100826042078 - Accuracy: 93.7516832749798% Epoch 8/50 - Loss: 0.10665657187749596 - Accuracy: 96.33187772925764% Validation - Loss: 0.18247238485135062 - Accuracy: 93.94021007271748% Epoch 9/50 - Loss: 0.09652395501349761 - Accuracy: 96.42794759825327% Validation - Loss: 0.16856147423144718 - Accuracy: 94.07487207110154% Epoch 10/50 - Loss: 0.09461829145328407 - Accuracy: 96.61135371179039% Validation - Loss: 0.16461577974075145 - Accuracy: 95.25989765688122% Epoch 11/50 - Loss: 0.08674301526069579 - Accuracy: 97.04803493449782% Validation - Loss: 0.23142057441413655 - Accuracy: 92.13573929437113% Epoch 12/50 - Loss: 0.07901567957762697 - Accuracy: 97.31877729257641% Validation - Loss: 0.16474162553164956 - Accuracy: 94.04793967142473% Epoch 13/50 - Loss: 0.07649627330126182 - Accuracy: 97.22270742358079% Validation - Loss: 0.13734501857985465 - Accuracy: 95.01750605978992% Epoch 14/50 - Loss: 0.07466959768767058 - Accuracy: 97.30131004366812% Validation - Loss: 0.1782972940006828 - Accuracy: 95.01750605978992% Epoch 15/50 - Loss: 0.07744909493295234 - Accuracy: 97.43231441048034% Validation - Loss: 0.16220979324520274 - Accuracy: 94.85591166172907% Epoch 16/50 - Loss: 0.06598834054277593 - Accuracy: 97.67685589519651% Validation - Loss: 0.20910257923739758 - Accuracy: 94.80204686237543% Epoch 17/50 - Loss: 0.0631268548967145 - Accuracy: 97.7467248908297% Validation - Loss: 0.23347401651130603 - Accuracy: 92.67438728790735% Epoch 18/50 - Loss: 0.06555010120751201 - Accuracy: 97.6593886462882% Validation - Loss: 0.14539578607162168 - Accuracy: 94.82897926205224% Epoch 19/50 - Loss: 0.059845885576344716 - Accuracy: 97.89519650655022% Validation - Loss: 0.16041203396160358 - Accuracy: 95.47535685429571% Epoch 20/50 - Loss: 0.05594490132637338 - Accuracy: 98.00873362445415% Validation - Loss: 0.1859909418073898 - Accuracy: 94.6943172636682% Epoch 21/50 - Loss: 0.05607218733795544 - Accuracy: 98.0% Validation - Loss: 0.18075589669533954 - Accuracy: 94.80204686237543% Epoch 22/50 - Loss: 0.053907548648485876 - Accuracy: 98.16593886462883% Validation - Loss: 0.16545909134583342 - Accuracy: 95.31376245623485% Epoch 23/50 - Loss: 0.0470346647800306 - Accuracy: 98.20087336244542% Validation - Loss: 0.20778126434300542 - Accuracy: 94.80204686237543% Epoch 24/50 - Loss: 0.049574521635580994 - Accuracy: 98.07860262008734% Validation - Loss: 0.1564015623499023 - Accuracy: 95.52922165364934% Epoch 25/50 - Loss: 0.04179995841685765 - Accuracy: 98.44541484716157% Validation - Loss: 0.16747620166950647 - Accuracy: 95.87934284944788% Epoch 26/50 - Loss: 0.057450394027208904 - Accuracy: 98.02620087336244% Validation - Loss: 0.17789020401386252 - Accuracy: 95.42149205494209% Epoch 27/50 - Loss: 0.04669765595903117 - Accuracy: 98.37554585152839% Validation - Loss: 0.13639129634924652 - Accuracy: 95.50228925397253% Epoch 28/50 - Loss: 0.04844437915596128 - Accuracy: 98.24454148471615% Validation - Loss: 0.18360183318857715 - Accuracy: 95.71774845138702% Epoch 29/50 - Loss: 0.04143963105984792 - Accuracy: 98.47161572052401% Validation - Loss: 0.20800431887982251 - Accuracy: 94.85591166172907% Epoch 30/50 - Loss: 0.041857603174143575 - Accuracy: 98.46288209606988% Validation - Loss: 0.17584734748835648 - Accuracy: 95.50228925397253% Epoch 31/50 - Loss: 0.03474195322907903 - Accuracy: 98.62882096069869% Validation - Loss: 0.18661053382497014 - Accuracy: 95.01750605978992% Epoch 32/50 - Loss: 0.04250668472811499 - Accuracy: 98.35807860262008% Validation - Loss: 0.18554277706394653 - Accuracy: 95.1791004578508% Epoch 33/50 - Loss: 0.06541120282187302 - Accuracy: 97.76419213973799% Validation - Loss: 0.26579954834157893 - Accuracy: 93.48235927821169% Epoch 34/50 - Loss: 0.04426630861981929 - Accuracy: 98.36681222707423% Validation - Loss: 0.21441175401304033 - Accuracy: 95.42149205494209% Epoch 35/50 - Loss: 0.028175492812085125 - Accuracy: 98.91703056768559% Validation - Loss: 0.2022299800695501 - Accuracy: 94.99057366011311% Epoch 36/50 - Loss: 0.03601222772712842 - Accuracy: 98.62882096069869% Validation - Loss: 0.16125017245418552 - Accuracy: 95.6908160517102% Epoch 37/50 - Loss: 0.03346441090231524 - Accuracy: 98.76855895196506% Validation - Loss: 0.1846331839053582 - Accuracy: 95.47535685429571% Epoch 38/50 - Loss: 0.04371237936143519 - Accuracy: 98.52401746724891% Validation - Loss: 0.19558387678959094 - Accuracy: 95.71774845138702% Epoch 39/50 - Loss: 0.030030558195032336 - Accuracy: 98.82096069868996% Validation - Loss: 0.1712810149240384 - Accuracy: 95.71774845138702% Epoch 40/50 - Loss: 0.03408633007866076 - Accuracy: 98.71615720524018% Validation - Loss: 0.16651659916882647 - Accuracy: 96.17559924589281% Epoch 41/50 - Loss: 0.05832681692387858 - Accuracy: 98.11353711790393% Validation - Loss: 0.1940097768461991 - Accuracy: 94.85591166172907% Epoch 42/50 - Loss: 0.03644430886454975 - Accuracy: 98.66375545851528% Validation - Loss: 0.16284053362546483 - Accuracy: 95.42149205494209% Epoch 43/50 - Loss: 0.02775010324127412 - Accuracy: 98.8471615720524% Validation - Loss: 0.21003097014535518 - Accuracy: 95.9062752491247% Epoch 44/50 - Loss: 0.02983980184835317 - Accuracy: 98.93449781659389% Validation - Loss: 0.25863636508398546 - Accuracy: 95.04443845946673% Epoch 45/50 - Loss: 0.029176325753753937 - Accuracy: 98.87336244541484% Validation - Loss: 0.20173561535529325 - Accuracy: 95.39455965526528% Epoch 46/50 - Loss: 0.036389959756238495 - Accuracy: 98.646288209607% Validation - Loss: 0.18621138047269314 - Accuracy: 95.87934284944788% Epoch 47/50 - Loss: 0.030779930890910984 - Accuracy: 98.85589519650655% Validation - Loss: 0.1914231225390675 - Accuracy: 95.77161325074064% Epoch 48/50 - Loss: 0.030747590330883614 - Accuracy: 98.87336244541484% Validation - Loss: 0.17265122002989186 - Accuracy: 95.96014004847832% Epoch 49/50 - Loss: 0.032022547733197564 - Accuracy: 98.77729257641921% Validation - Loss: 0.2257735441972219 - Accuracy: 95.9062752491247% Epoch 50/50 - Loss: 0.051979961867302804 - Accuracy: 98.35807860262008% Validation - Loss: 0.19219638606686065 - Accuracy: 95.36762725558847%
Test Accuracy: 95.50% True Positives: 2362 True Negatives: 1184 False Positives: 76 False Negatives: 91 Recall: 0.96 Precision: 0.97 F1 Score: 0.97
가변변수 : 학습률 lr = 0.001 / batch size : 16
학습률 0.001→(0.0005~0.0015 까지 변동) / 배치사이즈 8~32
Epoch27에서 Validation - Loss: 0.13639129634924652 - Accuracy: 95.50228925397253%
Loss 최소화
Epoch40에서 Validation - Loss: 0.16651659916882647 - Accuracy: 96.17559924589281%
Accuracy 최대화
2회차
Epoch 1/50 - Loss: 0.6374655251479682 - Accuracy: 65.4585152838428% Validation - Loss: 0.6089157151306136 - Accuracy: 66.06517640721788% Epoch 2/50 - Loss: 0.6104997010620613 - Accuracy: 66.82969432314411% Validation - Loss: 0.6375511520154487 - Accuracy: 66.28063560463237% Epoch 3/50 - Loss: 0.5883422911000651 - Accuracy: 68.37554585152839% Validation - Loss: 0.6032145276561763 - Accuracy: 72.28656073256127% Epoch 4/50 - Loss: 0.5030790554702947 - Accuracy: 75.66812227074236% Validation - Loss: 0.49059116343324083 - Accuracy: 78.48101265822785% Validation - Loss: 0.4007307684644577 - Accuracy: 82.84406140587126% Epoch 6/50 - Loss: 0.2967591914738523 - Accuracy: 88.20960698689956% Validation - Loss: 0.24634872003190636 - Accuracy: 90.25047131699435% Epoch 7/50 - Loss: 0.22121516016296336 - Accuracy: 91.32751091703057% Validation - Loss: 0.2692206932667467 - Accuracy: 90.33126851602478% Epoch 8/50 - Loss: 0.1774287813014023 - Accuracy: 93.20524017467248% Validation - Loss: 0.25134529862856253 - Accuracy: 91.78561809857258% Epoch 9/50 - Loss: 0.15533368403219497 - Accuracy: 94.19213973799127% Validation - Loss: 0.19808103727032392 - Accuracy: 92.94371128467546% Epoch 10/50 - Loss: 0.14022522799829384 - Accuracy: 94.8646288209607% Validation - Loss: 0.1785024829128784 - Accuracy: 93.61702127659575% Epoch 11/50 - Loss: 0.11876230336096158 - Accuracy: 95.57205240174673% Validation - Loss: 0.17760257571759533 - Accuracy: 94.31726366819284% Epoch 12/50 - Loss: 0.11255150806911904 - Accuracy: 95.89519650655022% Validation - Loss: 0.19679401048765982 - Accuracy: 92.97064368435228% Epoch 13/50 - Loss: 0.10906023864683763 - Accuracy: 96.38427947598254% Validation - Loss: 0.18057883002811922 - Accuracy: 94.23646646916241% Epoch 14/50 - Loss: 0.09391327219083255 - Accuracy: 96.49781659388647% Validation - Loss: 0.17777163004062407 - Accuracy: 94.23646646916241% Epoch 15/50 - Loss: 0.09343335340768567 - Accuracy: 96.87336244541484% Validation - Loss: 0.18401163442905086 - Accuracy: 94.4519256665769% Epoch 16/50 - Loss: 0.08242809773271893 - Accuracy: 97.10917030567686% Validation - Loss: 0.15741297614989844 - Accuracy: 95.09830325882037% Epoch 17/50 - Loss: 0.07917675327372414 - Accuracy: 97.31004366812228% Validation - Loss: 0.24296570544914256 - Accuracy: 93.07837328305952% Epoch 18/50 - Loss: 0.075202678994753 - Accuracy: 97.46724890829694% Validation - Loss: 0.21809350874820682 - Accuracy: 93.23996768112039% Epoch 19/50 - Loss: 0.0782263199164657 - Accuracy: 97.32751091703057% Validation - Loss: 0.15781629191428204 - Accuracy: 95.42149205494209% Epoch 20/50 - Loss: 0.06664176774186839 - Accuracy: 97.50218340611353% Validation - Loss: 0.17339552751698165 - Accuracy: 94.90977646108269% Epoch 21/50 - Loss: 0.07003335272499839 - Accuracy: 97.60698689956332% Validation - Loss: 0.1459663668664076 - Accuracy: 95.61001885267977% Epoch 22/50 - Loss: 0.056589838393522274 - Accuracy: 98.0524017467249% Validation - Loss: 0.1703211957696763 - Accuracy: 95.42149205494209% Epoch 23/50 - Loss: 0.07348731968591872 - Accuracy: 97.53711790393012% Validation - Loss: 0.17566500985856287 - Accuracy: 94.88284406140588% Epoch 24/50 - Loss: 0.057779731823340535 - Accuracy: 97.87772925764192% Validation - Loss: 0.17910494189487955 - Accuracy: 95.34069485591166% Epoch 25/50 - Loss: 0.05102776479256969 - Accuracy: 98.20087336244542% Validation - Loss: 0.2027335888596442 - Accuracy: 94.23646646916241% Epoch 26/50 - Loss: 0.056748868372468876 - Accuracy: 97.82532751091703% Validation - Loss: 0.1767430979726268 - Accuracy: 95.36762725558847% Epoch 27/50 - Loss: 0.05940716062976807 - Accuracy: 97.86899563318778% Validation - Loss: 0.18336149054548836 - Accuracy: 94.85591166172907% Epoch 28/50 - Loss: 0.044361167377719134 - Accuracy: 98.32314410480349% Validation - Loss: 0.17678624691080108 - Accuracy: 95.47535685429571% Epoch 29/50 - Loss: 0.05044873635017221 - Accuracy: 98.08733624454149% Validation - Loss: 0.16793122357903578 - Accuracy: 95.66388365203339% Epoch 30/50 - Loss: 0.05108720323993142 - Accuracy: 98.20087336244542% Validation - Loss: 0.17699416872587492 - Accuracy: 95.01750605978992% Epoch 31/50 - Loss: 0.05211298361380146 - Accuracy: 98.02620087336244% Validation - Loss: 0.20881809475728566 - Accuracy: 95.52922165364934% Epoch 32/50 - Loss: 0.05415598442682469 - Accuracy: 98.15720524017468% Validation - Loss: 0.19552493849213604 - Accuracy: 94.18260166980878%% Validation - Loss: 0.1879186201899025 - Accuracy: 95.9062752491247% Epoch 34/50 - Loss: 0.04182143150268652 - Accuracy: 98.46288209606988% Validation - Loss: 0.18229082060701973 - Accuracy: 95.42149205494209% Epoch 35/50 - Loss: 0.03837175755229484 - Accuracy: 98.66375545851528% Validation - Loss: 0.19106595558050998 - Accuracy: 95.87934284944788% Epoch 36/50 - Loss: 0.047611393852962744 - Accuracy: 98.17467248908297% Validation - Loss: 0.19295416953250558 - Accuracy: 95.34069485591166% Epoch 37/50 - Loss: 0.045657686266934956 - Accuracy: 98.37554585152839% Validation - Loss: 0.2049356814742586 - Accuracy: 95.04443845946673% Epoch 38/50 - Loss: 0.03785175835036064 - Accuracy: 98.62882096069869% Validation - Loss: 0.16413542011082144 - Accuracy: 96.47185564233773% Epoch 39/50 - Loss: 0.039307622751379584 - Accuracy: 98.39301310043668% Validation - Loss: 0.18903851686918927 - Accuracy: 95.1791004578508% Epoch 40/50 - Loss: 0.043503422272399866 - Accuracy: 98.52401746724891% Validation - Loss: 0.21076091286311144 - Accuracy: 95.55615405332615% Epoch 41/50 - Loss: 0.03957407312714548 - Accuracy: 98.55021834061135% Validation - Loss: 0.17504435820749448 - Accuracy: 95.58308645300296% Epoch 42/50 - Loss: 0.03617630868605847 - Accuracy: 98.78602620087337% Validation - Loss: 0.16026781386293787 - Accuracy: 96.09480204686237% Epoch 43/50 - Loss: 0.03529346647518544 - Accuracy: 98.63755458515284% Validation - Loss: 0.19684494405822872 - Accuracy: 95.6908160517102% Epoch 44/50 - Loss: 0.04115273041106623 - Accuracy: 98.60262008733625% Validation - Loss: 0.20179263993075255 - Accuracy: 95.82547805009426% Epoch 45/50 - Loss: 0.03639087620302123 - Accuracy: 98.65502183406113% Validation - Loss: 0.16575164101778536 - Accuracy: 96.41799084298411% Epoch 46/50 - Loss: 0.03130802676288474 - Accuracy: 98.75109170305677% Validation - Loss: 0.18754117433931314 - Accuracy: 95.71774845138702% Epoch 47/50 - Loss: 0.032002409119756305 - Accuracy: 98.85589519650655% Validation - Loss: 0.19749215803039646 - Accuracy: 96.04093724750875% Epoch 48/50 - Loss: 0.03648554221495058 - Accuracy: 98.60262008733625% Validation - Loss: 0.18204397347574383 - Accuracy: 95.96014004847832% Epoch 49/50 - Loss: 0.03131737612667628 - Accuracy: 98.8471615720524% Validation - Loss: 0.2103282531669574 - Accuracy: 95.63695125235658% Epoch 50/50 - Loss: 0.0469573224636914 - Accuracy: 98.44541484716157% Validation - Loss: 0.17800881498925492 - Accuracy: 96.25639644492324% Test Accuracy: 96.63% True Positives: 2382 True Negatives: 1206 False Positives: 54 False Negatives: 71 Recall: 0.97 Precision: 0.98 F1 Score: 0.97
Epoch 21/50 Validation - Loss: 0.1459663668664076 - Accuracy: 95.61001885267977%
학습률 lr:0.0015 배치크기 : 16