I have my faith on a combination between Deep Learning and Gaussian Processses. Deep Learning is great but it can be also improved by integrating model uncertainty (i.e. it will know when it works well and when it does not by doing so).
A combination of deep learning and Gaussian Processes for regression is somewhat straightforward (well it is not that straightforward at all, but at least there are some code for it). But meanwhile it is not easy to find a code that works well for classification.
I found this peace of code useful, and plan to use it as a basic block to do my research in future. https://gist.github.com/john-bradshaw/11bbf17dbca013d9fc3886a7bfe46840
Note: It should run with TF 1.4, GPflow git commit f618fe4d9aa096b32a3d24576d68f46a3f260116
Baseline: 512-17-output Epoch: 46 Valid: F1-BAD: 0.478405315615 F1-OK: 0.897335295079 F1-score multiplied: 0.429289975055 Test: F1-BAD: 0.455080105455 F1-OK: 0.889682637435 F1-score multiplied: 0.404876868466
RBF:
Epoch 43: \Dev set LL -1.0475469365930898, Acc 0.8370441198348999, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481529769665 F1-OK: 0.903330362207 F1-score multiplied: 0.434980461245 Epoch 43: Test set LL -1.138587147827296, Acc 0.8229991793632507, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442820292347 F1-OK: 0.894788114954 F1-score multiplied: 0.396230334653
Matern52:
Epoch 38: \Dev set LL -1.025865894273344, Acc 0.8407321572303772, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480854853072 F1-OK: 0.905937399161 F1-score multiplied: 0.435624394966 Epoch 38: Test set LL -1.1147749525122255, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441449403447 F1-OK: 0.897908084969 F1-score multiplied: 0.39638098846 [202294 186901 196985 ..., 16384 150178 216051]
Matern32: Epoch 29: \Dev set LL -0.9932644037945643, Acc 0.8442835807800293, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482288828338 F1-OK: 0.908360128617 F1-score multiplied: 0.43809194214 Epoch 29: Test set LL -1.085620656306074, Acc 0.8301010727882385, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443649373882 F1-OK: 0.89974210187 F1-score multiplied: 0.39917002015
Matern12:
Epoch 44: \Dev set LL -1.0138522804283852, Acc 0.838546633720398, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.486086956522 F1-OK: 0.904229460379 F1-score multiplied: 0.439534146393 Epoch 44: Test set LL -1.088824646373591, Acc 0.8275061249732971, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45419187554 F1-OK: 0.897566909976 F1-score multiplied: 0.407667598265
Baseline: 512-256-17-output
Baseline: - with keras Epoch: 21 Valid: F1-BAD: 0.490836653386 F1-OK: 0.894658753709 F1-score multiplied: 0.439131308594 Test: F1-BAD: 0.459352801894 F1-OK: 0.886870355078 F1-score multiplied: 0.407386382522
Baseline - with my tensorflow: epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.469244288225 F1-OK: 0.902312793142 F1-score multiplied: 0.423405124374 Result from the previous epoch on test: F1-BAD: 0.450201741346 F1-OK: 0.894666178445 F1-score multiplied: 0.40278027146 [ 95272 217111 176486 ..., 183877 161754 214087] epoch:
Gaussian Processes
Epoch 49: \Dev set LL -0.8574439718192862, Acc 0.8352683782577515, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397602397602 F1-OK: 0.904588607595 F1-score multiplied: 0.359666599224 Epoch 49: Test set LL -0.9088562727056888, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373023715415 F1-OK: 0.899445324881 F1-score multiplied: 0.3355144369
Matern12:
Epoch 38: \Dev set LL -1.031681831273476, Acc 0.8375905156135559, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.489918489918 F1-OK: 0.903419705954 F1-score multiplied: 0.442602018104 Epoch 38: Test set LL -1.0955293990816295, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45861774744 F1-OK: 0.896829268293 F1-score multiplied: 0.411301818863
Matern12 with pre-training:
Epoch 7: \Dev set LL -0.9269897989714446, Acc 0.8373172879219055, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.493407060825 F1-OK: 0.903099829143 F1-score multiplied: 0.445595832329 Epoch 7: Test set LL -1.0031441810312096, Acc 0.8231357336044312, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461090303787 F1-OK: 0.894207989543 F1-score multiplied: 0.412310633547 [ 44555 140306 112838 ..., 74919 150399 165017]
RBF:
Epoch 43: \Dev set LL -1.0397760432170096, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466574458276 F1-OK: 0.907239637617 F1-score multiplied: 0.423294842448 Epoch 43: Test set LL -1.0891987405798425, Acc 0.8307839632034302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441891891892 F1-OK: 0.900273663876 F1-score multiplied: 0.397823632551 [ 86065 158811 87623 ..., 10358 112387 134839]
RBF with pre-training:
Epoch 11: \Dev set LL -1.0214825326985937, Acc 0.8356781601905823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.486993603412 F1-OK: 0.902171261283 F1-score multiplied: 0.439351633427 Epoch 11: Test set LL -1.0950924530623292, Acc 0.8225211501121521, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458428839342 F1-OK: 0.893870717465 F1-score multiplied: 0.409776115529 [ 78595 203579 77628 ..., 171197 169790 184869]
Baseline: 512-256-128-17-output
Epoch: 12 Valid: F1-BAD: 0.491790148178 F1-OK: 0.895512556608 F1-score multiplied: 0.440404252909 Test: F1-BAD: 0.464313421257 F1-OK: 0.885546162771 F1-score multiplied: 0.411170968517
larger-scale with 144 features
baseline: Epoch: 15 Valid: F1-BAD: 0.502758077226 F1-OK: 0.895736946464 F1-score multiplied: 0.450338984905 Test: F1-BAD: 0.489992301771 F1-OK: 0.890004980907 F1-score multiplied: 0.436095589182
RBF: Epoch 40: \Dev set LL -0.9904265657295217, Acc 0.8485179543495178, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.501573033708 F1-OK: 0.910686961424 F1-score multiplied: 0.456776022 Epoch 40: Test set LL -1.0630065542831817, Acc 0.8377492427825928, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.470588235294 F1-OK: 0.904193548387 F1-score multiplied: 0.4255028463
Matern12: (more detailed) https://drive.google.com/file/d/1e95Au14DdZ2WSTMi_I6gpt-ap7vuNIs6/view?usp=sharing
Epoch 23: \Dev set LL -1.0098853155593643, Acc 0.8431908488273621, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.487042001787 F1-OK: 0.907449209932 F1-score multiplied: 0.441965879726 Epoch 23: Test set LL -1.067731174472187, Acc 0.8333788514137268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.470256187581 F1-OK: 0.90114253302 F1-score multiplied: 0.423767852045
now I run the code for tensorflow 512-256-17-1 baseline: 6 [211235 108099 35584 ..., 173533 203627 154044] Result from the previous epoch on dev: F1-BAD: 0.499796830557 F1-OK: 0.898940973647 F1-score multiplied: 0.449287849487 Result from the previous epoch on test: F1-BAD: 0.485190409027 F1-OK: 0.894964028777 F1-score multiplied: 0.434227963187
RBF:
Epoch 39: \Dev set LL -1.0627435747788827, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.497478991597 F1-OK: 0.902462893492 F1-score multiplied: 0.448956330208 Epoch 39: Test set LL -1.1335080609318582, Acc 0.8257306814193726, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.468333333333 F1-OK: 0.895785690951 F1-score multiplied: 0.419526298595
matern12: Epoch 17: \Dev set LL -0.9767212579140047, Acc 0.8451031446456909, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.495102404274 F1-OK: 0.908518877057 F1-score multiplied: 0.44980988036 Epoch 17: Test set LL -1.022837668817143, Acc 0.8361786603927612, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.471702268223 F1-OK: 0.903058956641 F1-score multiplied: 0.425974958187 [151463 159307 100073 ..., 99926 64887 45399]
now I run the code for tensorflow 512-256-17-1 baseline: 10 Result from the previous epoch on dev: F1-BAD: 0.515399610136 F1-OK: 0.897077088681 F1-score multiplied: 0.462353181769 Result from the previous epoch on test: F1-BAD: 0.494732735076 F1-OK: 0.892806886847 F1-score multiplied: 0.441700793025 [ 79978 62975 104982 ..., 106252 110351 75418]
and I used the results from the baseline as pre-training
Matern12 Epoch 7: \Dev set LL -0.9495129103340999, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.512077294686 F1-OK: 0.900312551406 F1-score multiplied: 0.461029615696 Epoch 7: Test set LL -0.9774145143733359, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.494804156675 F1-OK: 0.895898534014 F1-score multiplied: 0.443294318589 [ 44555 140306 112838 ..., 74919 150399 165017]
RBF Epoch 2: \Dev set LL -0.7937541243405875, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.508828250401 F1-OK: 0.899259259259 F1-score multiplied: 0.457568515546 Epoch 2: Test set LL -0.8319089715712372, Acc 0.8263452649116516, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.490686961746 F1-OK: 0.895328256843 F1-score multiplied: 0.439325902116
Matern52:
Epoch 3: \Dev set LL -0.8526977758464622, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.502256873205 F1-OK: 0.900614502253 F1-score multiplied: 0.452339823865 Epoch 3: Test set LL -0.8996582731967095, Acc 0.8266184329986572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.483207815998 F1-OK: 0.895835897436 F1-score multiplied: 0.432874907493 [ 97998 95754 98742 ..., 203012 213193 125451]
Matern32:
Epoch 3: \Dev set LL -0.8293870780170994, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.5 F1-OK: 0.900605862125 F1-score multiplied: 0.450302931063 Epoch 3: Test set LL -0.8693412485538202, Acc 0.8281890153884888, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.486320947325 F1-OK: 0.89684296843 F1-score multiplied: 0.436153522009
deeper network: 512-256-128-17-output
baseline - epoch 6:
Result from the previous epoch on dev: F1-BAD: 0.498638661999 F1-OK: 0.893215143733 F1-score multiplied: 0.445391604148 Result from the previous epoch on test: F1-BAD: 0.484056857472 F1-OK: 0.888464413255 F1-score multiplied: 0.430067291856 [211235 108099 35584 ..., 173533 203627 154044]
Matern12
Epoch 4: \Dev set LL -0.9304697710619161, Acc 0.8232482075691223, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.503834355828 F1-OK: 0.892471331228 F1-score multiplied: 0.449657718265 Epoch 4: Test set LL -0.9586520539179797, Acc 0.8188336491584778, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.492831198624 F1-OK: 0.889720247745 F1-score multiplied: 0.438481896136 [ 82707 140148 157986 ..., 51883 106201 103473]
216 features: train with pre-training
network: 512-256-17-output baseline: epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.501399440224 F1-OK: 0.897290173791 F1-score multiplied: 0.449900790857 Result from the previous epoch on test: F1-BAD: 0.484513710791 F1-OK: 0.892109500805 F1-score multiplied: 0.432239284667 [ 82707 140148 157986 ..., 51883 106201 103473]
Our - Matern12 Epoch 7: \Dev set LL -0.9919056734849215, Acc 0.8246141076087952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.512528473804 F1-OK: 0.893071285809 F1-score multiplied: 0.457724463114 Epoch 7: Test set LL -1.0410420331300183, Acc 0.8158972859382629, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.489393939394 F1-OK: 0.887704098634 F1-score multiplied: 0.434437005847
RBF:
Epoch 13: \Dev set LL -0.9810681383297054, Acc 0.8430542349815369, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.504100129478 F1-OK: 0.90677484787 F1-score multiplied: 0.457105318219 Epoch 13: Test set LL -1.0474645150024602, Acc 0.8326959609985352, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.478501489996 F1-OK: 0.90036600244 F1-score multiplied: 0.430826473709
Matern12 without pre-training
Epoch 19: \Dev set LL -1.013438401281861, Acc 0.8397759795188904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479360852197 F1-OK: 0.905319234805 F1-score multiplied: 0.433974599907 Epoch 19: Test set LL -1.0505727824796036, Acc 0.8345397710800171, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.466181978409 F1-OK: 0.902097054426 F1-score multiplied: 0.42054138955 [ 873 43953 181616 ..., 181234 7816 90895]
RBF without pre-training
Epoch 20: \Dev set LL -1.0611289695849617, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.490977759127 F1-OK: 0.901052288115 F1-score multiplied: 0.442396633275 Epoch 20: Test set LL -1.141914249989954, Acc 0.821906566619873, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460264900662 F1-OK: 0.893359502781 F1-score multiplied: 0.411182022803 [139636 198046 199708 ..., 32597 183833 57999]
=--------------------------------------------------------- Results with English-to-German Baseline:72-512-256-17-1 maximum 30 iterations
29 Result from the previous epoch on dev: F1-BAD: 0.530168716042 F1-OK: 0.702732042699 F1-score multiplied: 0.3725665448 Result from the previous epoch on test: F1-BAD: 0.518600601551 F1-OK: 0.699891443797 F1-score multiplied: 0.362964123774 Result from the previous epoch on test: F1-BAD: 0.50467159392 F1-OK: 0.680259249257 F1-score multiplied: 0.343307519602 [236416 34551 51158 ..., 242429 27062 62833] Done!
Matern12 with pre-train:
Epoch 49: \Dev set LL -2.304943293720357, Acc 0.6436170339584351, Outputs [1 0 0 ..., 0 1 1] Result from the previous epoch on dev: F1-BAD: 0.530373831776 F1-OK: 0.712857142857 F1-score multiplied: 0.378080774366 Epoch 49: Test set LL -2.3342309966711405, Acc 0.636231005191803, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.517574975814 F1-OK: 0.708040593286 F1-score multiplied: 0.366464092946 Epoch 49: Test set LL -2.432163270645982, Acc 0.6236870884895325, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.503643841547 F1-OK: 0.696973701599 F1-score multiplied: 0.351026512531 [170550 153814 80248 ..., 180904 272190 220843]
RBF with pre-train:
[128949 262150 113820 ..., 94096 261192 78313] Epoch 33: \Dev set LL -2.3081468257326656, Acc 0.6423980593681335, Outputs [1 0 0 ..., 0 1 1] Result from the previous epoch on dev: F1-BAD: 0.51929092805 F1-OK: 0.715306572563 F1-score multiplied: 0.371452213906 Epoch 33: Test set LL -2.3571965879883665, Acc 0.634650468826294, Outputs [1 1 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.506406044678 F1-OK: 0.709998069871 F1-score multiplied: 0.359547314292 Epoch 33: Test set LL -2.4491446479420333, Acc 0.6204594969749451, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.491125128356 F1-OK: 0.697374160342 F1-score multiplied: 0.34249797401 [215935 137192 311492 ..., 304011 32029 253544]
Matern32 with pre-train Epoch 49: \Dev set LL -2.390197871213981, Acc 0.6337544322013855, Outputs [1 0 0 ..., 0 1 0] Result from the previous epoch on dev: F1-BAD: 0.536400617197 F1-OK: 0.697316604085 F1-score multiplied: 0.374041056813 Epoch 49: Test set LL -2.4537811196708676, Acc 0.6229179501533508, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.522736016004 F1-OK: 0.688338441441 F1-score multiplied: 0.359819294541 Epoch 49: Test set LL -2.5909655766607576, Acc 0.6041028499603271, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.50141233207 F1-OK: 0.671716942617 F1-score multiplied: 0.336807158689 [170550 153814 80248 ..., 180904 272190 220843] Done!
Matern32 without pre-train
Epoch 27: \Dev set LL -2.41257187262274, Acc 0.6289893388748169, Outputs [1 0 0 ..., 0 1 0] Result from the previous epoch on dev: F1-BAD: 0.51882724921 F1-OK: 0.698106402164 F1-score multiplied: 0.36219662429 Epoch 27: Test set LL -2.4734187258226923, Acc 0.6200000047683716, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.507601417881 F1-OK: 0.690621133383 F1-score multiplied: 0.350560266524 Epoch 27: Test set LL -2.536608869289372, Acc 0.6087527275085449, Outputs [0 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.501185660483 F1-OK: 0.678156781568 F1-score multiplied: 0.339882454481 [125917 94384 282921 ..., 287261 206878 288006]
Matern52 without pre-train Epoch 11: \Dev set LL -2.414924391611122, Acc 0.6191267967224121, Outputs [1 0 0 ..., 0 1 0] Result from the previous epoch on dev: F1-BAD: 0.508929847121 F1-OK: 0.688931124989 F1-score multiplied: 0.350617612117 Epoch 11: Test set LL -2.4710455014376866, Acc 0.6121580600738525, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.497162673392 F1-OK: 0.684345933109 F1-score multiplied: 0.34023125363 Epoch 11: Test set LL -2.57481057104963, Acc 0.5980306267738342, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.493520816101 F1-OK: 0.666787592962 F1-score multiplied: 0.329073557045 [236944 67973 205470 ..., 168422 308493 212732]
RBF without pre-train
Epoch 33: \Dev set LL -2.585161781631039, Acc 0.6068262457847595, Outputs [1 0 0 ..., 0 1 0] Result from the previous epoch on dev: F1-BAD: 0.528567632208 F1-OK: 0.662801748717 F1-score multiplied: 0.350335550943 Epoch 33: Test set LL -2.664540284145497, Acc 0.5942857265472412, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.514335613448 F1-OK: 0.651633782232 F1-score multiplied: 0.335158461128 Epoch 33: Test set LL -2.7623289783155762, Acc 0.5807986855506897, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.503530936184 F1-OK: 0.63725443787 F1-score multiplied: 0.320877323688
Matern12 without pre-train Epoch 33: \Dev set LL -2.51836834805866, Acc 0.610704779624939, Outputs [1 0 0 ..., 0 1 0] Result from the previous epoch on dev: F1-BAD: 0.523273171394 F1-OK: 0.671036613915 F1-score multiplied: 0.351135457085 Epoch 33: Test set LL -2.571270450345819, Acc 0.603161096572876, Outputs [1 0 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.518938835667 F1-OK: 0.662286601138 F1-score multiplied: 0.343686237672 Epoch 33: Test set LL -2.695880803336656, Acc 0.5867067575454712, Outputs [0 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.502010414607 F1-OK: 0.646781055683 F1-score multiplied: 0.324690825923 [215935 137192 311492 ..., 304011 32029 253544]
Here is the result with a better resampling method
Baseline (as the above):
epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.4988336623 F1-OK: 0.776112224449 F1-score multiplied: 0.387150903278 Result from the previous epoch on test: F1-BAD: 0.493337281611 F1-OK: 0.774561904344 F1-score multiplied: 0.382120264328 Result from the previous epoch on test: F1-BAD: 0.475737734326 F1-OK: 0.769981504073 F1-score multiplied: 0.366309256221 [ 43379 199156 245551 ..., 193210 207728 258779]
Matern12 with pretrain
Epoch 44: \Dev set LL -2.0058208174533307, Acc 0.6848404407501221, Outputs [1 0 0 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.509655172414 F1-OK: 0.767798824298 F1-score multiplied: 0.391312642177 Epoch 44: Test set LL -2.0204724763739503, Acc 0.6822492480278015, Outputs [1 1 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.501858381778 F1-OK: 0.76672468425 F1-score multiplied: 0.384787209307 Epoch 44: Test set LL -2.0975594509681383, Acc 0.6716630458831787, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.486920841169 F1-OK: 0.758587402462 F1-score multiplied: 0.369372016107 [ 8239 75951 18537 ..., 75920 112273 199137]
RBF with pretrain
Epoch 46: \Dev set LL -2.125521476360115, Acc 0.6727614998817444, Outputs [1 0 0 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.523786486051 F1-OK: 0.750738583608 F1-score multiplied: 0.39322672465 Epoch 46: Test set LL -2.1786543521156587, Acc 0.6633434891700745, Outputs [1 1 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.50851970181 F1-OK: 0.743990384615 F1-score multiplied: 0.378333768534 Epoch 46: Test set LL -2.225349368863511, Acc 0.6572757363319397, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.495287198904 F1-OK: 0.740547480018 F1-score multiplied: 0.366783687034
RBF without pre-train Epoch 44: \Dev set LL -2.10585268231703, Acc 0.675642728805542, Outputs [1 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.500767525158 F1-OK: 0.759786622897 F1-score multiplied: 0.380476466796 Epoch 44: Test set LL -2.138964521563216, Acc 0.6699696183204651, Outputs [1 1 0 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.48681349844 F1-OK: 0.756776130102 F1-score multiplied: 0.368408835431 Epoch 44: Test set LL -2.178761008595202, Acc 0.663238525390625, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.482776004033 F1-OK: 0.750344715711 F1-score multiplied: 0.362248423498 [ 8239 75951 18537 ..., 75920 112273 199137]
Matern12 without pre-train Epoch 41: \Dev set LL -2.0237285916763716, Acc 0.6868351101875305, Outputs [1 0 0 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.500706713781 F1-OK: 0.771876009041 F1-score multiplied: 0.386483499933 Epoch 41: Test set LL -2.0362838900515965, Acc 0.6817021369934082, Outputs [1 1 1 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.487671232877 F1-OK: 0.769135802469 F1-score multiplied: 0.37508540504 Epoch 41: Test set LL -2.0797453362915417, Acc 0.677625834941864, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.483206173814 F1-OK: 0.765751083198 F1-score multiplied: 0.370015651006 [ 25448 105319 255368 ..., 51909 188489 55076]
Matern32 without pre-training
Epoch 47: \Dev set LL -2.0401124842159915, Acc 0.6876108050346375, Outputs [1 0 0 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.490327246429 F1-OK: 0.774786290645 F1-score multiplied: 0.379898828463 Epoch 47: Test set LL -2.0587980699834336, Acc 0.6844376921653748, Outputs [1 1 1 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.48095190481 F1-OK: 0.773308878117 F1-score multiplied: 0.371924377936 Epoch 47: Test set LL -2.0945572769050247, Acc 0.6785557866096497, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.475169703466 F1-OK: 0.768333070494 F1-score multiplied: 0.365088597269 [ 59597 49440 42322 ..., 153440 186116 7463]
Matern52 without pre-training Epoch 42: \Dev set LL -2.070641107828316, Acc 0.6858377456665039, Outputs [1 0 0 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.497072911123 F1-OK: 0.771573604061 F1-score multiplied: 0.383528337516 Epoch 42: Test set LL -2.1084234953543355, Acc 0.6784802675247192, Outputs [1 1 1 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.47917282127 F1-OK: 0.767465377006 F1-score multiplied: 0.367748549927 Epoch 42: Test set LL -2.145120792928431, Acc 0.6743982434272766, Outputs [1 1 0 ..., 1 1 0] Result from the previous epoch on test: F1-BAD: 0.480446927374 F1-OK: 0.762906309751 F1-score multiplied: 0.366535992395 [221375 139101 249196 ..., 213715 137850 7294]
Sent - task 1 - prediction
baseline: 17-512-256-17-3 10 Result from the previous epoch on dev: 0.517142857143 Result from the previous epoch on test normal: 0.544444444444 Result from the previous epoch on test adaptation: 0.431524547804 epoch:
full batch is better than mini-batch size
0.54 0.524547803618 0.528571428571 [1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1] get at epoch: 20
Matern12 - with pre-training
0.537777777778 0.421188630491 0.528571428571 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 1
RBF - with pre-training 0.548888888889 0.335917312661 0.538095238095 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 0 1 0 1 0 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 0 1 0 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 0 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1] 3
RBF - without pre-training
0.544444444444 0.348837209302 0.519047619048 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 2
Matern12 - without pre-training
0.542222222222 0.354005167959 0.533333333333 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1]
Matern52 - without pre-training
0.671111111111 0.333333333333 0.542857142857 [1 1 0 1 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0 1 1 0 0 0 0 1 0 1 1 1 0 0 1 1 1 0 0 1 0 1 1 0 1 1 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 1 0 1 0 1 0 0 0 1 0 1 0 0 1 1 0 1 0 0 0 1 0 0 1 0 0 0 0 1 1 0 0 0 0 1 0 1 1 0 1 1 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 0 1 1 0 0 1 0 0 0 0 0 1 0 1 1 1 0 1 0 0 1 0 0 0 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 1 0 0 0 1 1 0 0 0 0 1 0 1 1 1 0 0 1 1 1 0 0 0 0 1 1 0 1 1 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 0 0 1 0 1 0 1 0 0 0 0 1 1 0 1 1 1 0 1 0 0 0 1 1 0 1 0 0 0 0 1 1 0 0 0 0 1 0 1 1 0 1 1 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 0 1 1 0 0 1 0 0 0 0 0 1 0 1 1 1 0 1 0 0 1 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 1 1 0 0 0 0 1 0 1 1 1 0 0 1 1 1 0 0 0 0 1 1 0 1 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 0 0 1 0 1 0 1 0 0 0 0 1 1 0 1 1 1 0 1 0 0 0 1 1 0 1 0 0 0 0 1 1 0 0 0 0 1 0 1 1 0 1 1 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 1 0 1 1 0 0 1 0 0 0 0 0 1 0 1] 6
Matern32 - without pretraining
0.544444444444 0.33850129199 0.538095238095 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 0
Matern52 - with pretraining
0.54 0.369509043928 0.533333333333 [1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 0 1 1 0 0 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 0 1 1 0 0 0 1 0 0 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 1 1 0 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1] 5
Matern32 - with pre-training
0.528888888889 0.410852713178 0.52380952381 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1] 4
small scale Gaussian Processes:
Matern52 0.708888888889 0.64857881137 0.680952380952 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 0 1 1 1 2 1 2 2 1 0 1 1 1 1 1 0 1 1 0 1 1 0 2 2 1 2 1 1 2 2 1 1 1 1 2 1 2 1 2 1 1 1 1 1 2 1 2 1 1 1 1 0 1 1 2 0 1 2 2 1 0 1 1 2 1 0 2 1 1 1 1 2 1 1 0 2 0 1 1 0 2 1 2 1 1 1 1 2 1 1 1 2 1 1 0 2 0 1 1 1 0 1 1 0 1 0 1 0 1 1 1 1 1 1 0 0 0 1 1 1 2 2 1 2 2 0 2 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 0 1 1 1 2 1 2 2 1 0 1 1 1 1 1 0 1 1 0 1 1 0 2 2 1 2 2 1 2 1 1 1 1 1 2 1 2 1 2 1 1 1 1 1 2 1 2 1 1 1 1 0 1 1 2 0 1 2 2 1 0 1 1 2 1 0 2 1 1 1 2 2 1 1 2 2 0 1 1 0 2 1 2 1 1 1 1 2 1 1 1 2 1 2 0 2 1 1 1 1 0 1 1 0 1 2 1 2 1 1 1 1 1 1 0 2 0 1 1 1 1 0 1 2 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 2 1 1 1 2 1 2 2 1 2 1 1 1 1 1 0 2 2 0 1 1 0 2 2 1 2 1 1 2 1 1 1 1 1 2 1 1 1 2 1 1 1 1 1 2 1 2 1 1 1 1 2 1 1 2 2 1 2 2 1 0 1 1 2 1 0 2 1 1 1 1 2 1 1 1 2 0 1 1 0 2 1 2 1 1 1 1 2 1 1 1 2 1 2 0 2 1 1 1 1 2 1 1 0 1 2 1 2 1 1 1 2 1 1 0 2 2 1 1 1 2 2 1 2 2 0 1 1 1 1 1 1] 0
Matern12
0.622222222222 0.537467700258 0.719047619048 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 0 1 0 2 1 2 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 2 1 1 1 1 0 1 1 0 2 1 1 0 1 0 1 1 1 1 0 2 1 1 1 1 2 1 1 1 1 2 1 1 0 2 1 1 1 1 1 1 2 1 1 1 0 1 1 0 0 1 1 1 1 0 1 1 0 1 2 1 1 1 1 1 1 1 1 0 0 0 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 2 1 1 1 0 1 0 0 1 2 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 2 1 1 1 1 2 1 1 1 2 1 1 2 1 1 1 1 1 1 2 2 1 1 1 1 2 1 1 1 1 2 1 1 0 2 1 1 1 1 1 1 2 1 1 1 0 1 1 0 0 1 1 1 1 2 1 1 0 1 1 1 1 1 1 1 1 1 1 0 2 0 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 2 1 1 1 0 1 2 1 1 2 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 2 1 1 1 2 1 1 2 1 1 1 1 1 1 2 2 1 1 1 1 2 1 1 1 1 2 1 1 0 2 1 1 1 1 1 1 2 1 1 1 2 1 1 0 2 1 1 1 1 2 1 1 0 1 1 1 1 1 1 1 1 1 1 1 2 2 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1] 4
Matern32
0.984444444444 0.617571059432 0.695238095238 [2 1 0 2 1 2 0 2 1 1 1 1 1 1 0 2 2 2 0 2 1 2 2 2 2 2 2 0 2 0 2 0 2 2 2 2 0 1 2 2 2 2 2 2 1 1 2 2 2 2 2 1 2 1 2 1 0 2 1 1 0 2 2 2 2 1 2 2 2 0 2 0 0 2 2 2 2 1 2 2 0 2 1 0 2 2 2 2 2 2 2 1 2 2 2 0 1 0 2 2 0 2 2 2 0 2 1 1 0 2 1 2 0 0 1 1 1 2 0 1 1 0 2 2 0 2 2 0 0 2 2 1 0 2 2 1 0 2 2 2 1 2 2 0 2 0 2 1 2 1 2 1 0 2 1 1 0 2 1 1 1 2 1 1 0 2 0 2 2 2 1 0 2 2 0 2 2 0 2 1 2 0 2 2 2 2 0 1 2 2 2 0 2 2 1 1 2 2 0 1 2 1 2 1 2 1 0 2 1 1 0 2 2 2 2 1 2 2 2 2 2 0 0 2 2 2 2 1 2 2 0 2 1 2 2 0 1 2 2 2 2 2 2 2 2 0 1 0 2 2 0 2 2 2 0 2 1 1 0 0 1 2 0 0 1 1 1 2 2 1 1 0 2 2 0 2 2 0 2 2 2 1 0 2 2 2 2 2 2 0 1 2 2 2 0 2 2 1 2 1 2 1 2 2 1 2 0 2 1 2 1 2 1 1 2 2 0 2 2 2 1 2 2 2 2 2 2 2 2 1 2 0 2 2 2 2 0 1 2 2 2 0 2 2 1 1 2 2 2 1 2 1 2 1 2 1 2 2 2 1 0 2 2 2 2 1 2 2 2 2 2 2 0 2 2 2 2 1 2 2 0 2 1 2 2 2 1 2 2 2 2 2 2 2 2 0 1 2 2 2 2 2 1 2 0 2 1 1 1 2 1 2 0 2 1 1 1 2 2 1 1 0 2 2 0 2 2 0 0 2 2 1 2 2 2 2 2 2 2 2 1 2 2 2 2 2 2 1 2 1] 7
RBF 0.808888888889 0.66149870801 0.614285714286 [0 0 0 1 1 0 1 0 1 1 0 1 0 0 0 2 0 0 2 0 2 2 2 0 2 2 0 2 2 0 0 0 0 0 0 0 2 0 0 0 2 0 0 2 1 0 0 2 2 0 0 1 0 1 2 1 0 1 0 1 0 2 0 2 2 0 2 2 0 2 0 0 0 0 0 0 2 1 0 2 0 2 1 2 2 2 0 2 2 2 1 1 0 2 0 2 2 0 2 2 0 0 0 1 1 2 1 1 2 2 1 0 0 0 1 0 1 2 0 0 1 2 0 2 0 0 2 0 0 0 0 1 0 0 2 0 0 1 0 0 1 0 0 0 2 0 2 1 0 1 0 2 0 1 1 0 1 2 1 1 1 2 0 0 0 2 0 0 2 0 2 0 2 0 2 2 2 0 0 1 0 0 0 0 0 0 2 0 0 0 2 0 0 2 1 0 0 2 0 0 2 1 0 1 1 1 2 1 0 1 0 0 2 0 2 1 2 2 0 2 0 0 0 0 0 0 0 1 0 2 0 2 1 2 2 2 0 2 2 0 0 0 0 0 2 2 2 0 0 1 0 0 0 1 1 2 1 1 2 2 1 0 0 0 1 0 1 2 0 0 1 2 0 0 0 0 0 0 0 0 0 1 0 2 2 0 0 1 0 0 1 0 0 0 0 0 2 1 0 1 2 2 0 1 1 0 1 0 1 2 1 2 0 0 0 2 0 2 2 0 2 0 2 0 2 2 2 0 0 1 0 0 2 0 0 2 2 0 2 0 0 0 0 2 1 0 0 1 0 0 0 1 2 1 2 1 0 2 0 1 0 0 2 0 2 1 2 2 2 2 0 0 0 0 0 0 0 1 0 2 0 0 1 2 2 0 0 2 2 2 2 2 0 0 0 2 2 0 0 2 2 0 0 1 1 2 1 1 2 2 0 2 0 0 1 2 1 2 2 0 1 2 0 0 0 0 0 0 0 2 2 1 0 2 0 0 0 1 2 0 2 2 2 0 0 0 2 1 1 1] 0
---89 features - pretty big
baseline - 89-512-256-17-3
0.542222222222 0.542222222222 0.485714285714 [1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1] 12
Matern12 - with pretraining 0.528888888889 0.528888888889 0.471428571429 [1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1] 6
RBF - with pretraining
0.542222222222 0.542222222222 0.490476190476 [1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 0 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1] 0
Matern52 - with pretraining
0.54 0.54 0.480952380952 [1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 1 1 1 0 0 0 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 1 1 0 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 0 0 1 1 1 1 1 0 1 1 1 1] 0
Matern32 - with pretraining
0.524444444444 0.524444444444 0.485714285714 [1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 0 0 1 1 0 1 1 1 1 0 0 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 0 0 1 1 1 0 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 0 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 0 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 0 1 1 1 1 1 1 1 1 0 1 1 0 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 0 1 1 1 1 1 1 0 1 1 1 1] 2
Matern32 - without pretraining
0.531111111111 0.531111111111 0.5 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 2
Matern52 - without pretraining
0.595555555556 0.595555555556 0.52380952381 [0 0 1 0 1 0 0 1 1 1 1 1 1 0 1 0 1 0 1 1 1 0 1 1 1 0 1 1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 1 1 1 0 0 0 1 0 0 0 0 0 0 0 1 0 1 0 1 0 0 0 1 0 0 0 1 0 0 0 0 0 1 0 1 1 1 1 1 1 1 0 1 0 1 1 0 0 1 0 1 1 1 1 0 1 1 1 0 1 0 0 0 0 1 1 0 0 1 0 1 1 1 0 1 0 1 1 1 1 0 0 1 0 1 0 1 0 0 0 0 0 1 1 0 1 0 1 0 0 0 0 0 1 0 0 1 1 1 1 1 1 0 1 0 1 1 1 1 0 0 1 1 0 0 1 1 1 1 1 0 1 0 0 0 0 1 1 0 1 0 1 0 0 0 0 0 1 0 0 1 1 1 0 0 1 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 1 0 0 0 1 0 1 0 0 0 0 0 0 0 0 1 1 1 1 1 1 0 1 0 1 0 0 0 1 1 1 1 0 1 1 1 0 1 0 0 1 1 1 1 1 0 1 0 1 1 1 0 1 1 1 1 1 1 0 0 1 0 1 1 1 0 1 0 0 1 1 1 0 0 1 0 1 0 0 1 0 1 0 0 0 1 1 1 1 1 1 1 0 1 1 1 0 1 0 1 1 1 0 1 1 1 1 0 0 1 0 0 1 0 1 1 0 0 1 1 0 1 0 0 0 0 1 0 1 1 1 1 0 0 1 0 0 0 0 0 1 0 1 1 1 0 0 0 0 0 1 1 0 1 1 1 0 0 1 0 1 0 0 1 1 1 0 0 1 1 0 0 1 0 1 0 1 0 1 1 1 0 0 1 1 0 0 1 0 0 0 0 1 1 1 0 1 0 1 1 1 1 1 0 1 0 1 1 0 1 1 1 1 0 1 0 0 0 0 1 1 1 0 1 0 1 0] 10
RBF - without pretraining
0.542222222222 0.542222222222 0.5 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 10
Matern12 - without pretraining
0.535555555556 0.535555555556 0.480952380952 [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 2
Gaussian Processes - Matern12
0.662222222222 0.662222222222 0.642857142857 [0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 1 0 0 0 0 1 1 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 1 0 0 0 1 0 1 1 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 0 1 1 1 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 0 0 0 1 0 0 0 1 0 0 0 0 1 0 1 1 0 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 1 1 1 1 0 0 0 1 1 1 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 1 0 1 0 1 1 0 0 1 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 1 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0] 0
RBF
0.662222222222 0.662222222222 0.633333333333 [0 0 0 0 1 1 0 0 1 0 0 0 0 0 1 0 1 1 0 1 1 0 0 0 0 0 0 0 1 0 0 0 0 1 0 1 1 1 1 1 1 1 1 1 1 0 0 2 0 0 0 1 1 1 1 0 1 0 0 1 0 1 0 1 0 1 0 1 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 0 0 1 0 1 1 0 0 0 0 0 0 1 1 0 0 1 0 0 0 1 1 0 0 1 1 1 0 0 2 0 1 1 0 0 0 1 1 1 0 0 2 0 1 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 0 0 1 0 0 0 0 1 1 0 0 1 2 0 0 0 1 1 0 1 1 0 1 1 0 0 1 0 0 1 1 0 1 0 0 0 1 1 1 1 0 1 1 1 1 1 1 1 0 1 2 2 0 0 1 1 0 1 0 1 0 2 1 0 1 0 1 0 1 2 1 1 0 1 0 0 0 0 0 0 0 1 1 0 0 1 0 0 0 0 0 1 1 2 1 1 0 1 1 1 0 0 1 0 1 0 2 1 0 0 1 1 1 0 0 0 0 0 1 0 0 0 1 1 2 0 0 2 0 1 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 0 0 0 1 1 0 0 1 2 0 0 2 0 2 0 1 1 0 1 1 0 0 1 0 0 1 1 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 0 1 0 1 1 0 0 1 1 1 0 0 0 1 1 0 1 0 0 1 1 1 2 1 0 0 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 1 1 1 0 0 1 0 1 1 1 0 1 1 0 1 0 2 1 0 0 1 1 1 0 0 2 0 0 1 1 1 0 0 1 0 1 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 1 1 0 0 0 0 0 1] 0
Matern52
0.66 0.66 0.647619047619 [0 0 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 1 0 1 1 0 0 1 1 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 1 1 1 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 1 1 0 0 0 2 0 0 0 1 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 1 1 0 1 1 1 0 1 1 1 0 1 0 0 0 0 1 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 0 0 1 0 0 1 0 0 0 1 1 0 0 1 0 1 0 0 1 0 0 1 1 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 2 0 0 2 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 0 1 0 0 0 0 0 1 1 1 0 0 0 0 0 0 1 0 0 1 1 2 2 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 1 0 0 0 1 0 1 0 1 1 0 0 1 1 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0] 4
Matern32
0.653333333333 0.653333333333 0.642857142857 [0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 1 1 0 0 1 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 1 0 0 0 2 0 0 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 1 1 0 1 1 0 0 1 0 1 0 1 0 0 0 0 1 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 0 0 0 1 0 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 1 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 1 1 1 1 0 1 0 1 0 1 0 0 0 0 0 1 1 1 0 0 0 0 0 0 1 0 0 0 0 2 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 1 0 1 0 1 1 0 0 1 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 1 0 0] 11
German - English baseline: 17-512-256-17-3
0.713333333333 0.713333333333 0.72380952381 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 1, 1, 0, 0, 1, 0, 1, 1, 1, 0, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 1, 0, 0, 0, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 1, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 0, 0, 1, 0, 0, 1, 0, 1, 1, 0, 1, 1, 0, 0, 0, 1, 1, 0, 1, 1, 0, 0, 1, 0, 0, 1, 1, 1, 0, 0, 0, 1, 1, 1, 0, 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 1, 0, 1, 0, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 1, 0, 0, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 1, 1, 0, 0, 0, 1, 0, 1, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 0, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 1, 1, 0, 1, 0, 0, 0, 0, 1, 1, 1, 1, 1, 0, 0, 1, 0, 1, 1, 2, 1, 1, 0, 0, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0, 0, 0, 1, 0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 1, 0, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 1, 1, 1, 0, 0, 1, 0, 1, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 0, 1, 0, 0, 0, 1, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 0, 0, 0, 1, 0, 0, 1, 0, 1, 1, 0, 1, 0, 0, 0, 0, 1, 0, 0, 1, 1, 0, 1, 1, 0, 1, 1, 1, 1, 1, 0, 0, 1] 22
RBF - with pre-training
0.651111111111 0.651111111111 0.585714285714 [0 1 1 1 2 2 2 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 2 2 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 2 2 2 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 2 1 1 1 1 2 2 1 1 1 2 1 2 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 1 1 1 1 1] 35
Matern12 - with pre-training
0.653333333333 0.653333333333 0.590476190476 [0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 8
Matern12 - without pretraining
0.653333333333 0.653333333333 0.585714285714 [0 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 12
phrase level - 144 features - matern 52 from scratch
Epoch 1: \Dev set LL -0.7493147904988721, Acc 0.839093029499054, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.420845624385 F1-OK: 0.906567258883 F1-score multiplied: 0.381524864112 Epoch 1: Test set LL -0.7783776118377148, Acc 0.8318082690238953, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.402909090909 F1-OK: 0.902118189405 F1-score multiplied: 0.363471619586 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.879300563405222, Acc 0.8281655311584473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.451612903226 F1-OK: 0.898121153223 F1-score multiplied: 0.405603101456 Epoch 2: Test set LL -0.9003143742573952, Acc 0.8228626251220703, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443108630313 F1-OK: 0.894681282988 F1-score multiplied: 0.396440997872 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.9124609975698444, Acc 0.8470154404640198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.440559440559 F1-OK: 0.911392405063 F1-score multiplied: 0.401522528105 Epoch 3: Test set LL -0.9459802497826799, Acc 0.8389784097671509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.422341989221 F1-OK: 0.906450845037 F1-score multiplied: 0.382832253024 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9672487047990705, Acc 0.8380002975463867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456461961503 F1-OK: 0.90481540931 F1-score multiplied: 0.413013816532 Epoch 4: Test set LL -1.0041998135212165, Acc 0.8349494934082031, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45055694476 F1-OK: 0.902888826389 F1-score multiplied: 0.406802831076 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -1.0081210912293341, Acc 0.8359513878822327, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477144101001 F1-OK: 0.902713649251 F1-score multiplied: 0.430724492633 Epoch 5: Test set LL -1.0455956600449658, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457289659602 F1-OK: 0.897022382906 F1-score multiplied: 0.410199060134 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -1.020641456214472, Acc 0.8333560824394226, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470026064292 F1-OK: 0.90113452188 F1-score multiplied: 0.423556712717 Epoch 6: Test set LL -1.0544540613194733, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.463284093342 F1-OK: 0.898159808263 F1-score multiplied: 0.416103152447 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9839530767813401, Acc 0.8433274030685425, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472643678161 F1-OK: 0.907997112377 F1-score multiplied: 0.429159094953 Epoch 7: Test set LL -1.0346109731798498, Acc 0.8359054923057556, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456457814974 F1-OK: 0.903365906623 F1-score multiplied: 0.412348427859 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9860655202902947, Acc 0.8445567488670349, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473148148148 F1-OK: 0.908828713347 F1-score multiplied: 0.430010622704 Epoch 8: Test set LL -1.0413509122011808, Acc 0.8382272720336914, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45276045276 F1-OK: 0.905084338315 F1-score multiplied: 0.409786394802 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0573214688448014, Acc 0.8339024782180786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474503025065 F1-OK: 0.90136275146 F1-score multiplied: 0.427699352249 Epoch 9: Test set LL -1.0871795191209193, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.466396415618 F1-OK: 0.898337465957 F1-score multiplied: 0.418981374137 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -1.0459707227828303, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471004869411 F1-OK: 0.903496729387 F1-score multiplied: 0.425551359038 Epoch 10: Test set LL -1.0822425755217928, Acc 0.8320813775062561, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460627330555 F1-OK: 0.900562093089 F1-score multiplied: 0.414823512939 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -1.0330078106800569, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471434997751 F1-OK: 0.905386907158 F1-score multiplied: 0.42683107454 Epoch 11: Test set LL -1.0526317259132754, Acc 0.8357006311416626, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461744966443 F1-OK: 0.90305423483 F1-score multiplied: 0.416980747358 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0615618464829928, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472246696035 F1-OK: 0.903168444876 F1-score multiplied: 0.426518314056 Epoch 12: Test set LL -1.0769240227441526, Acc 0.8334471583366394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.46943658908 F1-OK: 0.901219067676 F1-score multiplied: 0.423065205144 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0611722838248603, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480274442539 F1-OK: 0.901543460601 F1-score multiplied: 0.432988282965 Epoch 13: Test set LL -1.1031822336067936, Acc 0.8262087106704712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.469902103728 F1-OK: 0.896067301017 F1-score multiplied: 0.42106390983 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0686174185183, Acc 0.8359513878822327, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473937801139 F1-OK: 0.902823853063 F1-score multiplied: 0.427882351736 Epoch 14: Test set LL -1.093445991745239, Acc 0.8316716551780701, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.468864468864 F1-OK: 0.899987828133 F1-score multiplied: 0.421972315022 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.1775949966916288, Acc 0.8166916966438293, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46914556962 F1-OK: 0.889219085356 F1-score multiplied: 0.417173194316 Epoch 15: Test set LL -1.1930409318947213, Acc 0.8135072588920593, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.467745078932 F1-OK: 0.886947882601 F1-score multiplied: 0.414865507356 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0227206770733492, Acc 0.8440103530883789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471785383904 F1-OK: 0.908493589744 F1-score multiplied: 0.428613997011 Epoch 16: Test set LL -1.0824350163999676, Acc 0.8335837125778198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446765039728 F1-OK: 0.902061648515 F1-score multiplied: 0.403009608236 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.045133706304, Acc 0.8399125933647156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46581586144 F1-OK: 0.905848329049 F1-score multiplied: 0.42195851973 Epoch 17: Test set LL -1.0817940661582846, Acc 0.8341982960700989, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459242761693 F1-OK: 0.902088878135 F1-score multiplied: 0.414277787687 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0485657011768017, Acc 0.8384100794792175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472581364244 F1-OK: 0.904589079764 F1-score multiplied: 0.427491941396 Epoch 18: Test set LL -1.1046500052693027, Acc 0.8303059339523315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460134694764 F1-OK: 0.899331577881 F1-score multiplied: 0.41381366108 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.042973610559692, Acc 0.8396393656730652, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473070017953 F1-OK: 0.905429353955 F1-score multiplied: 0.428331480731 Epoch 19: Test set LL -1.095536271489737, Acc 0.8334471583366394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464779460171 F1-OK: 0.901378836278 F1-score multiplied: 0.418942368935 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0847062754606531, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.48252344416 F1-OK: 0.90126870527 F1-score multiplied: 0.434883279781 Epoch 20: Test set LL -1.1256111127763424, Acc 0.8275744318962097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.471204188482 F1-OK: 0.896993432056 F1-score multiplied: 0.422667062226 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0366936740511363, Acc 0.8429176211357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468576709797 F1-OK: 0.907837794518 F1-score multiplied: 0.425391646784 Epoch 21: Test set LL -1.068370803859053, Acc 0.8366566300392151, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.454628362973 F1-OK: 0.903943458357 F1-score multiplied: 0.410958334693 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0520967694257068, Acc 0.8396393656730652, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472596585804 F1-OK: 0.905444587629 F1-score multiplied: 0.427910020748 Epoch 22: Test set LL -1.0903415570110888, Acc 0.8337885737419128, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464819700967 F1-OK: 0.901616814875 F1-score multiplied: 0.419089258277 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.063189014642339, Acc 0.8381368517875671, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475431606906 F1-OK: 0.904304288137 F1-score multiplied: 0.429934840841 Epoch 23: Test set LL -1.1023510022976344, Acc 0.8320813775062561, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.465783184879 F1-OK: 0.900384849099 F1-score multiplied: 0.41938412263 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.063432629971611, Acc 0.8375905156135559, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475055187638 F1-OK: 0.903934717621 F1-score multiplied: 0.429418876892 Epoch 24: Test set LL -1.0865836438885264, Acc 0.8342666029930115, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.470203012443 F1-OK: 0.90176872951 F1-score multiplied: 0.424014373142 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.1511239037147998, Acc 0.8222920298576355, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478974769724 F1-OK: 0.89287772746 F1-score multiplied: 0.427665903901 Epoch 25: Test set LL -1.1760984913062835, Acc 0.8192433714866638, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.471551207826 F1-OK: 0.890975740352 F1-score multiplied: 0.420140686506 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0546522873129494, Acc 0.8397759795188904, Outputs [1 1 1 ..., 1 1 0] Result from the previous epoch on dev: F1-BAD: 0.478434859938 F1-OK: 0.905349794239 F1-score multiplied: 0.433150902001 Epoch 26: Test set LL -1.0988168981208266, Acc 0.8329008221626282, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.469542597008 F1-OK: 0.900830800405 F1-score multiplied: 0.422978433487 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0417070743216614, Acc 0.8416882753372192, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476276547673 F1-OK: 0.906750341942 F1-score multiplied: 0.431863922461 Epoch 27: Test set LL -1.0876959978852727, Acc 0.8339934349060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.462762430939 F1-OK: 0.901829342164 F1-score multiplied: 0.417332738672 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0982520275345955, Acc 0.8339024782180786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482112436116 F1-OK: 0.901089962583 F1-score multiplied: 0.434426677021 Epoch 28: Test set LL -1.1236956763394434, Acc 0.8291450142860413, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.477006688963 F1-OK: 0.897894221352 F1-score multiplied: 0.428301549566 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0671044961788871, Acc 0.8362245559692383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.47389205792 F1-OK: 0.903017067055 F1-score multiplied: 0.427932616244 Epoch 29: Test set LL -1.1008019184249518, Acc 0.8322179913520813, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4680666811 F1-OK: 0.900401313389 F1-score multiplied: 0.421447854416 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrase level - 144 features - matern 32 from scratch
Epoch 1: \Dev set LL -0.6687387965291192, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.422298963986 F1-OK: 0.907173999207 F1-score multiplied: 0.38309864002 Epoch 1: Test set LL -0.7042616977965287, Acc 0.834130048751831, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.414275379793 F1-OK: 0.903384909113 F1-score multiplied: 0.374250126322 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.8595031504621647, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467543859649 F1-OK: 0.901795825918 F1-score multiplied: 0.421629101065 Epoch 2: Test set LL -0.9062876240169994, Acc 0.8236137628555298, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449605795866 F1-OK: 0.894978654198 F1-score multiplied: 0.402387590104 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.9018523466079391, Acc 0.8461958765983582, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46021093001 F1-OK: 0.910321758522 F1-score multiplied: 0.418940023097 Epoch 3: Test set LL -0.940677096186665, Acc 0.836246907711029, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438933083762 F1-OK: 0.904133685136 F1-score multiplied: 0.39685418655 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9323303084485602, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474180511899 F1-OK: 0.905678614579 F1-score multiplied: 0.429455149077 Epoch 4: Test set LL -0.9903253499445506, Acc 0.831261932849884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.453681185054 F1-OK: 0.900222087624 F1-score multiplied: 0.408413823525 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.9449707417404618, Acc 0.8438737988471985, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469112865769 F1-OK: 0.908479461926 F1-score multiplied: 0.426179403876 Epoch 5: Test set LL -1.0111407672328852, Acc 0.8346763253211975, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451642129105 F1-OK: 0.902665540948 F1-score multiplied: 0.407681786784 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9592126915237605, Acc 0.8442835807800293, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475620975161 F1-OK: 0.908565928778 F1-score multiplied: 0.432133013043 Epoch 6: Test set LL -1.0204373062455978, Acc 0.8357006311416626, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459568733154 F1-OK: 0.903124496698 F1-score multiplied: 0.415047780828 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9930843909015468, Acc 0.8444201350212097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470970738504 F1-OK: 0.908799743775 F1-score multiplied: 0.428018086478 Epoch 7: Test set LL -1.0303194106359206, Acc 0.8382272720336914, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45752232654 F1-OK: 0.904939609165 F1-score multiplied: 0.414030075363 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9829333956026811, Acc 0.8446933627128601, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481532147743 F1-OK: 0.90866736284 F1-score multiplied: 0.437552546812 Epoch 8: Test set LL -1.0640342389489683, Acc 0.8340617418289185, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457347029924 F1-OK: 0.902055622733 F1-score multiplied: 0.412552459883 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0819580581856216, Acc 0.827619194984436, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.486156351792 F1-OK: 0.896438536025 F1-score multiplied: 0.435809288279 Epoch 9: Test set LL -1.140674294238243, Acc 0.8178776502609253, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.467345715998 F1-OK: 0.890161031259 F1-score multiplied: 0.416012944507 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -1.0319669261951478, Acc 0.838546633720398, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478835978836 F1-OK: 0.904477129465 F1-score multiplied: 0.433096191622 Epoch 10: Test set LL -1.0847070418996865, Acc 0.8297596573829651, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.462367910287 F1-OK: 0.898868200073 F1-score multiplied: 0.415607811291 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -1.0665535601480076, Acc 0.8322633504867554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475661827498 F1-OK: 0.900162601626 F1-score multiplied: 0.428172988135 Epoch 11: Test set LL -1.12289845395134, Acc 0.8236820697784424, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.462754889721 F1-OK: 0.894534760232 F1-score multiplied: 0.413950334323 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0437649730813339, Acc 0.8384100794792175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.48227571116 F1-OK: 0.904264789188 F1-score multiplied: 0.436104944283 Epoch 12: Test set LL -1.0950396953536154, Acc 0.8321496844291687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.469114470842 F1-OK: 0.900316327358 F1-score multiplied: 0.422351417499 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.011480249446454, Acc 0.8438737988471985, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472542685741 F1-OK: 0.908376753507 F1-score multiplied: 0.429246790767 Epoch 13: Test set LL -1.051771319145348, Acc 0.8366566300392151, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456610631531 F1-OK: 0.903881700555 F1-score multiplied: 0.41272199412 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0838946112094447, Acc 0.8295314908027649, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480865224626 F1-OK: 0.898022552705 F1-score multiplied: 0.431827816525 Epoch 14: Test set LL -1.126889606654188, Acc 0.8239551782608032, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.474306688418 F1-OK: 0.894274934383 F1-score multiplied: 0.424160582662 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.0896069660884016, Acc 0.8313071727752686, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.491141326741 F1-OK: 0.898894801474 F1-score multiplied: 0.441484385396 Epoch 15: Test set LL -1.148065845497997, Acc 0.8219748735427856, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.470444850701 F1-OK: 0.893002257336 F1-score multiplied: 0.420108313628 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0357786703444862, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473873873874 F1-OK: 0.905973273225 F1-score multiplied: 0.429317064609 Epoch 16: Test set LL -1.0918020290868835, Acc 0.8323545455932617, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461268378319 F1-OK: 0.900731874975 F1-score multiplied: 0.41547913127 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0381645670538604, Acc 0.8403223752975464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481596452328 F1-OK: 0.905626866877 F1-score multiplied: 0.436146686221 Epoch 17: Test set LL -1.1139147712573898, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457711442786 F1-OK: 0.898357997162 F1-score multiplied: 0.411188735019 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0596041256064515, Acc 0.835131824016571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.493495593789 F1-OK: 0.901541724447 F1-score multiplied: 0.444906868632 Epoch 18: Test set LL -1.1316669742172445, Acc 0.8253209590911865, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.468633153303 F1-OK: 0.895480918526 F1-score multiplied: 0.419652046571 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.1101627180605902, Acc 0.8273459672927856, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485342019544 F1-OK: 0.896274413261 F1-score multiplied: 0.434999633798 Epoch 19: Test set LL -1.186153755618713, Acc 0.816511869430542, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.466547548144 F1-OK: 0.889200445342 F1-score multiplied: 0.414854287583 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.9979634118461422, Acc 0.8476983904838562, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.494789306751 F1-OK: 0.910333735424 F1-score multiplied: 0.450423397863 Epoch 20: Test set LL -1.0692094044867804, Acc 0.8361103534698486, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.46571682992 F1-OK: 0.903210195193 F1-score multiplied: 0.420640188856 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.028674347247688, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473612990528 F1-OK: 0.906076458753 F1-score multiplied: 0.429129581277 Epoch 21: Test set LL -1.0654030929682563, Acc 0.8357689380645752, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.467566969227 F1-OK: 0.902910661661 F1-score multiplied: 0.422171201556 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0431592616373733, Acc 0.8410053253173828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.483584738243 F1-OK: 0.906038101388 F1-score multiplied: 0.438146198098 Epoch 22: Test set LL -1.1043228768716191, Acc 0.8321496844291687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464488017429 F1-OK: 0.900477771479 F1-score multiplied: 0.418261134814 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0506880404816121, Acc 0.8388198614120483, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.493127147766 F1-OK: 0.904174110768 F1-score multiplied: 0.445872800327 Epoch 23: Test set LL -1.1100787603704128, Acc 0.8300327658653259, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.478743455497 F1-OK: 0.89846204055 F1-score multiplied: 0.430132821926 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0535326131481924, Acc 0.8382734656333923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482969432314 F1-OK: 0.90414507772 F1-score multiplied: 0.436674434916 Epoch 24: Test set LL -1.1057168562283024, Acc 0.8313302397727966, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.469957081545 F1-OK: 0.899707649829 F1-score multiplied: 0.422823981358 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0362864263475464, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.499356499356 F1-OK: 0.905206725692 F1-score multiplied: 0.452020861736 Epoch 25: Test set LL -1.126633814476552, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.469554300063 F1-OK: 0.89656860745 F1-score multiplied: 0.42098764493 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0694228784890885, Acc 0.8347220420837402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.493723849372 F1-OK: 0.901240613777 F1-score multiplied: 0.444963985045 Epoch 26: Test set LL -1.1509498638865527, Acc 0.8234089016914368, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464817880795 F1-OK: 0.894259077527 F1-score multiplied: 0.415667609298 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.038598634712906, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477812640072 F1-OK: 0.906131657401 F1-score multiplied: 0.432961159475 Epoch 27: Test set LL -1.0727203830580962, Acc 0.8355640769004822, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458389563653 F1-OK: 0.903067385879 F1-score multiplied: 0.413956664962 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0539005633158913, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.486178148311 F1-OK: 0.905281889509 F1-score multiplied: 0.440128272741 Epoch 28: Test set LL -1.0978509204440017, Acc 0.8322862386703491, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.468168038112 F1-OK: 0.900445885691 F1-score multiplied: 0.42155998373 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0603212776244912, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.487783969138 F1-OK: 0.902916565115 F1-score multiplied: 0.440428225933 Epoch 29: Test set LL -1.1039123992242594, Acc 0.8322179913520813, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.476677316294 F1-OK: 0.900093522547 F1-score multiplied: 0.429054164741 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrase level - shallow Neural network
epoch: 0 [157230 58090 106355 ..., 43269 152588 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.393292682927 F1-OK: 0.905791383936 F1-score multiplied: 0.35624112356 Result from the previous epoch on test: F1-BAD: 0.397518610422 F1-OK: 0.903872040542 F1-score multiplied: 0.359305957555 [ 10604 112260 2170 ..., 24253 38081 64020] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.41037962518 F1-OK: 0.902316694531 F1-score multiplied: 0.370292386895 Result from the previous epoch on test: F1-BAD: 0.414931801866 F1-OK: 0.902624556932 F1-score multiplied: 0.374527633817 [ 16587 157088 51334 ..., 99848 92538 64243] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.439622641509 F1-OK: 0.905126976521 F1-score multiplied: 0.39791431232 Result from the previous epoch on test: F1-BAD: 0.429496070273 F1-OK: 0.90112971717 F1-score multiplied: 0.387031672331 [ 97998 95754 98742 ..., 203012 213193 125451] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.456293706294 F1-OK: 0.899303869192 F1-score multiplied: 0.410346695558 Result from the previous epoch on test: F1-BAD: 0.449582530507 F1-OK: 0.895559978876 F1-score multiplied: 0.402628121524 [ 82707 140148 157986 ..., 51883 106201 103473] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.455650607834 F1-OK: 0.9026648418 F1-score multiplied: 0.411299783837 Result from the previous epoch on test: F1-BAD: 0.446088321004 F1-OK: 0.900471261127 F1-score multiplied: 0.401689712989 [ 96593 186600 181132 ..., 40532 34553 129546] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.467023172906 F1-OK: 0.903532827875 F1-score multiplied: 0.421970768099 Result from the previous epoch on test: F1-BAD: 0.450254819411 F1-OK: 0.899858728557 F1-score multiplied: 0.405165729321 [211235 108099 35584 ..., 173533 203627 154044] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.45911674683 F1-OK: 0.899878591663 F1-score multiplied: 0.413149331546 Result from the previous epoch on test: F1-BAD: 0.459465333623 F1-OK: 0.899258719164 F1-score multiplied: 0.413178207414 [ 44555 140306 112838 ..., 74919 150399 165017] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.472647702407 F1-OK: 0.902484421785 F1-score multiplied: 0.426557188415 Result from the previous epoch on test: F1-BAD: 0.460083571586 F1-OK: 0.900771997898 F1-score multiplied: 0.414430397977 [169730 20673 186182 ..., 67812 116880 108578] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.481858948227 F1-OK: 0.895725654278 F1-score multiplied: 0.43161342167 Result from the previous epoch on test: F1-BAD: 0.474164133739 F1-OK: 0.893442286371 F1-score multiplied: 0.423638287763 [ 41613 123879 70949 ..., 98250 105271 211104] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.481814291827 F1-OK: 0.901584721658 F1-score multiplied: 0.434396404188 Result from the previous epoch on test: F1-BAD: 0.471513605442 F1-OK: 0.898877318581 F1-score multiplied: 0.423832885334 [ 79978 62975 104982 ..., 106252 110351 75418] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.478204574881 F1-OK: 0.901906693712 F1-score multiplied: 0.431295907049 Result from the previous epoch on test: F1-BAD: 0.466292134831 F1-OK: 0.899837793998 F1-score multiplied: 0.419587285966 [ 78595 203579 77628 ..., 171197 169790 184869] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.485875706215 F1-OK: 0.904140669314 F1-score multiplied: 0.43929998622 Result from the previous epoch on test: F1-BAD: 0.471934369603 F1-OK: 0.900794938352 F1-score multiplied: 0.425116091372 [161145 8624 103629 ..., 131598 77971 145710] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.486554621849 F1-OK: 0.900342521611 F1-score multiplied: 0.438065815137 Result from the previous epoch on test: F1-BAD: 0.476569037657 F1-OK: 0.897910886241 F1-score multiplied: 0.427916526958 [ 88180 37890 33658 ..., 138465 165899 187250] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.489522212909 F1-OK: 0.900620104439 F1-score multiplied: 0.440873546515 Result from the previous epoch on test: F1-BAD: 0.477736163129 F1-OK: 0.89747569643 F1-score multiplied: 0.428756595714 [ 95272 217111 176486 ..., 183877 161754 214087] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.482337549062 F1-OK: 0.903878856588 F1-score multiplied: 0.435974712336 Result from the previous epoch on test: F1-BAD: 0.467044958533 F1-OK: 0.901157613535 F1-score multiplied: 0.420881120246 [ 43428 23203 165494 ..., 87260 127806 73850] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.480349344978 F1-OK: 0.903659326425 F1-score multiplied: 0.434072165532 Result from the previous epoch on test: F1-BAD: 0.478714161599 F1-OK: 0.902771025766 F1-score multiplied: 0.432169274715 [204644 31141 103650 ..., 30090 81702 136580] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.485494880546 F1-OK: 0.901935274028 F1-score multiplied: 0.437884958125 Result from the previous epoch on test: F1-BAD: 0.474410702909 F1-OK: 0.899304284145 F1-score multiplied: 0.426639577571 [151463 159307 100073 ..., 99926 64887 45399] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.484120171674 F1-OK: 0.902371669916 F1-score multiplied: 0.436856327753 Result from the previous epoch on test: F1-BAD: 0.47825155346 F1-OK: 0.901100686406 F1-score multiplied: 0.430952803098 [ 77558 65635 39900 ..., 52102 175656 30661] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.489983305509 F1-OK: 0.900212314225 F1-score multiplied: 0.441089005384 Result from the previous epoch on test: F1-BAD: 0.481612300021 F1-OK: 0.898059244127 F1-score multiplied: 0.432516378119 [ 873 43953 181616 ..., 181234 7816 90895] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.481529769665 F1-OK: 0.903330362207 F1-score multiplied: 0.434980461245 Result from the previous epoch on test: F1-BAD: 0.476025917927 F1-OK: 0.901614080623 F1-score multiplied: 0.429191670344 [139636 198046 199708 ..., 32597 183833 57999] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.489051094891 F1-OK: 0.896517739816 F1-score multiplied: 0.438442982246 Result from the previous epoch on test: F1-BAD: 0.481376518219 F1-OK: 0.894775751602 F1-score multiplied: 0.430724035893 [ 48250 85392 96772 ..., 159417 47120 80258] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.492716366752 F1-OK: 0.90380240494 F1-score multiplied: 0.445318237224 Result from the previous epoch on test: F1-BAD: 0.474178403756 F1-OK: 0.899845541013 F1-score multiplied: 0.426687322264 [ 94976 169993 129145 ..., 212870 49486 180803] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.492487479132 F1-OK: 0.900702270129 F1-score multiplied: 0.443584590464 Result from the previous epoch on test: F1-BAD: 0.480133139172 F1-OK: 0.897920836567 F1-score multiplied: 0.431121549989 [188706 216106 14316 ..., 23716 33182 2019] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.495405179616 F1-OK: 0.901371652515 F1-score multiplied: 0.446544185415 Result from the previous epoch on test: F1-BAD: 0.482012892493 F1-OK: 0.898239307161 F1-score multiplied: 0.432962926596 [ 49555 204099 199462 ..., 142630 30997 94732] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.497367355205 F1-OK: 0.898053068266 F1-score multiplied: 0.446662279397 Result from the previous epoch on test: F1-BAD: 0.48486080065 F1-OK: 0.89596585546 F1-score multiplied: 0.434418722034 [ 10586 40093 110450 ..., 135123 16134 39003] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.48709408826 F1-OK: 0.899346405229 F1-score multiplied: 0.438066317285 Result from the previous epoch on test: F1-BAD: 0.485150571132 F1-OK: 0.89870469497 F1-score multiplied: 0.436007096044 [124016 93299 142951 ..., 121315 130112 138434] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.495967741935 F1-OK: 0.897220851834 F1-score multiplied: 0.444992599901 Result from the previous epoch on test: F1-BAD: 0.484146341463 F1-OK: 0.895847012475 F1-score multiplied: 0.433721053601 [ 9469 193383 39949 ..., 202484 63420 57130] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.488706365503 F1-OK: 0.898009338904 F1-score multiplied: 0.438862880204 Result from the previous epoch on test: F1-BAD: 0.481848184818 F1-OK: 0.897217675941 F1-score multiplied: 0.432322708539 [ 70289 17736 199270 ..., 16586 34471 159323] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.499189627229 F1-OK: 0.89847215377 F1-score multiplied: 0.448507979516 Result from the previous epoch on test: F1-BAD: 0.484799020608 F1-OK: 0.896461229344 F1-score multiplied: 0.434603525999 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
deep network - phrase - 144 features
epoch: 0 [157230 58090 106355 ..., 43269 152588 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.420588235294 F1-OK: 0.906205364228 F1-score multiplied: 0.381139314955 Result from the previous epoch on test: F1-BAD: 0.419971333015 F1-OK: 0.903274639471 F1-score multiplied: 0.379349454417 [ 10604 112260 2170 ..., 24253 38081 64020] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.449499545041 F1-OK: 0.902764384442 F1-score multiplied: 0.405792180086 Result from the previous epoch on test: F1-BAD: 0.445739910314 F1-OK: 0.90043499275 F1-score multiplied: 0.401359812912 [ 16587 157088 51334 ..., 99848 92538 64243] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.467590523022 F1-OK: 0.903990326481 F1-score multiplied: 0.422697309566 Result from the previous epoch on test: F1-BAD: 0.455142231947 F1-OK: 0.899263694474 F1-score multiplied: 0.409292885012 [ 97998 95754 98742 ..., 203012 213193 125451] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.498397435897 F1-OK: 0.89692079697 F1-score multiplied: 0.447023025413 Result from the previous epoch on test: F1-BAD: 0.47587289133 F1-OK: 0.889541132699 F1-score multiplied: 0.423308510775 [ 82707 140148 157986 ..., 51883 106201 103473] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.484047402005 F1-OK: 0.909061696658 F1-score multiplied: 0.44002895253 Result from the previous epoch on test: F1-BAD: 0.459765018843 F1-OK: 0.90164265246 F1-score multiplied: 0.414543751098 [ 96593 186600 181132 ..., 40532 34553 129546] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.497388509442 F1-OK: 0.897062453715 F1-score multiplied: 0.446188556729 Result from the previous epoch on test: F1-BAD: 0.48197492163 F1-OK: 0.890671518359 F1-score multiplied: 0.429281335259 [211235 108099 35584 ..., 173533 203627 154044] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.49774497745 F1-OK: 0.899614848808 F1-score multiplied: 0.447778772633 Result from the previous epoch on test: F1-BAD: 0.486 F1-OK: 0.894186429513 F1-score multiplied: 0.434574604743 [ 44555 140306 112838 ..., 74919 150399 165017] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.501818181818 F1-OK: 0.88479650185 F1-score multiplied: 0.444006971837 Result from the previous epoch on test: F1-BAD: 0.494815874151 F1-OK: 0.880729298557 F1-score multiplied: 0.435798837756 [169730 20673 186182 ..., 67812 116880 108578] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.491638795987 F1-OK: 0.869550291795 F1-score multiplied: 0.427504658508 Result from the previous epoch on test: F1-BAD: 0.48928332217 F1-OK: 0.869188540058 F1-score multiplied: 0.425279456472 [ 41613 123879 70949 ..., 98250 105271 211104] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.506939371804 F1-OK: 0.886592741935 F1-score multiplied: 0.449448767643 Result from the previous epoch on test: F1-BAD: 0.490139835066 F1-OK: 0.880050611556 F1-score multiplied: 0.431347861598 [ 79978 62975 104982 ..., 106252 110351 75418] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.491938507687 F1-OK: 0.886847599165 F1-score multiplied: 0.436274484479 Result from the previous epoch on test: F1-BAD: 0.483194057567 F1-OK: 0.883571099862 F1-score multiplied: 0.426936304892 [ 78595 203579 77628 ..., 171197 169790 184869] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.48685558211 F1-OK: 0.871681038163 F1-score multiplied: 0.424382779249 Result from the previous epoch on test: F1-BAD: 0.485699779997 F1-OK: 0.870011548826 F1-score multiplied: 0.422564417859 [161145 8624 103629 ..., 131598 77971 145710] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.479713603819 F1-OK: 0.892150395778 F1-score multiplied: 0.427976681507 Result from the previous epoch on test: F1-BAD: 0.480109739369 F1-OK: 0.890303907381 F1-score multiplied: 0.427443576932 [ 88180 37890 33658 ..., 138465 165899 187250] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.486552567237 F1-OK: 0.896619625862 F1-score multiplied: 0.436252580798 Result from the previous epoch on test: F1-BAD: 0.482378420949 F1-OK: 0.891404023297 F1-score multiplied: 0.429994065186 [ 95272 217111 176486 ..., 183877 161754 214087] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.470690403821 F1-OK: 0.901207553286 F1-score multiplied: 0.424189747183 Result from the previous epoch on test: F1-BAD: 0.479783243018 F1-OK: 0.898080849326 F1-score multiplied: 0.430884142382 [ 43428 23203 165494 ..., 87260 127806 73850] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.480190174326 F1-OK: 0.891731308797 F1-score multiplied: 0.428200612624 Result from the previous epoch on test: F1-BAD: 0.467238689548 F1-OK: 0.886920529801 F1-score multiplied: 0.414403586077 [204644 31141 103650 ..., 30090 81702 136580] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.473073736537 F1-OK: 0.895976447498 F1-score multiplied: 0.423862925867 Result from the previous epoch on test: F1-BAD: 0.47144006436 F1-OK: 0.891923013654 F1-score multiplied: 0.420488242961 [151463 159307 100073 ..., 99926 64887 45399] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.466755912539 F1-OK: 0.903636803484 F1-score multiplied: 0.421777820814 Result from the previous epoch on test: F1-BAD: 0.461974286337 F1-OK: 0.900036438722 F1-score multiplied: 0.415793691456 [ 77558 65635 39900 ..., 52102 175656 30661] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.476853463279 F1-OK: 0.872291613561 F1-score multiplied: 0.415955276916 Result from the previous epoch on test: F1-BAD: 0.484098332474 F1-OK: 0.872140087768 F1-score multiplied: 0.422201562172 [ 873 43953 181616 ..., 181234 7816 90895]
epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.467674223342 F1-OK: 0.896574225122 F1-score multiplied: 0.419304654402 Result from the previous epoch on test: F1-BAD: 0.468198604842 F1-OK: 0.893831408208 F1-score multiplied: 0.418490618287 [139636 198046 199708 ..., 32597 183833 57999] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.468713563933 F1-OK: 0.88673460933 F1-score multiplied: 0.415624539002 Result from the previous epoch on test: F1-BAD: 0.475572519084 F1-OK: 0.885728542914 F1-score multiplied: 0.421228154378 [ 48250 85392 96772 ..., 159417 47120 80258] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.4621979735 F1-OK: 0.885723749586 F1-score multiplied: 0.409379722139 Result from the previous epoch on test: F1-BAD: 0.469737342977 F1-OK: 0.884080885412 F1-score multiplied: 0.41528580609 [ 94976 169993 129145 ..., 212870 49486 180803] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.464447184546 F1-OK: 0.893275452535 F1-score multiplied: 0.414879268954 Result from the previous epoch on test: F1-BAD: 0.46935483871 F1-OK: 0.891811903979 F1-score multiplied: 0.418576232351 [188706 216106 14316 ..., 23716 33182 2019] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.471750296326 F1-OK: 0.889604491784 F1-score multiplied: 0.419671182612 Result from the previous epoch on test: F1-BAD: 0.477203647416 F1-OK: 0.885447885448 F1-score multiplied: 0.422538960533 [ 49555 204099 199462 ..., 142630 30997 94732] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.478701825558 F1-OK: 0.894473187156 F1-score multiplied: 0.428185947604 Result from the previous epoch on test: F1-BAD: 0.466482649842 F1-OK: 0.888255698712 F1-score multiplied: 0.414355872072 [ 10586 40093 110450 ..., 135123 16134 39003] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.444711538462 F1-OK: 0.885888358307 F1-score multiplied: 0.393964774728 Result from the previous epoch on test: F1-BAD: 0.459352801894 F1-OK: 0.886870355078 F1-score multiplied: 0.407386382522 [124016 93299 142951 ..., 121315 130112 138434] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.458349940215 F1-OK: 0.887991428336 F1-score multiplied: 0.407010818089 Result from the previous epoch on test: F1-BAD: 0.466627748589 F1-OK: 0.886496335252 F1-score multiplied: 0.413663789051 [ 9469 193383 39949 ..., 202484 63420 57130] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.475827940617 F1-OK: 0.885393258427 F1-score multiplied: 0.421294850793 Result from the previous epoch on test: F1-BAD: 0.46844840386 F1-OK: 0.880167364017 F1-score multiplied: 0.412312996804 [ 70289 17736 199270 ..., 16586 34471 159323] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.461415433826 F1-OK: 0.889053619965 F1-score multiplied: 0.410223061751 Result from the previous epoch on test: F1-BAD: 0.465279128574 F1-OK: 0.886155630099 F1-score multiplied: 0.412309719354 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrase level - 72 features - shallow network
0 [157230 58090 106355 ..., 43269 152588 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.386895475819 F1-OK: 0.907304033336 F1-score multiplied: 0.35103182569 Result from the previous epoch on test: F1-BAD: 0.374714394516 F1-OK: 0.902836403803 F1-score multiplied: 0.338305796398 [ 10604 112260 2170 ..., 24253 38081 64020] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.397212543554 F1-OK: 0.904139950922 F1-score multiplied: 0.359135729635 Result from the previous epoch on test: F1-BAD: 0.382301764852 F1-OK: 0.901642588561 F1-score multiplied: 0.344699552873 [ 16587 157088 51334 ..., 99848 92538 64243] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.414888337469 F1-OK: 0.906628652887 F1-score multiplied: 0.376149654498 Result from the previous epoch on test: F1-BAD: 0.391697191697 F1-OK: 0.901123327909 F1-score multiplied: 0.352967476915 [ 97998 95754 98742 ..., 203012 213193 125451] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.431464908149 F1-OK: 0.903586548446 F1-score multiplied: 0.38986588713 Result from the previous epoch on test: F1-BAD: 0.409101571663 F1-OK: 0.899340659341 F1-score multiplied: 0.367921677197 [ 82707 140148 157986 ..., 51883 106201 103473] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.42471042471 F1-OK: 0.905171042164 F1-score multiplied: 0.384435577753 Result from the previous epoch on test: F1-BAD: 0.403634624582 F1-OK: 0.900661196527 F1-score multiplied: 0.363538043935 [ 96593 186600 181132 ..., 40532 34553 129546] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.434535104364 F1-OK: 0.904898675602 F1-score multiplied: 0.393210240442 Result from the previous epoch on test: F1-BAD: 0.408918406072 F1-OK: 0.900606253989 F1-score multiplied: 0.36827447388 [211235 108099 35584 ..., 173533 203627 154044] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.431316042267 F1-OK: 0.905732484076 F1-score multiplied: 0.390656950385 Result from the previous epoch on test: F1-BAD: 0.410684474124 F1-OK: 0.901534170153 F1-score multiplied: 0.370246086574 [ 44555 140306 112838 ..., 74919 150399 165017] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.434657730972 F1-OK: 0.905918903848 F1-score multiplied: 0.393764655191 Result from the previous epoch on test: F1-BAD: 0.408766079085 F1-OK: 0.901076125947 F1-score multiplied: 0.368329354961 [169730 20673 186182 ..., 67812 116880 108578] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.446892904363 F1-OK: 0.898569465772 F1-score multiplied: 0.401564318331 Result from the previous epoch on test: F1-BAD: 0.428159005108 F1-OK: 0.896106516038 F1-score multiplied: 0.383676074377 [ 41613 123879 70949 ..., 98250 105271 211104] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.441176470588 F1-OK: 0.902454676721 F1-score multiplied: 0.398141769141 Result from the previous epoch on test: F1-BAD: 0.421197522368 F1-OK: 0.898792570901 F1-score multiplied: 0.378569203986 [ 79978 62975 104982 ..., 106252 110351 75418] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.44896073903 F1-OK: 0.904384066683 F1-score multiplied: 0.406032938945 Result from the previous epoch on test: F1-BAD: 0.420253164557 F1-OK: 0.899009742212 F1-score multiplied: 0.377811689132 [ 78595 203579 77628 ..., 171197 169790 184869] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.445185891325 F1-OK: 0.907206632653 F1-score multiplied: 0.403875593374 Result from the previous epoch on test: F1-BAD: 0.413858566682 F1-OK: 0.901491584909 F1-score multiplied: 0.373090015207 [161145 8624 103629 ..., 131598 77971 145710] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.450442477876 F1-OK: 0.899693102891 F1-score multiplied: 0.405259990594 Result from the previous epoch on test: F1-BAD: 0.428635749662 F1-OK: 0.897850760686 F1-score multiplied: 0.384850933891 [ 88180 37890 33658 ..., 138465 165899 187250] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.447284345048 F1-OK: 0.902738735845 F1-score multiplied: 0.403780904212 Result from the previous epoch on test: F1-BAD: 0.426259402781 F1-OK: 0.8989197221 F1-score multiplied: 0.38317298389 [ 95272 217111 176486 ..., 183877 161754 214087] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.444231689804 F1-OK: 0.90751214849 F1-score multiplied: 0.403145655241 Result from the previous epoch on test: F1-BAD: 0.417938931298 F1-OK: 0.902773350335 F1-score multiplied: 0.377304129243 [ 43428 23203 165494 ..., 87260 127806 73850] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.442669172932 F1-OK: 0.905226146716 F1-score multiplied: 0.400715709683 Result from the previous epoch on test: F1-BAD: 0.424341338307 F1-OK: 0.901236049442 F1-score multiplied: 0.382431711351 [204644 31141 103650 ..., 30090 81702 136580] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.459299681673 F1-OK: 0.904444265852 F1-score multiplied: 0.415410963397 Result from the previous epoch on test: F1-BAD: 0.426551094891 F1-OK: 0.899052361066 F1-score multiplied: 0.383491768977 [151463 159307 100073 ..., 99926 64887 45399] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.448275862069 F1-OK: 0.905249679898 F1-score multiplied: 0.405801580644 Result from the previous epoch on test: F1-BAD: 0.423960993731 F1-OK: 0.900684520235 F1-score multiplied: 0.381855104237 [ 77558 65635 39900 ..., 52102 175656 30661] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.458240285842 F1-OK: 0.902201080384 F1-score multiplied: 0.413424880962 Result from the previous epoch on test: F1-BAD: 0.43245673185 F1-OK: 0.898345344015 F1-score multiplied: 0.388495491545 [ 873 43953 181616 ..., 181234 7816 90895] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.459962756052 F1-OK: 0.907155434609 F1-score multiplied: 0.41725771387 Result from the previous epoch on test: F1-BAD: 0.422934076137 F1-OK: 0.900480384307 F1-score multiplied: 0.380843839417 [139636 198046 199708 ..., 32597 183833 57999] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.46160635481 F1-OK: 0.901422107304 F1-score multiplied: 0.416102173098 Result from the previous epoch on test: F1-BAD: 0.433962264151 F1-OK: 0.89567327133 F1-score multiplied: 0.388688400766 [ 48250 85392 96772 ..., 159417 47120 80258] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.454377880184 F1-OK: 0.905067350866 F1-score multiplied: 0.411242584311 Result from the previous epoch on test: F1-BAD: 0.423556581986 F1-OK: 0.899991986537 F1-score multiplied: 0.381197529633 [ 94976 169993 129145 ..., 212870 49486 180803] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.462169553327 F1-OK: 0.905205655527 F1-score multiplied: 0.418358493484 Result from the previous epoch on test: F1-BAD: 0.426460559218 F1-OK: 0.898629916831 F1-score multiplied: 0.383230216862 [188706 216106 14316 ..., 23716 33182 2019] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.461047835991 F1-OK: 0.904957017755 F1-score multiplied: 0.417228474701 Result from the previous epoch on test: F1-BAD: 0.428440786465 F1-OK: 0.899654812555 F1-score multiplied: 0.385448815439 [ 49555 204099 199462 ..., 142630 30997 94732] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.458553791887 F1-OK: 0.900759657346 F1-score multiplied: 0.413046756455 Result from the previous epoch on test: F1-BAD: 0.434724983433 F1-OK: 0.896651993054 F1-score multiplied: 0.389797022825 [ 10586 40093 110450 ..., 135123 16134 39003] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.46091278807 F1-OK: 0.904014804087 F1-score multiplied: 0.416671983809 Result from the previous epoch on test: F1-BAD: 0.432224485178 F1-OK: 0.89911134344 F1-score multiplied: 0.388617937536 [124016 93299 142951 ..., 121315 130112 138434] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.458813108946 F1-OK: 0.901324289406 F1-score multiplied: 0.413539399391 Result from the previous epoch on test: F1-BAD: 0.437569060773 F1-OK: 0.897225699633 F1-score multiplied: 0.39259820669 [ 9469 193383 39949 ..., 202484 63420 57130] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.460296096904 F1-OK: 0.903085474905 F1-score multiplied: 0.41568671927 Result from the previous epoch on test: F1-BAD: 0.436704621567 F1-OK: 0.898303035189 F1-score multiplied: 0.392293087035 [ 70289 17736 199270 ..., 16586 34471 159323] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.461059190031 F1-OK: 0.90229931424 F1-score multiplied: 0.416013390989 Result from the previous epoch on test: F1-BAD: 0.435612788632 F1-OK: 0.897433828276 F1-score multiplied: 0.390933652548 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrase - 72 features - deeper network
Using TensorFlow backend. 217872 14644 7321 2018-03-13 17:39:34.717750: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA epoch: 0 [157230 58090 106355 ..., 43269 152588 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.423357664234 F1-OK: 0.905855247478 F1-score multiplied: 0.383500761706 Result from the previous epoch on test: F1-BAD: 0.398635477583 F1-OK: 0.902001270648 F1-score multiplied: 0.359569707305 [ 10604 112260 2170 ..., 24253 38081 64020] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.437209302326 F1-OK: 0.903138008325 F1-score multiplied: 0.394860338524 Result from the previous epoch on test: F1-BAD: 0.414279004227 F1-OK: 0.900359568518 F1-score multiplied: 0.373000065492 [ 16587 157088 51334 ..., 99848 92538 64243] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.432203389831 F1-OK: 0.903658731427 F1-score multiplied: 0.390564366973 Result from the previous epoch on test: F1-BAD: 0.414870944826 F1-OK: 0.901416317574 F1-score multiplied: 0.373971439354 [ 97998 95754 98742 ..., 203012 213193 125451] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.457142857143 F1-OK: 0.896478815971 F1-score multiplied: 0.409818887301 Result from the previous epoch on test: F1-BAD: 0.437977909941 F1-OK: 0.892351505289 F1-score multiplied: 0.390830247219 [ 82707 140148 157986 ..., 51883 106201 103473] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.459955257271 F1-OK: 0.902716208592 F1-score multiplied: 0.415209065965 Result from the previous epoch on test: F1-BAD: 0.432685867381 F1-OK: 0.897577492039 F1-score multiplied: 0.388369095685 [ 96593 186600 181132 ..., 40532 34553 129546] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.45871559633 F1-OK: 0.899700477617 F1-score multiplied: 0.412706641109 Result from the previous epoch on test: F1-BAD: 0.442894507411 F1-OK: 0.896518218623 F1-score multiplied: 0.397062994822 [211235 108099 35584 ..., 173533 203627 154044] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.466895958727 F1-OK: 0.899317960377 F1-score multiplied: 0.419887921311 Result from the previous epoch on test: F1-BAD: 0.447357112162 F1-OK: 0.895591458959 F1-score multiplied: 0.400649208757 [ 44555 140306 112838 ..., 74919 150399 165017] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.472817133443 F1-OK: 0.895202226953 F1-score multiplied: 0.4232669508 Result from the previous epoch on test: F1-BAD: 0.456673511294 F1-OK: 0.891637316734 F1-score multiplied: 0.407187144233 [169730 20673 186182 ..., 67812 116880 108578] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.473604826546 F1-OK: 0.883569641368 F1-score multiplied: 0.418462846741 Result from the previous epoch on test: F1-BAD: 0.459065986009 F1-OK: 0.880786699446 F1-score multiplied: 0.404339214644 [ 41613 123879 70949 ..., 98250 105271 211104] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.477216238608 F1-OK: 0.896794242722 F1-score multiplied: 0.427964775317 Result from the previous epoch on test: F1-BAD: 0.456632134877 F1-OK: 0.890211368767 F1-score multiplied: 0.406499117812 [ 79978 62975 104982 ..., 106252 110351 75418] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.46980424823 F1-OK: 0.896005228331 F1-score multiplied: 0.420947062706 Result from the previous epoch on test: F1-BAD: 0.455461839128 F1-OK: 0.89163630409 F1-score multiplied: 0.406106310894 [ 78595 203579 77628 ..., 171197 169790 184869] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.473773265651 F1-OK: 0.898680566868 F1-score multiplied: 0.425770826942 Result from the previous epoch on test: F1-BAD: 0.445275181724 F1-OK: 0.890859314346 F1-score multiplied: 0.396677543086 [161145 8624 103629 ..., 131598 77971 145710] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.471590909091 F1-OK: 0.893085892593 F1-score multiplied: 0.421171187984 Result from the previous epoch on test: F1-BAD: 0.452669902913 F1-OK: 0.888843246796 F1-score multiplied: 0.402352586232 [ 88180 37890 33658 ..., 138465 165899 187250] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.469342743714 F1-OK: 0.902787878788 F1-score multiplied: 0.423716940022 Result from the previous epoch on test: F1-BAD: 0.445736434109 F1-OK: 0.895552670021 F1-score multiplied: 0.399180453692 [ 95272 217111 176486 ..., 183877 161754 214087] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.475998386446 F1-OK: 0.893200690619 F1-score multiplied: 0.425162087507 Result from the previous epoch on test: F1-BAD: 0.457667731629 F1-OK: 0.888138385502 F1-score multiplied: 0.406472280266 [ 43428 23203 165494 ..., 87260 127806 73850] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.47741364039 F1-OK: 0.904715762274 F1-score multiplied: 0.431923645585 Result from the previous epoch on test: F1-BAD: 0.437975233543 F1-OK: 0.895199513875 F1-score multiplied: 0.392075216157 [204644 31141 103650 ..., 30090 81702 136580] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.465201465201 F1-OK: 0.906244983143 F1-score multiplied: 0.42158649399 Result from the previous epoch on test: F1-BAD: 0.43466607103 F1-OK: 0.897988795292 F1-score multiplied: 0.390325261478 [151463 159307 100073 ..., 99926 64887 45399] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.470739000427 F1-OK: 0.899276481587 F1-score multiplied: 0.42332451205 Result from the previous epoch on test: F1-BAD: 0.450821376586 F1-OK: 0.892111605866 F1-score multiplied: 0.402182982225 [ 77558 65635 39900 ..., 52102 175656 30661] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.469037155414 F1-OK: 0.890518164593 F1-score multiplied: 0.417686106765 Result from the previous epoch on test: F1-BAD: 0.459522878373 F1-OK: 0.88566228179 F1-score multiplied: 0.406982080995 [ 873 43953 181616 ..., 181234 7816 90895] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.459902525476 F1-OK: 0.901574485264 F1-score multiplied: 0.414636382678 Result from the previous epoch on test: F1-BAD: 0.446748757831 F1-OK: 0.89614339592 F1-score multiplied: 0.400350948966 [139636 198046 199708 ..., 32597 183833 57999] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.473445862495 F1-OK: 0.895275526079 F1-score multiplied: 0.423864493615 Result from the previous epoch on test: F1-BAD: 0.454968629832 F1-OK: 0.889390890048 F1-score multiplied: 0.40464495463 [ 48250 85392 96772 ..., 159417 47120 80258] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.464985994398 F1-OK: 0.889895412995 F1-score multiplied: 0.413788903522 Result from the previous epoch on test: F1-BAD: 0.460726846424 F1-OK: 0.885808853951 F1-score multiplied: 0.408115919816 [ 94976 169993 129145 ..., 212870 49486 180803] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.468534680753 F1-OK: 0.907180104292 F1-score multiplied: 0.42504534055 Result from the previous epoch on test: F1-BAD: 0.43527036123 F1-OK: 0.898634771052 F1-score multiplied: 0.391149081409 [188706 216106 14316 ..., 23716 33182 2019] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.460669274229 F1-OK: 0.899440888097 F1-score multiplied: 0.414344781131 Result from the previous epoch on test: F1-BAD: 0.44917756221 F1-OK: 0.893587549906 F1-score multiplied: 0.401379477288 [ 49555 204099 199462 ..., 142630 30997 94732] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.473817567568 F1-OK: 0.898484601597 F1-score multiplied: 0.425717788426 Result from the previous epoch on test: F1-BAD: 0.452837977296 F1-OK: 0.891543591212 F1-score multiplied: 0.403724796516 [ 10586 40093 110450 ..., 135123 16134 39003] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.449079754601 F1-OK: 0.889563007297 F1-score multiplied: 0.399484737019 Result from the previous epoch on test: F1-BAD: 0.452755122339 F1-OK: 0.886608136515 F1-score multiplied: 0.401416375315 [124016 93299 142951 ..., 121315 130112 138434] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.458172458172 F1-OK: 0.897408821379 F1-score multiplied: 0.411168005677 Result from the previous epoch on test: F1-BAD: 0.446228607648 F1-OK: 0.893260028507 F1-score multiplied: 0.398598178789 [ 9469 193383 39949 ..., 202484 63420 57130] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.476735316552 F1-OK: 0.885856905158 F1-score multiplied: 0.422319272101 Result from the previous epoch on test: F1-BAD: 0.461538461538 F1-OK: 0.880564014851 F1-score multiplied: 0.406414160701 [ 70289 17736 199270 ..., 16586 34471 159323] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.462940943321 F1-OK: 0.888192095057 F1-score multiplied: 0.411180486336 Result from the previous epoch on test: F1-BAD: 0.464513633727 F1-OK: 0.885184724468 F1-score multiplied: 0.411180372882 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrases 72 features - another attempt to train matern 32 and 52 - deep model
0 [157230 58090 106355 ..., 43269 152588 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.421563865954 F1-OK: 0.905348486053 F1-score multiplied: 0.381662207816 Result from the previous epoch on test: F1-BAD: 0.399420429848 F1-OK: 0.901101523044 F1-score multiplied: 0.359918357671 [ 10604 112260 2170 ..., 24253 38081 64020] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.449633699634 F1-OK: 0.903515813132 F1-score multiplied: 0.406251157736 Result from the previous epoch on test: F1-BAD: 0.424172794118 F1-OK: 0.899502726981 F1-score multiplied: 0.38154458502 [ 16587 157088 51334 ..., 99848 92538 64243] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.443510737628 F1-OK: 0.90464 F1-score multiplied: 0.401217553688 Result from the previous epoch on test: F1-BAD: 0.416608022519 F1-OK: 0.900619380619 F1-score multiplied: 0.375205259202 [ 97998 95754 98742 ..., 203012 213193 125451] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.469413233458 F1-OK: 0.895824822289 F1-score multiplied: 0.420512026443 Result from the previous epoch on test: F1-BAD: 0.441328108888 F1-OK: 0.889152583985 F1-score multiplied: 0.392408028403 [ 82707 140148 157986 ..., 51883 106201 103473] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.46393588602 F1-OK: 0.902871894159 F1-score multiplied: 0.418874672179 Result from the previous epoch on test: F1-BAD: 0.431188561215 F1-OK: 0.897388360471 F1-score multiplied: 0.386943596003 [ 96593 186600 181132 ..., 40532 34553 129546] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.461329715061 F1-OK: 0.904191135066 F1-score multiplied: 0.417130238701 Result from the previous epoch on test: F1-BAD: 0.427963253417 F1-OK: 0.897160120846 F1-score multiplied: 0.383951564153 [211235 108099 35584 ..., 173533 203627 154044] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.459854014599 F1-OK: 0.904899598394 F1-score multiplied: 0.41612171313 Result from the previous epoch on test: F1-BAD: 0.433821871477 F1-OK: 0.898965919607 F1-score multiplied: 0.389991077638 [ 44555 140306 112838 ..., 74919 150399 165017] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.466638334042 F1-OK: 0.897876149402 F1-score multiplied: 0.418983430533 Result from the previous epoch on test: F1-BAD: 0.448421052632 F1-OK: 0.893226831853 F1-score multiplied: 0.400541716178 [169730 20673 186182 ..., 67812 116880 108578] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.477704536642 F1-OK: 0.888336234767 F1-score multiplied: 0.424362249412 Result from the previous epoch on test: F1-BAD: 0.451014492754 F1-OK: 0.882179737071 F1-score multiplied: 0.397875846633 [ 41613 123879 70949 ..., 98250 105271 211104] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.472336911643 F1-OK: 0.895417348609 F1-score multiplied: 0.422938665074 Result from the previous epoch on test: F1-BAD: 0.446443172527 F1-OK: 0.888998196426 F1-score multiplied: 0.396887175183 [ 79978 62975 104982 ..., 106252 110351 75418] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.468708388815 F1-OK: 0.903382032448 F1-score multiplied: 0.423422736913 Result from the previous epoch on test: F1-BAD: 0.442835198596 F1-OK: 0.897335328131 F1-score multiplied: 0.39737166824 [ 78595 203579 77628 ..., 171197 169790 184869] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.474325500435 F1-OK: 0.902138690862 F1-score multiplied: 0.427907386005 Result from the previous epoch on test: F1-BAD: 0.440450411434 F1-OK: 0.895257397649 F1-score multiplied: 0.394316489133 [161145 8624 103629 ..., 131598 77971 145710] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.476389469285 F1-OK: 0.897705935178 F1-score multiplied: 0.427657654034 Result from the previous epoch on test: F1-BAD: 0.452877397832 F1-OK: 0.892862975666 F1-score multiplied: 0.40435746104 [ 88180 37890 33658 ..., 138465 165899 187250] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.480653482373 F1-OK: 0.901916206561 F1-score multiplied: 0.433509165492 Result from the previous epoch on test: F1-BAD: 0.449553001277 F1-OK: 0.894835298902 F1-score multiplied: 0.40227589427 [ 95272 217111 176486 ..., 183877 161754 214087] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.477947072975 F1-OK: 0.892821863681 F1-score multiplied: 0.426721596435 Result from the previous epoch on test: F1-BAD: 0.459126984127 F1-OK: 0.887578356978 F1-score multiplied: 0.407511174216 [ 43428 23203 165494 ..., 87260 127806 73850] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.466609589041 F1-OK: 0.898748577929 F1-score multiplied: 0.419364704599 Result from the previous epoch on test: F1-BAD: 0.45172195225 F1-OK: 0.894318875993 F1-score multiplied: 0.403983468598 [204644 31141 103650 ..., 30090 81702 136580] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.471359860079 F1-OK: 0.902144880615 F1-score multiplied: 0.425234884697 Result from the previous epoch on test: F1-BAD: 0.446305841924 F1-OK: 0.895339395908 F1-score multiplied: 0.399595202899 [151463 159307 100073 ..., 99926 64887 45399] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.466780238501 F1-OK: 0.898161704897 F1-score multiplied: 0.419244134824 Result from the previous epoch on test: F1-BAD: 0.45443196005 F1-OK: 0.892900906789 F1-score multiplied: 0.405762709202 [ 77558 65635 39900 ..., 52102 175656 30661] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.48 F1-OK: 0.892933618844 F1-score multiplied: 0.428608137045 Result from the previous epoch on test: F1-BAD: 0.457967622391 F1-OK: 0.884979926328 F1-score multiplied: 0.405292152724 [ 873 43953 181616 ..., 181234 7816 90895] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.468911917098 F1-OK: 0.900210936232 F1-score multiplied: 0.422119635902 Result from the previous epoch on test: F1-BAD: 0.453664700927 F1-OK: 0.894295028525 F1-score multiplied: 0.405710086656 [139636 198046 199708 ..., 32597 183833 57999] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.469729497638 F1-OK: 0.899699504589 F1-score multiplied: 0.422615396316 Result from the previous epoch on test: F1-BAD: 0.455291394908 F1-OK: 0.894477277359 F1-score multiplied: 0.407247807323 [ 48250 85392 96772 ..., 159417 47120 80258] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.466409927257 F1-OK: 0.898659081674 F1-score multiplied: 0.419143516913 Result from the previous epoch on test: F1-BAD: 0.452587991718 F1-OK: 0.891896312045 F1-score multiplied: 0.40366156069 [ 94976 169993 129145 ..., 212870 49486 180803] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.455719557196 F1-OK: 0.905403238737 F1-score multiplied: 0.41260996304 Result from the previous epoch on test: F1-BAD: 0.435553534894 F1-OK: 0.900237052513 F1-score multiplied: 0.392101430465 [188706 216106 14316 ..., 23716 33182 2019] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.454503033131 F1-OK: 0.906472517801 F1-score multiplied: 0.411994508791 Result from the previous epoch on test: F1-BAD: 0.43558000917 F1-OK: 0.901227633796 F1-score multiplied: 0.392556740993 [ 49555 204099 199462 ..., 142630 30997 94732] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.47717348154 F1-OK: 0.89136352388 F1-score multiplied: 0.425335036008 Result from the previous epoch on test: F1-BAD: 0.459653898503 F1-OK: 0.884903706772 F1-score multiplied: 0.406749438617 [ 10586 40093 110450 ..., 135123 16134 39003] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.46909537454 F1-OK: 0.89367980982 F1-score multiplied: 0.419221065106 Result from the previous epoch on test: F1-BAD: 0.458649620455 F1-OK: 0.888394695659 F1-score multiplied: 0.407461889979 [124016 93299 142951 ..., 121315 130112 138434] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.470541401274 F1-OK: 0.890354492993 F1-score multiplied: 0.418948650763 Result from the previous epoch on test: F1-BAD: 0.458253174298 F1-OK: 0.883105022831 F1-score multiplied: 0.404685679951 [ 9469 193383 39949 ..., 202484 63420 57130] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.473597359736 F1-OK: 0.895563922082 F1-score multiplied: 0.424136708973 Result from the previous epoch on test: F1-BAD: 0.457739409757 F1-OK: 0.888879746575 F1-score multiplied: 0.406875290542 [ 70289 17736 199270 ..., 16586 34471 159323] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.473264166002 F1-OK: 0.891232696111 F1-score multiplied: 0.421788498638 Result from the previous epoch on test: F1-BAD: 0.461449498843 F1-OK: 0.884066390041 F1-score multiplied: 0.407951992629 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern 32 - phrase - 72 features - with pretraining
Epoch 1: \Dev set LL -0.5317967134389773, Acc 0.8441469669342041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.445847498786 F1-OK: 0.909322101248 F1-score multiplied: 0.405418984432 Epoch 1: Test set LL -0.5643179174809212, Acc 0.8339251279830933, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.417624521073 F1-OK: 0.903153870659 F1-score multiplied: 0.377179202689 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.7414332546495933, Acc 0.8326731324195862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475823705605 F1-OK: 0.900446972775 F1-score multiplied: 0.428454015287 Epoch 2: Test set LL -0.7922857995033465, Acc 0.8214285969734192, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447262735151 F1-OK: 0.893513051268 F1-score multiplied: 0.399635091204 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.822730959338397, Acc 0.842644453048706, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.483408071749 F1-OK: 0.907186593619 F1-score multiplied: 0.438541321938 Epoch 3: Test set LL -0.8806207300139655, Acc 0.8286670446395874, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446014572753 F1-OK: 0.898663112404 F1-score multiplied: 0.400816844128 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9046720874178723, Acc 0.8295314908027649, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.495553759095 F1-OK: 0.897435897436 F1-score multiplied: 0.444727732521 Epoch 4: Test set LL -0.973457398827871, Acc 0.8141900897026062, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4578601315 F1-OK: 0.887881659731 F1-score multiplied: 0.406525613481 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.9021023607794195, Acc 0.8401857614517212, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479537366548 F1-OK: 0.905599483621 F1-score multiplied: 0.434268791523 Epoch 5: Test set LL -0.9764071977918957, Acc 0.8279158473014832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444689290436 F1-OK: 0.898181818182 F1-score multiplied: 0.39941183541 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9432990488379764, Acc 0.8354049921035767, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.49134655973 F1-OK: 0.901816996659 F1-score multiplied: 0.443104678814 Epoch 6: Test set LL -1.0160416595664115, Acc 0.821906566619873, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451178451178 F1-OK: 0.893707205739 F1-score multiplied: 0.403221432892 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9431846219489657, Acc 0.8427810668945312, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479891549932 F1-OK: 0.907393997908 F1-score multiplied: 0.435450712055 Epoch 7: Test set LL -1.0101934478071657, Acc 0.8294181823730469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444888888889 F1-OK: 0.89922543166 F1-score multiplied: 0.400055403152 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -1.0172457582508028, Acc 0.8281655311584473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482730263158 F1-OK: 0.89696969697 F1-score multiplied: 0.432994417863 Epoch 8: Test set LL -1.0901821304376451, Acc 0.8162387609481812, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458442342524 F1-OK: 0.889345779021 F1-score multiplied: 0.407713762248 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0096187677743234, Acc 0.8323999643325806, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475865014951 F1-OK: 0.900252012032 F1-score multiplied: 0.428398437165 Epoch 9: Test set LL -1.0729610610574134, Acc 0.8224529027938843, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450781580059 F1-OK: 0.894110939155 F1-score multiplied: 0.4030487419 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9806860989110072, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482606781154 F1-OK: 0.905019804381 F1-score multiplied: 0.436768694673 Epoch 10: Test set LL -1.0672185837822787, Acc 0.8277792930603027, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451023073574 F1-OK: 0.897869927918 F1-score multiplied: 0.404960054559 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -1.0342771848170167, Acc 0.8303510546684265, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476832350463 F1-OK: 0.898761004239 F1-score multiplied: 0.428558322156 Epoch 11: Test set LL -1.1117654572047784, Acc 0.8182190656661987, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457399103139 F1-OK: 0.890821097531 F1-score multiplied: 0.407460771068 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0294109248256922, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485799067401 F1-OK: 0.901245624033 F1-score multiplied: 0.437824283655 Epoch 12: Test set LL -1.1032648979477784, Acc 0.8220431804656982, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456403838131 F1-OK: 0.893606597534 F1-score multiplied: 0.407845480894 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0292192596211092, Acc 0.8318535685539246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485582950272 F1-OK: 0.899502000163 F1-score multiplied: 0.436782835015 Epoch 13: Test set LL -1.1173749529942627, Acc 0.8178776502609253, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.454935622318 F1-OK: 0.890674318508 F1-score multiplied: 0.405199475373 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0051843695959282, Acc 0.8412784934043884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.47277676951 F1-OK: 0.906576620035 F1-score multiplied: 0.428608365734 Epoch 14: Test set LL -1.0749299691493688, Acc 0.8292816281318665, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447147279965 F1-OK: 0.899055156263 F1-score multiplied: 0.402010067661 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.9827034614185041, Acc 0.8452396988868713, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481938728852 F1-OK: 0.909032517061 F1-score multiplied: 0.438097975758 Epoch 15: Test set LL -1.0720398935261657, Acc 0.8315351009368896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44399368943 F1-OK: 0.900728340912 F1-score multiplied: 0.399917699255 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0336514923620046, Acc 0.8334926962852478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476149548775 F1-OK: 0.90101502233 F1-score multiplied: 0.429017896322 Epoch 16: Test set LL -1.1146243445697819, Acc 0.8216334581375122, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457415870378 F1-OK: 0.893274495383 F1-score multiplied: 0.408597930792 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0335432323332616, Acc 0.8373172879219055, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476022877255 F1-OK: 0.903710890129 F1-score multiplied: 0.430187058125 Epoch 17: Test set LL -1.0960867820434046, Acc 0.8261404037475586, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449156209433 F1-OK: 0.896780994081 F1-score multiplied: 0.402794751993 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0802811821178793, Acc 0.8284387588500977, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.484823625923 F1-OK: 0.897082923632 F1-score multiplied: 0.434926995789 Epoch 18: Test set LL -1.1513586119913428, Acc 0.816511869430542, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458156886469 F1-OK: 0.889555674298 F1-score multiplied: 0.407556058077 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0281657284548515, Acc 0.8393661975860596, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.488250652742 F1-OK: 0.904731043422 F1-score multiplied: 0.441735522506 Epoch 19: Test set LL -1.1127050801873026, Acc 0.8255941271781921, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460726351351 F1-OK: 0.895975887911 F1-score multiplied: 0.412799701736 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0510074391165014, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482142857143 F1-OK: 0.900895036615 F1-score multiplied: 0.434360106939 Epoch 20: Test set LL -1.1379515722434475, Acc 0.8206091523170471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.455544041451 F1-OK: 0.892613334423 F1-score multiplied: 0.406624685816 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0147181641131544, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.492816717458 F1-OK: 0.90562980964 F1-score multiplied: 0.446309510018 Epoch 21: Test set LL -1.1018311788934476, Acc 0.8279158473014832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461768475011 F1-OK: 0.897585954645 F1-score multiplied: 0.414476897468 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0201790815308003, Acc 0.8389564156532288, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479470198675 F1-OK: 0.904742667852 F1-score multiplied: 0.433797146705 Epoch 22: Test set LL -1.1266974187233887, Acc 0.8242966532707214, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451034777043 F1-OK: 0.89541075566 F1-score multiplied: 0.403861390541 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0064083248866522, Acc 0.84209805727005, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481149012567 F1-OK: 0.906879329789 F1-score multiplied: 0.436344094046 Epoch 23: Test set LL -1.1146642344517816, Acc 0.8261404037475586, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441666666667 F1-OK: 0.897039792947 F1-score multiplied: 0.396192575218 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0099869041758414, Acc 0.842644453048706, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476839237057 F1-OK: 0.907395498392 F1-score multiplied: 0.432681777163 Epoch 24: Test set LL -1.0930057723607995, Acc 0.830442488193512, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446870126977 F1-OK: 0.899874994959 F1-score multiplied: 0.402127253261 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0230482273660328, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481464939705 F1-OK: 0.906393614448 F1-score multiplied: 0.436396746929 Epoch 25: Test set LL -1.104279161752242, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.455001089562 F1-OK: 0.89874083971 F1-score multiplied: 0.408928061302 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0208072650859756, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.484714222419 F1-OK: 0.906096083973 F1-score multiplied: 0.43919765878 Epoch 26: Test set LL -1.1172976454888421, Acc 0.826072096824646, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.453785116878 F1-OK: 0.896568527919 F1-score multiplied: 0.40684945423 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.01891367264576, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485091232755 F1-OK: 0.906655909641 F1-score multiplied: 0.439810832892 Epoch 27: Test set LL -1.11134793738784, Acc 0.8270964026451111, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45595186936 F1-OK: 0.897215230982 F1-score multiplied: 0.409086961784 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0167251025134512, Acc 0.8431908488273621, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478181818182 F1-OK: 0.907731875904 F1-score multiplied: 0.434060878841 Epoch 28: Test set LL -1.104578262022107, Acc 0.8299645185470581, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.453227931489 F1-OK: 0.89932885906 F1-score multiplied: 0.40760095852 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0650517178654968, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.49292256453 F1-OK: 0.900490196078 F1-score multiplied: 0.443871936785 Epoch 29: Test set LL -1.168633653858893, Acc 0.8166484832763672, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.457027300303 F1-OK: 0.889701351518 F1-score multiplied: 0.40661780676 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
phrase with Matern 52 - pretraining - 72 features
Epoch 1: \Dev set LL -0.5886904706076116, Acc 0.847152054309845, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419906687403 F1-OK: 0.911979863132 F1-score multiplied: 0.382946443306 Epoch 1: Test set LL -0.6218492284270157, Acc 0.836042046546936, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388591800357 F1-OK: 0.905327077008 F1-score multiplied: 0.351802678766 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.7242870865098034, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477732793522 F1-OK: 0.906514212094 F1-score multiplied: 0.433071566911 Epoch 2: Test set LL -0.7758411213946459, Acc 0.8255258202552795, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434108527132 F1-OK: 0.896863520769 F1-score multiplied: 0.389336102039 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.8333930505171782, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474329850068 F1-OK: 0.907001044932 F1-score multiplied: 0.430217669654 Epoch 3: Test set LL -0.884630591843767, Acc 0.8296913504600525, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.439550561798 F1-OK: 0.899589338916 F1-score multiplied: 0.395414999308 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9196170201539091, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.483193277311 F1-OK: 0.899690099494 F1-score multiplied: 0.434724207739 Epoch 4: Test set LL -0.9795385583352432, Acc 0.8180825114250183, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452977412731 F1-OK: 0.890900155623 F1-score multiplied: 0.403557647496 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.9309618816213984, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.495874587459 F1-OK: 0.899983630709 F1-score multiplied: 0.446279011597 Epoch 5: Test set LL -1.0070181076861324, Acc 0.8177410364151001, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460699131138 F1-OK: 0.890340605612 F1-score multiplied: 0.410179143422 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9441419800394448, Acc 0.8407321572303772, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.486343612335 F1-OK: 0.905754930488 F1-score multiplied: 0.440508124784 Epoch 6: Test set LL -0.9927683936983358, Acc 0.8277792930603027, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451739130435 F1-OK: 0.897845106935 F1-score multiplied: 0.405591767872 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9378020719555039, Acc 0.8431908488273621, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473877176902 F1-OK: 0.907865168539 F1-score multiplied: 0.430216583075 Epoch 7: Test set LL -1.0077464988533336, Acc 0.830442488193512, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444891571652 F1-OK: 0.89993955269 F1-score multiplied: 0.400375521988 [ 44555 140306 112838 ..., 74919 150399 165017]
Epoch 8: \Dev set LL -0.9768918776571536, Acc 0.8374539017677307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478527607362 F1-OK: 0.903721682848 F1-score multiplied: 0.432455774614 Epoch 8: Test set LL -1.0372929614513189, Acc 0.8285304307937622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460116104064 F1-OK: 0.898080123392 F1-score multiplied: 0.413221127512 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0226507796747784, Acc 0.8302144408226013, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482729920932 F1-OK: 0.898439414985 F1-score multiplied: 0.433703587758 Epoch 9: Test set LL -1.079272649095397, Acc 0.820882260799408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459732234809 F1-OK: 0.892645192977 F1-score multiplied: 0.410377769459 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9833795362607404, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472448057814 F1-OK: 0.906018667525 F1-score multiplied: 0.428046759815 Epoch 10: Test set LL -1.045458423237323, Acc 0.8286670446395874, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445279681627 F1-OK: 0.898687664042 F1-score multiplied: 0.400167356927 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -1.0179005733793314, Acc 0.8348585963249207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469038208169 F1-OK: 0.90222401941 F1-score multiplied: 0.423177537431 Epoch 11: Test set LL -1.063672038101324, Acc 0.8281207084655762, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458360232408 F1-OK: 0.897853171543 F1-score multiplied: 0.411540188377 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0687241642840206, Acc 0.8280289769172668, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480396203054 F1-OK: 0.896963744987 F1-score multiplied: 0.430897977369 Epoch 12: Test set LL -1.1302291183884479, Acc 0.8165801763534546, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458686013704 F1-OK: 0.889583162049 F1-score multiplied: 0.408039354459 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0102787236289477, Acc 0.8381368517875671, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475431606906 F1-OK: 0.904304288137 F1-score multiplied: 0.429934840841 Epoch 13: Test set LL -1.0732465130443738, Acc 0.8290084600448608, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4568329718 F1-OK: 0.898533106411 F1-score multiplied: 0.410479549263 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0102172951885864, Acc 0.8399125933647156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485061511424 F1-OK: 0.905224001294 F1-score multiplied: 0.439089322244 Epoch 14: Test set LL -1.092741027894261, Acc 0.825867235660553, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459287531807 F1-OK: 0.896223343643 F1-score multiplied: 0.411624207449 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.017819369350204, Acc 0.8389564156532288, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479470198675 F1-OK: 0.904742667852 F1-score multiplied: 0.433797146705 Epoch 15: Test set LL -1.0782003463422094, Acc 0.8266184329986572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449360225548 F1-OK: 0.897110669855 F1-score multiplied: 0.403125852947 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.002304406720373, Acc 0.8423712849617004, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461753731343 F1-OK: 0.907665226436 F1-score multiplied: 0.419117805117 Epoch 16: Test set LL -1.055083966857053, Acc 0.8336520195007324, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442817932296 F1-OK: 0.902231497833 F1-score multiplied: 0.399524286323 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.9913352223501327, Acc 0.8437371850013733, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466417910448 F1-OK: 0.908465354457 F1-score multiplied: 0.42372451234 Epoch 17: Test set LL -1.052630045922301, Acc 0.8344031572341919, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445207046442 F1-OK: 0.902676887266 F1-score multiplied: 0.401878110871 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0675908312926887, Acc 0.8308973908424377, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481574539363 F1-OK: 0.898971764322 F1-score multiplied: 0.432921913304 Epoch 18: Test set LL -1.1200798368334022, Acc 0.8206091523170471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.462011058775 F1-OK: 0.892358123335 F1-score multiplied: 0.412279321369 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0456840858590288, Acc 0.8334926962852478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479726845924 F1-OK: 0.900886250915 F1-score multiplied: 0.432179319688 Epoch 19: Test set LL -1.1185648564903359, Acc 0.8248429298400879, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459203036053 F1-OK: 0.895498064779 F1-score multiplied: 0.411215430126 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0032031673293027, Acc 0.84209805727005, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477868112014 F1-OK: 0.90698422916 F1-score multiplied: 0.433418841216 Epoch 20: Test set LL -1.0791478114854969, Acc 0.8320131301879883, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451137884873 F1-OK: 0.900830444247 F1-score multiplied: 0.406398741247 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0635306245103435, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.48433530906 F1-OK: 0.900814332248 F1-score multiplied: 0.436296188015 Epoch 21: Test set LL -1.1171551718428436, Acc 0.8241600394248962, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464322862492 F1-OK: 0.894816388219 F1-score multiplied: 0.415483706783 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0267701772978315, Acc 0.8380002975463867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477533039648 F1-OK: 0.90413837698 F1-score multiplied: 0.431755947421 Epoch 22: Test set LL -1.0907690872504385, Acc 0.8287352919578552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456907752274 F1-OK: 0.898338062424 F1-score multiplied: 0.410457624884 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0300583703643325, Acc 0.8382734656333923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461328480437 F1-OK: 0.904853744777 F1-score multiplied: 0.417434803095 Epoch 23: Test set LL -1.0943273109255305, Acc 0.8305107951164246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440990990991 F1-OK: 0.900112685126 F1-score multiplied: 0.396941585017 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0320721784201043, Acc 0.8374539017677307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478070175439 F1-OK: 0.903737259343 F1-score multiplied: 0.432049830125 Epoch 24: Test set LL -1.0998241086417961, Acc 0.8289401531219482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.459546925566 F1-OK: 0.898389648319 F1-score multiplied: 0.412852200845 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0736388090539843, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46288209607 F1-OK: 0.900420984456 F1-score multiplied: 0.41678875263 Epoch 25: Test set LL -1.1065006295080897, Acc 0.8273012638092041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4567132116 F1-OK: 0.897332846182 F1-score multiplied: 0.409823766054 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.053831890048353, Acc 0.835131824016571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478166882836 F1-OK: 0.902100738097 F1-score multiplied: 0.43135469794 Epoch 26: Test set LL -1.111943750508736, Acc 0.8260038495063782, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458793542906 F1-OK: 0.896338486574 F1-score multiplied: 0.411234309898 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0234836347724807, Acc 0.8407321572303772, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480854853072 F1-OK: 0.905937399161 F1-score multiplied: 0.435624394966 Epoch 27: Test set LL -1.0836094275733468, Acc 0.8309205174446106, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461036134088 F1-OK: 0.899732728598 F1-score multiplied: 0.414809298905 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0116532457223018, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468534680753 F1-OK: 0.907180104292 F1-score multiplied: 0.42504534055 Epoch 28: Test set LL -1.0724263136716359, Acc 0.8333788514137268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.454626732231 F1-OK: 0.901668412993 F1-score multiplied: 0.409922564154 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0534986115604152, Acc 0.8360879421234131, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477806788512 F1-OK: 0.902786779002 F1-score multiplied: 0.431357651586 Epoch 29: Test set LL -1.1307988660213832, Acc 0.8246380686759949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.454545454545 F1-OK: 0.895524816924 F1-score multiplied: 0.407056734966 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern52 from scratch - phrase 72 features
Epoch 1: \Dev set LL -0.6964280706933401, Acc 0.8313071727752686, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.400194269063 F1-OK: 0.901851704681 F1-score multiplied: 0.360915883758 Epoch 1: Test set LL -0.7269325071410395, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389704113543 F1-OK: 0.899048983327 F1-score multiplied: 0.35036308708 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.8398386819371361, Acc 0.8382734656333923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.423563777994 F1-OK: 0.905942167143 F1-score multiplied: 0.383724286959 Epoch 2: Test set LL -0.8893474096376841, Acc 0.8300327658653259, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.393666260658 F1-OK: 0.901163483302 F1-score multiplied: 0.354757658713 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.8870523748508732, Acc 0.8498839139938354, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405624661979 F1-OK: 0.914093644962 F1-score multiplied: 0.370778925755 Epoch 3: Test set LL -0.9555119836436368, Acc 0.8390467166900635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366568126848 F1-OK: 0.907810849924 F1-score multiplied: 0.332774522788 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9554108302391628, Acc 0.8347220420837402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462222222222 F1-OK: 0.902356358941 F1-score multiplied: 0.417089161466 Epoch 4: Test set LL -1.0268548144029865, Acc 0.8225894570350647, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.426743159753 F1-OK: 0.895055744062 F1-score multiplied: 0.381958916376 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.9777564988170486, Acc 0.8349952101707458, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461675579323 F1-OK: 0.902564929827 F1-score multiplied: 0.416692186854 Epoch 5: Test set LL -1.0493239048071066, Acc 0.8241600394248962, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.426631039857 F1-OK: 0.89615679316 F1-score multiplied: 0.382328304541 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.991246149469982, Acc 0.8373172879219055, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.439001413095 F1-OK: 0.904864605799 F1-score multiplied: 0.397236840605 Epoch 6: Test set LL -1.0338458799527435, Acc 0.8291450142860413, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.411016949153 F1-OK: 0.900079872204 F1-score multiplied: 0.369948083067 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.978107286374424, Acc 0.8403223752975464, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.455011655012 F1-OK: 0.906457549812 F1-score multiplied: 0.412448749938 Epoch 7: Test set LL -1.0485034224996772, Acc 0.8288719058036804, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.421781264421 F1-OK: 0.899575218402 F1-score multiplied: 0.379423973059 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -1.0253391857330956, Acc 0.8313071727752686, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462342185459 F1-OK: 0.899959497772 F1-score multiplied: 0.416089241025 Epoch 8: Test set LL -1.0894925160107165, Acc 0.8225211501121521, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440955044096 F1-OK: 0.894516822923 F1-score multiplied: 0.394441705096 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0184721073022156, Acc 0.834585428237915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472331154684 F1-OK: 0.901919494614 F1-score multiplied: 0.426004676323 Epoch 9: Test set LL -1.0967052816775087, Acc 0.8234089016914368, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441950798446 F1-OK: 0.895108298856 F1-score multiplied: 0.395593827375 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9930524127954933, Acc 0.842644453048706, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456090651558 F1-OK: 0.908016608112 F1-score multiplied: 0.41413788642 Epoch 10: Test set LL -1.0612854628375026, Acc 0.8326277136802673, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.419881656805 F1-OK: 0.902206439772 F1-score multiplied: 0.378819934711 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9953476371206811, Acc 0.8423712849617004, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.457706766917 F1-OK: 0.907783282723 F1-score multiplied: 0.415498551397 Epoch 11: Test set LL -1.0778914939977369, Acc 0.8316716551780701, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.423391812865 F1-OK: 0.901451245352 F1-score multiplied: 0.38166707698 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0200978035209314, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475593372145 F1-OK: 0.9056330083 F1-score multiplied: 0.430713056344 Epoch 12: Test set LL -1.1125243366866848, Acc 0.826276957988739, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43163538874 F1-OK: 0.897468966629 F1-score multiplied: 0.387379366293 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0346106626092597, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471162377995 F1-OK: 0.903777849532 F1-score multiplied: 0.425826120764 Epoch 13: Test set LL -1.0981204387061927, Acc 0.825867235660553, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438325991189 F1-OK: 0.896961370616 F1-score multiplied: 0.393161481834 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.993435770460614, Acc 0.8429176211357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.451335877863 F1-OK: 0.908337318667 F1-score multiplied: 0.409965221116 Epoch 14: Test set LL -1.0569575186981066, Acc 0.8320131301879883, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.423347398031 F1-OK: 0.901686515866 F1-score multiplied: 0.381726640331 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.0385346888882288, Acc 0.8360879421234131, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470432480141 F1-OK: 0.903038138332 F1-score multiplied: 0.424818471078 Epoch 15: Test set LL -1.1021082375516742, Acc 0.8270964026451111, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446194225722 F1-OK: 0.897556238874 F1-score multiplied: 0.400484411046 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0595034438506457, Acc 0.8358147740364075, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465302491103 F1-OK: 0.903017589156 F1-score multiplied: 0.420176333744 Epoch 16: Test set LL -1.1287622433191273, Acc 0.825867235660553, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438325991189 F1-OK: 0.896961370616 F1-score multiplied: 0.393161481834 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0610870234125138, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465502183406 F1-OK: 0.900906735751 F1-score multiplied: 0.419374052538 Epoch 17: Test set LL -1.1356006347772674, Acc 0.8241600394248962, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443964586482 F1-OK: 0.895567181733 F1-score multiplied: 0.397600113505 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0504506524315025, Acc 0.8356781601905823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459325842697 F1-OK: 0.903116694854 F1-score multiplied: 0.414824836917 Epoch 18: Test set LL -1.1021616330897601, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440489432703 F1-OK: 0.898560077441 F1-score multiplied: 0.395806218762 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0473255515813522, Acc 0.8373172879219055, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46230248307 F1-OK: 0.904160296129 F1-score multiplied: 0.417995549994 Epoch 19: Test set LL -1.1029759300845625, Acc 0.8281890153884888, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441385435169 F1-OK: 0.898482892189 F1-score multiplied: 0.39657726236 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0364493591720105, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478935698448 F1-OK: 0.905142488092 F1-score multiplied: 0.433505049729 Epoch 20: Test set LL -1.125530914404405, Acc 0.8243649005889893, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430217102348 F1-OK: 0.896181480584 F1-score multiplied: 0.385552599755 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0977898774793768, Acc 0.8292583227157593, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.47168216399 F1-OK: 0.898175301401 F1-score multiplied: 0.423653269807 Epoch 21: Test set LL -1.1435918655425994, Acc 0.8217700123786926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452141057935 F1-OK: 0.893573642146 F1-score multiplied: 0.404021331902 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0331798002745463, Acc 0.8415517210960388, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.457436856876 F1-OK: 0.9072296865 F1-score multiplied: 0.415000296257 Epoch 22: Test set LL -1.0922679410987661, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43084004603 F1-OK: 0.900853946999 F1-score multiplied: 0.388123955991 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.036878709384679, Acc 0.8388198614120483, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475088967972 F1-OK: 0.904792641601 F1-score multiplied: 0.429857002326 Epoch 23: Test set LL -1.1178248708627492, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442489553552 F1-OK: 0.897538498848 F1-score multiplied: 0.397151409651 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0257761215309138, Acc 0.8422346711158752, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467496542185 F1-OK: 0.907399983965 F1-score multiplied: 0.424206354883 Epoch 24: Test set LL -1.0981794339568416, Acc 0.830647349357605, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434306569343 F1-OK: 0.900417603598 F1-score multiplied: 0.391057280395 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0706503780950614, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462014134276 F1-OK: 0.901599612215 F1-score multiplied: 0.416551764301 Epoch 25: Test set LL -1.1164638219592415, Acc 0.8266184329986572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448642779587 F1-OK: 0.897135680428 F1-score multiplied: 0.402493445334 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0603861197095759, Acc 0.8369075059890747, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456284153005 F1-OK: 0.904065563233 F1-score multiplied: 0.412510789781 Epoch 26: Test set LL -1.1229357640649666, Acc 0.8259355425834656, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.435187236871 F1-OK: 0.897114026236 F1-score multiplied: 0.390412574236 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0129277604177247, Acc 0.8441469669342041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466073935423 F1-OK: 0.908756497401 F1-score multiplied: 0.423547717085 Epoch 27: Test set LL -1.0806745965944973, Acc 0.8335154056549072, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.435909301249 F1-OK: 0.902347192181 F1-score multiplied: 0.393341534028 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0242422687754063, Acc 0.8429176211357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471507352941 F1-OK: 0.907749077491 F1-score multiplied: 0.428010364662 Epoch 28: Test set LL -1.0949228994020304, Acc 0.8301693797111511, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434901158828 F1-OK: 0.900068308756 F1-score multiplied: 0.391440750502 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0925775583562005, Acc 0.8321267366409302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471397849462 F1-OK: 0.900219209223 F1-score multiplied: 0.424361399272 Epoch 29: Test set LL -1.1540837504247767, Acc 0.8217700123786926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446095076401 F1-OK: 0.893798828125 F1-score multiplied: 0.398719256519 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern32 from scratch - phrase 72 features
Epoch 1: \Dev set LL -0.6971392896546063, Acc 0.8349952101707458, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416988416988 F1-OK: 0.903898170247 F1-score multiplied: 0.37691506713 Epoch 1: Test set LL -0.7280565044135398, Acc 0.8275744318962097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3934662503 F1-OK: 0.899502487562 F1-score multiplied: 0.353923870917 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.8491756595364848, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.434905660377 F1-OK: 0.904328382048 F1-score multiplied: 0.393297532192 Epoch 2: Test set LL -0.8900345501822534, Acc 0.8293498754501343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.409917355372 F1-OK: 0.90025146689 F1-score multiplied: 0.369028700477 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.8714825765968035, Acc 0.8423712849617004, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.424725822532 F1-OK: 0.908673630896 F1-score multiplied: 0.385937155296 Epoch 3: Test set LL -0.9215029865412192, Acc 0.8372029662132263, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.407554671968 F1-OK: 0.905636478784 F1-score multiplied: 0.369096378033 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.9423308429410878, Acc 0.8308973908424377, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.449288256228 F1-OK: 0.900112957883 F1-score multiplied: 0.404410181255 Epoch 4: Test set LL -0.9972757572437662, Acc 0.8257989883422852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437486218302 F1-OK: 0.896941784834 F1-score multiplied: 0.392399669484 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.9484183994624966, Acc 0.8355416059494019, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.45960502693 F1-OK: 0.903012727566 F1-score multiplied: 0.415029188971 Epoch 5: Test set LL -1.0065971344199953, Acc 0.8262087106704712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430011198208 F1-OK: 0.897474116747 F1-score multiplied: 0.385923920303 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9343963229868061, Acc 0.8475618362426758, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41935483871 F1-OK: 0.912264150943 F1-score multiplied: 0.382562385879 Epoch 6: Test set LL -0.9940387486144447, Acc 0.8393198847770691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396821327865 F1-OK: 0.907314767401 F1-score multiplied: 0.360041850791 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9656145098831234, Acc 0.8415517210960388, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.455909943715 F1-OK: 0.907274180655 F1-score multiplied: 0.413635320637 Epoch 7: Test set LL -1.0296460847621205, Acc 0.8322179913520813, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.419560595322 F1-OK: 0.901935741369 F1-score multiplied: 0.378416696591 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9866747916790197, Acc 0.841141939163208, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465778594396 F1-OK: 0.906698756518 F1-score multiplied: 0.422320872352 Epoch 8: Test set LL -1.044718351363289, Acc 0.8320131301879883, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444945848375 F1-OK: 0.901029932411 F1-score multiplied: 0.400909527688 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.0043640411041788, Acc 0.8393661975860596, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.455555555556 F1-OK: 0.905784329434 F1-score multiplied: 0.412635083409 Epoch 9: Test set LL -1.0543190240959963, Acc 0.830647349357605, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.424326833798 F1-OK: 0.900720576461 F1-score multiplied: 0.382199910346 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9876199383527123, Acc 0.8429176211357117, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.439024390244 F1-OK: 0.908672172808 F1-score multiplied: 0.398929246599 Epoch 10: Test set LL -1.034563667307349, Acc 0.8389101624488831, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.425614803993 F1-OK: 0.906318255828 F1-score multiplied: 0.38574246681 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9949894249767502, Acc 0.8437371850013733, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.433663366337 F1-OK: 0.909364601489 F1-score multiplied: 0.394358114309 Epoch 11: Test set LL -1.035641068094921, Acc 0.83870530128479, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.417365564874 F1-OK: 0.906396132203 F1-score multiplied: 0.378298533717 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0877981371009926, Acc 0.8218822479248047, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46948738812 F1-OK: 0.892974392646 F1-score multiplied: 0.419240215262 Epoch 12: Test set LL -1.1315090917353352, Acc 0.8168533444404602, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452876376989 F1-OK: 0.890018863282 F1-score multiplied: 0.403068518255 [161145 8624 103629 ..., 131598 77971 145710]
Epoch 13: \Dev set LL -1.0840726149680155, Acc 0.826526403427124, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466834592779 F1-OK: 0.896411092985 F1-score multiplied: 0.418475707557 Epoch 13: Test set LL -1.1185429092391168, Acc 0.8211554288864136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.455169544414 F1-OK: 0.893019076018 F1-score multiplied: 0.406475085985 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.9953766665439399, Acc 0.84209805727005, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479747974797 F1-OK: 0.90692431562 F1-score multiplied: 0.435095103713 Epoch 14: Test set LL -1.068547538935032, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433941030835 F1-OK: 0.898772388811 F1-score multiplied: 0.390014216887 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.0051519617939926, Acc 0.8431908488273621, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.450191570881 F1-OK: 0.908555042218 F1-score multiplied: 0.409023821688 Epoch 15: Test set LL -1.0648082895576916, Acc 0.8354957699775696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.42629197428 F1-OK: 0.903981824704 F1-score multiplied: 0.385360196766 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0316436553361934, Acc 0.8371807336807251, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46975088968 F1-OK: 0.903824431176 F1-score multiplied: 0.424572330659 Epoch 16: Test set LL -1.0904838304523798, Acc 0.8270281553268433, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438483706495 F1-OK: 0.897768091375 F1-score multiplied: 0.393656680279 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.9925282436166362, Acc 0.8437371850013733, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.45471877979 F1-OK: 0.908801020408 F1-score multiplied: 0.413248891072 Epoch 17: Test set LL -1.056504749292476, Acc 0.8339251279830933, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.423696682464 F1-OK: 0.902983883836 F1-score multiplied: 0.3825912759 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.033278882514026, Acc 0.8384100794792175, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461538461538 F1-OK: 0.904941743672 F1-score multiplied: 0.417665420156 Epoch 18: Test set LL -1.078350567177299, Acc 0.831057071685791, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441282746161 F1-OK: 0.900482703138 F1-score multiplied: 0.397367480111 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.9847758248609813, Acc 0.8463324904441833, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461979913917 F1-OK: 0.910365707912 F1-score multiplied: 0.420570671374 Epoch 19: Test set LL -1.0565889604779244, Acc 0.8365200757980347, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.424242424242 F1-OK: 0.904735376045 F1-score multiplied: 0.383827129231 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0072214928400185, Acc 0.8451031446456909, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462049335863 F1-OK: 0.909526089038 F1-score multiplied: 0.42024592539 Epoch 20: Test set LL -1.0742100087975899, Acc 0.8339934349060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430011723329 F1-OK: 0.902849378572 F1-score multiplied: 0.388235817187 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0781545862339494, Acc 0.8319901823997498, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476595744681 F1-OK: 0.899934917019 F1-score multiplied: 0.428905151941 Epoch 21: Test set LL -1.1412960490292534, Acc 0.8211554288864136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450828265884 F1-OK: 0.893184877034 F1-score multiplied: 0.402672989227 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0401651329768726, Acc 0.8371807336807251, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470692717584 F1-OK: 0.903793381759 F1-score multiplied: 0.425408962995 Epoch 22: Test set LL -1.105317153658297, Acc 0.8275744318962097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443464844611 F1-OK: 0.897983919842 F1-score multiplied: 0.398224299476 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.048111037087856, Acc 0.8356781601905823, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475816993464 F1-OK: 0.902567425285 F1-score multiplied: 0.429456918698 Epoch 23: Test set LL -1.113756714683909, Acc 0.8245015144348145, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444444444444 F1-OK: 0.895791095613 F1-score multiplied: 0.398129375828 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.9963267001316932, Acc 0.8453763127326965, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465028355388 F1-OK: 0.909627973814 F1-score multiplied: 0.423002800677 Epoch 24: Test set LL -1.051323025891098, Acc 0.8372029662132263, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.435606060606 F1-OK: 0.904883498244 F1-score multiplied: 0.394172735978 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0181991420521253, Acc 0.841141939163208, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46479521399 F1-OK: 0.906728687144 F1-score multiplied: 0.421443154172 Epoch 25: Test set LL -1.081146845404494, Acc 0.8321496844291687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43623853211 F1-OK: 0.901396020539 F1-score multiplied: 0.39322367685 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0208554280467255, Acc 0.8408687114715576, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464367816092 F1-OK: 0.906553300714 F1-score multiplied: 0.420974176423 Epoch 26: Test set LL -1.0754095510974468, Acc 0.8334471583366394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442004118051 F1-OK: 0.902115021873 F1-score multiplied: 0.398738554623 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0362410451387445, Acc 0.8382734656333923, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475177304965 F1-OK: 0.90440820281 F1-score multiplied: 0.429754252399 Epoch 27: Test set LL -1.1165744226423941, Acc 0.8273012638092041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445273086203 F1-OK: 0.897731408468 F1-score multiplied: 0.39973563483 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -0.9812788582405763, Acc 0.8497473001480103, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.45652173913 F1-OK: 0.912822951339 F1-score multiplied: 0.416723521264 Epoch 28: Test set LL -1.0529424998935204, Acc 0.8390467166900635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.422445479049 F1-OK: 0.906494227794 F1-score multiplied: 0.382944388316 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0266075586376688, Acc 0.8393661975860596, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463503649635 F1-OK: 0.905542168675 F1-score multiplied: 0.419722100079 Epoch 29: Test set LL -1.0946397923136968, Acc 0.8296913504600525, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436766034327 F1-OK: 0.899678197908 F1-score multiplied: 0.392948878671 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern12 pretraining - phrase 72 features
Epoch 1: \Dev set LL -0.40533634995401635, Acc 0.8472886085510254, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.434782608696 F1-OK: 0.911718256475 F1-score multiplied: 0.396399241946 Epoch 1: Test set LL -0.4177118722128757, Acc 0.8385003805160522, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.412422360248 F1-OK: 0.906384831572 F1-score multiplied: 0.37381337153 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.5202454507999688, Acc 0.8356781601905823, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479446127218 F1-OK: 0.902441002352 F1-score multiplied: 0.43267184362 Epoch 2: Test set LL -0.5507564978752855, Acc 0.8250477910041809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448082722964 F1-OK: 0.89604804025 F1-score multiplied: 0.401503645782 [ 16587 157088 51334 ..., 99848 92538 64243]
Epoch 3: \Dev set LL -0.727793010623235, Acc 0.8433274030685425, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474094452086 F1-OK: 0.907952812776 F1-score multiplied: 0.430455391293 Epoch 3: Test set LL -0.7717817091550372, Acc 0.8329691290855408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437701149425 F1-OK: 0.901916753549 F1-score multiplied: 0.394769999714 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.8264766339718538, Acc 0.8319901823997498, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.49173553719 F1-OK: 0.899361806578 F1-score multiplied: 0.442248161086 Epoch 4: Test set LL -0.877999221193535, Acc 0.8172630667686462, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460701330109 F1-OK: 0.889994244841 F1-score multiplied: 0.410021532387 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.8645340755111807, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.494186046512 F1-OK: 0.90044139284 F1-score multiplied: 0.444985572043 Epoch 5: Test set LL -0.9334155050132873, Acc 0.8197214007377625, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.462978030919 F1-OK: 0.891678975874 F1-score multiplied: 0.412827776462 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.8874903223548433, Acc 0.8429176211357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474885844749 F1-OK: 0.907645358175 F1-score multiplied: 0.43102793265 Epoch 6: Test set LL -0.9469550275434354, Acc 0.8318765163421631, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445745159838 F1-OK: 0.900909603155 F1-score multiplied: 0.401576095058 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9020265379052844, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472991375397 F1-OK: 0.906664522872 F1-score multiplied: 0.428844499697 Epoch 7: Test set LL -0.9615233821130824, Acc 0.8296230435371399, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443949186539 F1-OK: 0.899399217773 F1-score multiplied: 0.399287551104 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9385123170817392, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.482150727193 F1-OK: 0.905035157197 F1-score multiplied: 0.436363359177 Epoch 8: Test set LL -0.9965940907289806, Acc 0.8281207084655762, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456019018803 F1-OK: 0.897936012327 F1-score multiplied: 0.409475899289 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.9701829316149979, Acc 0.8322633504867554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481418918919 F1-OK: 0.899951116181 F1-score multiplied: 0.433253493432 Epoch 9: Test set LL -1.0322336260514664, Acc 0.8212237358093262, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.463084495488 F1-OK: 0.892757660167 F1-score multiplied: 0.413422230652 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.942130053077485, Acc 0.8412784934043884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476104598738 F1-OK: 0.906471345782 F1-score multiplied: 0.431575176351 Epoch 10: Test set LL -1.0178326662709372, Acc 0.8295547962188721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448275862069 F1-OK: 0.899208528509 F1-score multiplied: 0.403093478297 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -1.042552310212879, Acc 0.8205163478851318, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485512920908 F1-OK: 0.891297154203 F1-score multiplied: 0.432736284734 Epoch 11: Test set LL -1.095577969146159, Acc 0.8129609227180481, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.468258590565 F1-OK: 0.886522765878 F1-score multiplied: 0.415121900854 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0121908067804357, Acc 0.8318535685539246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.494455852156 F1-OK: 0.89915622184 F1-score multiplied: 0.444593055891 Epoch 12: Test set LL -1.0914710701817953, Acc 0.8173313140869141, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.464678807284 F1-OK: 0.889876909143 F1-score multiplied: 0.413506940771 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.9707638359194521, Acc 0.8418248891830444, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480251346499 F1-OK: 0.906718221363 F1-score multiplied: 0.435452646705 Epoch 13: Test set LL -1.0539847147804808, Acc 0.8270281553268433, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45137535196 F1-OK: 0.897328847635 F1-score multiplied: 0.405032124425 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0074457551421763, Acc 0.8337658643722534, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.480580452411 F1-OK: 0.901048865761 F1-score multiplied: 0.433026471552 Epoch 14: Test set LL -1.0835154445684814, Acc 0.8208140134811401, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452877397832 F1-OK: 0.892862975666 F1-score multiplied: 0.40435746104 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.9825868445091737, Acc 0.8418248891830444, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470749542962 F1-OK: 0.907017825598 F1-score multiplied: 0.426978226858 Epoch 15: Test set LL -1.0434995669033866, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444985609918 F1-OK: 0.898792943361 F1-score multiplied: 0.399949926092 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.9733909176289236, Acc 0.8437371850013733, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.48 F1-OK: 0.908053367626 F1-score multiplied: 0.43586561646 Epoch 16: Test set LL -1.0637117445370385, Acc 0.8294181823730469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44832155477 F1-OK: 0.899111470113 F1-score multiplied: 0.403091052193 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.9789777974545197, Acc 0.842644453048706, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476839237057 F1-OK: 0.907395498392 F1-score multiplied: 0.432681777163 Epoch 17: Test set LL -1.056811199649368, Acc 0.8288719058036804, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441373160945 F1-OK: 0.89895976131 F1-score multiplied: 0.396776711412 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0358839007661567, Acc 0.832536518573761, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481387478849 F1-OK: 0.900146603681 F1-score multiplied: 0.433319304141 Epoch 18: Test set LL -1.1013129842061173, Acc 0.821906566619873, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.467755102041 F1-OK: 0.893062161719 F1-score multiplied: 0.417734382584 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0033435352671654, Acc 0.8380002975463867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471479500891 F1-OK: 0.904339409582 F1-score multiplied: 0.426377493466 Epoch 19: Test set LL -1.0846894417688535, Acc 0.8251844048500061, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446845289542 F1-OK: 0.896188158962 F1-score multiplied: 0.400457457375 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0490796633174513, Acc 0.8310340046882629, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.479157894737 F1-OK: 0.899160348904 F1-score multiplied: 0.430839779811 Epoch 20: Test set LL -1.1148491257487907, Acc 0.8207457065582275, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.461759278245 F1-OK: 0.892466510999 F1-score multiplied: 0.412104691977 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.003488728535686, Acc 0.8396393656730652, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.48823016565 F1-OK: 0.904923874312 F1-score multiplied: 0.441811133055 Epoch 21: Test set LL -1.0957281763388131, Acc 0.8246380686759949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45731191885 F1-OK: 0.895422707281 F1-score multiplied: 0.409487476449 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -0.9979234317614198, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481497993758 F1-OK: 0.906202113074 F1-score multiplied: 0.436334499385 Epoch 22: Test set LL -1.0873870348420578, Acc 0.8266184329986572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.455267110062 F1-OK: 0.896901774475 F1-score multiplied: 0.408329878875 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -0.9970972347082299, Acc 0.8429176211357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481514878269 F1-OK: 0.907437218287 F1-score multiplied: 0.4369445217 Epoch 23: Test set LL -1.0766067376202952, Acc 0.8271647095680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447017697182 F1-OK: 0.897575978309 F1-score multiplied: 0.401232346869 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.9935265197914077, Acc 0.8442835807800293, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485559566787 F1-OK: 0.908256880734 F1-score multiplied: 0.44101281754 Epoch 24: Test set LL -1.0893359764812387, Acc 0.8281207084655762, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451753430625 F1-OK: 0.898084787626 F1-score multiplied: 0.405712883802 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0271493303060388, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468444444444 F1-OK: 0.903486120077 F1-score multiplied: 0.423233053583 Epoch 25: Test set LL -1.1008991179159515, Acc 0.8264135718345642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450259515571 F1-OK: 0.896934803763 F1-score multiplied: 0.403853430241 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0161001416689897, Acc 0.839093029499054, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476444444444 F1-OK: 0.90493867011 F1-score multiplied: 0.431153001937 Epoch 26: Test set LL -1.0916656447254482, Acc 0.8268232941627502, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.460195828012 F1-OK: 0.896868645791 F1-score multiplied: 0.412735209068 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0247745761795237, Acc 0.8389564156532288, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.481302243731 F1-OK: 0.904681057482 F1-score multiplied: 0.435425022827 Epoch 27: Test set LL -1.1074355925537434, Acc 0.826481819152832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458093410109 F1-OK: 0.896703118013 F1-score multiplied: 0.410773789186 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -0.999496334588626, Acc 0.8430542349815369, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471237919926 F1-OK: 0.90785147165 F1-score multiplied: 0.427814039102 Epoch 28: Test set LL -1.0700796860590978, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451541361721 F1-OK: 0.900197748093 F1-score multiplied: 0.406476516992 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0041363989092245, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.485600354453 F1-OK: 0.906257569641 F1-score multiplied: 0.440078997043 Epoch 29: Test set LL -1.091562356752454, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.456451264318 F1-OK: 0.898017112039 F1-score multiplied: 0.40990104617 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern12 - phrase - 72 features - instead of using 17 hidden -> 68 hidden
Epoch 1: \Dev set LL -0.4370331511204081, Acc 0.8373172879219055, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418172936004 F1-OK: 0.905438666137 F1-score multiplied: 0.37862994539 Epoch 1: Test set LL -0.45307886222610594, Acc 0.8300327658653259, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.393666260658 F1-OK: 0.901163483302 F1-score multiplied: 0.354757658713 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.6712170421771798, Acc 0.8319901823997498, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.450402144772 F1-OK: 0.900838439213 F1-score multiplied: 0.405739565115 Epoch 2: Test set LL -0.7030008328650122, Acc 0.8242283463478088, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.423387096774 F1-OK: 0.896310022559 F1-score multiplied: 0.379486098261 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.7467167779369507, Acc 0.8438737988471985, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.437223042836 F1-OK: 0.909364840219 F1-score multiplied: 0.397595262489 Epoch 3: Test set LL -0.7964001420101124, Acc 0.835837185382843, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.408173313639 F1-OK: 0.904701498454 F1-score multiplied: 0.369275008478 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.8558249773267019, Acc 0.8303510546684265, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.45953002611 F1-OK: 0.899384316267 F1-score multiplied: 0.413294098337 Epoch 4: Test set LL -0.8933407109750527, Acc 0.8225211501121521, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43463128127 F1-OK: 0.894738973715 F1-score multiplied: 0.388881546548 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.8968023757522076, Acc 0.8341756463050842, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.460444444444 F1-OK: 0.902033570045 F1-score multiplied: 0.41533634603 Epoch 5: Test set LL -0.9450166543691131, Acc 0.8246380686759949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434610303831 F1-OK: 0.896225652631 F1-score multiplied: 0.389508903191 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9154513825405859, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462251042149 F1-OK: 0.906993511175 F1-score multiplied: 0.419258695763 Epoch 6: Test set LL -0.9779505426467995, Acc 0.8307156562805176, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.428143021915 F1-OK: 0.900653228069 F1-score multiplied: 0.385608394763 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9463019698504198, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463448275862 F1-OK: 0.906392877196 F1-score multiplied: 0.42006621619 Epoch 7: Test set LL -1.0064683442988325, Acc 0.8294864892959595, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.431077694236 F1-OK: 0.899714847986 F1-score multiplied: 0.387847002139 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.962137676111767, Acc 0.8393661975860596, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463503649635 F1-OK: 0.905542168675 F1-score multiplied: 0.419722100079 Epoch 8: Test set LL -1.0316380653316581, Acc 0.8277109861373901, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.428797826579 F1-OK: 0.898556551807 F1-score multiplied: 0.385299096473 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -1.001522632117633, Acc 0.8303510546684265, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468321917808 F1-OK: 0.899073622623 F1-score multiplied: 0.421055883198 Epoch 9: Test set LL -1.0603662103030609, Acc 0.8229308724403381, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449819647783 F1-OK: 0.894486266531 F1-score multiplied: 0.402357497357 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.980943535417408, Acc 0.8410053253173828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468493150685 F1-OK: 0.906521040797 F1-score multiplied: 0.424698898565 Epoch 10: Test set LL -1.0532128749011147, Acc 0.8301693797111511, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433872069201 F1-OK: 0.900100421771 F1-score multiplied: 0.390528432483 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9875794267151063, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.451764705882 F1-OK: 0.906926579851 F1-score multiplied: 0.409717419603 Epoch 11: Test set LL -1.0447531311244798, Acc 0.8329691290855408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43458159963 F1-OK: 0.902011056806 F1-score multiplied: 0.391997407951 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.9914249120554052, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.460119870908 F1-OK: 0.90611721318 F1-score multiplied: 0.416922535156 Epoch 12: Test set LL -1.0550858492639557, Acc 0.831261932849884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437258027784 F1-OK: 0.900751094509 F1-score multiplied: 0.39386064711 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.041782833232654, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469370146678 F1-OK: 0.900194741967 F1-score multiplied: 0.422524538076 Epoch 13: Test set LL -1.0934389661347907, Acc 0.8232723474502563, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447008547009 F1-OK: 0.894830949285 F1-score multiplied: 0.399997082458 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0263667229623221, Acc 0.8369075059890747, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471213463242 F1-OK: 0.903585271318 F1-score multiplied: 0.425781545032 Epoch 14: Test set LL -1.0872272813109929, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44614376229 F1-OK: 0.897414107078 F1-score multiplied: 0.400375706064 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.0175960143707665, Acc 0.8399125933647156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465328467153 F1-OK: 0.905863453815 F1-score multiplied: 0.421524052414 Epoch 15: Test set LL -1.0784659406516268, Acc 0.8305791020393372, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440081245768 F1-OK: 0.900189081546 F1-score multiplied: 0.396156332434 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.015878972389153, Acc 0.8396393656730652, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459484346225 F1-OK: 0.905854049719 F1-score multiplied: 0.41622575581 Epoch 16: Test set LL -1.0753483065066416, Acc 0.8324228525161743, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444041685546 F1-OK: 0.901342767548 F1-score multiplied: 0.400233761757 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0231028363180448, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470534904805 F1-OK: 0.906079125121 F1-score multiplied: 0.426341854884 Epoch 17: Test set LL -1.087358966033398, Acc 0.8291450142860413, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444986690328 F1-OK: 0.899031476998 F1-score multiplied: 0.40005704145 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.036116560419699, Acc 0.8384100794792175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471639124609 F1-OK: 0.904619850036 F1-score multiplied: 0.426654114175 Epoch 18: Test set LL -1.104277782692106, Acc 0.8275744318962097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441495244415 F1-OK: 0.898049824363 F1-score multiplied: 0.396484726704 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.049049938742939, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473501303215 F1-OK: 0.901782820097 F1-score multiplied: 0.426995340533 Epoch 19: Test set LL -1.1112103286359902, Acc 0.8254575133323669, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452442159383 F1-OK: 0.896181965881 F1-score multiplied: 0.405470503844 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0198900161752313, Acc 0.8410053253173828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474729241877 F1-OK: 0.906325446644 F1-score multiplied: 0.430259192179 Epoch 20: Test set LL -1.0944133373517457, Acc 0.8294181823730469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443404634581 F1-OK: 0.899274193548 F1-score multiplied: 0.398742345179 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0470138715895634, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467289719626 F1-OK: 0.903428801936 F1-score multiplied: 0.422162991559 Epoch 21: Test set LL -1.1106728135411117, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446915195117 F1-OK: 0.897291607627 F1-score multiplied: 0.401013253899 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0165361240250905, Acc 0.8434640169143677, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466480446927 F1-OK: 0.908275972467 F1-score multiplied: 0.42369298157 Epoch 22: Test set LL -1.0824086716368664, Acc 0.8321496844291687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.432594644506 F1-OK: 0.901506651707 F1-score multiplied: 0.389986949515 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0442119433874864, Acc 0.8375905156135559, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461747397012 F1-OK: 0.904367409314 F1-score multiplied: 0.417589297193 Epoch 23: Test set LL -1.1048635068345583, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440240373915 F1-OK: 0.89856825973 F1-score multiplied: 0.395586026652 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0599179190387464, Acc 0.835131824016571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464745011086 F1-OK: 0.902559134577 F1-score multiplied: 0.419459855005 Epoch 24: Test set LL -1.115530978818112, Acc 0.8255941271781921, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441382327209 F1-OK: 0.896666127205 F1-score multiplied: 0.395772581955 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.042884253176557, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470222222222 F1-OK: 0.903808908974 F1-score multiplied: 0.424991033642 Epoch 25: Test set LL -1.1088463570923688, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444200833151 F1-OK: 0.897480486917 F1-score multiplied: 0.398661580025 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.056708872074179, Acc 0.834585428237915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465342163355 F1-OK: 0.902157227115 F1-score multiplied: 0.419811795752 Epoch 26: Test set LL -1.110978737110131, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445851528384 F1-OK: 0.897280233123 F1-score multiplied: 0.400053763327 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0388368474341025, Acc 0.8378636837005615, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470325747434 F1-OK: 0.904281912749 F1-score multiplied: 0.425307066505 Epoch 27: Test set LL -1.0949767005419604, Acc 0.8301010727882385, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451740855002 F1-OK: 0.899474747475 F1-score multiplied: 0.406329491477 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0484888286049452, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.477481416703 F1-OK: 0.903278025091 F1-score multiplied: 0.431298471097 Epoch 28: Test set LL -1.1202636175253262, Acc 0.8245697617530823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452121987631 F1-OK: 0.89556486036 F1-score multiplied: 0.404904564718 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0345574602564507, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475292003594 F1-OK: 0.905927835052 F1-score multiplied: 0.430580255833 Epoch 29: Test set LL -1.109372935649945, Acc 0.8283255696296692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444051304732 F1-OK: 0.898489865138 F1-score multiplied: 0.398975596903 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern12 - phrase - 72 features - instead of using 17 hidden -> 34 hidden
Epoch 1: \Dev set LL -0.4393242920309501, Acc 0.8397759795188904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417287630402 F1-OK: 0.907118536701 F1-score multiplied: 0.378529344674 Epoch 1: Test set LL -0.4579980038352507, Acc 0.8318082690238953, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388682055101 F1-OK: 0.902490201512 F1-score multiplied: 0.350781746232 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.6654017493928057, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.438432835821 F1-OK: 0.903664586334 F1-score multiplied: 0.396196227217 Epoch 2: Test set LL -0.7038209392449273, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.415244330138 F1-OK: 0.900003998241 F1-score multiplied: 0.373721557371 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.7832289969792856, Acc 0.8448299169540405, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.455938697318 F1-OK: 0.909510912856 F1-score multiplied: 0.414681220804 Epoch 3: Test set LL -0.8366870734643029, Acc 0.8319448232650757, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.413628782464 F1-OK: 0.90191702204 F1-score multiplied: 0.37305883971 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.8332254794999973, Acc 0.8416882753372192, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469565217391 F1-OK: 0.906959942201 F1-score multiplied: 0.425876842425 Epoch 4: Test set LL -0.8991766614425359, Acc 0.8255258202552795, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430830920027 F1-OK: 0.896971652083 F1-score multiplied: 0.386443122105 [ 82707 140148 157986 ..., 51883 106201 103473]
Epoch 5: \Dev set LL -0.9151585686026714, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465034965035 F1-OK: 0.900922778048 F1-score multiplied: 0.418960592589 Epoch 5: Test set LL -0.9748376343684593, Acc 0.8213602900505066, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437902879244 F1-OK: 0.893805309735 F1-score multiplied: 0.391399918616 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.8947169564360042, Acc 0.8476983904838562, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466251795117 F1-OK: 0.911176611169 F1-score multiplied: 0.424837730626 Epoch 6: Test set LL -0.9685912906554305, Acc 0.8335837125778198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.420727359163 F1-OK: 0.902834815199 F1-score multiplied: 0.379847307559 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9235077119243292, Acc 0.8418248891830444, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469294225481 F1-OK: 0.907062600321 F1-score multiplied: 0.425679240481 Epoch 7: Test set LL -0.9972296856712511, Acc 0.8301010727882385, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436083408885 F1-OK: 0.899983920244 F1-score multiplied: 0.392468055882 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9511528038786713, Acc 0.8399125933647156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462878093492 F1-OK: 0.905939004815 F1-score multiplied: 0.419339319369 Epoch 8: Test set LL -1.0153238080008715, Acc 0.8297596573829651, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436610169492 F1-OK: 0.899730523268 F1-score multiplied: 0.392831496261 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.9947346736802084, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463157894737 F1-OK: 0.900986895324 F1-score multiplied: 0.417299193624 Epoch 9: Test set LL -1.0531133496908403, Acc 0.8245015144348145, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444684528954 F1-OK: 0.895782643958 F1-score multiplied: 0.398340683074 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9886182331866004, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469069870939 F1-OK: 0.903751512707 F1-score multiplied: 0.423922605426 Epoch 10: Test set LL -1.0396009617086812, Acc 0.8289401531219482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445428381669 F1-OK: 0.898873682936 F1-score multiplied: 0.400383849915 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9805687956467195, Acc 0.8425078392028809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471827759963 F1-OK: 0.90745645718 F1-score multiplied: 0.428163147455 Epoch 11: Test set LL -1.047012352869056, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442390078918 F1-OK: 0.900494910071 F1-score multiplied: 0.398370014331 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.9955299948108033, Acc 0.8380002975463867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472419928826 F1-OK: 0.904308536389 F1-score multiplied: 0.427213374397 Epoch 12: Test set LL -1.059147593057356, Acc 0.8277792930603027, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440301819796 F1-OK: 0.898232588169 F1-score multiplied: 0.395493443171 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0310698813752817, Acc 0.8337658643722534, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470639408438 F1-OK: 0.901401604148 F1-score multiplied: 0.424235117742 Epoch 13: Test set LL -1.07778278793983, Acc 0.8265501260757446, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.452586206897 F1-OK: 0.896949042519 F1-score multiplied: 0.405946764933 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.9907175364012892, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471552116523 F1-OK: 0.906709521896 F1-score multiplied: 0.427560794121 Epoch 14: Test set LL -1.064597477433907, Acc 0.8287352919578552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437415881561 F1-OK: 0.898993153443 F1-score multiplied: 0.393233882731 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.990240136486085, Acc 0.8433274030685425, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466263378315 F1-OK: 0.908188585608 F1-score multiplied: 0.423455078073 Epoch 15: Test set LL -1.064192912767892, Acc 0.8327642679214478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440228571429 F1-OK: 0.901697908722 F1-score multiplied: 0.396953182217 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.9840960319160043, Acc 0.8434640169143677, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471889400922 F1-OK: 0.908114175754 F1-score multiplied: 0.428529454365 Epoch 16: Test set LL -1.0598725637975304, Acc 0.8307839632034302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436818181818 F1-OK: 0.900433944069 F1-score multiplied: 0.393325918296 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.022821116401845, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46927871772 F1-OK: 0.90383994837 F1-score multiplied: 0.424152851996 Epoch 17: Test set LL -1.0834987493536234, Acc 0.8284621834754944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444739168877 F1-OK: 0.898562429333 F1-score multiplied: 0.399625908006 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.019432709327731, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471631205674 F1-OK: 0.903762312288 F1-score multiplied: 0.426242508987 Epoch 18: Test set LL -1.079742231176521, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445416757821 F1-OK: 0.897439009589 F1-score multiplied: 0.399734373993 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.074110000739413, Acc 0.8289850950241089, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469940728196 F1-OK: 0.898045602606 F1-score multiplied: 0.422028204442 Epoch 19: Test set LL -1.1195106552941303, Acc 0.8208140134811401, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451734224822 F1-OK: 0.892906701494 F1-score multiplied: 0.403356516638 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.9864409728239754, Acc 0.8441469669342041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.448525857902 F1-OK: 0.909249980116 F1-score multiplied: 0.407822127379 Epoch 20: Test set LL -1.0560522983711886, Acc 0.8344714641571045, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.423954372624 F1-OK: 0.903349282297 F1-score multiplied: 0.382978878236 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0392370919914053, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478184991274 F1-OK: 0.903157894737 F1-score multiplied: 0.431876550014 Epoch 21: Test set LL -1.1140059987094237, Acc 0.8243649005889893, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4499572284 F1-OK: 0.895498130993 F1-score multiplied: 0.402935857059 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.028656827423876, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473336271485 F1-OK: 0.903418734341 F1-score multiplied: 0.427620855303 Epoch 22: Test set LL -1.1086235870566379, Acc 0.8240234851837158, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444492347489 F1-OK: 0.89545214816 F1-score multiplied: 0.398021627399 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0259442930337719, Acc 0.8410053253173828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475202885482 F1-OK: 0.906310367032 F1-score multiplied: 0.430681301556 Epoch 23: Test set LL -1.0925876992847494, Acc 0.8285304307937622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448979591837 F1-OK: 0.898467510412 F1-score multiplied: 0.403393576103 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.012437073520265, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461964038728 F1-OK: 0.906437905877 F1-score multiplied: 0.418741715855 Epoch 24: Test set LL -1.0788405965263157, Acc 0.830852210521698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436917481246 F1-OK: 0.900478122866 F1-score multiplied: 0.393434633359 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.084800439305873, Acc 0.8242043256759644, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466196598922 F1-OK: 0.894775570272 F1-score multiplied: 0.417141327659 Epoch 25: Test set LL -1.1401793852237825, Acc 0.8181507587432861, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.455307833913 F1-OK: 0.89085618263 F1-score multiplied: 0.405613798841 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0550215491059087, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465441819773 F1-OK: 0.901100679832 F1-score multiplied: 0.419409940219 Epoch 26: Test set LL -1.1142373427065364, Acc 0.8252526521682739, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451916898694 F1-OK: 0.896055891791 F1-score multiplied: 0.404942799674 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0083568256740023, Acc 0.8438737988471985, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473514509443 F1-OK: 0.908347365889 F1-score multiplied: 0.430115657362 Epoch 27: Test set LL -1.0953286953406018, Acc 0.8291450142860413, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.435723951286 F1-OK: 0.899332099461 F1-score multiplied: 0.391860535895 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.015595003485752, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459321245932 F1-OK: 0.906892962933 F1-score multiplied: 0.416555205662 Epoch 28: Test set LL -1.0848848744608095, Acc 0.830647349357605, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.432494279176 F1-OK: 0.900473553255 F1-score multiplied: 0.389449660332 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0618763990549094, Acc 0.8333560824394226, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471403812825 F1-OK: 0.901086427761 F1-score multiplied: 0.424775577731 Epoch 29: Test set LL -1.129714656730309, Acc 0.8211554288864136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443594646272 F1-OK: 0.893454293967 F1-score multiplied: 0.396331541492 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Matern12 - phrase - 72 features - instead of using 17 hidden -> 100 hidden
Epoch 1: \Dev set LL -0.44776423640250096, Acc 0.838546633720398, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414271555996 F1-OK: 0.906368821293 F1-score multiplied: 0.375482821903 Epoch 1: Test set LL -0.4647355119731794, Acc 0.8318082690238953, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388074534161 F1-OK: 0.90250564066 F1-score multiplied: 0.350239456077 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.6691451806445993, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.449448529412 F1-OK: 0.903898604203 F1-score multiplied: 0.406255898397 Epoch 2: Test set LL -0.7075913160882169, Acc 0.8298962116241455, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.421907635182 F1-OK: 0.900276232035 F1-score multiplied: 0.379833416069 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.7754166139163946, Acc 0.8431908488273621, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.437254901961 F1-OK: 0.908903348675 F1-score multiplied: 0.397422444617 Epoch 3: Test set LL -0.8245307631372202, Acc 0.835837185382843, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.414800389484 F1-OK: 0.904527402701 F1-score multiplied: 0.375198318939 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.833131028342462, Acc 0.8396393656730652, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469738030714 F1-OK: 0.905535886707 F1-score multiplied: 0.425364644162 Epoch 4: Test set LL -0.8995078258913888, Acc 0.8261404037475586, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434975588105 F1-OK: 0.89726414333 F1-score multiplied: 0.39028799843 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.8792139403834678, Acc 0.8362245559692383, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471573380344 F1-OK: 0.90309544977 F1-score multiplied: 0.425875774021 Epoch 5: Test set LL -0.9378459405890391, Acc 0.8229308724403381, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436916395223 F1-OK: 0.894947939878 F1-score multiplied: 0.391017427803 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9120177672583853, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456876456876 F1-OK: 0.90677762663 F1-score multiplied: 0.41428534923 Epoch 6: Test set LL -0.9675335600023591, Acc 0.831261932849884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.428670520231 F1-OK: 0.90101349998 F1-score multiplied: 0.386237925772 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9162561416397664, Acc 0.8479716181755066, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.460494425594 F1-OK: 0.911519198664 F1-score multiplied: 0.419749509807 Epoch 7: Test set LL -0.9789218372406274, Acc 0.8349494934082031, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.41940907999 F1-OK: 0.903800995025 F1-score multiplied: 0.379062343818 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9435850420653584, Acc 0.8437371850013733, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459867799811 F1-OK: 0.908655381667 F1-score multiplied: 0.417861351154 Epoch 8: Test set LL -1.0055441497745576, Acc 0.8347446322441101, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430051813472 F1-OK: 0.90336235125 F1-score multiplied: 0.388492617377 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.9750543326738952, Acc 0.8388198614120483, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463148316652 F1-OK: 0.905175184828 F1-score multiplied: 0.419230363128 Epoch 9: Test set LL -1.0285809144094513, Acc 0.8298279047012329, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43721770551 F1-OK: 0.899758648431 F1-score multiplied: 0.39339041178 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -1.0051153314991728, Acc 0.8356781601905823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469810489202 F1-OK: 0.902772165198 F1-score multiplied: 0.42413183257 Epoch 10: Test set LL -1.0624925437029356, Acc 0.8251160979270935, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444829828745 F1-OK: 0.896210739615 F1-score multiplied: 0.398661269822 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.988200206581095, Acc 0.8431908488273621, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464552238806 F1-OK: 0.908145303249 F1-score multiplied: 0.421880933785 Epoch 11: Test set LL -1.052249693825962, Acc 0.8309888243675232, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437883261413 F1-OK: 0.900542495479 F1-score multiplied: 0.394332484961 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.9876502162023854, Acc 0.8423712849617004, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462756052142 F1-OK: 0.907635665119 F1-score multiplied: 0.420013897173 Epoch 12: Test set LL -1.0489722996158177, Acc 0.8329691290855408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436405529954 F1-OK: 0.901956068623 F1-score multiplied: 0.393618616122 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -1.0061379293517567, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466819221968 F1-OK: 0.906478285301 F1-score multiplied: 0.423161487875 Epoch 13: Test set LL -1.0764199504698182, Acc 0.8285304307937622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437121721587 F1-OK: 0.898860111975 F1-score multiplied: 0.392911279612 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0010724430650118, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.470641784251 F1-OK: 0.906548814785 F1-score multiplied: 0.426659751701 Epoch 14: Test set LL -1.0694452566163848, Acc 0.8311936855316162, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44623655914 F1-OK: 0.900418949404 F1-score multiplied: 0.401799853766 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.9882306402402267, Acc 0.8452396988868713, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459188544153 F1-OK: 0.909699529768 F1-score multiplied: 0.417723602691 Epoch 15: Test set LL -1.0466908575928495, Acc 0.8364517688751221, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.432060706664 F1-OK: 0.904471301504 F1-score multiplied: 0.390786509685 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0435095050779577, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466312056738 F1-OK: 0.902793476506 F1-score multiplied: 0.420983482839 Epoch 16: Test set LL -1.0943209990479494, Acc 0.8273012638092041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448899542384 F1-OK: 0.897607190575 F1-score multiplied: 0.402935457089 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0170590663510983, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465414567109 F1-OK: 0.90633277149 F1-score multiplied: 0.4218204745 Epoch 17: Test set LL -1.0793258627333207, Acc 0.8309205174446106, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443094916779 F1-OK: 0.900330086144 F1-score multiplied: 0.398931684594 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0137538818779985, Acc 0.8425078392028809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.476622787108 F1-OK: 0.907307661388 F1-score multiplied: 0.432443506335 Epoch 18: Test set LL -1.0847251246023504, Acc 0.8297596573829651, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442655935614 F1-OK: 0.899536570623 F1-score multiplied: 0.398185202288 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0172075599977113, Acc 0.8412784934043884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462534690102 F1-OK: 0.906891025641 F1-score multiplied: 0.419468559501 Epoch 19: Test set LL -1.0738683180612814, Acc 0.8325594067573547, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.435543278085 F1-OK: 0.901699807569 F1-score multiplied: 0.392729290037 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0197375793894354, Acc 0.840595543384552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474561008555 F1-OK: 0.90604621206 F1-score multiplied: 0.429974204192 Epoch 20: Test set LL -1.0915724453397668, Acc 0.8305107951164246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451370468612 F1-OK: 0.899773865288 F1-score multiplied: 0.40613135122 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0341317385667785, Acc 0.8386832475662231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468257541648 F1-OK: 0.90491908864 F1-score multiplied: 0.423735187837 Epoch 21: Test set LL -1.099027884621566, Acc 0.8293498754501343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44773480663 F1-OK: 0.899083309777 F1-score multiplied: 0.402550891847 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0179367944625475, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.468221307727 F1-OK: 0.906623845845 F1-score multiplied: 0.424500602718 Epoch 22: Test set LL -1.0844912644366251, Acc 0.8316034078598022, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446091644205 F1-OK: 0.900708648736 F1-score multiplied: 0.401798602064 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0224608563043358, Acc 0.8416882753372192, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.460679385761 F1-OK: 0.907228047707 F1-score multiplied: 0.417941259763 Epoch 23: Test set LL -1.0889829305820629, Acc 0.8316034078598022, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4375 F1-OK: 0.900979762287 F1-score multiplied: 0.394178646001 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.0092273778249015, Acc 0.8446933627128601, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.460370194589 F1-OK: 0.909293976865 F1-score multiplied: 0.418611845068 Epoch 24: Test set LL -1.0626666422618354, Acc 0.8366566300392151, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433980123048 F1-OK: 0.904556699386 F1-score multiplied: 0.392559627703 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0422784591795924, Acc 0.8389564156532288, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466757123474 F1-OK: 0.90515646368 F1-score multiplied: 0.422488227281 Epoch 25: Test set LL -1.1077568306024206, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448404840484 F1-OK: 0.898678414097 F1-score multiplied: 0.40297175092 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.055283201621927, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.46356453029 F1-OK: 0.901164671627 F1-score multiplied: 0.417747977717 Epoch 26: Test set LL -1.1107009587991328, Acc 0.8262087106704712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.448298287449 F1-OK: 0.8968591692 F1-score multiplied: 0.402060429635 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0231107087285385, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.458774758176 F1-OK: 0.905781412878 F1-score multiplied: 0.415549648653 Epoch 27: Test set LL -1.0813735034953684, Acc 0.8322862386703491, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443336355394 F1-OK: 0.901270300691 F1-score multiplied: 0.399565890334 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0199393858127412, Acc 0.8418248891830444, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.474591651543 F1-OK: 0.906898215147 F1-score multiplied: 0.430406321708 Epoch 28: Test set LL -1.0891891030029268, Acc 0.8307156562805176, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449233503666 F1-OK: 0.899987896881 F1-score multiplied: 0.404304716173 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0251688557651633, Acc 0.840049147605896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466514806378 F1-OK: 0.905921105487 F1-score multiplied: 0.42262560912 Epoch 29: Test set LL -1.0978298740826162, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443460942686 F1-OK: 0.898461786911 F1-score multiplied: 0.398432710991 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
Gaussia processes - only - 72 features - matern52 - phrase
Epoch 1: \Dev set LL -0.5460106441549424, Acc 0.7987979650497437, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.330758746025 F1-OK: 0.881601157463 F1-score multiplied: 0.291597293336 Epoch 1: Test set LL -0.5487441200641229, Acc 0.7947282195091248, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331108144192 F1-OK: 0.878760990562 F1-score multiplied: 0.290964920774 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.4387871884787938, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.324844368987 F1-OK: 0.907339805825 F1-score multiplied: 0.29474422668 Epoch 2: Test set LL -0.45018598618107714, Acc 0.8292816281318665, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.310535024821 F1-OK: 0.902579689814 F1-score multiplied: 0.280282606379 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.5105204372392332, Acc 0.8456494808197021, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.315151515152 F1-OK: 0.913023399015 F1-score multiplied: 0.287740707568 Epoch 3: Test set LL -0.5316783109048019, Acc 0.8389784097671509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.297377830751 F1-OK: 0.909069875058 F1-score multiplied: 0.270337227446 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.59296528763708, Acc 0.8456494808197021, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.323353293413 F1-OK: 0.912889300031 F1-score multiplied: 0.295185761687 Epoch 4: Test set LL -0.6222670752965531, Acc 0.840412437915802, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.310008857396 F1-OK: 0.909771823482 F1-score multiplied: 0.282037323489 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.6483049671285707, Acc 0.846059262752533, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.332741267022 F1-OK: 0.912993129005 F1-score multiplied: 0.303790490527 Epoch 5: Test set LL -0.6823718142622606, Acc 0.840617299079895, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.31993006993 F1-OK: 0.909730816832 F1-score multiplied: 0.291050243846 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.6837085175958232, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.339988590987 F1-OK: 0.91023353247 F1-score multiplied: 0.309469016173 Epoch 6: Test set LL -0.7215108528173237, Acc 0.8377492427825928, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330704225352 F1-OK: 0.90768513482 F1-score multiplied: 0.300175309374 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.7159680639754394, Acc 0.8410053253173828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348264277716 F1-OK: 0.909458618544 F1-score multiplied: 0.316731948899 Epoch 7: Test set LL -0.7564291068328312, Acc 0.836042046546936, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331756192597 F1-OK: 0.90655769605 F1-score multiplied: 0.300756129611 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.7317261285790353, Acc 0.838546633720398, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357608695652 F1-OK: 0.907670676457 F1-score multiplied: 0.324590926689 Epoch 8: Test set LL -0.7741302014193568, Acc 0.8333105444908142, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339019767127 F1-OK: 0.90462981051 F1-score multiplied: 0.306687387695 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.748061452858849, Acc 0.8381368517875671, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.372019077901 F1-OK: 0.907095256762 F1-score multiplied: 0.337456740989 Epoch 9: Test set LL -0.7920156883278913, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349381741647 F1-OK: 0.902970141641 F1-score multiplied: 0.315481280742 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.7636789410540683, Acc 0.8374539017677307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380853277836 F1-OK: 0.906446540881 F1-score multiplied: 0.345223136277 Epoch 10: Test set LL -0.8095271253579883, Acc 0.830237627029419, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358947911294 F1-OK: 0.902164502165 F1-score multiplied: 0.323830063696 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.7800583687909963, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385368366821 F1-OK: 0.906070388158 F1-score multiplied: 0.34917086571 Epoch 11: Test set LL -0.8274086188097932, Acc 0.8294181823730469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363728986246 F1-OK: 0.901506190364 F1-score multiplied: 0.327903932715 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.7968654236492794, Acc 0.8358147740364075, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387359836901 F1-OK: 0.905205047319 F1-score multiplied: 0.350640079491 Epoch 12: Test set LL -0.8471855170787189, Acc 0.8289401531219482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.364696931271 F1-OK: 0.90116393766 F1-score multiplied: 0.328651722636 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.8091234679776717, Acc 0.8352683782577515, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392749244713 F1-OK: 0.904709228824 F1-score multiplied: 0.355323866306 Epoch 13: Test set LL -0.859462175623407, Acc 0.8285987377166748, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370927318296 F1-OK: 0.900782670567 F1-score multiplied: 0.334124900361 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.8206563908536897, Acc 0.8348585963249207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395197598799 F1-OK: 0.904373961876 F1-score multiplied: 0.35740641815 Epoch 14: Test set LL -0.8728538627462618, Acc 0.8280524611473083, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373007968127 F1-OK: 0.900364039253 F1-score multiplied: 0.335842960857 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.8395616402847395, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390954773869 F1-OK: 0.904204868795 F1-score multiplied: 0.353503210011 Epoch 15: Test set LL -0.8945791534055972, Acc 0.8274378776550293, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367775831874 F1-OK: 0.90008303349 F1-score multiplied: 0.331028786397 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.8481081971004485, Acc 0.8349952101707458, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393574297189 F1-OK: 0.904505928854 F1-score multiplied: 0.355990285252 Epoch 16: Test set LL -0.9035665107131705, Acc 0.8279158473014832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369053580371 F1-OK: 0.900371629635 F1-score multiplied: 0.332285373581 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.8519223449769541, Acc 0.8334926962852478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396833250866 F1-OK: 0.903414943348 F1-score multiplied: 0.35850508885 Epoch 17: Test set LL -0.907494114963491, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.374352651048 F1-OK: 0.899457060199 F1-score multiplied: 0.336714134989 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -0.860645823449573, Acc 0.8340390920639038, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392196098049 F1-OK: 0.903899390967 F1-score multiplied: 0.354505814166 Epoch 18: Test set LL -0.920449388308449, Acc 0.8270964026451111, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370775347913 F1-OK: 0.899778340722 F1-score multiplied: 0.333615627325 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.8627530118647371, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397435897436 F1-OK: 0.903123513556 F1-score multiplied: 0.358933704106 Epoch 19: Test set LL -0.9223407699664837, Acc 0.8262087106704712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372070071552 F1-OK: 0.899148008718 F1-score multiplied: 0.33454606394 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.8722410809101663, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398221343874 F1-OK: 0.903471231574 F1-score multiplied: 0.359781527988 Epoch 20: Test set LL -0.9313910067636264, Acc 0.8259355425834656, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373556156304 F1-OK: 0.898925413379 F1-score multiplied: 0.335799122226 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -0.8779724231434555, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395833333333 F1-OK: 0.903532393474 F1-score multiplied: 0.357648239083 Epoch 21: Test set LL -0.938220159577997, Acc 0.8269598484039307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372461614661 F1-OK: 0.899643564356 F1-score multiplied: 0.335082694599 [ 48250 85392 96772 ..., 159417 47120 80258]
Epoch 1: \Dev set LL -0.5671985422869743, Acc 0.8229749798774719, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.317894736842 F1-OK: 0.898289122587 F1-score multiplied: 0.285561384233 Epoch 1: Test set LL -0.5695403622563391, Acc 0.8168533444404602, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.312307692308 F1-OK: 0.89435953994 F1-score multiplied: 0.279315364012 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.43372405967888605, Acc 0.8425078392028809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.292203806016 F1-OK: 0.911396296012 F1-score multiplied: 0.266313466483 Epoch 2: Test set LL -0.4411925081098339, Acc 0.8365883827209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.277257626095 F1-OK: 0.907880047735 F1-score multiplied: 0.251716666814 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.4896923653190095, Acc 0.846605658531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.284257488846 F1-OK: 0.914097758739 F1-score multiplied: 0.259839133459 Epoch 3: Test set LL -0.505055670562966, Acc 0.8405490517616272, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.264566929134 F1-OK: 0.910580936698 F1-score multiplied: 0.24090960215 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.6458602120146377, Acc 0.846605658531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.309772587585 F1-OK: 0.913714944295 F1-score multiplied: 0.283043842609 Epoch 4: Test set LL -0.6751912905206581, Acc 0.8383638262748718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.284678150499 F1-OK: 0.908887947958 F1-score multiplied: 0.258740540035 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.7727535204092579, Acc 0.8452396988868713, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.341661824521 F1-OK: 0.912313288445 F1-score multiplied: 0.311702622665 Epoch 5: Test set LL -0.8151384151727492, Acc 0.8384321331977844, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320895522388 F1-OK: 0.908308789335 F1-score multiplied: 0.291472223443 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.781449279612514, Acc 0.8408687114715576, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.369247428262 F1-OK: 0.908948808128 F1-score multiplied: 0.335627009823 Epoch 6: Test set LL -0.8311216677944965, Acc 0.8320131301879883, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33692722372 F1-OK: 0.903823598405 F1-score multiplied: 0.304522775743 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.7924428930458927, Acc 0.8419615030288696, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.368794326241 F1-OK: 0.909672886252 F1-score multiplied: 0.335482199185 Epoch 7: Test set LL -0.8423134788193705, Acc 0.8326277136802673, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335592301437 F1-OK: 0.904254072425 F1-score multiplied: 0.303460705249 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.8026443748267191, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.376734258271 F1-OK: 0.908521303258 F1-score multiplied: 0.342271099306 Epoch 8: Test set LL -0.8534419451166504, Acc 0.831057071685791, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.348604528699 F1-OK: 0.902942330326 F1-score multiplied: 0.314769785506 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.8155513901146186, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387295081967 F1-OK: 0.905752561072 F1-score multiplied: 0.350793512382 Epoch 9: Test set LL -0.868280484473278, Acc 0.8280524611473083, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359938993391 F1-OK: 0.900686282243 F1-score multiplied: 0.324192113792 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.8231914324893042, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392893401015 F1-OK: 0.905618686869 F1-score multiplied: 0.355811605907 Epoch 10: Test set LL -0.877042565745267, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.360647445625 F1-OK: 0.900213152285 F1-score multiplied: 0.324659573889 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.827048314042897, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38683127572 F1-OK: 0.906126949126 F1-score multiplied: 0.350518243695 Epoch 11: Test set LL -0.8808464095363211, Acc 0.8280524611473083, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358634742741 F1-OK: 0.900717609021 F1-score multiplied: 0.323028627993 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.8288176621636452, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386270491803 F1-OK: 0.905594956659 F1-score multiplied: 0.349804609283 Epoch 12: Test set LL -0.8849724519516047, Acc 0.8277792930603027, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358596134283 F1-OK: 0.900536362202 F1-score multiplied: 0.322928858267 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.833456999537028, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392875318066 F1-OK: 0.905892561332 F1-score multiplied: 0.355902828167 Epoch 13: Test set LL -0.8888729827888241, Acc 0.8280524611473083, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363820111167 F1-OK: 0.900592183182 F1-score multiplied: 0.327653548202 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.8322505193875633, Acc 0.8377270698547363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393258426966 F1-OK: 0.906338694418 F1-score multiplied: 0.356425329266 Epoch 14: Test set LL -0.8887964320628302, Acc 0.8281207084655762, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365515502899 F1-OK: 0.900596342956 F1-score multiplied: 0.329181925205 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.8474737234796186, Acc 0.8374539017677307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386597938144 F1-OK: 0.906313966305 F1-score multiplied: 0.350379110685 Epoch 15: Test set LL -0.9023281393825263, Acc 0.8290084600448608, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.360572012257 F1-OK: 0.901308529087 F1-score multiplied: 0.324986629998 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.8477997541181771, Acc 0.8360879421234131, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387129724208 F1-OK: 0.905392620624 F1-score multiplied: 0.350504395523 Epoch 16: Test set LL -0.9052152535380127, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363867038823 F1-OK: 0.901092831499 F1-score multiplied: 0.327877980302 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.8476163715190348, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394974874372 F1-OK: 0.904837179893 F1-score multiplied: 0.357387951455 Epoch 17: Test set LL -0.9058227376869632, Acc 0.8271647095680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368670491394 F1-OK: 0.899877368567 F1-score multiplied: 0.331758231664 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -0.8517431659452694, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394108684611 F1-OK: 0.905862858045 F1-score multiplied: 0.357008419422 Epoch 18: Test set LL -0.9117296489710632, Acc 0.8288035988807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367398435529 F1-OK: 0.901006910168 F1-score multiplied: 0.331028529196 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.8473649951645946, Acc 0.8354049921035767, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396594892339 F1-OK: 0.904705417161 F1-score multiplied: 0.358801547517 Epoch 19: Test set LL -0.9082156572463885, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.36739780658 F1-OK: 0.899588542491 F1-score multiplied: 0.330506857336 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.8571512846977608, Acc 0.8349952101707458, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396603396603 F1-OK: 0.904430379747 F1-score multiplied: 0.358700160599 Epoch 20: Test set LL -0.9182596937803895, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369873228934 F1-OK: 0.899663566198 F1-score multiplied: 0.332761468184 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -0.8564711275050088, Acc 0.8348585963249207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389702170621 F1-OK: 0.904509912329 F1-score multiplied: 0.352489476183 Epoch 21: Test set LL -0.9162071188727773, Acc 0.8281890153884888, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367521367521 F1-OK: 0.900592651126 F1-score multiplied: 0.330987042722 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -0.8614665539019747, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396188565697 F1-OK: 0.904807084124 F1-score multiplied: 0.358474220892 Epoch 22: Test set LL -0.9232147282774539, Acc 0.8269598484039307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365230460922 F1-OK: 0.899826059456 F1-score multiplied: 0.328643886445 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -0.8631556724596497, Acc 0.834585428237915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395406889666 F1-OK: 0.90418545771 F1-score multiplied: 0.357521159514 Epoch 23: Test set LL -0.9254795121590798, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369376087497 F1-OK: 0.899584405304 F1-score multiplied: 0.332284968004 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.8647382116054273, Acc 0.834585428237915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396009975062 F1-OK: 0.904170293582 F1-score multiplied: 0.358060455414 Epoch 24: Test set LL -0.9260399598809229, Acc 0.8265501260757446, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369100844511 F1-OK: 0.899453724962 F1-score multiplied: 0.331989129482 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -0.8672789107532626, Acc 0.8333560824394226, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394240317776 F1-OK: 0.903389293633 F1-score multiplied: 0.356152482197 Epoch 25: Test set LL -0.9294212662308233, Acc 0.826481819152832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370883882149 F1-OK: 0.899362350984 F1-score multiplied: 0.333559000192 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -0.8682645310970621, Acc 0.8339024782180786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396226415094 F1-OK: 0.903706050048 F1-score multiplied: 0.358072208509 Epoch 26: Test set LL -0.9298395820756002, Acc 0.8270281553268433, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.371308016878 F1-OK: 0.899718912071 F1-score multiplied: 0.334072844988 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -0.8676608919518178, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394408387419 F1-OK: 0.904027217343 F1-score multiplied: 0.356555916975 Epoch 27: Test set LL -0.9306562590672847, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368027888446 F1-OK: 0.899572649573 F1-score multiplied: 0.331067822726 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -0.8667432136133975, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396645288604 F1-OK: 0.903051922315 F1-score multiplied: 0.358191290351 Epoch 28: Test set LL -0.9281150791793046, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373734880276 F1-OK: 0.899472995998 F1-score multiplied: 0.336164432471 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -0.8701280445636045, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.400197628458 F1-OK: 0.903788239024 F1-score multiplied: 0.361693909886 Epoch 29: Test set LL -0.9320565179079972, Acc 0.8260038495063782, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372104484968 F1-OK: 0.899009116132 F1-score multiplied: 0.33452532414 [ 44559 117975 7356 ..., 164492 159093 15768] Epoch 30: \Dev set LL -0.8706620650162088, Acc 0.8347220420837402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39620758483 F1-OK: 0.90425700269 F1-score multiplied: 0.358273483102 Epoch 30: Test set LL -0.9337523765254344, Acc 0.8265501260757446, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369414101291 F1-OK: 0.899445764054 F1-score multiplied: 0.332267948588 [109754 141570 108980 ..., 139365 215134 72258] Epoch 31: \Dev set LL -0.8753667169893016, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399207528479 F1-OK: 0.903905569199 F1-score multiplied: 0.360845908259 Epoch 31: Test set LL -0.9388675834636383, Acc 0.8263452649116516, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.371633308624 F1-OK: 0.899251218256 F1-score multiplied: 0.334191705524 [188636 149668 181585 ..., 86043 3885 149926] Epoch 32: \Dev set LL -0.8800449887526548, Acc 0.8326731324195862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399804017638 F1-OK: 0.902785493215 F1-score multiplied: 0.360937267253 Epoch 32: Test set LL -0.9441647573470827, Acc 0.8257306814193726, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376039119804 F1-OK: 0.898722120803 F1-score multiplied: 0.337954675256 [118069 172817 212991 ..., 6636 158235 11185] Epoch 33: \Dev set LL -0.8774861547837968, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39880952381 F1-OK: 0.904007603358 F1-score multiplied: 0.360526841815 Epoch 33: Test set LL -0.940298757382526, Acc 0.8267549872398376, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370315214693 F1-OK: 0.899560552674 F1-score multiplied: 0.333120959193 [ 35430 78766 7572 ..., 21798 172876 186694] Epoch 34: \Dev set LL -0.8861576216648462, Acc 0.8344488739967346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395812562313 F1-OK: 0.90408357075 F1-score multiplied: 0.357847634684 Epoch 34: Test set LL -0.950461629184822, Acc 0.8270964026451111, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370775347913 F1-OK: 0.899778340722 F1-score multiplied: 0.333615627325 [ 12263 179388 192145 ..., 56465 182676 75856] Epoch 35: \Dev set LL -0.8819330395124582, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39900990099 F1-OK: 0.903818729203 F1-score multiplied: 0.360632621652 Epoch 35: Test set LL -0.9439605549157262, Acc 0.8261404037475586, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369801980198 F1-OK: 0.899160329531 F1-score multiplied: 0.332511270376 [159646 185256 171645 ..., 194155 131629 68601] Epoch 36: \Dev set LL -0.8817089065788423, Acc 0.8322633504867554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399217221135 F1-OK: 0.902524210192 F1-score multiplied: 0.3603032072 Epoch 36: Test set LL -0.9454089232371605, Acc 0.8251844048500061, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373470386686 F1-OK: 0.898420760257 F1-score multiplied: 0.33553354874 [191753 201171 122412 ..., 38797 37466 188023] Epoch 37: \Dev set LL -0.8901016354743997, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394854032657 F1-OK: 0.903098011251 F1-score multiplied: 0.356591891627 Epoch 37: Test set LL -0.954533741437613, Acc 0.8260038495063782, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368681863231 F1-OK: 0.89909710122 F1-score multiplied: 0.331480794503 [153734 132148 148743 ..., 8738 83102 23751] Epoch 38: \Dev set LL -0.8911196038001308, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395833333333 F1-OK: 0.903532393474 F1-score multiplied: 0.357648239083 Epoch 38: Test set LL -0.9552442111755987, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368932038835 F1-OK: 0.899687388706 F1-score multiplied: 0.33192350263 [ 57591 60924 105622 ..., 133844 68700 81761] Epoch 39: \Dev set LL -0.8934875936256439, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398425971471 F1-OK: 0.903005789515 F1-score multiplied: 0.359780958931 Epoch 39: Test set LL -0.9574204254605403, Acc 0.825867235660553, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373772102161 F1-OK: 0.898873730964 F1-score multiplied: 0.335973924 [175786 45399 125058 ..., 82247 183438 112942] Epoch 40: \Dev set LL -0.896283829228742, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.400584795322 F1-OK: 0.902303415409 F1-score multiplied: 0.36144902898 Epoch 40: Test set LL -0.9592339577098423, Acc 0.8254575133323669, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377799415774 F1-OK: 0.898490865766 F1-score multiplied: 0.339449324165 [ 96819 206932 1785 ..., 78475 169891 180553] Epoch 41: \Dev set LL -0.8975548260265644, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398622047244 F1-OK: 0.903092783505 F1-score multiplied: 0.359992694212 Epoch 41: Test set LL -0.9605052005736014, Acc 0.826276957988739, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.374938574939 F1-OK: 0.899119676422 F1-score multiplied: 0.337114650177 [ 89635 183840 203254 ..., 106660 205319 196231] Epoch 42: \Dev set LL -0.897016916192385, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39468503937 F1-OK: 0.902458366376 F1-score multiplied: 0.356186815863 Epoch 42: Test set LL -0.9592103628357245, Acc 0.8261404037475586, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373215164943 F1-OK: 0.899072385634 F1-score multiplied: 0.3355474487 [110684 152431 187978 ..., 190728 153645 167144] Epoch 43: \Dev set LL -0.8962017442401101, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396645288604 F1-OK: 0.903051922315 F1-score multiplied: 0.358191290351 Epoch 43: Test set LL -0.9578527742207346, Acc 0.826072096824646, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370333745365 F1-OK: 0.899100740799 F1-score multiplied: 0.3329673448 [ 86065 158811 87623 ..., 10358 112387 134839] Epoch 44: \Dev set LL -0.9007652635668739, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398622047244 F1-OK: 0.903092783505 F1-score multiplied: 0.359992694212 Epoch 44: Test set LL -0.9620838771052003, Acc 0.8260038495063782, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372413793103 F1-OK: 0.899001109878 F1-score multiplied: 0.334800413334 [157439 92985 91913 ..., 110497 154030 216302] Epoch 45: \Dev set LL -0.9026745785473507, Acc 0.8321267366409302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.40252795333 F1-OK: 0.902344060389 F1-score multiplied: 0.363218707828 Epoch 45: Test set LL -0.9637205869994984, Acc 0.8253209590911865, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376705653021 F1-OK: 0.898427573062 F1-score multiplied: 0.338442745603 [185362 193751 196467 ..., 55673 208466 140780] Epoch 46: \Dev set LL -0.9092373800044132, Acc 0.8323999643325806, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39882410583 F1-OK: 0.902626775653 F1-score multiplied: 0.359989316698 Epoch 46: Test set LL -0.9706077603735977, Acc 0.826481819152832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378576669112 F1-OK: 0.899162665185 F1-score multiplied: 0.340402006776 [116178 194505 95043 ..., 1569 99101 146376] Epoch 47: \Dev set LL -0.9107607579490159, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398230088496 F1-OK: 0.902918781726 F1-score multiplied: 0.359569426351 Epoch 47: Test set LL -0.9728565605756163, Acc 0.8254575133323669, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373529411765 F1-OK: 0.898603617899 F1-score multiplied: 0.335654880803 [175592 162391 192422 ..., 104363 138714 190912] Epoch 48: \Dev set LL -0.9099994927826716, Acc 0.8332195281982422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.40234948605 F1-OK: 0.903087546631 F1-score multiplied: 0.363356810245 Epoch 48: Test set LL -0.9714587103401495, Acc 0.8257989883422852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375520195838 F1-OK: 0.898781891045 F1-score multiplied: 0.337510751741 [216202 15665 40210 ..., 93117 76944 106362] Epoch 49: \Dev set LL -0.9175313424032169, Acc 0.8318535685539246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.402717127608 F1-OK: 0.902154041809 F1-score multiplied: 0.363312884377 Epoch 49: Test set LL -0.9796902173944159, Acc 0.8239551782608032, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.374878758487 F1-OK: 0.897552058496 F1-score multiplied: 0.336473201366 [ 69791 98282 134589 ..., 145613 96047 127529] Done!
gaussian processes - only - 72 features - matern 12 - phrase Epoch 1: \Dev set LL -0.6080585817943559, Acc 0.8468788266181946, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.256138022561 F1-OK: 0.914655500571 F1-score multiplied: 0.234278051241 Epoch 1: Test set LL -0.609076118628154, Acc 0.8416416049003601, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.23842364532 F1-OK: 0.911633578478 F1-score multiplied: 0.217355000977 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.4975710804971242, Acc 0.8470154404640198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.252336448598 F1-OK: 0.914790018259 F1-score multiplied: 0.230834864421 Epoch 2: Test set LL -0.5001119249526498, Acc 0.8414367437362671, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.236686390533 F1-OK: 0.911529375905 F1-score multiplied: 0.215746597847 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.4314410127448262, Acc 0.8467422723770142, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.243935309973 F1-OK: 0.914728682171 F1-score multiplied: 0.223134624627 Epoch 3: Test set LL -0.43604650115035487, Acc 0.840822160243988, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.229930624381 F1-OK: 0.911237195842 F1-score multiplied: 0.209521337399 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.4338055352321438, Acc 0.8470154404640198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.243243243243 F1-OK: 0.914906549157 F1-score multiplied: 0.222544836281 Epoch 4: Test set LL -0.44134440552188847, Acc 0.841027021408081, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.229139072848 F1-OK: 0.911375057104 F1-score multiplied: 0.208831635601 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.4789577192917703, Acc 0.8470154404640198, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.243243243243 F1-OK: 0.914906549157 F1-score multiplied: 0.222544836281 Epoch 5: Test set LL -0.4899015719521964, Acc 0.8410953283309937, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.230743801653 F1-OK: 0.911396260899 F1-score multiplied: 0.210299038052 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.5388005699764716, Acc 0.8468788266181946, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.243079000675 F1-OK: 0.914824101512 F1-score multiplied: 0.222374528389 Epoch 6: Test set LL -0.5535281844792258, Acc 0.8412318825721741, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.231404958678 F1-OK: 0.911472413662 F1-score multiplied: 0.210919236219 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.5952410917123272, Acc 0.846605658531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.243771043771 F1-OK: 0.914646195941 F1-score multiplied: 0.222964257866 Epoch 7: Test set LL -0.6136092850067791, Acc 0.8410953283309937, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.231759656652 F1-OK: 0.911382764005 F1-score multiplied: 0.211221756465 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.6386055363249578, Acc 0.846605658531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.245802552048 F1-OK: 0.914620238729 F1-score multiplied: 0.224815988835 Epoch 8: Test set LL -0.6601741615541501, Acc 0.8408904671669006, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.233048057933 F1-OK: 0.911238095238 F1-score multiplied: 0.21236226841 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.6662196956620573, Acc 0.8472886085510254, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.254666666667 F1-OK: 0.914929234515 F1-score multiplied: 0.23300197839 Epoch 9: Test set LL -0.6905593744261916, Acc 0.8407539129257202, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.236910994764 F1-OK: 0.91110094541 F1-score multiplied: 0.215849831308 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.6848728734221106, Acc 0.8476983904838562, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.262078093977 F1-OK: 0.915086436677 F1-score multiplied: 0.239824109149 Epoch 10: Test set LL -0.711677843256844, Acc 0.841027021408081, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.2421875 F1-OK: 0.911199267623 F1-score multiplied: 0.220681072627 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.6984998540475604, Acc 0.8472886085510254, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.267365661861 F1-OK: 0.914760597743 F1-score multiplied: 0.24457557266 Epoch 11: Test set LL -0.7272555220072414, Acc 0.8413684964179993, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.251369642282 F1-OK: 0.911285086882 F1-score multiplied: 0.229069406306 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.7067032195389228, Acc 0.846605658531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.273139158576 F1-OK: 0.91425517294 F1-score multiplied: 0.249718888661 Epoch 12: Test set LL -0.7372589122224975, Acc 0.8412318825721741, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.260260897232 F1-OK: 0.91107286288 F1-score multiplied: 0.237116640737 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.7103987995488176, Acc 0.8463324904441833, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.287523749208 F1-OK: 0.913878894588 F1-score multiplied: 0.262761886094 Epoch 13: Test set LL -0.7426289057633779, Acc 0.8413001894950867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.271016311167 F1-OK: 0.910957854406 F1-score multiplied: 0.24688443733 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.7123293399075487, Acc 0.846059262752533, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.295184490306 F1-OK: 0.913593498428 F1-score multiplied: 0.269678631181 Epoch 14: Test set LL -0.7462673970258518, Acc 0.8413001894950867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.281829419036 F1-OK: 0.910793797021 F1-score multiplied: 0.256688486676 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.7090865953225155, Acc 0.8449665307998657, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.306658521686 F1-OK: 0.912725874664 F1-score multiplied: 0.279895167429 Epoch 15: Test set LL -0.744838795070987, Acc 0.840002715587616, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.293212669683 F1-OK: 0.909790936742 F1-score multiplied: 0.266762229416 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.7109278820869246, Acc 0.8440103530883789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321046373365 F1-OK: 0.911882716049 F1-score multiplied: 0.292756638922 Epoch 16: Test set LL -0.748309712353746, Acc 0.8390467166900635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301215535132 F1-OK: 0.909048813429 F1-score multiplied: 0.273819624798 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.7164574918646346, Acc 0.8438737988471985, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.33118782914 F1-OK: 0.911621433542 F1-score multiplied: 0.301917923572 Epoch 17: Test set LL -0.7552441481833808, Acc 0.8383638262748718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.310113669484 F1-OK: 0.908458057779 F1-score multiplied: 0.28172526187 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -0.7341661412258257, Acc 0.8433274030685425, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.335072463768 F1-OK: 0.911202291554 F1-score multiplied: 0.305318796822 Epoch 18: Test set LL -0.7742014286054725, Acc 0.8381589651107788, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.315028901734 F1-OK: 0.908239120335 F1-score multiplied: 0.286121572591 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.7359431814846722, Acc 0.8414151072502136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.33996588971 F1-OK: 0.909881238842 F1-score multiplied: 0.309328584893 Epoch 19: Test set LL -0.7763991403481839, Acc 0.836042046546936, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320407585621 F1-OK: 0.906775383421 F1-score multiplied: 0.290537711303 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.7432954705673896, Acc 0.8403223752975464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34214969049 F1-OK: 0.909133307423 F1-score multiplied: 0.311059679749 Epoch 20: Test set LL -0.7843344153763724, Acc 0.835017740726471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.324006715165 F1-OK: 0.906043400482 F1-score multiplied: 0.293564145987 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -0.7513232541318614, Acc 0.8397759795188904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345058626466 F1-OK: 0.908723056571 F1-score multiplied: 0.313562729738 Epoch 21: Test set LL -0.7928821124102179, Acc 0.8340617418289185, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327614831212 F1-OK: 0.905351717691 F1-score multiplied: 0.296606650179 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -0.7603558929149429, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34758467518 F1-OK: 0.908496223036 F1-score multiplied: 0.315779364586 Epoch 22: Test set LL -0.8025860322509759, Acc 0.8338568806648254, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330674002751 F1-OK: 0.905157291545 F1-score multiplied: 0.299311984714 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -0.7640535247285853, Acc 0.8386832475662231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350742166025 F1-OK: 0.907899867426 F1-score multiplied: 0.318438766035 Epoch 23: Test set LL -0.8066389940849292, Acc 0.8331056833267212, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333696837514 F1-OK: 0.904605776737 F1-score multiplied: 0.301864086894 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.7708803981891407, Acc 0.8384100794792175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353198469109 F1-OK: 0.907671895731 F1-score multiplied: 0.320588324025 Epoch 24: Test set LL -0.8140661538283306, Acc 0.8330374360084534, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337218758471 F1-OK: 0.90448845658 F1-score multiplied: 0.305010474379 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -0.7763641000642433, Acc 0.8382734656333923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35652173913 F1-OK: 0.907514450867 F1-score multiplied: 0.323548630309 Epoch 25: Test set LL -0.8199171213124344, Acc 0.8329691290855408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340700808625 F1-OK: 0.90437094378 F1-score multiplied: 0.308119911843 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -0.780668893244684, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357065803668 F1-OK: 0.906787613388 F1-score multiplied: 0.32378284793 Epoch 26: Test set LL -0.8246678905013503, Acc 0.8326277136802673, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343775100402 F1-OK: 0.904081712519 F1-score multiplied: 0.310800781493 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -0.7858751685376519, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358561460011 F1-OK: 0.906487205572 F1-score multiplied: 0.325031375911 Epoch 27: Test set LL -0.8303170737258669, Acc 0.8317399621009827, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346765641569 F1-OK: 0.903433139991 F1-score multiplied: 0.313279572404 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -0.7909526637257673, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3616 F1-OK: 0.90624265685 F1-score multiplied: 0.327697344717 Epoch 28: Test set LL -0.8358944480349662, Acc 0.8315351009368896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.348904724202 F1-OK: 0.903251107887 F1-score multiplied: 0.315148578682 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -0.7936178001218861, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.367195767196 F1-OK: 0.906210790464 F1-score multiplied: 0.332756766446 Epoch 29: Test set LL -0.8387861323353537, Acc 0.830237627029419, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.350574712644 F1-OK: 0.902356637863 F1-score multiplied: 0.316343419021 [ 44559 117975 7356 ..., 164492 159093 15768] Epoch 30: \Dev set LL -0.8027494924922737, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.36643653744 F1-OK: 0.906497374402 F1-score multiplied: 0.332173759075 Epoch 30: Test set LL -0.8489151984309594, Acc 0.830852210521698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349014454665 F1-OK: 0.902797943727 F1-score multiplied: 0.315089532003 [109754 141570 108980 ..., 139365 215134 72258] Epoch 31: \Dev set LL -0.8076322335163697, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.369978858351 F1-OK: 0.906509803922 F1-score multiplied: 0.335389462339 Epoch 31: Test set LL -0.8542668391327308, Acc 0.8305791020393372, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35137254902 F1-OK: 0.902564505361 F1-score multiplied: 0.317136390903 [188636 149668 181585 ..., 86043 3885 149926] Epoch 32: \Dev set LL -0.8094511616259624, Acc 0.8367709517478943, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374672946102 F1-OK: 0.906134632001 F1-score multiplied: 0.339504132136 Epoch 32: Test set LL -0.8559336342535928, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.354247353473 F1-OK: 0.901593547118 F1-score multiplied: 0.319387127975 [118069 172817 212991 ..., 6636 158235 11185] Epoch 33: \Dev set LL -0.8136431232146448, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.37558685446 F1-OK: 0.905933202358 F1-score multiplied: 0.340256601824 Epoch 33: Test set LL -0.8606088900644528, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.356573192694 F1-OK: 0.901539309476 F1-score multiplied: 0.321464749919 [ 35430 78766 7572 ..., 21798 172876 186694] Epoch 34: \Dev set LL -0.8197827045034227, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374281233664 F1-OK: 0.905962762197 F1-score multiplied: 0.339084860289 Epoch 34: Test set LL -0.8674437707724213, Acc 0.8295547962188721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.356701030928 F1-OK: 0.901763224181 F1-score multiplied: 0.321659871718 [ 12263 179388 192145 ..., 56465 182676 75856] Epoch 35: \Dev set LL -0.8220786132265011, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378378378378 F1-OK: 0.905960056613 F1-score multiplied: 0.342795697097 Epoch 35: Test set LL -0.8697209038628624, Acc 0.8293498754501343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.360706062932 F1-OK: 0.901532763308 F1-score multiplied: 0.325188333657 [159646 185256 171645 ..., 194155 131629 68601] Epoch 36: \Dev set LL -0.8243961938456011, Acc 0.8360879421234131, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378881987578 F1-OK: 0.905586152636 F1-score multiplied: 0.343110281433 Epoch 36: Test set LL -0.872227894562888, Acc 0.8292816281318665, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363543788187 F1-OK: 0.90141955836 F1-score multiplied: 0.327705480992 [191753 201171 122412 ..., 38797 37466 188023] Epoch 37: \Dev set LL -0.8283276476060933, Acc 0.8358147740364075, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380412371134 F1-OK: 0.905369233192 F1-score multiplied: 0.34441365675 Epoch 37: Test set LL -0.8764456926076751, Acc 0.8293498754501343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365896980462 F1-OK: 0.901408450704 F1-score multiplied: 0.329822630275 [153734 132148 148743 ..., 8738 83102 23751] Epoch 38: \Dev set LL -0.8344440306581189, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380755302638 F1-OK: 0.90581477693 F1-score multiplied: 0.344893779524 Epoch 38: Test set LL -0.8835456216642062, Acc 0.8294181823730469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.361778231988 F1-OK: 0.901552770553 F1-score multiplied: 0.326162167374 [ 57591 60924 105622 ..., 133844 68700 81761] Epoch 39: \Dev set LL -0.8358038477304198, Acc 0.8362245559692383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.383547557841 F1-OK: 0.905568244467 F1-score multiplied: 0.347328488623 Epoch 39: Test set LL -0.8850244150160201, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.364421855146 F1-OK: 0.901352897093 F1-score multiplied: 0.3284726949 [175786 45399 125058 ..., 82247 183438 112942] Epoch 40: \Dev set LL -0.8381505147324719, Acc 0.8356781601905823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385283597343 F1-OK: 0.90516357903 F1-score multiplied: 0.348744679913 Epoch 40: Test set LL -0.8874999684123072, Acc 0.8289401531219482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367903103709 F1-OK: 0.901085883514 F1-score multiplied: 0.331512293254 [ 96819 206932 1785 ..., 78475 169891 180553] Epoch 41: \Dev set LL -0.8418492025219386, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386270491803 F1-OK: 0.905594956659 F1-score multiplied: 0.349804609283 Epoch 41: Test set LL -0.8916603105922344, Acc 0.8288719058036804, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366851945427 F1-OK: 0.901065929728 F1-score multiplied: 0.330557789279 [ 89635 183840 203254 ..., 106660 205319 196231] Epoch 42: \Dev set LL -0.8443036595684532, Acc 0.8362245559692383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386700767263 F1-OK: 0.905493812564 F1-score multiplied: 0.350155152071 Epoch 42: Test set LL -0.8944594053848633, Acc 0.8285987377166748, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366161616162 F1-OK: 0.900900189514 F1-score multiplied: 0.329875069393 [110684 152431 187978 ..., 190728 153645 167144] Epoch 43: \Dev set LL -0.8484514680824821, Acc 0.8366343379020691, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386036960986 F1-OK: 0.905782259335 F1-score multiplied: 0.349665430708 Epoch 43: Test set LL -0.8991176134914397, Acc 0.8285304307937622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365107458913 F1-OK: 0.90088027474 F1-score multiplied: 0.328918107895 [ 86065 158811 87623 ..., 10358 112387 134839] Epoch 44: \Dev set LL -0.849748597315128, Acc 0.8362245559692383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387953037264 F1-OK: 0.905464006938 F1-score multiplied: 0.351277511625 Epoch 44: Test set LL -0.90051469627553, Acc 0.8278475999832153, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365466901586 F1-OK: 0.900414773849 F1-score multiplied: 0.329071797541 [157439 92985 91913 ..., 110497 154030 216302] Epoch 45: \Dev set LL -0.8505673563105066, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.391878172589 F1-OK: 0.905460858586 F1-score multiplied: 0.354830346613 Epoch 45: Test set LL -0.9011450012575517, Acc 0.8268232941627502, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.365047571357 F1-OK: 0.899739068554 F1-score multiplied: 0.328447561831 [185362 193751 196467 ..., 55673 208466 140780] Epoch 46: \Dev set LL -0.8528789889933427, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393309680689 F1-OK: 0.905517404689 F1-score multiplied: 0.356148761297 Epoch 46: Test set LL -0.9038024184927431, Acc 0.8270964026451111, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367316341829 F1-OK: 0.899865538243 F1-score multiplied: 0.330535317645 [116178 194505 95043 ..., 1569 99101 146376] Epoch 47: \Dev set LL -0.8557589048282545, Acc 0.8363611698150635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393110435664 F1-OK: 0.905431007262 F1-score multiplied: 0.355934377728 Epoch 47: Test set LL -0.9072134459542842, Acc 0.8270281553268433, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366591647912 F1-OK: 0.899837874175 F1-score multiplied: 0.329873049147 [175592 162391 192422 ..., 104363 138714 190912] Epoch 48: \Dev set LL -0.8572625030567564, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393756294058 F1-OK: 0.904867256637 F1-score multiplied: 0.356297177588 Epoch 48: Test set LL -0.90889642518922, Acc 0.8268915414810181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368617683686 F1-OK: 0.899695327029 F1-score multiplied: 0.331643607473 [216202 15665 40210 ..., 93117 76944 106362] Epoch 49: \Dev set LL -0.8574439718192862, Acc 0.8352683782577515, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397602397602 F1-OK: 0.904588607595 F1-score multiplied: 0.359666599224 Epoch 49: Test set LL -0.9088562727056888, Acc 0.826686680316925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373023715415 F1-OK: 0.899445324881 F1-score multiplied: 0.3355144369 [ 69791 98282 134589 ..., 145613 96047 127529] Done!
our model - hybrid network - phrase level - 72 features -matern 12 - 512-256-4-gps
Epoch 1: \Dev set LL -0.40927830122164016, Acc 0.8448299169540405, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.30135301353 F1-OK: 0.912722802704 F1-score multiplied: 0.275051767113 Epoch 1: Test set LL -0.4202262831452409, Acc 0.8407539129257202, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.292046144505 F1-OK: 0.910286989305 F1-score multiplied: 0.26584580562 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.584340848231078, Acc 0.8388198614120483, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.373673036093 F1-OK: 0.907509013952 F1-score multiplied: 0.339111648526 Epoch 2: Test set LL -0.6132472682671687, Acc 0.835017740726471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359830418654 F1-OK: 0.905306890335 F1-score multiplied: 0.325756957359 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.798654893707261, Acc 0.8121841549873352, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.426844518549 F1-OK: 0.887690925427 F1-score multiplied: 0.378906005684 Epoch 3: Test set LL -0.8211595166000859, Acc 0.8100245594978333, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.416526845638 F1-OK: 0.886541598695 F1-score multiplied: 0.369268375631 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.8559783497490903, Acc 0.8187406063079834, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.434115138593 F1-OK: 0.892087501017 F1-score multiplied: 0.387268689141 Epoch 4: Test set LL -0.8891277535258307, Acc 0.8114586472511292, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.414422057264 F1-OK: 0.887640906686 F1-score multiplied: 0.367857970661 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -1.0034646418070612, Acc 0.7972954511642456, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.444610778443 F1-OK: 0.876023391813 F1-score multiplied: 0.389489442168 Epoch 5: Test set LL -1.016653417903947, Acc 0.7950013875961304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441592261905 F1-OK: 0.874456339913 F1-score multiplied: 0.386153153079 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.9273157290019522, Acc 0.8280289769172668, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.448049101271 F1-OK: 0.898147399078 F1-score multiplied: 0.402414134966 Epoch 6: Test set LL -0.9645629715895957, Acc 0.8222480416297913, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.429541968004 F1-OK: 0.894721941355 F1-score multiplied: 0.384320623506 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -1.002960124245826, Acc 0.8151891827583313, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.446172738436 F1-OK: 0.889089269612 F1-score multiplied: 0.396687394137 Epoch 7: Test set LL -1.0377592788768562, Acc 0.8120732307434082, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434443074394 F1-OK: 0.887314716239 F1-score multiplied: 0.385487733278 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9153785365953993, Acc 0.8382734656333923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.447245564893 F1-OK: 0.90528 F1-score multiplied: 0.404882464986 Epoch 8: Test set LL -0.9628158556581569, Acc 0.8319448232650757, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.420804895269 F1-OK: 0.90171332721 F1-score multiplied: 0.37944538222 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.940714441370675, Acc 0.8339024782180786, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.451263537906 F1-OK: 0.902140672783 F1-score multiplied: 0.407103191689 Epoch 9: Test set LL -0.9952972617012005, Acc 0.8269598484039307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.42850699143 F1-OK: 0.898044580349 F1-score multiplied: 0.384818381295 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9876283105019558, Acc 0.8287119269371033, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.441674087266 F1-OK: 0.898838334947 F1-score multiplied: 0.396993601188 Epoch 10: Test set LL -1.0280328548373676, Acc 0.8250477910041809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.432180851064 F1-OK: 0.896593477559 F1-score multiplied: 0.38749053219 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9735293493011841, Acc 0.8349952101707458, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.453887884268 F1-OK: 0.902815768302 F1-score multiplied: 0.409777138958 Epoch 11: Test set LL -1.0304917093226962, Acc 0.8266184329986572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.424393561551 F1-OK: 0.897937854243 F1-score multiplied: 0.381079044013 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -1.0057098679241976, Acc 0.8273459672927856, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.47245409015 F1-OK: 0.896782622897 F1-score multiplied: 0.423688618163 Epoch 12: Test set LL -1.0884350875679605, Acc 0.8153510093688965, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.439933719967 F1-OK: 0.889452166803 F1-score multiplied: 0.391300000474 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.9719091308028653, Acc 0.8370441198348999, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.445889456572 F1-OK: 0.904475938826 F1-score multiplied: 0.403296284846 Epoch 13: Test set LL -1.034593488583802, Acc 0.8305791020393372, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.428209264808 F1-OK: 0.900557136559 F1-score multiplied: 0.385626909363 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -1.0269124385344945, Acc 0.8307608366012573, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456340500219 F1-OK: 0.899781606406 F1-score multiplied: 0.410606788356 Epoch 14: Test set LL -1.0804123779471007, Acc 0.8242966532707214, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44053055012 F1-OK: 0.895783547329 F1-score multiplied: 0.394620018893 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -1.0027658310473477, Acc 0.8355416059494019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466312056738 F1-OK: 0.902793476506 F1-score multiplied: 0.420983482839 Epoch 15: Test set LL -1.0634012016627221, Acc 0.826481819152832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438948995363 F1-OK: 0.897370653096 F1-score multiplied: 0.393899946645 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -1.0035635999807324, Acc 0.8332195281982422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462351387054 F1-OK: 0.901301430765 F1-score multiplied: 0.416717966668 Epoch 16: Test set LL -1.0618637123500476, Acc 0.8252526521682739, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434974608081 F1-OK: 0.896643644735 F1-score multiplied: 0.390017217957 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0433055869921013, Acc 0.8269361853599548, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464723278411 F1-OK: 0.896782077393 F1-score multiplied: 0.416755507027 Epoch 17: Test set LL -1.1170250188817923, Acc 0.8163753151893616, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.436150136297 F1-OK: 0.890329948203 F1-score multiplied: 0.388317528258 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -1.0750079231587994, Acc 0.8184674382209778, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462161068393 F1-OK: 0.890806014296 F1-score multiplied: 0.411695859298 Epoch 18: Test set LL -1.1243370813305518, Acc 0.8133706450462341, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.444625076204 F1-OK: 0.887840111626 F1-score multiplied: 0.394755977289 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.989617677164392, Acc 0.8399125933647156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466787989081 F1-OK: 0.905818064931 F1-score multiplied: 0.422824993002 Epoch 19: Test set LL -1.0645392806160912, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.426236949614 F1-OK: 0.898400450125 F1-score multiplied: 0.382931467393 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.079360061912897, Acc 0.8216090798377991, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467807660962 F1-OK: 0.892845421726 F1-score multiplied: 0.417679928338 Epoch 20: Test set LL -1.120886955322416, Acc 0.8156241178512573, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.449204406365 F1-OK: 0.889280734848 F1-score multiplied: 0.399468824589 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0783129366583173, Acc 0.8267996311187744, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467674223342 F1-OK: 0.896574225122 F1-score multiplied: 0.419304654402 Epoch 21: Test set LL -1.1185676774004467, Acc 0.8197214007377625, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.45 F1-OK: 0.892192094087 F1-score multiplied: 0.401486442339 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0406309945004155, Acc 0.8319901823997498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461942257218 F1-OK: 0.900453221107 F1-score multiplied: 0.415957393477 Epoch 22: Test set LL -1.0959940211786137, Acc 0.8253892660140991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443525571273 F1-OK: 0.896448386182 F1-score multiplied: 0.397597782598 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0004723887808058, Acc 0.8416882753372192, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471017800091 F1-OK: 0.90691510722 F1-score multiplied: 0.427173158672 Epoch 23: Test set LL -1.0682541227266718, Acc 0.8292133212089539, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433008388121 F1-OK: 0.899465369619 F1-score multiplied: 0.389476049869 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.9960917898419364, Acc 0.8423712849617004, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465245597776 F1-OK: 0.907561678949 F1-score multiplied: 0.422239075841 Epoch 24: Test set LL -1.059439778285598, Acc 0.8324910998344421, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.43802978236 F1-OK: 0.901576856719 F1-score multiplied: 0.394917514329 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0370163784664275, Acc 0.835131824016571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.462839341344 F1-OK: 0.90262202501 F1-score multiplied: 0.417768983538 Epoch 25: Test set LL -1.0885344529407963, Acc 0.8260038495063782, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.434280639432 F1-OK: 0.897191736604 F1-score multiplied: 0.389633001065 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0435825684800608, Acc 0.8326731324195862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.469007368877 F1-OK: 0.900689096068 F1-score multiplied: 0.422429823123 Epoch 26: Test set LL -1.0965667241988288, Acc 0.8230674862861633, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.440751133175 F1-OK: 0.894909754614 F1-score multiplied: 0.394432488435 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.081006171250204, Acc 0.8257068991661072, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467000835422 F1-OK: 0.895819725669 F1-score multiplied: 0.418348560275 Epoch 27: Test set LL -1.142272691858039, Acc 0.816511869430542, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447233079613 F1-OK: 0.889998771851 F1-score multiplied: 0.398036891587 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0284269301183864, Acc 0.8358147740364075, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.478298611111 F1-OK: 0.902577403145 F1-score multiplied: 0.431701518344 Epoch 28: Test set LL -1.1108282232816844, Acc 0.821291983127594, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441647109025 F1-OK: 0.893622210479 F1-score multiplied: 0.394665665819 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -0.9939548524199278, Acc 0.842644453048706, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.458137347131 F1-OK: 0.907957813998 F1-score multiplied: 0.415969384212 Epoch 29: Test set LL -1.0583296957617168, Acc 0.8335154056549072, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433550185874 F1-OK: 0.90241754723 F1-score multiplied: 0.391243295337 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
our model - hybrid network - phrase level - 72 features - matern12 - 512-256-8-gps
Epoch 1: \Dev set LL -0.4528816345199271, Acc 0.8388198614120483, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398572884811 F1-OK: 0.906940063091 F1-score multiplied: 0.361481717297 Epoch 1: Test set LL -0.4728323655811652, Acc 0.8332422971725464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378309572301 F1-OK: 0.903706624606 F1-score multiplied: 0.341880866641 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.6466635600642416, Acc 0.8377270698547363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.428846153846 F1-OK: 0.905429071804 F1-score multiplied: 0.388289775024 Epoch 2: Test set LL -0.6815355885487778, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399319893126 F1-OK: 0.901752016209 F1-score multiplied: 0.360087518739 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.7423799716083146, Acc 0.8369075059890747, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.445682451253 F1-OK: 0.904388212684 F1-score multiplied: 0.403069955514 Epoch 3: Test set LL -0.7929006219082544, Acc 0.8287352919578552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.418367346939 F1-OK: 0.899583600256 F1-score multiplied: 0.376356404189 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.8323221807636647, Acc 0.8222920298576355, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459043659044 F1-OK: 0.893683092261 F1-score multiplied: 0.410239556697 Epoch 4: Test set LL -0.8715956854727127, Acc 0.8169898986816406, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446738232865 F1-OK: 0.890361642939 F1-score multiplied: 0.397758586978 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.8651277934554672, Acc 0.8382734656333923, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466666666667 F1-OK: 0.904685235872 F1-score multiplied: 0.422186443407 Epoch 5: Test set LL -0.9259795188779278, Acc 0.8285987377166748, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.433664259928 F1-OK: 0.899018345671 F1-score multiplied: 0.389872125537 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.8810704035521646, Acc 0.8395028114318848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.451703219785 F1-OK: 0.905992479398 F1-score multiplied: 0.409239720046 Epoch 6: Test set LL -0.9395193969677212, Acc 0.8307156562805176, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.427614869545 F1-OK: 0.90066915094 F1-score multiplied: 0.385139521482 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.9116260992797365, Acc 0.8303510546684265, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.472835314092 F1-OK: 0.89890932769 F1-score multiplied: 0.425036074298 Epoch 7: Test set LL -0.9789988224271128, Acc 0.821291983127594, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.447540637534 F1-OK: 0.893405563928 F1-score multiplied: 0.399835295657 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.9265929735729738, Acc 0.8436006307601929, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.450312049928 F1-OK: 0.908830320885 F1-score multiplied: 0.409257244835 Epoch 8: Test set LL -0.9766005125037789, Acc 0.8340617418289185, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.430379746835 F1-OK: 0.902885460795 F1-score multiplied: 0.388583616038 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.9546570954651987, Acc 0.8280289769172668, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.473882156289 F1-OK: 0.897216099273 F1-score multiplied: 0.425174699781 Epoch 9: Test set LL -1.0177450740295455, Acc 0.8199945092201233, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450604418508 F1-OK: 0.892364230298 F1-score multiplied: 0.402103265091 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.9857606037384931, Acc 0.8322633504867554, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459507042254 F1-OK: 0.900727566694 F1-score multiplied: 0.413890660048 Epoch 10: Test set LL -1.0312223333441237, Acc 0.8248429298400879, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442996742671 F1-OK: 0.896082323867 F1-score multiplied: 0.396961550638 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.9912614646714131, Acc 0.8326731324195862, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464363795365 F1-OK: 0.900849858357 F1-score multiplied: 0.418322059281 Epoch 11: Test set LL -1.0525936018834803, Acc 0.8255941271781921, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.438681318681 F1-OK: 0.896758024092 F1-score multiplied: 0.393390992547 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.9697606461415318, Acc 0.8378636837005615, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.47778266608 F1-OK: 0.904034279247 F1-score multiplied: 0.431931908166 Epoch 12: Test set LL -1.0490209880459704, Acc 0.8273012638092041, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450336883286 F1-OK: 0.897557418884 F1-score multiplied: 0.404203210591 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.990060628365445, Acc 0.8364977240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.461538461538 F1-OK: 0.903615427973 F1-score multiplied: 0.417053274449 Epoch 13: Test set LL -1.045152590988838, Acc 0.8297596573829651, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.441657334826 F1-OK: 0.899568948153 F1-score multiplied: 0.397301224134 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.9836236206812295, Acc 0.8397759795188904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467060427079 F1-OK: 0.90571497468 F1-score multiplied: 0.423023622886 Epoch 14: Test set LL -1.0444922810857247, Acc 0.8301693797111511, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442501681237 F1-OK: 0.899826801466 F1-score multiplied: 0.398174872471 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.9914153536661141, Acc 0.8404589295387268, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.466179159049 F1-OK: 0.906214870724 F1-score multiplied: 0.422458486352 Epoch 15: Test set LL -1.0503923011474288, Acc 0.8317399621009827, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.442281575373 F1-OK: 0.900924809007 F1-score multiplied: 0.398462443821 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.9804729989050904, Acc 0.8445567488670349, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464722483537 F1-OK: 0.909076382231 F1-score multiplied: 0.422468234075 Epoch 16: Test set LL -1.0270862792414488, Acc 0.8351543545722961, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446076181735 F1-OK: 0.903168872844 F1-score multiplied: 0.40288212226 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -1.0193514073476, Acc 0.835131824016571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464269862406 F1-OK: 0.902574864799 F1-score multiplied: 0.419038308291 Epoch 17: Test set LL -1.0707186529162467, Acc 0.8279158473014832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450741063644 F1-OK: 0.897975708502 F1-score multiplied: 0.404754525977 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -0.9933126848318778, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.458818054909 F1-OK: 0.906907868406 F1-score multiplied: 0.416105704164 Epoch 18: Test set LL -1.0479105991667623, Acc 0.8318765163421631, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44020009095 F1-OK: 0.901084773001 F1-score multiplied: 0.396657599029 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -1.0053174397691942, Acc 0.8374539017677307, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.463963963964 F1-OK: 0.904202221864 F1-score multiplied: 0.419517247081 Epoch 19: Test set LL -1.0600870446082924, Acc 0.8289401531219482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445182724252 F1-OK: 0.898881847172 F1-score multiplied: 0.400166669505 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -1.0160000241742997, Acc 0.8356781601905823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.456394035246 F1-OK: 0.90321023413 F1-score multiplied: 0.41221976343 Epoch 20: Test set LL -1.067724178545557, Acc 0.8293498754501343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.450648494175 F1-OK: 0.898985407656 F1-score multiplied: 0.405126420245 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -1.0098120025802912, Acc 0.8384100794792175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465431540895 F1-OK: 0.904819374045 F1-score multiplied: 0.421131475493 Epoch 21: Test set LL -1.0807246730046682, Acc 0.8283255696296692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.439839572193 F1-OK: 0.898629032258 F1-score multiplied: 0.395252609108 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -1.0126230159020448, Acc 0.8386832475662231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.459990855053 F1-OK: 0.905178643115 F1-score multiplied: 0.416373898022 Epoch 22: Test set LL -1.0686147242339388, Acc 0.8283938765525818, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.437178051512 F1-OK: 0.898763243766 F1-score multiplied: 0.39291956368 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -1.0419643784898727, Acc 0.8322633504867554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.475661827498 F1-OK: 0.900162601626 F1-score multiplied: 0.428172988135 Epoch 23: Test set LL -1.1096282074631258, Acc 0.8220431804656982, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.451137320977 F1-OK: 0.89380603097 F1-score multiplied: 0.403229258285 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -1.019535520308302, Acc 0.8371807336807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.471631205674 F1-OK: 0.903762312288 F1-score multiplied: 0.426242508987 Epoch 24: Test set LL -1.080587590486898, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.446584938704 F1-OK: 0.897734627832 F1-score multiplied: 0.400914763743 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -1.0613220282557827, Acc 0.831580400466919, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.465539661899 F1-OK: 0.900040535063 F1-score multiplied: 0.419004566388 Epoch 25: Test set LL -1.12236880894949, Acc 0.8209505677223206, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.445431472081 F1-OK: 0.893241042345 F1-score multiplied: 0.397877672415 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -1.0301784231000979, Acc 0.8393661975860596, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.455050973123 F1-OK: 0.905799423262 F1-score multiplied: 0.41218490901 Epoch 26: Test set LL -1.0667088490230567, Acc 0.8326277136802673, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.443839346494 F1-OK: 0.901491097625 F1-score multiplied: 0.40011721964 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -1.0104989757964487, Acc 0.841141939163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.448030374941 F1-OK: 0.907219784603 F1-score multiplied: 0.406462020249 Epoch 27: Test set LL -1.0634484004455567, Acc 0.8327642679214478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.431390759229 F1-OK: 0.901965493775 F1-score multiplied: 0.389099579158 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -1.0264791700428042, Acc 0.8374539017677307, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.464446444644 F1-OK: 0.904186795491 F1-score multiplied: 0.41994634246 Epoch 28: Test set LL -1.0810276140601367, Acc 0.8280524611473083, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.44341290893 F1-OK: 0.898320142142 F1-score multiplied: 0.398326747378 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -1.0423875138889598, Acc 0.8347220420837402, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.467429577465 F1-OK: 0.902182700081 F1-score multiplied: 0.421706878295 Epoch 29: Test set LL -1.0896801235756488, Acc 0.8283255696296692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.458189655172 F1-OK: 0.898003894839 F1-score multiplied: 0.41145609492 [ 44559 117975 7356 ..., 164492 159093 15768] Done!
gaussian processes only - 144 feautres - phrases - RBF
Using TensorFlow backend. 2018-03-14 11:38:32.619355: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA [<tf.Variable 'sconvnet_kernel/W1:0' shape=(72, 512) dtype=float32_ref>, <tf.Variable 'sconvnet_kernel/b1:0' shape=(512,) dtype=float32_ref>, <tf.Variable '6/SVGP/kern/variance/unconstrained:0' shape=() dtype=float64_ref>, <tf.Variable '6/SVGP/kern/lengthscales/unconstrained:0' shape=() dtype=float64_ref>, <tf.Variable '6/SVGP/feature/Z/unconstrained:0' shape=(100, 144) dtype=float64_ref>, <tf.Variable '6/SVGP/q_mu/unconstrained:0' shape=(100, 2) dtype=float64_ref>, <tf.Variable '6/SVGP/q_sqrt/unconstrained:0' shape=(2, 5050) dtype=float64_ref>] [157230 58090 106355 ..., 43269 152588 159419] Epoch 1: \Dev set LL -0.5829801037740061, Acc 0.7257205247879028, Outputs [1 1 0 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.349740932642 F1-OK: 0.82620737407 F1-score multiplied: 0.288958537563 Epoch 1: Test set LL -0.5843180026299908, Acc 0.7264408469200134, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358218519705 F1-OK: 0.826173739478 F1-score multiplied: 0.295950733975 [ 10604 112260 2170 ..., 24253 38081 64020] Epoch 2: \Dev set LL -0.48327199359415596, Acc 0.7757136821746826, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.351500789889 F1-OK: 0.86440957886 F1-score multiplied: 0.303840649757 Epoch 2: Test set LL -0.4877685181501961, Acc 0.7792269587516785, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366947327198 F1-OK: 0.866299987594 F1-score multiplied: 0.317886464999 [ 16587 157088 51334 ..., 99848 92538 64243] Epoch 3: \Dev set LL -0.4808265996989135, Acc 0.8079497218132019, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.349676225717 F1-OK: 0.88733974359 F1-score multiplied: 0.310281612467 Epoch 3: Test set LL -0.490903305913322, Acc 0.8106391429901123, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.374746335964 F1-OK: 0.888423932724 F1-score multiplied: 0.332933613571 [ 97998 95754 98742 ..., 203012 213193 125451] Epoch 4: \Dev set LL -0.5239743947159541, Acc 0.8252971172332764, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35696329814 F1-OK: 0.898917252825 F1-score multiplied: 0.320880467323 Epoch 4: Test set LL -0.5396641405277335, Acc 0.8251160979270935, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367810417181 F1-OK: 0.898522011333 F1-score multiplied: 0.330485755834 [ 82707 140148 157986 ..., 51883 106201 103473] Epoch 5: \Dev set LL -0.5702534534629937, Acc 0.8323999643325806, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359268929504 F1-OK: 0.903590791231 F1-score multiplied: 0.324632096275 Epoch 5: Test set LL -0.5909027255704936, Acc 0.8318765163421631, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.360519480519 F1-OK: 0.903215661609 F1-score multiplied: 0.32562684112 [ 96593 186600 181132 ..., 40532 34553 129546] Epoch 6: \Dev set LL -0.6286085786592275, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360878661088 F1-OK: 0.904006284368 F1-score multiplied: 0.326236577518 Epoch 6: Test set LL -0.6480350401701599, Acc 0.8348128795623779, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367250850118 F1-OK: 0.905006872177 F1-score multiplied: 0.33236454317 [211235 108099 35584 ..., 173533 203627 154044] Epoch 7: \Dev set LL -0.6627330248031905, Acc 0.8341756463050842, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362394957983 F1-OK: 0.904694614539 F1-score multiplied: 0.327856766824 Epoch 7: Test set LL -0.682730927291714, Acc 0.8342666029930115, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.362155059133 F1-OK: 0.904760036102 F1-score multiplied: 0.327663424376 [ 44555 140306 112838 ..., 74919 150399 165017] Epoch 8: \Dev set LL -0.7009275918028103, Acc 0.8343122601509094, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.368558042686 F1-OK: 0.904645861174 F1-score multiplied: 0.333414507919 Epoch 8: Test set LL -0.7210862172105238, Acc 0.8345397710800171, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.364542355101 F1-OK: 0.904887144259 F1-score multiplied: 0.329869690669 [169730 20673 186182 ..., 67812 116880 108578] Epoch 9: \Dev set LL -0.7253197002767483, Acc 0.833629310131073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.372811534501 F1-OK: 0.904094488189 F1-score multiplied: 0.337056853475 Epoch 9: Test set LL -0.7436247976206934, Acc 0.8328325748443604, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.366131538063 F1-OK: 0.90372060096 F1-score multiplied: 0.330880613609 [ 41613 123879 70949 ..., 98250 105271 211104] Epoch 10: \Dev set LL -0.7470163776356781, Acc 0.8333560824394226, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378185524975 F1-OK: 0.903785488959 F1-score multiplied: 0.341798589606 Epoch 10: Test set LL -0.7652779416170302, Acc 0.8311253786087036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369936305732 F1-OK: 0.902495761542 F1-score multiplied: 0.333865947964 [ 79978 62975 104982 ..., 106252 110351 75418] Epoch 11: \Dev set LL -0.7589040883725782, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38573581115 F1-OK: 0.903327800174 F1-score multiplied: 0.348445881735 Epoch 11: Test set LL -0.7838730224282988, Acc 0.8298279047012329, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.371342078708 F1-OK: 0.901595324593 F1-score multiplied: 0.334800281988 [ 78595 203579 77628 ..., 171197 169790 184869] Epoch 12: \Dev set LL -0.7803440106737395, Acc 0.8334926962852478, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385274836107 F1-OK: 0.903704874003 F1-score multiplied: 0.34817474722 Epoch 12: Test set LL -0.8077159553346649, Acc 0.8305107951164246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377944862155 F1-OK: 0.901889477429 F1-score multiplied: 0.340864494226 [161145 8624 103629 ..., 131598 77971 145710] Epoch 13: \Dev set LL -0.7870816165483376, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390438247012 F1-OK: 0.903118568941 F1-score multiplied: 0.352612030901 Epoch 13: Test set LL -0.8163631022987512, Acc 0.8284621834754944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.37975308642 F1-OK: 0.900467548934 F1-score multiplied: 0.341955330929 [ 88180 37890 33658 ..., 138465 165899 187250] Epoch 14: \Dev set LL -0.8091525600443863, Acc 0.8332195281982422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398225726959 F1-OK: 0.90319511615 F1-score multiplied: 0.359675531715 Epoch 14: Test set LL -0.835329903500437, Acc 0.8282573223114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381303813038 F1-OK: 0.900289418388 F1-score multiplied: 0.343283788069 [ 95272 217111 176486 ..., 183877 161754 214087] Epoch 15: \Dev set LL -0.8231747367243807, Acc 0.8321267366409302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396068796069 F1-OK: 0.902514476085 F1-score multiplied: 0.357457821978 Epoch 15: Test set LL -0.8523815784430409, Acc 0.8271647095680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384634087041 F1-OK: 0.899463753724 F1-score multiplied: 0.34596441974 [ 43428 23203 165494 ..., 87260 127806 73850] Epoch 16: \Dev set LL -0.8270535279933107, Acc 0.832536518573761, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.40311587147 F1-OK: 0.90260565618 F1-score multiplied: 0.363854665685 Epoch 16: Test set LL -0.8591261033976252, Acc 0.8271647095680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388499637594 F1-OK: 0.8993598155 F1-score multiplied: 0.349400962388 [204644 31141 103650 ..., 30090 81702 136580] Epoch 17: \Dev set LL -0.8375377694051755, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.401759530792 F1-OK: 0.902826294062 F1-score multiplied: 0.362719068289 Epoch 17: Test set LL -0.868758530313309, Acc 0.8273695707321167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388485728108 F1-OK: 0.899499085633 F1-score multiplied: 0.349442557215 [151463 159307 100073 ..., 99926 64887 45399] Epoch 18: \Dev set LL -0.8456029721771318, Acc 0.8317169547080994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403100775194 F1-OK: 0.902051200509 F1-score multiplied: 0.36361753819 Epoch 18: Test set LL -0.8803185126991296, Acc 0.8259355425834656, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391210890853 F1-OK: 0.898450260946 F1-score multiplied: 0.351483526971 [ 77558 65635 39900 ..., 52102 175656 30661] Epoch 19: \Dev set LL -0.8485858760507397, Acc 0.8303510546684265, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405741626794 F1-OK: 0.901051625239 F1-score multiplied: 0.36559415225 Epoch 19: Test set LL -0.8865030928353351, Acc 0.8253892660140991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39450627516 F1-OK: 0.89798523838 F1-score multiplied: 0.354260811542 [ 873 43953 181616 ..., 181234 7816 90895] Epoch 20: \Dev set LL -0.862913535575115, Acc 0.8329463005065918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.401370533529 F1-OK: 0.902928803873 F1-score multiplied: 0.362409015749 Epoch 20: Test set LL -0.8991292039417308, Acc 0.826481819152832, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388741881164 F1-OK: 0.898889817357 F1-score multiplied: 0.349436118559 [139636 198046 199708 ..., 32597 183833 57999] Epoch 21: \Dev set LL -0.8640958328327333, Acc 0.831580400466919, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.406355320173 F1-OK: 0.901870274572 F1-score multiplied: 0.366479784179 Epoch 21: Test set LL -0.9007349639360741, Acc 0.8257306814193726, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396690307329 F1-OK: 0.898156277436 F1-score multiplied: 0.356289889725 [ 48250 85392 96772 ..., 159417 47120 80258] Epoch 22: \Dev set LL -0.8665784606075516, Acc 0.8323999643325806, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.408674698795 F1-OK: 0.902363332538 F1-score multiplied: 0.368773063129 Epoch 22: Test set LL -0.9048220926158516, Acc 0.826276957988739, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.393708293613 F1-OK: 0.898613103778 F1-score multiplied: 0.353791431707 [ 94976 169993 129145 ..., 212870 49486 180803] Epoch 23: \Dev set LL -0.8700377062062966, Acc 0.8326731324195862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410207029369 F1-OK: 0.902506963788 F1-score multiplied: 0.370214700601 Epoch 23: Test set LL -0.9134896850501114, Acc 0.8253892660140991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395651146301 F1-OK: 0.897952667917 F1-score multiplied: 0.355276002386 [188706 216106 14316 ..., 23716 33182 2019] Epoch 24: \Dev set LL -0.8707749041366738, Acc 0.8314437866210938, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407869481766 F1-OK: 0.901735945214 F1-score multiplied: 0.367790572664 Epoch 24: Test set LL -0.9168640108942309, Acc 0.8248429298400879, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39174768793 F1-OK: 0.897690558813 F1-score multiplied: 0.351668200891 [ 49555 204099 199462 ..., 142630 30997 94732] Epoch 25: \Dev set LL -0.8764992272563636, Acc 0.8317169547080994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405405405405 F1-OK: 0.901988862371 F1-score multiplied: 0.365671160421 Epoch 25: Test set LL -0.9174499975640235, Acc 0.8271647095680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399810291677 F1-OK: 0.899046707351 F1-score multiplied: 0.359448126297 [ 10586 40093 110450 ..., 135123 16134 39003] Epoch 26: \Dev set LL -0.8783663166619011, Acc 0.8322633504867554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410182516811 F1-OK: 0.902229299363 F1-score multiplied: 0.370078684753 Epoch 26: Test set LL -0.9216220267588935, Acc 0.825867235660553, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397448015123 F1-OK: 0.898227969349 F1-score multiplied: 0.356998923545 [124016 93299 142951 ..., 121315 130112 138434] Epoch 27: \Dev set LL -0.8832342040633231, Acc 0.8303510546684265, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410815939279 F1-OK: 0.900909526089 F1-score multiplied: 0.370107993166 Epoch 27: Test set LL -0.9279132327142918, Acc 0.8240234851837158, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395496129486 F1-OK: 0.897022977023 F1-score multiplied: 0.354769115473 [ 9469 193383 39949 ..., 202484 63420 57130] Epoch 28: \Dev set LL -0.8809486302862793, Acc 0.8332195281982422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415509813308 F1-OK: 0.902732414562 F1-score multiplied: 0.375094177042 Epoch 28: Test set LL -0.9287126844631421, Acc 0.8253892660140991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397927949141 F1-OK: 0.897887464558 F1-score multiplied: 0.357294517331 [ 70289 17736 199270 ..., 16586 34471 159323] Epoch 29: \Dev set LL -0.8832020531346934, Acc 0.833082914352417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414750957854 F1-OK: 0.902660506611 F1-score multiplied: 0.374379309734 Epoch 29: Test set LL -0.9308453835648028, Acc 0.8251844048500061, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398496240602 F1-OK: 0.897730904442 F1-score multiplied: 0.357742390492 [ 44559 117975 7356 ..., 164492 159093 15768] Epoch 30: \Dev set LL -0.8823647125774086, Acc 0.832536518573761, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41395793499 F1-OK: 0.902310756972 F1-score multiplied: 0.373518697676 Epoch 30: Test set LL -0.9282437092287086, Acc 0.8251160979270935, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399812514647 F1-OK: 0.897645977379 F1-score multiplied: 0.358890095479 [109754 141570 108980 ..., 139365 215134 72258] Epoch 31: \Dev set LL -0.890769109413625, Acc 0.8310340046882629, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410671748452 F1-OK: 0.901379255362 F1-score multiplied: 0.370170994817 Epoch 31: Test set LL -0.936787563920147, Acc 0.8257989883422852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.403832671185 F1-OK: 0.89799672118 F1-score multiplied: 0.36264041463 [188636 149668 181585 ..., 86043 3885 149926] Epoch 32: \Dev set LL -0.8911239098828772, Acc 0.8328097462654114, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414354066986 F1-OK: 0.902485659656 F1-score multiplied: 0.373948603475 Epoch 32: Test set LL -0.9358960342605618, Acc 0.8257306814193726, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.40037593985 F1-OK: 0.898050495366 F1-score multiplied: 0.359557811115 [118069 172817 212991 ..., 6636 158235 11185] Epoch 33: \Dev set LL -0.8887049751329645, Acc 0.8313071727752686, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412743699477 F1-OK: 0.901507297233 F1-score multiplied: 0.372091456965 Epoch 33: Test set LL -0.9401001895218963, Acc 0.8245697617530823, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.401862630966 F1-OK: 0.897211219141 F1-score multiplied: 0.360555661057 [ 35430 78766 7572 ..., 21798 172876 186694] Epoch 34: \Dev set LL -0.8907669483326504, Acc 0.832536518573761, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41619047619 F1-OK: 0.902248445224 F1-score multiplied: 0.37550721006 Epoch 34: Test set LL -0.9392364664325102, Acc 0.8250477910041809, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.400841908326 F1-OK: 0.8975691668 F1-score multiplied: 0.359783337674 [ 12263 179388 192145 ..., 56465 182676 75856] Epoch 35: \Dev set LL -0.8956419295226385, Acc 0.8318535685539246, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409592326139 F1-OK: 0.901967030342 F1-score multiplied: 0.369438774058 Epoch 35: Test set LL -0.9405245165309062, Acc 0.8245015144348145, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3984082397 F1-OK: 0.89726574992 F1-score multiplied: 0.357478067969 [159646 185256 171645 ..., 194155 131629 68601] Epoch 36: \Dev set LL -0.8951731093557647, Acc 0.8308973908424377, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411037107517 F1-OK: 0.901275917065 F1-score multiplied: 0.370457846025 Epoch 36: Test set LL -0.9466378280372066, Acc 0.8245015144348145, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.403435468895 F1-OK: 0.897117694155 F1-score multiplied: 0.361929097596 [191753 201171 122412 ..., 38797 37466 188023]
word-level 114 features
shallow neural network - 512-
2018-03-14 14:22:30.470703: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA epoch: 0 [491470 260968 489770 ..., 43269 414732 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.336827393431 F1-OK: 0.911061822499 F1-score multiplied: 0.306870578927 Result from the previous epoch on test: F1-BAD: 0.324561403509 F1-OK: 0.910692454782 F1-score multiplied: 0.295575621289 Result from the previous epoch on test: F1-BAD: 0.324561403509 F1-OK: 0.910692454782 F1-score multiplied: 0.295575621289 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.349524041982 F1-OK: 0.917254013103 F1-score multiplied: 0.320602330184 Result from the previous epoch on test: F1-BAD: 0.333784948885 F1-OK: 0.915641229589 F1-score multiplied: 0.305627261016 Result from the previous epoch on test: F1-BAD: 0.333784948885 F1-OK: 0.915641229589 F1-score multiplied: 0.305627261016 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.354579792257 F1-OK: 0.914743669702 F1-score multiplied: 0.324349620371 Result from the previous epoch on test: F1-BAD: 0.340890207715 F1-OK: 0.91298011377 F1-score multiplied: 0.311225980623 Result from the previous epoch on test: F1-BAD: 0.340890207715 F1-OK: 0.91298011377 F1-score multiplied: 0.311225980623 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.354503743057 F1-OK: 0.916892080963 F1-score multiplied: 0.325041674681 Result from the previous epoch on test: F1-BAD: 0.339521250611 F1-OK: 0.915565964091 F1-score multiplied: 0.310854101145 Result from the previous epoch on test: F1-BAD: 0.339521250611 F1-OK: 0.915565964091 F1-score multiplied: 0.310854101145 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.372093023256 F1-OK: 0.910818207556 F1-score multiplied: 0.338909100486 Result from the previous epoch on test: F1-BAD: 0.352555404794 F1-OK: 0.909675994574 F1-score multiplied: 0.320711188498 Result from the previous epoch on test: F1-BAD: 0.352555404794 F1-OK: 0.909675994574 F1-score multiplied: 0.320711188498 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.362893535208 F1-OK: 0.917524811001 F1-score multiplied: 0.332963822305 Result from the previous epoch on test: F1-BAD: 0.347073170732 F1-OK: 0.916393391424 F1-score multiplied: 0.318055559999 Result from the previous epoch on test: F1-BAD: 0.347073170732 F1-OK: 0.916393391424 F1-score multiplied: 0.318055559999 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.3696003696 F1-OK: 0.914652071931 F1-score multiplied: 0.338055743842 Result from the previous epoch on test: F1-BAD: 0.351341766166 F1-OK: 0.913968547641 F1-score multiplied: 0.321115323749 Result from the previous epoch on test: F1-BAD: 0.351341766166 F1-OK: 0.913968547641 F1-score multiplied: 0.321115323749 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.374185136897 F1-OK: 0.909153996593 F1-score multiplied: 0.340191912676 Result from the previous epoch on test: F1-BAD: 0.356757945672 F1-OK: 0.907371921767 F1-score multiplied: 0.323712142771 Result from the previous epoch on test: F1-BAD: 0.356757945672 F1-OK: 0.907371921767 F1-score multiplied: 0.323712142771 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.376615123914 F1-OK: 0.90681695849 F1-score multiplied: 0.34152098119 Result from the previous epoch on test: F1-BAD: 0.361853448276 F1-OK: 0.905937291528 F1-score multiplied: 0.327816532861 Result from the previous epoch on test: F1-BAD: 0.361853448276 F1-OK: 0.905937291528 F1-score multiplied: 0.327816532861 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.375111906893 F1-OK: 0.912300540269 F1-score multiplied: 0.34221479532 Result from the previous epoch on test: F1-BAD: 0.360298336202 F1-OK: 0.912236512759 F1-score multiplied: 0.32867729777 Result from the previous epoch on test: F1-BAD: 0.360298336202 F1-OK: 0.912236512759 F1-score multiplied: 0.32867729777 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.380830670927 F1-OK: 0.908032522383 F1-score multiplied: 0.345806634722 Result from the previous epoch on test: F1-BAD: 0.358604091456 F1-OK: 0.907079575891 F1-score multiplied: 0.325282447191 Result from the previous epoch on test: F1-BAD: 0.358604091456 F1-OK: 0.907079575891 F1-score multiplied: 0.325282447191 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.375865921788 F1-OK: 0.912249835056 F1-score multiplied: 0.342883625154 Result from the previous epoch on test: F1-BAD: 0.352738546331 F1-OK: 0.911268869335 F1-score multiplied: 0.321439656286 Result from the previous epoch on test: F1-BAD: 0.352738546331 F1-OK: 0.911268869335 F1-score multiplied: 0.321439656286 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.380334728033 F1-OK: 0.90603984266 F1-score multiplied: 0.344598417145 Result from the previous epoch on test: F1-BAD: 0.364261907322 F1-OK: 0.906048906049 F1-score multiplied: 0.330039102644 Result from the previous epoch on test: F1-BAD: 0.364261907322 F1-OK: 0.906048906049 F1-score multiplied: 0.330039102644 [287372 332628 486601 ..., 7030 498681 343739] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.375272094036 F1-OK: 0.909492273731 F1-score multiplied: 0.341307070072 Result from the previous epoch on test: F1-BAD: 0.356495468278 F1-OK: 0.909148354686 F1-score multiplied: 0.324107268438 Result from the previous epoch on test: F1-BAD: 0.356495468278 F1-OK: 0.909148354686 F1-score multiplied: 0.324107268438 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.383367983368 F1-OK: 0.905823331428 F1-score multiplied: 0.347263663857 Result from the previous epoch on test: F1-BAD: 0.359207878852 F1-OK: 0.903638824747 F1-score multiplied: 0.324594185486 Result from the previous epoch on test: F1-BAD: 0.359207878852 F1-OK: 0.903638824747 F1-score multiplied: 0.324594185486 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.383952951061 F1-OK: 0.907015819675 F1-score multiplied: 0.348251400623 Result from the previous epoch on test: F1-BAD: 0.361583136158 F1-OK: 0.905687956784 F1-score multiplied: 0.327481491795 Result from the previous epoch on test: F1-BAD: 0.361583136158 F1-OK: 0.905687956784 F1-score multiplied: 0.327481491795 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.380339128568 F1-OK: 0.908769157845 F1-score multiplied: 0.345640469565 Result from the previous epoch on test: F1-BAD: 0.363196658239 F1-OK: 0.908252957666 F1-score multiplied: 0.32987443906 Result from the previous epoch on test: F1-BAD: 0.363196658239 F1-OK: 0.908252957666 F1-score multiplied: 0.32987443906 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.380210526316 F1-OK: 0.906699626038 F1-score multiplied: 0.344736742026 Result from the previous epoch on test: F1-BAD: 0.36088927261 F1-OK: 0.905958203646 F1-score multiplied: 0.326950597128 Result from the previous epoch on test: F1-BAD: 0.36088927261 F1-OK: 0.905958203646 F1-score multiplied: 0.326950597128 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.37365532382 F1-OK: 0.910138902013 F1-score multiplied: 0.340078246153 Result from the previous epoch on test: F1-BAD: 0.358520179372 F1-OK: 0.909630752709 F1-score multiplied: 0.326120980624 Result from the previous epoch on test: F1-BAD: 0.358520179372 F1-OK: 0.909630752709 F1-score multiplied: 0.326120980624 [486439 273925 266751 ..., 295303 199517 319098] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.384252614312 F1-OK: 0.904445222261 F1-score multiplied: 0.347535441156 Result from the previous epoch on test: F1-BAD: 0.362934362934 F1-OK: 0.902561647115 F1-score multiplied: 0.327570636405 Result from the previous epoch on test: F1-BAD: 0.362934362934 F1-OK: 0.902561647115 F1-score multiplied: 0.327570636405 [ 40537 106670 99084 ..., 465976 431894 328479] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.377698595682 F1-OK: 0.905844670662 F1-score multiplied: 0.342136260015 Result from the previous epoch on test: F1-BAD: 0.355184233076 F1-OK: 0.904295570888 F1-score multiplied: 0.32119152882 Result from the previous epoch on test: F1-BAD: 0.355184233076 F1-OK: 0.904295570888 F1-score multiplied: 0.32119152882 [212561 356922 152295 ..., 524049 198795 528463] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.373827601608 F1-OK: 0.911895934142 F1-score multiplied: 0.340891869976 Result from the previous epoch on test: F1-BAD: 0.349839523155 F1-OK: 0.910696854237 F1-score multiplied: 0.318597753225 Result from the previous epoch on test: F1-BAD: 0.349839523155 F1-OK: 0.910696854237 F1-score multiplied: 0.318597753225 [ 95635 378627 25971 ..., 420115 259761 74441] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.387003311258 F1-OK: 0.905884595831 F1-score multiplied: 0.350580338205 Result from the previous epoch on test: F1-BAD: 0.360223557946 F1-OK: 0.903322444427 F1-score multiplied: 0.325398024904 Result from the previous epoch on test: F1-BAD: 0.360223557946 F1-OK: 0.903322444427 F1-score multiplied: 0.325398024904 [485069 313969 289735 ..., 30221 333017 288627]
epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.375 F1-OK: 0.913447064727 F1-score multiplied: 0.342542649272 Result from the previous epoch on test: F1-BAD: 0.35493612079 F1-OK: 0.912711384925 F1-score multiplied: 0.323954238366 Result from the previous epoch on test: F1-BAD: 0.35493612079 F1-OK: 0.912711384925 F1-score multiplied: 0.323954238366 [209130 518923 324077 ..., 124771 425901 349907] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.385501066098 F1-OK: 0.908837856646 F1-score multiplied: 0.350357962647 Result from the previous epoch on test: F1-BAD: 0.357329842932 F1-OK: 0.906579990487 F1-score multiplied: 0.323948085606 Result from the previous epoch on test: F1-BAD: 0.357329842932 F1-OK: 0.906579990487 F1-score multiplied: 0.323948085606 [360247 140109 475577 ..., 284869 401264 117631] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.374425022999 F1-OK: 0.914882964076 F1-score multiplied: 0.342555074865 Result from the previous epoch on test: F1-BAD: 0.345080416272 F1-OK: 0.913172995516 F1-score multiplied: 0.315118117421 Result from the previous epoch on test: F1-BAD: 0.345080416272 F1-OK: 0.913172995516 F1-score multiplied: 0.315118117421 [119698 10816 551151 ..., 126647 315313 223345] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.380707395498 F1-OK: 0.908688643762 F1-score multiplied: 0.345944486886 Result from the previous epoch on test: F1-BAD: 0.356562262924 F1-OK: 0.90577835616 F1-score multiplied: 0.32296638038 Result from the previous epoch on test: F1-BAD: 0.356562262924 F1-OK: 0.90577835616 F1-score multiplied: 0.32296638038 [255352 453736 505023 ..., 246196 430507 97061] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.37990248039 F1-OK: 0.907398613354 F1-score multiplied: 0.344722983916 Result from the previous epoch on test: F1-BAD: 0.360964011672 F1-OK: 0.906120504882 F1-score multiplied: 0.3270768925 Result from the previous epoch on test: F1-BAD: 0.360964011672 F1-OK: 0.906120504882 F1-score multiplied: 0.3270768925 [182829 156731 212271 ..., 262696 534335 194312] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.379372197309 F1-OK: 0.913076246703 F1-score multiplied: 0.346395742023 Result from the previous epoch on test: F1-BAD: 0.350418529985 F1-OK: 0.91081127887 F1-score multiplied: 0.319165149436 Result from the previous epoch on test: F1-BAD: 0.350418529985 F1-OK: 0.91081127887 F1-score multiplied: 0.319165149436 [ 63516 229449 556142 ..., 518027 383750 277428] Done!
deeper with 114 features - 512-256-17-
1 Result from the previous epoch on dev: F1-BAD: 0.357842116226 F1-OK: 0.902136304479 F1-score multiplied: 0.322822364319 Result from the previous epoch on test: F1-BAD: 0.341956776323 F1-OK: 0.901646909062 F1-score multiplied: 0.308324270404 Result from the previous epoch on test: F1-BAD: 0.341956776323 F1-OK: 0.901646909062 F1-score multiplied: 0.308324270404 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.369926813041 F1-OK: 0.910646328039 F1-score multiplied: 0.336872493939 Result from the previous epoch on test: F1-BAD: 0.346669672039 F1-OK: 0.908514163971 F1-score multiplied: 0.314954307266 Result from the previous epoch on test: F1-BAD: 0.346669672039 F1-OK: 0.908514163971 F1-score multiplied: 0.314954307266 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.371689497717 F1-OK: 0.913795263751 F1-score multiplied: 0.3396481026 Result from the previous epoch on test: F1-BAD: 0.34746857747 F1-OK: 0.91282856022 F1-score multiplied: 0.317179241293 Result from the previous epoch on test: F1-BAD: 0.34746857747 F1-OK: 0.91282856022 F1-score multiplied: 0.317179241293 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.389214046823 F1-OK: 0.907296954315 F1-score multiplied: 0.353132719259 Result from the previous epoch on test: F1-BAD: 0.358136078973 F1-OK: 0.903736249741 F1-score multiplied: 0.323660556908 Result from the previous epoch on test: F1-BAD: 0.358136078973 F1-OK: 0.903736249741 F1-score multiplied: 0.323660556908 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.390691977955 F1-OK: 0.904951440853 F1-score multiplied: 0.35355726838 Result from the previous epoch on test: F1-BAD: 0.363242574257 F1-OK: 0.901282338269 F1-score multiplied: 0.327384116685 Result from the previous epoch on test: F1-BAD: 0.363242574257 F1-OK: 0.901282338269 F1-score multiplied: 0.327384116685 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.388269794721 F1-OK: 0.89967616788 F1-score multiplied: 0.349317081018 Result from the previous epoch on test: F1-BAD: 0.361498171756 F1-OK: 0.895989954764 F1-score multiplied: 0.323898730559 Result from the previous epoch on test: F1-BAD: 0.361498171756 F1-OK: 0.895989954764 F1-score multiplied: 0.323898730559 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.389594428513 F1-OK: 0.905161988416 F1-score multiplied: 0.352646067588 Result from the previous epoch on test: F1-BAD: 0.361267822341 F1-OK: 0.900350461681 F1-score multiplied: 0.325267650635 Result from the previous epoch on test: F1-BAD: 0.361267822341 F1-OK: 0.900350461681 F1-score multiplied: 0.325267650635 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.387631366209 F1-OK: 0.903367776502 F1-score multiplied: 0.350173685394 Result from the previous epoch on test: F1-BAD: 0.361595755535 F1-OK: 0.899786985281 F1-score multiplied: 0.325359154763 Result from the previous epoch on test: F1-BAD: 0.361595755535 F1-OK: 0.899786985281 F1-score multiplied: 0.325359154763 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.384381157084 F1-OK: 0.888122131441 F1-score multiplied: 0.341377412515 Result from the previous epoch on test: F1-BAD: 0.358904606456 F1-OK: 0.884495997386 F1-score multiplied: 0.317449687854 Result from the previous epoch on test: F1-BAD: 0.358904606456 F1-OK: 0.884495997386 F1-score multiplied: 0.317449687854 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.379574468085 F1-OK: 0.907733198329 F1-score multiplied: 0.344552345919 Result from the previous epoch on test: F1-BAD: 0.356122890524 F1-OK: 0.905514810934 F1-score multiplied: 0.322474551882 Result from the previous epoch on test: F1-BAD: 0.356122890524 F1-OK: 0.905514810934 F1-score multiplied: 0.322474551882 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.37202268431 F1-OK: 0.892887083253 F1-score multiplied: 0.332174249497 Result from the previous epoch on test: F1-BAD: 0.355884025014 F1-OK: 0.889793139226 F1-score multiplied: 0.316663163818 Result from the previous epoch on test: F1-BAD: 0.355884025014 F1-OK: 0.889793139226 F1-score multiplied: 0.316663163818 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.376651196001 F1-OK: 0.886261481337 F1-score multiplied: 0.333811446915 Result from the previous epoch on test: F1-BAD: 0.355962643678 F1-OK: 0.882622500082 F1-score multiplied: 0.314180638499 Result from the previous epoch on test: F1-BAD: 0.355962643678 F1-OK: 0.882622500082 F1-score multiplied: 0.314180638499 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.372222222222 F1-OK: 0.907095876549 F1-score multiplied: 0.337641242938 Result from the previous epoch on test: F1-BAD: 0.354086435601 F1-OK: 0.903991095564 F1-score multiplied: 0.320090984843 Result from the previous epoch on test: F1-BAD: 0.354086435601 F1-OK: 0.903991095564 F1-score multiplied: 0.320090984843 [287372 332628 486601 ..., 7030 498681 343739] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.365552178318 F1-OK: 0.900188083777 F1-score multiplied: 0.329065714921 Result from the previous epoch on test: F1-BAD: 0.345476624165 F1-OK: 0.896273013022 F1-score multiplied: 0.309641374869 Result from the previous epoch on test: F1-BAD: 0.345476624165 F1-OK: 0.896273013022 F1-score multiplied: 0.309641374869 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.35833518807 F1-OK: 0.909370972305 F1-score multiplied: 0.325859618387 Result from the previous epoch on test: F1-BAD: 0.339409034303 F1-OK: 0.907972557369 F1-score multiplied: 0.308174088871 Result from the previous epoch on test: F1-BAD: 0.339409034303 F1-OK: 0.907972557369 F1-score multiplied: 0.308174088871 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.368717330117 F1-OK: 0.899776571976 F1-score multiplied: 0.33176321532 Result from the previous epoch on test: F1-BAD: 0.352412346419 F1-OK: 0.895816928343 F1-score multiplied: 0.315696945679 Result from the previous epoch on test: F1-BAD: 0.352412346419 F1-OK: 0.895816928343 F1-score multiplied: 0.315696945679 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.359613319012 F1-OK: 0.90581061013 F1-score multiplied: 0.325741559905 Result from the previous epoch on test: F1-BAD: 0.348641655886 F1-OK: 0.904037355865 F1-score multiplied: 0.315185080732 Result from the previous epoch on test: F1-BAD: 0.348641655886 F1-OK: 0.904037355865 F1-score multiplied: 0.315185080732 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.362592288761 F1-OK: 0.90110729286 F1-score multiplied: 0.326734555738 Result from the previous epoch on test: F1-BAD: 0.343641204178 F1-OK: 0.897394032527 F1-score multiplied: 0.308381565959 Result from the previous epoch on test: F1-BAD: 0.343641204178 F1-OK: 0.897394032527 F1-score multiplied: 0.308381565959 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.360162601626 F1-OK: 0.899694111649 F1-score multiplied: 0.324036171919 Result from the previous epoch on test: F1-BAD: 0.343409669211 F1-OK: 0.896640123051 F1-score multiplied: 0.307914888059 Result from the previous epoch on test: F1-BAD: 0.343409669211 F1-OK: 0.896640123051 F1-score multiplied: 0.307914888059 [486439 273925 266751 ..., 295303 199517 319098] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.360083160083 F1-OK: 0.902267098495 F1-score multiplied: 0.324891188065 Result from the previous epoch on test: F1-BAD: 0.349338610561 F1-OK: 0.900266615579 F1-score multiplied: 0.314497888621 Result from the previous epoch on test: F1-BAD: 0.349338610561 F1-OK: 0.900266615579 F1-score multiplied: 0.314497888621 [ 40537 106670 99084 ..., 465976 431894 328479] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.352401746725 F1-OK: 0.906506115244 F1-score multiplied: 0.319454338429 Result from the previous epoch on test: F1-BAD: 0.341837293332 F1-OK: 0.904746058157 F1-score multiplied: 0.309275943673 Result from the previous epoch on test: F1-BAD: 0.341837293332 F1-OK: 0.904746058157 F1-score multiplied: 0.309275943673 [212561 356922 152295 ..., 524049 198795 528463] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.348728593669 F1-OK: 0.876650394784 F1-score multiplied: 0.305713059312 Result from the previous epoch on test: F1-BAD: 0.335480546251 F1-OK: 0.872316197706 F1-score multiplied: 0.29264511451 Result from the previous epoch on test: F1-BAD: 0.335480546251 F1-OK: 0.872316197706 F1-score multiplied: 0.29264511451 [ 95635 378627 25971 ..., 420115 259761 74441] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.364110201042 F1-OK: 0.889564205354 F1-score multiplied: 0.323899401651 Result from the previous epoch on test: F1-BAD: 0.346870342772 F1-OK: 0.885987447563 F1-score multiplied: 0.307322769628 Result from the previous epoch on test: F1-BAD: 0.346870342772 F1-OK: 0.885987447563 F1-score multiplied: 0.307322769628 [485069 313969 289735 ..., 30221 333017 288627] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.363969839006 F1-OK: 0.900595598306 F1-score multiplied: 0.327789634924 Result from the previous epoch on test: F1-BAD: 0.345216144233 F1-OK: 0.897688712466 F1-score multiplied: 0.309896636039 Result from the previous epoch on test: F1-BAD: 0.345216144233 F1-OK: 0.897688712466 F1-score multiplied: 0.309896636039 [209130 518923 324077 ..., 124771 425901 349907] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.348160615533 F1-OK: 0.915663400218 F1-score multiplied: 0.31879793304 Result from the previous epoch on test: F1-BAD: 0.328810273807 F1-OK: 0.913415853963 F1-score multiplied: 0.300340517041 Result from the previous epoch on test: F1-BAD: 0.328810273807 F1-OK: 0.913415853963 F1-score multiplied: 0.300340517041 [360247 140109 475577 ..., 284869 401264 117631] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.35273641462 F1-OK: 0.892493495648 F1-score multiplied: 0.314814955726 Result from the previous epoch on test: F1-BAD: 0.33755192735 F1-OK: 0.889201286215 F1-score multiplied: 0.300151607964 Result from the previous epoch on test: F1-BAD: 0.33755192735 F1-OK: 0.889201286215 F1-score multiplied: 0.300151607964 [119698 10816 551151 ..., 126647 315313 223345] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.362349021241 F1-OK: 0.902799822234 F1-score multiplied: 0.327128631963 Result from the previous epoch on test: F1-BAD: 0.343029295658 F1-OK: 0.898996997381 F1-score multiplied: 0.30838230681 Result from the previous epoch on test: F1-BAD: 0.343029295658 F1-OK: 0.898996997381 F1-score multiplied: 0.30838230681 [255352 453736 505023 ..., 246196 430507 97061] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.349809885932 F1-OK: 0.908679672038 F1-score multiplied: 0.317865132424 Result from the previous epoch on test: F1-BAD: 0.336484357416 F1-OK: 0.906932693522 F1-score multiplied: 0.305168664599 Result from the previous epoch on test: F1-BAD: 0.336484357416 F1-OK: 0.906932693522 F1-score multiplied: 0.305168664599 [182829 156731 212271 ..., 262696 534335 194312] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.35885447107 F1-OK: 0.894421096532 F1-score multiplied: 0.320967009509 Result from the previous epoch on test: F1-BAD: 0.342586189865 F1-OK: 0.892860017709 F1-score multiplied: 0.305881511549 Result from the previous epoch on test: F1-BAD: 0.342586189865 F1-OK: 0.892860017709 F1-score multiplied: 0.305881511549 [ 63516 229449 556142 ..., 518027 383750 277428] Done!
hybrid network with 512-256-17-GP - matern12 - with pretraining
2018-03-14 14:50:39.119830: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA [<tf.Variable 'W1:0' shape=(114, 512) dtype=float32_ref>, <tf.Variable 'b1:0' shape=(512,) dtype=float32_ref>, <tf.Variable 'W2:0' shape=(512, 256) dtype=float32_ref>, <tf.Variable 'b2:0' shape=(256,) dtype=float32_ref>, <tf.Variable 'W3:0' shape=(256, 17) dtype=float32_ref>, <tf.Variable 'b3:0' shape=(17,) dtype=float32_ref>, <tf.Variable '6/SVGP/kern/variance/unconstrained:0' shape=() dtype=float64_ref>, <tf.Variable '6/SVGP/kern/lengthscales/unconstrained:0' shape=() dtype=float64_ref>, <tf.Variable '6/SVGP/feature/Z/unconstrained:0' shape=(100, 17) dtype=float64_ref>, <tf.Variable '6/SVGP/q_mu/unconstrained:0' shape=(100, 2) dtype=float64_ref>, <tf.Variable '6/SVGP/q_sqrt/unconstrained:0' shape=(2, 5050) dtype=float64_ref>] [491470 260968 489770 ..., 43269 414732 159419] Epoch 1: \Dev set LL -0.5657609523292442, Acc 0.8319193720817566, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39186764999 F1-OK: 0.902483459584 F1-score multiplied: 0.353654072462 Epoch 1: Test set LL -0.588081328950332, Acc 0.8270162343978882, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.369652945924 F1-OK: 0.899752912107 F1-score multiplied: 0.332596314564 Epoch 1: Test set LL -0.588081328950332, Acc 0.8270162343978882, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.369652945924 F1-OK: 0.899752912107 F1-score multiplied: 0.332596314564 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8193404517717592, Acc 0.8407338261604309, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388665679848 F1-OK: 0.908440221694 F1-score multiplied: 0.353079536366 Epoch 2: Test set LL -0.8504924436471274, Acc 0.8347684144973755, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.362120564344 F1-OK: 0.905092077224 F1-score multiplied: 0.327752453787 Epoch 2: Test set LL -0.8504924436471274, Acc 0.8347684144973755, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.362120564344 F1-OK: 0.905092077224 F1-score multiplied: 0.327752453787 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8104616979064163, Acc 0.8571507334709167, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380109968922 F1-OK: 0.919273995206 F1-score multiplied: 0.349425209748 Epoch 3: Test set LL -0.8317488714785419, Acc 0.8521276712417603, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352841391009 F1-OK: 0.916527311089 F1-score multiplied: 0.323388771343 Epoch 3: Test set LL -0.8317488714785419, Acc 0.8521276712417603, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352841391009 F1-OK: 0.916527311089 F1-score multiplied: 0.323388771343 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8564708794059699, Acc 0.8545615077018738, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385474860335 F1-OK: 0.917520619845 F1-score multiplied: 0.353681132789 Epoch 4: Test set LL -0.8853023488759628, Acc 0.8503280878067017, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363250883392 F1-OK: 0.915197339524 F1-score multiplied: 0.33244624206 Epoch 4: Test set LL -0.8853023488759628, Acc 0.8503280878067017, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363250883392 F1-OK: 0.915197339524 F1-score multiplied: 0.33244624206 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9363356772495188, Acc 0.8453062772750854, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386631716907 F1-OK: 0.911492151548 F1-score multiplied: 0.3524117755 Epoch 5: Test set LL -0.9631628315352714, Acc 0.8408316969871521, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361718663262 F1-OK: 0.909079407253 F1-score multiplied: 0.32883098799 Epoch 5: Test set LL -0.9631628315352714, Acc 0.8408316969871521, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361718663262 F1-OK: 0.909079407253 F1-score multiplied: 0.32883098799 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.9378374122669173, Acc 0.8467937707901001, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392131147541 F1-OK: 0.912351476567 F1-score multiplied: 0.357761431467 Epoch 6: Test set LL -0.9768117606820118, Acc 0.8401118516921997, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363916730918 F1-OK: 0.908564100128 F1-score multiplied: 0.330641677148 Epoch 6: Test set LL -0.9768117606820118, Acc 0.8401118516921997, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363916730918 F1-OK: 0.908564100128 F1-score multiplied: 0.330641677148 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9432358031196421, Acc 0.8457470536231995, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389179755672 F1-OK: 0.911727616646 F1-score multiplied: 0.354825931085 Epoch 7: Test set LL -0.988673985056867, Acc 0.8401118516921997, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365593760299 F1-OK: 0.908529341886 F1-score multiplied: 0.332152658442 Epoch 7: Test set LL -0.988673985056867, Acc 0.8401118516921997, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365593760299 F1-OK: 0.908529341886 F1-score multiplied: 0.332152658442 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9631572492487684, Acc 0.8455266356468201, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389904264578 F1-OK: 0.911568058534 F1-score multiplied: 0.355424273475 Epoch 8: Test set LL -1.0112132629554937, Acc 0.8375370502471924, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358828671329 F1-OK: 0.90698411692 F1-score multiplied: 0.325451905591 Epoch 8: Test set LL -1.0112132629554937, Acc 0.8375370502471924, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358828671329 F1-OK: 0.90698411692 F1-score multiplied: 0.325451905591 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8932520367538711, Acc 0.856654942035675, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375120076849 F1-OK: 0.919041692595 F1-score multiplied: 0.344750990354 Epoch 9: Test set LL -0.9238299953245803, Acc 0.8533182144165039, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353587115666 F1-OK: 0.917273039568 F1-score multiplied: 0.324335928339 Epoch 9: Test set LL -0.9238299953245803, Acc 0.8533182144165039, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353587115666 F1-OK: 0.917273039568 F1-score multiplied: 0.324335928339 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9336488667786224, Acc 0.8519171476364136, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.382636655949 F1-OK: 0.915868544601 F1-score multiplied: 0.350444877195 Epoch 10: Test set LL -0.9568913662465338, Acc 0.8482516407966614, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356009869581 F1-OK: 0.913992499255 F1-score multiplied: 0.325390350457 Epoch 10: Test set LL -0.9568913662465338, Acc 0.8482516407966614, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356009869581 F1-OK: 0.913992499255 F1-score multiplied: 0.325390350457 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9169842772795253, Acc 0.8543410897254944, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386827458256 F1-OK: 0.917354338585 F1-score multiplied: 0.354857847115 Epoch 11: Test set LL -0.9570937562492143, Acc 0.84880530834198, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354873006497 F1-OK: 0.91436814953 F1-score multiplied: 0.324484574269 Epoch 11: Test set LL -0.9570937562492143, Acc 0.84880530834198, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354873006497 F1-OK: 0.91436814953 F1-score multiplied: 0.324484574269 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9133451974763341, Acc 0.8548369407653809, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380145848036 F1-OK: 0.917792406327 F1-score multiplied: 0.348894972624 Epoch 12: Test set LL -0.9377513563669054, Acc 0.8517677783966064, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36231538828 F1-OK: 0.916136712509 F1-score multiplied: 0.33193042871 Epoch 12: Test set LL -0.9377513563669054, Acc 0.8517677783966064, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36231538828 F1-OK: 0.916136712509 F1-score multiplied: 0.33193042871 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9056423148925904, Acc 0.8570956587791443, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.379128769746 F1-OK: 0.919255431738 F1-score multiplied: 0.348516180917 Epoch 13: Test set LL -0.9381770466094005, Acc 0.8526260256767273, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356892593935 F1-OK: 0.916777411235 F1-score multiplied: 0.327191068357 Epoch 13: Test set LL -0.9381770466094005, Acc 0.8526260256767273, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356892593935 F1-OK: 0.916777411235 F1-score multiplied: 0.327191068357 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9450557346017073, Acc 0.8505949974060059, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.383075523203 F1-OK: 0.915005641219 F1-score multiplied: 0.350516264743 Epoch 14: Test set LL -0.9712109086289118, Acc 0.8467012047767639, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358772437753 F1-OK: 0.912944357971 F1-score multiplied: 0.327539272842 Epoch 14: Test set LL -0.9712109086289118, Acc 0.8467012047767639, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358772437753 F1-OK: 0.912944357971 F1-score multiplied: 0.327539272842 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.9191505697230379, Acc 0.8556082248687744, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.381109799292 F1-OK: 0.918269980355 F1-score multiplied: 0.349961687909 Epoch 15: Test set LL -0.9463039152830026, Acc 0.8513524532318115, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353366253162 F1-OK: 0.916024086963 F1-score multiplied: 0.323691999416 Epoch 15: Test set LL -0.9463039152830026, Acc 0.8513524532318115, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353366253162 F1-OK: 0.916024086963 F1-score multiplied: 0.323691999416 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.9848321497961859, Acc 0.8449757695198059, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390381282496 F1-OK: 0.911196667508 F1-score multiplied: 0.355714123668 Epoch 16: Test set LL -1.0415879216154542, Acc 0.8354882597923279, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358038029386 F1-OK: 0.905655584135 F1-score multiplied: 0.324259140646 Epoch 16: Test set LL -1.0415879216154542, Acc 0.8354882597923279, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358038029386 F1-OK: 0.905655584135 F1-score multiplied: 0.324259140646 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.9991653786574275, Acc 0.8423314094543457, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390285470814 F1-OK: 0.909459031952 F1-score multiplied: 0.354948646471 Epoch 17: Test set LL -1.0483098725740905, Acc 0.8353497982025146, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361430258778 F1-OK: 0.905490663488 F1-score multiplied: 0.327271724826 Epoch 17: Test set LL -1.0483098725740905, Acc 0.8353497982025146, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361430258778 F1-OK: 0.905490663488 F1-score multiplied: 0.327271724826 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9589526853663226, Acc 0.8489422798156738, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386577181208 F1-OK: 0.913865678206 F1-score multiplied: 0.353279617884 Epoch 18: Test set LL -1.0090557884500944, Acc 0.8422713875770569, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359671799483 F1-OK: 0.910058256106 F1-score multiplied: 0.327322290608 Epoch 18: Test set LL -1.0090557884500944, Acc 0.8422713875770569, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359671799483 F1-OK: 0.910058256106 F1-score multiplied: 0.327322290608 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9744784754507579, Acc 0.8462979197502136, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390829694323 F1-OK: 0.912053965452 F1-score multiplied: 0.356457772524 Epoch 19: Test set LL -1.030342548357726, Acc 0.8386445045471191, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360403863038 F1-OK: 0.907676710072 F1-score multiplied: 0.327130192699 Epoch 19: Test set LL -1.030342548357726, Acc 0.8386445045471191, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360403863038 F1-OK: 0.907676710072 F1-score multiplied: 0.327130192699 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.910681486445169, Acc 0.857591450214386, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375754648636 F1-OK: 0.919628144141 F1-score multiplied: 0.345554550177 Epoch 20: Test set LL -0.9560019583000481, Acc 0.8509925603866577, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.346527440505 F1-OK: 0.915908877848 F1-score multiplied: 0.317387559176 Epoch 20: Test set LL -0.9560019583000481, Acc 0.8509925603866577, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.346527440505 F1-OK: 0.915908877848 F1-score multiplied: 0.317387559176 [ 40537 106670 99084 ..., 465976 431894 328479]
Epoch 21: \Dev set LL -0.9540561079316255, Acc 0.8510907888412476, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.383017575896 F1-OK: 0.915327506813 F1-score multiplied: 0.35058652281 Epoch 21: Test set LL -0.9936332736574791, Acc 0.8439879417419434, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353710287877 F1-OK: 0.91128638675 F1-score multiplied: 0.322331370196 Epoch 21: Test set LL -0.9936332736574791, Acc 0.8439879417419434, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353710287877 F1-OK: 0.91128638675 F1-score multiplied: 0.322331370196 [212561 356922 152295 ..., 524049 198795 528463] ^CTraceback (most recent call last):
hybrid network with 512-256-17-GP - RBF - with pretraining
Epoch 1: \Dev set LL -0.8165246473345197, Acc 0.835940957069397, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398869600323 F1-OK: 0.905007974482 F1-score multiplied: 0.360980169071 Epoch 1: Test set LL -0.8593918893821445, Acc 0.8270993232727051, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.359684199733 F1-OK: 0.900056013443 F1-score multiplied: 0.323735926911 Epoch 1: Test set LL -0.8593918893821445, Acc 0.8270993232727051, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.359684199733 F1-OK: 0.900056013443 F1-score multiplied: 0.323735926911 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8923358010547597, Acc 0.8418906927108765, Outputs [0 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.391949152542 F1-OK: 0.909131205674 F1-score multiplied: 0.356333205614 Epoch 2: Test set LL -0.9389142667593615, Acc 0.8336332440376282, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354772898099 F1-OK: 0.904505363528 F1-score multiplied: 0.320893989165 Epoch 2: Test set LL -0.9389142667593615, Acc 0.8336332440376282, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354772898099 F1-OK: 0.904505363528 F1-score multiplied: 0.320893989165 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8910319263367367, Acc 0.8485015630722046, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392667844523 F1-OK: 0.913456696878 F1-score multiplied: 0.358685072228 Epoch 3: Test set LL -0.9421726022553317, Acc 0.8407209515571594, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355694926644 F1-OK: 0.90912824401 F1-score multiplied: 0.323372304063 Epoch 3: Test set LL -0.9421726022553317, Acc 0.8407209515571594, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355694926644 F1-OK: 0.90912824401 F1-score multiplied: 0.323372304063 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.9314311715013338, Acc 0.8461877703666687, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395409268081 F1-OK: 0.911885375245 F1-score multiplied: 0.3605679288 Epoch 4: Test set LL -0.9810234812196624, Acc 0.8389767408370972, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.362000877578 F1-OK: 0.90786096765 F1-score multiplied: 0.328646467008 Epoch 4: Test set LL -0.9810234812196624, Acc 0.8389767408370972, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.362000877578 F1-OK: 0.90786096765 F1-score multiplied: 0.328646467008 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -1.0766602213131327, Acc 0.8251432180404663, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394967594358 F1-OK: 0.897804108442 F1-score multiplied: 0.354603528916 Epoch 5: Test set LL -1.1283881097870478, Acc 0.8159140348434448, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363305563535 F1-OK: 0.892402297921 F1-score multiplied: 0.324214719746 Epoch 5: Test set LL -1.1283881097870478, Acc 0.8159140348434448, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363305563535 F1-OK: 0.892402297921 F1-score multiplied: 0.324214719746 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.0047089480308244, Acc 0.8381445407867432, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388680815647 F1-OK: 0.906724236459 F1-score multiplied: 0.352426315794 Epoch 6: Test set LL -1.0421695759541103, Acc 0.8306431770324707, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365258897997 F1-OK: 0.902285905976 F1-score multiplied: 0.329567955695 Epoch 6: Test set LL -1.0421695759541103, Acc 0.8306431770324707, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365258897997 F1-OK: 0.902285905976 F1-score multiplied: 0.329567955695 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -1.0212474004442644, Acc 0.8374834656715393, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389991728701 F1-OK: 0.906253972289 F1-score multiplied: 0.353431553296 Epoch 7: Test set LL -1.0612564071378094, Acc 0.8301171064376831, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363089059581 F1-OK: 0.901987093476 F1-score multiplied: 0.327501645524 Epoch 7: Test set LL -1.0612564071378094, Acc 0.8301171064376831, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363089059581 F1-OK: 0.901987093476 F1-score multiplied: 0.327501645524 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9855705522935461, Acc 0.8435434103012085, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396515087123 F1-OK: 0.910120893727 F1-score multiplied: 0.360876665469 Epoch 8: Test set LL -1.024752970826824, Acc 0.8367618322372437, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.36561222294 F1-OK: 0.906329435689 F1-score multiplied: 0.331365119698 Epoch 8: Test set LL -1.024752970826824, Acc 0.8367618322372437, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.36561222294 F1-OK: 0.906329435689 F1-score multiplied: 0.331365119698 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.9706286097523438, Acc 0.8448104858398438, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38880451291 F1-OK: 0.911121628017 F1-score multiplied: 0.354248200782 Epoch 9: Test set LL -1.0135808032178497, Acc 0.8384783864021301, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36058746164 F1-OK: 0.907564090376 F1-score multiplied: 0.327256231624 Epoch 9: Test set LL -1.0135808032178497, Acc 0.8384783864021301, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36058746164 F1-OK: 0.907564090376 F1-score multiplied: 0.327256231624 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9497908572899441, Acc 0.8505398631095886, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388550822628 F1-OK: 0.914864907271 F1-score multiplied: 0.355471512313 Epoch 10: Test set LL -0.9828492885246847, Acc 0.8448185324668884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358622267994 F1-OK: 0.9117308934 F1-score multiplied: 0.326967000791 Epoch 10: Test set LL -0.9828492885246847, Acc 0.8448185324668884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358622267994 F1-OK: 0.9117308934 F1-score multiplied: 0.326967000791 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9826941548317749, Acc 0.8440392017364502, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387362042848 F1-OK: 0.910646087807 F1-score multiplied: 0.352749728884 Epoch 11: Test set LL -1.0229834199011425, Acc 0.8380354046821594, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361910994764 F1-OK: 0.907245917235 F1-score multiplied: 0.328342272402 Epoch 11: Test set LL -1.0229834199011425, Acc 0.8380354046821594, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361910994764 F1-OK: 0.907245917235 F1-score multiplied: 0.328342272402 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -1.005227771873993, Acc 0.8413949012756348, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3965625655 F1-OK: 0.908698823455 F1-score multiplied: 0.360355936696 Epoch 12: Test set LL -1.0456768213947825, Acc 0.8348237872123718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367204072974 F1-OK: 0.90501512498 F1-score multiplied: 0.332325239996 Epoch 12: Test set LL -1.0456768213947825, Acc 0.8348237872123718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.367204072974 F1-OK: 0.90501512498 F1-score multiplied: 0.332325239996 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9323144017686263, Acc 0.853349506855011, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392791970803 F1-OK: 0.916604010025 F1-score multiplied: 0.360034695544 Epoch 13: Test set LL -0.9850379186629576, Acc 0.8452061414718628, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358903795436 F1-OK: 0.9119763213 F1-score multiplied: 0.327311763063 Epoch 13: Test set LL -0.9850379186629576, Acc 0.8452061414718628, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.358903795436 F1-OK: 0.9119763213 F1-score multiplied: 0.327311763063 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9424274720488246, Acc 0.8522477149963379, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385144429161 F1-OK: 0.916035314007 F1-score multiplied: 0.352805898104 Epoch 14: Test set LL -0.9701087140218421, Acc 0.8467565774917603, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.35481990908 F1-OK: 0.91305235709 F1-score multiplied: 0.323969154328 Epoch 14: Test set LL -0.9701087140218421, Acc 0.8467565774917603, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.35481990908 F1-OK: 0.91305235709 F1-score multiplied: 0.323969154328 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8704904856912785, Acc 0.8651939034461975, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.376242671425 F1-OK: 0.924430993484 F1-score multiplied: 0.347810386536 Epoch 15: Test set LL -0.8993102539395091, Acc 0.8599628806114197, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342262678804 F1-OK: 0.921639709983 F1-score multiplied: 0.315442876031 Epoch 15: Test set LL -0.8993102539395091, Acc 0.8599628806114197, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342262678804 F1-OK: 0.921639709983 F1-score multiplied: 0.315442876031 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -1.061433091413228, Acc 0.8335169553756714, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398487261146 F1-OK: 0.903388746803 F1-score multiplied: 0.359988907464 Epoch 16: Test set LL -1.110173922758627, Acc 0.824524462223053, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.362245924733 F1-OK: 0.898266452648 F1-score multiplied: 0.325393361797 Epoch 16: Test set LL -1.110173922758627, Acc 0.824524462223053, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.362245924733 F1-OK: 0.898266452648 F1-score multiplied: 0.325393361797 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.9783149438569848, Acc 0.8467386364936829, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398356401384 F1-OK: 0.912184343434 F1-score multiplied: 0.363374472449 Epoch 17: Test set LL -1.0337114324939198, Acc 0.8386445045471191, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.361664841183 F1-OK: 0.907650377131 F1-score multiplied: 0.328265229495 Epoch 17: Test set LL -1.0337114324939198, Acc 0.8386445045471191, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.361664841183 F1-OK: 0.907650377131 F1-score multiplied: 0.328265229495 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9644381442915362, Acc 0.8493829965591431, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.39298401421 F1-OK: 0.914025157233 F1-score multiplied: 0.359197275378 Epoch 18: Test set LL -1.0081693268788001, Acc 0.8417453169822693, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35976702509 F1-OK: 0.909714105197 F1-score multiplied: 0.327285137309 Epoch 18: Test set LL -1.0081693268788001, Acc 0.8417453169822693, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35976702509 F1-OK: 0.909714105197 F1-score multiplied: 0.327285137309 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9292144233508118, Acc 0.855938732624054, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390584945234 F1-OK: 0.918314434761 F1-score multiplied: 0.358679793209 Epoch 19: Test set LL -0.96699890958386, Acc 0.8490267992019653, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.355513532679 F1-OK: 0.914498957304 F1-score multiplied: 0.325116754943 Epoch 19: Test set LL -0.96699890958386, Acc 0.8490267992019653, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.355513532679 F1-OK: 0.914498957304 F1-score multiplied: 0.325116754943 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.0939850527951995, Acc 0.8285037279129028, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393532047536 F1-OK: 0.900131532514 F1-score multiplied: 0.354230605042 Epoch 20: Test set LL -1.156198511243627, Acc 0.8181843161582947, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361000291914 F1-OK: 0.894013976534 F1-score multiplied: 0.322739306504 Epoch 20: Test set LL -1.156198511243627, Acc 0.8181843161582947, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.361000291914 F1-OK: 0.894013976534 F1-score multiplied: 0.322739306504 [ 40537 106670 99084 ..., 465976 431894 328479] ^CTraceback (most recent call last):
hybrid network with 512-256-17-GP - matern52 - with pretraining
Epoch 1: \Dev set LL -0.7574342641366716, Acc 0.8360511064529419, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395367736692 F1-OK: 0.905168567969 F1-score multiplied: 0.357874448043 Epoch 1: Test set LL -0.7800932222919179, Acc 0.8311138153076172, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365904365904 F1-OK: 0.902583921556 F1-score multiplied: 0.330259397492 Epoch 1: Test set LL -0.7800932222919179, Acc 0.8311138153076172, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.365904365904 F1-OK: 0.902583921556 F1-score multiplied: 0.330259397492 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8604141941029749, Acc 0.8450308442115784, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.384329174874 F1-OK: 0.911359697495 F1-score multiplied: 0.350262120552 Epoch 2: Test set LL -0.8873717159472942, Acc 0.8398627042770386, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356904603069 F1-OK: 0.908544684081 F1-score multiplied: 0.324263779842 Epoch 2: Test set LL -0.8873717159472942, Acc 0.8398627042770386, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356904603069 F1-OK: 0.908544684081 F1-score multiplied: 0.324263779842 [472030 88008 511958 ..., 479005 325808 365441]
Epoch 3: \Dev set LL -0.8888687147799479, Acc 0.8472344875335693, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378390495405 F1-OK: 0.912916496561 F1-score multiplied: 0.345438925397 Epoch 3: Test set LL -0.9223011723226575, Acc 0.843101978302002, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352268830724 F1-OK: 0.910740443226 F1-score multiplied: 0.320825471028 Epoch 3: Test set LL -0.9223011723226575, Acc 0.843101978302002, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352268830724 F1-OK: 0.910740443226 F1-score multiplied: 0.320825471028 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.9803245432505784, Acc 0.8389708995819092, Outputs [0 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.379273731153 F1-OK: 0.907485361608 F1-score multiplied: 0.344185359064 Epoch 4: Test set LL -0.999932945851157, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363322545847 F1-OK: 0.906269851353 F1-score multiplied: 0.329268269618 Epoch 4: Test set LL -0.999932945851157, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363322545847 F1-OK: 0.906269851353 F1-score multiplied: 0.329268269618 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8687235980692759, Acc 0.8591339588165283, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.372515337423 F1-OK: 0.920661516026 F1-score multiplied: 0.342960535295 Epoch 5: Test set LL -0.8975873083086491, Acc 0.8559761047363281, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340349987319 F1-OK: 0.919163351566 F1-score multiplied: 0.31283723505 Epoch 5: Test set LL -0.8975873083086491, Acc 0.8559761047363281, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340349987319 F1-OK: 0.919163351566 F1-score multiplied: 0.31283723505 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.0443474638126282, Acc 0.8321948051452637, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.376841243863 F1-OK: 0.903043035396 F1-score multiplied: 0.34030386072 Epoch 6: Test set LL -1.0626284372109136, Acc 0.8290927410125732, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354626241505 F1-OK: 0.90150463517 F1-score multiplied: 0.31969720047 Epoch 6: Test set LL -1.0626284372109136, Acc 0.8290927410125732, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354626241505 F1-OK: 0.90150463517 F1-score multiplied: 0.31969720047 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -1.0923339197725408, Acc 0.8270713686943054, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396230044239 F1-OK: 0.899083748593 F1-score multiplied: 0.35624399348 Epoch 7: Test set LL -1.130562938639035, Acc 0.8203161954879761, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363475872891 F1-OK: 0.895393443151 F1-score multiplied: 0.325453913331 Epoch 7: Test set LL -1.130562938639035, Acc 0.8203161954879761, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363475872891 F1-OK: 0.895393443151 F1-score multiplied: 0.325453913331 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -1.0786826747093623, Acc 0.8277875781059265, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.381724683544 F1-OK: 0.899961597542 F1-score multiplied: 0.343537556024 Epoch 8: Test set LL -1.1014546640141, Acc 0.8247182965278625, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36056963943 F1-OK: 0.898439129249 F1-score multiplied: 0.323949872883 Epoch 8: Test set LL -1.1014546640141, Acc 0.8247182965278625, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36056963943 F1-OK: 0.898439129249 F1-score multiplied: 0.323949872883 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -1.0292040444044421, Acc 0.8359960317611694, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378885875235 F1-OK: 0.905525054743 F1-score multiplied: 0.343090652913 Epoch 9: Test set LL -1.0628559697891045, Acc 0.832138180732727, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356710875332 F1-OK: 0.903475395221 F1-score multiplied: 0.32227949907 Epoch 9: Test set LL -1.0628559697891045, Acc 0.832138180732727, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356710875332 F1-OK: 0.903475395221 F1-score multiplied: 0.32227949907 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9662804302799213, Acc 0.8487769961357117, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38604339074 F1-OK: 0.913768730563 F1-score multiplied: 0.352754379099 Epoch 10: Test set LL -1.0049043687605805, Acc 0.8425759077072144, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352981338188 F1-OK: 0.910386130812 F1-score multiplied: 0.321349314722 Epoch 10: Test set LL -1.0049043687605805, Acc 0.8425759077072144, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352981338188 F1-OK: 0.910386130812 F1-score multiplied: 0.321349314722 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9089245147389411, Acc 0.8583627343177795, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.368149422463 F1-OK: 0.920241973011 F1-score multiplied: 0.33878655089 Epoch 11: Test set LL -0.9329979323226443, Acc 0.8546748161315918, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.344120954642 F1-OK: 0.918284424379 F1-score multiplied: 0.31600091275 Epoch 11: Test set LL -0.9329979323226443, Acc 0.8546748161315918, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.344120954642 F1-OK: 0.918284424379 F1-score multiplied: 0.31600091275 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9606608638552175, Acc 0.849493145942688, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.379090909091 F1-OK: 0.914368104313 F1-score multiplied: 0.346628635908 Epoch 12: Test set LL -1.0027802274786428, Acc 0.8430742621421814, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.349253731343 F1-OK: 0.910779498804 F1-score multiplied: 0.318093138388 Epoch 12: Test set LL -1.0027802274786428, Acc 0.8430742621421814, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.349253731343 F1-OK: 0.910779498804 F1-score multiplied: 0.318093138388 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9151526915487426, Acc 0.8572058081626892, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380497131931 F1-OK: 0.919302615193 F1-score multiplied: 0.349792008458 Epoch 13: Test set LL -0.951407902933297, Acc 0.8529306054115295, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355026711996 F1-OK: 0.917002593669 F1-score multiplied: 0.325560415722 Epoch 13: Test set LL -0.951407902933297, Acc 0.8529306054115295, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355026711996 F1-OK: 0.917002593669 F1-score multiplied: 0.325560415722 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.95311642166946, Acc 0.8523027896881104, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.373744452231 F1-OK: 0.916278924523 F1-score multiplied: 0.342454164736 Epoch 14: Test set LL -0.9731071278072824, Acc 0.8488606810569763, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348645746331 F1-OK: 0.914512113002 F1-score multiplied: 0.318840758166 Epoch 14: Test set LL -0.9731071278072824, Acc 0.8488606810569763, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348645746331 F1-OK: 0.914512113002 F1-score multiplied: 0.318840758166 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.9688440988345123, Acc 0.8492177128791809, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374113880631 F1-OK: 0.914283924713 F1-score multiplied: 0.342046307073 Epoch 15: Test set LL -0.9825444867059202, Acc 0.8472825884819031, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353189493433 F1-OK: 0.913420185214 F1-score multiplied: 0.322610412508 Epoch 15: Test set LL -0.9825444867059202, Acc 0.8472825884819031, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353189493433 F1-OK: 0.913420185214 F1-score multiplied: 0.322610412508 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.923138991395902, Acc 0.8569854497909546, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.373249637856 F1-OK: 0.91928362664 F1-score multiplied: 0.34312228073 Epoch 16: Test set LL -0.9564938258261695, Acc 0.8516293168067932, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.34301826652 F1-OK: 0.916371467362 F1-score multiplied: 0.314332152222 Epoch 16: Test set LL -0.9564938258261695, Acc 0.8516293168067932, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.34301826652 F1-OK: 0.916371467362 F1-score multiplied: 0.314332152222 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -1.011870664977861, Acc 0.8422763347625732, Outputs [0 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380972972973 F1-OK: 0.909624672496 F1-score multiplied: 0.34654241577 Epoch 17: Test set LL -1.0515014846130224, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356379498364 F1-OK: 0.906418468954 F1-score multiplied: 0.323028959274 Epoch 17: Test set LL -1.0515014846130224, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356379498364 F1-OK: 0.906418468954 F1-score multiplied: 0.323028959274 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -1.0859758913985116, Acc 0.830872654914856, Outputs [0 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390389197776 F1-OK: 0.901816553665 F1-score multiplied: 0.352059440926 Epoch 18: Test set LL -1.1499062179653994, Acc 0.8206484317779541, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352717825739 F1-OK: 0.895902297927 F1-score multiplied: 0.3160007106 Epoch 18: Test set LL -1.1499062179653994, Acc 0.8206484317779541, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352717825739 F1-OK: 0.895902297927 F1-score multiplied: 0.3160007106 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9740424267917543, Acc 0.8496584296226501, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.377934807385 F1-OK: 0.914496976533 F1-score multiplied: 0.345620238681 Epoch 19: Test set LL -1.0066829481442034, Acc 0.8444862961769104, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354738655945 F1-OK: 0.911589252829 F1-score multiplied: 0.323375946322 Epoch 19: Test set LL -1.0066829481442034, Acc 0.8444862961769104, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354738655945 F1-OK: 0.911589252829 F1-score multiplied: 0.323375946322 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.9446131361619717, Acc 0.8546165823936462, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375975407898 F1-OK: 0.917724084178 F1-score multiplied: 0.345041686886 Epoch 20: Test set LL -0.95927811690958, Acc 0.8514355421066284, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.35890083632 F1-OK: 0.915982964865 F1-score multiplied: 0.328747052145 Epoch 20: Test set LL -0.95927811690958, Acc 0.8514355421066284, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.35890083632 F1-OK: 0.915982964865 F1-score multiplied: 0.328747052145 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -1.0660476241369736, Acc 0.8350595235824585, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.380893300248 F1-OK: 0.904855726452 F1-score multiplied: 0.344653483897 Epoch 21: Test set LL -1.0973832786119195, Acc 0.8293418884277344, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358050406165 F1-OK: 0.901590139856 F1-score multiplied: 0.32281471577 Epoch 21: Test set LL -1.0973832786119195, Acc 0.8293418884277344, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358050406165 F1-OK: 0.901590139856 F1-score multiplied: 0.32281471577 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.9646932151897628, Acc 0.8507602214813232, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.391919191919 F1-OK: 0.914942384376 F1-score multiplied: 0.358583479937 Epoch 22: Test set LL -1.0258658662230093, Acc 0.8417730331420898, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348866355247 F1-OK: 0.90994469044 F1-score multiplied: 0.31744908763 Epoch 22: Test set LL -1.0258658662230093, Acc 0.8417730331420898, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348866355247 F1-OK: 0.90994469044 F1-score multiplied: 0.31744908763 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.9570973589097768, Acc 0.8527435064315796, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.376777803684 F1-OK: 0.916507886928 F1-score multiplied: 0.345319828696 Epoch 23: Test set LL -0.9850438345473896, Acc 0.8486669063568115, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.350831353919 F1-OK: 0.914350183334 F1-score multiplied: 0.320782712775 Epoch 23: Test set LL -0.9850438345473896, Acc 0.8486669063568115, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.350831353919 F1-OK: 0.914350183334 F1-score multiplied: 0.320782712775 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.9564857551007263, Acc 0.8529087901115417, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390410958904 F1-OK: 0.916363864177 F1-score multiplied: 0.357758494919 Epoch 24: Test set LL -1.002994449559447, Acc 0.8455383777618408, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354506537082 F1-OK: 0.912272977435 F1-score multiplied: 0.323406734104 Epoch 24: Test set LL -1.002994449559447, Acc 0.8455383777618408, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.354506537082 F1-OK: 0.912272977435 F1-score multiplied: 0.323406734104 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -1.0185424453554097, Acc 0.8430476188659668, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.384 F1-OK: 0.910066605638 F1-score multiplied: 0.349465576565 Epoch 25: Test set LL -1.0699842284161063, Acc 0.8347684144973755, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.351867940921 F1-OK: 0.905314929399 F1-score multiplied: 0.318551300093 Epoch 25: Test set LL -1.0699842284161063, Acc 0.8347684144973755, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.351867940921 F1-OK: 0.905314929399 F1-score multiplied: 0.318551300093 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.9215808050045394, Acc 0.8581974506378174, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374027237354 F1-OK: 0.920042246521 F1-score multiplied: 0.344120859715 Epoch 26: Test set LL -0.9593152251554821, Acc 0.8524045348167419, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348845731037 F1-OK: 0.916769449345 F1-score multiplied: 0.319811108749 Epoch 26: Test set LL -0.9593152251554821, Acc 0.8524045348167419, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.348845731037 F1-OK: 0.916769449345 F1-score multiplied: 0.319811108749 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.9554838383985745, Acc 0.8521925806999207, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378791386895 F1-OK: 0.916116929811 F1-score multiplied: 0.347017202401 Epoch 27: Test set LL -0.9875634990125134, Acc 0.8481131792068481, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356103286385 F1-OK: 0.913901880159 F1-score multiplied: 0.325443462958 Epoch 27: Test set LL -0.9875634990125134, Acc 0.8481131792068481, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356103286385 F1-OK: 0.913901880159 F1-score multiplied: 0.325443462958 [255352 453736 505023 ..., 246196 430507 97061]
Matern32 with pretraining
Epoch 1: \Dev set LL -0.6661515505377451, Acc 0.8512009978294373, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388221970555 F1-OK: 0.91529994669 F1-score multiplied: 0.355339548953 Epoch 1: Test set LL -0.6885949652446496, Acc 0.8476425409317017, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359892985925 F1-OK: 0.913530585629 F1-score multiplied: 0.328773250196 Epoch 1: Test set LL -0.6885949652446496, Acc 0.8476425409317017, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.359892985925 F1-OK: 0.913530585629 F1-score multiplied: 0.328773250196 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8610959907786584, Acc 0.8432679772377014, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.393777967185 F1-OK: 0.909999683654 F1-score multiplied: 0.358337825569 Epoch 2: Test set LL -0.8928240921256286, Acc 0.835903525352478, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356390487567 F1-OK: 0.90596392137 F1-score multiplied: 0.322876923655 Epoch 2: Test set LL -0.8928240921256286, Acc 0.835903525352478, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356390487567 F1-OK: 0.90596392137 F1-score multiplied: 0.322876923655 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8790393509658562, Acc 0.8499889969825745, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.386020293123 F1-OK: 0.914556465531 F1-score multiplied: 0.353037354902 Epoch 3: Test set LL -0.9094048140277633, Acc 0.8440709710121155, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358249772106 F1-OK: 0.911253978759 F1-score multiplied: 0.326456530221 Epoch 3: Test set LL -0.9094048140277633, Acc 0.8440709710121155, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.358249772106 F1-OK: 0.911253978759 F1-score multiplied: 0.326456530221 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.9652528728944121, Acc 0.8401278257369995, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389823380992 F1-OK: 0.908013186256 F1-score multiplied: 0.353964770252 Epoch 4: Test set LL -0.9911718720877671, Acc 0.8360142707824707, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.366862640299 F1-OK: 0.905809201215 F1-score multiplied: 0.332307555165 Epoch 4: Test set LL -0.9911718720877671, Acc 0.8360142707824707, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.366862640299 F1-OK: 0.905809201215 F1-score multiplied: 0.332307555165 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9788781251213472, Acc 0.8421110510826111, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.381794650561 F1-OK: 0.90949854743 F1-score multiplied: 0.347241680101 Epoch 5: Test set LL -1.0061302668179, Acc 0.8383399248123169, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.357433696489 F1-OK: 0.907539073015 F1-score multiplied: 0.324385045577 Epoch 5: Test set LL -1.0061302668179, Acc 0.8383399248123169, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.357433696489 F1-OK: 0.907539073015 F1-score multiplied: 0.324385045577 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.0293347765492078, Acc 0.8352247476577759, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.390959071472 F1-OK: 0.904723983054 F1-score multiplied: 0.353710048353 Epoch 6: Test set LL -1.0569090566145098, Acc 0.8316952586174011, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.367363929649 F1-OK: 0.902936339395 F1-score multiplied: 0.331706241863 Epoch 6: Test set LL -1.0569090566145098, Acc 0.8316952586174011, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.367363929649 F1-OK: 0.902936339395 F1-score multiplied: 0.331706241863 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -1.062351777926441, Acc 0.8288893699645996, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385923289838 F1-OK: 0.900595276195 F1-score multiplied: 0.347560691802 Epoch 7: Test set LL -1.1070783071762118, Acc 0.8224480152130127, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36029925187 F1-OK: 0.896918650443 F1-score multiplied: 0.323159118743 Epoch 7: Test set LL -1.1070783071762118, Acc 0.8224480152130127, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.36029925187 F1-OK: 0.896918650443 F1-score multiplied: 0.323159118743 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9595983068687504, Acc 0.8485015630722046, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385062611807 F1-OK: 0.913608946972 F1-score multiplied: 0.351796647291 Epoch 8: Test set LL -0.9860250440236683, Acc 0.843932569026947, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360521837777 F1-OK: 0.911120571402 F1-score multiplied: 0.328478862838 Epoch 8: Test set LL -0.9860250440236683, Acc 0.843932569026947, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360521837777 F1-OK: 0.911120571402 F1-score multiplied: 0.328478862838 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -1.0230610961729785, Acc 0.8390259742736816, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.385359697097 F1-OK: 0.907385103011 F1-score multiplied: 0.349669648447 Epoch 9: Test set LL -1.0544221124564555, Acc 0.8342700600624084, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360743272106 F1-OK: 0.904793714413 F1-score multiplied: 0.326398245118 Epoch 9: Test set LL -1.0544221124564555, Acc 0.8342700600624084, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.360743272106 F1-OK: 0.904793714413 F1-score multiplied: 0.326398245118 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9065254767738812, Acc 0.859244167804718, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.379703811605 F1-OK: 0.920615193413 F1-score multiplied: 0.34956109796 Epoch 10: Test set LL -0.9356554263296066, Acc 0.8541210889816284, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.344570220177 F1-OK: 0.917927070515 F1-score multiplied: 0.316290332793 Epoch 10: Test set LL -0.9356554263296066, Acc 0.8541210889816284, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.344570220177 F1-OK: 0.917927070515 F1-score multiplied: 0.316290332793 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9171477522068165, Acc 0.8568201661109924, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.383099928792 F1-OK: 0.919011560874 F1-score multiplied: 0.35207326353 Epoch 11: Test set LL -0.9491717185264085, Acc 0.8523768782615662, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353853611246 F1-OK: 0.916669271403 F1-score multiplied: 0.324366732004 Epoch 11: Test set LL -0.9491717185264085, Acc 0.8523768782615662, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.353853611246 F1-OK: 0.916669271403 F1-score multiplied: 0.324366732004 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -1.0545386138704846, Acc 0.8345085978507996, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389182594551 F1-OK: 0.90428853629 F1-score multiplied: 0.351933358776 Epoch 12: Test set LL -1.0980380368770835, Acc 0.8278745412826538, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363077553529 F1-OK: 0.900491380828 F1-score multiplied: 0.326948207525 Epoch 12: Test set LL -1.0980380368770835, Acc 0.8278745412826538, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.363077553529 F1-OK: 0.900491380828 F1-score multiplied: 0.326948207525 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9753802780104261, Acc 0.8478404879570007, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.381826320501 F1-OK: 0.913242869707 F1-score multiplied: 0.348700164664 Epoch 13: Test set LL -0.997041379951264, Acc 0.8445416688919067, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356594476911 F1-OK: 0.911590118247 F1-score multiplied: 0.325068001373 Epoch 13: Test set LL -0.997041379951264, Acc 0.8445416688919067, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.356594476911 F1-OK: 0.911590118247 F1-score multiplied: 0.325068001373 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9835549217358313, Acc 0.8471793532371521, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.384922394678 F1-OK: 0.912750833491 F1-score multiplied: 0.351338236572 Epoch 14: Test set LL -1.0151642927599176, Acc 0.8413854241371155, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352728505254 F1-OK: 0.90961869153 F1-score multiplied: 0.320848441414 Epoch 14: Test set LL -1.0151642927599176, Acc 0.8413854241371155, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.352728505254 F1-OK: 0.90961869153 F1-score multiplied: 0.320848441414 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.9914172519664612, Acc 0.8467937707901001, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388387948098 F1-OK: 0.912428755865 F1-score multiplied: 0.354376332276 Epoch 15: Test set LL -1.022244756342223, Acc 0.8418006896972656, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355660802887 F1-OK: 0.909831150387 F1-score multiplied: 0.323591277438 Epoch 15: Test set LL -1.022244756342223, Acc 0.8418006896972656, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.355660802887 F1-OK: 0.909831150387 F1-score multiplied: 0.323591277438 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.9042883604679354, Acc 0.8606213927268982, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375616979269 F1-OK: 0.921555252387 F1-score multiplied: 0.346151800132 Epoch 16: Test set LL -0.9317228810620748, Acc 0.857498824596405, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.343411149381 F1-OK: 0.920076398702 F1-score multiplied: 0.315964493597 Epoch 16: Test set LL -0.9317228810620748, Acc 0.857498824596405, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.343411149381 F1-OK: 0.920076398702 F1-score multiplied: 0.315964493597 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -1.0267775553137843, Acc 0.8409541845321655, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.384828467931 F1-OK: 0.908671032236 F1-score multiplied: 0.349682481188 Epoch 17: Test set LL -1.050989555799368, Acc 0.8378969430923462, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.359619380947 F1-OK: 0.907203423409 F1-score multiplied: 0.32624793352 Epoch 17: Test set LL -1.050989555799368, Acc 0.8378969430923462, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.359619380947 F1-OK: 0.907203423409 F1-score multiplied: 0.32624793352 [ 65790 546348 448811 ..., 118458 326788 557465]
Matern12 - from scratch
Epoch 1: \Dev set LL -0.6314222266237799, Acc 0.8547267317771912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.339263342521 F1-OK: 0.918391978461 F1-score multiplied: 0.311576732357 Epoch 1: Test set LL -0.6384977743934105, Acc 0.8534289598464966, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.310856547774 F1-OK: 0.917993679906 F1-score multiplied: 0.285364346214 Epoch 1: Test set LL -0.6384977743934105, Acc 0.8534289598464966, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.310856547774 F1-OK: 0.917993679906 F1-score multiplied: 0.285364346214 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.770903814276964, Acc 0.8524680733680725, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362684435983 F1-OK: 0.91657840633 F1-score multiplied: 0.332428722334 Epoch 2: Test set LL -0.7820874804566567, Acc 0.8498573899269104, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332389511264 F1-OK: 0.915417608984 F1-score multiplied: 0.304275211653 Epoch 2: Test set LL -0.7820874804566567, Acc 0.8498573899269104, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332389511264 F1-OK: 0.915417608984 F1-score multiplied: 0.304275211653 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8568387401541332, Acc 0.8468488454818726, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.365586490187 F1-OK: 0.912912724767 F1-score multiplied: 0.333748558895 Epoch 3: Test set LL -0.8544652091010358, Acc 0.8464797139167786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341839762611 F1-OK: 0.913105480075 F1-score multiplied: 0.312135760548 Epoch 3: Test set LL -0.8544652091010358, Acc 0.8464797139167786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341839762611 F1-OK: 0.913105480075 F1-score multiplied: 0.312135760548 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8248772821620517, Acc 0.861833393573761, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.36312849162 F1-OK: 0.922511277266 F1-score multiplied: 0.334990128616 Epoch 4: Test set LL -0.8384081597933676, Acc 0.85935378074646, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326795653326 F1-OK: 0.921474061708 F1-score multiplied: 0.301133718019 Epoch 4: Test set LL -0.8384081597933676, Acc 0.85935378074646, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326795653326 F1-OK: 0.921474061708 F1-score multiplied: 0.301133718019 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8150263555199664, Acc 0.8674526214599609, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350782514841 F1-OK: 0.926191790907 F1-score multiplied: 0.324891885639 Epoch 5: Test set LL -0.8200220905372401, Acc 0.8674658536911011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.32396554159 F1-OK: 0.926531301318 F1-score multiplied: 0.300164214832 Epoch 5: Test set LL -0.8200220905372401, Acc 0.8674658536911011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.32396554159 F1-OK: 0.926531301318 F1-score multiplied: 0.300164214832 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8393814980335947, Acc 0.8645879030227661, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363871635611 F1-OK: 0.924229346486 F1-score multiplied: 0.336300843985 Epoch 6: Test set LL -0.8490889495217411, Acc 0.8637559413909912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337417530631 F1-OK: 0.924071531067 F1-score multiplied: 0.31179793414 Epoch 6: Test set LL -0.8490889495217411, Acc 0.8637559413909912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337417530631 F1-OK: 0.924071531067 F1-score multiplied: 0.31179793414 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.8143646729595362, Acc 0.8713089227676392, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348940914158 F1-OK: 0.928597628072 F1-score multiplied: 0.324025705225 Epoch 7: Test set LL -0.820712110179336, Acc 0.870566725730896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323737885144 F1-OK: 0.92843474933 F1-score multiplied: 0.300569502242 Epoch 7: Test set LL -0.820712110179336, Acc 0.870566725730896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323737885144 F1-OK: 0.92843474933 F1-score multiplied: 0.300569502242 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8768544979575005, Acc 0.859244167804718, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356585243012 F1-OK: 0.920978566789 F1-score multiplied: 0.328407366047 Epoch 8: Test set LL -0.8779649487840928, Acc 0.8599352240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342047080245 F1-OK: 0.921625431842 F1-score multiplied: 0.315239288041 Epoch 8: Test set LL -0.8779649487840928, Acc 0.8599352240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342047080245 F1-OK: 0.921625431842 F1-score multiplied: 0.315239288041 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8545275081813958, Acc 0.864863395690918, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361364228066 F1-OK: 0.924437051412 F1-score multiplied: 0.334058481479 Epoch 9: Test set LL -0.8562894704031735, Acc 0.8643926978111267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335594139989 F1-OK: 0.924490488083 F1-score multiplied: 0.310253590276 Epoch 9: Test set LL -0.8562894704031735, Acc 0.8643926978111267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335594139989 F1-OK: 0.924490488083 F1-score multiplied: 0.310253590276 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.8418791494620933, Acc 0.8680035471916199, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362765957447 F1-OK: 0.926376597837 F1-score multiplied: 0.336057893471 Epoch 10: Test set LL -0.8608926257976176, Acc 0.8643096685409546, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330555934982 F1-OK: 0.924503596901 F1-score multiplied: 0.305600150867 Epoch 10: Test set LL -0.8608926257976176, Acc 0.8643096685409546, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330555934982 F1-OK: 0.924503596901 F1-score multiplied: 0.305600150867 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8305516301183311, Acc 0.8696011304855347, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34268258817 F1-OK: 0.927621319145 F1-score multiplied: 0.317879674486 Epoch 11: Test set LL -0.8319279836894928, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326507231849 F1-OK: 0.927928894338 F1-score multiplied: 0.302975494643 Epoch 11: Test set LL -0.8319279836894928, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326507231849 F1-OK: 0.927928894338 F1-score multiplied: 0.302975494643 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.8757282591099961, Acc 0.8619436025619507, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363636363636 F1-OK: 0.922573070506 F1-score multiplied: 0.335481116548 Epoch 12: Test set LL -0.8876061125557225, Acc 0.8603228330612183, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335747202107 F1-OK: 0.921955973578 F1-score multiplied: 0.309544138594 Epoch 12: Test set LL -0.8876061125557225, Acc 0.8603228330612183, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335747202107 F1-OK: 0.921955973578 F1-score multiplied: 0.309544138594 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.8397401869273855, Acc 0.8686646223068237, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348633879781 F1-OK: 0.926969734101 F1-score multiplied: 0.32317305484 Epoch 13: Test set LL -0.8488557120121861, Acc 0.868379533290863, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330233868695 F1-OK: 0.927018728892 F1-score multiplied: 0.306132981195 Epoch 13: Test set LL -0.8488557120121861, Acc 0.868379533290863, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330233868695 F1-OK: 0.927018728892 F1-score multiplied: 0.306132981195 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.8607444735985065, Acc 0.8654693961143494, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355672823219 F1-OK: 0.924893891862 F1-score multiplied: 0.328959621697 Epoch 14: Test set LL -0.8640564414452384, Acc 0.8659154176712036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337029431896 F1-OK: 0.925415428211 F1-score multiplied: 0.311892236038 Epoch 14: Test set LL -0.8640564414452384, Acc 0.8659154176712036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337029431896 F1-OK: 0.925415428211 F1-score multiplied: 0.311892236038 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8462172086306494, Acc 0.868554413318634, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3540877098 F1-OK: 0.926832260043 F1-score multiplied: 0.328179912327 Epoch 15: Test set LL -0.8495926037172877, Acc 0.8675765991210938, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33076815447 F1-OK: 0.926518259053 F1-score multiplied: 0.30646273463 Epoch 15: Test set LL -0.8495926037172877, Acc 0.8675765991210938, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33076815447 F1-OK: 0.926518259053 F1-score multiplied: 0.30646273463 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8324456065163204, Acc 0.8705376982688904, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350828729282 F1-OK: 0.928099375841 F1-score multiplied: 0.325603924674 Epoch 16: Test set LL -0.844778180735542, Acc 0.8691270351409912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327308951188 F1-OK: 0.927512229532 F1-score multiplied: 0.303583055062 Epoch 16: Test set LL -0.844778180735542, Acc 0.8691270351409912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327308951188 F1-OK: 0.927512229532 F1-score multiplied: 0.303583055062 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8800287556281708, Acc 0.8621639609336853, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3659401926 F1-OK: 0.922677544966 F1-score multiplied: 0.337644798513 Epoch 17: Test set LL -0.8902959917061696, Acc 0.860765814781189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343215358495 F1-OK: 0.922128799492 F1-score multiplied: 0.316488766497 Epoch 17: Test set LL -0.8902959917061696, Acc 0.860765814781189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343215358495 F1-OK: 0.922128799492 F1-score multiplied: 0.316488766497 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.8464334374231919, Acc 0.8671771883964539, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354138762389 F1-OK: 0.92597709619 F1-score multiplied: 0.327924382846 Epoch 18: Test set LL -0.8553754276257722, Acc 0.8673551082611084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335598391347 F1-OK: 0.926322912021 F1-score multiplied: 0.310872479142 Epoch 18: Test set LL -0.8553754276257722, Acc 0.8673551082611084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335598391347 F1-OK: 0.926322912021 F1-score multiplied: 0.310872479142 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.8760602305766692, Acc 0.8640921115875244, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.367598051782 F1-OK: 0.923865074222 F1-score multiplied: 0.339611001393 Epoch 19: Test set LL -0.8873117232431491, Acc 0.8625100255012512, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342077371489 F1-OK: 0.923233884681 F1-score multiplied: 0.315817420541 Epoch 19: Test set LL -0.8873117232431491, Acc 0.8625100255012512, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342077371489 F1-OK: 0.923233884681 F1-score multiplied: 0.315817420541 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.8687057080369163, Acc 0.8646430373191833, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363306556103 F1-OK: 0.92427184466 F1-score multiplied: 0.335794020786 Epoch 20: Test set LL -0.8748084810876843, Acc 0.8648080229759216, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.344299718007 F1-OK: 0.924634594311 F1-score multiplied: 0.318351430081 Epoch 20: Test set LL -0.8748084810876843, Acc 0.8648080229759216, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.344299718007 F1-OK: 0.924634594311 F1-score multiplied: 0.318351430081 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.8471390235861456, Acc 0.8696011304855347, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355918367347 F1-OK: 0.927457170002 F1-score multiplied: 0.330099041731 Epoch 21: Test set LL -0.854450487721553, Acc 0.8687394261360168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331594529818 F1-OK: 0.927223885179 F1-score multiplied: 0.307462368242 Epoch 21: Test set LL -0.854450487721553, Acc 0.8687394261360168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331594529818 F1-OK: 0.927223885179 F1-score multiplied: 0.307462368242 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.8591719589522843, Acc 0.8675076961517334, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360882274781 F1-OK: 0.926093236225 F1-score multiplied: 0.334210633748 Epoch 22: Test set LL -0.8631844871727987, Acc 0.8666906356811523, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339596763133 F1-OK: 0.925862626449 F1-score multiplied: 0.314419951048 Epoch 22: Test set LL -0.8631844871727987, Acc 0.8666906356811523, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339596763133 F1-OK: 0.925862626449 F1-score multiplied: 0.314419951048 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.8627469124119455, Acc 0.8658549785614014, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359716013673 F1-OK: 0.925079228331 F1-score multiplied: 0.332765812347 Epoch 23: Test set LL -0.8653313622093619, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343834872352 F1-OK: 0.925517156334 F1-score multiplied: 0.318225073308 Epoch 23: Test set LL -0.8653313622093619, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343834872352 F1-OK: 0.925517156334 F1-score multiplied: 0.318225073308 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.8455265421628089, Acc 0.8697664141654968, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362115488397 F1-OK: 0.92748021351 F1-score multiplied: 0.335854950494 Epoch 24: Test set LL -0.8578944718244016, Acc 0.8677427172660828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339189376124 F1-OK: 0.926517866757 F1-score multiplied: 0.314265017193 Epoch 24: Test set LL -0.8578944718244016, Acc 0.8677427172660828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339189376124 F1-OK: 0.926517866757 F1-score multiplied: 0.314265017193 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.8630347979157347, Acc 0.86651611328125, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359164242264 F1-OK: 0.925498877717 F1-score multiplied: 0.332406103131 Epoch 25: Test set LL -0.8617443168553682, Acc 0.8667183518409729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342169991801 F1-OK: 0.92584719655 F1-score multiplied: 0.316797127652 Epoch 25: Test set LL -0.8617443168553682, Acc 0.8667183518409729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342169991801 F1-OK: 0.92584719655 F1-score multiplied: 0.316797127652 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.874108365408881, Acc 0.8655244708061218, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356785243742 F1-OK: 0.924913100987 F1-score multiplied: 0.329995346176 Epoch 26: Test set LL -0.8697074962279197, Acc 0.865361750125885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342926631536 F1-OK: 0.924996529759 F1-score multiplied: 0.317205944133 Epoch 26: Test set LL -0.8697074962279197, Acc 0.865361750125885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342926631536 F1-OK: 0.924996529759 F1-score multiplied: 0.317205944133 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.8763207539566138, Acc 0.8644777536392212, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364669421488 F1-OK: 0.924148988653 F1-score multiplied: 0.337008877061 Epoch 27: Test set LL -0.8877672133182258, Acc 0.8625653982162476, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349410222805 F1-OK: 0.923167409609 F1-score multiplied: 0.322564130277 Epoch 27: Test set LL -0.8877672133182258, Acc 0.8625653982162476, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349410222805 F1-OK: 0.923167409609 F1-score multiplied: 0.322564130277 [255352 453736 505023 ..., 246196 430507 97061] Epoch 28: \Dev set LL -0.8511464641241377, Acc 0.8704825639724731, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359225947125 F1-OK: 0.927960778306 F1-score multiplied: 0.333347589481 Epoch 28: Test set LL -0.8486356553406481, Acc 0.8693762421607971, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33884529148 F1-OK: 0.927529108169 F1-score multiplied: 0.314288871013 Epoch 28: Test set LL -0.8486356553406481, Acc 0.8693762421607971, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33884529148 F1-OK: 0.927529108169 F1-score multiplied: 0.314288871013 [182829 156731 212271 ..., 262696 534335 194312] Epoch 29: \Dev set LL -0.8663239438746957, Acc 0.8663508296012878, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360906217071 F1-OK: 0.92537221607 F1-score multiplied: 0.333972585884 Epoch 29: Test set LL -0.8818092354669526, Acc 0.8640881776809692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335094135175 F1-OK: 0.924308071853 F1-score multiplied: 0.309730213973 Epoch 29: Test set LL -0.8818092354669526, Acc 0.8640881776809692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335094135175 F1-OK: 0.924308071853 F1-score multiplied: 0.309730213973 [ 63516 229449 556142 ..., 518027 383750 277428] Epoch 30: \Dev set LL -0.8688845870204057, Acc 0.8659101128578186, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354033970276 F1-OK: 0.925190558151 F1-score multiplied: 0.327548886564 Epoch 30: Test set LL -0.8696743987932485, Acc 0.8660538792610168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340512540894 F1-OK: 0.925456842624 F1-score multiplied: 0.31512966097 Epoch 30: Test set LL -0.8696743987932485, Acc 0.8660538792610168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340512540894 F1-OK: 0.925456842624 F1-score multiplied: 0.31512966097 [457261 283956 219083 ..., 266029 196105 187136] Epoch 31: \Dev set LL -0.8718593292249642, Acc 0.8652490377426147, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.351537645811 F1-OK: 0.924812492315 F1-score multiplied: 0.325106406365 Epoch 31: Test set LL -0.8701242925613156, Acc 0.8655001521110535, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341198806618 F1-OK: 0.925104834731 F1-score multiplied: 0.315644665607 Epoch 31: Test set LL -0.8701242925613156, Acc 0.8655001521110535, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341198806618 F1-OK: 0.925104834731 F1-score multiplied: 0.315644665607 [262413 88672 33985 ..., 318723 95762 425717] Epoch 32: \Dev set LL -0.8563086311951438, Acc 0.8680035471916199, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35935828877 F1-OK: 0.926421815502 F1-score multiplied: 0.332917358298 Epoch 32: Test set LL -0.8682007967188913, Acc 0.8658323884010315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336164383562 F1-OK: 0.925374973051 F1-score multiplied: 0.311078107379 Epoch 32: Test set LL -0.8682007967188913, Acc 0.8658323884010315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336164383562 F1-OK: 0.925374973051 F1-score multiplied: 0.311078107379 [251290 383272 991 ..., 526297 101320 365163] Epoch 33: \Dev set LL -0.8500595226205522, Acc 0.8698214888572693, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355604035997 F1-OK: 0.927597512026 F1-score multiplied: 0.329857419057 Epoch 33: Test set LL -0.8558269137689537, Acc 0.8679365515708923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337131739855 F1-OK: 0.926662771747 F1-score multiplied: 0.312407432499 Epoch 33: Test set LL -0.8558269137689537, Acc 0.8679365515708923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337131739855 F1-OK: 0.926662771747 F1-score multiplied: 0.312407432499 [355881 139443 16797 ..., 553960 256872 531958] Epoch 34: \Dev set LL -0.8597100595878867, Acc 0.8670669794082642, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357047695177 F1-OK: 0.925870172959 F1-score multiplied: 0.330579811288 Epoch 34: Test set LL -0.8654890364627356, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340251228837 F1-OK: 0.925563052654 F1-score multiplied: 0.314923966031 Epoch 34: Test set LL -0.8654890364627356, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340251228837 F1-OK: 0.925563052654 F1-score multiplied: 0.314923966031 [141835 239010 254090 ..., 15612 504913 215719] Epoch 35: \Dev set LL -0.8769685527403986, Acc 0.8644226789474487, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354237732879 F1-OK: 0.924260609978 F1-score multiplied: 0.327407983067 Epoch 35: Test set LL -0.8767830959811564, Acc 0.8638389706611633, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3414568827 F1-OK: 0.924069785394 F1-score multiplied: 0.315529988318 Epoch 35: Test set LL -0.8767830959811564, Acc 0.8638389706611633, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3414568827 F1-OK: 0.924069785394 F1-score multiplied: 0.315529988318 [217496 218246 75279 ..., 327762 448278 78427] Epoch 36: \Dev set LL -0.8660301244067461, Acc 0.8668466210365295, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360412807621 F1-OK: 0.92568793236 F1-score multiplied: 0.333629786683 Epoch 36: Test set LL -0.8760889006281916, Acc 0.864863395690918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341917217204 F1-OK: 0.924700328597 F1-score multiplied: 0.316170963101 Epoch 36: Test set LL -0.8760889006281916, Acc 0.864863395690918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341917217204 F1-OK: 0.924700328597 F1-score multiplied: 0.316170963101 [398841 208123 485669 ..., 52121 453759 477812] Epoch 37: \Dev set LL -0.8603739490971908, Acc 0.8678933382034302, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353290183387 F1-OK: 0.926432691128 F1-score multiplied: 0.327299575344 Epoch 37: Test set LL -0.8738193449690475, Acc 0.8654171228408813, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340702563407 F1-OK: 0.925059739459 F1-score multiplied: 0.315170224538 Epoch 37: Test set LL -0.8738193449690475, Acc 0.8654171228408813, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340702563407 F1-OK: 0.925059739459 F1-score multiplied: 0.315170224538 [442506 478532 173682 ..., 35206 362546 523040] Epoch 38: \Dev set LL -0.8699940105726331, Acc 0.8654693961143494, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362068965517 F1-OK: 0.924806010592 F1-score multiplied: 0.334843555559 Epoch 38: Test set LL -0.8843942408393866, Acc 0.8643926978111267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.347629195525 F1-OK: 0.924331839951 F1-score multiplied: 0.32132473392 Epoch 38: Test set LL -0.8843942408393866, Acc 0.8643926978111267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.347629195525 F1-OK: 0.924331839951 F1-score multiplied: 0.32132473392 [282590 352776 441935 ..., 48457 341548 197253] Epoch 39: \Dev set LL -0.8762155044712601, Acc 0.864863395690918, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356336919444 F1-OK: 0.924506816853 F1-score multiplied: 0.329435911122 Epoch 39: Test set LL -0.882658043420981, Acc 0.863949716091156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346368715084 F1-OK: 0.924072929543 F1-score multiplied: 0.320069953249 Epoch 39: Test set LL -0.882658043420981, Acc 0.863949716091156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346368715084 F1-OK: 0.924072929543 F1-score multiplied: 0.320069953249 [ 80053 60994 279247 ..., 16715 185116 347150] Epoch 40: \Dev set LL -0.8367186885816444, Acc 0.8701520562171936, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345459594557 F1-OK: 0.927927101489 F1-score multiplied: 0.320561320259 Epoch 40: Test set LL -0.8424380214174213, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335640627207 F1-OK: 0.9278227106 F1-score multiplied: 0.311414996523 Epoch 40: Test set LL -0.8424380214174213, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335640627207 F1-OK: 0.9278227106 F1-score multiplied: 0.311414996523 [216423 451073 217042 ..., 546097 95729 180165] Epoch 41: \Dev set LL -0.8380744921689418, Acc 0.8718047738075256, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345060512243 F1-OK: 0.92894873439 F1-score multiplied: 0.320543526136 Epoch 41: Test set LL -0.8381511882904471, Acc 0.8714526891708374, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337943818623 F1-OK: 0.928815638176 F1-score multiplied: 0.313887503561 Epoch 41: Test set LL -0.8381511882904471, Acc 0.8714526891708374, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337943818623 F1-OK: 0.928815638176 F1-score multiplied: 0.313887503561 [129069 546938 149331 ..., 88907 352839 46273] Epoch 42: \Dev set LL -0.8319160019757935, Acc 0.8730718493461609, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350253807107 F1-OK: 0.929666035778 F1-score multiplied: 0.325619068369 Epoch 42: Test set LL -0.8384599808187949, Acc 0.871231198310852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335286551379 F1-OK: 0.928710473475 F1-score multiplied: 0.311384131881 Epoch 42: Test set LL -0.8384599808187949, Acc 0.871231198310852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335286551379 F1-OK: 0.928710473475 F1-score multiplied: 0.311384131881 [196874 554968 509277 ..., 29502 207947 546993] Epoch 43: \Dev set LL -0.8597283521489869, Acc 0.8680035471916199, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360725720384 F1-OK: 0.926403735103 F1-score multiplied: 0.334177654712 Epoch 43: Test set LL -0.8758236071822022, Acc 0.8656385540962219, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341609008276 F1-OK: 0.925185379315 F1-score multiplied: 0.316051659899 Epoch 43: Test set LL -0.8758236071822022, Acc 0.8656385540962219, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341609008276 F1-OK: 0.925185379315 F1-score multiplied: 0.316051659899 [171248 192942 534310 ..., 105640 464237 341731] Epoch 44: \Dev set LL -0.8560322157349249, Acc 0.8684442639350891, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357719203873 F1-OK: 0.926716995029 F1-score multiplied: 0.331504465677 Epoch 44: Test set LL -0.8666348612580612, Acc 0.8670505881309509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342732001095 F1-OK: 0.926045709357 F1-score multiplied: 0.317385499074 Epoch 44: Test set LL -0.8666348612580612, Acc 0.8670505881309509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342732001095 F1-OK: 0.926045709357 F1-score multiplied: 0.317385499074 [341039 94776 61925 ..., 172440 350443 75638] Epoch 45: \Dev set LL -0.874325034022797, Acc 0.8659651875495911, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35923097182 F1-OK: 0.92515458209 F1-score multiplied: 0.332344179608 Epoch 45: Test set LL -0.8874333744508512, Acc 0.8632575869560242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341729974677 F1-OK: 0.92370433305 F1-score multiplied: 0.315657458342 Epoch 45: Test set LL -0.8874333744508512, Acc 0.8632575869560242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341729974677 F1-OK: 0.92370433305 F1-score multiplied: 0.315657458342 [ 8616 406801 335128 ..., 190972 320886 532378] Epoch 46: \Dev set LL -0.8630807014591239, Acc 0.8671220541000366, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363924050633 F1-OK: 0.925812007874 F1-score multiplied: 0.33692525603 Epoch 46: Test set LL -0.8815198847984483, Acc 0.8640328049659729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341777241657 F1-OK: 0.924186053692 F1-score multiplied: 0.315865760208 Epoch 46: Test set LL -0.8815198847984483, Acc 0.8640328049659729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341777241657 F1-OK: 0.924186053692 F1-score multiplied: 0.315865760208 [ 7998 158677 35477 ..., 542381 83471 293265] Epoch 47: \Dev set LL -0.8315456741021433, Acc 0.8730167746543884, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34609929078 F1-OK: 0.929680588181 F1-score multiplied: 0.321761792222 Epoch 47: Test set LL -0.8431957456492383, Acc 0.871065080165863, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330024456913 F1-OK: 0.928668800833 F1-score multiplied: 0.306483416647 Epoch 47: Test set LL -0.8431957456492383, Acc 0.871065080165863, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330024456913 F1-OK: 0.928668800833 F1-score multiplied: 0.306483416647 [161251 227729 16139 ..., 377658 3473 81891] Epoch 48: \Dev set LL -0.9023020265416151, Acc 0.8598501682281494, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358224016145 F1-OK: 0.92133580705 F1-score multiplied: 0.33004461302 Epoch 48: Test set LL -0.9079130140943357, Acc 0.8591600060462952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349405294795 F1-OK: 0.921032614601 F1-score multiplied: 0.32181367222 Epoch 48: Test set LL -0.9079130140943357, Acc 0.8591600060462952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.349405294795 F1-OK: 0.921032614601 F1-score multiplied: 0.32181367222 [ 51692 486231 454694 ..., 4492 161811 458279] Epoch 49: \Dev set LL -0.8436205339762202, Acc 0.8709233403205872, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354011579818 F1-OK: 0.928298191388 F1-score multiplied: 0.328628309276 Epoch 49: Test set LL -0.8461092535296494, Acc 0.8706774711608887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33941450997 F1-OK: 0.928322617276 F1-score multiplied: 0.315086166237 Epoch 49: Test set LL -0.8461092535296494, Acc 0.8706774711608887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33941450997 F1-OK: 0.928322617276 F1-score multiplied: 0.315086166237 [183654 343661 354598 ..., 560868 213642 249252] Done!
Matern52 - from scratch - is running
Epoch 1: \Dev set LL -0.7243554470119374, Acc 0.8646981120109558, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318156579678 F1-OK: 0.924897559782 F1-score multiplied: 0.294262244173 Epoch 1: Test set LL -0.7350903100945894, Acc 0.8635898232460022, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.295035055087 F1-OK: 0.924489264203 F1-score multiplied: 0.272756740991 Epoch 1: Test set LL -0.7350903100945894, Acc 0.8635898232460022, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.295035055087 F1-OK: 0.924489264203 F1-score multiplied: 0.272756740991 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8380889745649635, Acc 0.8504297137260437, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353109363831 F1-OK: 0.915439000841 F1-score multiplied: 0.323250083213 Epoch 2: Test set LL -0.8446783068848933, Acc 0.8506326079368591, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329730401292 F1-OK: 0.915951331225 F1-score multiplied: 0.302017000009 Epoch 2: Test set LL -0.8446783068848933, Acc 0.8506326079368591, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329730401292 F1-OK: 0.915951331225 F1-score multiplied: 0.302017000009 [472030 88008 511958 ..., 479005 325808 365441]
Epoch 3: \Dev set LL -0.8597831904573988, Acc 0.8577016592025757, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348878245526 F1-OK: 0.92012246034 F1-score multiplied: 0.321010709632 Epoch 3: Test set LL -0.8797063813313525, Acc 0.854979395866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.324303405573 F1-OK: 0.918773067022 F1-score multiplied: 0.297961234584 Epoch 3: Test set LL -0.8797063813313525, Acc 0.854979395866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.324303405573 F1-OK: 0.918773067022 F1-score multiplied: 0.297961234584 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8573893095793238, Acc 0.8611723184585571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348500517063 F1-OK: 0.92230854606 F1-score multiplied: 0.321425005194 Epoch 4: Test set LL -0.8670020104890883, Acc 0.8599905967712402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326541483553 F1-OK: 0.921874275827 F1-score multiplied: 0.301030193678 Epoch 4: Test set LL -0.8670020104890883, Acc 0.8599905967712402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326541483553 F1-OK: 0.921874275827 F1-score multiplied: 0.301030193678 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8685478401852492, Acc 0.8605663180351257, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354501402703 F1-OK: 0.921841707069 F1-score multiplied: 0.326794178226 Epoch 5: Test set LL -0.8783734296804145, Acc 0.8596583604812622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33381521882 F1-OK: 0.921567717279 F1-score multiplied: 0.307633329201 Epoch 5: Test set LL -0.8783734296804145, Acc 0.8596583604812622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33381521882 F1-OK: 0.921567717279 F1-score multiplied: 0.307633329201 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8456204975872617, Acc 0.8652490377426147, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.337845154304 F1-OK: 0.92499233364 F1-score multiplied: 0.312504177689 Epoch 6: Test set LL -0.8514383400766029, Acc 0.8653063774108887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326643598616 F1-OK: 0.925168812391 F1-score multiplied: 0.302200470207 Epoch 6: Test set LL -0.8514383400766029, Acc 0.8653063774108887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326643598616 F1-OK: 0.925168812391 F1-score multiplied: 0.302200470207 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9101255511262956, Acc 0.8551674485206604, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361117861482 F1-OK: 0.918326136258 F1-score multiplied: 0.331623970469 Epoch 7: Test set LL -0.9180759212586562, Acc 0.8542872071266174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337404003525 F1-OK: 0.918142934909 F1-score multiplied: 0.309785102047 Epoch 7: Test set LL -0.9180759212586562, Acc 0.8542872071266174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337404003525 F1-OK: 0.918142934909 F1-score multiplied: 0.309785102047 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8683514396582712, Acc 0.8629903197288513, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358524632448 F1-OK: 0.923304653529 F1-score multiplied: 0.331027461544 Epoch 8: Test set LL -0.8841329236968594, Acc 0.8610149621963501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332801701223 F1-OK: 0.922427913589 F1-score multiplied: 0.306985578898 Epoch 8: Test set LL -0.8841329236968594, Acc 0.8610149621963501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332801701223 F1-OK: 0.922427913589 F1-score multiplied: 0.306985578898 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8967334595529228, Acc 0.8580872416496277, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357285429142 F1-OK: 0.920237800347 F1-score multiplied: 0.328787557409 Epoch 9: Test set LL -0.9084399079063802, Acc 0.8557546138763428, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333759590793 F1-OK: 0.919121984538 F1-score multiplied: 0.306765777448 Epoch 9: Test set LL -0.9084399079063802, Acc 0.8557546138763428, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333759590793 F1-OK: 0.919121984538 F1-score multiplied: 0.306765777448 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.8755130971541594, Acc 0.8629903197288513, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359515838269 F1-OK: 0.923290459887 F1-score multiplied: 0.331937543652 Epoch 10: Test set LL -0.8969194277073121, Acc 0.8601289987564087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335263157895 F1-OK: 0.92184164114 F1-score multiplied: 0.309059539687 Epoch 10: Test set LL -0.8969194277073121, Acc 0.8601289987564087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335263157895 F1-OK: 0.92184164114 F1-score multiplied: 0.309059539687 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8432714642147352, Acc 0.8687747716903687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354471544715 F1-OK: 0.926963880542 F1-score multiplied: 0.328582318631 Epoch 11: Test set LL -0.8571467277576753, Acc 0.8655001521110535, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327519379845 F1-OK: 0.92527763251 F1-score multiplied: 0.303046356384 Epoch 11: Test set LL -0.8571467277576753, Acc 0.8655001521110535, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327519379845 F1-OK: 0.92527763251 F1-score multiplied: 0.303046356384 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.8643219432637766, Acc 0.8645879030227661, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358559498956 F1-OK: 0.924304015767 F1-score multiplied: 0.331417984777 Epoch 12: Test set LL -0.8746879567655842, Acc 0.8616517782211304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334886197258 F1-OK: 0.922796446504 F1-score multiplied: 0.309031792813 Epoch 12: Test set LL -0.8746879567655842, Acc 0.8616517782211304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334886197258 F1-OK: 0.922796446504 F1-score multiplied: 0.309031792813 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.8670625078207808, Acc 0.8642023205757141, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355218414857 F1-OK: 0.924109479388 F1-score multiplied: 0.328260704423 Epoch 13: Test set LL -0.8784727875492679, Acc 0.8630914688110352, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334186077824 F1-OK: 0.923701223558 F1-score multiplied: 0.308688088982 Epoch 13: Test set LL -0.8784727875492679, Acc 0.8630914688110352, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334186077824 F1-OK: 0.923701223558 F1-score multiplied: 0.308688088982 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9032267905890055, Acc 0.8578118085861206, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356840269125 F1-OK: 0.920070607909 F1-score multiplied: 0.328318243341 Epoch 14: Test set LL -0.9178487216968967, Acc 0.8556438684463501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336809972017 F1-OK: 0.919007083385 F1-score multiplied: 0.309530750039 Epoch 14: Test set LL -0.9178487216968967, Acc 0.8556438684463501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336809972017 F1-OK: 0.919007083385 F1-score multiplied: 0.309530750039 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8709621832736726, Acc 0.8642573952674866, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.343633457645 F1-OK: 0.924301075269 F1-score multiplied: 0.3176207744 Epoch 15: Test set LL -0.8663359106040257, Acc 0.8651402592658997, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331549334431 F1-OK: 0.925005003772 F1-score multiplied: 0.306684793346 Epoch 15: Test set LL -0.8663359106040257, Acc 0.8651402592658997, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331549334431 F1-OK: 0.925005003772 F1-score multiplied: 0.306684793346 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.85348602430863, Acc 0.8678382635116577, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.351796811673 F1-OK: 0.926417814312 F1-score multiplied: 0.325910833351 Epoch 16: Test set LL -0.8712300499578516, Acc 0.8658046722412109, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3268990418 F1-OK: 0.925473192183 F1-score multiplied: 0.302536299736 Epoch 16: Test set LL -0.8712300499578516, Acc 0.8658046722412109, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3268990418 F1-OK: 0.925473192183 F1-score multiplied: 0.302536299736 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8504341239197578, Acc 0.8688849806785583, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353260869565 F1-OK: 0.927047572339 F1-score multiplied: 0.327489631533 Epoch 17: Test set LL -0.8740710881600381, Acc 0.865029513835907, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326005806719 F1-OK: 0.925005768787 F1-score multiplied: 0.301557251873 Epoch 17: Test set LL -0.8740710881600381, Acc 0.865029513835907, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326005806719 F1-OK: 0.925005768787 F1-score multiplied: 0.301557251873 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.8843770218584842, Acc 0.8626046776771545, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357878475798 F1-OK: 0.923072177668 F1-score multiplied: 0.330347663996 Epoch 18: Test set LL -0.9011762663962072, Acc 0.8599628806114197, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334998685248 F1-OK: 0.921741552172 F1-score multiplied: 0.308782208117 Epoch 18: Test set LL -0.9011762663962072, Acc 0.8599628806114197, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334998685248 F1-OK: 0.921741552172 F1-score multiplied: 0.308782208117 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.8390678236281744, Acc 0.8706478476524353, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345961002786 F1-OK: 0.928226447393 F1-score multiplied: 0.321130152552 Epoch 19: Test set LL -0.8563662248731911, Acc 0.8685179352760315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326478513686 F1-OK: 0.927148050992 F1-score multiplied: 0.302693917655 Epoch 19: Test set LL -0.8563662248731911, Acc 0.8685179352760315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326478513686 F1-OK: 0.927148050992 F1-score multiplied: 0.302693917655 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.8736350082547402, Acc 0.8649735450744629, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.346225660176 F1-OK: 0.924712025802 F1-score multiplied: 0.320159031606 Epoch 20: Test set LL -0.8683805802924741, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334203655352 F1-OK: 0.925416788535 F1-score multiplied: 0.309277673453 Epoch 20: Test set LL -0.8683805802924741, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334203655352 F1-OK: 0.925416788535 F1-score multiplied: 0.309277673453 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.8511847331861103, Acc 0.868278980255127, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.342951360264 F1-OK: 0.926802387877 F1-score multiplied: 0.317848139618 Epoch 21: Test set LL -0.8578430261814485, Acc 0.8677704334259033, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329401853412 F1-OK: 0.926653971374 F1-score multiplied: 0.305241535642 Epoch 21: Test set LL -0.8578430261814485, Acc 0.8677704334259033, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329401853412 F1-OK: 0.926653971374 F1-score multiplied: 0.305241535642 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.838537549689238, Acc 0.8719700574874878, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345720720721 F1-OK: 0.929042501221 F1-score multiplied: 0.321189243102 Epoch 22: Test set LL -0.852460581307511, Acc 0.8682964444160461, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.319748319748 F1-OK: 0.927090198483 F1-score multiplied: 0.29643553322 Epoch 22: Test set LL -0.852460581307511, Acc 0.8682964444160461, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.319748319748 F1-OK: 0.927090198483 F1-score multiplied: 0.29643553322 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.8546767013787598, Acc 0.868278980255127, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.341866226259 F1-OK: 0.926815830553 F1-score multiplied: 0.316847030429 Epoch 23: Test set LL -0.862457337500645, Acc 0.8668844699859619, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325855300056 F1-OK: 0.926151199582 F1-score multiplied: 0.301791277037 Epoch 23: Test set LL -0.862457337500645, Acc 0.8668844699859619, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325855300056 F1-OK: 0.926151199582 F1-score multiplied: 0.301791277037 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.861097672601743, Acc 0.8677831888198853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.337748344371 F1-OK: 0.926560587515 F1-score multiplied: 0.312944304393 Epoch 24: Test set LL -0.8651613554681485, Acc 0.8670782446861267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323516979005 F1-OK: 0.926298337453 F1-score multiplied: 0.29967323979 Epoch 24: Test set LL -0.8651613554681485, Acc 0.8670782446861267, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323516979005 F1-OK: 0.926298337453 F1-score multiplied: 0.29967323979 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.8822906205649657, Acc 0.8621088862419128, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.346304518151 F1-OK: 0.922925327175 F1-score multiplied: 0.319613210717 Epoch 25: Test set LL -0.893102846891756, Acc 0.8607380986213684, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330582911898 F1-OK: 0.922285396453 F1-score multiplied: 0.30489179196 Epoch 25: Test set LL -0.893102846891756, Acc 0.8607380986213684, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330582911898 F1-OK: 0.922285396453 F1-score multiplied: 0.30489179196 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.8734826272926015, Acc 0.8651939034461975, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.365569095152 F1-OK: 0.924584707369 F1-score multiplied: 0.337999594864 Epoch 26: Test set LL -0.9004673641756662, Acc 0.8607934713363647, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334216101695 F1-OK: 0.922270661349 F1-score multiplied: 0.308237705144 Epoch 26: Test set LL -0.9004673641756662, Acc 0.8607934713363647, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334216101695 F1-OK: 0.922270661349 F1-score multiplied: 0.308237705144 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.8817199137054971, Acc 0.8644777536392212, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361370716511 F1-OK: 0.92419573524 F1-score multiplied: 0.33397727504 Epoch 27: Test set LL -0.9024431940099443, Acc 0.8610703349113464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332357637041 F1-OK: 0.922468403325 F1-score multiplied: 0.306589418774 Epoch 27: Test set LL -0.9024431940099443, Acc 0.8610703349113464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332357637041 F1-OK: 0.922468403325 F1-score multiplied: 0.306589418774 [255352 453736 505023 ..., 246196 430507 97061] Epoch 28: \Dev set LL -0.851186493890581, Acc 0.8702071309089661, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353457738749 F1-OK: 0.927862829149 F1-score multiplied: 0.32796029746 Epoch 28: Test set LL -0.8707830359287225, Acc 0.8667183518409729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327089740006 F1-OK: 0.926034048307 F1-score multiplied: 0.302896236097 Epoch 28: Test set LL -0.8707830359287225, Acc 0.8667183518409729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327089740006 F1-OK: 0.926034048307 F1-score multiplied: 0.302896236097 [182829 156731 212271 ..., 262696 534335 194312] Epoch 29: \Dev set LL -0.8595323261856357, Acc 0.8670119047164917, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.347567567568 F1-OK: 0.925960004907 F1-score multiplied: 0.321833666571 Epoch 29: Test set LL -0.8761282444171129, Acc 0.8651402592658997, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325626470995 F1-OK: 0.925078827963 F1-score multiplied: 0.301230154142 Epoch 29: Test set LL -0.8761282444171129, Acc 0.8651402592658997, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325626470995 F1-OK: 0.925078827963 F1-score multiplied: 0.301230154142 [ 63516 229449 556142 ..., 518027 383750 277428] Epoch 30: \Dev set LL -0.8309688772267753, Acc 0.8725759983062744, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.342337219221 F1-OK: 0.929453746912 F1-score multiplied: 0.318186611112 Epoch 30: Test set LL -0.8431051999816814, Acc 0.8706220984458923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320488585139 F1-OK: 0.928504765839 F1-score multiplied: 0.297575178698 Epoch 30: Test set LL -0.8431051999816814, Acc 0.8706220984458923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320488585139 F1-OK: 0.928504765839 F1-score multiplied: 0.297575178698 [457261 283956 219083 ..., 266029 196105 187136] Epoch 31: \Dev set LL -0.8563772791472066, Acc 0.8680035471916199, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34248079034 F1-OK: 0.926638089406 F1-score multiplied: 0.317355745219 Epoch 31: Test set LL -0.8583205911884115, Acc 0.8685733079910278, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326953069616 F1-OK: 0.927176497661 F1-score multiplied: 0.303143201986 Epoch 31: Test set LL -0.8583205911884115, Acc 0.8685733079910278, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326953069616 F1-OK: 0.927176497661 F1-score multiplied: 0.303143201986 [262413 88672 33985 ..., 318723 95762 425717] Epoch 32: \Dev set LL -0.872863705390289, Acc 0.8649735450744629, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354830218479 F1-OK: 0.924596215967 F1-score multiplied: 0.328074677316 Epoch 32: Test set LL -0.886806541526923, Acc 0.8626207709312439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329096809086 F1-OK: 0.923475525123 F1-score multiplied: 0.303912848587 Epoch 32: Test set LL -0.886806541526923, Acc 0.8626207709312439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329096809086 F1-OK: 0.923475525123 F1-score multiplied: 0.303912848587 [251290 383272 991 ..., 526297 101320 365163] Epoch 33: \Dev set LL -0.8608096976635338, Acc 0.8676179051399231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.342184505886 F1-OK: 0.92640347922 F1-score multiplied: 0.317000916787 Epoch 33: Test set LL -0.8683950709389242, Acc 0.8661922812461853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320539856601 F1-OK: 0.925788867562 F1-score multiplied: 0.296752230851 Epoch 33: Test set LL -0.8683950709389242, Acc 0.8661922812461853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320539856601 F1-OK: 0.925788867562 F1-score multiplied: 0.296752230851 [355881 139443 16797 ..., 553960 256872 531958] Epoch 34: \Dev set LL -0.8618024566717369, Acc 0.8671220541000366, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.347755543537 F1-OK: 0.926025884806 F1-score multiplied: 0.3220306349 Epoch 34: Test set LL -0.8729665899383203, Acc 0.8655831813812256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331911380212 F1-OK: 0.925274353173 F1-score multiplied: 0.307109087636 Epoch 34: Test set LL -0.8729665899383203, Acc 0.8655831813812256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331911380212 F1-OK: 0.925274353173 F1-score multiplied: 0.307109087636 [141835 239010 254090 ..., 15612 504913 215719] Epoch 35: \Dev set LL -0.8550876223662841, Acc 0.8677831888198853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35170178282 F1-OK: 0.926384884363 F1-score multiplied: 0.325811215408 Epoch 35: Test set LL -0.8834739966926627, Acc 0.8640050888061523, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326200274348 F1-OK: 0.924370265443 F1-score multiplied: 0.301529834187 Epoch 35: Test set LL -0.8834739966926627, Acc 0.8640050888061523, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326200274348 F1-OK: 0.924370265443 F1-score multiplied: 0.301529834187 [217496 218246 75279 ..., 327762 448278 78427] Epoch 36: \Dev set LL -0.8767576443804268, Acc 0.865689754486084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362780972295 F1-OK: 0.924933801342 F1-score multiplied: 0.335548383759 Epoch 36: Test set LL -0.9044793292239974, Acc 0.8609042167663574, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325275315606 F1-OK: 0.922459562909 F1-score multiplied: 0.300053325459 Epoch 36: Test set LL -0.9044793292239974, Acc 0.8609042167663574, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325275315606 F1-OK: 0.922459562909 F1-score multiplied: 0.300053325459 [398841 208123 485669 ..., 52121 453759 477812] Epoch 37: \Dev set LL -0.8789637177616278, Acc 0.8649184703826904, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.351665785299 F1-OK: 0.924604882849 F1-score multiplied: 0.325151902218 Epoch 37: Test set LL -0.8868919714332325, Acc 0.8646141886711121, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332878581173 F1-OK: 0.924662599371 F1-score multiplied: 0.307800374143 Epoch 37: Test set LL -0.8868919714332325, Acc 0.8646141886711121, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332878581173 F1-OK: 0.924662599371 F1-score multiplied: 0.307800374143 [442506 478532 173682 ..., 35206 362546 523040] Epoch 38: \Dev set LL -0.8371741786628686, Acc 0.8717496991157532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.339387060159 F1-OK: 0.928981086028 F1-score multiplied: 0.31528415973 Epoch 38: Test set LL -0.8526264734546993, Acc 0.8699576258659363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.314406655963 F1-OK: 0.928166149235 F1-score multiplied: 0.291821615159 Epoch 38: Test set LL -0.8526264734546993, Acc 0.8699576258659363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.314406655963 F1-OK: 0.928166149235 F1-score multiplied: 0.291821615159 [282590 352776 441935 ..., 48457 341548 197253] Epoch 39: \Dev set LL -0.8556065742950543, Acc 0.8684993386268616, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35469045688 F1-OK: 0.926790369575 F1-score multiplied: 0.328723699617 Epoch 39: Test set LL -0.8877543304830691, Acc 0.863617479801178, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326681246583 F1-OK: 0.924124333816 F1-score multiplied: 0.301894089369 Epoch 39: Test set LL -0.8877543304830691, Acc 0.863617479801178, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326681246583 F1-OK: 0.924124333816 F1-score multiplied: 0.301894089369 [ 80053 60994 279247 ..., 16715 185116 347150] Epoch 40: \Dev set LL -0.8651086711657021, Acc 0.8672873377799988, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348742903487 F1-OK: 0.926115626438 F1-score multiplied: 0.322976252529 Epoch 40: Test set LL -0.8799649968386661, Acc 0.8654447793960571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329099944782 F1-OK: 0.925223866818 F1-score multiplied: 0.304491123481 Epoch 40: Test set LL -0.8799649968386661, Acc 0.8654447793960571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329099944782 F1-OK: 0.925223866818 F1-score multiplied: 0.304491123481 [216423 451073 217042 ..., 546097 95729 180165] Epoch 41: \Dev set LL -0.8719842209708482, Acc 0.8660202622413635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350427350427 F1-OK: 0.925307125307 F1-score multiplied: 0.324252924253 Epoch 41: Test set LL -0.8961117077331566, Acc 0.8621777892112732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327479059714 F1-OK: 0.923221666975 F1-score multiplied: 0.302335763408 Epoch 41: Test set LL -0.8961117077331566, Acc 0.8621777892112732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327479059714 F1-OK: 0.923221666975 F1-score multiplied: 0.302335763408 [129069 546938 149331 ..., 88907 352839 46273] Epoch 42: \Dev set LL -0.8471956075142387, Acc 0.8703173398971558, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.351157662624 F1-OK: 0.927959358551 F1-score multiplied: 0.325860039359 Epoch 42: Test set LL -0.8663290944246517, Acc 0.8676319718360901, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325384506844 F1-OK: 0.926616629062 F1-score multiplied: 0.30150669488 Epoch 42: Test set LL -0.8663290944246517, Acc 0.8676319718360901, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.325384506844 F1-OK: 0.926616629062 F1-score multiplied: 0.30150669488 [196874 554968 509277 ..., 29502 207947 546993] Epoch 43: \Dev set LL -0.8798509557928278, Acc 0.8646430373191833, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356637863315 F1-OK: 0.924365091581 F1-score multiplied: 0.329663591184 Epoch 43: Test set LL -0.904311527087751, Acc 0.8609595894813538, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330221392371 F1-OK: 0.922428174235 F1-score multiplied: 0.304605516059 Epoch 43: Test set LL -0.904311527087751, Acc 0.8609595894813538, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330221392371 F1-OK: 0.922428174235 F1-score multiplied: 0.304605516059 [171248 192942 534310 ..., 105640 464237 341731] Epoch 44: \Dev set LL -0.8659990769309934, Acc 0.8673975467681885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.338190816607 F1-OK: 0.926317078397 F1-score multiplied: 0.31327192918 Epoch 44: Test set LL -0.8742977600902605, Acc 0.8661922812461853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320730850316 F1-OK: 0.925786588456 F1-score multiplied: 0.296928319727 Epoch 44: Test set LL -0.8742977600902605, Acc 0.8661922812461853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.320730850316 F1-OK: 0.925786588456 F1-score multiplied: 0.296928319727 [341039 94776 61925 ..., 172440 350443 75638] Epoch 45: \Dev set LL -0.8667787116049188, Acc 0.866901695728302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.351583467525 F1-OK: 0.925839523605 F1-score multiplied: 0.325509870081 Epoch 45: Test set LL -0.8821473621906883, Acc 0.8650571703910828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330862163646 F1-OK: 0.924962280999 F1-score multiplied: 0.306035021583 Epoch 45: Test set LL -0.8821473621906883, Acc 0.8650571703910828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330862163646 F1-OK: 0.924962280999 F1-score multiplied: 0.306035021583 [ 8616 406801 335128 ..., 190972 320886 532378] Epoch 46: \Dev set LL -0.8602692551679503, Acc 0.8678933382034302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345881069285 F1-OK: 0.926527360745 F1-score multiplied: 0.320468274257 Epoch 46: Test set LL -0.86708178728004, Acc 0.8675212264060974, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328232486312 F1-OK: 0.926514627966 F1-score multiplied: 0.304112199942 Epoch 46: Test set LL -0.86708178728004, Acc 0.8675212264060974, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328232486312 F1-OK: 0.926514627966 F1-score multiplied: 0.304112199942 [ 7998 158677 35477 ..., 542381 83471 293265] Epoch 47: \Dev set LL -0.8715043250554132, Acc 0.8672873377799988, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.356054530874 F1-OK: 0.926020329822 F1-score multiplied: 0.329713734115 Epoch 47: Test set LL -0.8919689305391703, Acc 0.8633683323860168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328845369237 F1-OK: 0.923942359559 F1-score multiplied: 0.303834166383 Epoch 47: Test set LL -0.8919689305391703, Acc 0.8633683323860168, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328845369237 F1-OK: 0.923942359559 F1-score multiplied: 0.303834166383 [161251 227729 16139 ..., 377658 3473 81891] Epoch 48: \Dev set LL -0.8770859428906611, Acc 0.8653041124343872, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.352660841938 F1-OK: 0.924831678298 F1-score multiplied: 0.32615191832 Epoch 48: Test set LL -0.8945188687057685, Acc 0.8628976345062256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330629899973 F1-OK: 0.9236273905 F1-score multiplied: 0.305378831733 Epoch 48: Test set LL -0.8945188687057685, Acc 0.8628976345062256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330629899973 F1-OK: 0.9236273905 F1-score multiplied: 0.305378831733 [ 51692 486231 454694 ..., 4492 161811 458279] Epoch 49: \Dev set LL -0.8432091394883059, Acc 0.8717496991157532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3375071144 F1-OK: 0.929002744739 F1-score multiplied: 0.313545035646 Epoch 49: Test set LL -0.8461180862382278, Acc 0.8709543347358704, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326152956484 F1-OK: 0.928644693131 F1-score multiplied: 0.302880212188 Epoch 49: Test set LL -0.8461180862382278, Acc 0.8709543347358704, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326152956484 F1-OK: 0.928644693131 F1-score multiplied: 0.302880212188 [183654 343661 354598 ..., 560868 213642 249252] Done!
non-linear SVM 144 - features phrases
F1-BAD: 0.470914127424 F1-OK: 0.908158358711 F1-score multiplied: 0.427664601055
Matern32 - from scratch - is running
Epoch 1: \Dev set LL -0.7600612670433339, Acc 0.8629903197288513, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.320677410544 F1-OK: 0.923812149619 F1-score multiplied: 0.296245687968 Epoch 1: Test set LL -0.7663131367126639, Acc 0.8618455529212952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.29896038213 F1-OK: 0.923372235872 F1-score multiplied: 0.276051716484 Epoch 1: Test set LL -0.7663131367126639, Acc 0.8618455529212952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.29896038213 F1-OK: 0.923372235872 F1-score multiplied: 0.276051716484 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8295193632162415, Acc 0.8585279583930969, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.340862422998 F1-OK: 0.920760306097 F1-score multiplied: 0.313852588937 Epoch 2: Test set LL -0.8447367502182255, Acc 0.8577203154563904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.318706085112 F1-OK: 0.920565731509 F1-score multiplied: 0.293389900378 Epoch 2: Test set LL -0.8447367502182255, Acc 0.8577203154563904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.318706085112 F1-OK: 0.920565731509 F1-score multiplied: 0.293389900378 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.851511828527853, Acc 0.8620537519454956, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.34553058024 F1-OK: 0.922901656506 F1-score multiplied: 0.318890744877 Epoch 3: Test set LL -0.8644127593712881, Acc 0.8604335784912109, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.324172141038 F1-OK: 0.922181571188 F1-score multiplied: 0.298945574358 Epoch 3: Test set LL -0.8644127593712881, Acc 0.8604335784912109, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.324172141038 F1-OK: 0.922181571188 F1-score multiplied: 0.298945574358 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8986892036600203, Acc 0.8567100167274475, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358253145818 F1-OK: 0.919351337943 F1-score multiplied: 0.32936050893 Epoch 4: Test set LL -0.9130718210830389, Acc 0.8542595505714417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336191677175 F1-OK: 0.918143932326 F1-score multiplied: 0.308672348497 Epoch 4: Test set LL -0.9130718210830389, Acc 0.8542595505714417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336191677175 F1-OK: 0.918143932326 F1-score multiplied: 0.308672348497 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8720409471733401, Acc 0.8632657527923584, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357327809425 F1-OK: 0.923494235867 F1-score multiplied: 0.329990172319 Epoch 5: Test set LL -0.8823027544197822, Acc 0.8610149621963501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335275423729 F1-OK: 0.922394335714 F1-score multiplied: 0.309256151752 Epoch 5: Test set LL -0.8823027544197822, Acc 0.8610149621963501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335275423729 F1-OK: 0.922394335714 F1-score multiplied: 0.309256151752 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8978000249354909, Acc 0.8579770922660828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359343936382 F1-OK: 0.920136307311 F1-score multiplied: 0.330645402677 Epoch 6: Test set LL -0.9223974764202325, Acc 0.8551731705665588, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340602546325 F1-OK: 0.918653292901 F1-score multiplied: 0.312895650752 Epoch 6: Test set LL -0.9223974764202325, Acc 0.8551731705665588, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340602546325 F1-OK: 0.918653292901 F1-score multiplied: 0.312895650752 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9132106268759952, Acc 0.8582525253295898, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360745341615 F1-OK: 0.920288732613 F1-score multiplied: 0.331989873231 Epoch 7: Test set LL -0.9203520451496062, Acc 0.8567789793014526, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341606211022 F1-OK: 0.919650207359 F1-score multiplied: 0.314158222802 Epoch 7: Test set LL -0.9203520451496062, Acc 0.8567789793014526, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341606211022 F1-OK: 0.919650207359 F1-score multiplied: 0.314158222802 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8479143596956776, Acc 0.8681687712669373, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361696452387 F1-OK: 0.926493626171 F1-score multiplied: 0.335109457746 Epoch 8: Test set LL -0.8748424899740053, Acc 0.8632852435112, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33324331623 F1-OK: 0.923833909181 F1-score multiplied: 0.307861475541 Epoch 8: Test set LL -0.8748424899740053, Acc 0.8632852435112, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33324331623 F1-OK: 0.923833909181 F1-score multiplied: 0.307861475541 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8955492501023802, Acc 0.8610621690750122, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.366331658291 F1-OK: 0.921977478035 F1-score multiplied: 0.337749538436 Epoch 9: Test set LL -0.9150086000617443, Acc 0.8575541973114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340130819546 F1-OK: 0.920159525768 F1-score multiplied: 0.312974613612 Epoch 9: Test set LL -0.9150086000617443, Acc 0.8575541973114014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340130819546 F1-OK: 0.920159525768 F1-score multiplied: 0.312974613612 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.8980651582349978, Acc 0.8604010343551636, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363955823293 F1-OK: 0.921596534653 F1-score multiplied: 0.335420425514 Epoch 10: Test set LL -0.9169360237429011, Acc 0.857498824596405, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335098824441 F1-OK: 0.920197838659 F1-score multiplied: 0.308357213988 Epoch 10: Test set LL -0.9169360237429011, Acc 0.857498824596405, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335098824441 F1-OK: 0.920197838659 F1-score multiplied: 0.308357213988 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8265513774616692, Acc 0.8726311326026917, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.350196739741 F1-OK: 0.929395956758 F1-score multiplied: 0.325471433986 Epoch 11: Test set LL -0.8458097370597085, Acc 0.8694592714309692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321875449446 F1-OK: 0.927778203263 F1-score multiplied: 0.298629026162 Epoch 11: Test set LL -0.8458097370597085, Acc 0.8694592714309692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321875449446 F1-OK: 0.927778203263 F1-score multiplied: 0.298629026162 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.8600977304920372, Acc 0.8675076961517334, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358837643295 F1-OK: 0.926120480447 F1-score multiplied: 0.332326890611 Epoch 12: Test set LL -0.8791235761786088, Acc 0.8646695613861084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332969432314 F1-OK: 0.924695732553 F1-score multiplied: 0.307895413132 Epoch 12: Test set LL -0.8791235761786088, Acc 0.8646695613861084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332969432314 F1-OK: 0.924695732553 F1-score multiplied: 0.307895413132 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.8641496734273716, Acc 0.866075336933136, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362778505898 F1-OK: 0.925174674505 F1-score multiplied: 0.335633486111 Epoch 13: Test set LL -0.885336883477846, Acc 0.8624546527862549, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335651243648 F1-OK: 0.923285978999 F1-score multiplied: 0.309902087094 Epoch 13: Test set LL -0.885336883477846, Acc 0.8624546527862549, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335651243648 F1-OK: 0.923285978999 F1-score multiplied: 0.309902087094 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.8482854807438742, Acc 0.8686646223068237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362225789192 F1-OK: 0.92679481668 F1-score multiplied: 0.335708983891 Epoch 14: Test set LL -0.8715469951071305, Acc 0.8647803068161011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335690968444 F1-OK: 0.92472952563 F1-score multiplied: 0.310423350007 Epoch 14: Test set LL -0.8715469951071305, Acc 0.8647803068161011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335690968444 F1-OK: 0.92472952563 F1-score multiplied: 0.310423350007 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8366157240073182, Acc 0.8705927729606628, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.347318699639 F1-OK: 0.928176119859 F1-score multiplied: 0.322372922985 Epoch 15: Test set LL -0.8483159146972387, Acc 0.8686286807060242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329896907216 F1-OK: 0.927175898215 F1-score multiplied: 0.305872461267 Epoch 15: Test set LL -0.8483159146972387, Acc 0.8686286807060242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.329896907216 F1-OK: 0.927175898215 F1-score multiplied: 0.305872461267 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8647994270783456, Acc 0.8670119047164917, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.36036036036 F1-OK: 0.925791577006 F1-score multiplied: 0.333618586308 Epoch 16: Test set LL -0.8856091037881609, Acc 0.8638113141059875, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334100446731 F1-OK: 0.924149203559 F1-score multiplied: 0.308758661755 Epoch 16: Test set LL -0.8856091037881609, Acc 0.8638113141059875, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334100446731 F1-OK: 0.924149203559 F1-score multiplied: 0.308758661755 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8710969433358133, Acc 0.8659651875495911, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.357878068092 F1-OK: 0.925172997078 F1-score multiplied: 0.331099124845 Epoch 17: Test set LL -0.8809139581437271, Acc 0.8642542958259583, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333740997418 F1-OK: 0.924428551611 F1-score multiplied: 0.308519706857 Epoch 17: Test set LL -0.8809139581437271, Acc 0.8642542958259583, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333740997418 F1-OK: 0.924428551611 F1-score multiplied: 0.308519706857 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.828424434260093, Acc 0.8729616403579712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.346742209632 F1-OK: 0.929639348264 F1-score multiplied: 0.322345201778 Epoch 18: Test set LL -0.8469623565141474, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321845710166 F1-OK: 0.927981869133 F1-score multiplied: 0.298666983692 Epoch 18: Test set LL -0.8469623565141474, Acc 0.8697915077209473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321845710166 F1-OK: 0.927981869133 F1-score multiplied: 0.298666983692 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.8951000212964998, Acc 0.861833393573761, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364097363083 F1-OK: 0.922496909765 F1-score multiplied: 0.335878692298 Epoch 19: Test set LL -0.9162704568983743, Acc 0.8586339354515076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340310077519 F1-OK: 0.920834754566 F1-score multiplied: 0.313369346709 Epoch 19: Test set LL -0.9162704568983743, Acc 0.8586339354515076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340310077519 F1-OK: 0.920834754566 F1-score multiplied: 0.313369346709 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.8970323807632937, Acc 0.8611723184585571, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364278506559 F1-OK: 0.922077922078 F1-score multiplied: 0.335893168386 Epoch 20: Test set LL -0.9145123220113444, Acc 0.8580802083015442, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.338239091144 F1-OK: 0.92051727346 F1-score multiplied: 0.311354925957 Epoch 20: Test set LL -0.9145123220113444, Acc 0.8580802083015442, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.338239091144 F1-OK: 0.92051727346 F1-score multiplied: 0.311354925957 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.8749398045907385, Acc 0.8655244708061218, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.368107688325 F1-OK: 0.924755710367 F1-score multiplied: 0.340409686808 Epoch 21: Test set LL -0.8965610388101142, Acc 0.861264169216156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.344024086922 F1-OK: 0.92242913977 F1-score multiplied: 0.31733784256 Epoch 21: Test set LL -0.8965610388101142, Acc 0.861264169216156, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.344024086922 F1-OK: 0.92242913977 F1-score multiplied: 0.31733784256 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.8490414167090229, Acc 0.8692154884338379, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355241716458 F1-OK: 0.927227024707 F1-score multiplied: 0.329389719804 Epoch 22: Test set LL -0.8619639900899428, Acc 0.867133617401123, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335042261327 F1-OK: 0.926193076083 F1-score multiplied: 0.310313822637 Epoch 22: Test set LL -0.8619639900899428, Acc 0.867133617401123, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335042261327 F1-OK: 0.926193076083 F1-score multiplied: 0.310313822637 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.8509249281091458, Acc 0.8695460557937622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.354768392371 F1-OK: 0.927437641723 F1-score multiplied: 0.329025561178 Epoch 23: Test set LL -0.8678055718149037, Acc 0.8674658536911011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333379752124 F1-OK: 0.926418371582 F1-score multiplied: 0.308849127081 Epoch 23: Test set LL -0.8678055718149037, Acc 0.8674658536911011, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333379752124 F1-OK: 0.926418371582 F1-score multiplied: 0.308849127081 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.8683267726227446, Acc 0.8662406206130981, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.370331950207 F1-OK: 0.925172583826 F1-score multiplied: 0.342620967247 Epoch 24: Test set LL -0.885551022926278, Acc 0.8632575869560242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346606694007 F1-OK: 0.923638275174 F1-score multiplied: 0.320139209017 Epoch 24: Test set LL -0.885551022926278, Acc 0.8632575869560242, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346606694007 F1-OK: 0.923638275174 F1-score multiplied: 0.320139209017 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.8363142839622355, Acc 0.8712538480758667, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359199341925 F1-OK: 0.928438007165 F1-score multiplied: 0.333494321192 Epoch 25: Test set LL -0.8707506115261303, Acc 0.866136908531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331166136395 F1-OK: 0.925625682598 F1-score multiplied: 0.306535881054 Epoch 25: Test set LL -0.8707506115261303, Acc 0.866136908531189, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331166136395 F1-OK: 0.925625682598 F1-score multiplied: 0.306535881054 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.8209710997386421, Acc 0.8745592832565308, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.340191248913 F1-OK: 0.930691261072 F1-score multiplied: 0.316613022457 Epoch 26: Test set LL -0.8368730579933853, Acc 0.8727262616157532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326446886447 F1-OK: 0.929723449467 F1-score multiplied: 0.303505325335 Epoch 26: Test set LL -0.8368730579933853, Acc 0.8727262616157532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326446886447 F1-OK: 0.929723449467 F1-score multiplied: 0.303505325335 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.8656881629048856, Acc 0.8664059042930603, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364351245085 F1-OK: 0.925359352396 F1-score multiplied: 0.337155832197 Epoch 27: Test set LL -0.8846793490026176, Acc 0.8632298707962036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339572192513 F1-OK: 0.923715988758 F1-score multiplied: 0.313668263562 Epoch 27: Test set LL -0.8846793490026176, Acc 0.8632298707962036, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339572192513 F1-OK: 0.923715988758 F1-score multiplied: 0.313668263562 [255352 453736 505023 ..., 246196 430507 97061] Epoch 28: \Dev set LL -0.845021220784309, Acc 0.8698214888572693, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355955301172 F1-OK: 0.92759307492 F1-score multiplied: 0.330181672348 Epoch 28: Test set LL -0.8732674498660018, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328668421782 F1-OK: 0.925485612341 F1-score multiplied: 0.30417789559 Epoch 28: Test set LL -0.8732674498660018, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328668421782 F1-OK: 0.925485612341 F1-score multiplied: 0.30417789559 [182829 156731 212271 ..., 262696 534335 194312] Epoch 29: \Dev set LL -0.8499722449900703, Acc 0.8690502643585205, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364608393478 F1-OK: 0.92700304026 F1-score multiplied: 0.337993089258 Epoch 29: Test set LL -0.8918939121542987, Acc 0.8626761436462402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334406870639 F1-OK: 0.923440249437 F1-score multiplied: 0.308804764036 Epoch 29: Test set LL -0.8918939121542987, Acc 0.8626761436462402, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334406870639 F1-OK: 0.923440249437 F1-score multiplied: 0.308804764036 [ 63516 229449 556142 ..., 518027 383750 277428] Epoch 30: \Dev set LL -0.8369774887328837, Acc 0.8718598484992981, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35567867036 F1-OK: 0.928855447483 F1-score multiplied: 0.330374070517 Epoch 30: Test set LL -0.8596097430934042, Acc 0.8688501715660095, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331026691145 F1-OK: 0.927298678576 F1-score multiplied: 0.306960613273 Epoch 30: Test set LL -0.8596097430934042, Acc 0.8688501715660095, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331026691145 F1-OK: 0.927298678576 F1-score multiplied: 0.306960613273 [457261 283956 219083 ..., 266029 196105 187136] Epoch 31: \Dev set LL -0.8243157663967364, Acc 0.8738982081413269, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.348420153715 F1-OK: 0.93019426062 F1-score multiplied: 0.32409842727 Epoch 31: Test set LL -0.8489998310530708, Acc 0.8699853420257568, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323927440253 F1-OK: 0.92807694664 F1-score multiplied: 0.300629589683 Epoch 31: Test set LL -0.8489998310530708, Acc 0.8699853420257568, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323927440253 F1-OK: 0.92807694664 F1-score multiplied: 0.300629589683 [262413 88672 33985 ..., 318723 95762 425717]
RBF from scratch
Epoch 1: \Dev set LL -0.8325751485696179, Acc 0.854175865650177, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.328683743343 F1-OK: 0.918204011001 F1-score multiplied: 0.301798731488 Epoch 1: Test set LL -0.8430690542895629, Acc 0.853069007396698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303451896574 F1-OK: 0.917872452375 F1-score multiplied: 0.278530136486 Epoch 1: Test set LL -0.8430690542895629, Acc 0.853069007396698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303451896574 F1-OK: 0.917872452375 F1-score multiplied: 0.278530136486 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8803735124944514, Acc 0.855387806892395, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.337957124842 F1-OK: 0.918828658895 F1-score multiplied: 0.310524691783 Epoch 2: Test set LL -0.886307469706844, Acc 0.8545086979866028, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.319035894778 F1-OK: 0.918553649199 F1-score multiplied: 0.293051585374 Epoch 2: Test set LL -0.886307469706844, Acc 0.8545086979866028, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.319035894778 F1-OK: 0.918553649199 F1-score multiplied: 0.293051585374 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8970663351874332, Acc 0.8558836579322815, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.343702960361 F1-OK: 0.919054396931 F1-score multiplied: 0.315881716958 Epoch 3: Test set LL -0.9056775954193003, Acc 0.8548686504364014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.322213602276 F1-OK: 0.91873372194 F1-score multiplied: 0.296028502078 Epoch 3: Test set LL -0.9056775954193003, Acc 0.8548686504364014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.322213602276 F1-OK: 0.91873372194 F1-score multiplied: 0.296028502078 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.9596465701805911, Acc 0.8467386364936829, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364550022841 F1-OK: 0.912860991042 F1-score multiplied: 0.332783495135 Epoch 4: Test set LL -0.9732447409384548, Acc 0.8446246981620789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337895233601 F1-OK: 0.911985194944 F1-score multiplied: 0.308155450486 Epoch 4: Test set LL -0.9732447409384548, Acc 0.8446246981620789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337895233601 F1-OK: 0.911985194944 F1-score multiplied: 0.308155450486 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -1.0158520403392337, Acc 0.8378140330314636, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.36688172043 F1-OK: 0.906994376698 F1-score multiplied: 0.332759657343 Epoch 5: Test set LL -1.0376177732744307, Acc 0.8340762257575989, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343951833607 F1-OK: 0.905028287086 F1-score multiplied: 0.31128613881 Epoch 5: Test set LL -1.0376177732744307, Acc 0.8340762257575989, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343951833607 F1-OK: 0.905028287086 F1-score multiplied: 0.31128613881 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8933840137052824, Acc 0.8581974506378174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362871287129 F1-OK: 0.920220679395 F1-score multiplied: 0.333921662375 Epoch 6: Test set LL -0.9221218476955799, Acc 0.8536504507064819, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330716637123 F1-OK: 0.9178427106 F1-score multiplied: 0.303545854658 Epoch 6: Test set LL -0.9221218476955799, Acc 0.8536504507064819, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.330716637123 F1-OK: 0.9178427106 F1-score multiplied: 0.303545854658 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9103574366038855, Acc 0.8595746755599976, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.365762627519 F1-OK: 0.921046925817 F1-score multiplied: 0.336884543655 Epoch 7: Test set LL -0.9183728061790976, Acc 0.8572496175765991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342514664626 F1-OK: 0.919932915088 F1-score multiplied: 0.31509051389 Epoch 7: Test set LL -0.9183728061790976, Acc 0.8572496175765991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342514664626 F1-OK: 0.919932915088 F1-score multiplied: 0.31509051389 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8775799832065797, Acc 0.8648082613945007, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.355228586442 F1-OK: 0.924487660779 F1-score multiplied: 0.328404444922 Epoch 8: Test set LL -0.9069402792986716, Acc 0.8605719804763794, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323481998925 F1-OK: 0.92227675402 F1-score multiplied: 0.298339927953 Epoch 8: Test set LL -0.9069402792986716, Acc 0.8605719804763794, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.323481998925 F1-OK: 0.92227675402 F1-score multiplied: 0.298339927953 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.9496920871320935, Acc 0.8523027896881104, Outputs [1 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.365443786982 F1-OK: 0.916425075595 F1-score multiplied: 0.334901850111 Epoch 9: Test set LL -0.9715604114033501, Acc 0.8492206335067749, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339398350315 F1-OK: 0.914898271713 F1-score multiplied: 0.310514964126 Epoch 9: Test set LL -0.9715604114033501, Acc 0.8492206335067749, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339398350315 F1-OK: 0.914898271713 F1-score multiplied: 0.310514964126 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.857901480351267, Acc 0.8673424124717712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362288135593 F1-OK: 0.925971470733 F1-score multiplied: 0.335468477744 Epoch 10: Test set LL -0.8797860655564841, Acc 0.8646695613861084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326536235878 F1-OK: 0.924776854417 F1-score multiplied: 0.301973153068 Epoch 10: Test set LL -0.8797860655564841, Acc 0.8646695613861084, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326536235878 F1-OK: 0.924776854417 F1-score multiplied: 0.301973153068 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9010829759105966, Acc 0.8596848845481873, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364996260284 F1-OK: 0.921128417923 F1-score multiplied: 0.336208427784 Epoch 11: Test set LL -0.9301613991596643, Acc 0.8564467430114746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335171175792 F1-OK: 0.919536305653 F1-score multiplied: 0.308202064749 Epoch 11: Test set LL -0.9301613991596643, Acc 0.8564467430114746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335171175792 F1-OK: 0.919536305653 F1-score multiplied: 0.308202064749 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9057434176191915, Acc 0.8603459596633911, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362905252576 F1-OK: 0.921577726218 F1-score multiplied: 0.334445397502 Epoch 12: Test set LL -0.9229012610756402, Acc 0.8581632971763611, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33614098743 F1-OK: 0.920599494738 F1-score multiplied: 0.309451223189 Epoch 12: Test set LL -0.9229012610756402, Acc 0.8581632971763611, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33614098743 F1-OK: 0.920599494738 F1-score multiplied: 0.309451223189 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9681933448329654, Acc 0.8496584296226501, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.376228571429 F1-OK: 0.914529111466 F1-score multiplied: 0.344071981137 Epoch 13: Test set LL -0.9936457980367247, Acc 0.8459259867668152, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343672602901 F1-OK: 0.912718204489 F1-score multiplied: 0.313676241052 Epoch 13: Test set LL -0.9936457980367247, Acc 0.8459259867668152, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343672602901 F1-OK: 0.912718204489 F1-score multiplied: 0.313676241052 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9006007058849282, Acc 0.8619986772537231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375467464473 F1-OK: 0.922429009383 F1-score multiplied: 0.346342081309 Epoch 14: Test set LL -0.9351037701904641, Acc 0.8568066954612732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33573079887 F1-OK: 0.91975423571 F1-score multiplied: 0.308789824319 Epoch 14: Test set LL -0.9351037701904641, Acc 0.8568066954612732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33573079887 F1-OK: 0.91975423571 F1-score multiplied: 0.308789824319 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.900113134725546, Acc 0.8631004691123962, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364937388193 F1-OK: 0.923281158346 F1-score multiplied: 0.336939814495 Epoch 15: Test set LL -0.9153587211674475, Acc 0.8599352240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331792365606 F1-OK: 0.921768444493 F1-score multiplied: 0.305835732739 Epoch 15: Test set LL -0.9153587211674475, Acc 0.8599352240562439, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331792365606 F1-OK: 0.921768444493 F1-score multiplied: 0.305835732739 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8854372507090673, Acc 0.8641471862792969, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362790697674 F1-OK: 0.923968674847 F1-score multiplied: 0.335207240177 Epoch 16: Test set LL -0.9094986902720206, Acc 0.8614579439163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328862660944 F1-OK: 0.9227563212 F1-score multiplied: 0.303460099193 Epoch 16: Test set LL -0.9094986902720206, Acc 0.8614579439163208, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.328862660944 F1-OK: 0.9227563212 F1-score multiplied: 0.303460099193 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.9274209244916032, Acc 0.8578118085861206, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.375514154367 F1-OK: 0.919772465885 F1-score multiplied: 0.345387579737 Epoch 17: Test set LL -0.9564519038087135, Acc 0.8545086979866028, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339409176618 F1-OK: 0.918252103978 F1-score multiplied: 0.311663190539 Epoch 17: Test set LL -0.9564519038087135, Acc 0.8545086979866028, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339409176618 F1-OK: 0.918252103978 F1-score multiplied: 0.311663190539 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9076177137820111, Acc 0.8591890931129456, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.371681415929 F1-OK: 0.92070976548 F1-score multiplied: 0.342210709293 Epoch 18: Test set LL -0.9364906531998167, Acc 0.8559483885765076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340808311162 F1-OK: 0.919139016241 F1-score multiplied: 0.313250215848 Epoch 18: Test set LL -0.9364906531998167, Acc 0.8559483885765076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340808311162 F1-OK: 0.919139016241 F1-score multiplied: 0.313250215848 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.883687799229513, Acc 0.864863395690918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374394287172 F1-OK: 0.924250378285 F1-score multiplied: 0.346034061546 Epoch 19: Test set LL -0.9233859169209521, Acc 0.8592153787612915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336248531523 F1-OK: 0.921256794215 F1-score multiplied: 0.309771244211 Epoch 19: Test set LL -0.9233859169209521, Acc 0.8592153787612915, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336248531523 F1-OK: 0.921256794215 F1-score multiplied: 0.309771244211 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.8735810224914828, Acc 0.8658549785614014, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.37031290406 F1-OK: 0.924931405494 F1-score multiplied: 0.342514034825 Epoch 20: Test set LL -0.9129828024814888, Acc 0.8611810803413391, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332534611289 F1-OK: 0.922534993666 F1-score multiplied: 0.306774815519 Epoch 20: Test set LL -0.9129828024814888, Acc 0.8611810803413391, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332534611289 F1-OK: 0.922534993666 F1-score multiplied: 0.306774815519 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.9219593986261788, Acc 0.8585830926895142, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.378600823045 F1-OK: 0.920212600628 F1-score multiplied: 0.348393247974 Epoch 21: Test set LL -0.9566884747372834, Acc 0.8537611961364746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343361511686 F1-OK: 0.917718166807 F1-score multiplied: 0.315109097056 Epoch 21: Test set LL -0.9566884747372834, Acc 0.8537611961364746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343361511686 F1-OK: 0.917718166807 F1-score multiplied: 0.315109097056 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.8409430960889221, Acc 0.8714191317558289, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.360898138007 F1-OK: 0.928518926865 F1-score multiplied: 0.335100751809 Epoch 22: Test set LL -0.8685528274001192, Acc 0.868545651435852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333894500561 F1-OK: 0.927077253878 F1-score multiplied: 0.309545996665 Epoch 22: Test set LL -0.8685528274001192, Acc 0.868545651435852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.333894500561 F1-OK: 0.927077253878 F1-score multiplied: 0.309545996665 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.9106917353400005, Acc 0.8613926768302917, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.374129353234 F1-OK: 0.922066658407 F1-score multiplied: 0.344972202548 Epoch 23: Test set LL -0.9358792168607819, Acc 0.8577203154563904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337843061461 F1-OK: 0.920297160228 F1-score multiplied: 0.310916010065 Epoch 23: Test set LL -0.9358792168607819, Acc 0.8577203154563904, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337843061461 F1-OK: 0.920297160228 F1-score multiplied: 0.310916010065 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.8318947637745995, Acc 0.8743939995765686, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.353007945516 F1-OK: 0.930445393533 F1-score multiplied: 0.328454616786 Epoch 24: Test set LL -0.8455821516227868, Acc 0.8723386526107788, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326763031099 F1-OK: 0.929483552279 F1-score multiplied: 0.3037208629 Epoch 24: Test set LL -0.8455821516227868, Acc 0.8723386526107788, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326763031099 F1-OK: 0.929483552279 F1-score multiplied: 0.3037208629 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.8712048586216974, Acc 0.8676179051399231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.359370834444 F1-OK: 0.926181918717 F1-score multiplied: 0.332842768976 Epoch 25: Test set LL -0.8800900481577787, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33589884552 F1-OK: 0.925618053631 F1-score multiplied: 0.310914035607 Epoch 25: Test set LL -0.8800900481577787, Acc 0.8662199974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33589884552 F1-OK: 0.925618053631 F1-score multiplied: 0.310914035607 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.909284783644064, Acc 0.8617232441902161, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.373126873127 F1-OK: 0.922291021672 F1-score multiplied: 0.344131565029 Epoch 26: Test set LL -0.9337305996677518, Acc 0.8574434518814087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.34181260386 F1-OK: 0.920065202204 F1-score multiplied: 0.314489882487 Epoch 26: Test set LL -0.9337305996677518, Acc 0.8574434518814087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.34181260386 F1-OK: 0.920065202204 F1-score multiplied: 0.314489882487 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.8594463362990077, Acc 0.8692706227302551, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358128212064 F1-OK: 0.927224215659 F1-score multiplied: 0.332065150536 Epoch 27: Test set LL -0.8746163815770984, Acc 0.8665522336959839, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326627549595 F1-OK: 0.925937307929 F1-score multiplied: 0.302436633967 Epoch 27: Test set LL -0.8746163815770984, Acc 0.8665522336959839, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.326627549595 F1-OK: 0.925937307929 F1-score multiplied: 0.302436633967 [255352 453736 505023 ..., 246196 430507 97061] Epoch 28: \Dev set LL -0.8837777471194316, Acc 0.8649735450744629, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362548764629 F1-OK: 0.924489355803 F1-score multiplied: 0.335172473859 Epoch 28: Test set LL -0.8956584807990668, Acc 0.8639220595359802, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339115234638 F1-OK: 0.924152405055 F1-score multiplied: 0.313394159681 Epoch 28: Test set LL -0.8956584807990668, Acc 0.8639220595359802, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339115234638 F1-OK: 0.924152405055 F1-score multiplied: 0.313394159681 [182829 156731 212271 ..., 262696 534335 194312] Epoch 29: \Dev set LL -0.8946453108751248, Acc 0.8632106781005859, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.367388535032 F1-OK: 0.923314493962 F1-score multiplied: 0.33921515931 Epoch 29: Test set LL -0.9132002638585558, Acc 0.8609595894813538, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336591809775 F1-OK: 0.922341807385 F1-score multiplied: 0.310452698179 Epoch 29: Test set LL -0.9132002638585558, Acc 0.8609595894813538, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336591809775 F1-OK: 0.922341807385 F1-score multiplied: 0.310452698179 [ 63516 229449 556142 ..., 518027 383750 277428] Epoch 30: \Dev set LL -0.8665015368751906, Acc 0.8683340549468994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.366047745358 F1-OK: 0.926538390607 F1-score multiplied: 0.339157288869 Epoch 30: Test set LL -0.8963720960317691, Acc 0.8644204139709473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335278946654 F1-OK: 0.924511723266 F1-score multiplied: 0.309969316746 Epoch 30: Test set LL -0.8963720960317691, Acc 0.8644204139709473, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335278946654 F1-OK: 0.924511723266 F1-score multiplied: 0.309969316746 [457261 283956 219083 ..., 266029 196105 187136] Epoch 31: \Dev set LL -0.8777485677502005, Acc 0.8661304712295532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.364871928907 F1-OK: 0.925180121929 F1-score multiplied: 0.337572255675 Epoch 31: Test set LL -0.9097188299955317, Acc 0.8618178963661194, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332307692308 F1-OK: 0.922934391551 F1-score multiplied: 0.306698197808 Epoch 31: Test set LL -0.9097188299955317, Acc 0.8618178963661194, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332307692308 F1-OK: 0.922934391551 F1-score multiplied: 0.306698197808 [262413 88672 33985 ..., 318723 95762 425717] Epoch 32: \Dev set LL -0.8678199093820603, Acc 0.8680035471916199, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.366807610994 F1-OK: 0.926322263223 F1-score multiplied: 0.339782056383 Epoch 32: Test set LL -0.8990915636632816, Acc 0.8635344505310059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331298331298 F1-OK: 0.924013751214 F1-score multiplied: 0.306124213874 Epoch 32: Test set LL -0.8990915636632816, Acc 0.8635344505310059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331298331298 F1-OK: 0.924013751214 F1-score multiplied: 0.306124213874 [251290 383272 991 ..., 526297 101320 365163] Epoch 33: \Dev set LL -0.834428194879932, Acc 0.8737879991531372, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.35591790835 F1-OK: 0.930039392921 F1-score multiplied: 0.331017675411 Epoch 33: Test set LL -0.8591670564755501, Acc 0.8698192238807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321696480092 F1-OK: 0.928000490001 F1-score multiplied: 0.298534491157 Epoch 33: Test set LL -0.8591670564755501, Acc 0.8698192238807678, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.321696480092 F1-OK: 0.928000490001 F1-score multiplied: 0.298534491157 [355881 139443 16797 ..., 553960 256872 531958] Epoch 34: \Dev set LL -0.897996153959073, Acc 0.8636513948440552, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.369426751592 F1-OK: 0.923561567683 F1-score multiplied: 0.341188349845 Epoch 34: Test set LL -0.9299878775019674, Acc 0.8594091534614563, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33966189857 F1-OK: 0.921329863048 F1-score multiplied: 0.312940650492 Epoch 34: Test set LL -0.9299878775019674, Acc 0.8594091534614563, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.33966189857 F1-OK: 0.921329863048 F1-score multiplied: 0.312940650492 [141835 239010 254090 ..., 15612 504913 215719] Epoch 35: \Dev set LL -0.9026395753221597, Acc 0.8621639609336853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.369773299748 F1-OK: 0.922620152162 F1-score multiplied: 0.341160298079 Epoch 35: Test set LL -0.9305486277973422, Acc 0.8587446808815002, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339632410044 F1-OK: 0.920913938492 F1-score multiplied: 0.312772220373 Epoch 35: Test set LL -0.9305486277973422, Acc 0.8587446808815002, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339632410044 F1-OK: 0.920913938492 F1-score multiplied: 0.312772220373 [217496 218246 75279 ..., 327762 448278 78427] Epoch 36: \Dev set LL -0.8762919344287929, Acc 0.8670669794082642, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361809045226 F1-OK: 0.925806352428 F1-score multiplied: 0.334965112436 Epoch 36: Test set LL -0.8886346933702172, Acc 0.865361750125885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339894122438 F1-OK: 0.92503584036 F1-score multiplied: 0.314414245183 Epoch 36: Test set LL -0.8886346933702172, Acc 0.865361750125885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.339894122438 F1-OK: 0.92503584036 F1-score multiplied: 0.314414245183 [398841 208123 485669 ..., 52121 453759 477812] Epoch 37: \Dev set LL -0.8649347415889838, Acc 0.8692154884338379, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.369957537155 F1-OK: 0.927034669289 F1-score multiplied: 0.342963463108 Epoch 37: Test set LL -0.8882809972476676, Acc 0.8656108975410461, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332324621733 F1-OK: 0.925286294791 F1-score multiplied: 0.307495417911 Epoch 37: Test set LL -0.8882809972476676, Acc 0.8656108975410461, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.332324621733 F1-OK: 0.925286294791 F1-score multiplied: 0.307495417911 [442506 478532 173682 ..., 35206 362546 523040] Epoch 38: \Dev set LL -0.8598762122187998, Acc 0.8704274892807007, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.361563517915 F1-OK: 0.927896995708 F1-score multiplied: 0.335493702031 Epoch 38: Test set LL -0.8734773385067441, Acc 0.8683518171310425, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334499650105 F1-OK: 0.926950670579 F1-score multiplied: 0.310064674973 Epoch 38: Test set LL -0.8734773385067441, Acc 0.8683518171310425, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334499650105 F1-OK: 0.926950670579 F1-score multiplied: 0.310064674973 [282590 352776 441935 ..., 48457 341548 197253] Epoch 39: \Dev set LL -0.8827891552107469, Acc 0.8666813373565674, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.365828092243 F1-OK: 0.925510957892 F1-score multiplied: 0.338577908076 Epoch 39: Test set LL -0.9002958353048751, Acc 0.8637559413909912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335987046283 F1-OK: 0.924090271029 F1-score multiplied: 0.310482360661 Epoch 39: Test set LL -0.9002958353048751, Acc 0.8637559413909912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.335987046283 F1-OK: 0.924090271029 F1-score multiplied: 0.310482360661 [ 80053 60994 279247 ..., 16715 185116 347150] Epoch 40: \Dev set LL -0.8534832665023355, Acc 0.8711436986923218, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.362843911741 F1-OK: 0.928324089112 F1-score multiplied: 0.336836743857 Epoch 40: Test set LL -0.8722367306687603, Acc 0.8679919242858887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334264172019 F1-OK: 0.926731821255 F1-score multiplied: 0.309773244916 Epoch 40: Test set LL -0.8722367306687603, Acc 0.8679919242858887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.334264172019 F1-OK: 0.926731821255 F1-score multiplied: 0.309773244916 [216423 451073 217042 ..., 546097 95729 180165] Epoch 41: \Dev set LL -0.8609867187377798, Acc 0.8687747716903687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.367498672331 F1-OK: 0.926793287848 F1-score multiplied: 0.34059530281 Epoch 41: Test set LL -0.8817685368231253, Acc 0.8659985065460205, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340419732897 F1-OK: 0.925423728814 F1-score multiplied: 0.315032498579 Epoch 41: Test set LL -0.8817685368231253, Acc 0.8659985065460205, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340419732897 F1-OK: 0.925423728814 F1-score multiplied: 0.315032498579 [129069 546938 149331 ..., 88907 352839 46273]
deeper network - compare to the baseline - -512-256-17-17-
Using TensorFlow backend. 567552 36119 36119 18152 2018-03-15 11:52:48.628811: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA epoch: 0 [491470 260968 489770 ..., 43269 414732 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.366344943349 F1-OK: 0.90424250111 F1-score multiplied: 0.331264667843 Result from the previous epoch on test: F1-BAD: 0.346740638003 F1-OK: 0.902600811262 F1-score multiplied: 0.312968381159 Result from the previous epoch on test: F1-BAD: 0.346740638003 F1-OK: 0.902600811262 F1-score multiplied: 0.312968381159 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.381156316916 F1-OK: 0.908642599734 F1-score multiplied: 0.346334866708 Result from the previous epoch on test: F1-BAD: 0.349627356423 F1-OK: 0.905979655861 F1-score multiplied: 0.316755272051 Result from the previous epoch on test: F1-BAD: 0.349627356423 F1-OK: 0.905979655861 F1-score multiplied: 0.316755272051 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.376758965048 F1-OK: 0.913913098 F1-score multiplied: 0.344324952946 Result from the previous epoch on test: F1-BAD: 0.346077399743 F1-OK: 0.912177121771 F1-score multiplied: 0.315683886407 Result from the previous epoch on test: F1-BAD: 0.346077399743 F1-OK: 0.912177121771 F1-score multiplied: 0.315683886407 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.389402341343 F1-OK: 0.905423890568 F1-score multiplied: 0.352574182895 Result from the previous epoch on test: F1-BAD: 0.356470834204 F1-OK: 0.901774317079 F1-score multiplied: 0.321456243073 Result from the previous epoch on test: F1-BAD: 0.356470834204 F1-OK: 0.901774317079 F1-score multiplied: 0.321456243073 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.391706015192 F1-OK: 0.905736009926 F1-score multiplied: 0.354782243264 Result from the previous epoch on test: F1-BAD: 0.358439390778 F1-OK: 0.901838728213 F1-score multiplied: 0.323254524321 Result from the previous epoch on test: F1-BAD: 0.358439390778 F1-OK: 0.901838728213 F1-score multiplied: 0.323254524321 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.382648228831 F1-OK: 0.894955680902 F1-score multiplied: 0.34245320618 Result from the previous epoch on test: F1-BAD: 0.359203885344 F1-OK: 0.891005393848 F1-score multiplied: 0.320052599333 Result from the previous epoch on test: F1-BAD: 0.359203885344 F1-OK: 0.891005393848 F1-score multiplied: 0.320052599333 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.391269523428 F1-OK: 0.902906419674 F1-score multiplied: 0.353279764526 Result from the previous epoch on test: F1-BAD: 0.352445540485 F1-OK: 0.899177678943 F1-score multiplied: 0.316911163047 Result from the previous epoch on test: F1-BAD: 0.352445540485 F1-OK: 0.899177678943 F1-score multiplied: 0.316911163047 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.378775167785 F1-OK: 0.906075596144 F1-score multiplied: 0.343198935956 Result from the previous epoch on test: F1-BAD: 0.356097560976 F1-OK: 0.903324417272 F1-score multiplied: 0.32167162176 Result from the previous epoch on test: F1-BAD: 0.356097560976 F1-OK: 0.903324417272 F1-score multiplied: 0.32167162176 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.374069058903 F1-OK: 0.878339255165 F1-score multiplied: 0.328559538577 Result from the previous epoch on test: F1-BAD: 0.356784347086 F1-OK: 0.874989666518 F1-score multiplied: 0.312182616876 Result from the previous epoch on test: F1-BAD: 0.356784347086 F1-OK: 0.874989666518 F1-score multiplied: 0.312182616876 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.375455910749 F1-OK: 0.90800493 F1-score multiplied: 0.340915817958 Result from the previous epoch on test: F1-BAD: 0.344624768544 F1-OK: 0.904578397323 F1-score multiplied: 0.311740120807 Result from the previous epoch on test: F1-BAD: 0.344624768544 F1-OK: 0.904578397323 F1-score multiplied: 0.311740120807 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.380186915888 F1-OK: 0.892873295858 F1-score multiplied: 0.339458744631 Result from the previous epoch on test: F1-BAD: 0.352828746177 F1-OK: 0.890374591252 F1-score multiplied: 0.31414975066 Result from the previous epoch on test: F1-BAD: 0.352828746177 F1-OK: 0.890374591252 F1-score multiplied: 0.31414975066 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.369826435247 F1-OK: 0.875428873054 F1-score multiplied: 0.323756739434 Result from the previous epoch on test: F1-BAD: 0.350548523207 F1-OK: 0.872557461747 F1-score multiplied: 0.305873729629 Result from the previous epoch on test: F1-BAD: 0.350548523207 F1-OK: 0.872557461747 F1-score multiplied: 0.305873729629 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.373974208675 F1-OK: 0.89726159174 F1-score multiplied: 0.335552693746 Result from the previous epoch on test: F1-BAD: 0.347215253387 F1-OK: 0.895540603472 F1-score multiplied: 0.310945357553 Result from the previous epoch on test: F1-BAD: 0.347215253387 F1-OK: 0.895540603472 F1-score multiplied: 0.310945357553 [287372 332628 486601 ..., 7030 498681 343739] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.367696980525 F1-OK: 0.884749405673 F1-score multiplied: 0.325319684987 Result from the previous epoch on test: F1-BAD: 0.353705397987 F1-OK: 0.884778495466 F1-score multiplied: 0.312950929869 Result from the previous epoch on test: F1-BAD: 0.353705397987 F1-OK: 0.884778495466 F1-score multiplied: 0.312950929869 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.371125265393 F1-OK: 0.906248021776 F1-score multiplied: 0.336331537593 Result from the previous epoch on test: F1-BAD: 0.337006832709 F1-OK: 0.904755873599 F1-score multiplied: 0.304908911336 Result from the previous epoch on test: F1-BAD: 0.337006832709 F1-OK: 0.904755873599 F1-score multiplied: 0.304908911336 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.371559633028 F1-OK: 0.894181256437 F1-score multiplied: 0.332241659502 Result from the previous epoch on test: F1-BAD: 0.346187812776 F1-OK: 0.892613663835 F1-score multiplied: 0.309011971937 Result from the previous epoch on test: F1-BAD: 0.346187812776 F1-OK: 0.892613663835 F1-score multiplied: 0.309011971937 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.368502117828 F1-OK: 0.894567663131 F1-score multiplied: 0.329650078404 Result from the previous epoch on test: F1-BAD: 0.34768897211 F1-OK: 0.893398399124 F1-score multiplied: 0.310624771076 Result from the previous epoch on test: F1-BAD: 0.34768897211 F1-OK: 0.893398399124 F1-score multiplied: 0.310624771076 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.365458750964 F1-OK: 0.894202339632 F1-score multiplied: 0.326794070151 Result from the previous epoch on test: F1-BAD: 0.344488188976 F1-OK: 0.892715615838 F1-score multiplied: 0.307529985771 Result from the previous epoch on test: F1-BAD: 0.344488188976 F1-OK: 0.892715615838 F1-score multiplied: 0.307529985771 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.366229321164 F1-OK: 0.892639716541 F1-score multiplied: 0.326910837432 Result from the previous epoch on test: F1-BAD: 0.33992017911 F1-OK: 0.890567255709 F1-score multiplied: 0.30272178107 Result from the previous epoch on test: F1-BAD: 0.33992017911 F1-OK: 0.890567255709 F1-score multiplied: 0.30272178107 [486439 273925 266751 ..., 295303 199517 319098] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.368943151469 F1-OK: 0.893503315949 F1-score multiplied: 0.329651929234 Result from the previous epoch on test: F1-BAD: 0.342596191216 F1-OK: 0.890775837019 F1-score multiplied: 0.30517640899 Result from the previous epoch on test: F1-BAD: 0.342596191216 F1-OK: 0.890775837019 F1-score multiplied: 0.30517640899 [ 40537 106670 99084 ..., 465976 431894 328479] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.373813291139 F1-OK: 0.898681515617 F1-score multiplied: 0.335939095039 Result from the previous epoch on test: F1-BAD: 0.346052897234 F1-OK: 0.896072643265 F1-score multiplied: 0.310088534334 Result from the previous epoch on test: F1-BAD: 0.346052897234 F1-OK: 0.896072643265 F1-score multiplied: 0.310088534334 [212561 356922 152295 ..., 524049 198795 528463] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.362028514709 F1-OK: 0.885089230569 F1-score multiplied: 0.320427539527 Result from the previous epoch on test: F1-BAD: 0.342025246476 F1-OK: 0.883668648693 F1-score multiplied: 0.302236987372 Result from the previous epoch on test: F1-BAD: 0.342025246476 F1-OK: 0.883668648693 F1-score multiplied: 0.302236987372 [ 95635 378627 25971 ..., 420115 259761 74441] epoch: 23 Result from the previous epoch on dev: F1-BAD: 0.360902255639 F1-OK: 0.89664 F1-score multiplied: 0.323599398496 Result from the previous epoch on test: F1-BAD: 0.342118652692 F1-OK: 0.896412491388 F1-score multiplied: 0.306679433809 Result from the previous epoch on test: F1-BAD: 0.342118652692 F1-OK: 0.896412491388 F1-score multiplied: 0.306679433809 [485069 313969 289735 ..., 30221 333017 288627] epoch: 24 Result from the previous epoch on dev: F1-BAD: 0.369892473118 F1-OK: 0.89666228478 F1-score multiplied: 0.331668630069 Result from the previous epoch on test: F1-BAD: 0.34509171538 F1-OK: 0.895725014443 F1-score multiplied: 0.309107281743 Result from the previous epoch on test: F1-BAD: 0.34509171538 F1-OK: 0.895725014443 F1-score multiplied: 0.309107281743 [209130 518923 324077 ..., 124771 425901 349907] epoch: 25 Result from the previous epoch on dev: F1-BAD: 0.366871425545 F1-OK: 0.905360478739 F1-score multiplied: 0.332150889467 Result from the previous epoch on test: F1-BAD: 0.337428696797 F1-OK: 0.904312284148 F1-score multiplied: 0.305140915537 Result from the previous epoch on test: F1-BAD: 0.337428696797 F1-OK: 0.904312284148 F1-score multiplied: 0.305140915537 [360247 140109 475577 ..., 284869 401264 117631] epoch: 26 Result from the previous epoch on dev: F1-BAD: 0.36427248405 F1-OK: 0.901764986484 F1-score multiplied: 0.328488171656 Result from the previous epoch on test: F1-BAD: 0.338853503185 F1-OK: 0.900856442421 F1-score multiplied: 0.305258361381 Result from the previous epoch on test: F1-BAD: 0.338853503185 F1-OK: 0.900856442421 F1-score multiplied: 0.305258361381 [119698 10816 551151 ..., 126647 315313 223345] epoch: 27 Result from the previous epoch on dev: F1-BAD: 0.360353130016 F1-OK: 0.898212005109 F1-score multiplied: 0.323673507459 Result from the previous epoch on test: F1-BAD: 0.340394899218 F1-OK: 0.897398982628 F1-score multiplied: 0.30547003625 Result from the previous epoch on test: F1-BAD: 0.340394899218 F1-OK: 0.897398982628 F1-score multiplied: 0.30547003625 [255352 453736 505023 ..., 246196 430507 97061] epoch: 28 Result from the previous epoch on dev: F1-BAD: 0.360033030553 F1-OK: 0.901462174189 F1-score multiplied: 0.324556158503 Result from the previous epoch on test: F1-BAD: 0.337478920742 F1-OK: 0.899824701195 F1-score multiplied: 0.303671869016 Result from the previous epoch on test: F1-BAD: 0.337478920742 F1-OK: 0.899824701195 F1-score multiplied: 0.303671869016 [182829 156731 212271 ..., 262696 534335 194312] epoch: 29 Result from the previous epoch on dev: F1-BAD: 0.355863192182 F1-OK: 0.899209989806 F1-score multiplied: 0.319995737415 Result from the previous epoch on test: F1-BAD: 0.336708068051 F1-OK: 0.898574780152 F1-score multiplied: 0.302557378225 Result from the previous epoch on test: F1-BAD: 0.336708068051 F1-OK: 0.898574780152 F1-score multiplied: 0.302557378225 [ 63516 229449 556142 ..., 518027 383750 277428] Done!
gaussian only - baseline
Epoch 1: \Dev set LL -0.535730195594102, Acc 0.7404693961143494, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.278449992342 F1-OK: 0.841780016793 F1-score multiplied: 0.234393639229 Epoch 1: Test set LL -0.5336820838984481, Acc 0.7412165403366089, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.273568042279 F1-OK: 0.842566236041 F1-score multiplied: 0.230499195684 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.6272237769018613, Acc 0.7849823832511902, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.298652291105 F1-OK: 0.873027749764 F1-score multiplied: 0.260731737665 Epoch 2: Test set LL -0.6254610008634425, Acc 0.7840471863746643, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.284534947716 F1-OK: 0.872831616017 F1-score multiplied: 0.248351098228 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.6871611350566108, Acc 0.8077346682548523, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.304503786369 F1-OK: 0.88844850732 F1-score multiplied: 0.270535934473 Epoch 3: Test set LL -0.6909745923011538, Acc 0.8052825331687927, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.287797468354 F1-OK: 0.887224796754 F1-score multiplied: 0.255341050367 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.7276060250567463, Acc 0.8208461999893188, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.312473572939 F1-OK: 0.897003863939 F1-score multiplied: 0.280290002305 Epoch 4: Test set LL -0.7379940159998544, Acc 0.8156095147132874, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.286937901499 F1-OK: 0.894114280263 F1-score multiplied: 0.256555275279 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.7450919708748875, Acc 0.8280630111694336, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.307521633015 F1-OK: 0.901846086109 F1-score multiplied: 0.277337181129 Epoch 5: Test set LL -0.7566154758732436, Acc 0.8246352076530457, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.291974066622 F1-OK: 0.899924161031 F1-score multiplied: 0.262754516948 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.7492483164034739, Acc 0.8344535231590271, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.313142857143 F1-OK: 0.905884932193 F1-score multiplied: 0.28367139591 Epoch 6: Test set LL -0.7620085999571968, Acc 0.8309200406074524, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.29553581728 F1-OK: 0.903931161415 F1-score multiplied: 0.267144034554 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.7597995294833535, Acc 0.8379241824150085, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.315813953488 F1-OK: 0.908073990751 F1-score multiplied: 0.286782437079 Epoch 7: Test set LL -0.7763654800913647, Acc 0.8341593146324158, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.296948356808 F1-OK: 0.905992027371 F1-score multiplied: 0.269032843808 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.7615476852349599, Acc 0.839356541633606, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.317096018735 F1-OK: 0.90897171755 F1-score multiplied: 0.288231312778 Epoch 8: Test set LL -0.7784459570072271, Acc 0.8362081050872803, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.302193913659 F1-OK: 0.90721455458 F1-score multiplied: 0.274154716777 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.7666262368635305, Acc 0.8390259742736816, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.313117066291 F1-OK: 0.908829953198 F1-score multiplied: 0.284570168702 Epoch 9: Test set LL -0.7844413555959809, Acc 0.8365403413772583, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301797540208 F1-OK: 0.907434699445 F1-score multiplied: 0.273861560192 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.7644627657494474, Acc 0.8416152596473694, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.316615165201 F1-OK: 0.910427765835 F1-score multiplied: 0.288255237483 Epoch 10: Test set LL -0.7830656521759614, Acc 0.8378415703773499, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299150412828 F1-OK: 0.908313896151 F1-score multiplied: 0.27172247701 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.772309674298157, Acc 0.8437086939811707, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.323073252207 F1-OK: 0.911655715754 F1-score multiplied: 0.294531576982 Epoch 11: Test set LL -0.7890603144150151, Acc 0.8401118516921997, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.304133028076 F1-OK: 0.90967953831 F1-score multiplied: 0.276663592565 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.7649181641701966, Acc 0.8445350527763367, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.3120429059 F1-OK: 0.912365691572 F1-score multiplied: 0.284697241641 Epoch 12: Test set LL -0.7793364344530654, Acc 0.8417730331420898, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299718171793 F1-OK: 0.9108104312 F1-score multiplied: 0.272986437289 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.769558851619365, Acc 0.8454715609550476, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321644498186 F1-OK: 0.912804252541 F1-score multiplied: 0.293598465751 Epoch 13: Test set LL -0.7884258585835375, Acc 0.8410254716873169, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299585264699 F1-OK: 0.910337289194 F1-score multiplied: 0.272723637748 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.7721103347778581, Acc 0.8465733528137207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.326481257557 F1-OK: 0.913425969101 F1-score multiplied: 0.298216459078 Epoch 14: Test set LL -0.7897910447558836, Acc 0.8404994606971741, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.300425015179 F1-OK: 0.909988594285 F1-score multiplied: 0.273383337251 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.7680343690679252, Acc 0.8480057120323181, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.325262900465 F1-OK: 0.914356666149 F1-score multiplied: 0.297406301291 Epoch 15: Test set LL -0.7863918624661134, Acc 0.8440709710121155, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.304691358025 F1-OK: 0.912189341732 F1-score multiplied: 0.277936209308 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.7699727480493657, Acc 0.847730278968811, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.31921182266 F1-OK: 0.914278625481 F1-score multiplied: 0.291848546459 Epoch 16: Test set LL -0.7843902638089195, Acc 0.8433511257171631, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301653912614 F1-OK: 0.911781214918 F1-score multiplied: 0.275042370928 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.7712239070850652, Acc 0.8489973545074463, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.322708178898 F1-OK: 0.915026195864 F1-score multiplied: 0.295286437311 Epoch 17: Test set LL -0.7869398381738032, Acc 0.8443201780319214, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301403901106 F1-OK: 0.912399320756 F1-score multiplied: 0.275000714642 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.7755213380855821, Acc 0.8488320708274841, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321799307958 F1-OK: 0.914935829872 F1-score multiplied: 0.294425716879 Epoch 18: Test set LL -0.7897272418250896, Acc 0.8448185324668884, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301905592228 F1-OK: 0.912706941395 F1-score multiplied: 0.275551329672 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.7627708296047041, Acc 0.8512560725212097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.326010983525 F1-OK: 0.916403492476 F1-score multiplied: 0.298757603888 Epoch 19: Test set LL -0.7795874158526103, Acc 0.8467565774917603, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301753500694 F1-OK: 0.913933852685 F1-score multiplied: 0.27578273945 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.7698428969958984, Acc 0.8498237133026123, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.322901142573 F1-OK: 0.915546192453 F1-score multiplied: 0.295630911622 Epoch 20: Test set LL -0.784611006827681, Acc 0.8460643887519836, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.300980638672 F1-OK: 0.913508804679 F1-score multiplied: 0.274948463465 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.7734439750460628, Acc 0.8494380712509155, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.319302615193 F1-OK: 0.915358171514 F1-score multiplied: 0.292276258003 Epoch 21: Test set LL -0.787662305662755, Acc 0.8463689684867859, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301749087706 F1-OK: 0.913689318878 F1-score multiplied: 0.275704918418 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.7640025570524249, Acc 0.8513111472129822, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.323389320632 F1-OK: 0.916478415596 F1-score multiplied: 0.296379332193 Epoch 22: Test set LL -0.7757172368041536, Acc 0.8476425409317017, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299961836916 F1-OK: 0.91451916057 F1-score multiplied: 0.2743208473 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.7796264272859272, Acc 0.8493829965591431, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318883906328 F1-OK: 0.915329823475 F1-score multiplied: 0.291883949688 Epoch 23: Test set LL -0.789283529823838, Acc 0.8467288613319397, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303472571716 F1-OK: 0.913890185099 F1-score multiplied: 0.277340604738 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.7723248881918459, Acc 0.8496033549308777, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318181818182 F1-OK: 0.915479876161 F1-score multiplied: 0.291289051506 Epoch 24: Test set LL -0.7823836278378984, Acc 0.8475871682167053, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301661803882 F1-OK: 0.914458861005 F1-score multiplied: 0.275857309587 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.7669612581969856, Acc 0.8502093553543091, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.319399249061 F1-OK: 0.91584388251 F1-score multiplied: 0.292519848331 Epoch 25: Test set LL -0.7803100647231916, Acc 0.8479470610618591, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303929024081 F1-OK: 0.914651582023 F1-score multiplied: 0.277989162698 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.7679947850682691, Acc 0.8505949974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.317220543807 F1-OK: 0.916120252382 F1-score multiplied: 0.290612164653 Epoch 26: Test set LL -0.7802946812435716, Acc 0.848030149936676, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.302275327317 F1-OK: 0.914728682171 F1-score multiplied: 0.276499911809 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.7782354853883444, Acc 0.8479506373405457, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318854886476 F1-OK: 0.914423911695 F1-score multiplied: 0.291568532554 Epoch 27: Test set LL -0.788010579014559, Acc 0.8467012047767639, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.302732653318 F1-OK: 0.91388400703 F1-score multiplied: 0.276662530273 [255352 453736 505023 ..., 246196 430507 97061] Epoch 28: \Dev set LL -0.7749358746869791, Acc 0.8500440716743469, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318477716575 F1-OK: 0.915753636645 F1-score multiplied: 0.291647127144 Epoch 28: Test set LL -0.7841599027735908, Acc 0.847697913646698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303053338401 F1-OK: 0.914507731758 F1-score multiplied: 0.277144621103 [182829 156731 212271 ..., 262696 534335 194312] Epoch 29: \Dev set LL -0.7766454011045395, Acc 0.8496584296226501, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.318261304022 F1-OK: 0.915513451596 F1-score multiplied: 0.291372504955 Epoch 29: Test set LL -0.7902736115796404, Acc 0.8470888137817383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299911268855 F1-OK: 0.914171160391 F1-score multiplied: 0.274170232664 [ 63516 229449 556142 ..., 518027 383750 277428] Epoch 30: \Dev set LL -0.7675411675262105, Acc 0.8506500720977783, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.315576874527 F1-OK: 0.916179698853 F1-score multiplied: 0.289125125869 Epoch 30: Test set LL -0.7778728662012749, Acc 0.8492206335067749, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301078028747 F1-OK: 0.915495143221 F1-score multiplied: 0.275635473049 [457261 283956 219083 ..., 266029 196105 187136] Epoch 31: \Dev set LL -0.7689737073800385, Acc 0.8521925806999207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.324691668764 F1-OK: 0.917014629922 F1-score multiplied: 0.29774701047 Epoch 31: Test set LL -0.7817575393834568, Acc 0.8481408953666687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.299399667901 F1-OK: 0.914841093636 F1-score multiplied: 0.273903119617 [262413 88672 33985 ..., 318723 95762 425717] Epoch 32: \Dev set LL -0.771931856109044, Acc 0.8515865802764893, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321068548387 F1-OK: 0.916687283523 F1-score multiplied: 0.294319455446 Epoch 32: Test set LL -0.7829435131209274, Acc 0.8488330245018005, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.303038039316 F1-OK: 0.915222656978 F1-score multiplied: 0.277347279508 [251290 383272 991 ..., 526297 101320 365163] Epoch 33: \Dev set LL -0.7666301640926564, Acc 0.8521375060081482, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321879737241 F1-OK: 0.91702219749 F1-score multiplied: 0.295170863972 Epoch 33: Test set LL -0.7809956716263842, Acc 0.850549578666687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.30616966581 F1-OK: 0.916255546247 F1-score multiplied: 0.280529654391 [355881 139443 16797 ..., 553960 256872 531958] Epoch 34: \Dev set LL -0.7680349502332002, Acc 0.8516417145729065, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.316323940086 F1-OK: 0.916792831763 F1-score multiplied: 0.290003520786 Epoch 34: Test set LL -0.782022457179423, Acc 0.8500235080718994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301843021008 F1-OK: 0.915988151181 F1-score multiplied: 0.27648463076 [141835 239010 254090 ..., 15612 504913 215719] Epoch 35: \Dev set LL -0.772871845768421, Acc 0.8528536558151245, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.319143512618 F1-OK: 0.917513356598 F1-score multiplied: 0.292818435499 Epoch 35: Test set LL -0.7850148980545514, Acc 0.8499127626419067, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.302765273312 F1-OK: 0.915905247972 F1-score multiplied: 0.27730430273 [217496 218246 75279 ..., 327762 448278 78427] Epoch 36: \Dev set LL -0.7656906699133259, Acc 0.8519171476364136, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.315682281059 F1-OK: 0.916975537435 F1-score multiplied: 0.289472929333 Epoch 36: Test set LL -0.7774602239820477, Acc 0.850549578666687, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.300233341976 F1-OK: 0.916341206373 F1-score multiplied: 0.275116182779 [398841 208123 485669 ..., 52121 453759 477812] Epoch 37: \Dev set LL -0.7565342792068855, Acc 0.8540105819702148, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.31946584489 F1-OK: 0.91823511262 F1-score multiplied: 0.29334475606 Epoch 37: Test set LL -0.769737011228432, Acc 0.8517677783966064, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.301955671447 F1-OK: 0.917079667947 F1-score multiplied: 0.276917406905 [442506 478532 173682 ..., 35206 362546 523040] Epoch 38: \Dev set LL -0.7721033104281348, Acc 0.8514764308929443, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.321931589537 F1-OK: 0.916604800792 F1-score multiplied: 0.295084040496 Epoch 38: Test set LL -0.7837474373231753, Acc 0.848971426486969, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.306949561682 F1-OK: 0.915251604083 F1-score multiplied: 0.280936078702 [282590 352776 441935 ..., 48457 341548 197253] Epoch 39: \Dev set LL -0.7648956357172907, Acc 0.8512560725212097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.31437277806 F1-OK: 0.916579126244 F1-score multiplied: 0.288147526229 Epoch 39: Test set LL -0.7796225454573422, Acc 0.8504111170768738, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.304006183177 F1-OK: 0.916200077549 F1-score multiplied: 0.278530488602 [ 80053 60994 279247 ..., 16715 185116 347150]
SVM non linear 72 features
F1-BAD: 0.398248325605 F1-OK: 0.908053215776 F1-score multiplied: 0.361630672743
614 features
gaussian processes only
Epoch 1: \Dev set LL -0.43246618248924085, Acc 0.8063023090362549, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.31328125 F1-OK: 0.887249871729 F1-score multiplied: 0.277958748878 Epoch 1: Test set LL -0.4354370114379273, Acc 0.8067498803138733, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.298915226999 F1-OK: 0.887929096689 F1-score multiplied: 0.265415527496 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.485987753873165, Acc 0.8339025974273682, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.338380513496 F1-OK: 0.905030396573 F1-score multiplied: 0.306244650322 Epoch 2: Test set LL -0.4918978863618546, Acc 0.8324981331825256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.32068268583 F1-OK: 0.904471673088 F1-score multiplied: 0.290048405383 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.5565666961227259, Acc 0.8411194086074829, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.348690153568 F1-OK: 0.909524407077 F1-score multiplied: 0.317142205178 Epoch 3: Test set LL -0.567714321736022, Acc 0.8391982316970825, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.327933348762 F1-OK: 0.908673501478 F1-score multiplied: 0.297984344271 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.610434163516195, Acc 0.8440943360328674, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.352402745995 F1-OK: 0.911379720674 F1-score multiplied: 0.32117271621 Epoch 4: Test set LL -0.6276412240012235, Acc 0.842686653137207, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.331529411765 F1-OK: 0.910853807776 F1-score multiplied: 0.301974827095 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.6521287292840368, Acc 0.8451410531997681, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.361861520999 F1-OK: 0.911878115301 F1-score multiplied: 0.329973601769 Epoch 5: Test set LL -0.6699044256995675, Acc 0.8429635167121887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.336918400748 F1-OK: 0.910935242761 F1-score multiplied: 0.306910845176 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.6721200817409915, Acc 0.8485015630722046, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.367525298988 F1-OK: 0.913944173238 F1-score multiplied: 0.335897605528 Epoch 6: Test set LL -0.6910111823512829, Acc 0.8443478345870972, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337340876945 F1-OK: 0.911817297738 F1-score multiplied: 0.307593246832 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.7007685182610405, Acc 0.8470692038536072, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.367941712204 F1-OK: 0.913010779644 F1-score multiplied: 0.335934749523 Epoch 7: Test set LL -0.7173808750807441, Acc 0.8434618711471558, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.337784024362 F1-OK: 0.911240188383 F1-score multiplied: 0.307802377992 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.7036302000155953, Acc 0.8504297137260437, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.37571855599 F1-OK: 0.915036770458 F1-score multiplied: 0.343796294074 Epoch 8: Test set LL -0.7239711797243029, Acc 0.8451784253120422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.338068181818 F1-OK: 0.912337356953 F1-score multiplied: 0.30843223147 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.7043708888745587, Acc 0.8526332974433899, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.374269005848 F1-OK: 0.916481938243 F1-score multiplied: 0.343010783904 Epoch 9: Test set LL -0.7246094781841688, Acc 0.8472825884819031, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.341451766953 F1-OK: 0.913626256616 F1-score multiplied: 0.311959299656 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.7175129950876227, Acc 0.85114586353302, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.375404530744 F1-OK: 0.915504409281 F1-score multiplied: 0.343684503161 Epoch 10: Test set LL -0.736836486219996, Acc 0.8470610976219177, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343162901308 F1-OK: 0.913454910071 F1-score multiplied: 0.313463837154 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.7278407914428828, Acc 0.8504297137260437, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.375431331953 F1-OK: 0.915042087805 F1-score multiplied: 0.343535469818 Epoch 11: Test set LL -0.7474042269589574, Acc 0.846285879611969, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343890333255 F1-OK: 0.91294530858 F1-score multiplied: 0.313953066411 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.7247159718245795, Acc 0.8544512987136841, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.380103237916 F1-OK: 0.917545721241 F1-score multiplied: 0.34876209958 Epoch 12: Test set LL -0.7428832944966686, Acc 0.8488883972167969, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.340661995651 F1-OK: 0.914665415885 F1-score multiplied: 0.311591745928 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.7330308222936178, Acc 0.8529087901115417, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.378202142524 F1-OK: 0.916588566073 F1-score multiplied: 0.346655759502 Epoch 13: Test set LL -0.7543557404790047, Acc 0.848030149936676, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.346469817835 F1-OK: 0.914018076724 F1-score multiplied: 0.316679676541 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.7323046708799058, Acc 0.8534045815467834, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.378125730311 F1-OK: 0.916908665105 F1-score multiplied: 0.346706758621 Epoch 14: Test set LL -0.7573356363121102, Acc 0.8482239246368408, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342370441459 F1-OK: 0.914212387719 F1-score multiplied: 0.31299929877 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.7312483480961796, Acc 0.8547267317771912, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.37733175915 F1-OK: 0.91777105616 F1-score multiplied: 0.346304167118 Epoch 15: Test set LL -0.7525308140140392, Acc 0.8502727150917053, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.343689320388 F1-OK: 0.915497359292 F1-score multiplied: 0.314646665233 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.7417305946654603, Acc 0.8531842231750488, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.378353160718 F1-OK: 0.916762969672 F1-score multiplied: 0.346860167205 Epoch 16: Test set LL -0.763487749813639, Acc 0.8497466444969177, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.345908159576 F1-OK: 0.915124880749 F1-score multiplied: 0.316549163282 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.7508477533512214, Acc 0.8528536558151245, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.377824365246 F1-OK: 0.916559932523 F1-score multiplied: 0.346298674715 Epoch 17: Test set LL -0.7695784288049092, Acc 0.8497743606567383, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.347993270848 F1-OK: 0.915107328368 F1-score multiplied: 0.318451192376 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.7470159814356033, Acc 0.8531291484832764, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.372705882353 F1-OK: 0.916827852998 F1-score multiplied: 0.341707133917 Epoch 18: Test set LL -0.7682800556547194, Acc 0.8503003716468811, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.345795523291 F1-OK: 0.915479968112 F1-score multiplied: 0.316568874636 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.7419734013711843, Acc 0.854175865650177, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.374379579296 F1-OK: 0.917469522651 F1-score multiplied: 0.343481853907 Epoch 19: Test set LL -0.7645873607230933, Acc 0.8514078259468079, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.345727172985 F1-OK: 0.916186460529 F1-score multiplied: 0.316750554926 [486439 273925 266751 ..., 295303 199517 319098] Done!
Matern12 - from scratch
Epoch 1: \Dev set LL -0.5611348369354463, Acc 0.8401278257369995, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396673596674 F1-OK: 0.907855464533 F1-score multiplied: 0.360122292376 Epoch 1: Test set LL -0.5681877232408932, Acc 0.8375647068023682, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376182881446 F1-OK: 0.90662549934 F1-score multiplied: 0.341056992734 Epoch 1: Test set LL -0.5681877232408932, Acc 0.8375647068023682, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376182881446 F1-OK: 0.90662549934 F1-score multiplied: 0.341056992734 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.7852391465524081, Acc 0.8358307480812073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405664140407 F1-OK: 0.904761904762 F1-score multiplied: 0.367029460368 Epoch 2: Test set LL -0.8124965911267252, Acc 0.8302832245826721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381931841097 F1-OK: 0.901636713736 F1-score multiplied: 0.344363770078 Epoch 2: Test set LL -0.8124965911267252, Acc 0.8302832245826721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381931841097 F1-OK: 0.901636713736 F1-score multiplied: 0.344363770078 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.7395307352223666, Acc 0.8661304712295532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397620228061 F1-OK: 0.924697861791 F1-score multiplied: 0.367678574693 Epoch 3: Test set LL -0.7642975706414251, Acc 0.8628699779510498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.37375142243 F1-OK: 0.923005176514 F1-score multiplied: 0.344974497633 Epoch 3: Test set LL -0.7642975706414251, Acc 0.8628699779510498, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.37375142243 F1-OK: 0.923005176514 F1-score multiplied: 0.344974497633 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.7756077323170335, Acc 0.8716394901275635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.391962421712 F1-OK: 0.928245873368 F1-score multiplied: 0.363837500469 Epoch 4: Test set LL -0.7959170906250166, Acc 0.868545651435852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373118563507 F1-OK: 0.926574291723 F1-score multiplied: 0.34572206871 Epoch 4: Test set LL -0.7959170906250166, Acc 0.868545651435852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373118563507 F1-OK: 0.926574291723 F1-score multiplied: 0.34572206871 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9242504128070259, Acc 0.8505398631095886, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415931108719 F1-OK: 0.914305568717 F1-score multiplied: 0.380288128904 Epoch 5: Test set LL -0.9462426361737157, Acc 0.8472825884819031, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391438658429 F1-OK: 0.912685598506 F1-score multiplied: 0.357260426246 Epoch 5: Test set LL -0.9462426361737157, Acc 0.8472825884819031, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391438658429 F1-OK: 0.912685598506 F1-score multiplied: 0.357260426246 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.996529164660298, Acc 0.8423864841461182, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418614102825 F1-OK: 0.908835994009 F1-score multiplied: 0.380451564247 Epoch 6: Test set LL -1.0214994736146674, Acc 0.8386721611022949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387984455414 F1-OK: 0.907090581501 F1-score multiplied: 0.351937045275 Epoch 6: Test set LL -1.0214994736146674, Acc 0.8386721611022949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387984455414 F1-OK: 0.907090581501 F1-score multiplied: 0.351937045275 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9478393724782797, Acc 0.8499889969825745, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.420021299255 F1-OK: 0.913853649277 F1-score multiplied: 0.383837997098 Epoch 7: Test set LL -0.9798853863794312, Acc 0.8446524143218994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385634512208 F1-OK: 0.911084700103 F1-score multiplied: 0.351345703905 Epoch 7: Test set LL -0.9798853863794312, Acc 0.8446524143218994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385634512208 F1-OK: 0.911084700103 F1-score multiplied: 0.351345703905 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8302064333129368, Acc 0.8702071309089661, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.401118454499 F1-OK: 0.927216558542 F1-score multiplied: 0.371923672948 Epoch 8: Test set LL -0.8465524667567002, Acc 0.8670505881309509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.37603950104 F1-OK: 0.925598834867 F1-score multiplied: 0.348061724026 Epoch 8: Test set LL -0.8465524667567002, Acc 0.8670505881309509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.37603950104 F1-OK: 0.925598834867 F1-score multiplied: 0.348061724026 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8223793043332067, Acc 0.8710885643959045, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415292353823 F1-OK: 0.927558665098 F1-score multiplied: 0.385208021338 Epoch 9: Test set LL -0.8526743761085834, Acc 0.8658323884010315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382202957675 F1-OK: 0.924744541417 F1-score multiplied: 0.353440098823 Epoch 9: Test set LL -0.8526743761085834, Acc 0.8658323884010315, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382202957675 F1-OK: 0.924744541417 F1-score multiplied: 0.353440098823 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9014337100486716, Acc 0.8588585257530212, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415602189781 F1-OK: 0.919736842105 F1-score multiplied: 0.382244645601 Epoch 10: Test set LL -0.9295519306903413, Acc 0.8541764616966248, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384624372006 F1-OK: 0.917288273999 F1-score multiplied: 0.352811426336 Epoch 10: Test set LL -0.9295519306903413, Acc 0.8541764616966248, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384624372006 F1-OK: 0.917288273999 F1-score multiplied: 0.352811426336 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8166974084168406, Acc 0.8732922077178955, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392819429778 F1-OK: 0.929265592324 F1-score multiplied: 0.365033580089 Epoch 11: Test set LL -0.8315228896205754, Acc 0.8706774711608887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.371078497374 F1-OK: 0.927928900958 F1-score multiplied: 0.344334462238 Epoch 11: Test set LL -0.8315228896205754, Acc 0.8706774711608887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.371078497374 F1-OK: 0.927928900958 F1-score multiplied: 0.344334462238 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.7959319986660929, Acc 0.8700418472290039, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.398367763326 F1-OK: 0.927153135905 F1-score multiplied: 0.369347921011 Epoch 12: Test set LL -0.8175985273325541, Acc 0.8689055442810059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370764119601 F1-OK: 0.926830775887 F1-score multiplied: 0.343635596641 Epoch 12: Test set LL -0.8175985273325541, Acc 0.8689055442810059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370764119601 F1-OK: 0.926830775887 F1-score multiplied: 0.343635596641 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -1.035308211481774, Acc 0.8408439755439758, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409805924413 F1-OK: 0.908019994269 F1-score multiplied: 0.372111973137 Epoch 13: Test set LL -1.0417806043340303, Acc 0.8394473791122437, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388871324692 F1-OK: 0.907584184609 F1-score multiplied: 0.352933464138 Epoch 13: Test set LL -1.0417806043340303, Acc 0.8394473791122437, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388871324692 F1-OK: 0.907584184609 F1-score multiplied: 0.352933464138 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -1.009516559112489, Acc 0.8448655605316162, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411125052279 F1-OK: 0.910665566906 F1-score multiplied: 0.374397428803 Epoch 14: Test set LL -1.025872113210022, Acc 0.8422713875770569, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391151009939 F1-OK: 0.909400295797 F1-score multiplied: 0.35571284414 Epoch 14: Test set LL -1.025872113210022, Acc 0.8422713875770569, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391151009939 F1-OK: 0.909400295797 F1-score multiplied: 0.35571284414 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -1.0231288303827044, Acc 0.8424416184425354, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414414414414 F1-OK: 0.908975175048 F1-score multiplied: 0.376692414885 Epoch 15: Test set LL -1.0381161451699674, Acc 0.8402779698371887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394584951202 F1-OK: 0.908003635842 F1-score multiplied: 0.358284570339 Epoch 15: Test set LL -1.0381161451699674, Acc 0.8402779698371887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394584951202 F1-OK: 0.908003635842 F1-score multiplied: 0.358284570339 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8520285536138078, Acc 0.8680586218833923, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.400200350614 F1-OK: 0.92587663644 F1-score multiplied: 0.370536154528 Epoch 16: Test set LL -0.866745661315587, Acc 0.8660261631011963, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378100501221 F1-OK: 0.924926695316 F1-score multiplied: 0.349715247092 Epoch 16: Test set LL -0.866745661315587, Acc 0.8660261631011963, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378100501221 F1-OK: 0.924926695316 F1-score multiplied: 0.349715247092 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8543342863994521, Acc 0.8681136965751648, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403290129611 F1-OK: 0.925863991081 F1-score multiplied: 0.373391808966 Epoch 17: Test set LL -0.873438719148272, Acc 0.8654724955558777, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380940247165 F1-OK: 0.924536799764 F1-score multiplied: 0.352193277015 Epoch 17: Test set LL -0.873438719148272, Acc 0.8654724955558777, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380940247165 F1-OK: 0.924536799764 F1-score multiplied: 0.352193277015 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -1.022324049131486, Acc 0.8437086939811707, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410309706922 F1-OK: 0.909916489379 F1-score multiplied: 0.37334756808 Epoch 18: Test set LL -1.0396063173569414, Acc 0.8403887152671814, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386897798575 F1-OK: 0.90825177051 F1-score multiplied: 0.351400610562 Epoch 18: Test set LL -1.0396063173569414, Acc 0.8403887152671814, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386897798575 F1-OK: 0.90825177051 F1-score multiplied: 0.351400610562 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9218163532829062, Acc 0.8581423759460449, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416496714253 F1-OK: 0.919256216487 F1-score multiplied: 0.382867193724 Epoch 19: Test set LL -0.9469473341308896, Acc 0.854314923286438, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.393219557196 F1-OK: 0.917219897429 F1-score multiplied: 0.360668801918 Epoch 19: Test set LL -0.9469473341308896, Acc 0.854314923286438, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.393219557196 F1-OK: 0.917219897429 F1-score multiplied: 0.360668801918 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.0135182728476813, Acc 0.843598484992981, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419308652076 F1-OK: 0.909629158046 F1-score multiplied: 0.381415376149 Epoch 20: Test set LL -1.0426888748449992, Acc 0.8391428589820862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390474192195 F1-OK: 0.907345389596 F1-score multiplied: 0.354294958044 Epoch 20: Test set LL -1.0426888748449992, Acc 0.8391428589820862, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390474192195 F1-OK: 0.907345389596 F1-score multiplied: 0.354294958044 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.863986202362324, Acc 0.8675628304481506, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.406419753086 F1-OK: 0.925466608793 F1-score multiplied: 0.376127910635 Epoch 21: Test set LL -0.8868297392156604, Acc 0.8643373250961304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381781478678 F1-OK: 0.923808931459 F1-score multiplied: 0.352693139868 Epoch 21: Test set LL -0.8868297392156604, Acc 0.8643373250961304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381781478678 F1-OK: 0.923808931459 F1-score multiplied: 0.352693139868 [212561 356922 152295 ..., 524049 198795 528463] ^CTraceback (most recent call last):
RBF from scratch
Epoch 1: \Dev set LL -0.6588478408564025, Acc 0.8518620729446411, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403372531617 F1-OK: 0.915432273485 F1-score multiplied: 0.36926023368 Epoch 1: Test set LL -0.6918311139867366, Acc 0.8467565774917603, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370235521675 F1-OK: 0.912764582578 F1-score multiplied: 0.337937871397 Epoch 1: Test set LL -0.6918311139867366, Acc 0.8467565774917603, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370235521675 F1-OK: 0.912764582578 F1-score multiplied: 0.337937871397 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.8725770318571358, Acc 0.846903920173645, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.408345752608 F1-OK: 0.912076438764 F1-score multiplied: 0.372442539823 Epoch 2: Test set LL -0.901873950999082, Acc 0.843268096446991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377022119511 F1-OK: 0.91035771405 F1-score multiplied: 0.343224994865 Epoch 2: Test set LL -0.901873950999082, Acc 0.843268096446991, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377022119511 F1-OK: 0.91035771405 F1-score multiplied: 0.343224994865 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.936339964109335, Acc 0.8472895622253418, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412213740458 F1-OK: 0.912245156389 F1-score multiplied: 0.37603998813 Epoch 3: Test set LL -0.9572268421631335, Acc 0.844098687171936, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382362619283 F1-OK: 0.910790386718 F1-score multiplied: 0.348252197883 Epoch 3: Test set LL -0.9572268421631335, Acc 0.844098687171936, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382362619283 F1-OK: 0.910790386718 F1-score multiplied: 0.348252197883 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8249740840593008, Acc 0.8647531867027283, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.391272005951 F1-OK: 0.923925505872 F1-score multiplied: 0.361506186032 Epoch 4: Test set LL -0.847835467011303, Acc 0.8628422617912292, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369238604533 F1-OK: 0.923055417495 F1-score multiplied: 0.340827694262 Epoch 4: Test set LL -0.847835467011303, Acc 0.8628422617912292, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369238604533 F1-OK: 0.923055417495 F1-score multiplied: 0.340827694262 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9201799995555136, Acc 0.8507602214813232, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403172504957 F1-OK: 0.91471745632 F1-score multiplied: 0.368788928192 Epoch 5: Test set LL -0.9370523025016059, Acc 0.849137544631958, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.383108796558 F1-OK: 0.914060405331 F1-score multiplied: 0.350184581868 Epoch 5: Test set LL -0.9370523025016059, Acc 0.849137544631958, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.383108796558 F1-OK: 0.914060405331 F1-score multiplied: 0.350184581868 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8921412136006026, Acc 0.8574812412261963, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405150609335 F1-OK: 0.91904240338 F1-score multiplied: 0.372350589734 Epoch 6: Test set LL -0.912592370961472, Acc 0.8546748161315918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379917306556 F1-OK: 0.917692440374 F1-score multiplied: 0.348647240194 Epoch 6: Test set LL -0.912592370961472, Acc 0.8546748161315918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379917306556 F1-OK: 0.917692440374 F1-score multiplied: 0.348647240194 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.9537382002214049, Acc 0.8464081287384033, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417954070981 F1-OK: 0.911531382877 F1-score multiplied: 0.380978252301 Epoch 7: Test set LL -0.9887884942368187, Acc 0.8411362171173096, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387227680478 F1-OK: 0.908738111143 F1-score multiplied: 0.35188855094 Epoch 7: Test set LL -0.9887884942368187, Acc 0.8411362171173096, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387227680478 F1-OK: 0.908738111143 F1-score multiplied: 0.35188855094 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9523338250731312, Acc 0.8512560725212097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.408154318281 F1-OK: 0.914939197278 F1-score multiplied: 0.373436384334 Epoch 8: Test set LL -0.9701674903002182, Acc 0.8492760062217712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.38150420359 F1-OK: 0.914181222019 F1-score multiplied: 0.348763979043 Epoch 8: Test set LL -0.9701674903002182, Acc 0.8492760062217712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.38150420359 F1-OK: 0.914181222019 F1-score multiplied: 0.348763979043 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8749488167804169, Acc 0.8605663180351257, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411258432194 F1-OK: 0.920918606468 F1-score multiplied: 0.378735542274 Epoch 9: Test set LL -0.9088463936967319, Acc 0.854979395866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380997400142 F1-OK: 0.917868790768 F1-score multiplied: 0.349705622954 Epoch 9: Test set LL -0.9088463936967319, Acc 0.854979395866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380997400142 F1-OK: 0.917868790768 F1-score multiplied: 0.349705622954 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.8575648739062316, Acc 0.8646430373191833, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412903225806 F1-OK: 0.923503222392 F1-score multiplied: 0.381317459568 Epoch 10: Test set LL -0.8918720471580697, Acc 0.8596306443214417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376996805112 F1-OK: 0.920904836193 F1-score multiplied: 0.347178181057 Epoch 10: Test set LL -0.8918720471580697, Acc 0.8596306443214417, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376996805112 F1-OK: 0.920904836193 F1-score multiplied: 0.347178181057 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8968111922278876, Acc 0.8603459596633911, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412514484357 F1-OK: 0.920754009191 F1-score multiplied: 0.379824365321 Epoch 11: Test set LL -0.9201889267462456, Acc 0.8564744591712952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385345032013 F1-OK: 0.918751175475 F1-score multiplied: 0.354036201126 Epoch 11: Test set LL -0.9201889267462456, Acc 0.8564744591712952, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385345032013 F1-OK: 0.918751175475 F1-score multiplied: 0.354036201126 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9118560423046072, Acc 0.8565447330474854, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407912687585 F1-OK: 0.918385256692 F1-score multiplied: 0.374620998296 Epoch 12: Test set LL -0.9328699544596057, Acc 0.8532628417015076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377203290247 F1-OK: 0.91683404469 F1-score multiplied: 0.345832818267 Epoch 12: Test set LL -0.9328699544596057, Acc 0.8532628417015076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377203290247 F1-OK: 0.91683404469 F1-score multiplied: 0.345832818267 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -1.0386000198020764, Acc 0.8382547497749329, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.406628940986 F1-OK: 0.906365607858 F1-score multiplied: 0.36855448727 Epoch 13: Test set LL -1.0544838501420624, Acc 0.8356820344924927, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386436472656 F1-OK: 0.905138655798 F1-score multiplied: 0.349778589411 Epoch 13: Test set LL -1.0544838501420624, Acc 0.8356820344924927, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386436472656 F1-OK: 0.905138655798 F1-score multiplied: 0.349778589411 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9271774922208411, Acc 0.8542860150337219, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414434359088 F1-OK: 0.916789882656 F1-score multiplied: 0.379949227437 Epoch 14: Test set LL -0.9568056513467813, Acc 0.8516016602516174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389104171416 F1-OK: 0.91554266986 F1-score multiplied: 0.356241471951 Epoch 14: Test set LL -0.9568056513467813, Acc 0.8516016602516174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389104171416 F1-OK: 0.91554266986 F1-score multiplied: 0.356241471951 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.9408985598085798, Acc 0.8544512987136841, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407623318386 F1-OK: 0.917033036051 F1-score multiplied: 0.373804049224 Epoch 15: Test set LL -0.9552147989606866, Acc 0.8520722985267639, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385084589711 F1-OK: 0.915923145919 F1-score multiplied: 0.352707888853 Epoch 15: Test set LL -0.9552147989606866, Acc 0.8520722985267639, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385084589711 F1-OK: 0.915923145919 F1-score multiplied: 0.352707888853 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8992310292881069, Acc 0.861007034778595, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.404812455768 F1-OK: 0.921316076719 F1-score multiplied: 0.372960223555 Epoch 16: Test set LL -0.920293493553719, Acc 0.8585509061813354, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379900473358 F1-OK: 0.920170627666 F1-score multiplied: 0.349573257021 Epoch 16: Test set LL -0.920293493553719, Acc 0.8585509061813354, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379900473358 F1-OK: 0.920170627666 F1-score multiplied: 0.349573257021 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.9021988581304617, Acc 0.8617783188819885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41446907818 F1-OK: 0.921640276086 F1-score multiplied: 0.381991395643 Epoch 17: Test set LL -0.9353255675121307, Acc 0.856502115726471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381282081891 F1-OK: 0.918839354222 F1-score multiplied: 0.350336981901 Epoch 17: Test set LL -0.9353255675121307, Acc 0.856502115726471, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381282081891 F1-OK: 0.918839354222 F1-score multiplied: 0.350336981901 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9516042625129157, Acc 0.8530189394950867, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403665623603 F1-OK: 0.916179704681 F1-score multiplied: 0.369830251823 Epoch 18: Test set LL -0.9714710252328992, Acc 0.8513247966766357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382900482648 F1-OK: 0.915480987157 F1-score multiplied: 0.350538111837 Epoch 18: Test set LL -0.9714710252328992, Acc 0.8513247966766357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382900482648 F1-OK: 0.915480987157 F1-score multiplied: 0.350538111837 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9077230181203126, Acc 0.8578118085861206, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409787331351 F1-OK: 0.919169459146 F1-score multiplied: 0.376663999723 Epoch 19: Test set LL -0.9377886855117211, Acc 0.854647159576416, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382352941176 F1-OK: 0.917631554175 F1-score multiplied: 0.350859123655 Epoch 19: Test set LL -0.9377886855117211, Acc 0.854647159576416, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382352941176 F1-OK: 0.917631554175 F1-score multiplied: 0.350859123655 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.0035641277392842, Acc 0.8461326360702515, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410137275607 F1-OK: 0.911527131046 F1-score multiplied: 0.373851254169 Epoch 20: Test set LL -1.0214291564537377, Acc 0.8435726165771484, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384129060388 F1-OK: 0.910408473931 F1-score multiplied: 0.349714351661 Epoch 20: Test set LL -1.0214291564537377, Acc 0.8435726165771484, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384129060388 F1-OK: 0.910408473931 F1-score multiplied: 0.349714351661 [ 40537 106670 99084 ..., 465976 431894 328479]
Matern 52 from scratch
Epoch 1: \Dev set LL -0.7226474879774406, Acc 0.847454845905304, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405666452028 F1-OK: 0.912498024964 F1-score multiplied: 0.37016983627 Epoch 1: Test set LL -0.7486105633371489, Acc 0.8428251147270203, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.378407971094 F1-OK: 0.910038824182 F1-score multiplied: 0.344365945075 Epoch 1: Test set LL -0.7486105633371489, Acc 0.8428251147270203, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.378407971094 F1-OK: 0.910038824182 F1-score multiplied: 0.344365945075 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.9242257819728223, Acc 0.8451410531997681, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.4 F1-OK: 0.911097757677 F1-score multiplied: 0.364439103071 Epoch 2: Test set LL -0.9549360419985565, Acc 0.8416345715522766, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373768338078 F1-OK: 0.909355983773 F1-score multiplied: 0.339888474776 Epoch 2: Test set LL -0.9549360419985565, Acc 0.8416345715522766, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373768338078 F1-OK: 0.909355983773 F1-score multiplied: 0.339888474776 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.8226107769740789, Acc 0.8670669794082642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399900522258 F1-OK: 0.925254778057 F1-score multiplied: 0.370009868967 Epoch 3: Test set LL -0.8567939005474761, Acc 0.8603782057762146, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.361887890674 F1-OK: 0.921613429704 F1-score multiplied: 0.333520740093 Epoch 3: Test set LL -0.8567939005474761, Acc 0.8603782057762146, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.361887890674 F1-OK: 0.921613429704 F1-score multiplied: 0.333520740093 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8968740311212546, Acc 0.8568753004074097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403033088235 F1-OK: 0.918690535804 F1-score multiplied: 0.370262683778 Epoch 4: Test set LL -0.9234963946214886, Acc 0.8527921438217163, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377619103359 F1-OK: 0.916524059973 F1-score multiplied: 0.346096993735 Epoch 4: Test set LL -0.9234963946214886, Acc 0.8527921438217163, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377619103359 F1-OK: 0.916524059973 F1-score multiplied: 0.346096993735 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8191510331152565, Acc 0.8716394901275635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38327157226 F1-OK: 0.928365000307 F1-score multiplied: 0.355815913299 Epoch 5: Test set LL -0.8419531560000942, Acc 0.8687117695808411, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.353774870537 F1-OK: 0.926933744222 F1-score multiplied: 0.327925865358 Epoch 5: Test set LL -0.8419531560000942, Acc 0.8687117695808411, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.353774870537 F1-OK: 0.926933744222 F1-score multiplied: 0.327925865358 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.9038246318590999, Acc 0.8593543171882629, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396025550035 F1-OK: 0.920410262805 F1-score multiplied: 0.364505980586 Epoch 6: Test set LL -0.9280591033445637, Acc 0.8557268977165222, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369204696768 F1-OK: 0.918548853494 F1-score multiplied: 0.339132550921 Epoch 6: Test set LL -0.9280591033445637, Acc 0.8557268977165222, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369204696768 F1-OK: 0.918548853494 F1-score multiplied: 0.339132550921 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.8880940666576401, Acc 0.8576465249061584, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407882676444 F1-OK: 0.91909830933 F1-score multiplied: 0.374884278324 Epoch 7: Test set LL -0.9205854882356862, Acc 0.8530136346817017, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378700994734 F1-OK: 0.916647041276 F1-score multiplied: 0.347135146351 Epoch 7: Test set LL -0.9205854882356862, Acc 0.8530136346817017, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378700994734 F1-OK: 0.916647041276 F1-score multiplied: 0.347135146351 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.8707358089063796, Acc 0.8651939034461975, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409650180941 F1-OK: 0.923909325539 F1-score multiplied: 0.37847962238 Epoch 8: Test set LL -0.8882140661940403, Acc 0.8607934713363647, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379565646594 F1-OK: 0.921601646553 F1-score multiplied: 0.349808324876 Epoch 8: Test set LL -0.8882140661940403, Acc 0.8607934713363647, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379565646594 F1-OK: 0.921601646553 F1-score multiplied: 0.349808324876 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.7882897968271567, Acc 0.8784707188606262, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.345011876485 F1-OK: 0.933021617683 F1-score multiplied: 0.321903539117 Epoch 9: Test set LL -0.7918899834276609, Acc 0.8781250715255737, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342199641363 F1-OK: 0.932841058188 F1-score multiplied: 0.31921787556 Epoch 9: Test set LL -0.7918899834276609, Acc 0.8781250715255737, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.342199641363 F1-OK: 0.932841058188 F1-score multiplied: 0.31921787556 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.8905956917775395, Acc 0.8604010343551636, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397813688213 F1-OK: 0.921049351944 F1-score multiplied: 0.366406039723 Epoch 10: Test set LL -0.9032362978044609, Acc 0.8585785627365112, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378134891648 F1-OK: 0.920217418468 F1-score multiplied: 0.347966313825 Epoch 10: Test set LL -0.9032362978044609, Acc 0.8585785627365112, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378134891648 F1-OK: 0.920217418468 F1-score multiplied: 0.347966313825 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.9926738388549409, Acc 0.8453614115715027, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407430863416 F1-OK: 0.911078024519 F1-score multiplied: 0.371201306169 Epoch 11: Test set LL -1.0099121670825548, Acc 0.8425759077072144, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384232185402 F1-OK: 0.909751761793 F1-score multiplied: 0.349555907607 Epoch 11: Test set LL -1.0099121670825548, Acc 0.8425759077072144, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384232185402 F1-OK: 0.909751761793 F1-score multiplied: 0.349555907607 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9722881105306309, Acc 0.8502644300460815, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416237113402 F1-OK: 0.914117795753 F1-score multiplied: 0.380489752614 Epoch 12: Test set LL -0.992522524108499, Acc 0.8456767797470093, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385717434428 F1-OK: 0.911753530492 F1-score multiplied: 0.351679232612 Epoch 12: Test set LL -0.992522524108499, Acc 0.8456767797470093, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385717434428 F1-OK: 0.911753530492 F1-score multiplied: 0.351679232612 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9460283625018178, Acc 0.855828583240509, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412042237699 F1-OK: 0.917841333626 F1-score multiplied: 0.37818939696 Epoch 13: Test set LL -0.9754253625639167, Acc 0.8513801693916321, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386934673367 F1-OK: 0.915440597335 F1-score multiplied: 0.354215708516 Epoch 13: Test set LL -0.9754253625639167, Acc 0.8513801693916321, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386934673367 F1-OK: 0.915440597335 F1-score multiplied: 0.354215708516 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.8095948214426277, Acc 0.8770383596420288, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.363740022805 F1-OK: 0.931942919868 F1-score multiplied: 0.338984938926 Epoch 14: Test set LL -0.7983956820457581, Acc 0.8787341713905334, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35417281038 F1-OK: 0.933084820337 F1-score multiplied: 0.330473273142 Epoch 14: Test set LL -0.7983956820457581, Acc 0.8787341713905334, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35417281038 F1-OK: 0.933084820337 F1-score multiplied: 0.330473273142 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8798611180864745, Acc 0.8660202622413635, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403921568627 F1-OK: 0.924528301887 F1-score multiplied: 0.373436921939 Epoch 15: Test set LL -0.8907493077202616, Acc 0.8633959889411926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378745907832 F1-OK: 0.923261167102 F1-score multiplied: 0.3496813889 Epoch 15: Test set LL -0.8907493077202616, Acc 0.8633959889411926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378745907832 F1-OK: 0.923261167102 F1-score multiplied: 0.3496813889 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.9952768286762832, Acc 0.8487769961357117, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405200433369 F1-OK: 0.913376881568 F1-score multiplied: 0.370100708241 Epoch 16: Test set LL -1.0235471740915478, Acc 0.8445693254470825, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379942566821 F1-OK: 0.911148391998 F1-score multiplied: 0.346184058811 Epoch 16: Test set LL -1.0235471740915478, Acc 0.8445693254470825, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.379942566821 F1-OK: 0.911148391998 F1-score multiplied: 0.346184058811 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8369602710471968, Acc 0.8699867725372314, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.389865563599 F1-OK: 0.927241336786 F1-score multiplied: 0.361499466358 Epoch 17: Test set LL -0.8471509414569098, Acc 0.8693762421607971, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375264830508 F1-OK: 0.927063043008 F1-score multiplied: 0.347894155705 Epoch 17: Test set LL -0.8471509414569098, Acc 0.8693762421607971, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375264830508 F1-OK: 0.927063043008 F1-score multiplied: 0.347894155705 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -1.0310535088925674, Acc 0.8435434103012085, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.400084495142 F1-OK: 0.910041178334 F1-score multiplied: 0.364093365392 Epoch 18: Test set LL -1.039633805122709, Acc 0.841856062412262, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380880121396 F1-OK: 0.909350599886 F1-score multiplied: 0.346353566876 Epoch 18: Test set LL -1.039633805122709, Acc 0.841856062412262, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380880121396 F1-OK: 0.909350599886 F1-score multiplied: 0.346353566876 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.8538837665718708, Acc 0.8692706227302551, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.392939370683 F1-OK: 0.926747954931 F1-score multiplied: 0.364155758193 Epoch 19: Test set LL -0.8650379784976241, Acc 0.868047297000885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372564507636 F1-OK: 0.92627084558 F1-score multiplied: 0.345095641521 Epoch 19: Test set LL -0.8650379784976241, Acc 0.868047297000885, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.372564507636 F1-OK: 0.92627084558 F1-score multiplied: 0.345095641521 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.9031661029138643, Acc 0.8636513948440552, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.402318280609 F1-OK: 0.923048223114 F1-score multiplied: 0.371359174042 Epoch 20: Test set LL -0.9171762974486307, Acc 0.8615410327911377, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380527684876 F1-OK: 0.922060313255 F1-score multiplied: 0.350869476318 Epoch 20: Test set LL -0.9171762974486307, Acc 0.8615410327911377, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.380527684876 F1-OK: 0.922060313255 F1-score multiplied: 0.350869476318 [ 40537 106670 99084 ..., 465976 431894 328479]
RBF32 from scratch
Epoch 1: \Dev set LL -0.6842161778496724, Acc 0.8489973545074463, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.403482045702 F1-OK: 0.913557665016 F1-score multiplied: 0.368604115547 Epoch 1: Test set LL -0.7145277675015616, Acc 0.8446524143218994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370046031211 F1-OK: 0.911401999021 F1-score multiplied: 0.337260692576 Epoch 1: Test set LL -0.7145277675015616, Acc 0.8446524143218994, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.370046031211 F1-OK: 0.911401999021 F1-score multiplied: 0.337260692576 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.9750955838430745, Acc 0.8383648991584778, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.402200488998 F1-OK: 0.906548604918 F1-score multiplied: 0.364614292198 Epoch 2: Test set LL -1.0052391122960291, Acc 0.8348237872123718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373714045769 F1-OK: 0.90486669218 F1-score multiplied: 0.338161392417 Epoch 2: Test set LL -1.0052391122960291, Acc 0.8348237872123718, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373714045769 F1-OK: 0.90486669218 F1-score multiplied: 0.338161392417 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -1.1471971844616735, Acc 0.8185874819755554, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.4080532087 F1-OK: 0.892879216681 F1-score multiplied: 0.364342229349 Epoch 3: Test set LL -1.196864067523482, Acc 0.810958206653595, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.373463020738 F1-OK: 0.88868601239 F1-score multiplied: 0.331891362675 Epoch 3: Test set LL -1.196864067523482, Acc 0.810958206653595, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.373463020738 F1-OK: 0.88868601239 F1-score multiplied: 0.331891362675 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -1.0161187079117493, Acc 0.839356541633606, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414457831325 F1-OK: 0.906908440812 F1-score multiplied: 0.37587530559 Epoch 4: Test set LL -1.04085200947299, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.388140161725 F1-OK: 0.905706799591 F1-score multiplied: 0.351541183669 Epoch 4: Test set LL -1.04085200947299, Acc 0.8365957140922546, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.388140161725 F1-OK: 0.905706799591 F1-score multiplied: 0.351541183669 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -1.0679290055283244, Acc 0.8355553150177002, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.40691436519 F1-OK: 0.904544146334 F1-score multiplied: 0.368072007091 Epoch 5: Test set LL -1.0709377761732857, Acc 0.8351006507873535, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.387368854145 F1-OK: 0.904728389532 F1-score multiplied: 0.350463599566 Epoch 5: Test set LL -1.0709377761732857, Acc 0.8351006507873535, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.387368854145 F1-OK: 0.904728389532 F1-score multiplied: 0.350463599566 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.1071151621902025, Acc 0.8275672197341919, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409656733308 F1-OK: 0.899038771692 F1-score multiplied: 0.368297286329 Epoch 6: Test set LL -1.1150665337628016, Acc 0.8261856436729431, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386794295761 F1-OK: 0.898741935484 F1-score multiplied: 0.347628254006 Epoch 6: Test set LL -1.1150665337628016, Acc 0.8261856436729431, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386794295761 F1-OK: 0.898741935484 F1-score multiplied: 0.347628254006 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.8302649465486847, Acc 0.8711987733840942, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.38570677877 F1-OK: 0.928057111207 F1-score multiplied: 0.357957918879 Epoch 7: Test set LL -0.8506474938897199, Acc 0.8686563968658447, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35665852997 F1-OK: 0.926862358165 F1-score multiplied: 0.330573366148 Epoch 7: Test set LL -0.8506474938897199, Acc 0.8686563968658447, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.35665852997 F1-OK: 0.926862358165 F1-score multiplied: 0.330573366148 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9620372091787716, Acc 0.8506500720977783, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41611027353 F1-OK: 0.914374151164 F1-score multiplied: 0.38048047815 Epoch 8: Test set LL -0.9978487020091831, Acc 0.8464243412017822, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381812102976 F1-OK: 0.912321188651 F1-score multiplied: 0.348335271628 Epoch 8: Test set LL -0.9978487020091831, Acc 0.8464243412017822, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381812102976 F1-OK: 0.912321188651 F1-score multiplied: 0.348335271628 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.8818749615177007, Acc 0.8642023205757141, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.396572827417 F1-OK: 0.923492349235 F1-score multiplied: 0.366231972034 Epoch 9: Test set LL -0.9077695793262953, Acc 0.8605996966362, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368176684653 F1-OK: 0.921657408704 F1-score multiplied: 0.339332769123 Epoch 9: Test set LL -0.9077695793262953, Acc 0.8605996966362, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.368176684653 F1-OK: 0.921657408704 F1-score multiplied: 0.339332769123 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -1.1036874210888508, Acc 0.8321397304534912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411662483105 F1-OK: 0.902104417671 F1-score multiplied: 0.371362544598 Epoch 10: Test set LL -1.1329502228685886, Acc 0.8279575705528259, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.38426476417 F1-OK: 0.900009654684 F1-score multiplied: 0.345841997708 Epoch 10: Test set LL -1.1329502228685886, Acc 0.8279575705528259, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.38426476417 F1-OK: 0.900009654684 F1-score multiplied: 0.345841997708 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -1.0676859048231195, Acc 0.8377588987350464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416485040618 F1-OK: 0.905781105032 F1-score multiplied: 0.377244280321 Epoch 11: Test set LL -1.1015898616698523, Acc 0.8324981331825256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381896199428 F1-OK: 0.903122497998 F1-score multiplied: 0.344899049603 Epoch 11: Test set LL -1.1015898616698523, Acc 0.8324981331825256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381896199428 F1-OK: 0.903122497998 F1-score multiplied: 0.344899049603 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -1.1188630827652284, Acc 0.8287240862846375, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.406792596833 F1-OK: 0.89991307987 F1-score multiplied: 0.366077978684 Epoch 12: Test set LL -1.1619056155093377, Acc 0.8222818970680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373939334829 F1-OK: 0.896442687747 F1-score multiplied: 0.335215182368 Epoch 12: Test set LL -1.1619056155093377, Acc 0.8222818970680237, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.373939334829 F1-OK: 0.896442687747 F1-score multiplied: 0.335215182368 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -1.0358851638700262, Acc 0.8406786918640137, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414100486224 F1-OK: 0.907804131599 F1-score multiplied: 0.375922132291 Epoch 13: Test set LL -1.067112644509894, Acc 0.8364018797874451, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.382614146902 F1-OK: 0.905707948362 F1-score multiplied: 0.346536674005 Epoch 13: Test set LL -1.067112644509894, Acc 0.8364018797874451, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.382614146902 F1-OK: 0.905707948362 F1-score multiplied: 0.346536674005 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.9240431914934675, Acc 0.8592992424964905, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407699443414 F1-OK: 0.920167541885 F1-score multiplied: 0.375151794674 Epoch 14: Test set LL -0.9482804045688302, Acc 0.8556161522865295, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375673410751 F1-OK: 0.918368944197 F1-score multiplied: 0.345006793594 Epoch 14: Test set LL -0.9482804045688302, Acc 0.8556161522865295, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375673410751 F1-OK: 0.918368944197 F1-score multiplied: 0.345006793594 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -1.0171698310975534, Acc 0.8442595601081848, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.413850300643 F1-OK: 0.910199803056 F1-score multiplied: 0.37668646214 Epoch 15: Test set LL -1.0372022304023722, Acc 0.8413577079772949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.383870967742 F1-OK: 0.908958022181 F1-score multiplied: 0.348922595611 Epoch 15: Test set LL -1.0372022304023722, Acc 0.8413577079772949, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.383870967742 F1-OK: 0.908958022181 F1-score multiplied: 0.348922595611 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -1.0998670088552145, Acc 0.8330211639404297, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.408123413396 F1-OK: 0.902799602347 F1-score multiplied: 0.368453655322 Epoch 16: Test set LL -1.1356745350715884, Acc 0.8278745412826538, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.377241310227 F1-OK: 0.900136535218 F1-score multiplied: 0.339568685929 Epoch 16: Test set LL -1.1356745350715884, Acc 0.8278745412826538, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.377241310227 F1-OK: 0.900136535218 F1-score multiplied: 0.339568685929 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -1.044671340938505, Acc 0.8420559763908386, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418340434165 F1-OK: 0.908621513944 F1-score multiplied: 0.380113118635 Epoch 17: Test set LL -1.0768107812278576, Acc 0.8372324705123901, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382911724572 F1-OK: 0.906252491588 F1-score multiplied: 0.347014704452 Epoch 17: Test set LL -1.0768107812278576, Acc 0.8372324705123901, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382911724572 F1-OK: 0.906252491588 F1-score multiplied: 0.347014704452 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.904237161535608, Acc 0.8613926768302917, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.413793103448 F1-OK: 0.921404473323 F1-score multiplied: 0.381270816547 Epoch 18: Test set LL -0.9325362253730104, Acc 0.8570835590362549, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.376419424982 F1-OK: 0.919293308318 F1-score multiplied: 0.346039858507 Epoch 18: Test set LL -0.9325362253730104, Acc 0.8570835590362549, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.376419424982 F1-OK: 0.919293308318 F1-score multiplied: 0.346039858507 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -1.1556372002922206, Acc 0.8228845596313477, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403856851474 F1-OK: 0.895991718159 F1-score multiplied: 0.361852394242 Epoch 19: Test set LL -1.2068426093119804, Acc 0.8145851492881775, Outputs [1 1 1 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.369812741131 F1-OK: 0.891301877911 F1-score multiplied: 0.329614790646 Epoch 19: Test set LL -1.2068426093119804, Acc 0.8145851492881775, Outputs [1 1 1 ..., 0 0 1] Result from the previous epoch on test: F1-BAD: 0.369812741131 F1-OK: 0.891301877911 F1-score multiplied: 0.329614790646 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.0040200390347656, Acc 0.8475649952888489, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.413895361152 F1-OK: 0.912389576671 F1-score multiplied: 0.377633813348 Epoch 20: Test set LL -1.0322814430182072, Acc 0.8432957530021667, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.382500545494 F1-OK: 0.910261288686 F1-score multiplied: 0.348175439465 Epoch 20: Test set LL -1.0322814430182072, Acc 0.8432957530021667, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.382500545494 F1-OK: 0.910261288686 F1-score multiplied: 0.348175439465 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.9063762895854285, Acc 0.8628801107406616, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410887573964 F1-OK: 0.922410299573 F1-score multiplied: 0.379006930191 Epoch 21: Test set LL -0.9370162852001382, Acc 0.8577479720115662, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.379917933864 F1-OK: 0.91965849387 F1-score multiplied: 0.349394754852 Epoch 21: Test set LL -0.9370162852001382, Acc 0.8577479720115662, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.379917933864 F1-OK: 0.91965849387 F1-score multiplied: 0.349394754852 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.9868169230558514, Acc 0.8499338626861572, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409366869037 F1-OK: 0.914047709201 F1-score multiplied: 0.374180848866 Epoch 22: Test set LL -1.001446821546861, Acc 0.8480855226516724, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.384934424392 F1-OK: 0.913340808945 F1-score multiplied: 0.351576318565 Epoch 22: Test set LL -1.001446821546861, Acc 0.8480855226516724, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.384934424392 F1-OK: 0.913340808945 F1-score multiplied: 0.351576318565 [ 95635 378627 25971 ..., 420115 259761 74441] ^CTraceback (most recent call last):
svm linear 614
F1-BAD: 0.319672131148 F1-OK: 0.917553934503 F1-score multiplied: 0.293316421685
--- deep NN - baseline - 512-256-17-
0 [491470 260968 489770 ..., 43269 414732 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.417167000222 F1-OK: 0.917596755431 F1-score multiplied: 0.382791085877 Result from the previous epoch on test: F1-BAD: 0.380454545455 F1-OK: 0.914057820234 F1-score multiplied: 0.347757452516 Result from the previous epoch on test: F1-BAD: 0.380454545455 F1-OK: 0.914057820234 F1-score multiplied: 0.347757452516 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.423568191183 F1-OK: 0.911033386328 F1-score multiplied: 0.385884763554 Result from the previous epoch on test: F1-BAD: 0.384192730347 F1-OK: 0.907159014879 F1-score multiplied: 0.348523898785 Result from the previous epoch on test: F1-BAD: 0.384192730347 F1-OK: 0.907159014879 F1-score multiplied: 0.348523898785 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.426104507737 F1-OK: 0.919642016015 F1-score multiplied: 0.391863608529 Result from the previous epoch on test: F1-BAD: 0.389931350114 F1-OK: 0.916028851302 F1-score multiplied: 0.357188366732 Result from the previous epoch on test: F1-BAD: 0.389931350114 F1-OK: 0.916028851302 F1-score multiplied: 0.357188366732 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.425356988317 F1-OK: 0.916166908655 F1-score multiplied: 0.389697997061 Result from the previous epoch on test: F1-BAD: 0.396494342134 F1-OK: 0.913956725294 F1-score multiplied: 0.362378670535 Result from the previous epoch on test: F1-BAD: 0.396494342134 F1-OK: 0.913956725294 F1-score multiplied: 0.362378670535 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.421928327645 F1-OK: 0.914283906883 F1-score multiplied: 0.385762279824 Result from the previous epoch on test: F1-BAD: 0.393876886332 F1-OK: 0.911418915703 F1-score multiplied: 0.358986844661 Result from the previous epoch on test: F1-BAD: 0.393876886332 F1-OK: 0.911418915703 F1-score multiplied: 0.358986844661 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.428600040056 F1-OK: 0.908881862604 F1-score multiplied: 0.389546802718 Result from the previous epoch on test: F1-BAD: 0.401590051982 F1-OK: 0.905954154452 F1-score multiplied: 0.36382217598 Result from the previous epoch on test: F1-BAD: 0.401590051982 F1-OK: 0.905954154452 F1-score multiplied: 0.36382217598 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.426534407936 F1-OK: 0.911806769426 F1-score multiplied: 0.388916960549 Result from the previous epoch on test: F1-BAD: 0.399829587816 F1-OK: 0.910340657767 F1-score multiplied: 0.363981129967 Result from the previous epoch on test: F1-BAD: 0.399829587816 F1-OK: 0.910340657767 F1-score multiplied: 0.363981129967 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.423092955398 F1-OK: 0.912143718657 F1-score multiplied: 0.385921581674 Result from the previous epoch on test: F1-BAD: 0.392647215988 F1-OK: 0.909622938566 F1-score multiplied: 0.357160914427 Result from the previous epoch on test: F1-BAD: 0.392647215988 F1-OK: 0.909622938566 F1-score multiplied: 0.357160914427 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.414055884843 F1-OK: 0.912349588347 F1-score multiplied: 0.37776371609 Result from the previous epoch on test: F1-BAD: 0.3938190793 F1-OK: 0.910217899204 F1-score multiplied: 0.358461175027 Result from the previous epoch on test: F1-BAD: 0.3938190793 F1-OK: 0.910217899204 F1-score multiplied: 0.358461175027 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.40724801812 F1-OK: 0.917934083853 F1-score multiplied: 0.373826836414 Result from the previous epoch on test: F1-BAD: 0.389302325581 F1-OK: 0.917470693611 F1-score multiplied: 0.357173474675 Result from the previous epoch on test: F1-BAD: 0.389302325581 F1-OK: 0.917470693611 F1-score multiplied: 0.357173474675 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.416684133305 F1-OK: 0.9117432531 F1-score multiplied: 0.379908947215 Result from the previous epoch on test: F1-BAD: 0.390977443609 F1-OK: 0.909897025172 F1-score multiplied: 0.355749212849 Result from the previous epoch on test: F1-BAD: 0.390977443609 F1-OK: 0.909897025172 F1-score multiplied: 0.355749212849 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.409997807498 F1-OK: 0.915225404026 F1-score multiplied: 0.375240409017 Result from the previous epoch on test: F1-BAD: 0.389151474229 F1-OK: 0.914319989898 F1-score multiplied: 0.355808971986 Result from the previous epoch on test: F1-BAD: 0.389151474229 F1-OK: 0.914319989898 F1-score multiplied: 0.355808971986 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.407068860451 F1-OK: 0.906981931742 F1-score multiplied: 0.369204101404 Result from the previous epoch on test: F1-BAD: 0.387209902011 F1-OK: 0.905009353565 F1-score multiplied: 0.350428583113 Result from the previous epoch on test: F1-BAD: 0.387209902011 F1-OK: 0.905009353565 F1-score multiplied: 0.350428583113 [287372 332628 486601 ..., 7030 498681 343739] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.413389121339 F1-OK: 0.911051896967 F1-score multiplied: 0.376618943181 Result from the previous epoch on test: F1-BAD: 0.393418100224 F1-OK: 0.909715485297 F1-score multiplied: 0.35789853797 Result from the previous epoch on test: F1-BAD: 0.393418100224 F1-OK: 0.909715485297 F1-score multiplied: 0.35789853797 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.4132268087 F1-OK: 0.91685011636 F1-score multiplied: 0.378867047639 Result from the previous epoch on test: F1-BAD: 0.385158206237 F1-OK: 0.914864779676 F1-score multiplied: 0.35236767749 Result from the previous epoch on test: F1-BAD: 0.385158206237 F1-OK: 0.914864779676 F1-score multiplied: 0.35236767749 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.403331871986 F1-OK: 0.914246109256 F1-score multiplied: 0.368744594702 Result from the previous epoch on test: F1-BAD: 0.390428491931 F1-OK: 0.913411221602 F1-score multiplied: 0.356621765763 Result from the previous epoch on test: F1-BAD: 0.390428491931 F1-OK: 0.913411221602 F1-score multiplied: 0.356621765763 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.410920121335 F1-OK: 0.907108007271 F1-score multiplied: 0.372748932411 Result from the previous epoch on test: F1-BAD: 0.393700787402 F1-OK: 0.906496660595 F1-score multiplied: 0.356888449053 Result from the previous epoch on test: F1-BAD: 0.393700787402 F1-OK: 0.906496660595 F1-score multiplied: 0.356888449053 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.399568500539 F1-OK: 0.912122264675 F1-score multiplied: 0.364455325605 Result from the previous epoch on test: F1-BAD: 0.376601671309 F1-OK: 0.911559679433 F1-score multiplied: 0.343294898773 Result from the previous epoch on test: F1-BAD: 0.376601671309 F1-OK: 0.911559679433 F1-score multiplied: 0.343294898773 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.401599663229 F1-OK: 0.909897632555 F1-score multiplied: 0.365414582807 Result from the previous epoch on test: F1-BAD: 0.390489450573 F1-OK: 0.909524490867 F1-score multiplied: 0.355159718721 Result from the previous epoch on test: F1-BAD: 0.390489450573 F1-OK: 0.909524490867 F1-score multiplied: 0.355159718721 [486439 273925 266751 ..., 295303 199517 319098] Done!
Matern12 - pretraining Epoch 1: \Dev set LL -0.5030332533439323, Acc 0.8366020321846008, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.420929324483 F1-OK: 0.904881021102 F1-score multiplied: 0.38089095695 Epoch 1: Test set LL -0.5141602210727606, Acc 0.8344638347625732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4 F1-OK: 0.903987281808 F1-score multiplied: 0.361594912723 Epoch 1: Test set LL -0.5141602210727606, Acc 0.8344638347625732, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.4 F1-OK: 0.903987281808 F1-score multiplied: 0.361594912723 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.742116194535328, Acc 0.8572608828544617, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.42306835894 F1-OK: 0.918555307579 F1-score multiplied: 0.388611686573 Epoch 2: Test set LL -0.7709080227663822, Acc 0.853069007396698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391329280881 F1-OK: 0.916450196004 F1-score multiplied: 0.358633796165 Epoch 2: Test set LL -0.7709080227663822, Acc 0.853069007396698, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391329280881 F1-OK: 0.916450196004 F1-score multiplied: 0.358633796165 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.7809835888242473, Acc 0.8595196008682251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.421506352087 F1-OK: 0.920052671181 F1-score multiplied: 0.387808045158 Epoch 3: Test set LL -0.8091925486377144, Acc 0.853733479976654, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386767266396 F1-OK: 0.91696399101 F1-score multiplied: 0.354651656186 Epoch 3: Test set LL -0.8091925486377144, Acc 0.853733479976654, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386767266396 F1-OK: 0.91696399101 F1-score multiplied: 0.354651656186 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8727649298040638, Acc 0.8544512987136841, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.424902046147 F1-OK: 0.916682434563 F1-score multiplied: 0.389500242113 Epoch 4: Test set LL -0.9021009863968794, Acc 0.8493590354919434, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391727221912 F1-OK: 0.914034727379 F1-score multiplied: 0.358052284487 Epoch 4: Test set LL -0.9021009863968794, Acc 0.8493590354919434, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391727221912 F1-OK: 0.914034727379 F1-score multiplied: 0.358052284487 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9619660454424561, Acc 0.8445901274681091, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.430446194226 F1-OK: 0.910018819176 F1-score multiplied: 0.391714137388 Epoch 5: Test set LL -0.9846432428978636, Acc 0.8413023352622986, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397139251157 F1-OK: 0.908624262713 F1-score multiplied: 0.360850359277 Epoch 5: Test set LL -0.9846432428978636, Acc 0.8413023352622986, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397139251157 F1-OK: 0.908624262713 F1-score multiplied: 0.360850359277 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.9831446102708185, Acc 0.8438739776611328, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.423045602606 F1-OK: 0.909722222222 F1-score multiplied: 0.384853985704 Epoch 6: Test set LL -1.0103012425683975, Acc 0.8403887152671814, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395258575475 F1-OK: 0.908061558089 F1-score multiplied: 0.358919117894 Epoch 6: Test set LL -1.0103012425683975, Acc 0.8403887152671814, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395258575475 F1-OK: 0.908061558089 F1-score multiplied: 0.358919117894 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -1.0257298432438262, Acc 0.8382547497749329, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411623246493 F1-OK: 0.906240020438 F1-score multiplied: 0.373029459315 Epoch 7: Test set LL -1.0342777963256484, Acc 0.836651086807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390999174236 F1-OK: 0.905675459632 F1-score multiplied: 0.354118356842 Epoch 7: Test set LL -1.0342777963256484, Acc 0.836651086807251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390999174236 F1-OK: 0.905675459632 F1-score multiplied: 0.354118356842 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -1.0619766289126513, Acc 0.8330762386322021, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409126365055 F1-OK: 0.902809853734 F1-score multiplied: 0.369363313794 Epoch 8: Test set LL -1.0681026050162545, Acc 0.8336332440376282, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395533648526 F1-OK: 0.903542706711 F1-score multiplied: 0.357381543385 Epoch 8: Test set LL -1.0681026050162545, Acc 0.8336332440376282, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395533648526 F1-OK: 0.903542706711 F1-score multiplied: 0.357381543385 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -1.0267049309239615, Acc 0.8403481841087341, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.422479075329 F1-OK: 0.907370708943 F1-score multiplied: 0.383345138095 Epoch 9: Test set LL -1.0347446081567242, Acc 0.8380907773971558, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397734294542 F1-OK: 0.906473899693 F1-score multiplied: 0.360535757015 Epoch 9: Test set LL -1.0347446081567242, Acc 0.8380907773971558, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397734294542 F1-OK: 0.906473899693 F1-score multiplied: 0.360535757015 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -0.9428036307907918, Acc 0.852798581123352, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.42064180399 F1-OK: 0.91568850183 F1-score multiplied: 0.385176863302 Epoch 10: Test set LL -0.9537592706319639, Acc 0.8509648442268372, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395100573098 F1-OK: 0.91501286727 F1-score multiplied: 0.36152210825 Epoch 10: Test set LL -0.9537592706319639, Acc 0.8509648442268372, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395100573098 F1-OK: 0.91501286727 F1-score multiplied: 0.36152210825 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8533306890182785, Acc 0.8667364716529846, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.405797101449 F1-OK: 0.924952688239 F1-score multiplied: 0.375343119865 Epoch 11: Test set LL -0.8743738567094694, Acc 0.8635621070861816, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377934864933 F1-OK: 0.923378319547 F1-score multiplied: 0.34897686048 Epoch 11: Test set LL -0.8743738567094694, Acc 0.8635621070861816, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377934864933 F1-OK: 0.923378319547 F1-score multiplied: 0.34897686048 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.8403794392935233, Acc 0.8697664141654968, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.394777265745 F1-OK: 0.927032532872 F1-score multiplied: 0.365971368584 Epoch 12: Test set LL -0.8357447224629297, Acc 0.8697084784507751, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375862068966 F1-OK: 0.927262048286 F1-score multiplied: 0.348522631942 Epoch 12: Test set LL -0.8357447224629297, Acc 0.8697084784507751, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375862068966 F1-OK: 0.927262048286 F1-score multiplied: 0.348522631942 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -1.0021694045753315, Acc 0.8454715609550476, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415990006246 F1-OK: 0.910955207771 F1-score multiplied: 0.378948262571 Epoch 13: Test set LL -1.0162033006309925, Acc 0.8427420258522034, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389772238934 F1-OK: 0.909740982044 F1-score multiplied: 0.354591779421 Epoch 13: Test set LL -1.0162033006309925, Acc 0.8427420258522034, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389772238934 F1-OK: 0.909740982044 F1-score multiplied: 0.354591779421 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.8234784323883483, Acc 0.8717496991157532, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.384452670545 F1-OK: 0.928417686489 F1-score multiplied: 0.356932658952 Epoch 14: Test set LL -0.8198892721011737, Acc 0.8726986050605774, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.36961886482 F1-OK: 0.929200542005 F1-score multiplied: 0.343450049527 Epoch 14: Test set LL -0.8198892721011737, Acc 0.8726986050605774, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.36961886482 F1-OK: 0.929200542005 F1-score multiplied: 0.343450049527 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -1.08476950855874, Acc 0.833737313747406, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41669887901 F1-OK: 0.903051718599 F1-score multiplied: 0.376300638829 Epoch 15: Test set LL -1.1286155808130958, Acc 0.8265732526779175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3866039953 F1-OK: 0.899010092542 F1-score multiplied: 0.347560893591 Epoch 15: Test set LL -1.1286155808130958, Acc 0.8265732526779175, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3866039953 F1-OK: 0.899010092542 F1-score multiplied: 0.347560893591 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.9486817000158589, Acc 0.8525782227516174, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.430395913155 F1-OK: 0.915332531798 F1-score multiplied: 0.393955380863 Epoch 16: Test set LL -0.97960245281481, Acc 0.846950352191925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394656154183 F1-OK: 0.912401356448 F1-score multiplied: 0.360084810407 Epoch 16: Test set LL -0.97960245281481, Acc 0.846950352191925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394656154183 F1-OK: 0.912401356448 F1-score multiplied: 0.360084810407 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8984033427094908, Acc 0.86089688539505, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419673638244 F1-OK: 0.920977685976 F1-score multiplied: 0.386510056215 Epoch 17: Test set LL -0.9149894330463385, Acc 0.8583847880363464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396744899163 F1-OK: 0.919776031619 F1-score multiplied: 0.364916448917 Epoch 17: Test set LL -0.9149894330463385, Acc 0.8583847880363464, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396744899163 F1-OK: 0.919776031619 F1-score multiplied: 0.364916448917 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9459367279175103, Acc 0.852523148059845, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.434874393076 F1-OK: 0.915196249248 F1-score multiplied: 0.397995413437 Epoch 18: Test set LL -0.9748686125740975, Acc 0.8486392498016357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399032648126 F1-OK: 0.913416005448 F1-score multiplied: 0.364482807494 Epoch 18: Test set LL -0.9748686125740975, Acc 0.8486392498016357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399032648126 F1-OK: 0.913416005448 F1-score multiplied: 0.364482807494 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9280472245817782, Acc 0.8552225828170776, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.429439861051 F1-OK: 0.917092561045 F1-score multiplied: 0.393836101986 Epoch 19: Test set LL -0.9616698900383532, Acc 0.85005122423172, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395940218604 F1-OK: 0.914401314958 F1-score multiplied: 0.362048256536 Epoch 19: Test set LL -0.9616698900383532, Acc 0.85005122423172, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395940218604 F1-OK: 0.914401314958 F1-score multiplied: 0.362048256536 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.8990239140348307, Acc 0.8591339588165283, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415275554539 F1-OK: 0.919921079828 F1-score multiplied: 0.382020736558 Epoch 20: Test set LL -0.9303188353208192, Acc 0.8564467430114746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39603960396 F1-OK: 0.918542723831 F1-score multiplied: 0.363779296567 Epoch 20: Test set LL -0.9303188353208192, Acc 0.8564467430114746, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39603960396 F1-OK: 0.918542723831 F1-score multiplied: 0.363779296567 [ 40537 106670 99084 ..., 465976 431894 328479]
Matern32 - pretraining
Epoch 1: \Dev set LL -0.6921804734749115, Acc 0.8421110510826111, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.424959871589 F1-OK: 0.908492975734 F1-score multiplied: 0.386073058308 Epoch 1: Test set LL -0.7145237090601163, Acc 0.8393089771270752, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.400289315974 F1-OK: 0.907225063939 F1-score multiplied: 0.363152500279 Epoch 1: Test set LL -0.7145237090601163, Acc 0.8393089771270752, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.400289315974 F1-OK: 0.907225063939 F1-score multiplied: 0.363152500279 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.834508731975681, Acc 0.8489422798156738, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.42346509672 F1-OK: 0.913084823127 F1-score multiplied: 0.386659552939 Epoch 2: Test set LL -0.8551948975636888, Acc 0.846950352191925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395979020979 F1-OK: 0.912373585265 F1-score multiplied: 0.36128079906 Epoch 2: Test set LL -0.8551948975636888, Acc 0.846950352191925, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395979020979 F1-OK: 0.912373585265 F1-score multiplied: 0.36128079906 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.9790050565484714, Acc 0.8405685424804688, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419341894061 F1-OK: 0.907598978289 F1-score multiplied: 0.380594274603 Epoch 3: Test set LL -0.9987900277967915, Acc 0.8375924229621887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392250310816 F1-OK: 0.906272968395 F1-score multiplied: 0.355485853538 Epoch 3: Test set LL -0.9987900277967915, Acc 0.8375924229621887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392250310816 F1-OK: 0.906272968395 F1-score multiplied: 0.355485853538 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8643871928990291, Acc 0.8579220175743103, Outputs [0 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414794644883 F1-OK: 0.919146001191 F1-score multiplied: 0.38125683916 Epoch 4: Test set LL -0.8911187036094247, Acc 0.8538442254066467, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386091405977 F1-OK: 0.917047722309 F1-score multiplied: 0.354064244455 Epoch 4: Test set LL -0.8911187036094247, Acc 0.8538442254066467, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386091405977 F1-OK: 0.917047722309 F1-score multiplied: 0.354064244455 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9056448932313583, Acc 0.8534596562385559, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.42199043894 F1-OK: 0.916093621854 F1-score multiplied: 0.386582749596 Epoch 5: Test set LL -0.9478423930123617, Acc 0.8485838770866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386264167882 F1-OK: 0.913638732294 F1-score multiplied: 0.352905904675 Epoch 5: Test set LL -0.9478423930123617, Acc 0.8485838770866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.386264167882 F1-OK: 0.913638732294 F1-score multiplied: 0.352905904675 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -0.8491887635873089, Acc 0.8641471862792969, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417847025496 F1-OK: 0.923100910565 F1-score multiplied: 0.385714969712 Epoch 6: Test set LL -0.8855210329901473, Acc 0.8586062788963318, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381494489524 F1-OK: 0.920179428268 F1-score multiplied: 0.351043381258 Epoch 6: Test set LL -0.8855210329901473, Acc 0.8586062788963318, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381494489524 F1-OK: 0.920179428268 F1-score multiplied: 0.351043381258 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.8602578198898466, Acc 0.8651939034461975, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414172851329 F1-OK: 0.923833535655 F1-score multiplied: 0.382626769615 Epoch 7: Test set LL -0.8803391572009059, Acc 0.8623992800712585, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381225099602 F1-OK: 0.92259290409 F1-score multiplied: 0.351715571753 Epoch 7: Test set LL -0.8803391572009059, Acc 0.8623992800712585, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381225099602 F1-OK: 0.92259290409 F1-score multiplied: 0.351715571753 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9408823009109445, Acc 0.8537902235984802, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41412803532 F1-OK: 0.91647258765 F1-score multiplied: 0.379536992148 Epoch 8: Test set LL -0.9656955494048964, Acc 0.8507433533668518, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382827704637 F1-OK: 0.915106372927 F1-score multiplied: 0.350328072246 Epoch 8: Test set LL -0.9656955494048964, Acc 0.8507433533668518, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382827704637 F1-OK: 0.915106372927 F1-score multiplied: 0.350328072246 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.9428353299550182, Acc 0.8527435064315796, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417773905467 F1-OK: 0.915712799168 F1-score multiplied: 0.382560912395 Epoch 9: Test set LL -0.967055725602282, Acc 0.8492482900619507, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.391552128729 F1-OK: 0.913966092054 F1-score multiplied: 0.35786536893 Epoch 9: Test set LL -0.967055725602282, Acc 0.8492482900619507, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.391552128729 F1-OK: 0.913966092054 F1-score multiplied: 0.35786536893 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -1.1478768458430182, Acc 0.8237108588218689, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419237749546 F1-OK: 0.89608365266 F1-score multiplied: 0.375672093946 Epoch 10: Test set LL -1.1773117546758676, Acc 0.8185996413230896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394118734973 F1-OK: 0.89333159677 F1-score multiplied: 0.352078718831 Epoch 10: Test set LL -1.1773117546758676, Acc 0.8185996413230896, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394118734973 F1-OK: 0.89333159677 F1-score multiplied: 0.352078718831 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -1.0648635948493301, Acc 0.8371529579162598, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409508589692 F1-OK: 0.905553070484 F1-score multiplied: 0.370831760785 Epoch 11: Test set LL -1.0803354250490333, Acc 0.8350175619125366, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389759344598 F1-OK: 0.904614793591 F1-score multiplied: 0.352582069064 Epoch 11: Test set LL -1.0803354250490333, Acc 0.8350175619125366, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389759344598 F1-OK: 0.904614793591 F1-score multiplied: 0.352582069064 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.8720847843864663, Acc 0.8651939034461975, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.409079932383 F1-OK: 0.92391878867 F1-score multiplied: 0.377956635597 Epoch 12: Test set LL -0.8852601132690385, Acc 0.8633959889411926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385554171856 F1-OK: 0.923155993023 F1-score multiplied: 0.355926644383 Epoch 12: Test set LL -0.8852601132690385, Acc 0.8633959889411926, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385554171856 F1-OK: 0.923155993023 F1-score multiplied: 0.355926644383 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9766167133180441, Acc 0.8499338626861572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416202314616 F1-OK: 0.91390100512 F1-score multiplied: 0.380367713661 Epoch 13: Test set LL -0.9844222787864103, Acc 0.8485838770866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387089543875 F1-OK: 0.913622364369 F1-score multiplied: 0.353653664298 Epoch 13: Test set LL -0.9844222787864103, Acc 0.8485838770866394, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387089543875 F1-OK: 0.913622364369 F1-score multiplied: 0.353653664298 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -1.049376889463861, Acc 0.8416152596473694, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416953964713 F1-OK: 0.908360692315 F1-score multiplied: 0.37874459205 Epoch 14: Test set LL -1.0744504387148461, Acc 0.8368448615074158, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381572043236 F1-OK: 0.906026248226 F1-score multiplied: 0.345714286761 Epoch 14: Test set LL -1.0744504387148461, Acc 0.8368448615074158, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381572043236 F1-OK: 0.906026248226 F1-score multiplied: 0.345714286761 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.9903079195832613, Acc 0.8478404879570007, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419259882254 F1-OK: 0.912450868518 F1-score multiplied: 0.382554043697 Epoch 15: Test set LL -1.0160670226925084, Acc 0.8438771963119507, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388858784003 F1-OK: 0.910507689134 F1-score multiplied: 0.354058912822 Epoch 15: Test set LL -1.0160670226925084, Acc 0.8438771963119507, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388858784003 F1-OK: 0.910507689134 F1-score multiplied: 0.354058912822 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -1.0964444473851767, Acc 0.8331864476203918, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417244033872 F1-OK: 0.902661694741 F1-score multiplied: 0.376630206736 Epoch 16: Test set LL -1.121459974465028, Acc 0.8290373682975769, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392164583128 F1-OK: 0.900529969877 F1-score multiplied: 0.353155960231 Epoch 16: Test set LL -1.121459974465028, Acc 0.8290373682975769, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392164583128 F1-OK: 0.900529969877 F1-score multiplied: 0.353155960231 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -0.8951446235029917, Acc 0.8607866764068604, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416262416262 F1-OK: 0.920969507428 F1-score multiplied: 0.383364992466 Epoch 17: Test set LL -0.9311840700654763, Acc 0.8566128611564636, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384258708834 F1-OK: 0.918858790167 F1-score multiplied: 0.35307949231 Epoch 17: Test set LL -0.9311840700654763, Acc 0.8566128611564636, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384258708834 F1-OK: 0.918858790167 F1-score multiplied: 0.35307949231 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9685727558054725, Acc 0.8508153557777405, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.433946488294 F1-OK: 0.914086294416 F1-score multiplied: 0.39666453746 Epoch 18: Test set LL -1.0120521246314402, Acc 0.8444585800170898, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395393887215 F1-OK: 0.910748895879 F1-score multiplied: 0.360104546218 Epoch 18: Test set LL -1.0120521246314402, Acc 0.8444585800170898, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395393887215 F1-OK: 0.910748895879 F1-score multiplied: 0.360104546218 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -0.9237506231809319, Acc 0.8590788841247559, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418371987267 F1-OK: 0.919826991788 F1-score multiplied: 0.384829846496 Epoch 19: Test set LL -0.9412973341846285, Acc 0.8555054068565369, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.39587915268 F1-OK: 0.917938961304 F1-score multiplied: 0.363392898213 Epoch 19: Test set LL -0.9412973341846285, Acc 0.8555054068565369, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on test: F1-BAD: 0.39587915268 F1-OK: 0.917938961304 F1-score multiplied: 0.363392898213 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -0.9355042653373867, Acc 0.8559938073158264, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414688759516 F1-OK: 0.917896852817 F1-score multiplied: 0.380641507259 Epoch 20: Test set LL -0.9631434348997697, Acc 0.85273677110672, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387987573352 F1-OK: 0.916298173006 F1-score multiplied: 0.355512304611 Epoch 20: Test set LL -0.9631434348997697, Acc 0.85273677110672, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387987573352 F1-OK: 0.916298173006 F1-score multiplied: 0.355512304611 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.9355543854810515, Acc 0.8573160171508789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.415877311682 F1-OK: 0.918732350173 F1-score multiplied: 0.382079939945 Epoch 21: Test set LL -0.9480483529233533, Acc 0.8553116321563721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395418787598 F1-OK: 0.917822436079 F1-score multiplied: 0.362924234905 Epoch 21: Test set LL -0.9480483529233533, Acc 0.8553116321563721, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.395418787598 F1-OK: 0.917822436079 F1-score multiplied: 0.362924234905 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.9789670449435732, Acc 0.8512560725212097, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419853889128 F1-OK: 0.914691943128 F1-score multiplied: 0.384036969676 Epoch 22: Test set LL -1.003643400341101, Acc 0.8473103046417236, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394554835877 F1-OK: 0.9126391991 F1-score multiplied: 0.360086209416 Epoch 22: Test set LL -1.003643400341101, Acc 0.8473103046417236, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394554835877 F1-OK: 0.9126391991 F1-score multiplied: 0.360086209416 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -0.8660694300791347, Acc 0.8676179051399231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414616321559 F1-OK: 0.925370353117 F1-score multiplied: 0.383673651889 Epoch 23: Test set LL -0.884998849641432, Acc 0.8653063774108887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392102961389 F1-OK: 0.924262473729 F1-score multiplied: 0.36240605305 Epoch 23: Test set LL -0.884998849641432, Acc 0.8653063774108887, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.392102961389 F1-OK: 0.924262473729 F1-score multiplied: 0.36240605305 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.9679214101174383, Acc 0.8523578643798828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.421915444349 F1-OK: 0.915371984338 F1-score multiplied: 0.386209577516 Epoch 24: Test set LL -0.9904500049355909, Acc 0.8484731316566467, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389787044264 F1-OK: 0.91349634102 F1-score multiplied: 0.356069038712 Epoch 24: Test set LL -0.9904500049355909, Acc 0.8484731316566467, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389787044264 F1-OK: 0.91349634102 F1-score multiplied: 0.356069038712 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -1.1324916871223385, Acc 0.8277875781059265, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418093819806 F1-OK: 0.898939609466 F1-score multiplied: 0.375841095097 Epoch 25: Test set LL -1.1676175302692722, Acc 0.8233339786529541, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388968687159 F1-OK: 0.896739218383 F1-score multiplied: 0.348803476498 Epoch 25: Test set LL -1.1676175302692722, Acc 0.8233339786529541, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388968687159 F1-OK: 0.896739218383 F1-score multiplied: 0.348803476498 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.916084440082629, Acc 0.8605663180351257, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418294644909 F1-OK: 0.920789910181 F1-score multiplied: 0.385161488515 Epoch 26: Test set LL -0.9370574799365134, Acc 0.8567236065864563, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388947927736 F1-OK: 0.918847715975 F1-score multiplied: 0.357383915034 Epoch 26: Test set LL -0.9370574799365134, Acc 0.8567236065864563, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388947927736 F1-OK: 0.918847715975 F1-score multiplied: 0.357383915034 [119698 10816 551151 ..., 126647 315313 223345] Epoch 27: \Dev set LL -0.8853132185759538, Acc 0.8647531867027283, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412538884901 F1-OK: 0.923579766537 F1-score multiplied: 0.381012567004 Epoch 27: Test set LL -0.8957887585884851, Acc 0.863783597946167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389880952381 F1-OK: 0.923333437218 F1-score multiplied: 0.359990119868 Epoch 27: Test set LL -0.8957887585884851, Acc 0.863783597946167, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389880952381 F1-OK: 0.923333437218 F1-score multiplied: 0.359990119868 [255352 453736 505023 ..., 246196 430507 97061] ^CTraceback (most recent call last):
RBF - pretraining
Epoch 1: \Dev set LL -0.7256313862488453, Acc 0.8551674485206604, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417202394148 F1-OK: 0.917308841569 F1-score multiplied: 0.382703444875 Epoch 1: Test set LL -0.7434474427391696, Acc 0.8532628417015076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39621781727 F1-OK: 0.916482823826 F1-score multiplied: 0.363126824022 Epoch 1: Test set LL -0.7434474427391696, Acc 0.8532628417015076, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.39621781727 F1-OK: 0.916482823826 F1-score multiplied: 0.363126824022 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.9424366231967581, Acc 0.8318091630935669, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41969207375 F1-OK: 0.901652546468 F1-score multiplied: 0.378416427029 Epoch 2: Test set LL -0.9690052117652529, Acc 0.8278191685676575, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396154966502 F1-OK: 0.899594762589 F1-score multiplied: 0.356378933038 Epoch 2: Test set LL -0.9690052117652529, Acc 0.8278191685676575, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396154966502 F1-OK: 0.899594762589 F1-score multiplied: 0.356378933038 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.9081045119640754, Acc 0.8507602214813232, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.426180893878 F1-OK: 0.914226007662 F1-score multiplied: 0.389625657152 Epoch 3: Test set LL -0.9313817650195501, Acc 0.8474764227867126, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397462539648 F1-OK: 0.912687217688 F1-score multiplied: 0.362758979446 Epoch 3: Test set LL -0.9313817650195501, Acc 0.8474764227867126, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397462539648 F1-OK: 0.912687217688 F1-score multiplied: 0.362758979446 [ 73496 37439 143952 ..., 401484 225891 300836]
Epoch 4: \Dev set LL -1.1653481211379237, Acc 0.8216725587844849, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.410489892551 F1-OK: 0.894946937981 F1-score multiplied: 0.367366672411 Epoch 4: Test set LL -1.21815821323972, Acc 0.813200831413269, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.377869986169 F1-OK: 0.890101477367 F1-score multiplied: 0.336342632941 Epoch 4: Test set LL -1.21815821323972, Acc 0.813200831413269, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.377869986169 F1-OK: 0.890101477367 F1-score multiplied: 0.336342632941 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.8087939691186301, Acc 0.872410774230957, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.358448753463 F1-OK: 0.929161314003 F1-score multiplied: 0.33305671477 Epoch 5: Test set LL -0.8145745424599783, Acc 0.8725601434707642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.345141556409 F1-OK: 0.929411584291 F1-score multiplied: 0.320778560747 Epoch 5: Test set LL -0.8145745424599783, Acc 0.8725601434707642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.345141556409 F1-OK: 0.929411584291 F1-score multiplied: 0.320778560747 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.135622269139451, Acc 0.8231049180030823, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414158000365 F1-OK: 0.895824546605 F1-score multiplied: 0.3710129029 Epoch 6: Test set LL -1.1562321279901755, Acc 0.8200393319129944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390815370197 F1-OK: 0.894425675676 F1-score multiplied: 0.349555301553 Epoch 6: Test set LL -1.1562321279901755, Acc 0.8200393319129944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.390815370197 F1-OK: 0.894425675676 F1-score multiplied: 0.349555301553 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -1.1340182041942082, Acc 0.8260246515274048, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.421187683284 F1-OK: 0.897627074689 F1-score multiplied: 0.378069468042 Epoch 7: Test set LL -1.1914538883775891, Acc 0.817409098148346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385081585082 F1-OK: 0.892786890576 F1-score multiplied: 0.343795790963 Epoch 7: Test set LL -1.1914538883775891, Acc 0.817409098148346, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385081585082 F1-OK: 0.892786890576 F1-score multiplied: 0.343795790963 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -1.1881821924967786, Acc 0.8139598965644836, Outputs [1 1 1 ..., 1 0 1] Result from the previous epoch on dev: F1-BAD: 0.41095412524 F1-OK: 0.889535834615 F1-score multiplied: 0.365558420783 Epoch 8: Test set LL -1.223124308838446, Acc 0.8094631433486938, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.389352262644 F1-OK: 0.887121112715 F1-score multiplied: 0.345402612475 Epoch 8: Test set LL -1.223124308838446, Acc 0.8094631433486938, Outputs [1 1 1 ..., 0 1 1] Result from the previous epoch on test: F1-BAD: 0.389352262644 F1-OK: 0.887121112715 F1-score multiplied: 0.345402612475 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.9123278992521223, Acc 0.8597399592399597, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.407079646018 F1-OK: 0.920462355514 F1-score multiplied: 0.374701489855 Epoch 9: Test set LL -0.9403274972204011, Acc 0.8549240231513977, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375149057954 F1-OK: 0.917935225208 F1-score multiplied: 0.344362534999 Epoch 9: Test set LL -0.9403274972204011, Acc 0.8549240231513977, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.375149057954 F1-OK: 0.917935225208 F1-score multiplied: 0.344362534999 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -1.013597954865763, Acc 0.8450859189033508, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.4199669967 F1-OK: 0.910605289929 F1-score multiplied: 0.38242416879 Epoch 10: Test set LL -1.0452048211529603, Acc 0.8398073315620422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388372093023 F1-OK: 0.90783395457 F1-score multiplied: 0.352577373054 Epoch 10: Test set LL -1.0452048211529603, Acc 0.8398073315620422, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388372093023 F1-OK: 0.90783395457 F1-score multiplied: 0.352577373054 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -1.1017746410842622, Acc 0.8325253129005432, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.422711735663 F1-OK: 0.902055544816 F1-score multiplied: 0.381309465013 Epoch 11: Test set LL -1.1356587522283275, Acc 0.8266286253929138, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3893114882 F1-OK: 0.898973928756 F1-score multiplied: 0.349980878057 Epoch 11: Test set LL -1.1356587522283275, Acc 0.8266286253929138, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3893114882 F1-OK: 0.898973928756 F1-score multiplied: 0.349980878057 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -0.9668127848967135, Acc 0.8501542806625366, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414550150667 F1-OK: 0.914081748689 F1-score multiplied: 0.378932726641 Epoch 12: Test set LL -0.9818102236692121, Acc 0.8487222790718079, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398899889989 F1-OK: 0.913473110787 F1-score multiplied: 0.364384323401 Epoch 12: Test set LL -0.9818102236692121, Acc 0.8487222790718079, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398899889989 F1-OK: 0.913473110787 F1-score multiplied: 0.364384323401 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9465078681610537, Acc 0.8534596562385559, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419213973799 F1-OK: 0.916151809356 F1-score multiplied: 0.384063640603 Epoch 13: Test set LL -0.9609912869859186, Acc 0.8517124056816101, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398066981344 F1-OK: 0.915440479949 F1-score multiplied: 0.364406628454 Epoch 13: Test set LL -0.9609912869859186, Acc 0.8517124056816101, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398066981344 F1-OK: 0.915440479949 F1-score multiplied: 0.364406628454 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.967002416378982, Acc 0.85114586353302, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.424126172208 F1-OK: 0.914526129318 F1-score multiplied: 0.387874466612 Epoch 14: Test set LL -0.9939137982214981, Acc 0.8464797139167786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398524785769 F1-OK: 0.912010663451 F1-score multiplied: 0.36345885427 Epoch 14: Test set LL -0.9939137982214981, Acc 0.8464797139167786, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.398524785769 F1-OK: 0.912010663451 F1-score multiplied: 0.36345885427 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -0.8606057597671388, Acc 0.8677831888198853, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399098647972 F1-OK: 0.925719591458 F1-score multiplied: 0.369453437352 Epoch 15: Test set LL -0.8542731693011697, Acc 0.8672720789909363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382057231245 F1-OK: 0.925651364764 F1-score multiplied: 0.35365179752 Epoch 15: Test set LL -0.8542731693011697, Acc 0.8672720789909363, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.382057231245 F1-OK: 0.925651364764 F1-score multiplied: 0.35365179752 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -1.074504460623399, Acc 0.8356103897094727, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.421481194261 F1-OK: 0.904193154819 F1-score multiplied: 0.381100410736 Epoch 16: Test set LL -1.0951842998170513, Acc 0.8331072330474854, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397441023591 F1-OK: 0.903139762831 F1-score multiplied: 0.358944791785 Epoch 16: Test set LL -1.0951842998170513, Acc 0.8331072330474854, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.397441023591 F1-OK: 0.903139762831 F1-score multiplied: 0.358944791785 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -1.1275893378879527, Acc 0.8275672197341919, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417132216015 F1-OK: 0.898816835844 F1-score multiplied: 0.374925458527 Epoch 17: Test set LL -1.1667127219437172, Acc 0.8215343952178955, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385861280488 F1-OK: 0.895597810243 F1-score multiplied: 0.345576517862 Epoch 17: Test set LL -1.1667127219437172, Acc 0.8215343952178955, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385861280488 F1-OK: 0.895597810243 F1-score multiplied: 0.345576517862 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -0.9855593354130009, Acc 0.8481159210205078, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.414525376938 F1-OK: 0.912739357493 F1-score multiplied: 0.378353626211 Epoch 18: Test set LL -1.0111436042223845, Acc 0.8452337980270386, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391730141458 F1-OK: 0.911337393732 F1-score multiplied: 0.356998326163 Epoch 18: Test set LL -1.0111436042223845, Acc 0.8452337980270386, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391730141458 F1-OK: 0.911337393732 F1-score multiplied: 0.356998326163 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -1.068298438520442, Acc 0.837593674659729, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41345005969 F1-OK: 0.905748449389 F1-score multiplied: 0.374481750464 Epoch 19: Test set LL -1.0844721251298746, Acc 0.8353221416473389, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394173966185 F1-OK: 0.904710028837 F1-score multiplied: 0.356613140314 Epoch 19: Test set LL -1.0844721251298746, Acc 0.8353221416473389, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.394173966185 F1-OK: 0.904710028837 F1-score multiplied: 0.356613140314 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.1130105283230736, Acc 0.8313684463500977, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.404590546586 F1-OK: 0.90177454032 F1-score multiplied: 0.364849454166 Epoch 20: Test set LL -1.1197133850731096, Acc 0.8297848701477051, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389352403655 F1-OK: 0.901109860061 F1-score multiplied: 0.350849289972 Epoch 20: Test set LL -1.1197133850731096, Acc 0.8297848701477051, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389352403655 F1-OK: 0.901109860061 F1-score multiplied: 0.350849289972 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -0.9053802751174073, Acc 0.8595196008682251, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41135734072 F1-OK: 0.920242712373 F1-score multiplied: 0.378548594979 Epoch 21: Test set LL -0.9277564796194049, Acc 0.8569728136062622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.38820464235 F1-OK: 0.919020597548 F1-score multiplied: 0.356768062383 Epoch 21: Test set LL -0.9277564796194049, Acc 0.8569728136062622, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.38820464235 F1-OK: 0.919020597548 F1-score multiplied: 0.356768062383 [212561 356922 152295 ..., 524049 198795 528463] Epoch 22: \Dev set LL -0.9477274301917136, Acc 0.8544512987136841, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.420105355575 F1-OK: 0.916782159506 F1-score multiplied: 0.385145095104 Epoch 22: Test set LL -0.9534246133696324, Acc 0.8540103435516357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.400863538234 F1-OK: 0.916878162587 F1-score multiplied: 0.367543024384 Epoch 22: Test set LL -0.9534246133696324, Acc 0.8540103435516357, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.400863538234 F1-OK: 0.916878162587 F1-score multiplied: 0.367543024384 [ 95635 378627 25971 ..., 420115 259761 74441] Epoch 23: \Dev set LL -1.0040713701919823, Acc 0.846077561378479, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.420091324201 F1-OK: 0.911262148256 F1-score multiplied: 0.382813322555 Epoch 23: Test set LL -1.0241060324513853, Acc 0.8440709710121155, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399957383337 F1-OK: 0.910392668491 F1-score multiplied: 0.364118269499 Epoch 23: Test set LL -1.0241060324513853, Acc 0.8440709710121155, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.399957383337 F1-OK: 0.910392668491 F1-score multiplied: 0.364118269499 [485069 313969 289735 ..., 30221 333017 288627] Epoch 24: \Dev set LL -0.9295606983559888, Acc 0.8569854497909546, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417414721724 F1-OK: 0.918487817131 F1-score multiplied: 0.383390336594 Epoch 24: Test set LL -0.9522597101430024, Acc 0.8543702960014343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391485423415 F1-OK: 0.917287794446 F1-score multiplied: 0.359104800602 Epoch 24: Test set LL -0.9522597101430024, Acc 0.8543702960014343, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391485423415 F1-OK: 0.917287794446 F1-score multiplied: 0.359104800602 [209130 518923 324077 ..., 124771 425901 349907] Epoch 25: \Dev set LL -0.845493618617476, Acc 0.8710334897041321, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.397736043221 F1-OK: 0.927784804269 F1-score multiplied: 0.369013457011 Epoch 25: Test set LL -0.8592992338469566, Acc 0.8689886331558228, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376054852321 F1-OK: 0.926810406162 F1-score multiplied: 0.348531550419 Epoch 25: Test set LL -0.8592992338469566, Acc 0.8689886331558228, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.376054852321 F1-OK: 0.926810406162 F1-score multiplied: 0.348531550419 [360247 140109 475577 ..., 284869 401264 117631] Epoch 26: \Dev set LL -0.8415189535986783, Acc 0.871584415435791, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.395016869971 F1-OK: 0.928168623463 F1-score multiplied: 0.366642264446 Epoch 26: Test set LL -0.8401870278705866, Acc 0.871231198310852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377459510106 F1-OK: 0.928188738092 F1-score multiplied: 0.350353666366 Epoch 26: Test set LL -0.8401870278705866, Acc 0.871231198310852, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.377459510106 F1-OK: 0.928188738092 F1-score multiplied: 0.350353666366 [119698 10816 551151 ..., 126647 315313 223345]
Matern52 - pretraining
[491470 260968 489770 ..., 43269 414732 159419] Epoch 1: \Dev set LL -0.8616309089805793, Acc 0.8298259377479553, Outputs [1 0 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.42099343955 F1-OK: 0.900255093803 F1-score multiplied: 0.379001488413 Epoch 1: Test set LL -0.8751985071680012, Acc 0.8254104256629944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396323951752 F1-OK: 0.897947954428 F1-score multiplied: 0.355878281766 Epoch 1: Test set LL -0.8751985071680012, Acc 0.8254104256629944, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.396323951752 F1-OK: 0.897947954428 F1-score multiplied: 0.355878281766 [340070 257106 257098 ..., 129183 218369 446289] Epoch 2: \Dev set LL -0.9327728405616157, Acc 0.8414499759674072, Outputs [1 1 0 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416936790924 F1-OK: 0.908250446315 F1-score multiplied: 0.378683026442 Epoch 2: Test set LL -0.9632810167103091, Acc 0.8377308249473572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389669894825 F1-OK: 0.906426119582 F1-score multiplied: 0.353206970684 Epoch 2: Test set LL -0.9632810167103091, Acc 0.8377308249473572, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389669894825 F1-OK: 0.906426119582 F1-score multiplied: 0.353206970684 [472030 88008 511958 ..., 479005 325808 365441] Epoch 3: \Dev set LL -0.82719814766785, Acc 0.8645879030227661, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.411398467433 F1-OK: 0.923493525896 F1-score multiplied: 0.379923821238 Epoch 3: Test set LL -0.8512731899204367, Acc 0.8616240620613098, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387950036738 F1-OK: 0.921994006742 F1-score multiplied: 0.357687608788 Epoch 3: Test set LL -0.8512731899204367, Acc 0.8616240620613098, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387950036738 F1-OK: 0.921994006742 F1-score multiplied: 0.357687608788 [ 73496 37439 143952 ..., 401484 225891 300836] Epoch 4: \Dev set LL -0.8620516651763013, Acc 0.8619986772537231, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.412936489337 F1-OK: 0.921809158161 F1-score multiplied: 0.380648637609 Epoch 4: Test set LL -0.888566501521089, Acc 0.8580248355865479, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388504650608 F1-OK: 0.919689281463 F1-score multiplied: 0.357303562963 Epoch 4: Test set LL -0.888566501521089, Acc 0.8580248355865479, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388504650608 F1-OK: 0.919689281463 F1-score multiplied: 0.357303562963 [510679 511318 18562 ..., 84939 68253 433525] Epoch 5: \Dev set LL -0.9649160313706274, Acc 0.8470692038536072, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.423588039867 F1-OK: 0.911839430894 F1-score multiplied: 0.386244277206 Epoch 5: Test set LL -1.0072148789076307, Acc 0.8409978151321411, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387674592174 F1-OK: 0.908636790277 F1-score multiplied: 0.352255397105 Epoch 5: Test set LL -1.0072148789076307, Acc 0.8409978151321411, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387674592174 F1-OK: 0.908636790277 F1-score multiplied: 0.352255397105 [147162 465190 283137 ..., 55498 258345 405116] Epoch 6: \Dev set LL -1.0747908853984465, Acc 0.8339025974273682, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.421638212162 F1-OK: 0.903026599337 F1-score multiplied: 0.380750520879 Epoch 6: Test set LL -1.113691199043351, Acc 0.8274592161178589, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389019607843 F1-OK: 0.899545439892 F1-score multiplied: 0.349940814264 Epoch 6: Test set LL -1.113691199043351, Acc 0.8274592161178589, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389019607843 F1-OK: 0.899545439892 F1-score multiplied: 0.349940814264 [525358 348717 381830 ..., 40299 131805 164902] Epoch 7: \Dev set LL -0.8534077163075675, Acc 0.8673424124717712, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.403369672944 F1-OK: 0.925374984505 F1-score multiplied: 0.37326820485 Epoch 7: Test set LL -0.863820793198256, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381620931717 F1-OK: 0.924770585221 F1-score multiplied: 0.352911812356 Epoch 7: Test set LL -0.863820793198256, Acc 0.8658600449562073, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.381620931717 F1-OK: 0.924770585221 F1-score multiplied: 0.352911812356 [303145 549858 540060 ..., 519941 442145 502538] Epoch 8: \Dev set LL -0.9359528284609088, Acc 0.8547267317771912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.427610158455 F1-OK: 0.916806006878 F1-score multiplied: 0.392035561873 Epoch 8: Test set LL -0.9774323415025322, Acc 0.8478086590766907, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385604113111 F1-OK: 0.913147208924 F1-score multiplied: 0.352113319636 Epoch 8: Test set LL -0.9774323415025322, Acc 0.8478086590766907, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.385604113111 F1-OK: 0.913147208924 F1-score multiplied: 0.352113319636 [203272 427546 160476 ..., 35530 291886 122938] Epoch 9: \Dev set LL -0.9662349816912318, Acc 0.8506500720977783, Outputs [0 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.418365157691 F1-OK: 0.914325443226 F1-score multiplied: 0.382521908237 Epoch 9: Test set LL -0.9860572083677385, Acc 0.8477809429168701, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391140642303 F1-OK: 0.913017339577 F1-score multiplied: 0.357118188636 Epoch 9: Test set LL -0.9860572083677385, Acc 0.8477809429168701, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391140642303 F1-OK: 0.913017339577 F1-score multiplied: 0.357118188636 [375554 196391 123272 ..., 142191 131206 539957] Epoch 10: \Dev set LL -1.1834302829796972, Acc 0.8203503489494324, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.41169042035 F1-OK: 0.893989142096 F1-score multiplied: 0.368046765698 Epoch 10: Test set LL -1.1829949474853532, Acc 0.8198732137680054, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3955778521 F1-OK: 0.894166639555 F1-score multiplied: 0.353712518694 Epoch 10: Test set LL -1.1829949474853532, Acc 0.8198732137680054, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.3955778521 F1-OK: 0.894166639555 F1-score multiplied: 0.353712518694 [289773 544209 358522 ..., 15752 275512 298737] Epoch 11: \Dev set LL -0.8570466958171129, Acc 0.8682239055633545, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.399296835761 F1-OK: 0.925994678547 F1-score multiplied: 0.369746745075 Epoch 11: Test set LL -0.8683731766474758, Acc 0.8664414882659912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378350515464 F1-OK: 0.925183783616 F1-score multiplied: 0.35004376143 Epoch 11: Test set LL -0.8683731766474758, Acc 0.8664414882659912, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.378350515464 F1-OK: 0.925183783616 F1-score multiplied: 0.35004376143 [ 52439 292310 502374 ..., 502210 412649 239458] Epoch 12: \Dev set LL -1.169450288855243, Acc 0.8226641416549683, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417375565611 F1-OK: 0.895415705513 F1-score multiplied: 0.373724636546 Epoch 12: Test set LL -1.19721822862633, Acc 0.81840580701828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389349222605 F1-OK: 0.893344390783 F1-score multiplied: 0.34782294407 Epoch 12: Test set LL -1.19721822862633, Acc 0.81840580701828, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389349222605 F1-OK: 0.893344390783 F1-score multiplied: 0.34782294407 [136994 505285 86993 ..., 239063 548691 119253] Epoch 13: \Dev set LL -0.9726444973156203, Acc 0.8505949974060059, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.427364864865 F1-OK: 0.914090217942 F1-score multiplied: 0.390650042465 Epoch 13: Test set LL -1.0082664696054924, Acc 0.8440433144569397, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388315778043 F1-OK: 0.910628440876 F1-score multiplied: 0.353611391527 Epoch 13: Test set LL -1.0082664696054924, Acc 0.8440433144569397, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.388315778043 F1-OK: 0.910628440876 F1-score multiplied: 0.353611391527 [287372 332628 486601 ..., 7030 498681 343739] Epoch 14: \Dev set LL -0.8736199843936144, Acc 0.8653041124343872, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.387678437265 F1-OK: 0.924329175822 F1-score multiplied: 0.358342490402 Epoch 14: Test set LL -0.8809598336831312, Acc 0.8640881776809692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369914003337 F1-OK: 0.923828882648 F1-score multiplied: 0.341737240379 Epoch 14: Test set LL -0.8809598336831312, Acc 0.8640881776809692, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.369914003337 F1-OK: 0.923828882648 F1-score multiplied: 0.341737240379 [422772 266811 140196 ..., 341111 536562 348396] Epoch 15: \Dev set LL -1.035637507072832, Acc 0.8423864841461182, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.417430258603 F1-OK: 0.908865033606 F1-score multiplied: 0.379387766014 Epoch 15: Test set LL -1.0630308670923738, Acc 0.8387552499771118, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391939862184 F1-OK: 0.907053941909 F1-score multiplied: 0.355510596985 Epoch 15: Test set LL -1.0630308670923738, Acc 0.8387552499771118, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.391939862184 F1-OK: 0.907053941909 F1-score multiplied: 0.355510596985 [466248 339784 218237 ..., 259660 381376 293685] Epoch 16: \Dev set LL -0.8493228950441845, Acc 0.8702622056007385, Outputs [1 0 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.388787957436 F1-OK: 0.927429046871 F1-score multiplied: 0.360573244799 Epoch 16: Test set LL -0.8700806253869311, Acc 0.8672997355461121, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363225720739 F1-OK: 0.925932221724 F1-score multiplied: 0.336322398591 Epoch 16: Test set LL -0.8700806253869311, Acc 0.8672997355461121, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.363225720739 F1-OK: 0.925932221724 F1-score multiplied: 0.336322398591 [302905 471604 287167 ..., 368217 43437 503943] Epoch 17: \Dev set LL -1.0748941695534897, Acc 0.8379241824150085, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.419494869771 F1-OK: 0.905813804584 F1-score multiplied: 0.379984243991 Epoch 17: Test set LL -1.092073433556556, Acc 0.8351836800575256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389247973736 F1-OK: 0.904738282313 F1-score multiplied: 0.352167543151 Epoch 17: Test set LL -1.092073433556556, Acc 0.8351836800575256, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389247973736 F1-OK: 0.904738282313 F1-score multiplied: 0.352167543151 [ 65790 546348 448811 ..., 118458 326788 557465] Epoch 18: \Dev set LL -1.0532034663134735, Acc 0.8398523330688477, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.422870756403 F1-OK: 0.907026577542 F1-score multiplied: 0.383555014922 Epoch 18: Test set LL -1.0859538987365458, Acc 0.8352944254875183, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389407779945 F1-OK: 0.904808384671 F1-score multiplied: 0.35233942435 Epoch 18: Test set LL -1.0859538987365458, Acc 0.8352944254875183, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.389407779945 F1-OK: 0.904808384671 F1-score multiplied: 0.35233942435 [220083 361502 360027 ..., 54375 36675 208199] Epoch 19: \Dev set LL -1.1211249103635723, Acc 0.8308175206184387, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.416714150047 F1-OK: 0.901059956829 F1-score multiplied: 0.375484434052 Epoch 19: Test set LL -1.141103695981018, Acc 0.8270439505577087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384956187851 F1-OK: 0.899373399269 F1-score multiplied: 0.346219355237 Epoch 19: Test set LL -1.141103695981018, Acc 0.8270439505577087, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.384956187851 F1-OK: 0.899373399269 F1-score multiplied: 0.346219355237 [486439 273925 266751 ..., 295303 199517 319098] Epoch 20: \Dev set LL -1.0042492683992925, Acc 0.8472344875335693, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.425523099233 F1-OK: 0.911903929854 F1-score multiplied: 0.388036186434 Epoch 20: Test set LL -1.0402407165049796, Acc 0.8419391512870789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387774798928 F1-OK: 0.909255638739 F1-score multiplied: 0.352586422486 Epoch 20: Test set LL -1.0402407165049796, Acc 0.8419391512870789, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387774798928 F1-OK: 0.909255638739 F1-score multiplied: 0.352586422486 [ 40537 106670 99084 ..., 465976 431894 328479] Epoch 21: \Dev set LL -1.0120386253425877, Acc 0.8467386364936829, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on dev: F1-BAD: 0.423777961889 F1-OK: 0.911615198882 F1-score multiplied: 0.386322431009 Epoch 21: Test set LL -1.0402348668303325, Acc 0.8421606421470642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387976382179 F1-OK: 0.909397199752 F1-score multiplied: 0.352824635524 Epoch 21: Test set LL -1.0402348668303325, Acc 0.8421606421470642, Outputs [1 1 1 ..., 1 1 1] Result from the previous epoch on test: F1-BAD: 0.387976382179 F1-OK: 0.909397199752 F1-score multiplied: 0.352824635524 [212561 356922 152295 ..., 524049 198795 528463] ^CTraceback (most recent call last):
Classification baseline shallow - is running
epoch: 0 [491470 260968 489770 ..., 43269 414732 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.393183707398 F1-OK: 0.907278038867 F1-score multiplied: 0.356726942963 Result from the previous epoch on test: F1-BAD: 0.373631002527 F1-OK: 0.905199069204 F1-score multiplied: 0.338210435714 Result from the previous epoch on test: F1-BAD: 0.373631002527 F1-OK: 0.905199069204 F1-score multiplied: 0.338210435714 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.410743801653 F1-OK: 0.909356725146 F1-score multiplied: 0.373512638345 Result from the previous epoch on test: F1-BAD: 0.376208796922 F1-OK: 0.904201465962 F1-score multiplied: 0.340168545685 Result from the previous epoch on test: F1-BAD: 0.376208796922 F1-OK: 0.904201465962 F1-score multiplied: 0.340168545685 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.418927718689 F1-OK: 0.915544057797 F1-score multiplied: 0.383546783492 Result from the previous epoch on test: F1-BAD: 0.389031323152 F1-OK: 0.913367158234 F1-score multiplied: 0.355328434092 Result from the previous epoch on test: F1-BAD: 0.389031323152 F1-OK: 0.913367158234 F1-score multiplied: 0.355328434092 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.426482534525 F1-OK: 0.910006373486 F1-score multiplied: 0.388101824598 Result from the previous epoch on test: F1-BAD: 0.391223349203 F1-OK: 0.906002301202 F1-score multiplied: 0.354449254662 Result from the previous epoch on test: F1-BAD: 0.391223349203 F1-OK: 0.906002301202 F1-score multiplied: 0.354449254662 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.423048869438 F1-OK: 0.897339390006 F1-score multiplied: 0.379618414445 Result from the previous epoch on test: F1-BAD: 0.39192443045 F1-OK: 0.893131510417 F1-score multiplied: 0.350040058537 Result from the previous epoch on test: F1-BAD: 0.39192443045 F1-OK: 0.893131510417 F1-score multiplied: 0.350040058537 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.42583621684 F1-OK: 0.922143326347 F1-score multiplied: 0.392682025476 Result from the previous epoch on test: F1-BAD: 0.399483931504 F1-OK: 0.919638372677 F1-score multiplied: 0.367380752679 Result from the previous epoch on test: F1-BAD: 0.399483931504 F1-OK: 0.919638372677 F1-score multiplied: 0.367380752679 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.432469304229 F1-OK: 0.921770199962 F1-score multiplied: 0.398637317037 Result from the previous epoch on test: F1-BAD: 0.394867645359 F1-OK: 0.917671851165 F1-score multiplied: 0.362358923082 Result from the previous epoch on test: F1-BAD: 0.394867645359 F1-OK: 0.917671851165 F1-score multiplied: 0.362358923082 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.435477263417 F1-OK: 0.912290751703 F1-score multiplied: 0.397281879992 Result from the previous epoch on test: F1-BAD: 0.402992829679 F1-OK: 0.908248822167 F1-score multiplied: 0.366017762898 Result from the previous epoch on test: F1-BAD: 0.402992829679 F1-OK: 0.908248822167 F1-score multiplied: 0.366017762898 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.435624762628 F1-OK: 0.904246407629 F1-score multiplied: 0.393912126681 Result from the previous epoch on test: F1-BAD: 0.405436668595 F1-OK: 0.900297426613 F1-score multiplied: 0.36501358939 Result from the previous epoch on test: F1-BAD: 0.405436668595 F1-OK: 0.900297426613 F1-score multiplied: 0.36501358939 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.433618102055 F1-OK: 0.92327901667 F1-score multiplied: 0.400350494876 Result from the previous epoch on test: F1-BAD: 0.399809953676 F1-OK: 0.920822952412 F1-score multiplied: 0.368154181948 Result from the previous epoch on test: F1-BAD: 0.399809953676 F1-OK: 0.920822952412 F1-score multiplied: 0.368154181948 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.427374301676 F1-OK: 0.908283267289 F1-score multiplied: 0.388176927082 Result from the previous epoch on test: F1-BAD: 0.402201610437 F1-OK: 0.906050266712 F1-score multiplied: 0.364414876408 Result from the previous epoch on test: F1-BAD: 0.402201610437 F1-OK: 0.906050266712 F1-score multiplied: 0.364414876408 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.433937251436 F1-OK: 0.919378186167 F1-score multiplied: 0.398952443135 Result from the previous epoch on test: F1-BAD: 0.398040555935 F1-OK: 0.91673495115 F1-score multiplied: 0.364897689601 Result from the previous epoch on test: F1-BAD: 0.398040555935 F1-OK: 0.91673495115 F1-score multiplied: 0.364897689601 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.430820522319 F1-OK: 0.900566251416 F1-score multiplied: 0.387982422818 Result from the previous epoch on test: F1-BAD: 0.398465999439 F1-OK: 0.895510747884 F1-score multiplied: 0.356830585164 Result from the previous epoch on test: F1-BAD: 0.398465999439 F1-OK: 0.895510747884 F1-score multiplied: 0.356830585164 [287372 332628 486601 ..., 7030 498681 343739]
epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.438419829589 F1-OK: 0.906872190109 F1-score multiplied: 0.397590751047 Result from the previous epoch on test: F1-BAD: 0.40152851264 F1-OK: 0.901534691772 F1-score multiplied: 0.36199188388 Result from the previous epoch on test: F1-BAD: 0.40152851264 F1-OK: 0.901534691772 F1-score multiplied: 0.36199188388 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.43627767032 F1-OK: 0.917127420935 F1-score multiplied: 0.400122214592 Result from the previous epoch on test: F1-BAD: 0.39960456942 F1-OK: 0.913422244749 F1-score multiplied: 0.365007702812 Result from the previous epoch on test: F1-BAD: 0.39960456942 F1-OK: 0.913422244749 F1-score multiplied: 0.365007702812 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.429977289932 F1-OK: 0.902901353965 F1-score multiplied: 0.388227077254 Result from the previous epoch on test: F1-BAD: 0.398896184223 F1-OK: 0.897665602877 F1-score multiplied: 0.358075383696 Result from the previous epoch on test: F1-BAD: 0.398896184223 F1-OK: 0.897665602877 F1-score multiplied: 0.358075383696 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.429858429858 F1-OK: 0.915997724543 F1-score multiplied: 0.393749343626 Result from the previous epoch on test: F1-BAD: 0.396528998243 F1-OK: 0.912978743625 F1-score multiplied: 0.362022546626 Result from the previous epoch on test: F1-BAD: 0.396528998243 F1-OK: 0.912978743625 F1-score multiplied: 0.362022546626 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.429886982001 F1-OK: 0.913595127831 F1-score multiplied: 0.392742652274 Result from the previous epoch on test: F1-BAD: 0.399957109157 F1-OK: 0.911050356053 F1-score multiplied: 0.364381066704 Result from the previous epoch on test: F1-BAD: 0.399957109157 F1-OK: 0.911050356053 F1-score multiplied: 0.364381066704 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.419069767442 F1-OK: 0.921947256593 F1-score multiplied: 0.386360222414 Result from the previous epoch on test: F1-BAD: 0.39339655778 F1-OK: 0.918661789409 F1-score multiplied: 0.361398385718 Result from the previous epoch on test: F1-BAD: 0.39339655778 F1-OK: 0.918661789409 F1-score multiplied: 0.361398385718 [486439 273925 266751 ..., 295303 199517 319098] epoch: 20 Result from the previous epoch on dev: F1-BAD: 0.42566191446 F1-OK: 0.910173918583 F1-score multiplied: 0.387426372676 Result from the previous epoch on test: F1-BAD: 0.395759717314 F1-OK: 0.907148332695 F1-score multiplied: 0.359012767709 Result from the previous epoch on test: F1-BAD: 0.395759717314 F1-OK: 0.907148332695 F1-score multiplied: 0.359012767709 [ 40537 106670 99084 ..., 465976 431894 328479] epoch: 21 Result from the previous epoch on dev: F1-BAD: 0.427966101695 F1-OK: 0.914513677812 F1-score multiplied: 0.39138085364 Result from the previous epoch on test: F1-BAD: 0.399738732854 F1-OK: 0.912548372772 F1-score multiplied: 0.3647809302 Result from the previous epoch on test: F1-BAD: 0.399738732854 F1-OK: 0.912548372772 F1-score multiplied: 0.3647809302 [212561 356922 152295 ..., 524049 198795 528463] epoch: 22 Result from the previous epoch on dev: F1-BAD: 0.426163182738 F1-OK: 0.919855595668 F1-score multiplied: 0.392008588309 Result from the previous epoch on test: F1-BAD: 0.394040114613 F1-OK: 0.916757199314 F1-score multiplied: 0.36123911189 Result from the previous epoch on test: F1-BAD: 0.394040114613 F1-OK: 0.916757199314 F1-score multiplied: 0.36123911189 [ 95635 378627 25971 ..., 420115 259761 74441]
--deeper -512-256-17-17-
0 [491470 260968 489770 ..., 43269 414732 159419] epoch: 1 Result from the previous epoch on dev: F1-BAD: 0.415812591508 F1-OK: 0.911398026838 F1-score multiplied: 0.378970775435 Result from the previous epoch on test: F1-BAD: 0.383699731903 F1-OK: 0.908651630029 F1-score multiplied: 0.348649386836 Result from the previous epoch on test: F1-BAD: 0.383699731903 F1-OK: 0.908651630029 F1-score multiplied: 0.348649386836 [340070 257106 257098 ..., 129183 218369 446289] epoch: 2 Result from the previous epoch on dev: F1-BAD: 0.425796425796 F1-OK: 0.905122608807 F1-score multiplied: 0.385397971738 Result from the previous epoch on test: F1-BAD: 0.400318979266 F1-OK: 0.903289071794 F1-score multiplied: 0.361603759203 Result from the previous epoch on test: F1-BAD: 0.400318979266 F1-OK: 0.903289071794 F1-score multiplied: 0.361603759203 [472030 88008 511958 ..., 479005 325808 365441] epoch: 3 Result from the previous epoch on dev: F1-BAD: 0.432635060639 F1-OK: 0.919009096918 F1-score multiplied: 0.397595556374 Result from the previous epoch on test: F1-BAD: 0.398287902681 F1-OK: 0.915688131313 F1-score multiplied: 0.36470750533 Result from the previous epoch on test: F1-BAD: 0.398287902681 F1-OK: 0.915688131313 F1-score multiplied: 0.36470750533 [ 73496 37439 143952 ..., 401484 225891 300836] epoch: 4 Result from the previous epoch on dev: F1-BAD: 0.42326679545 F1-OK: 0.915089271607 F1-score multiplied: 0.387326903543 Result from the previous epoch on test: F1-BAD: 0.397788857576 F1-OK: 0.911826318796 F1-score multiplied: 0.362714349662 Result from the previous epoch on test: F1-BAD: 0.397788857576 F1-OK: 0.911826318796 F1-score multiplied: 0.362714349662 [510679 511318 18562 ..., 84939 68253 433525] epoch: 5 Result from the previous epoch on dev: F1-BAD: 0.428422588039 F1-OK: 0.912934454848 F1-score multiplied: 0.391121741856 Result from the previous epoch on test: F1-BAD: 0.402325581395 F1-OK: 0.909936601994 F1-score multiplied: 0.36609077243 Result from the previous epoch on test: F1-BAD: 0.402325581395 F1-OK: 0.909936601994 F1-score multiplied: 0.36609077243 [147162 465190 283137 ..., 55498 258345 405116] epoch: 6 Result from the previous epoch on dev: F1-BAD: 0.422177419355 F1-OK: 0.908563042369 F1-score multiplied: 0.383574800548 Result from the previous epoch on test: F1-BAD: 0.4002034588 F1-OK: 0.905524932701 F1-score multiplied: 0.362394210096 Result from the previous epoch on test: F1-BAD: 0.4002034588 F1-OK: 0.905524932701 F1-score multiplied: 0.362394210096 [525358 348717 381830 ..., 40299 131805 164902] epoch: 7 Result from the previous epoch on dev: F1-BAD: 0.427483896155 F1-OK: 0.905936307367 F1-score multiplied: 0.387273182341 Result from the previous epoch on test: F1-BAD: 0.397598661549 F1-OK: 0.901396652544 F1-score multiplied: 0.358394102576 Result from the previous epoch on test: F1-BAD: 0.397598661549 F1-OK: 0.901396652544 F1-score multiplied: 0.358394102576 [303145 549858 540060 ..., 519941 442145 502538] epoch: 8 Result from the previous epoch on dev: F1-BAD: 0.423117045692 F1-OK: 0.912252864079 F1-score multiplied: 0.385989736773 Result from the previous epoch on test: F1-BAD: 0.391359060403 F1-OK: 0.907435169532 F1-score multiplied: 0.355132975324 Result from the previous epoch on test: F1-BAD: 0.391359060403 F1-OK: 0.907435169532 F1-score multiplied: 0.355132975324 [203272 427546 160476 ..., 35530 291886 122938] epoch: 9 Result from the previous epoch on dev: F1-BAD: 0.41806765242 F1-OK: 0.908406924475 F1-score multiplied: 0.379775550358 Result from the previous epoch on test: F1-BAD: 0.391005236677 F1-OK: 0.90510248164 F1-score multiplied: 0.353899810051 Result from the previous epoch on test: F1-BAD: 0.391005236677 F1-OK: 0.90510248164 F1-score multiplied: 0.353899810051 [375554 196391 123272 ..., 142191 131206 539957] epoch: 10 Result from the previous epoch on dev: F1-BAD: 0.408172635445 F1-OK: 0.919306372856 F1-score multiplied: 0.37523570499 Result from the previous epoch on test: F1-BAD: 0.392038879889 F1-OK: 0.917384741179 F1-score multiplied: 0.359650486359 Result from the previous epoch on test: F1-BAD: 0.392038879889 F1-OK: 0.917384741179 F1-score multiplied: 0.359650486359 [289773 544209 358522 ..., 15752 275512 298737] epoch: 11 Result from the previous epoch on dev: F1-BAD: 0.41628959276 F1-OK: 0.909738566249 F1-score multiplied: 0.378714697262 Result from the previous epoch on test: F1-BAD: 0.387858696778 F1-OK: 0.905584405209 F1-score multiplied: 0.351238787227 Result from the previous epoch on test: F1-BAD: 0.387858696778 F1-OK: 0.905584405209 F1-score multiplied: 0.351238787227 [ 52439 292310 502374 ..., 502210 412649 239458] epoch: 12 Result from the previous epoch on dev: F1-BAD: 0.414951700966 F1-OK: 0.911673324456 F1-score multiplied: 0.378300396708 Result from the previous epoch on test: F1-BAD: 0.389613142554 F1-OK: 0.90830055889 F1-score multiplied: 0.353885835133 Result from the previous epoch on test: F1-BAD: 0.389613142554 F1-OK: 0.90830055889 F1-score multiplied: 0.353885835133 [136994 505285 86993 ..., 239063 548691 119253] epoch: 13 Result from the previous epoch on dev: F1-BAD: 0.415646940822 F1-OK: 0.906989367477 F1-score multiplied: 0.37698735595 Result from the previous epoch on test: F1-BAD: 0.387823439878 F1-OK: 0.903290960678 F1-score multiplied: 0.350317407581 Result from the previous epoch on test: F1-BAD: 0.387823439878 F1-OK: 0.903290960678 F1-score multiplied: 0.350317407581 [287372 332628 486601 ..., 7030 498681 343739] epoch: 14 Result from the previous epoch on dev: F1-BAD: 0.406144025534 F1-OK: 0.904860822601 F1-score multiplied: 0.367503817039 Result from the previous epoch on test: F1-BAD: 0.384870071235 F1-OK: 0.901543254484 F1-score multiplied: 0.346977016575 Result from the previous epoch on test: F1-BAD: 0.384870071235 F1-OK: 0.901543254484 F1-score multiplied: 0.346977016575 [422772 266811 140196 ..., 341111 536562 348396] epoch: 15 Result from the previous epoch on dev: F1-BAD: 0.406680207628 F1-OK: 0.917516393185 F1-score multiplied: 0.373135757283 Result from the previous epoch on test: F1-BAD: 0.383886255924 F1-OK: 0.913847513254 F1-score multiplied: 0.350813500349 Result from the previous epoch on test: F1-BAD: 0.383886255924 F1-OK: 0.913847513254 F1-score multiplied: 0.350813500349 [466248 339784 218237 ..., 259660 381376 293685] epoch: 16 Result from the previous epoch on dev: F1-BAD: 0.401805869074 F1-OK: 0.907257166492 F1-score multiplied: 0.364541254256 Result from the previous epoch on test: F1-BAD: 0.384950248756 F1-OK: 0.905192522767 F1-score multiplied: 0.348454086812 Result from the previous epoch on test: F1-BAD: 0.384950248756 F1-OK: 0.905192522767 F1-score multiplied: 0.348454086812 [302905 471604 287167 ..., 368217 43437 503943] epoch: 17 Result from the previous epoch on dev: F1-BAD: 0.411975542905 F1-OK: 0.911631443871 F1-score multiplied: 0.375569859018 Result from the previous epoch on test: F1-BAD: 0.385205713068 F1-OK: 0.908234695176 F1-score multiplied: 0.349857193388 Result from the previous epoch on test: F1-BAD: 0.385205713068 F1-OK: 0.908234695176 F1-score multiplied: 0.349857193388 [ 65790 546348 448811 ..., 118458 326788 557465] epoch: 18 Result from the previous epoch on dev: F1-BAD: 0.405245901639 F1-OK: 0.914242491096 F1-score multiplied: 0.370493022621 Result from the previous epoch on test: F1-BAD: 0.376556939502 F1-OK: 0.911361983367 F1-score multiplied: 0.343179679235 Result from the previous epoch on test: F1-BAD: 0.376556939502 F1-OK: 0.911361983367 F1-score multiplied: 0.343179679235 [220083 361502 360027 ..., 54375 36675 208199] epoch: 19 Result from the previous epoch on dev: F1-BAD: 0.400611620795 F1-OK: 0.913509424447 F1-score multiplied: 0.365962491139 Result from the previous epoch on test: F1-BAD: 0.380931649978 F1-OK: 0.909785884219 F1-score multiplied: 0.346566238002 Result from the previous epoch on test: F1-BAD: 0.380931649978 F1-OK: 0.909785884219 F1-score multiplied: 0.346566238002 [486439 273925 266751 ..., 295303 199517 319098] Done!