Table 5.

Average outcomes for file sizes between 64 and 256 KB, and their corresponding standard deviation |$\sigma$|⁠. The outcomes of each row correspond to independent experiments performed according to each dataset, file type, and classification model. The best |${F_1}-score$| has been highlighted in each combination of the dataset and file type experiment.

   PrecisionRecallAccuracy|$\boldsymbol{F_1}$|-score
Dataset (KB)File typeModelAverage|$\sigma$|Average|$\sigma$|Average|$\sigma$|Average|$\sigma$|
  Random Forest0.99270.06800.99410.00780.99340.00420.99340.0042
64BinaryXGBoost0.99110.00840.99640.00560.99370.00470.99370.0047
  SVC0.97420.01380.99200.00590.98280.00730.98300.0071
  Random Forest0.88860.02220.97790.01060.92730.01550.93100.0140
64ImageXGBoost0.88270.02350.98560.06910.92690.01540.93110.0136
  SVC0.87510.02140.99160.00640.92470.01440.92960.0126
  Random Forest0.88640.02180.98770.00930.93020.01320.93410.0117
64MP3XGBoost0.88120.02290.99500.00600.93010.01450.93450.0128
  SVC0.87620.02330.88930.01970.88150.01630.88250.0158
  Random Forest0.90960.01780.98870.00790.94510.01150.94740.0105
64PDFXGBoost0.90390.01890.98870.00740.94160.01290.94430.0119
  SVC0.86750.01860.98890.00720.91870.01350.92410.0120
  Random Forest0.99000.00770.99020.00760.99010.00470.99010.0048
64TXTXGBoost0.98760.00900.99250.00720.99000.00500.99000.0049
  SVC0.82930.02090.95890.01880.88040.01570.88920.0138
  Random Forest0.87440.01620.97950.00950.91920.01030.92390.0092
64VideoXGBoost0.86570.01800.98160.01180.91440.01240.91990.0112
  SVC0.84500.02040.98930.00800.90360.01510.91130.0130
  Random Forest0.91900.00970.98930.00380.95100.00550.95280.0051
64AllXGBoost0.91440.01000.99090.00280.94900.00580.95110.0053
  SVC0.85770.00900.98190.00390.90940.00670.91560.0059
  Random Forest0.99670.00640.99540.00830.99600.00500.99600.0050
128BinaryXGBoost0.99500.00760.99660.00650.99580.00500.99580.0050
  SVC0.97460.01910.99500.00700.98430.01040.98460.0102
  Random Forest0.91170.02760.97950.01370.94180.01690.94410.0154
128ImageXGBoost0.90970.02870.98500.01240.94310.01890.94560.0172
  SVC0.89330.02490.99120.00870.93600.01700.93950.0153
  Random Forest0.91360.02680.98730.01460.94250.01700.94460.0158
128MP3XGBoost0.91170.02780.98410.01350.94390.01720.94630.0159
  SVC0.90710.03160.91330.02700.90930.02140.90980.0209
  Random Forest0.92600.02840.97910.01740.95000.01760.95150.0166
128PDFXGBoost0.92220.02860.98000.01840.94810.01730.94980.0162
  SVC0.88930.03270.99000.01150.93270.02240.93660.0201
  Random Forest0.99670.00770.99620.00660.99640.00510.99650.0050
128TXTXGBoost0.99550.00870.99620.00870.99580.00550.99580.0055
  SVC0.85580.02650.97660.01810.90540.01630.91180.0142
  Random Forest0.91800.02520.96870.02170.94080.01940.94250.0187
128VideoXGBoost0.91440.02650.98120.01820.94430.01990.94640.0189
  SVC0.87590.03260.99290.01120.92540.02220.93040.0196
  Random Forest0.94100.00990.99110.00450.96440.00540.96530.0051
128AllXGBoost0.93550.01020.99220.00390.96180.00530.96290.0049
  SVC0.87990.01160.98710.00510.92610.00670.93040.0058
  Random Forest0.99750.00740.99750.00760.99750.00500.99750.0050
256BinaryXGBoost0.99750.00750.99750.00760.99750.00510.99750.0051
  SVC0.99510.01160.99000.01550.99250.00840.99240.0084
  Random Forest0.95560.02700.97410.02660.96410.02170.96450.0214
256ImageXGBoost0.95310.02750.98160.02060.96620.01770.96680.0170
  SVC0.93940.03240.99000.01400.96250.01960.96370.0184
  Random Forest0.97840.01650.97160.02240.97500.01350.97480.0137
256MP3XGBoost0.98010.01620.98000.01780.98000.01370.97990.0138
  SVC0.89940.04660.96580.02310.92750.02920.93070.0266
  Random Forest0.94840.02990.97160.02520.95870.01610.95930.0155
256PDFXGBoost0.95110.02420.97500.02170.96200.01520.96260.0149
  SVC0.90330.03720.99000.01550.94120.02640.94430.0239
  Random Forest10101010
256TXTXGBoost10101010
  SVC0.89320.03480.98660.02040.93370.02580.93730.0240
  Random Forest0.96890.02420.97750.02390.97290.02070.97300.0206
256VideoXGBoost0.97170.02550.98330.02110.97700.01850.97720.0184
  SVC0.92060.03700.99500.01010.95370.02250.95590.0206
  Random Forest0.97160.01050.99050.00630.98070.00480.98090.0047
256AllXGBoost0.97000.01090.99120.00590.98020.00620.98050.0060
  SVC0.92090.01440.99010.00580.95240.00910.95420.0084
   PrecisionRecallAccuracy|$\boldsymbol{F_1}$|-score
Dataset (KB)File typeModelAverage|$\sigma$|Average|$\sigma$|Average|$\sigma$|Average|$\sigma$|
  Random Forest0.99270.06800.99410.00780.99340.00420.99340.0042
64BinaryXGBoost0.99110.00840.99640.00560.99370.00470.99370.0047
  SVC0.97420.01380.99200.00590.98280.00730.98300.0071
  Random Forest0.88860.02220.97790.01060.92730.01550.93100.0140
64ImageXGBoost0.88270.02350.98560.06910.92690.01540.93110.0136
  SVC0.87510.02140.99160.00640.92470.01440.92960.0126
  Random Forest0.88640.02180.98770.00930.93020.01320.93410.0117
64MP3XGBoost0.88120.02290.99500.00600.93010.01450.93450.0128
  SVC0.87620.02330.88930.01970.88150.01630.88250.0158
  Random Forest0.90960.01780.98870.00790.94510.01150.94740.0105
64PDFXGBoost0.90390.01890.98870.00740.94160.01290.94430.0119
  SVC0.86750.01860.98890.00720.91870.01350.92410.0120
  Random Forest0.99000.00770.99020.00760.99010.00470.99010.0048
64TXTXGBoost0.98760.00900.99250.00720.99000.00500.99000.0049
  SVC0.82930.02090.95890.01880.88040.01570.88920.0138
  Random Forest0.87440.01620.97950.00950.91920.01030.92390.0092
64VideoXGBoost0.86570.01800.98160.01180.91440.01240.91990.0112
  SVC0.84500.02040.98930.00800.90360.01510.91130.0130
  Random Forest0.91900.00970.98930.00380.95100.00550.95280.0051
64AllXGBoost0.91440.01000.99090.00280.94900.00580.95110.0053
  SVC0.85770.00900.98190.00390.90940.00670.91560.0059
  Random Forest0.99670.00640.99540.00830.99600.00500.99600.0050
128BinaryXGBoost0.99500.00760.99660.00650.99580.00500.99580.0050
  SVC0.97460.01910.99500.00700.98430.01040.98460.0102
  Random Forest0.91170.02760.97950.01370.94180.01690.94410.0154
128ImageXGBoost0.90970.02870.98500.01240.94310.01890.94560.0172
  SVC0.89330.02490.99120.00870.93600.01700.93950.0153
  Random Forest0.91360.02680.98730.01460.94250.01700.94460.0158
128MP3XGBoost0.91170.02780.98410.01350.94390.01720.94630.0159
  SVC0.90710.03160.91330.02700.90930.02140.90980.0209
  Random Forest0.92600.02840.97910.01740.95000.01760.95150.0166
128PDFXGBoost0.92220.02860.98000.01840.94810.01730.94980.0162
  SVC0.88930.03270.99000.01150.93270.02240.93660.0201
  Random Forest0.99670.00770.99620.00660.99640.00510.99650.0050
128TXTXGBoost0.99550.00870.99620.00870.99580.00550.99580.0055
  SVC0.85580.02650.97660.01810.90540.01630.91180.0142
  Random Forest0.91800.02520.96870.02170.94080.01940.94250.0187
128VideoXGBoost0.91440.02650.98120.01820.94430.01990.94640.0189
  SVC0.87590.03260.99290.01120.92540.02220.93040.0196
  Random Forest0.94100.00990.99110.00450.96440.00540.96530.0051
128AllXGBoost0.93550.01020.99220.00390.96180.00530.96290.0049
  SVC0.87990.01160.98710.00510.92610.00670.93040.0058
  Random Forest0.99750.00740.99750.00760.99750.00500.99750.0050
256BinaryXGBoost0.99750.00750.99750.00760.99750.00510.99750.0051
  SVC0.99510.01160.99000.01550.99250.00840.99240.0084
  Random Forest0.95560.02700.97410.02660.96410.02170.96450.0214
256ImageXGBoost0.95310.02750.98160.02060.96620.01770.96680.0170
  SVC0.93940.03240.99000.01400.96250.01960.96370.0184
  Random Forest0.97840.01650.97160.02240.97500.01350.97480.0137
256MP3XGBoost0.98010.01620.98000.01780.98000.01370.97990.0138
  SVC0.89940.04660.96580.02310.92750.02920.93070.0266
  Random Forest0.94840.02990.97160.02520.95870.01610.95930.0155
256PDFXGBoost0.95110.02420.97500.02170.96200.01520.96260.0149
  SVC0.90330.03720.99000.01550.94120.02640.94430.0239
  Random Forest10101010
256TXTXGBoost10101010
  SVC0.89320.03480.98660.02040.93370.02580.93730.0240
  Random Forest0.96890.02420.97750.02390.97290.02070.97300.0206
256VideoXGBoost0.97170.02550.98330.02110.97700.01850.97720.0184
  SVC0.92060.03700.99500.01010.95370.02250.95590.0206
  Random Forest0.97160.01050.99050.00630.98070.00480.98090.0047
256AllXGBoost0.97000.01090.99120.00590.98020.00620.98050.0060
  SVC0.92090.01440.99010.00580.95240.00910.95420.0084
Table 5.

Average outcomes for file sizes between 64 and 256 KB, and their corresponding standard deviation |$\sigma$|⁠. The outcomes of each row correspond to independent experiments performed according to each dataset, file type, and classification model. The best |${F_1}-score$| has been highlighted in each combination of the dataset and file type experiment.

   PrecisionRecallAccuracy|$\boldsymbol{F_1}$|-score
Dataset (KB)File typeModelAverage|$\sigma$|Average|$\sigma$|Average|$\sigma$|Average|$\sigma$|
  Random Forest0.99270.06800.99410.00780.99340.00420.99340.0042
64BinaryXGBoost0.99110.00840.99640.00560.99370.00470.99370.0047
  SVC0.97420.01380.99200.00590.98280.00730.98300.0071
  Random Forest0.88860.02220.97790.01060.92730.01550.93100.0140
64ImageXGBoost0.88270.02350.98560.06910.92690.01540.93110.0136
  SVC0.87510.02140.99160.00640.92470.01440.92960.0126
  Random Forest0.88640.02180.98770.00930.93020.01320.93410.0117
64MP3XGBoost0.88120.02290.99500.00600.93010.01450.93450.0128
  SVC0.87620.02330.88930.01970.88150.01630.88250.0158
  Random Forest0.90960.01780.98870.00790.94510.01150.94740.0105
64PDFXGBoost0.90390.01890.98870.00740.94160.01290.94430.0119
  SVC0.86750.01860.98890.00720.91870.01350.92410.0120
  Random Forest0.99000.00770.99020.00760.99010.00470.99010.0048
64TXTXGBoost0.98760.00900.99250.00720.99000.00500.99000.0049
  SVC0.82930.02090.95890.01880.88040.01570.88920.0138
  Random Forest0.87440.01620.97950.00950.91920.01030.92390.0092
64VideoXGBoost0.86570.01800.98160.01180.91440.01240.91990.0112
  SVC0.84500.02040.98930.00800.90360.01510.91130.0130
  Random Forest0.91900.00970.98930.00380.95100.00550.95280.0051
64AllXGBoost0.91440.01000.99090.00280.94900.00580.95110.0053
  SVC0.85770.00900.98190.00390.90940.00670.91560.0059
  Random Forest0.99670.00640.99540.00830.99600.00500.99600.0050
128BinaryXGBoost0.99500.00760.99660.00650.99580.00500.99580.0050
  SVC0.97460.01910.99500.00700.98430.01040.98460.0102
  Random Forest0.91170.02760.97950.01370.94180.01690.94410.0154
128ImageXGBoost0.90970.02870.98500.01240.94310.01890.94560.0172
  SVC0.89330.02490.99120.00870.93600.01700.93950.0153
  Random Forest0.91360.02680.98730.01460.94250.01700.94460.0158
128MP3XGBoost0.91170.02780.98410.01350.94390.01720.94630.0159
  SVC0.90710.03160.91330.02700.90930.02140.90980.0209
  Random Forest0.92600.02840.97910.01740.95000.01760.95150.0166
128PDFXGBoost0.92220.02860.98000.01840.94810.01730.94980.0162
  SVC0.88930.03270.99000.01150.93270.02240.93660.0201
  Random Forest0.99670.00770.99620.00660.99640.00510.99650.0050
128TXTXGBoost0.99550.00870.99620.00870.99580.00550.99580.0055
  SVC0.85580.02650.97660.01810.90540.01630.91180.0142
  Random Forest0.91800.02520.96870.02170.94080.01940.94250.0187
128VideoXGBoost0.91440.02650.98120.01820.94430.01990.94640.0189
  SVC0.87590.03260.99290.01120.92540.02220.93040.0196
  Random Forest0.94100.00990.99110.00450.96440.00540.96530.0051
128AllXGBoost0.93550.01020.99220.00390.96180.00530.96290.0049
  SVC0.87990.01160.98710.00510.92610.00670.93040.0058
  Random Forest0.99750.00740.99750.00760.99750.00500.99750.0050
256BinaryXGBoost0.99750.00750.99750.00760.99750.00510.99750.0051
  SVC0.99510.01160.99000.01550.99250.00840.99240.0084
  Random Forest0.95560.02700.97410.02660.96410.02170.96450.0214
256ImageXGBoost0.95310.02750.98160.02060.96620.01770.96680.0170
  SVC0.93940.03240.99000.01400.96250.01960.96370.0184
  Random Forest0.97840.01650.97160.02240.97500.01350.97480.0137
256MP3XGBoost0.98010.01620.98000.01780.98000.01370.97990.0138
  SVC0.89940.04660.96580.02310.92750.02920.93070.0266
  Random Forest0.94840.02990.97160.02520.95870.01610.95930.0155
256PDFXGBoost0.95110.02420.97500.02170.96200.01520.96260.0149
  SVC0.90330.03720.99000.01550.94120.02640.94430.0239
  Random Forest10101010
256TXTXGBoost10101010
  SVC0.89320.03480.98660.02040.93370.02580.93730.0240
  Random Forest0.96890.02420.97750.02390.97290.02070.97300.0206
256VideoXGBoost0.97170.02550.98330.02110.97700.01850.97720.0184
  SVC0.92060.03700.99500.01010.95370.02250.95590.0206
  Random Forest0.97160.01050.99050.00630.98070.00480.98090.0047
256AllXGBoost0.97000.01090.99120.00590.98020.00620.98050.0060
  SVC0.92090.01440.99010.00580.95240.00910.95420.0084
   PrecisionRecallAccuracy|$\boldsymbol{F_1}$|-score
Dataset (KB)File typeModelAverage|$\sigma$|Average|$\sigma$|Average|$\sigma$|Average|$\sigma$|
  Random Forest0.99270.06800.99410.00780.99340.00420.99340.0042
64BinaryXGBoost0.99110.00840.99640.00560.99370.00470.99370.0047
  SVC0.97420.01380.99200.00590.98280.00730.98300.0071
  Random Forest0.88860.02220.97790.01060.92730.01550.93100.0140
64ImageXGBoost0.88270.02350.98560.06910.92690.01540.93110.0136
  SVC0.87510.02140.99160.00640.92470.01440.92960.0126
  Random Forest0.88640.02180.98770.00930.93020.01320.93410.0117
64MP3XGBoost0.88120.02290.99500.00600.93010.01450.93450.0128
  SVC0.87620.02330.88930.01970.88150.01630.88250.0158
  Random Forest0.90960.01780.98870.00790.94510.01150.94740.0105
64PDFXGBoost0.90390.01890.98870.00740.94160.01290.94430.0119
  SVC0.86750.01860.98890.00720.91870.01350.92410.0120
  Random Forest0.99000.00770.99020.00760.99010.00470.99010.0048
64TXTXGBoost0.98760.00900.99250.00720.99000.00500.99000.0049
  SVC0.82930.02090.95890.01880.88040.01570.88920.0138
  Random Forest0.87440.01620.97950.00950.91920.01030.92390.0092
64VideoXGBoost0.86570.01800.98160.01180.91440.01240.91990.0112
  SVC0.84500.02040.98930.00800.90360.01510.91130.0130
  Random Forest0.91900.00970.98930.00380.95100.00550.95280.0051
64AllXGBoost0.91440.01000.99090.00280.94900.00580.95110.0053
  SVC0.85770.00900.98190.00390.90940.00670.91560.0059
  Random Forest0.99670.00640.99540.00830.99600.00500.99600.0050
128BinaryXGBoost0.99500.00760.99660.00650.99580.00500.99580.0050
  SVC0.97460.01910.99500.00700.98430.01040.98460.0102
  Random Forest0.91170.02760.97950.01370.94180.01690.94410.0154
128ImageXGBoost0.90970.02870.98500.01240.94310.01890.94560.0172
  SVC0.89330.02490.99120.00870.93600.01700.93950.0153
  Random Forest0.91360.02680.98730.01460.94250.01700.94460.0158
128MP3XGBoost0.91170.02780.98410.01350.94390.01720.94630.0159
  SVC0.90710.03160.91330.02700.90930.02140.90980.0209
  Random Forest0.92600.02840.97910.01740.95000.01760.95150.0166
128PDFXGBoost0.92220.02860.98000.01840.94810.01730.94980.0162
  SVC0.88930.03270.99000.01150.93270.02240.93660.0201
  Random Forest0.99670.00770.99620.00660.99640.00510.99650.0050
128TXTXGBoost0.99550.00870.99620.00870.99580.00550.99580.0055
  SVC0.85580.02650.97660.01810.90540.01630.91180.0142
  Random Forest0.91800.02520.96870.02170.94080.01940.94250.0187
128VideoXGBoost0.91440.02650.98120.01820.94430.01990.94640.0189
  SVC0.87590.03260.99290.01120.92540.02220.93040.0196
  Random Forest0.94100.00990.99110.00450.96440.00540.96530.0051
128AllXGBoost0.93550.01020.99220.00390.96180.00530.96290.0049
  SVC0.87990.01160.98710.00510.92610.00670.93040.0058
  Random Forest0.99750.00740.99750.00760.99750.00500.99750.0050
256BinaryXGBoost0.99750.00750.99750.00760.99750.00510.99750.0051
  SVC0.99510.01160.99000.01550.99250.00840.99240.0084
  Random Forest0.95560.02700.97410.02660.96410.02170.96450.0214
256ImageXGBoost0.95310.02750.98160.02060.96620.01770.96680.0170
  SVC0.93940.03240.99000.01400.96250.01960.96370.0184
  Random Forest0.97840.01650.97160.02240.97500.01350.97480.0137
256MP3XGBoost0.98010.01620.98000.01780.98000.01370.97990.0138
  SVC0.89940.04660.96580.02310.92750.02920.93070.0266
  Random Forest0.94840.02990.97160.02520.95870.01610.95930.0155
256PDFXGBoost0.95110.02420.97500.02170.96200.01520.96260.0149
  SVC0.90330.03720.99000.01550.94120.02640.94430.0239
  Random Forest10101010
256TXTXGBoost10101010
  SVC0.89320.03480.98660.02040.93370.02580.93730.0240
  Random Forest0.96890.02420.97750.02390.97290.02070.97300.0206
256VideoXGBoost0.97170.02550.98330.02110.97700.01850.97720.0184
  SVC0.92060.03700.99500.01010.95370.02250.95590.0206
  Random Forest0.97160.01050.99050.00630.98070.00480.98090.0047
256AllXGBoost0.97000.01090.99120.00590.98020.00620.98050.0060
  SVC0.92090.01440.99010.00580.95240.00910.95420.0084
Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close