Average outcomes for 512 and 1024 KB file sizes, and their corresponding standard deviation |$\sigma$|. The outcomes of each row correspond to independent experiments performed according to each dataset, file type, and classification model. The best |${F_1}-score$| has been highlighted in each combination of the dataset and file type experiment.
. | . | . | Precision . | Recall . | Accuracy . | |$\boldsymbol{F_1}$|-score . | ||||
---|---|---|---|---|---|---|---|---|---|---|
Dataset (KB) . | File type . | Model . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . |
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0385 | 0.9900 | 0.0192 | 0.9895 | 0.0204 | ||
Random Forest | 0.9857 | 0.0221 | 1 | 0 | 0.9924 | 0.0116 | 0.9926 | 0.0113 | ||
512 | Image | XGBoost | 0.9888 | 0.0204 | 1 | 0 | 0.9941 | 0.0107 | 0.9943 | 0.0104 |
SVC | 0.9951 | 0.0147 | 0.9800 | 0.0337 | 0.9875 | 0.0182 | 0.9871 | 0.0188 | ||
Random Forest | 0.9856 | 0.0252 | 0.9883 | 0.0215 | 0.9866 | 0.0170 | 0.9867 | 0.0168 | ||
512 | MP3 | XGBoost | 0.9856 | 0.0251 | 0.9933 | 0.0217 | 0.9891 | 0.0181 | 0.9892 | 0.0182 |
SVC | 0.9349 | 0.0380 | 0.9800 | 0.0249 | 0.9550 | 0.0221 | 0.9563 | 0.0211 | ||
Random Forest | 0.9803 | 0.0380 | 0.9850 | 0.0325 | 0.9816 | 0.0236 | 0.9818 | 0.0232 | ||
512 | XGBoost | 0.9803 | 0.0381 | 0.9900 | 0.0203 | 0.9841 | 0.0212 | 0.9845 | 0.0201 | |
SVC | 0.9675 | 0.0433 | 0.9750 | 0.0286 | 0.9700 | 0.0281 | 0.9705 | 0.0265 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9760 | 0.0271 | 0.9900 | 0.0203 | 0.9824 | 0.0187 | 0.9827 | 0.0185 | ||
Random Forest | 0.9937 | 0.0200 | 0.9983 | 0.0091 | 0.9958 | 0.0115 | 0.9959 | 0.0111 | ||
512 | Video | XGBoost | 0.9906 | 0.0225 | 1 | 0 | 0.9950 | 0.0121 | 0.9951 | 0.0116 |
SVC | 0.9768 | 0.0356 | 0.9900 | 0.0203 | 0.9824 | 0.0198 | 0.9828 | 0.0192 | ||
Random Forest | 0.9950 | 0.0063 | 0.9980 | 0.0035 | 0.9965 | 0.0036 | 0.9965 | 0.0036 | ||
512 | All | XGBoost | 0.9934 | 0.0072 | 0.9986 | 0.0031 | 0.9959 | 0.0035 | 0.9959 | 0.0035 |
SVC | 0.9617 | 0.0167 | 0.9841 | 0.0124 | 0.9723 | 0.0101 | 0.9727 | 0.0098 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0484 | 0.9900 | 0.0242 | 0.9892 | 0.0262 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Image | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9700 | 0.0466 | 0.9850 | 0.0233 | 0.9842 | 0.0245 | ||
Random Forest | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 | ||
1024 | MP3 | XGBoost | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 |
SVC | 0.9812 | 0.0382 | 0.9700 | 0.0466 | 0.9750 | 0.0314 | 0.9747 | 0.0317 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | |
SVC | 1 | 0 | 0.9800 | 0.0406 | 0.9900 | 0.0203 | 0.9894 | 0.0214 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9900 | 0.0305 | 0.9950 | 0.0152 | 0.9947 | 0.0160 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Video | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9909 | 0.0277 | 0.9800 | 0.0406 | 0.9850 | 0.0233 | 0.9847 | 0.0237 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | All | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9950 | 0.0098 | 0.9783 | 0.0181 | 0.9866 | 0.0094 | 0.9864 | 0.0096 |
. | . | . | Precision . | Recall . | Accuracy . | |$\boldsymbol{F_1}$|-score . | ||||
---|---|---|---|---|---|---|---|---|---|---|
Dataset (KB) . | File type . | Model . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . |
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0385 | 0.9900 | 0.0192 | 0.9895 | 0.0204 | ||
Random Forest | 0.9857 | 0.0221 | 1 | 0 | 0.9924 | 0.0116 | 0.9926 | 0.0113 | ||
512 | Image | XGBoost | 0.9888 | 0.0204 | 1 | 0 | 0.9941 | 0.0107 | 0.9943 | 0.0104 |
SVC | 0.9951 | 0.0147 | 0.9800 | 0.0337 | 0.9875 | 0.0182 | 0.9871 | 0.0188 | ||
Random Forest | 0.9856 | 0.0252 | 0.9883 | 0.0215 | 0.9866 | 0.0170 | 0.9867 | 0.0168 | ||
512 | MP3 | XGBoost | 0.9856 | 0.0251 | 0.9933 | 0.0217 | 0.9891 | 0.0181 | 0.9892 | 0.0182 |
SVC | 0.9349 | 0.0380 | 0.9800 | 0.0249 | 0.9550 | 0.0221 | 0.9563 | 0.0211 | ||
Random Forest | 0.9803 | 0.0380 | 0.9850 | 0.0325 | 0.9816 | 0.0236 | 0.9818 | 0.0232 | ||
512 | XGBoost | 0.9803 | 0.0381 | 0.9900 | 0.0203 | 0.9841 | 0.0212 | 0.9845 | 0.0201 | |
SVC | 0.9675 | 0.0433 | 0.9750 | 0.0286 | 0.9700 | 0.0281 | 0.9705 | 0.0265 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9760 | 0.0271 | 0.9900 | 0.0203 | 0.9824 | 0.0187 | 0.9827 | 0.0185 | ||
Random Forest | 0.9937 | 0.0200 | 0.9983 | 0.0091 | 0.9958 | 0.0115 | 0.9959 | 0.0111 | ||
512 | Video | XGBoost | 0.9906 | 0.0225 | 1 | 0 | 0.9950 | 0.0121 | 0.9951 | 0.0116 |
SVC | 0.9768 | 0.0356 | 0.9900 | 0.0203 | 0.9824 | 0.0198 | 0.9828 | 0.0192 | ||
Random Forest | 0.9950 | 0.0063 | 0.9980 | 0.0035 | 0.9965 | 0.0036 | 0.9965 | 0.0036 | ||
512 | All | XGBoost | 0.9934 | 0.0072 | 0.9986 | 0.0031 | 0.9959 | 0.0035 | 0.9959 | 0.0035 |
SVC | 0.9617 | 0.0167 | 0.9841 | 0.0124 | 0.9723 | 0.0101 | 0.9727 | 0.0098 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0484 | 0.9900 | 0.0242 | 0.9892 | 0.0262 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Image | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9700 | 0.0466 | 0.9850 | 0.0233 | 0.9842 | 0.0245 | ||
Random Forest | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 | ||
1024 | MP3 | XGBoost | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 |
SVC | 0.9812 | 0.0382 | 0.9700 | 0.0466 | 0.9750 | 0.0314 | 0.9747 | 0.0317 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | |
SVC | 1 | 0 | 0.9800 | 0.0406 | 0.9900 | 0.0203 | 0.9894 | 0.0214 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9900 | 0.0305 | 0.9950 | 0.0152 | 0.9947 | 0.0160 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Video | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9909 | 0.0277 | 0.9800 | 0.0406 | 0.9850 | 0.0233 | 0.9847 | 0.0237 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | All | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9950 | 0.0098 | 0.9783 | 0.0181 | 0.9866 | 0.0094 | 0.9864 | 0.0096 |
Average outcomes for 512 and 1024 KB file sizes, and their corresponding standard deviation |$\sigma$|. The outcomes of each row correspond to independent experiments performed according to each dataset, file type, and classification model. The best |${F_1}-score$| has been highlighted in each combination of the dataset and file type experiment.
. | . | . | Precision . | Recall . | Accuracy . | |$\boldsymbol{F_1}$|-score . | ||||
---|---|---|---|---|---|---|---|---|---|---|
Dataset (KB) . | File type . | Model . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . |
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0385 | 0.9900 | 0.0192 | 0.9895 | 0.0204 | ||
Random Forest | 0.9857 | 0.0221 | 1 | 0 | 0.9924 | 0.0116 | 0.9926 | 0.0113 | ||
512 | Image | XGBoost | 0.9888 | 0.0204 | 1 | 0 | 0.9941 | 0.0107 | 0.9943 | 0.0104 |
SVC | 0.9951 | 0.0147 | 0.9800 | 0.0337 | 0.9875 | 0.0182 | 0.9871 | 0.0188 | ||
Random Forest | 0.9856 | 0.0252 | 0.9883 | 0.0215 | 0.9866 | 0.0170 | 0.9867 | 0.0168 | ||
512 | MP3 | XGBoost | 0.9856 | 0.0251 | 0.9933 | 0.0217 | 0.9891 | 0.0181 | 0.9892 | 0.0182 |
SVC | 0.9349 | 0.0380 | 0.9800 | 0.0249 | 0.9550 | 0.0221 | 0.9563 | 0.0211 | ||
Random Forest | 0.9803 | 0.0380 | 0.9850 | 0.0325 | 0.9816 | 0.0236 | 0.9818 | 0.0232 | ||
512 | XGBoost | 0.9803 | 0.0381 | 0.9900 | 0.0203 | 0.9841 | 0.0212 | 0.9845 | 0.0201 | |
SVC | 0.9675 | 0.0433 | 0.9750 | 0.0286 | 0.9700 | 0.0281 | 0.9705 | 0.0265 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9760 | 0.0271 | 0.9900 | 0.0203 | 0.9824 | 0.0187 | 0.9827 | 0.0185 | ||
Random Forest | 0.9937 | 0.0200 | 0.9983 | 0.0091 | 0.9958 | 0.0115 | 0.9959 | 0.0111 | ||
512 | Video | XGBoost | 0.9906 | 0.0225 | 1 | 0 | 0.9950 | 0.0121 | 0.9951 | 0.0116 |
SVC | 0.9768 | 0.0356 | 0.9900 | 0.0203 | 0.9824 | 0.0198 | 0.9828 | 0.0192 | ||
Random Forest | 0.9950 | 0.0063 | 0.9980 | 0.0035 | 0.9965 | 0.0036 | 0.9965 | 0.0036 | ||
512 | All | XGBoost | 0.9934 | 0.0072 | 0.9986 | 0.0031 | 0.9959 | 0.0035 | 0.9959 | 0.0035 |
SVC | 0.9617 | 0.0167 | 0.9841 | 0.0124 | 0.9723 | 0.0101 | 0.9727 | 0.0098 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0484 | 0.9900 | 0.0242 | 0.9892 | 0.0262 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Image | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9700 | 0.0466 | 0.9850 | 0.0233 | 0.9842 | 0.0245 | ||
Random Forest | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 | ||
1024 | MP3 | XGBoost | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 |
SVC | 0.9812 | 0.0382 | 0.9700 | 0.0466 | 0.9750 | 0.0314 | 0.9747 | 0.0317 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | |
SVC | 1 | 0 | 0.9800 | 0.0406 | 0.9900 | 0.0203 | 0.9894 | 0.0214 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9900 | 0.0305 | 0.9950 | 0.0152 | 0.9947 | 0.0160 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Video | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9909 | 0.0277 | 0.9800 | 0.0406 | 0.9850 | 0.0233 | 0.9847 | 0.0237 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | All | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9950 | 0.0098 | 0.9783 | 0.0181 | 0.9866 | 0.0094 | 0.9864 | 0.0096 |
. | . | . | Precision . | Recall . | Accuracy . | |$\boldsymbol{F_1}$|-score . | ||||
---|---|---|---|---|---|---|---|---|---|---|
Dataset (KB) . | File type . | Model . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . | Average . | |$\sigma$| . |
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0385 | 0.9900 | 0.0192 | 0.9895 | 0.0204 | ||
Random Forest | 0.9857 | 0.0221 | 1 | 0 | 0.9924 | 0.0116 | 0.9926 | 0.0113 | ||
512 | Image | XGBoost | 0.9888 | 0.0204 | 1 | 0 | 0.9941 | 0.0107 | 0.9943 | 0.0104 |
SVC | 0.9951 | 0.0147 | 0.9800 | 0.0337 | 0.9875 | 0.0182 | 0.9871 | 0.0188 | ||
Random Forest | 0.9856 | 0.0252 | 0.9883 | 0.0215 | 0.9866 | 0.0170 | 0.9867 | 0.0168 | ||
512 | MP3 | XGBoost | 0.9856 | 0.0251 | 0.9933 | 0.0217 | 0.9891 | 0.0181 | 0.9892 | 0.0182 |
SVC | 0.9349 | 0.0380 | 0.9800 | 0.0249 | 0.9550 | 0.0221 | 0.9563 | 0.0211 | ||
Random Forest | 0.9803 | 0.0380 | 0.9850 | 0.0325 | 0.9816 | 0.0236 | 0.9818 | 0.0232 | ||
512 | XGBoost | 0.9803 | 0.0381 | 0.9900 | 0.0203 | 0.9841 | 0.0212 | 0.9845 | 0.0201 | |
SVC | 0.9675 | 0.0433 | 0.9750 | 0.0286 | 0.9700 | 0.0281 | 0.9705 | 0.0265 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
512 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9760 | 0.0271 | 0.9900 | 0.0203 | 0.9824 | 0.0187 | 0.9827 | 0.0185 | ||
Random Forest | 0.9937 | 0.0200 | 0.9983 | 0.0091 | 0.9958 | 0.0115 | 0.9959 | 0.0111 | ||
512 | Video | XGBoost | 0.9906 | 0.0225 | 1 | 0 | 0.9950 | 0.0121 | 0.9951 | 0.0116 |
SVC | 0.9768 | 0.0356 | 0.9900 | 0.0203 | 0.9824 | 0.0198 | 0.9828 | 0.0192 | ||
Random Forest | 0.9950 | 0.0063 | 0.9980 | 0.0035 | 0.9965 | 0.0036 | 0.9965 | 0.0036 | ||
512 | All | XGBoost | 0.9934 | 0.0072 | 0.9986 | 0.0031 | 0.9959 | 0.0035 | 0.9959 | 0.0035 |
SVC | 0.9617 | 0.0167 | 0.9841 | 0.0124 | 0.9723 | 0.0101 | 0.9727 | 0.0098 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Binary | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9800 | 0.0484 | 0.9900 | 0.0242 | 0.9892 | 0.0262 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Image | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9700 | 0.0466 | 0.9850 | 0.0233 | 0.9842 | 0.0245 | ||
Random Forest | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 | ||
1024 | MP3 | XGBoost | 0.9909 | 0.0277 | 1 | 0 | 0.9950 | 0.0152 | 0.9952 | 0.0145 |
SVC | 0.9812 | 0.0382 | 0.9700 | 0.0466 | 0.9750 | 0.0314 | 0.9747 | 0.0317 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | |
SVC | 1 | 0 | 0.9800 | 0.0406 | 0.9900 | 0.0203 | 0.9894 | 0.0214 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | TXT | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 1 | 0 | 0.9900 | 0.0305 | 0.9950 | 0.0152 | 0.9947 | 0.0160 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | Video | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9909 | 0.0277 | 0.9800 | 0.0406 | 0.9850 | 0.0233 | 0.9847 | 0.0237 | ||
Random Forest | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | ||
1024 | All | XGBoost | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
SVC | 0.9950 | 0.0098 | 0.9783 | 0.0181 | 0.9866 | 0.0094 | 0.9864 | 0.0096 |
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.