The arms race: adversarial search defeats entropy used to detect malware

Menéndez, Héctor D. ORCID: https://orcid.org/0000-0002-6314-3725, Bhattacharya, Sukriti, Clark, David and Barr, Earl T. (2019) The arms race: adversarial search defeats entropy used to detect malware. Expert Systems with Applications, 118 . pp. 246-260. ISSN 0957-4174 (doi:10.1016/j.eswa.2018.10.011)

[img]
Preview
PDF - Published version (with publisher's formatting)
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

Malware creators have been getting their way for too long now. String-based similarity measures can leverage ground truth in a scalable way and can operate at a level of abstraction that is difficult to combat from the code level. At the string level, information theory and, specifically, entropy play an important role related to detecting patterns altered by concealment strategies, such as polymorphism or encryption. Controlling the entropy levels in different parts of a disk resident executable allows an analyst to detect malware or a black hat to evade the detection. This paper shows these two perspectives into two scalable entropy-based tools: EnTS and EEE. EnTS, the detection tool, shows the effectiveness of detecting entropy patterns, achieving 100% precision with 82% accuracy. It outperforms VirusTotal for accuracy on combined Kaggle and VirusShare malware. EEE, the evasion tool, shows the effectiveness of entropy as a concealment strategy, attacking binary-based state of the art detectors. It learns their detection patterns in up to 8 generations of its search process, and increments their false negative rate from range 0–9%, up to the range 90–98.7%.

Item Type: Article
Keywords (uncontrolled): Malware, information theory, entropy, time series, packing, adversarial learning
Research Areas: A. > School of Science and Technology > Computer Science
Item ID: 28781
Notes on copyright: © 2018 The Authors.
Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)
Useful Links:
Depositing User: Hector Menendez Benito
Date Deposited: 02 Feb 2020 20:06
Last Modified: 05 Feb 2020 11:14
URI: https://eprints.mdx.ac.uk/id/eprint/28781

Actions (login required)

Edit Item Edit Item

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year