TransWikia.com

Shannon Entropy of Individual PE sections

Reverse Engineering Asked by Rishabh Jain on January 21, 2021

Why is Shannon Entropy of individual sections always between 0-8. Also why we need to create a 256 freq array while calculating the Shannon Entropy?

One Answer

The channel capacity of a single byte samples has a maximum of 8 bits.

Another way of thinking about it: If a single byte has the same value for every sample, you need 0 additional bits of information to describe the values.

If a single byte takes on 256 different values, [0 to 255], then for every sample you will need 8 additional bits of information to uniquely describe the values.

For example, if you were measuring the Shannon Entropy of a collection of Short values (2 bytes / 16 bits) it would range from 0 (constant) to 16 (completely random).

Correct answer by pythonpython on January 21, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP