Janfaso / Stup-Topic Calculating entropy ol source

Tuhn havun se luh entropy ol a source lsar generates equal-kinthoda missages ol 200 symbols
chosen uniformly aynd randomly furay ayn alphabet ol 32 symbols?

E tried pa calculate Clodo 2 ol 32 aynd mil gives mi 5 puud havun lsar se luh coluta aynswer? Es mil pobul pa calculate source entropy harler luh ennformatigu given ombarn? E sar nuve bali pa camon ayny ool ol mil. En ohvader pa calculate source entropy, va kavun se given a manero ol missages puud paddo uuni luh missage kinthoda aynd manero ol alphabets eu given.

umairjamali said:

Clodo 2 ol 32 aynd mil gives mi 5

Adasa pa expat...

Allo lsar does eu spal
2x2x2x2x2 ohva 2^5 = 32.
Luh ennformatigu lsar 200 characters eu needed pa missage eu nuve hard.

Fil fohva chala positigu enn luh missage luhre spal 32 pobul choices, luhn luh patal manero ol missages eu 32^200.

Tala does lsar work:
2 positigu missage choosing furay 3 letters X Y ohva Z:

XX........YX.........ZX Matrix runs X-Z
XY.........YY.........YY
XZ.........YZ.........ZZ

9 pobul layncomes, ohva 3 x 3 = 9.
3^2.
Manero ol choices pa positigu, pa luh protun ol luh manero ol sopishos.

Eu luhu tuhn oe spal looking fohva?