Re: Entropy of draw from normal or binomial distribution

On 11-08-30 3:33 PM, David Malone wrote:
Jeffrey Goldberg <nobody@xxxxxxxxxxxx> writes:

More generally, how do we calculate the bits of entropy that we can get
from a drawing from a binomial distribution (as in the example above) or
a normal distribution?

If you want the Shannon Entropy, check Wikipedia, as it lists the
it for many discrete distributions.

Thanks. There's a handy table of these for continuous functions at

http://en.wikipedia.org/wiki/Differential_entropy

Cheers,

-j


--
Jeffrey Goldberg http://goldmark.org/jeff/
I rarely read HTML or poorly quoting posts
Reply-To address is valid
.

Relevant Pages

  • Re: SBS 2003
    ... "I assume that you want to create a Distribution ... > List in Outlook, so when users can send emails and faxes at the same time ... Create a new Contact public folder under All Public Folders list. ... > distribution lists directly in Fax wizard. ...
    (microsoft.public.windows.server.sbs)
  • Re: Adding a group to multiple Distribution list
    ... distribution lists. ... Distinguished Name of the group to be added as a member. ... ' Specify Distinguished Name of new member. ...
    (microsoft.public.windows.server.active_directory)
  • Re: Migrate Distribution Lists from 5.5 to 2003
    ... So i'm a little confused do you mean the Distribution Groups do exist in the ... And you can't change them to Distribution lists? ... Microsoft Exchange ... > Exchange 2003 server. ...
    (microsoft.public.exchange.setup)
  • Re: Fastcode Sort B&V version 0.8
    ... > Concrete here with log distribution, ... >> In making the benchmark we should just care about realism, ... >> algorithms on purpose doesn't make sense for a benchmark. ... implementations do get realistic worst cases (namely the sorted lists). ...
    (borland.public.delphi.language.basm)
  • Re: Socialism: A Hypothesis of Working Conditions
    ... exchange should be owned or regulated by the community ... Well that surely is not the way that Wikipedia works. ... pages, the power to bar people from editing Wikipedia, ...
    (rec.arts.sf.misc)