power sets: what are ALL the possible subsets you can make from some big collection?. how many ways can you get distinct subsets of a big set of items? k-permutations: all the ways possible to sort some some subset of a collection. permutations: all the different ways you might sort some collection of items. If you've found this post in its current state, read on for an unmotivated account of how many different ways there are to pluck items out of a bag. Once the series is complete, I'll come back and fill in some reasons why you might be interested in this stuff and generally polish things up. How information entropy and Thermodynamic entropy might be the same thing. Information entropy, as defined by Shannon. Thermodynamic entropy and statistical mechanics. Stirling's approximation for calculating enormous factorials. 
Combinations and permutations how to#
How to think about logarithms and exponents, and when to reach for each.
permutations vs combinations (this post!), various ones you might want.This is the first of a short series of posts building up the mathematical concepts and tools required for a solid understanding of what entropy is. (Why the hell didn't I do this back in school?)Įntropy is my latest obsession - thermodynamic entropy, and information entropy, and the ways in which these two things are similar. In my ongoing quest to lay a more solid foundation for this new, strange life as a machine learning "researcher", I've been going through various foundational concepts and ideas and trying to build up rock solid intuitions that I can lean on for years.
0 kommentar(er)
