Tuesday, September 30, 2014

Managing complexity

Complexity is interpreted in a variety of ways. With mereology systems that have more parts tend to be more complex then ones that do not. Within information theory the notion of complexity is determined by Kolmogorov complexity. In computer science there is a notion of complexity called computational complexity which is related to the growth rate of the computation time with respect to argument size.

Information theory

Information theory studies the ways in which we can encode information. This includes the study of the lossless compression of information. Information theory is related to thermodynamics by Landauer's principle which is always related to reversible computing.