What is it?

ITIP(Information Theoretic Inequality Prover) is an online service that automatically prove or disprove information theory inequalities in form of entropy, joint entropy and mutual information. Such problems are not only important in Information Theory, but they also arise in fields like Machine Learning and Cryptography.

For information inequalities involving more than a few random variables, it is tedious and sometimes infeasible to construct the proof or disproof by hand, so we developed this web service to help in such cases. It can also be used as a tool for teaching and learning Information Theory.

How does it work?

As described in Proving and Disproving Information Inequalities (ISIT 2014), the proof or disproof of an information inequality can be constructed by solving a linear programming (LP) problem. In this web service, we took a slightly different approach to solve the LP using ADMM, a first-order method that makes the system more scalable. The details will be reported in a future paper.

Who made it?

Dr. Siu Wai Ho

Adjunct Senior Research Fellow, Institute for Telecommunications Research, University of South Australia

Prof. Raymond Yeung

Choh-Ming Li Professor, Department of Information Engineering, Chinese University of Hong Kong

Dr. Chee Wei Tan

Associate Professor, Department of Computer Science, City University of Hong Kong

Mr. Alex Lin Ling

PhD Student, Department of Computer Science, City University of Hong Kong