Quantcast
Channel: Active questions tagged real-analysis - Mathematics Stack Exchange
Viewing all articles
Browse latest Browse all 8465

Simple-ish inequality from entropy-inspired dynamical system: Does it have a simple proof?

$
0
0

This question introduces a dynamical system inspired by entropy where each step

$$(p_1, \dots, p_n) \mapsto (\frac1H p_1 \ln p_1, \dots, \frac1H p_n \ln p_n)$$where $H = \sum_i p_i \ln p_i$ and conjectures that this always limits to the uniform distribution on $n$ outcomes.

and my answer to it shows that this follows from a particular inequality. Namely, that no point $(x,y)$ in the region$$e^{-x} + e^{-y} \le 1 \tag{1}$$satisfies$$\frac{\ln x - \ln y}{x - y} \ge 1.99 \tag{2}$$Where substituting $1.99$ for any other number $<2$ works too (but it might not be true if we set our number too small).

I can prove that this is true (and thus prove the original conjecture), but more than half of the proof is taken up showing the above inequalities, in a very inelegant way, especially considering how suggestively the curves fit together (I strongly encourage you to look at the graph). I would like to know if there is a better way.


My proof

First, observe that, by concavity of $\ln$, $(2)$ is strictly decreasing in $x$ and $y$, and $(1)$ is also strictly decreasing in $x$ and $y$. Hence if there is any point of overlap, in particular we can find a point of overlap on the boundary of $(1)$ by decreasing $x$ and/or $y$ until we reach the boundary.

$(1)$ can be rearranged to$$y \ge -\ln(1 - e^{-x})$$$$y \ge e^{-x} + \frac12 e^{-2x} + \frac13 e^{-3x} + \dots$$so on the boundary we have$$e^{-x} < y < e^{-x} + e^{-2x} + e^{-3x} + \dots = \frac{e^{-x}}{1 - e^{-x}} = \alpha$$So taking wlog $x > y$, in $(2)$ the numerator is$$\ln x - \ln y < \ln x - \ln(e^{-x}) = \ln x + x$$and the denominator is$$x - y > x - \alpha$$bounding $(2)$ as$$\frac{\ln x - \ln y}{x - y} < \frac{\ln x + x}{x - \alpha} \tag{3}$$The RHS of which is plotted in the graph I linked, and, treating $\alpha$ as exogenous for now, for $\alpha = \frac12$ it can be seen to have a global maximum of $2$ at $x=1$*.Clearly the whole expression is strictly increasing in $\alpha$, so if we pick any $\alpha^* < \frac12$ there will be some constant $c < 2$ that $(3)$ is upper bounded by. Hence on the boundary of $(1)$, and when $x$ is large enough that $\alpha$ (which remember is actually a function of $x$) is $\le \alpha^*$, we have that $(2)$ is bounded above by $c$. $\alpha = \frac12$ when $x = \ln 3$ so picking $x \ge x^* = 1.1 > \ln 3$ will work.

By symmetry, if $y \ge x^*$, $(2)$ is bounded above by $c$. So the only region we still need to check is the area away from the tails, where the curves are a finite distance apart, so we can do this mechanically:

If we can find any curve going from $x = x^*$ to $y = x^*$ that sandwiches between $(1)$ and $(2)$, intersecting neither, that shows the two regions cannot intersect. We can do this by building a staircase of points that we can just computationally verify to be in neither region. Because both expressions are decreasing in $x$ and $y$, if two points are both inside the gap, then the vertical or horizontal line between them must also be in the gap, so we only need to verify the computation for finitely many points. An example staircase is plotted on the graph I linked, showing it is possible, and completing the proof.

*proof:$$\frac{\ln x + x}{x - \frac12} \le 2$$rearranges to$$\ln x \le x - 1$$for $x > \frac12$, which is true by concavity of $\ln$ and tangency at $(1,0)$, meaning for all $x > \frac12$ the expression is bounded above by $2$.


Viewing all articles
Browse latest Browse all 8465

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>