|
| 1 | +# Ising perceptron capacity threshold |
| 2 | + |
| 3 | +## Description of constant |
| 4 | + |
| 5 | +Let $G = (g_{ij})$ be an $M \times N$ random matrix with independent standard Gaussian entries, and let |
| 6 | +$$ |
| 7 | +Z(G) := \left| \left\{ \sigma \in \{-1,1\}^N : G \sigma \geq 0 \text{ coordinatewise} \right\} \right|. |
| 8 | +$$ |
| 9 | +This is the zero-margin binary (or Ising) perceptron. Write $M = \lfloor \alpha N \rfloor$. |
| 10 | + |
| 11 | +Define $C_{80a}$ to be the infimum of all $\alpha > 0$ such that |
| 12 | +$$ |
| 13 | +\mathbb{P}(Z(G) > 0) \to 0 \qquad \text{as } N \to \infty. |
| 14 | +$$ |
| 15 | +Equivalently, $C_{80a}$ is the asymptotic storage-capacity / satisfiability threshold of the zero-margin Ising perceptron. Sharp-threshold results [X2021], [NS2023] show that this formulation captures the threshold location up to $o(1)$. |
| 16 | + |
| 17 | +## Known upper bounds |
| 18 | + |
| 19 | +| Bound | Reference | Comments | |
| 20 | +| ----- | --------- | -------- | |
| 21 | +| $<1$ | [KR1998] | Kim--Roche prove that the capacity is bounded away from $1$ with high probability. | |
| 22 | +| $0.9963$ | [KR1998] | Explicit combinatorial upper bound. | |
| 23 | +| $<1$ | [T1999] | Independent non-explicit upper bound of the form $1-\varepsilon$ for some $\varepsilon>0$. | |
| 24 | +| $0.847$ | [AT2024] | Complete proof of the upper bound outlined earlier by Krauth M\'ezard. | |
| 25 | +| $\alpha_{\star} \approx 0.833$ | [H2024] | Conditional on an explicit numerical maximization hypothesis for a two-variable function $\mathscr{S}_{\star}(\lambda_1,\lambda_2)$. | |
| 26 | + |
| 27 | +## Known lower bounds |
| 28 | + |
| 29 | +| Bound | Reference | Comments | |
| 30 | +| ----- | --------- | -------- | |
| 31 | +| $0$ | Trivial | | |
| 32 | +| $>0$ | [KR1998] | Shows the capacity is bounded away from zero with high probability. | |
| 33 | +| $\alpha_{\star} \approx 0.833$ | [DS2025], [NS2023] | Conditional on an explicit numerical maximization hypothesis for a one-variable function $\mathscr{S}_{\star}(\lambda)$; Ding--Sun prove the lower bound with positive probability, and the sharp-threshold theory of Nakajima--Sun upgrades this to with high probability for every $\alpha < \alpha_{\star}$. | |
| 34 | + |
| 35 | +## Additional comments |
| 36 | + |
| 37 | +- The physics prediction of Krauth--M\'ezard [KM1989] is that $C_{80a} = \alpha_{\star} \approx 0.833$. |
| 38 | +- The literature uses both the names _binary perceptron_ and _Ising perceptron_ for this model. |
| 39 | +- Huang [H2024], together with Ding--Sun [DS2025], gives a conditional proof of the Krauth M\'ezard prediction. |
| 40 | +- The explicit upper bound $0.9963$ comes from Kim--Roche [KR1998]; Talagrand [T1999] obtained an independent non-explicit upper bound. |
| 41 | +- There are several nearby variants, including the symmetric Ising perceptron, the spherical perceptron, and nonzero-margin perceptrons. |
| 42 | + |
| 43 | +## References |
| 44 | + |
| 45 | +- [KM1989] Krauth, Werner; M\'ezard, Marc. "Storage capacity of memory networks with binary couplings." _Journal de Physique_ 50, no. 20 (1989): 3057--3066. DOI: [10.1051/jphys:0198900500200305700](https://doi.org/10.1051/jphys:0198900500200305700) |
| 46 | +- [KR1998] Kim, Jeong Han; Roche, James R. "Covering Cubes by Random Half Cubes, with Applications to Binary Neural Networks." _Journal of Computer and System Sciences_ 56, no. 2 (1998): 223--252. DOI: [10.1006/jcss.1997.1560](https://doi.org/10.1006/jcss.1997.1560) |
| 47 | +- [T1999] Talagrand, Michel. "Intersecting random half cubes." _Random Structures & Algorithms_ 15, no. 3-4 (1999): 436--449. DOI: [10.1002/(SICI)1098-2418(199910/12)15:3/4<436::AID-RSA11>3.0.CO;2-5](https://doi.org/10.1002/(SICI)1098-2418(199910/12)15:3/4%3C436::AID-RSA11%3E3.0.CO;2-5) |
| 48 | +- [X2021] Xu, Changji. "Sharp threshold for the Ising perceptron model." _The Annals of Probability_ 49, no. 5 (2021): 2399--2415. DOI: [10.1214/21-AOP1511](https://doi.org/10.1214/21-AOP1511) |
| 49 | +- [NS2023] Nakajima, Shuta; Sun, Nike. "Sharp threshold sequence and universality for Ising perceptron models." In _Proceedings of the 2023 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA)_, 638--674 (2023). DOI: [10.1137/1.9781611977554.ch28](https://doi.org/10.1137/1.9781611977554.ch28) |
| 50 | +- [AT2024] Altschuler, Dylan J.; Tikhomirov, Konstantin. "A note on the capacity of the binary perceptron." arXiv (2024), [arXiv:2401.15092](https://arxiv.org/abs/2401.15092) |
| 51 | +- [H2024] Huang, Brice. "Capacity Threshold for the Ising Perceptron." In _2024 IEEE 65th Annual Symposium on Foundations of Computer Science (FOCS)_, 1126--1136 (2024). DOI: [10.1109/FOCS61266.2024.00074](https://doi.org/10.1109/FOCS61266.2024.00074); preprint at [arXiv:2404.18902](https://arxiv.org/abs/2404.18902) |
| 52 | +- [DS2025] Ding, Jian; Sun, Nike. "Capacity lower bound for the Ising perceptron." _Probability Theory and Related Fields_ 193, no. 3-4 (2025): 627--715. DOI: [10.1007/s00440-025-01364-x](https://doi.org/10.1007/s00440-025-01364-x) |
| 53 | + |
| 54 | +## Contribution notes |
| 55 | + |
| 56 | +- Used GPT5.4 Pro for a more in depth literature search. |
0 commit comments