TY - GEN
T1 - Energy Function Choice for Training Nonlinear Resistive Neural Networks with Equilibrium Propagation
AU - Kiraz, Zulal
AU - Pham, Dang Kien Germain
AU - Desgreys, Patricia
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026/1/1
Y1 - 2026/1/1
N2 - Equilibrium Propagation (EqProp) is an alternative to backpropagation for minimizing an energy function. Existing EqProp implementations for nonlinear resistive networks typically rely on a pseudo-power formulation, defined as the integral of the local current-voltage characteristic. However, pseudo-power is only applicable to two-terminal components and cannot be extended to dependent or multi-terminal elements, limiting its conceptual consistency across the circuit. This work proposes using the true electrical power, defined as I • V , as the governing energy function for analog resistive networks. Theoretically, the true electrical power satisfies the equilibrium condition ∂P/∂V = 0 and aligns with Kirchhoff's laws across both linear and nonlinear devices. Ngspice and PySpice simulations of the XOR task, averaged over 100 randomly initialized resistance values, show that the true-power formulation achieves stable convergence to approximately -7dB error, compared to -4dB for pseudo-power. When controlled-source or diode contributions were excluded, both formulations failed to learn and diverged toward +10dB. These results demonstrate that EqProp learning in analog hardware requires an energy function that accounts for all circuit components; in addition, the true electrical power provides a physically consistent formulation with lower computational overhead than pseudo-power.
AB - Equilibrium Propagation (EqProp) is an alternative to backpropagation for minimizing an energy function. Existing EqProp implementations for nonlinear resistive networks typically rely on a pseudo-power formulation, defined as the integral of the local current-voltage characteristic. However, pseudo-power is only applicable to two-terminal components and cannot be extended to dependent or multi-terminal elements, limiting its conceptual consistency across the circuit. This work proposes using the true electrical power, defined as I • V , as the governing energy function for analog resistive networks. Theoretically, the true electrical power satisfies the equilibrium condition ∂P/∂V = 0 and aligns with Kirchhoff's laws across both linear and nonlinear devices. Ngspice and PySpice simulations of the XOR task, averaged over 100 randomly initialized resistance values, show that the true-power formulation achieves stable convergence to approximately -7dB error, compared to -4dB for pseudo-power. When controlled-source or diode contributions were excluded, both formulations failed to learn and diverged toward +10dB. These results demonstrate that EqProp learning in analog hardware requires an energy function that accounts for all circuit components; in addition, the true electrical power provides a physically consistent formulation with lower computational overhead than pseudo-power.
KW - Equilibrium Propagation
KW - analog neural networks
KW - energy based models
KW - machine learning
KW - non-von Neumann architectures
UR - https://www.scopus.com/pages/publications/105043444154
U2 - 10.1109/ISCAS66217.2026.11562534
DO - 10.1109/ISCAS66217.2026.11562534
M3 - Conference contribution
AN - SCOPUS:105043444154
T3 - Proceedings - IEEE International Symposium on Circuits and Systems
SP - 1864
EP - 1868
BT - ISCAS 2026 - 2026 IEEE International Symposium on Circuits and Systems
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2026 IEEE International Symposium on Circuits and Systems, ISCAS 2026
Y2 - 24 May 2026 through 27 May 2026
ER -