Skip to main navigation Skip to search Skip to main content

Energy Function Choice for Training Nonlinear Resistive Neural Networks with Equilibrium Propagation

  • C2S Team
  • Institut Polytechnique de Paris

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Equilibrium Propagation (EqProp) is an alternative to backpropagation for minimizing an energy function. Existing EqProp implementations for nonlinear resistive networks typically rely on a pseudo-power formulation, defined as the integral of the local current-voltage characteristic. However, pseudo-power is only applicable to two-terminal components and cannot be extended to dependent or multi-terminal elements, limiting its conceptual consistency across the circuit. This work proposes using the true electrical power, defined as I • V , as the governing energy function for analog resistive networks. Theoretically, the true electrical power satisfies the equilibrium condition ∂P/∂V = 0 and aligns with Kirchhoff's laws across both linear and nonlinear devices. Ngspice and PySpice simulations of the XOR task, averaged over 100 randomly initialized resistance values, show that the true-power formulation achieves stable convergence to approximately -7dB error, compared to -4dB for pseudo-power. When controlled-source or diode contributions were excluded, both formulations failed to learn and diverged toward +10dB. These results demonstrate that EqProp learning in analog hardware requires an energy function that accounts for all circuit components; in addition, the true electrical power provides a physically consistent formulation with lower computational overhead than pseudo-power.

Original languageEnglish
Title of host publicationISCAS 2026 - 2026 IEEE International Symposium on Circuits and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1864-1868
Number of pages5
ISBN (Electronic)9798331577698
DOIs
Publication statusPublished - 1 Jan 2026
Event2026 IEEE International Symposium on Circuits and Systems, ISCAS 2026 - Shanghai, China
Duration: 24 May 2026 → 27 May 2026

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
ISSN (Print)0271-4310

Conference

Conference2026 IEEE International Symposium on Circuits and Systems, ISCAS 2026
Country/TerritoryChina
CityShanghai
Period24/05/26 → 27/05/26

Keywords

  • Equilibrium Propagation
  • analog neural networks
  • energy based models
  • machine learning
  • non-von Neumann architectures

Fingerprint

Dive into the research topics of 'Energy Function Choice for Training Nonlinear Resistive Neural Networks with Equilibrium Propagation'. Together they form a unique fingerprint.

Cite this