Inferring bifurcation diagrams with transformers
Document Type
Article
Publication Date
5-1-2024
Journal / Book Title
Chaos
Abstract
The construction of bifurcation diagrams is an essential component of understanding nonlinear dynamical systems. The task can be challenging when one knows the equations of the dynamical system and becomes much more difficult if only the underlying data associated with the system are available. In this work, we present a transformer-based method to directly estimate the bifurcation diagram using only noisy data associated with an arbitrary dynamical system. By splitting a bifurcation diagram into segments at bifurcation points, the transformer is trained to simultaneously predict how many segments are present and to minimize the loss with respect to the predicted position, shape, and asymptotic stability of each predicted segment. The trained model is shown, both quantitatively and qualitatively, to reliably estimate the structure of the bifurcation diagram for arbitrarily generated one- and two-dimensional systems experiencing a codimension-one bifurcation with as few as 30 trajectories. We show that the method is robust to noise in both the state variable and the system parameter.
DOI
10.1063/5.0204714
Journal ISSN / Book ISBN
85194017736 (Scopus)
Montclair State University Digital Commons Citation
Zhornyak, Lyra; Hsieh, M. Ani; and Forgoston, Eric, "Inferring bifurcation diagrams with transformers" (2024). School of Computing Faculty Scholarship and Creative Works. 76.
https://digitalcommons.montclair.edu/computing-facpubs/76