Machine learning offers effective approaches to modeling dynamical systems solely from observed data. However, without explicit structural priors (built-in assumptions about the underlying dynamics) or additional contextual inputs, even modern high-capacity models that demonstrate impressive generalization typically require large and diverse training datasets, and may still struggle to generalize to aspects of the dynamics that are poorly represented in the training data.
In this talk, we will first show that reservoir computing—a simple, efficient, and versatile framework for data-driven modeling of dynamical systems—can generalize to unexplored regions of state space without explicit structural priors. Using multistable dynamical systems as a test setting, we demonstrate that reservoir computers trained on trajectories from a single basin of attraction can achieve out-of-domain generalization by capturing system behavior in entirely unobserved basins.
We then consider settings in which the underlying dynamics (governing equations) also differ between the training and test data, a challenging scenario for models both with and without structural priors. We introduce Meta-learning for Tailored Forecasting using Related Time Series (METAFORS), which builds and initializes a model tailored to short time-series data from a target system by leveraging a library of models trained on longer time series from potentially related systems. Without requiring contextual labels, METAFORS reliably predicts both short-term evolution and long-term statistical properties, even when the target and related systems exhibit substantially different behaviors.