Sparse feature map-based Markov models for nonlinear fluid flows

•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers & fluids 2019-09, Vol.191, p.104252, Article 104252
Hauptverfasser: Jayaraman, Balaji, Lu, Chen, Whitman, Joshua, Chowdhary, Girish
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 104252
container_title Computers & fluids
container_volume 191
creator Jayaraman, Balaji
Lu, Chen
Whitman, Joshua
Chowdhary, Girish
description •Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations. Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The re
doi_str_mv 10.1016/j.compfluid.2019.104252
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2324875354</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0045793019302208</els_id><sourcerecordid>2324875354</sourcerecordid><originalsourceid>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</originalsourceid><addsrcrecordid>eNqFUE1LxDAQDaLguvobLHjumiZtprm5LH7Bigf1HNJ0Aq1tU5N2xX9v1hWvXmaY4X3wHiGXGV1lNBPX7cq4frTd3NQrRjMZvzkr2BFZZCXIlEIOx2RBaV6kIDk9JWchtDTenOULcvMyah8wsain2WPS6zGtdMA6edL-3e2S3tXYhcQ6nwxu6JoBtU9-3OJ0n-GcnFjdBbz43Uvydnf7unlIt8_3j5v1NjVcsimFqqgkrcBSpFzwomIcDRMCZE1LELoEK0EiK4Qpc51ZQNR6T9KsEiCAL8nVQXf07mPGMKnWzX6IlorFJCUUvMgjCg4o410IHq0afdNr_6UyqvZ1qVb91aX2dalDXZG5PjBjWtw16FUwDQ4G68ajmVTtmn81vgEZ-HcX</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2324875354</pqid></control><display><type>article</type><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</creator><creatorcontrib>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</creatorcontrib><description>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations. Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</description><identifier>ISSN: 0045-7930</identifier><identifier>EISSN: 1879-0747</identifier><identifier>DOI: 10.1016/j.compfluid.2019.104252</identifier><language>eng</language><publisher>Amsterdam: Elsevier Ltd</publisher><subject>Approximation ; Attractors (mathematics) ; Base flow ; Boussinesq equations ; Computational fluid dynamics ; Cylinders ; Data-driven ; Decision making ; Evolution ; Feature map ; Feature maps ; Flow mapping ; Fluid flow ; Forecasting ; Gaussian process ; Gaussian processes ; Hilbert space ; Kernels ; Linear systems ; Machine learning ; Markov chains ; Markovian ; Mathematical analysis ; Multilayers ; Nonlinear systems ; POD ; Radial basis function kernels ; Reconstruction ; Sparse ; System effectiveness</subject><ispartof>Computers &amp; fluids, 2019-09, Vol.191, p.104252, Article 104252</ispartof><rights>2019</rights><rights>Copyright Elsevier BV Sep 15, 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</citedby><cites>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</cites><orcidid>0000-0001-5825-6453</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compfluid.2019.104252$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Jayaraman, Balaji</creatorcontrib><creatorcontrib>Lu, Chen</creatorcontrib><creatorcontrib>Whitman, Joshua</creatorcontrib><creatorcontrib>Chowdhary, Girish</creatorcontrib><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><title>Computers &amp; fluids</title><description>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations. Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</description><subject>Approximation</subject><subject>Attractors (mathematics)</subject><subject>Base flow</subject><subject>Boussinesq equations</subject><subject>Computational fluid dynamics</subject><subject>Cylinders</subject><subject>Data-driven</subject><subject>Decision making</subject><subject>Evolution</subject><subject>Feature map</subject><subject>Feature maps</subject><subject>Flow mapping</subject><subject>Fluid flow</subject><subject>Forecasting</subject><subject>Gaussian process</subject><subject>Gaussian processes</subject><subject>Hilbert space</subject><subject>Kernels</subject><subject>Linear systems</subject><subject>Machine learning</subject><subject>Markov chains</subject><subject>Markovian</subject><subject>Mathematical analysis</subject><subject>Multilayers</subject><subject>Nonlinear systems</subject><subject>POD</subject><subject>Radial basis function kernels</subject><subject>Reconstruction</subject><subject>Sparse</subject><subject>System effectiveness</subject><issn>0045-7930</issn><issn>1879-0747</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNqFUE1LxDAQDaLguvobLHjumiZtprm5LH7Bigf1HNJ0Aq1tU5N2xX9v1hWvXmaY4X3wHiGXGV1lNBPX7cq4frTd3NQrRjMZvzkr2BFZZCXIlEIOx2RBaV6kIDk9JWchtDTenOULcvMyah8wsain2WPS6zGtdMA6edL-3e2S3tXYhcQ6nwxu6JoBtU9-3OJ0n-GcnFjdBbz43Uvydnf7unlIt8_3j5v1NjVcsimFqqgkrcBSpFzwomIcDRMCZE1LELoEK0EiK4Qpc51ZQNR6T9KsEiCAL8nVQXf07mPGMKnWzX6IlorFJCUUvMgjCg4o410IHq0afdNr_6UyqvZ1qVb91aX2dalDXZG5PjBjWtw16FUwDQ4G68ajmVTtmn81vgEZ-HcX</recordid><startdate>20190915</startdate><enddate>20190915</enddate><creator>Jayaraman, Balaji</creator><creator>Lu, Chen</creator><creator>Whitman, Joshua</creator><creator>Chowdhary, Girish</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7TB</scope><scope>7U5</scope><scope>8FD</scope><scope>FR3</scope><scope>H8D</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5825-6453</orcidid></search><sort><creationdate>20190915</creationdate><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><author>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Approximation</topic><topic>Attractors (mathematics)</topic><topic>Base flow</topic><topic>Boussinesq equations</topic><topic>Computational fluid dynamics</topic><topic>Cylinders</topic><topic>Data-driven</topic><topic>Decision making</topic><topic>Evolution</topic><topic>Feature map</topic><topic>Feature maps</topic><topic>Flow mapping</topic><topic>Fluid flow</topic><topic>Forecasting</topic><topic>Gaussian process</topic><topic>Gaussian processes</topic><topic>Hilbert space</topic><topic>Kernels</topic><topic>Linear systems</topic><topic>Machine learning</topic><topic>Markov chains</topic><topic>Markovian</topic><topic>Mathematical analysis</topic><topic>Multilayers</topic><topic>Nonlinear systems</topic><topic>POD</topic><topic>Radial basis function kernels</topic><topic>Reconstruction</topic><topic>Sparse</topic><topic>System effectiveness</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jayaraman, Balaji</creatorcontrib><creatorcontrib>Lu, Chen</creatorcontrib><creatorcontrib>Whitman, Joshua</creatorcontrib><creatorcontrib>Chowdhary, Girish</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers &amp; fluids</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jayaraman, Balaji</au><au>Lu, Chen</au><au>Whitman, Joshua</au><au>Chowdhary, Girish</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Sparse feature map-based Markov models for nonlinear fluid flows</atitle><jtitle>Computers &amp; fluids</jtitle><date>2019-09-15</date><risdate>2019</risdate><volume>191</volume><spage>104252</spage><pages>104252-</pages><artnum>104252</artnum><issn>0045-7930</issn><eissn>1879-0747</eissn><abstract>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations. Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</abstract><cop>Amsterdam</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.compfluid.2019.104252</doi><orcidid>https://orcid.org/0000-0001-5825-6453</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0045-7930
ispartof Computers & fluids, 2019-09, Vol.191, p.104252, Article 104252
issn 0045-7930
1879-0747
language eng
recordid cdi_proquest_journals_2324875354
source Elsevier ScienceDirect Journals Complete
subjects Approximation
Attractors (mathematics)
Base flow
Boussinesq equations
Computational fluid dynamics
Cylinders
Data-driven
Decision making
Evolution
Feature map
Feature maps
Flow mapping
Fluid flow
Forecasting
Gaussian process
Gaussian processes
Hilbert space
Kernels
Linear systems
Machine learning
Markov chains
Markovian
Mathematical analysis
Multilayers
Nonlinear systems
POD
Radial basis function kernels
Reconstruction
Sparse
System effectiveness
title Sparse feature map-based Markov models for nonlinear fluid flows
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T18%3A17%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Sparse%20feature%20map-based%20Markov%20models%20for%20nonlinear%20fluid%20flows&rft.jtitle=Computers%20&%20fluids&rft.au=Jayaraman,%20Balaji&rft.date=2019-09-15&rft.volume=191&rft.spage=104252&rft.pages=104252-&rft.artnum=104252&rft.issn=0045-7930&rft.eissn=1879-0747&rft_id=info:doi/10.1016/j.compfluid.2019.104252&rft_dat=%3Cproquest_cross%3E2324875354%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2324875354&rft_id=info:pmid/&rft_els_id=S0045793019302208&rfr_iscdi=true