Sparse feature map-based Markov models for nonlinear fluid flows
•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressi...
Gespeichert in:
Veröffentlicht in: | Computers & fluids 2019-09, Vol.191, p.104252, Article 104252 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 104252 |
container_title | Computers & fluids |
container_volume | 191 |
creator | Jayaraman, Balaji Lu, Chen Whitman, Joshua Chowdhary, Girish |
description | •Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations.
Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The re |
doi_str_mv | 10.1016/j.compfluid.2019.104252 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2324875354</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0045793019302208</els_id><sourcerecordid>2324875354</sourcerecordid><originalsourceid>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</originalsourceid><addsrcrecordid>eNqFUE1LxDAQDaLguvobLHjumiZtprm5LH7Bigf1HNJ0Aq1tU5N2xX9v1hWvXmaY4X3wHiGXGV1lNBPX7cq4frTd3NQrRjMZvzkr2BFZZCXIlEIOx2RBaV6kIDk9JWchtDTenOULcvMyah8wsain2WPS6zGtdMA6edL-3e2S3tXYhcQ6nwxu6JoBtU9-3OJ0n-GcnFjdBbz43Uvydnf7unlIt8_3j5v1NjVcsimFqqgkrcBSpFzwomIcDRMCZE1LELoEK0EiK4Qpc51ZQNR6T9KsEiCAL8nVQXf07mPGMKnWzX6IlorFJCUUvMgjCg4o410IHq0afdNr_6UyqvZ1qVb91aX2dalDXZG5PjBjWtw16FUwDQ4G68ajmVTtmn81vgEZ-HcX</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2324875354</pqid></control><display><type>article</type><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</creator><creatorcontrib>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</creatorcontrib><description>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations.
Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</description><identifier>ISSN: 0045-7930</identifier><identifier>EISSN: 1879-0747</identifier><identifier>DOI: 10.1016/j.compfluid.2019.104252</identifier><language>eng</language><publisher>Amsterdam: Elsevier Ltd</publisher><subject>Approximation ; Attractors (mathematics) ; Base flow ; Boussinesq equations ; Computational fluid dynamics ; Cylinders ; Data-driven ; Decision making ; Evolution ; Feature map ; Feature maps ; Flow mapping ; Fluid flow ; Forecasting ; Gaussian process ; Gaussian processes ; Hilbert space ; Kernels ; Linear systems ; Machine learning ; Markov chains ; Markovian ; Mathematical analysis ; Multilayers ; Nonlinear systems ; POD ; Radial basis function kernels ; Reconstruction ; Sparse ; System effectiveness</subject><ispartof>Computers & fluids, 2019-09, Vol.191, p.104252, Article 104252</ispartof><rights>2019</rights><rights>Copyright Elsevier BV Sep 15, 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</citedby><cites>FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</cites><orcidid>0000-0001-5825-6453</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compfluid.2019.104252$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Jayaraman, Balaji</creatorcontrib><creatorcontrib>Lu, Chen</creatorcontrib><creatorcontrib>Whitman, Joshua</creatorcontrib><creatorcontrib>Chowdhary, Girish</creatorcontrib><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><title>Computers & fluids</title><description>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations.
Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</description><subject>Approximation</subject><subject>Attractors (mathematics)</subject><subject>Base flow</subject><subject>Boussinesq equations</subject><subject>Computational fluid dynamics</subject><subject>Cylinders</subject><subject>Data-driven</subject><subject>Decision making</subject><subject>Evolution</subject><subject>Feature map</subject><subject>Feature maps</subject><subject>Flow mapping</subject><subject>Fluid flow</subject><subject>Forecasting</subject><subject>Gaussian process</subject><subject>Gaussian processes</subject><subject>Hilbert space</subject><subject>Kernels</subject><subject>Linear systems</subject><subject>Machine learning</subject><subject>Markov chains</subject><subject>Markovian</subject><subject>Mathematical analysis</subject><subject>Multilayers</subject><subject>Nonlinear systems</subject><subject>POD</subject><subject>Radial basis function kernels</subject><subject>Reconstruction</subject><subject>Sparse</subject><subject>System effectiveness</subject><issn>0045-7930</issn><issn>1879-0747</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNqFUE1LxDAQDaLguvobLHjumiZtprm5LH7Bigf1HNJ0Aq1tU5N2xX9v1hWvXmaY4X3wHiGXGV1lNBPX7cq4frTd3NQrRjMZvzkr2BFZZCXIlEIOx2RBaV6kIDk9JWchtDTenOULcvMyah8wsain2WPS6zGtdMA6edL-3e2S3tXYhcQ6nwxu6JoBtU9-3OJ0n-GcnFjdBbz43Uvydnf7unlIt8_3j5v1NjVcsimFqqgkrcBSpFzwomIcDRMCZE1LELoEK0EiK4Qpc51ZQNR6T9KsEiCAL8nVQXf07mPGMKnWzX6IlorFJCUUvMgjCg4o410IHq0afdNr_6UyqvZ1qVb91aX2dalDXZG5PjBjWtw16FUwDQ4G68ajmVTtmn81vgEZ-HcX</recordid><startdate>20190915</startdate><enddate>20190915</enddate><creator>Jayaraman, Balaji</creator><creator>Lu, Chen</creator><creator>Whitman, Joshua</creator><creator>Chowdhary, Girish</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7TB</scope><scope>7U5</scope><scope>8FD</scope><scope>FR3</scope><scope>H8D</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5825-6453</orcidid></search><sort><creationdate>20190915</creationdate><title>Sparse feature map-based Markov models for nonlinear fluid flows</title><author>Jayaraman, Balaji ; Lu, Chen ; Whitman, Joshua ; Chowdhary, Girish</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c392t-7b5b90b7f0e03635b23ec26679d0876a87f979e256c84a1f7eeaa7b5ba2b67673</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Approximation</topic><topic>Attractors (mathematics)</topic><topic>Base flow</topic><topic>Boussinesq equations</topic><topic>Computational fluid dynamics</topic><topic>Cylinders</topic><topic>Data-driven</topic><topic>Decision making</topic><topic>Evolution</topic><topic>Feature map</topic><topic>Feature maps</topic><topic>Flow mapping</topic><topic>Fluid flow</topic><topic>Forecasting</topic><topic>Gaussian process</topic><topic>Gaussian processes</topic><topic>Hilbert space</topic><topic>Kernels</topic><topic>Linear systems</topic><topic>Machine learning</topic><topic>Markov chains</topic><topic>Markovian</topic><topic>Mathematical analysis</topic><topic>Multilayers</topic><topic>Nonlinear systems</topic><topic>POD</topic><topic>Radial basis function kernels</topic><topic>Reconstruction</topic><topic>Sparse</topic><topic>System effectiveness</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jayaraman, Balaji</creatorcontrib><creatorcontrib>Lu, Chen</creatorcontrib><creatorcontrib>Whitman, Joshua</creatorcontrib><creatorcontrib>Chowdhary, Girish</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers & fluids</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jayaraman, Balaji</au><au>Lu, Chen</au><au>Whitman, Joshua</au><au>Chowdhary, Girish</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Sparse feature map-based Markov models for nonlinear fluid flows</atitle><jtitle>Computers & fluids</jtitle><date>2019-09-15</date><risdate>2019</risdate><volume>191</volume><spage>104252</spage><pages>104252-</pages><artnum>104252</artnum><issn>0045-7930</issn><eissn>1879-0747</eissn><abstract>•Feature-mapped Markov models are related to Koopman theory for nonlinear systems.•Appropriate feature maps improve time-dependent predictions of nonlinear dynamics.•Nonlinear functions embedded in local kernels generalize better to unseen data.•Global data-driven basis are not sufficiently expressive to capture complex dynamics.•Layered feature maps offer better and efficient nonlinear approximations.
Data-driven Markov linear models of nonlinear fluid flows using maps of the state into a sparse feature space are explored in this article. The underlying principle of low-order models for fluid systems is identifying maps to a feature space where the system evolution (a) is simpler and efficient to model accurately and (b) the state can be recovered accurately from the features through inverse mapping. Such methods are useful when real-time models are needed for online decision making from sensor data. The Markov linear approximation is popular as it allows us to leverage the well established linear systems machinery. Examples include the Koopman operator approximation techniques and evolutionary kernel methods in machine learning. The success of these models in approximating nonlinear dynamical systems is tied to the effectiveness of the feature map in accomplishing both (a) and (b) above as long as the system provides a feasible prediction horizon using data. We assess this by performing an in-depth study of two different classes of sparse linear feature transformations of the state: (i) a pure data-driven POD-based projection that uses left singular vectors of the data snapshots – a staple of common Koopman approximation methods such as Dynamic Mode Decomposition (DMD) and its variants such as extended DMD; and (ii) a partially data-driven sparse Gaussian kernel (sGK) regression (a mean sparse Gaussian Process (sGP) predictor). The sGK/sGP regression equivalently represents a projection onto an infinite-dimensional basis characterized by a kernel in the inner product reproducing kernel Hilbert space (RKHS). We are particularly interested in the effectiveness of these linear feature maps for long-term prediction using limited data for three classes of fluid flows with escalating complexity (and decreasing prediction horizons) starting from a limit-cycle attractor in a cylinder wake followed by a transient wake evolution with a shift in the base flow and finally, a continuously evolving buoyant Boussinesq mixing flow with no well-defined base state. The results indicate that a purely data-driven POD map is good for full state reconstruction as long as the basis remains relevant to the predictions whereas the more generic sparse Gaussian Kernel (sGK) basis is less sensitive to the evolution of the dynamics but prone to reconstruction errors from lack of parsimony. Contrastingly, the sGK-maps outperform POD-based maps in learning the transient nonlinear evolution of the state for the same feature dimension in systems that contain a well-defined attractor(s). Consequently, both POD and sGK-maps require additional layer(s) to help mitigate these shortcomings. For example, POD-maps require nonlinear functional extensions for improved feature space predictions whereas sGK-maps require dimensionality reduction to balance the large feature dimension needed for accurate full state reconstruction. However, both classes of multilayer feature maps fail to predict the highly evolving buoyant mixing flow for very different reasons.</abstract><cop>Amsterdam</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.compfluid.2019.104252</doi><orcidid>https://orcid.org/0000-0001-5825-6453</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0045-7930 |
ispartof | Computers & fluids, 2019-09, Vol.191, p.104252, Article 104252 |
issn | 0045-7930 1879-0747 |
language | eng |
recordid | cdi_proquest_journals_2324875354 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Approximation Attractors (mathematics) Base flow Boussinesq equations Computational fluid dynamics Cylinders Data-driven Decision making Evolution Feature map Feature maps Flow mapping Fluid flow Forecasting Gaussian process Gaussian processes Hilbert space Kernels Linear systems Machine learning Markov chains Markovian Mathematical analysis Multilayers Nonlinear systems POD Radial basis function kernels Reconstruction Sparse System effectiveness |
title | Sparse feature map-based Markov models for nonlinear fluid flows |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T18%3A17%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Sparse%20feature%20map-based%20Markov%20models%20for%20nonlinear%20fluid%20flows&rft.jtitle=Computers%20&%20fluids&rft.au=Jayaraman,%20Balaji&rft.date=2019-09-15&rft.volume=191&rft.spage=104252&rft.pages=104252-&rft.artnum=104252&rft.issn=0045-7930&rft.eissn=1879-0747&rft_id=info:doi/10.1016/j.compfluid.2019.104252&rft_dat=%3Cproquest_cross%3E2324875354%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2324875354&rft_id=info:pmid/&rft_els_id=S0045793019302208&rfr_iscdi=true |