Publications

Results 26–50 of 93
Skip to search filters

Machine learning strategies for systems with invariance properties

Journal of Computational Physics

Ling, Julia L.; Jones, Reese E.; Templeton, Jeremy A.

In many scientific fields, empirical models are employed to facilitate computational simulations of engineering systems. For example, in fluid mechanics, empirical Reynolds stress closures enable computationally-efficient Reynolds Averaged Navier Stokes simulations. Likewise, in solid mechanics, constitutive relations between the stress and strain in a material are required in deformation analysis. Traditional methods for developing and tuning empirical models usually combine physical intuition with simple regression techniques on limited data sets. The rise of high performance computing has led to a growing availability of high fidelity simulation data. These data open up the possibility of using machine learning algorithms, such as random forests or neural networks, to develop more accurate and general empirical models. A key question when using data-driven algorithms to develop these empirical models is how domain knowledge should be incorporated into the machine learning process. This paper will specifically address physical systems that possess symmetry or invariance properties. Two different methods for teaching a machine learning model an invariance property are compared. In the first method, a basis of invariant inputs is constructed, and the machine learning model is trained upon this basis, thereby embedding the invariance into the model. In the second method, the algorithm is trained on multiple transformations of the raw input data until the model learns invariance to that transformation. Results are discussed for two case studies: one in turbulence modeling and one in crystal elasticity. It is shown that in both cases embedding the invariance property into the input features yields higher performance at significantly reduced computational training costs.

More Details

Calibration and Forward Uncertainty Propagation for Large-eddy Simulations of Engineering Flows

Templeton, Jeremy A.; Blaylock, Myra L.; Domino, Stefan P.; Hewson, John C.; Kumar, Pritvi R.; Ling, Julia L.; Najm, H.N.; Ruiz, Anthony R.; Safta, Cosmin S.; Sargsyan, Khachik S.; Stewart, Alessia S.; Wagner, Gregory L.

The objective of this work is to investigate the efficacy of using calibration strategies from Uncertainty Quantification (UQ) to determine model coefficients for LES. As the target methods are for engineering LES, uncertainty from numerical aspects of the model must also be quantified. 15 The ultimate goal of this research thread is to generate a cost versus accuracy curve for LES such that the cost could be minimized given an accuracy prescribed by an engineering need. Realization of this goal would enable LES to serve as a predictive simulation tool within the engineering design process.

More Details

Evaluation of machine learning algorithms for prediction of regions of high Reynolds averaged Navier Stokes uncertainty

Physics of Fluids

Ling, Julia L.; Templeton, Jeremy A.

Reynolds Averaged Navier Stokes (RANS) models are widely used in industry to predict fluid flows, despite their acknowledged deficiencies. Not only do RANS models often produce inaccurate flow predictions, but there are very limited diagnostics available to assess RANS accuracy for a given flow configuration. If experimental or higher fidelity simulation results are not available for RANS validation, there is no reliable method to evaluate RANS accuracy. This paper explores the potential of utilizing machine learning algorithms to identify regions of high RANS uncertainty. Three different machine learning algorithms were evaluated: support vector machines, Adaboost decision trees, and random forests. The algorithms were trained on a database of canonical flow configurations for which validated direct numerical simulation or large eddy simulation results were available, and were used to classify RANS results on a point-by-point basis as having either high or low uncertainty, based on the breakdown of specific RANS modeling assumptions. Classifiers were developed for three different basic RANS eddy viscosity model assumptions: the isotropy of the eddy viscosity, the linearity of the Boussinesq hypothesis, and the non-negativity of the eddy viscosity. It is shown that these classifiers are able to generalize to flows substantially different from those on which they were trained. Feature selection techniques, model evaluation, and extrapolation detection are discussed in the context of turbulence modeling applications.

More Details

Atomistic and Molecular Effects in Electric Double Layers at High Surface Charges

Langmuir

Lee, Jonathan W.; Mani, Ali; Templeton, Jeremy A.

The Poisson-Boltzmann theory for electrolytes near a charged surface is known to be invalid due to unaccounted physics associated with high ion concentration regimes. To investigate this regime, fluids density functional theory (f-DFT) and molecular dynamics (MD) simulations were used to determine electric surface potential as a function of surface charge. Based on these detailed computations, for electrolytes with nonpolar solvent, the surface potential is shown to depend quadratically on the surface charge in the high charge limit. We demonstrate that modified Poisson-Boltzmann theories can model this limit if they are augmented with atomic packing densities provided by MD. However, when the solvent is a highly polar molecule, water in this case, an intermediate regime is identified in which a constant capacitance is realized. Simulation results demonstrate the mechanism underlying this regime, and for the salt water system studied here, it persists throughout the range of physically realistic surface charge densities so the potential's quadratic surface charge dependence is not obtained.

More Details

Spatial resolution of the electrical conductance of ionic fluids using a Green-Kubo method

Journal of Chemical Physics

Jones, Reese E.; Ward, D.K.; Templeton, Jeremy A.

We present a Green-Kubo method to spatially resolve transport coefficients in compositionally heterogeneous mixtures. We develop the underlying theory based on well-known results from mixture theory, Irving-Kirkwood field estimation, and linear response theory. Then, using standard molecular dynamics techniques, we apply the methodology to representative systems. With a homogeneous salt water system, where the expectation of the distribution of conductivity is clear, we demonstrate the sensitivities of the method to system size, and other physical and algorithmic parameters. Then we present a simple model of an electrochemical double layer where we explore the resolution limit of the method. In this system, we observe significant anisotropy in the wall-normal vs. transverse ionic conductances, as well as near wall effects. Finally, we discuss extensions and applications to more realistic systems such as batteries where detailed understanding of the transport properties in the vicinity of the electrodes is of technological importance.

More Details

Computational solution verification and validation applied to a thermal model of a ruggedized instrumentation package

WIT Transactions on Modelling and Simulation

Scott, Sarah N.; Templeton, Jeremy A.; Ruthruff, Joseph R.; Hough, Patricia D.; Peterson, Jerrod P.

This study details a methodology for quantification of errors and uncertainties of a finite element heat transfer model applied to a Ruggedized Instrumentation Package (RIP). The proposed verification and validation (V&V) process includes solution verification to examine errors associated with the code's solution techniques, and model validation to assess the model's predictive capability for quantities of interest. The model was subjected to mesh resolution and numerical parameters sensitivity studies to determine reasonable parameter values and to understand how they change the overall model response and performance criteria. To facilitate quantification of the uncertainty associated with the mesh, automatic meshing and mesh refining/coarsening algorithms were created and implemented on the complex geometry of the RIP. Automated software to vary model inputs was also developed to determine the solution’s sensitivity to numerical and physical parameters. The model was compared with an experiment to demonstrate its accuracy and determine the importance of both modelled and unmodelled physics in quantifying the results' uncertainty. An emphasis is placed on automating the V&V process to enable uncertainty quantification within tight development schedules.

More Details

Theoretical and experimental studies of electrified interfaces relevant to energy storage

Hayden, Carl C.; Templeton, Jeremy A.; Jones, Reese E.; Kliewer, Christopher J.; Sasaki, Darryl Y.; Reyes, Karla R.

Advances in technology for electrochemical energy storage require increased understanding of electrolyte/electrode interfaces, including the electric double layer structure, and processes involved in charging of the interface, and the incorporation of this understanding into quantitative models. Simplified models such as Helmholtz's electric double-layer (EDL) concept don't account for the molecular nature of ion distributions, solvents, and electrode surfaces and therefore cannot be used in predictive, high-fidelity simulations for device design. This report presents theoretical results from models that explicitly include the molecular nature of the electrical double layer and predict critical electrochemical quantities such as interfacial capacitance. It also describes development of experimental tools for probing molecular properties of electrochemical interfaces through optical spectroscopy. These optical experimental methods are designed to test our new theoretical models that provide descriptions of the electric double layer in unprecedented detail.

More Details
Results 26–50 of 93
Results 26–50 of 93