This work evaluates different optimization algorithms for computational fluid dynamics (CFD) simulations of engine combustion. Due to the computational expense of CFD simulations, emulators built with machine learning algorithms were used as surrogates for the optimizers. Two types of emulators were used: a Gaussian process (GP) and a weighted variety of machine learning methods called SuperLearner (SL). The emulators were trained using a dataset of 2048 CFD simulations that were run concurrently on a supercomputer. The design of experiments (DOE) for the CFD runs was obtained by perturbing nine input parameters using a Monte-Carlo method. The CFD simulations were of a heavy duty engine running with a low octane gasoline-like fuel at a partially premixed compression ignition mode. Ten optimization algorithms were tested, including types typically used in research applications. Each optimizer was allowed 800 function evaluations and was randomly tested 100 times. The optimizers were evaluated for the median, minimum, and maximum merits obtained in the 100 attempts. Some optimizers required more sequential evaluations, thereby resulting in longer wall clock times to reach an optimum. The best performing optimization methods were particle swarm optimization (PSO), differential evolution (DE), GENOUD (an evolutionary algorithm), and micro-genetic algorithm (GA). These methods found a high median optimum as well as a reasonable minimum optimum of the 100 trials. Moreover, all of these methods were able to operate with less than 100 successive iterations, which reduced the wall clock time required in practice. Two methods were found to be effective but required a much larger number of successive iterations: the DIRECT and MALSCHAINS algorithms. A random search method that completed in a single iteration performed poorly in finding optimum designs but was included to illustrate the limitation of highly concurrent search methods. The last three methods, Nelder–Mead, bound optimization by quadratic approximation (BOBYQA), and constrained optimization by linear approximation (COBYLA), did not perform as well.

References

1.
EPA Report, 2016, “
Light-Duty Automotive Technology, Carbon Dioxide Emissions, and Fuel Economy Trends: 1975 Through 2016
,” United States Environmental Protection Agency, Washington, DC, accessed May 2018, https://www.fueleconomy.gov/feg/pdfs/420r16010.pdf
2.
Patterson
,
M.
,
Kong
,
S.
,
Hampson
,
G.
, and
Reitz
,
R.
,
1994
, “
Modeling the Effects of Fuel Injection Characteristics on Diesel Engine Soot and NOx Emissions
,”
SAE
Paper No. 940523.
3.
Ge
,
H.
,
Reitz
,
R.
, and
Willems
,
W.
,
2008
, “
Modeling the Effects of in-Cylinder Flows on HSDI Diesel Engine Performance and Emissions
,”
SAE Int. J. Fuels Lubr.
,
1
(
1
), pp.
293
311
.
4.
Liang
,
L.
,
Reitz
,
R.
,
Iyer
,
C.
, and
Yi
,
J.
,
2007
, “
Modeling Knock in Spark-Ignition Engines Using a G-Equation Combustion Model Incorporating Detailed Chemical Kinetics
,”
SAE
Paper No. 2007-01-0165.
5.
Shao
,
J.
, and
Rutland
,
C. J.
,
2015
, “
Modeling Investigation of Different Methods to Suppress Engine Knock on a Small Spark Ignition Engine
,”
ASME J. Eng. Gas Turbines Power
,
137
(
6
), p.
061506
.
6.
Fontanesi
,
S.
,
d'Adamo
,
A.
, and
Rutland
,
C. J.
,
2015
, “
Large-Eddy Simulation Analysis of Spark Configuration Effect on Cycle-to-Cycle Variability of Combustion and Knock
,”
Int. J. Engine Res.
,
16
(
3
), pp.
403
418
.
7.
Kokjohn
,
S. L.
,
Hanson
,
R. M.
,
Splitter
,
D. A.
, and
Reitz
,
R. D.
,
2011
, “
Fuel Reactivity Controlled Compression Ignition (RCCI): A Pathway to Controlled High-Efficiency Clean Combustion
,”
Int. J. Engine Res.
,
12
(
3
), pp.
209
226
.
8.
Pei
,
Y.
,
Zhang
,
Y.
,
Kumar
,
P.
,
Traver
,
M.
,
Cleary
,
D.
,
Ameen
,
M.
,
Som
,
S.
,
Probst
,
D.
,
Burton
,
T.
,
Pomraning
,
E.
, and
Senecal
,
P. K.
,
2017
, “
CFD-Guided Heavy Duty Mixing-Controlled Combustion System Optimization With a Gasoline-Like Fuel
,”
SAE Int. J. Commer. Veh.
,
10
(
2
), pp.
532
546
.
9.
Montgomery
,
D.
, and
Reitz
,
R.
,
2000
, “
Optimization of Heavy-Duty Diesel Engine Operating Parameters Using a Response Surface Method
,”
SAE
Paper No. 2000-01-1962.
10.
Probst
,
D. M.
,
Senecal
,
P. K.
,
Qian
,
P. Z.
,
Xu
,
M. X.
, and
Leyde
,
B. P.
, 2016, “
Optimization and Uncertainty Analysis of a Diesel Engine Operating Point Using CFD
,”
ASME
Paper No. ICEF2016-9345.
11.
Brochu
,
E.
,
Cora
,
V. M.
, and
De Freitas
,
N.
, 2010, “
A Tutorial on Bayesian Optimization of Expensive Cost Functions, With Application to Active User Modeling and Hierarchical Reinforcement Learning
,”
arXiv:1012.2599
.https://arxiv.org/abs/1012.2599
12.
Wickman
,
D.
,
Senecal
,
P.
, and
Reitz
,
R.
,
2001
, “
Diesel Engine Combustion Chamber Geometry Optimization Using Genetic Algorithms and Multi-Dimensional Spray and Combustion Modeling
,”
SAE
Paper No. 2001-01-0547.
13.
Ge
,
H.-W.
,
Shi
,
Y.
,
Reitz
,
R. D.
,
Wickman
,
D. D.
, and
Willems
,
W.
,
2009
, “
Optimization of a HSDI Diesel Engine for Passenger Cars Using a Multi-Objective Genetic Algorithm and Multi-Dimensional Modeling
,”
SAE Int. J. Engines
,
2
(
1
), pp.
691
713
.
14.
Senecal
,
P.
, and
Reitz
,
R.
,
2000
, “
Simultaneous Reduction of Engine Emissions and Fuel Consumption Using Genetic Algorithms and Multi-Dimensional Spray and Combustion Modeling
,”
SAE
Paper No. 2000-01-1890.
15.
Moiz
,
A.
,
Pal
,
P.
,
Probst
,
D.
, and
Pei
,
Y.
,
2018
, “
A Machine Learning-Genetic Algorithm (ML-GA) Approach for Rapid Optimization Using High-Performance Computing
,”
SAE
Paper No. 2018-01-0190.
16.
Mullen
,
K.
,
2014
, “
Continuous Global Optimization in R
,”
J. Stat. Software
,
60
(
6
), pp. 1–45.
17.
Richards
,
K. J.
,
Senecal
,
P. K.
, and
Pomraning
,
E.
,
2018
,
CONVERGE v2.4 Theory Manual
,
Convergent Science
,
Madison, WI
.
18.
Scrucca
,
L.
,
2013
, “
GA: A Package for Genetic Algorithms in R
,”
J. Stat. Software
,
53
(
4
), pp.
1
37
.https://www.jstatsoft.org/index.php/jss/article/view/v053i04/v53i04.pdf
19.
Walter
,
M.
, Jr.
, and
Jasjeet
,
S. S.
,
2011
, “
Genetic Optimization Using Derivatives: The rgenoud Package for R
,”
J. Stat. Software
,
42
(
11
), pp.
1
26
. https://cran.r-project.org/web/packages/rgenoud/vignettes/rgenoud.pdf
20.
Storn
,
R.
,
Price
,
K.
, and
Lampinen
,
J.
,
2006
, Differential Evolution—A Practical Approach to Global Optimization, Springer, Berlin.
21.
Brest
,
J.
,
Greiner
,
S.
,
Boskovic
,
B.
,
Mernik
,
M.
, and
Zumer
,
V.
,
2006
, “
Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems
,”
IEEE Trans. Evol. Comput.
,
10
(
6
), pp.
646
657
.
22.
Molina
,
D.
,
Lozano
,
M.
,
Sanchez
,
A. M.
, and
Herrera
,
F.
,
2011
, “
Memetic Algorithms Based on Local Search Chains for Large Scale Continuous Optimization Problems: MA-SSW-Chains
,”
Soft Comput.
,
15
(
11
), pp.
2201
2220
.
23.
Molina
,
D.
,
Lozano
,
M.
,
García-Martínez
,
C.
, and
Herrera
,
F.
,
2010
, “
Memetic Algorithms for Continuous Optimization Based on Local Search Chains
,”
Evol. Comput.
,
18
(
1
), pp.
27
63
.
24.
Kennedy
,
J.
, and
Eberhart
,
R.
,
1995
, “
Particle Swarm Optimization
,”
IEEE International Conference
on Neural Networks (
ICNN
), Perth, Australia, Nov. 27–Dec. 1, pp.
1942
1948
.
25.
Jones
,
D. R.
,
Perttunen
,
C. D.
, and
Stuckman
,
B.
,
1993
, “
Lipschitzian Optimisation Without the Lipschitz Constant
,”
J. Optim. Theory Appl.
,
79
(
1
), pp.
157
181
.
26.
Gablonsky
,
J. M.
, and
Kelley
,
C. T.
,
2001
, “
A Locally-Biased Form of the DIRECT Algorithm
,”
J. Global Optim.
,
21
(
1
), pp.
27
37
.
27.
Steven
,
G. J.
, “
The NLopt Nonlinear-Optimization Package
,” accessed June 14, 2019, http://ab-initio.mit.edu/nlopt
28.
Nelder
,
J. A.
, and
Mead
,
R.
,
1965
, “
A Simplex Method for Function Minimization
,”
Comput. J.
,
7
(
4
), pp.
308
313
.
29.
Powell
,
M. J. D.
,
2009
, “
The BOBYQA Algorithm for Bound Constrained Optimization Without Derivatives
,” Department of Applied Mathematics and Theoretical Physics, Cambridge, UK, Report No. NA2009/06.
30.
Powell
,
M. J. D.
,
1994
, “
A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation
,”
Advances in Optimization and Numerical Analysis
, eds.
S.
Gomez
and
J.-P.
Hennart
,
Kluwer Academic
,
Dordrecht, The Netherlands
, pp.
51
67
.
31.
Liu
,
Y.-D.
,
Jia
,
M.
,
Xie
,
M.-Z.
, and
Pang
,
B.
,
2012
, “
Enhancement on a Skeletal Kinetic Model for Primary Reference Fuel Oxidation by Using a Semidecoupling Methodology
,”
Energy Fuels
,
26
(
12
), pp.
7069
7083
.
32.
Zhang
,
Y.
,
Kumar
,
P.
,
Traver
,
M.
, and
Cleary
,
D.
,
2016
, “
Conventional and Low Temperature Combustion Using Naphtha Fuels in a Multi-Cylinder Heavy-Duty Diesel Engine
,”
SAE Int. J. Engines
,
9
(
2
), pp.
1021
1035
.
33.
Pal
,
P.
,
Probst
,
D.
,
Pei
,
Y.
,
Zhang
,
Y.
,
Traver
,
M.
,
Cleary
,
D.
, and
Som
,
S.
,
2017
, “
Numerical Investigation of a Gasoline-Like Fuel in a Heavy-Duty Compression Ignition Engine Using Global Sensitivity Analysis
,”
SAE Int. J. Fuels Lubr.
,
10
(
1
), pp.
56
68
.
34.
van der Laan
,
M. J.
,
Polley
,
E. C.
, and
Hubbard
,
A. E.
,
2007
, “
Super Learner
,”
Stat. Appl. Genet. Mol. Biol.
,
6
(
25
), pp. 1–20.
35.
MacDonald
,
K. B.
,
Ranjan
,
P.
, and
Chipman
,
H.
,
2015
, “
GPfit: An R Package for Fitting a Gaussian Process Model to Deterministic Simulator Outputs
,”
J. Stat. Software
,
64
(
12
), pp.
1
23
. https://www.jstatsoft.org/index.php/jss/article/view/v064i12/v64i12.pdf
36.
Ranjan
,
P.
,
Haynes
,
R.
, and
Karsten
,
R.
,
2011
, “
A Computationally Stable Approach to Gaussian Process Interpolation of Deterministic Computer Simulation Data
,”
Technometrics
,
53
(
4
), pp.
366
378
.
You do not currently have access to this content.