This page introduces our research findings by theme. Each theme page describes the background and results of individual studies, together with related publications.
We study mathematically why evolutionary algorithms such as CMA-ES work, and use this understanding to design new algorithms.
Starting from dd-CMA-ES, the latest version of CMA-ES, we broaden the problems CMA-ES can handle, including high-dimensional problems, automatic hyperparameter adaptation, and problems with mixed discrete and continuous variables.
We study, in black-box settings, worst-case and risk-aware optimization for solutions whose performance is guaranteed despite simulation model errors and environmental uncertainty, and bilevel optimization in which an upper-level decision is evaluated through the outcome of a lower-level optimization.
We study problems in which an upper-level designer sets incentives or environments, and the quality of the design is judged through the behavior of a lower-level agent that learns in response. The agent's learning process is a black box to the designer, and we develop methods that improve the design with few trials.
We study reinforcement learning from human feedback (RLHF) and alignment methods that make large language models follow human preferences and safety requirements. Human evaluations and preference data are also black boxes; we work on aligning models to preferences while respecting constraints, and on analyzing their vulnerability to biases and attacks in preference data.
Toward real-world use of reinforcement learning, we develop methods that satisfy safety constraints throughout, from learning to deployment, and methods that keep worst-case performance under discrepancies between simulators and real environments.
Together with universities and companies in Japan and abroad, we apply our optimization techniques to a range of applications, including autonomous ship navigation, topology optimization of cloaking devices and structures, CO₂ geological storage, and data analysis.
These are topics we have worked on in the past, though they are not our main focus at present, including neural architecture search, constrained optimization with deep generative models, and automated selection of simulation fidelity.