Summary

Message

In May 2023, the National Institute of Informatics (NII) established the LLM Research Group (LLM-jp) in which anyone who agrees with our philosophy can join. We’ve also disclosed all of our model’s mechanisms, development data, tools, technical documents, and other materials, including the development processes, discussions, and even failures. Thanks to the participation from various universities and companies, the number of participants in the LLM-jp has exceeded 1700 people. The recognition of our activities has led to the establishment of Research and Development Center for Large Language Models (abbreviated as LLMC below), for implementing the “R&D Hub Aimed at Ensuring Transparency and Reliability of Generative AI Models” project of the Ministry of Education, Culture, Sports, Science and Technology. We will prepare the necessary computational resources and strive to elucidate the principles of generative AI and establish methods of developing LLM. We hope our new research center will become the place where talented and energetic young researchers can join and the hub of research and development of LLMs in Japan. We also want to build an international cooperation system of researching open LLMs.

Director-General KUROHASHI Sadao

Project Structure/Research Issues

Mission

By bringing together the research capabilities of industry, academia, and government, we aim to build an academic research hub. We will develop an environment conducive to the cultivation of research and development capabilities related to generative AI models, ensure transparency through elucidation of the learning principles of generative AI models, and carry out R&D that contributes to the advancement of generative AI models.

Through these initiatives, we contribute to the evolution of AI and, ultimately, the creation of innovative breakthroughs over the long term.

R&D to ensure the transparency and reliability of generative AI models

1.Build LLMs for R&D

LLMC makes LLMs fully open to researchers as well as prepares corpus data, computing environments, and assessment benchmarks for R&D.

2.Ensure the Transparency and Reliability of LLMs

LLMC ensures the transparency and reliability of generative AI by elucidating generative AI behavioral principles and developing technologies to control the impact of data alteration, data bias, etc.

3.Make LLMs Highly Sophisticated

LLMC makes LLMs fully open to researchers as well as prepares corpus data, computing environments, and assessment benchmarks for R&D.