参考資料

特に大規模化した場合に必要な知見

大規模言語モデルの事前学習知見を振り返る

https://fukabori.fm/episode/107

https://prod-files-secure.s3.us-west-2.amazonaws.com/9db80869-7992-4b3a-8752-893d590f311d/aae53fd7-d660-44af-a92d-cf52ec2ced2e/LLMを作る_拡張する.pdf

https://prod-files-secure.s3.us-west-2.amazonaws.com/9db80869-7992-4b3a-8752-893d590f311d/072ca1f9-d609-4435-978e-d934c1380ae6/LLM-Whitepaper-Japanese-Final.pdf

https://nlp-colloquium-jp.github.io/schedule/2023-09-20_takuya-akiba/

https://www.youtube.com/watch?v=XjEPXrv7qDM

だいき