HyperCLOVA X Technical Report

要約

韓国の言語と文化に合わせてカスタマイズされた大規模言語モデル (LLM) ファミリーである HyperCLOVA X と、英語、数学、コーディングの競争力のある機能を紹介します。
HyperCLOVA X は、責任ある AI への取り組みを反映した厳格な安全ガイドラインを遵守しながら、韓国語、英語、およびコード データをバランスよく組み合わせてトレーニングされ、その後、人間による注釈が付けられた高品質のデータセットを使用して命令チューニングが行われました。
このモデルは、韓国語と英語の両方で、包括的な推論、知識、常識、事実性、コーディング、数学、チャット、指示への従うこと、無害性などのさまざまなベンチマークにわたって評価されます。
HyperCLOVA X は、言語と文化のニュアンスに対する深い理解に裏打ちされた、韓国語での強力な推論能力を発揮します。
固有のバイリンガルの性質とその多言語主義への拡張をさらに分析すると、モデルのクロスリンガル能力と、複数の言語ペア間の機械翻訳やクロスリンガル推論タスクなど、対象外の言語に対する強力な一般化能力が強調されます。
私たちは、HyperCLOVA X が、地域や国がソブリン LLM を開発する際に役立つガイダンスを提供できると信じています。

要約(オリジナル)

We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment to responsible AI. The model is evaluated across various benchmarks, including comprehensive reasoning, knowledge, commonsense, factuality, coding, math, chatting, instruction-following, and harmlessness, in both Korean and English. HyperCLOVA X exhibits strong reasoning capabilities in Korean backed by a deep understanding of the language and cultural nuances. Further analysis of the inherent bilingual nature and its extension to multilingualism highlights the model’s cross-lingual proficiency and strong generalization ability to untargeted languages, including machine translation between several language pairs and cross-lingual inference tasks. We believe that HyperCLOVA X can provide helpful guidance for regions or countries in developing their sovereign LLMs.

arxiv情報

著者 Kang Min Yoo,Jaegeun Han,Sookyo In,Heewon Jeon,Jisu Jeong,Jaewook Kang,Hyunwook Kim,Kyung-Min Kim,Munhyong Kim,Sungju Kim,Donghyun Kwak,Hanock Kwak,Se Jung Kwon,Bado Lee,Dongsoo Lee,Gichang Lee,Jooho Lee,Baeseong Park,Seongjin Shin,Joonsang Yu,Seolki Baek,Sumin Byeon,Eungsup Cho,Dooseok Choe,Jeesung Han,Youngkyun Jin,Hyein Jun,Jaeseung Jung,Chanwoong Kim,Jinhong Kim,Jinuk Kim,Dokyeong Lee,Dongwook Park,Jeong Min Sohn,Sujung Han,Jiae Heo,Sungju Hong,Mina Jeon,Hyunhoon Jung,Jungeun Jung,Wangkyo Jung,Chungjoon Kim,Hyeri Kim,Jonghyun Kim,Min Young Kim,Soeun Lee,Joonhee Park,Jieun Shin,Sojin Yang,Jungsoon Yoon,Hwaran Lee,Sanghwan Bae,Jeehwan Cha,Donghoon Ham,Youngki Hong,Yunki Hong,Myunggeun Ji,Yeguk Jin,Chansong Jo,Shinyoung Joo,Seunghwan Jung,Hyomin Kim,Jungwhan Kim,Minkyoung Kim,Minseung Kim,Sungdong Kim,Yonghee Kim,Youngjun Kim,Donghyeon Ko,Dughyun Lee,Jaehong Lee,Jieun Lee,Jongjin Lee,Min Young Lee,Yehbin Lee,Taehong Min,Kiyoon Moon,Jaesun Park,Kyuyon Park,Seunghyun Seo,Gyubin Son,Wonjoon Yoo,Myungin You,Doheon Ahn,Homin Ahn,Joohee Ahn,Seongmin Ahn,Chanwoo An,Hyeryun An,Junho An,Sang-Min An,Boram Byun,Jongho Cha,Minji Chang,Seunggyu Chang,Haesong Cho,Youngdo Cho,Dalnim Choi,Daseul Choi,Hyoseok Choi,Minseong Choi,Sangho Choi,Seongjae Choi,Wooyong Choi,Sewhan Chun,Dong Young Go,Chiheon Ham,Danbi Han,Jaemin Han,Mihak Hong,Moonyoung Hong,Sung Bum Hong,Seongchan Hwang,Eunbin Hyun,Jinbae Im,Jaehyung Jang,Jaeni Jang,Sihyeon Jang,Sungwon Jang,Joonha Jeon,Yujin Jeon,Daun Jeong,Joonhyun Jeong,Kyeongseok Jeong,Mini Jeong,Yeji Jeong,Sol Jin,Hanbyeol Jo,Hanju Jo,Minjung Jo,Lee Jonghyun,Chaeyoon Jung,Hyungsik Jung,Jaeuk Jung,Ju Hwan Jung,Kwangsun Jung,Seungjae Jung,Soonwon Ka,Donghan Kang,Soyoung Kang,Taeho Kil,Areum Kim,Beomyoung Kim,Byeongwook Kim,Daehee Kim,Dong-Gyun Kim,Donggook Kim,Donghyun Kim,Euna Kim,Eunchul Kim,Geewook Kim,Gyu Ri Kim,Hanbyul Kim,Heesu Kim,Isaac Kim,Jeonghoon Kim,Jihye Kim,Joonghoon Kim,Minjae Kim,Minsub Kim,Pil Hwan Kim,Sammy Kim,Seokhun Kim,Seonghyeon Kim,Soojin Kim,Soong Kim,Soyoon Kim,Sunyoung Kim,Taeho Kim,Wonho Kim,Yoonsik Kim,You Jin Kim,Yuri Kim,Beomseok Kwon,Ohsung Kwon,Yoo-Hwan Kwon,Anna Lee,Byungwook Lee,Changho Lee,Daun Lee,Dongjae Lee,Ha-Ram Lee,Hodong Lee,Hwiyeong Lee,Hyunmi Lee,Injae Lee,Jaeung Lee,Jeongsang Lee,Jisoo Lee,Joongjae Lee,Juhan Lee,Jung Hyun Lee,Junghoon Lee,Junwoo Lee,Se Yun Lee,Sujin Lee,Sungjae Lee,Sungwoo Lee,Wonjae Lee,Zoo Hyun Lee,Jong Kun Lim,Kun Lim,Taemin Lim,Yuri Min,Nuri Na,Jeongyeon Nam,Kyeong-Min Nam,Yeonseog Noh,Biro Oh,Hyangnam Oh,Jung-Sik Oh,Solgil Oh,Yeontaek Oh,Boyoun Park,Cheonbok Park,Dongju Park,Hyeonjin Park,Hyun Tae Park,Hyunjung Park,Jihye Park,Jooseok Park,Junghwan Park,Jungsoo Park,Miru Park,Sang Hee Park,Seunghyun Park,Taerim Park,Wonkyeong Park,Hyunjoon Ryu,Jeonghun Ryu,Nahyeon Ryu,Soonshin Seo,Suk Min Seo,Yoonjeong Shim,Kyuyong Shin,Wonkwang Shin,Hyun Sim,Mihyun Sim,Woongseob Sim,Hyejin Soh,Bokyoung Son,Hyunjun Son,Seulah Son,Chi-Yun Song,Chiyoung Song,Ka Yeon Song,Minchul Song,Seungmin Song,Jisung Wang,Matt Yeo,Yonggoo Yeo,Myeong Yeon Yi,Moon Bin Yim,Taehwan Yoo,Youngjoon Yoo,Sungmin Yoon,Young Jin Yoon,Hangyeol Yu,Ui Seon Yu,Xingdong Zuo,Jeongin Bae,Joungeun Bae,Hyunsoo Cho,Seonghyun Cho,Yongjin Cho,Taekyoon Choi,Yera Choi,Jiwan Chung,Zhenghui Han,Byeongho Heo,Euisuk Hong,Taebaek Hwang,Seonyeol Im,Sumin Jegal,Sumin Jeon,Yelim Jeong,Yonghyun Jeong,Can Jiang,Juyong Jiang,Jiho Jin,Ara Jo,Younghyun Jo,Hoyoun Jung,Juyoung Jung,Dae Hee Kim,Ginam Kim,Hangyeol Kim,Heeseung Kim,Hyojin Kim,Hyojun Kim,Hyun-Ah Kim,Jeehye Kim,Jin-Hwa Kim,Jiseon Kim,Jonghak Kim,Jung Yoon Kim,Rak Yeong Kim,Seoyoon Kim,Sewon Kim,Sooyoung Kim,Sukyoung Kim,Taeyong Kim,Naeun Ko,Bonseung Koo,Heeyoung Kwak,Haena Kwon,Youngjin Kwon,Boram Lee,Bruce W. Lee,Dagyeong Lee,Erin Lee,Euijin Lee,Ha Gyeong Lee,Hyojin Lee,Hyunjeong Lee,Jeeyoon Lee,Jeonghyun Lee,Jongheok Lee,Joonhyung Lee,Junhyuk Lee,Mingu Lee,Nayeon Lee,Sangkyu Lee,Se Young Lee,Seulgi Lee,Seung Jin Lee,Suhyeon Lee,Yeonjae Lee,Yesol Lee,Youngbeom Lee,Yujin Lee,Shaodong Li,Tianyu Liu,Seong-Eun Moon,Taehong Moon,Max-Lasse Nihlenramstroem,Wonseok Oh,Yuri Oh,Hongbeen Park,Hyekyung Park,Nohil Park,Sangjin Park,Jiwon Ryu,Miru Ryu,Simo Ryu,Ahreum Seo,Hee Seo,Kangdeok Seo,Jamin Shin,Seungyoun Shin,Heetae Sin,Jiangping Wang,Lei Wang,Ning Xiang,Longxiang Xiao,Jing Xu,Seonyeong Yi,Haanju Yoo,Haneul Yoo,Hwanhee Yoo,Liang Yu,Youngjae Yu,Weijie Yuan,Bo Zeng,Qian Zhou,Kyunghyun Cho,Jung-Woo Ha,Joonsuk Park,Jihyun Hwang,Hyoung Jo Kwon,Soonyong Kwon,Jungyeon Lee,Seungho Lee,Seungho Choi,Sang-Woo Lee,Jung Hwa Lim,Nako Sung
発行日 2024-04-02 13:48:49+00:00
arxivサイト arxiv_id(pdf)

提供元, 利用サービス

arxiv.jp, Google

カテゴリー: cs.AI, cs.CL パーマリンク