要約
Seed1.5の考えを導入し、応答する前に思考を通じて推論できるようになり、幅広いベンチマークでパフォーマンスが向上します。
Seed1.5は、AIME 2024で86.7、Codeforcesで55.0、GPQAで77.3を達成し、STEMとコーディングの優れた推論能力を示しています。
推論のタスクを超えて、この方法は、多様なドメイン全体の顕著な一般化を示しています。
たとえば、非合理的なタスクでの勝率でDeepseek R1を8％上回り、その幅広い適用性を示しています。
他の最先端の推論モデルと比較して、Seed1.5思考は比較的小さいサイズの混合物（MOE）モデルで、20Bの活性化と200Bの合計パラメーターを備えています。
一般化された推論を評価するための取り組みの一環として、2つの内部ベンチマークを開発しました。
モデルトライアルリンク：https：//www.volcengine.com/experience/ark。
要約(オリジナル)
We introduce Seed1.5-Thinking, capable of reasoning through thinking before responding, resulting in improved performance on a wide range of benchmarks. Seed1.5-Thinking achieves 86.7 on AIME 2024, 55.0 on Codeforces and 77.3 on GPQA, demonstrating excellent reasoning abilities in STEM and coding. Beyond reasoning tasks, the method demonstrates notable generalization across diverse domains. For instance, it surpasses DeepSeek R1 by 8% in win rate on non-reasoning tasks, indicating its broader applicability. Compared to other state-of-the-art reasoning models, Seed1.5-Thinking is a Mixture-of-Experts (MoE) model with a relatively small size, featuring 20B activated and 200B total parameters. As part of our effort to assess generalized reasoning, we develop two internal benchmarks, BeyondAIME and Codeforces, both of which will be publicly released to support future research. Model trial link: https://www.volcengine.com/experience/ark.
arxiv情報
| 著者 | ByteDance Seed,:,Jiaze Chen,Tiantian Fan,Xin Liu,Lingjun Liu,Zhiqi Lin,Mingxuan Wang,Chengyi Wang,Xiangpeng Wei,Wenyuan Xu,Yufeng Yuan,Yu Yue,Lin Yan,Qiying Yu,Xiaochen Zuo,Chi Zhang,Ruofei Zhu,Zhecheng An,Zhihao Bai,Yu Bao,Xingyan Bin,Jiangjie Chen,Feng Chen,Hongmin Chen,Riwei Chen,Liangqiang Chen,Zixin Chen,Jinsong Chen,Siyan Chen,Kaiyuan Chen,Zhi Chen,Jin Chen,Jiecao Chen,Jinxin Chi,Weinan Dai,Ning Dai,Jiahui Dai,Shihan Dou,Yantao Du,Zhengyin Du,Jianhui Duan,Chen Dun,Ting-Han Fan,Jiazhan Feng,Junda Feng,Ziyuan Feng,Yuwei Fu,Wenqi Fu,Hanjie Fu,Hao Ge,Hongyi Guo,Mingji Han,Li Han,Wenhao Hao,Xintong Hao,Qianyu He,Jerry He,Feng He,Wen Heng,Zehua Hong,Qi Hou,Liang Hu,Shengding Hu,Nan Hu,Kai Hua,Qi Huang,Ziyue Huang,Hongzhi Huang,Zihao Huang,Ting Huang,Wenhao Huang,Wei Jia,Bin Jia,Xiaoying Jia,Yuhua Jiang,Haobin Jiang,Ziheng Jiang,Kaihua Jiang,Chengquan Jiang,Jianpeng Jiao,Xiaoran Jin,Xing Jin,Xunhao Lai,Zheng Li,Xiang Li,Liyi Li,Hongkai Li,Zheng Li,Shengxian Wan,Ya Wang,Yunshui Li,Chenggang Li,Niuniu Li,Siyu Li,Xi Li,Xiao Li,Aoyan Li,Yuntao Li,Nianning Liang,Xinnian Liang,Haibin Lin,Weijian Lin,Ye Lin,Zhicheng Liu,Guanlin Liu,Guanlin Liu,Chenxiao Liu,Yan Liu,Gaohong Liu,Juncai Liu,Chundian Liu,Deyi Liu,Kaibo Liu,Siyao Liu,Qi Liu,Yongfei Liu,Kang Liu,Gan Liu,Boyi Liu,Rui Long,Weiqiang Lou,Chenwei Lou,Xiang Luo,Yao Luo,Caiping Lv,Heyang Lv,Bole Ma,Qianli Ma,Hongzhi Ma,Yiyuan Ma,Jin Ma,Wenchang Ma,Tingting Ma,Chen Mao,Qiyang Min,Zhe Nan,Guanghan Ning,Jinxiang Ou,Haojie Pan,Renming Pang,Yanghua Peng,Tao Peng,Lihua Qian,Lihua Qian,Mu Qiao,Meng Qu,Cheng Ren,Hongbin Ren,Yong Shan,Wei Shen,Ke Shen,Kai Shen,Guangming Sheng,Jinlong Shi,Wenlei Shi,Guang Shi,Shuai Shuai Cao,Yuxin Song,Zuquan Song,Jing Su,Yifan Sun,Tao Sun,Zewei Sun,Borui Wan,Zihan Wang,Xiaohui Wang,Xi Wang,Shuguang Wang,Jun Wang,Qinlong Wang,Chenyuan Wang,Shuai Wang,Zihan Wang,Changbao Wang,Jiaqiang Wang,Shihang Wang,Xuwu Wang,Zaiyuan Wang,Yuxuan Wang,Wenqi Wang,Taiqing Wang,Chengzhi Wei,Houmin Wei,Ziyun Wei,Shufa Wei,Zheng Wu,Yonghui Wu,Yangjun Wu,Bohong Wu,Shuang Wu,Jingqiao Wu,Ning Wu,Shuangzhi Wu,Jianmin Wu,Chenguang Xi,Fan Xia,Yuqiao Xian,Liang Xiang,Boren Xiang,Bowen Xiao,Zhen Xiao,Xia Xiao,Yongsheng Xiao,Chao Xin,Shulin Xin,Yuwen Xiong,Jingjing Xu,Ziwen Xu,Chenyin Xu,Jiayi Xu,Yifan Xu,Wei Xu,Yufei Xu,Shikun Xu,Shipeng Yan,Shen Yan,Qingping Yang,Xi Yang,Tianhao Yang,Yuehang Yang,Yuan Yang,Ximing Yang,Zeyu Yang,Guang Yang,Yifan Yang,Xuesong Yao,Bairen Yi,Fan Yin,Jianian Yin,Ziqiang Ying,Xiangyu Yu,Hongli Yu,Song Yu,Menghan Yu,Huan Yu,Siyu Yuan,Jun Yuan,Yutao Zeng,Tianyang Zhan,Zheng Zhang,Yun Zhang,Mofan Zhang,Wang Zhang,Ru Zhang,Zhi Zhang,Tianqi Zhang,Xinyi Zhang,Zhexi Zhang,Sijun Zhang,Wenqiang Zhang,Xiangxiang Zhang,Yongtao Zhang,Yuyu Zhang,Ge Zhang,He Zhang,Yue Zhang,Renjie Zheng,Ningxin Zheng,Zhuolin Zheng,Yaowei Zheng,Chen Zheng,Xiaoyun Zhi,Wanjun Zhong,Cheng Zhong,Zheng Zhong,Baoquan Zhong,Xun Zhou,Na Zhou,Huan Zhou,Hang Zhu,Defa Zhu,Wenjia Zhu,Lei Zuo |
| 発行日 | 2025-04-29 14:09:22+00:00 |
| arxivサイト | arxiv_id(pdf) |
提供元, 利用サービス
arxiv.jp, Google