Öйú³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍøÐÂÎÅ£¬£¬£¬£¬£¬£¬£¬£¬¿ËÈÕÖйú³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍø¿ªÔ´12B²ÎÊý¹æÄ£Ðdz½ÓïÒå´óÄ£×ÓTeleChat-12B£¬£¬£¬£¬£¬£¬£¬£¬Ïà½Ï1Ô¿ªÔ´7B°æ±¾£¬£¬£¬£¬£¬£¬£¬£¬ÄÚÈÝ¡¢ÐÔÄܺÍÓ¦Óõȷ½ÃæÕûÌåЧ¹ûÌáÉý30%£¬£¬£¬£¬£¬£¬£¬£¬ÆäÖУ¬£¬£¬£¬£¬£¬£¬£¬¶àÂÖÍÆÀí¡¢Çå¾²ÎÊÌâµÈÁìÓòÌáÉý³¬40%¡£¡£¡£¡£¡£¡£¡£ÔÚC-eval¡¢MMLU¡¢AGIEVALµÈ¹ú¼ÊȨÍþ°ñµ¥ÉÏ£¬£¬£¬£¬£¬£¬£¬£¬ÅÅÃû´¦ÓÚº£ÄÚͬ¼¶±ð²ÎÊý¿ªÔ´Ä£×ÓµÄǰÏߣ¬£¬£¬£¬£¬£¬£¬£¬½øÒ»²½Ôö½ø´óÄ£×Ó¿ªÔ´Éú̬²ýÊ¢£¬£¬£¬£¬£¬£¬£¬£¬ÖúÁ¦AI¹¤Òµ¼ÓËÙ¸ßÖÊÁ¿Éú³¤¡£¡£¡£¡£¡£¡£¡£Áí¾ÝϤ£¬£¬£¬£¬£¬£¬£¬£¬Öйú³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍø½«ÓÚÄêÄÚ¿ªÔ´Ç§ÒÚ¼¶²ÎÊý´óÄ£×Ó¡£¡£¡£¡£¡£¡£¡£
Öйú³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍøÈ˹¤ÖÇÄÜÑо¿Ôº£¨TeleAI£©¼á³ÖÍêÈ«×ÔÑÐ×ÔÖ÷¿É¿Ø£¬£¬£¬£¬£¬£¬£¬£¬ÔÚÖйú³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍøÊ×ϯÊÖÒÕ¹Ù¡¢È˹¤ÖÇÄÜÊ×ϯ¿ÆÑ§¼Ò¡¢TeleAIÔº³¤ÀîѧÁúÏòµ¼Ï£¬£¬£¬£¬£¬£¬£¬£¬¼ÓËÙÑз¢Á¢Ò죬£¬£¬£¬£¬£¬£¬£¬Ò»Ö±ÓÅ»¯µ×²ãÄ£×ӽṹ£¬£¬£¬£¬£¬£¬£¬£¬É¨³ýWord EmbeddingÓëlmhead¹²Ïí²ÎÊý£¬£¬£¬£¬£¬£¬£¬£¬ÓÐÓÃÌáÉýÄ£×ÓÎȹÌÐÔºÍѵÁ·Ð§¹û£¬£¬£¬£¬£¬£¬£¬£¬²¢»ùÓÚϸÄ廯µÄCheckPointЧ¹ûÑéÖ¤£¬£¬£¬£¬£¬£¬£¬£¬¾ÙÐж¯Ì¬µÄÊý¾ÝÅä±ÈÓÅ»¯µ÷½â£¬£¬£¬£¬£¬£¬£¬£¬´ó·ùÌáÉýÄ£×ÓѵÁ·Ð§¹û¡£¡£¡£¡£¡£¡£¡£
º£Á¿¸ßÖÊÁ¿Êý¾ÝÊǰü¹Ü´óÄ£×ÓЧ¹ûµÄ»ù´¡£¡£¡£¡£¡£¡£¡£¬£¬£¬£¬£¬£¬£¬£¬TeleChat-12B½«7B°æ±¾1.5TѵÁ·Êý¾ÝÌáÉýÖÁ3T£¬£¬£¬£¬£¬£¬£¬£¬ÓÅ»¯Êý¾Ýϴ媡¢±ê×¢Õ½ÂÔ£¬£¬£¬£¬£¬£¬£¬£¬Ò»Á¬¹¹½¨×¨ÏîʹÃüSFT£¨¼àÊÓ΢µ÷£©Êý¾Ý£¬£¬£¬£¬£¬£¬£¬£¬ÓÅ»¯Êý¾Ý¹¹½¨¹æ·¶£¬£¬£¬£¬£¬£¬£¬£¬´ó´óÌáÉýÊý¾ÝÖÊÁ¿£»£»£»£»£»£»£»£»Í¬Ê±£¬£¬£¬£¬£¬£¬£¬£¬»ùÓÚ³ÏÐÅΪ±¾×¨Òµ·þÎñ ¹ÙÍøÐdz½´óÄ£×ÓÓû§ÕæÊµ»ØÁ÷Êý¾Ý£¬£¬£¬£¬£¬£¬£¬£¬ÓÅ»¯½±ÀøÄ£×ÓºÍÇ¿»¯Ñ§Ï°Ä£×Ó£¬£¬£¬£¬£¬£¬£¬£¬ÓÐÓÃÌáÉýÄ£×ÓÎÊ´ðЧ¹û¡£¡£¡£¡£¡£¡£¡£
TeleAIͨ¹ý¸ü³¹µ×µØ¿ªÔ´Íƶ¯´óÄ£×ÓÊÖÒÕǰ½øºÍ´óÄ£×Ó¹ú²ú»¯Àú³Ì¡£¡£¡£¡£¡£¡£¡£´Ë´Î¿ªÔ´Ìṩ»ù´¡Ä£×ÓÒÔ¼°»ùÓÚÏìÓ¦°æ±¾µÄ¶Ô»°Ä£×Ó¡¢²»µ«Ö§³Ö¹Å°åµÄÈ«Á¿²ÎÊý¸üл¹Ö§³Ö LoRA µÈÖ»¸üв¿·Ö²ÎÊýµÄ¸ßЧ΢µ÷ÒªÁì¡¢Ö§³ÖDeepspeed΢µ÷¡¢Ö§³Öint8¡¢int4Á¿»¯ºÍ¹ú²úоƬѵÁ·ÍÆÀí£¬£¬£¬£¬£¬£¬£¬£¬Íƶ¯´óÄ£×Ó¹ú²ú»¯Àú³Ì¡£¡£¡£¡£¡£¡£¡£
¼ÓËÙ̽Ë÷Á¢ÒìµÄͬʱ£¬£¬£¬£¬£¬£¬£¬£¬Ðdz½´óÄ£×ÓÒ²ÔÚÉîÈëÍÆ¸ÐÈ˹¤ÖÇÄÜÓë¸÷Ðи÷ÒµµÄÈںϣ¬£¬£¬£¬£¬£¬£¬£¬Æð¾¢Ì½Ë÷ÐÂÐ˵ÄÓ¦Óó¡¾°¡£¡£¡£¡£¡£¡£¡£Ðdz½ÓïÒå´óÄ£×ÓÒÑÓ¦ÓÃÓÚÐÐÎÄд×÷¡¢´úÂë±à³Ì¡¢ÍøÂç¹ÊÕÏÆÊÎöÒÔ¼°Ä±»®ÆÊÎöµÈ³¡¾°£¬£¬£¬£¬£¬£¬£¬£¬ÒÔÐÐÎÄд×÷ΪÀý£¬£¬£¬£¬£¬£¬£¬£¬Æäƽ¾ùÌìÉú×ÖÊýÁè¼Ý1500×Ö£¬£¬£¬£¬£¬£¬£¬£¬ÓÐÓýÓÄÉÂʵִï85.7%£»£»£»£»£»£»£»£»ÔÚ¶ÔÍâÆóÊÂÒµµ¥Î»¿Í»§µÄÓªÒµÖУ¬£¬£¬£¬£¬£¬£¬£¬Ðdz½ÓïÒå´óÄ£×ÓÖ§³ÖÆóҵı»®ÆÊÎö¡¢ÕþÎñ¹ûÕæ×Éѯ¡¢ÃñÉúËßÇó½Ó´ýµÈ³¡¾°£¬£¬£¬£¬£¬£¬£¬£¬¿ÉÁýÕÖ95%µÄÏÖʵӪҵ³¡¾°£¬£¬£¬£¬£¬£¬£¬£¬¶àÂÖÃ÷ȷ׼ȷÂʵִï90%¡£¡£¡£¡£¡£¡£¡£³ý¹Å°åÐÐÒµÓ¦Óó¡¾°£¬£¬£¬£¬£¬£¬£¬£¬Ðdz½´óÄ£×ÓÆð¾¢Ì½Ë÷Ç°ÑØÁìÓòÓ¦Ó㬣¬£¬£¬£¬£¬£¬£¬¸³ÄܾßÉíÖÇÄÜ£¬£¬£¬£¬£¬£¬£¬£¬½â¾öÎÞÈË»ú±àÅÅͶÈë¶à¡¢¿ª·¢Á¿´óµÄÎÊÌ⣬£¬£¬£¬£¬£¬£¬£¬ÊµÏÖÎÞÈË»úÖÇÄܱàÅÅÇáÁ¿»¯½¨Éè¡£¡£¡£¡£¡£¡£¡£
¾ÝϤ£¬£¬£¬£¬£¬£¬£¬£¬Ðdz½´óÄ£×ÓÒÑÆÕ±éÓ¦ÓÃÂ䵨£¬£¬£¬£¬£¬£¬£¬£¬¸³ÄÜǧÐаÙҵתÐÍÉý¼¶¡£¡£¡£¡£¡£¡£¡£¿Í·þ´óÄ£×ÓÔÚÌìÏÂÊÔµãÉÏÏß18¸ö·þÎñ³¡¾°£¬£¬£¬£¬£¬£¬£¬£¬³ä·Ö¸³ÄÜÖǻۿͷþºÍÊý×ÖÈË£¬£¬£¬£¬£¬£¬£¬£¬ÔÚ¼¤»îÊ®ÒÚ¼¶µÄÈÕÖ¾¡¢°ÙÒÚ¼¶µÄÍøÂç²ÎÊýµÈº£Á¿Êý¾Ý×ʲúµÄ»ù´¡ÉÏ£¬£¬£¬£¬£¬£¬£¬£¬½øÒ»²½ÉÖÇÄÜ»¯ÔËÓª£»£»£»£»£»£»£»£»Ðdz½ÕþÎñ´óÄ£×ÓÒÑÂ䵨ijÊÐÃñÉúËßÇ󳡾°£¬£¬£¬£¬£¬£¬£¬£¬ÎªÊÐÃñÌṩÔÚÏßÎı¾ÎÊ´ð·þÎñ£¬£¬£¬£¬£¬£¬£¬£¬ÌáÉýÕþÎñ·þÎñÄÜÁ¦£¬£¬£¬£¬£¬£¬£¬£¬Ìá¸ßÊÐÃñÖª×ã¶È£»£»£»£»£»£»£»£»Ðdz½¾·Ö´óÄ£×ÓÒÑÂ䵨ijÊоОÖÐÐÒµ´óÄ£×Ó£¬£¬£¬£¬£¬£¬£¬£¬Ê¹ÓôóÄ£×ÓÌìÉúÄÜÁ¦¿ìËÙÆð²ÝÏà¹Ø¹¤ÒµÑо¿±¨¸æ£¬£¬£¬£¬£¬£¬£¬£¬¼ò»¯ÖªÊ¶¼ìË÷Á÷³Ì£¬£¬£¬£¬£¬£¬£¬£¬¿ìËÙ¡¢¾«×¼ÅÌÎÊËùÐè֪ʶÄÚÈÝ£¬£¬£¬£¬£¬£¬£¬£¬ÒÔ±ãѸËÙ¡¢×¼È·µØÕÆÎÕÉú³¤¶¯Ì¬£¬£¬£¬£¬£¬£¬£¬£¬Ö§³Ö¾öÒéÀú³Ì£¬£¬£¬£¬£¬£¬£¬£¬²¢×·×ÙÈ«Çò¾¼ÃÐÎÊÆºÍ¿Æ¼¼Á¢Ò죬£¬£¬£¬£¬£¬£¬£¬Öª×ãÆÈÇеĹ¤Òµ¶´²ìºÍÆÊÎöÐèÇ󡣡£¡£¡£¡£¡£¡£