|
Äú²éѯµÄ¹Ø¼ü´Ê½öÔÚÍøÒ³±êÌâ»òÖ¸Ïò´ËÍøÒ³µÄÁ´½ÓÖгöÏÖ¡£ (90°×¶ÈºÍÍøÒ³https://www.leiphone.com/category/chipdesign/hbqTOXts9yqXDQ2j.htmlµÄ×÷ÕßÎ޹أ¬²»¶ÔÆäÄÚÈݸºÔð¡£90°×¶È¿ìÕÕ½÷ÎªÍøÂç¹ÊÕÏʱ֮Ë÷Òý£¬²»´ú±í±»ËÑË÷ÍøÕ¾µÄ¼´Ê±Ò³Ãæ¡£) |
0
| ±¾ÎÄ×÷Õߣº ÎâÓÅ | 2022-03-03 19:57 |
À×·åÍø(¹«ÖںţºÀ×·åÍø)ÏûÏ¢£¬±¾ÖÜËÄ£¬×ܲ¿Î»ÓÚÓ¢¹úµÄAIоƬ¹«Ë¾Graphcore·¢²¼ÁËÐÂÒ»´úIPU²úÆ·Bow£¬ÕâÊÇÆäµÚÈý´úIPUϵͳ£¬·¢²¼¼´ÃæÏò¿Í»§·¢»õ¡£ÓëÉÏÒ»´úIPUÏà±È£¬Bow IPUÐÔÄÜÌáÉý40% £¬ÄܺıÈÌáÉýÁË16%£¬µçԴЧÂÊÒ²ÌáÉý16%¡£
ÖµµÃ×¢ÒâµÄÊÇ£¬ÕâÒ»´ÎBow IPUµÄÐÔÄÜÌáÉý²¢·ÇÖ÷ÒªÒÀÀµ²ÉÓøüÏȽøµÄÖÆ³Ì£¬Bow IPU²ÉÓÃÁ˺ÍÉÏÒ»´úIPUÏàͬµĄ̈»ýµç 7nm£¬Í¨¹ý²ÉÓúĮ́»ýµç¹²Í¬¿ª·¢µÄÏȽø¹è¾§Ô²¶Ñµþ¼¼Êõ£¨3D Wafer-on-Wafer£©´ïµ½ÐÔÄܺÍÄܺıȵÄÌáÉý¡£
Bow×÷ΪÊÀ½çÊ׿î3D WoW´¦ÀíÆ÷£¬Ö¤Ã÷ÁËоƬÐÔÄÜÌáÉýµÄ·¶Ê½´ÓÏȽøÖƳÌÏòÏȽø·â×°×ªÒÆµÄ¿ÉÐÐÐÔ¡£

ÐÂÒ»´ú IPU ÐÔÄÜÌáÉý40%£¬¼Û¸ñ±£³Ö²»±ä
2016Ä꣬Graphcore³ÉÁ¢²¢¿ª´´ÁËÈ«ÐÂÀàÐÍ´¦ÀíÆ÷¼Ü¹¹IPU£¬ÒòÆäÔڼܹ¹ÉϵĴ´ÐÂÔø±»Ó¢¹ú°ëµ¼ÌåÖ®¸¸Hermann Hauser³ÆÖ®ÎªÊǼÆËã»úÀúÊ·ÉϵĵÚÈý´Î¸ïÃü¡£
¾Àú6Äêʱ¼äµÄ·¢Õ¹£¬GraphcoreµÄIPUÖð½¥ÔÚÔÚ½ðÈÚ¡¢Ò½ÁÆ¡¢µçÐÅ¡¢»úÆ÷ÈË¡¢Ôƺͻ¥ÁªÍøµÈÁìÓòÈ¡µÃ³ÉЧ¡£±¾ÖÜËÄ£¬GraphcoreÓÖÍÆ³öÁ˵ÚÈý´ú²úÆ·Bow IPU¡£
¾ÝGraphcore½éÉÜ£¬µÚÈý´úIPUÏà¶ÔÓÚÉÏÒ»´úM2000£¬ÐÔÄÜÌá¸ß40%£¬Ã¿ÍßÐÔÄÜÌáÉý16%£¬¼´ÄܺıÈʵÏÖ16%µÄÌáÉý¡£²»¹ý£¬AIоƬµÄÕæÊµÐÔÄÜ»¹ÐèÒª·ÅÔÚ²»Í¬µÄÓ¦ÓÃÁìÓòÖÐÌÖÂÛ¡£Îª´Ë£¬GraphcoreÒ²¸ø³öÁËÔÚ²»Í¬´¹Ö±ÁìÓòÖÐBowµÄÐÔÄܱíÏÖ¡£

ÔÚͼÏñ·½Ã棬ÎÞÂÛÊǵäÐ͵ÄCNNÍøÂ磬»¹ÊǽüÆÚ±È½ÏÈÈÃŵÄVision TransformerÍøÂ磬ÒÔ¼°Éî²ã´ÎµÄÎı¾µ½Í¼Æ¬µÄÍøÂ磬ÓëÉÏÒ»´ú²úÆ·Ïà±È£¬Bow IPU¶¼ÓÐ30%µ½40%µÄÐÔÄÜÌáÉý£¬ÔÚEfficientNet-B4ÕâÒ»ÏîÖУ¬½Ó½üÀíÂÛÉÏÏÞÖµ¡£
BERTѵÁ·Ä£ÐÍÊÇ×ÔÈ»ÓïÑÔ·½ÃæµÄ¾µäÄ£ÐÍ£¬»ùÓÚBERT£¬OpenAIÌá³öÁËGPT-1¡¢GPT-2¡¢GPT-3µÈ×ÝÏòÀ©Õ¹»òºáÏòÀ©Õ¹£¬Í¨¹ý¸üÉîµÄÍøÂç²ã´ÎºÍ¸ü¿íµÄÍøÂç¿í¶ÈÈÃÄ£Ð͵ÄÐÔÄܺ;«¶È½øÒ»²½Ìá¸ß¡£
¡°ÎÒÃÇ¿ÉÒÔ¿´µ½£¬ÕâЩģÐÍÔÚÎÒÃÇ×îеÄÓ²¼þÐÎ̬É϶¼ÓкܴóµÄÐÔÄÜÌáÉý¡£¡±GraphcoreÖйú¹¤³Ì¸±×ܲá¢AIËã·¨¿ÆÑ§¼Ò½ð衽éÉܵÀ¡£

²»½öÈç´Ë£¬×ª»»µ½Êµ¼ÊÄ£ÐÍÖеÄÍÌÍÂÁ¿£¬ÓëIPU POD64Ïà±È£¬ÔÚ¼ÆËã»úÊÓ¾õµÄResNet50 ºÍ EifficientNet-B4 ѵÁ·Ä£ÐÍÖУ¬Bow Pod64µÄÍÌÍÂÁ¿Äܹ»´ïµ½34%ºÍ39%µÄÐÔÄÜÌáÉý¡£×ÔÈ»ÓïÑÔ·½Ã棬 BERT-Large Ph1 ԤѵÁ·Ä£ÐͺÍÓïÒôʶ±ðConformer Large ѵÁ·Ä£ÐÍ£¬ºóÕß¶¼ÓÐ36%µÄÍÌÍÂÁ¿ÌáÉý¡£

×÷ΪӢΰ´ïµÄ¾ºÕù¶ÔÊÖ£¬Graphcore×ÔÈ»²»Íü½« Bow Pod16 ÓëDGX-A100½øÐжԱȣ¬ÊµÑéÊý¾Ý±íÃ÷£¬EfficientNet-B4µÄbackboneµÄѵÁ·ÔÚDGX-A100ÉÏÐèÒª»¨·Ñ70¸öСʱµÄѵÁ·Ê±¼ä£¬¶øÔÚBow Pod16ÉÏ£¬Ö»ÐèÒª14Сʱ×óÓÒ¡£
½Ó½üÀíÂÛ¼«ÏÞµÄÐÔÄÜÌáÉý£¬Graphcore Bow IPUÊÇÈçºÎʵÏֵģ¿
5nm²»ÔÙÊÇÊ×Ñ¡£¬²ÉÓÃÏȽø·â×°ÐԼ۱ȸü¸ß
´ÓоƬµÄ¹æ¸ñÉÏ¿´£¬Bow IPUÊÇÊÀ½çÉϵÚÒ»¿î»ùÓŲ́»ýµçµÄ 3D Wafer-On-WaferµÄ´¦ÀíÆ÷£¬µ¥¸ö·â×°ÖÐÓµÓг¬¹ý600ÒÚ¸ö¾§Ìå¹Ü£¬¾ßÓÐ350 TeraFLOPSµÄÈ˹¤ÖÇÄܼÆËãµÄÐÔÄÜ£¬ÊÇÉÏÒ»´úMK2 IPUµÄ1.4±¶¡£Æ¬ÄÚ´æ´¢½ÏÉÏÒ»´úÀ´¿´Ã»Óб仯£¬ÒÀÈ»±£³Ö0.9GBµÄÈÝÁ¿£¬²»¹ýÍÌÍÂÁ¿´Ó47.5TBÌá¸ßµ½ÁË65TB¡£

¡°±ä»¯Ö÷ÒªÌåÏÖÔÚ£¬ËüÊÇÒ»¸ö3D·â×°µÄ´¦ÀíÆ÷£¬¾§Ìå¹ÜµÄ¹æÄ£ÓÐËùÔö¼Ó£¬ËãÁ¦ºÍÍÌÍÂÁ¿¾ùµÃµ½ÌáÉý¡£¡± Graphcore´óÖлªÇø×ܲüæÈ«ÇòÊ×ϯӪÊÕ¹Ù¬ÌÎ˵µÀ¡£¶øÔÚ´ó¼Ò¶¼¹Ø×¢µÄ¹¤ÒÕÖÆ³ÌÉÏ£¬Bow IPU ÑÓÐøÁËÉÏÒ»´ų́»ýµç 7nm ¹¤ÒÕÖÆ³Ì£¬Ã»Óб仯¡£
ÀíÂÛÉÏ£¬Ò»¿ÅоƬµÄÐÔÄÜÌáÉýºÜ´ó³Ì¶ÈÉÏÈ¡¾öÓÚ¹¤ÒÕÖÆ³ÌÉϵĽø²½£¬µ«Ëæ×ʤÒÕÖÆ³ÌÔ½À´Ô½±Æ½üÎïÀí¼«ÏÞ£¬Ä¦¶û¶¨ÂÉÖð½¥Ê§Ð§£¬Òµ½ç²»µÃ²»Ñ°ÕÒеļ¼Êõ·½ÏòÀ´ÑÓÐøÄ¦¶û¶¨ÂÉ¡£ÆäÖУ¬3D·â×°¾ÍÊDZ»Òµ½ç¹ã·º¿´ºÃµÄ¼¼Êõ·½Ïò¡£
Öйú¹¤³ÌԺԺʿ¡¢Õã½´óѧ΢Äɵç×ÓѧԺԺ³¤Î⺺Ã÷¾ÍÔøÔÚÒ»´ÎÑݽ²ÖÐÌáµ½£¬Èç¹û½«Ð¾Æ¬ÖÆÔìºÍоƬ·â×°Ïà½áºÏ£¬Ò²¿ÉÒÔ×öµ½65nm¹¤ÒÕÖÆ³ÌʵÏÖ40nm¹¤ÒÕÖÆ³ÌµÄÐÔÄܹ¦ºÄÒªÇó¡£
Bow IPUÕýºÃÑéÖ¤ÁËÎâԺʿµÄ¹Ûµã¡£
¬Ìαíʾ£¬Bow IPU²úÆ·ÐÔÄܵÄÌáÉýÖ÷ÒªÀ´Ô´ÓÚ3D WoWºÍÐÂÔöµÄDie¡£
ÖÁÓÚΪºÎÑ¡Ôñ¸Ä±ä·â×°·½Ê½¶ø²»ÊǸüÏȽøµÄ¹¤ÒÕ£¬Â¬ÌÎÔò±íʾMK2 IPUÓÐ594ÒÚ¸ö¾§Ìå¹Ü£¬´ó¸Å823ƽ·½ºÁÃ×£¬ÒѾÊÇ7nmµ¥¸öDieÄܹ»Éú²úµÄ×ÃܵÄоƬ¡£
¡°ÎÒÃÇÆÀ¹À´Ó7nm¡¢5nm£¬µ½3nmµÈ²»Í¬¹¤ÒÕ½ÚµãµÄÊÕÒæÊ±·¢ÏÖ£¬´Ó7nmµ½5nmµÄÉú²ú¹¤ÒÕÌáÉýËù´øÀ´µÄÊÕÒæ²»ÏñÒÔǰ´Ó28nmµ½14nmÒ»Ñù£¬Äܹ»´øÀ´°Ù·ÖÖ®¼¸Ê®µÄÊÕÒæ£¬¶øÊǽµµ½ÁË20%¡£ÕâʱºòÎÒÃÇ¿ÉÒÔͨ¹ý±ðµÄÊֶκͷ½·¨»ñµÃͬÑùµÄÊÕÒæ¡£¡±
ͨ¹ý3D¶ÑµþµÄ·½Ê½£¬Bow IPUµÄÁ½¸öDieÔö¼ÓÁ˾§Ìå¹ÜµÄÊýÁ¿£¬ÆäÖÐÒ»¸öDie£¨Colossus Die£©ºÍÉÏÒ»´úÒ»Ñù£¬ÁíÒ»¸öDieÖ÷ÒªÓÃÓÚÌá¸ß¿çColossus DieµÄµçÔ´¹¦ÂÊ´«Ê䣬ÓÅ»¯Colossus DieµÄ²Ù×÷½Úµã£¬´Ó¶ø×ª»¯ÎªÓÐЧµÄʱÖÓ¼ÓËÙ¡£
ÔŲ́ͬ»ýµçµÄºÏ×÷·½Ã棬¬ÌθæËßÀ×·åÍø£¬GraphcoreÔÚÒ»Äê֮ǰ¾Į́ͬ»ýµçºÏ×÷ÁËÒ»¿Å²âÊÔоƬ£¬Óę̈»ýµçµÄ¹ØÏµ·Ç³£½ôÃÜ£¬¼ÓÉÏAI´¦ÀíÆ÷±¾Éí¹æÄ£½Ï´ó£¬ÐèҪһЩм¼ÊõÖ§³ÖÂ䵨£¬¶ø´Ǫ́»ýµçµÄ½Ç¶È¶øÑÔ£¬Ðµļ¼ÊõÒ²ÐèÒªÓÐÐèÇóµÄ²úÆ·¹²Í¬Íƽø¡£
ÖµµÃÒ»ÌáµÄÊÇ£¬ËäÈ»·â×°·½Ê½ÓÐËù±ä»¯£¬µ«Bow IPU¿ªÏä¼´Óã¬Óëǰһ´ú²úÆ·°Ù·ÖÖ®°ÙÈí¼þ¼æÈÝ£¬²»ÓÃÐÞ¸ÄÈκδúÂ룬ÀÏÓû§ÎÞÐè×öÈκÎÈí¼þÊÊÅ乤×÷¾ÍÄÜ»ñµÃÐÔÄÜÌáÉý£¬¼Û¸ñ±£³Ö²»±ä¡£
Ŀǰ£¬ÃÀ¹ú¹ú¼ÒʵÑéÊÒPacific NorthwestÒѾ»ùÓÚBow IPU³¢ÊÔ×öһЩ»ùÓÚTransformerµÄÄ£ÐÍÒÔ¼°Í¼Éñ¾ÍøÂç£¬ÃæÏò¼ÆË㻯ѧºÍÍøÂ簲ȫ·½ÃæµÄÓ¦Óã¬ÇÒ¸ø³öÁ˱ȽÏÕýÃæµÄ·´À¡¡£
ÑÓÐø3D·â×°£¬¿ª·¢³¬Ô½ÈËÄԵij¬¼¶ÖÇÄÜ»úÆ÷
Bow IPUʹÓÃ3D·â×°Ö»ÊÇÆðµã£¬ÃæÏòδÀ´£¬GraphcoreÕýÔÚ¿ª·¢Ò»¿î¿ÉÒÔÓÃÀ´³¬Ô½ÈËÄÔ´¦ÀíµÄ³¬¼¶ÖÇÄÜ»úÆ÷¡£
Graphcore½«Õâ¿îÕýÔÚÑз¢µÄ²úÆ·ÃüÃûΪGood Computer£¬Ò»·½ÃæÏ£Íû¼ÆËã»úÄܹ»ÎªÕâ¸öÊÀ½ç´øÀ´ÕýÃæµÄÓ°Ï죬ÁíÒ»·½ÃæÖ¾´ÖøÃû¼ÆËã»ú¿ÆÑ§¼ÒGood¡£

»ùÓÚ3D WoW£¬Ô¤¼ÆÎ´À´Good Computer½«°üº¬8192¸öIPU£¬Ìṩ³¬¹ý10 Exa-FlopsµÄAIËãÁ¦£¬ÊµÏÖ4 PBµÄ´æ´¢£¬¿ÉÒÔÖúÁ¦³¬¹ý500ÍòÒÚ²ÎÊý¹æÄ£µÄÈ˹¤ÖÇÄÜÄ£Ð͵Ŀª·¢¡£
È¡¾öÓÚ²»Í¬µÄÅäÖã¬Good Computer¼Û¸ñ½«ÔÚ100ÍòÃÀÔªµ½1.5ÒÚÃÀÔªÖ®¼ä¡£
¬Ìαíʾ£¬¿ª·¢Good Computer»¹ÊÇ»áÑØÓÃIPUµÄÌåϵ½á¹¹£¬IPUµÄ´æ´¢ÊÇÔÚ´¦ÀíÆ÷ÀïÃæ£¬ËäÈ»²»½ÐÀàÄÔ¡¢ÄÚ´æ¼ÆËã»ò´æËãÒ»Ì壬µ«´ÓijÖ̶ֳÈÉ϶øÑÔ£¬IPUµÄÔË×÷»úÀí½Ó½ü´óÄÔ¼ÆËãµÄ¹¤×÷ÔÀí£¬Ö»ÊǰѼÆËãºÍ´æ´¢Ïà½áºÏ¡£
ÁíÍ⣬GraphcoreÒ²½«´ÓÈí¼þ·½Ãæ¸üÓÐЧ֧³ÖÏ¡Ê軯ÒÔ´ïµ½ÀàÄԵļÆËãÁ¿¡£
À×·åÍø
Ïà¹ØÎÄÕ£º
²»ÊÇGPUµÄIPU£¬ÎªÊ²Ã´¸üÖµµÃӢΰ´ï¾¯Ì裿
³¬Ô½È«Çò×î´ó7nmоƬA100£¡GraphcoreµÚ¶þ´úIPU¾§Ìå¹ÜÊýÁ¿¸ß´ï594ÒÚ¸ö
Ö±»÷CPU¡¢GPUÈõÏµÚÈýÀàAI´¦ÀíÆ÷IPUÕýÔÚáÈÆð
À×·åÍøÔ´´ÎÄÕ£¬Î´¾ÊÚȨ½ûÖ¹×ªÔØ¡£ÏêÇé¼û×ªÔØÐëÖª¡£