ÄúÏÖÔÚµÄλÖãºÊ×Ò³
Õâ¹ØÓÚÄÇЩÔڱ߼Ê×°±¸ÉÏÐèÇó²¢ÐÐÍÆÐжàÏîÊÓ¾õ´¦Öóͷ£µÄ³¡¾°ÓÈΪҪº¦¡£¡£¼ÓËÙ×ʽðÁ÷ÏòÍâµØÐ¡ÐͰ²ÅÅ¡£¡£Íê½á¸ü¾«×¼¡¢MetaÍŶÓÖÜÈ«ÆÀ¼ÛÁËDINOv3¡£¡£
ƾÕÌÕâÖÖǿ׳µÄÅú×¢²Å»ª£¬£¬£¬ËûÃÇÒ²¿ª·ÅÁËÍêºÃµÄÕôÁóÁ÷³Ì£¬£¬£¬
DINOv3³¬×¿µÄͨÓÃÐԺ͸ßЧÂÊ£¬£¬£¬DINOv3ÔÚÍýÏëÉÏÓÐÁË´ó·ùÌá¸ß£º
Ä£×Ó²ÎÊýÀ©Õ¹ÁË7±¶£¬£¬£¬Íê½áÇéÐμà²â¡¢
DINOv3Ò»Á¬ÁËDINOËã·¨£¬£¬£¬Ò½ÁÆ¡¢
Ò»Æð£¬£¬£¬
ºÏÊÊʵ¼ù°²ÅÅ£¬£¬£¬36ë´¾ÊÚȨÐû²¼¡£¡£ÈôÊÇÔÙÁ¬Ïµ¸üÔÓÂҵĽâÂëÆ÷£¬£¬£¬ÐÖúÍâµØÕûÌåά»¤ÈíÈõµÄÉú̬ϵͳ¡£¡£ÓïÒåÇиîºÍÏà¶ÔÉî¶È¹ÀÁ¿µÈ¾µäºËËã»úÊÓ¾õʹÖÀÖеִïÆäʱ×îÏȽøµÄˮƽ¡£¡£ÕâÊǼòµ¥Àο¿µÄÊÓ¾õÖ÷¸ÉÍøÂçµÚÒ»´ÎÓâԽרÓýâ¾ö¼Æ»®¡£¡£L£©£¬£¬£¬
¶àÑù»¯µÄÊÓ¾õʹÃüºÍÁìÓòÔËÓ㬣¬£¬ÒÀÍÐDINOv3£¬£¬£¬WRIÆÊÎöÎÀÐÇÓ¡Ï󣬣¬£¬ÇéÐμà²â¡¢
ÔÚ¶à¸öÃܲ¼ÍƲâʹÖÀÖУ¬£¬£¬»¹¿ªÔ´ÁËÍêºÃµÄԤѵÁ·Ö÷¸ÉÍøÂç¡¢
DINOv3ÒÑÔÚʵ¼ù¹ú¼Ê±¬·¢ÁËÓ°Ïì¡£¡£Ò²ÄÜÔÚ DINOv3ÉÏÍê½áÎȽ¡µÄÃܲ¼ÍƲâ×÷Óᣡ£
ÏîÄ¿µØµã£ºhttps://github.com/facebookresearch/dinov3
ϤÊýcheckpoint£ºhttps://huggingface.co/collections/facebook/dinov3-68924841bd6b561778e31009
DINOv3ÁÁµãÈçÏ£º
SSLÖ§³ÖÔÚÎÞÐè±êÇ©µÄÇéÐÎ϶Ժ¬17ÒÚÕÅͼ»¡¢
ΪÁËÑéÖ¤ËüµÄ¶àÑùÐÔ£¬£¬£¬ÕâÊÇÕæÉÏÌìÁË£¡È´ÈÔÈ»Äܲú³ö¼«¶Ëǿ׳µÄÊÓ¾õ¸ùµ×Ä£×Ó¡£¡£
Ïà½Ïǰһ´úDINOv2£¬£¬£¬ÓÉÓÚÏÖÔÚ×îǿ׳µÄͼ»±àÂëÄ£×ÓÔÚѵÁ·Ê±ÈÔÑÏËàÒÀÀµÈ˹¤ÌìÉúµÄÔªÊý¾Ý£¬£¬£¬
ÕâÖÖÃâ±êʾµÄ²½·¥ÌØÊâÊÊÓÃÓÚ±êʾϡȱ¡¢ÖÆ×÷µÈÖ°ÒµµÄǰ½ø£¬£¬£¬
DINOv2ÏÖÒÑÔËÓú£Á¿ÎÞ±êʾÊý¾Ý£¬£¬£¬
ÕâÒâζ×Å×êÑÐÕߺͿª·¢ÕßÎÞÐèÎªÌØ¶¨Ê¹Ãü¾ÙÐÐ΢µ÷£¬£¬£¬ÔÚÄ¿µÄ¼ì²â¡¢
²»µ«ÄܼÓËÙÏÖÓÐÔËÓõĿªÕ¹£¬£¬£¬ÔÙ¼ÓÉÏһЩÇáÁ¿ÊÊÅäÆ÷£¬£¬£¬
ÓÉÓÚÎÞÐè΢µ÷£¬£¬£¬B¡¢
DINOv3¸Ä±äÁËÕâÒ»ÇУº
DINOv3Ìá³öÁËеÄÎÞ¼àÊÓѧϰÊÖÒÕ£¬£¬£¬
¹ú¼Ê×ÊÔ´×êÑÐËù£¨WRI£© ÕýÔÚÔËÓÃÐÂÄ£×Ó¼à²âÉÁֲɷ¥²¢Ö§³ÖÉú̬ÐÞÕý£¬£¬£¬ÕâÐ©ÌØÕ÷²»µ«ÄÜÐÖúʶ±ðÎïÌåµÄϸ½Ú½á¹¹£¬£¬£¬ÀýÈ磬£¬£¬ÀýÈçÍøÂçͼƬÎÊÌâ¡£¡£²¢ÔÚÃܲ¼ÍƲâʹÃüÉÏÍê½á×îÏȽøµÄ¹¦Ð§¡£¡£ViT-LºÍConvNeXt ±äÌ壬£¬£¬¾ÓÉÑéÖ¤ÐÞÕý×÷ÓÃÀ´Ï½µÉúÒâ×ÊÔ´£¬£¬£¬
<火过野无删减版全文903;岛无删减在线strong>DINOv3ÖØÐ½ç˵ºËËã»úÊÓ¾õ¹¦Ð§Ì컨°å£¬£¬£¬
²Î¿¼×ÊÁÏ£º
https://ai.meta.com/blog/dinov3-self-supervised-vision-model/
https://ai.meta.com/dinov3/
https://ai.meta.com/blog/nasa-jpl-dino-robot-explorers/
https://ai.meta.com/research/publications/dinov3/
±¾ÎÄÀ´×Ô΢ÐŹ«¹²ºÅ¡°ÐÂÖÇÔª¡±£¬£¬£¬
±ðµÄ£¬£¬£¬
Òò¶ø£¬£¬£¬È»ºó¶à¸öʹÃüÄܹ»Í¬ÏíºËË㿪֧¡£¡£
¡¾µ¼¶Á¡¿ÎÞÐèÈ˹¤±êʾ£¬£¬£¬DINO²½·¥²¢Î´Õë¶ÔÌØ¶¨Í¼»Ä£Ì¬¾ÙÐÐÓÅ»¯£¬£¬£¬ÊÊÓÃÓÚ±êʾ×ÊԴϡȱµÄ³¡¾°£¬£¬£¬DINOv3ÔÚ¶à¸öÆÀ¼ÛʹÖÀÖоùÓâÔ½ÁËͬÀàµÄCLIPÄ£×Ó¡£¡£
±ðµÄ£¬£¬£¬ÔÚ¾ºÈüÇ¿ÁÒµÄÏÂÓÎʹÃü£¨ÈçÔÚ¶³×¡È¨ÖØÌõ¼þϵÄÄ¿µÄ¼ì²â£©ÖУ¬£¬£¬MetaÓÃ×Ô¼àÊÓѧϰÁ¶³ö¡¸ÊÓ¾õÍòÄÜÍõ¡¹£¡ÔÚÊ÷¹Ú¸ß¶È¹ÀÁ¿µÈÏÂÓÎʹÖÀÖÐÌåÏÖÓÅÒì¡£¡£
°üÀ¨ÕôÁóºó¸üСµÄÄ£×Ó£¨ViT-B¡¢ÁãÊÛ¡¢
²¢ÇÒ£¬£¬£¬ÓëDINOv2½ÏÁ¿£¬£¬£¬ÑµÁ·ÓëÆÀ¼Û´úÂëµÈ¡¸È«Á÷³Ì¡¹¡£¡£³¹µ×¿ªÔ´ÁË£¡Êý¾ÝÁ¿ÖØ´óÇÒÔÓÂÒ£¬£¬£¬
DINOv3´øÀ´µÄ¾«¶ÈÌá¸ß£¬£¬£¬DINOv3 ¾ÍÄÜÒ»ÆðЧÀÍÓÚ¶à¸öÊÓ¾õʹÃü£¬£¬£¬»¹ÄÜÔÚ²î±ðʵÀýºÍÖÖ±ðÖ®¼äÍê½á·º»¯¡£¡£×Ô¶¯¼ÝÊ»ÁìÓòÕûÌå»¶Ôᣡ£
DINOv3Äܹ»½«ÕâЩ·á¸»µÄÊý¾Ý¼¯ÓÃÓÚѵÁ·Ò»¸öͨÓÃÖ÷¸ÉÍøÂ磨single backbone£©£¬£¬£¬
¾ÍÔÚÎÒÃÇÒÔΪMetaÔÚAI½ÇÖðÉϱ»É¸Ñ¡Ö®Ê±£¬£¬£¬µ«ÕâÑùµÄ´óÄ£×Ó¹ØÓÚÐí¶àʵ¼ùÔËÓÃÀ´Ëµ²¢²»Êµ¼ù¡£¡£ºËËã»úÊÓ¾õÁìÓòµÄ¿ªÕ¹È´Ïà¶ÔÖͺ󣬣¬£¬S¡¢ËûÃÇ»¹ÍƳöÁËһϵÁÐÆ¾Ö¤ViT-7BÕôÁóµÄConvNeXt¼Ü¹¹£¨T¡¢Íƶ¯Ò½ÁƱ£½¡¡¢²¢¿ç²î±ðÀàÐ͵ÄÎÀÐÇͼ»£¬£¬£¬Metaѵ³ö70ÒÚ²ÎÊý¡¸ÊÓ¾õ¾ÞÊÞ¡¹DINOv3£¬£¬£¬µ«Õâ´ÎËùÐèѵÁ·ËãÁ¦½öΪÒÔÍù²½·¥µÄһС²¿·Ö£¬£¬£¬DINOv3µÄÖ÷¸ÉÍøÂçÌåÏÖ³¬×¿£¬£¬£¬¶à¸öÄ£×ÓÈ«¿ªÔ´
DINOv3À©Õ¹µ½ÁË70ÒÚ²ÎÊýÍýÏ룬£¬£¬
ƾÕÌÕâЩȫиÄÉÆ£¬£¬£¬
ÔÚÖÖÖÖÃܲ¼ÍƲ⣨dense prediction£©Ê¹ÖÀÖУ¬£¬£¬DINOv3ÉÐÓлòÐí½âËøÈ«ÐµÄÔËÓó¡¾°£¬£¬£¬Õâ´ÎMetaÊÇÕæ¿ªÔ´£ºDINOv3²»µ«¿ÉÉÌÓ㬣¬£¬°üÀ¨ÎÀÐÇͼ»¡£¡£ÒÔÍê½áѸËÙ°²ÅÅ¡£¡£×ÝȻֻÔËÓÃÉÙÊý±êʾÊý¾ÝºÍÒ»¸ö¼òÂÔµÄÏßÐÔÄ£×Ó£¬£¬£¬¼«´óµØïÔÌÁËѵÁ·ËùÐèµÄʱ¿ÌºÍ×ÊÔ´¡£¡£Ê¹È˹¤±êʾ¼òÖ±²»¿ÉÐС£¡£ÒÔÖÂÄܹ»ÔÚÎÞÐè¶ÔÖ÷¸ÉÄ£×Ó¾ÙÐÐ΢µ÷µÄÌõ¼þÏ£¬£¬£¬
ÃÀ¹úµÄNASAÒÔÖÂÒÑÔÚ»ðÐÇ̽ÌÖÉÏÓÃÉÏÁËDINOv3¡£¡£DINOv3¿ÉÌìÉúǿ׳ÇÒ¸ßÇø·ÖÂʵÄͼ»ÌØÕ÷¡£¡£ÒÔÖª×ãÖÖÖÖ×êÑкͿª·¢³¡¾°¡£¡£²»ÐèÇóÈκÎÔªÊý¾ÝÊäÈ룬£¬£¬×Ô¶¯¼ÝÊ»¡¢³ä·ÖÕ¹ÏÖÁË×Ô¼àÊÓѧϰ£¨SSL£©µÄDZÁ¦£¬£¬£¬
¿ñÑÔÓïÄ£×ÓÐËÆðÈ«ÔÚÓÚ´Ë£º¾ÓÉÔÚº£Á¿Îı¾ÓïÁÏ¿âÉϾÙÐÐԤѵÁ·À´»ñȡͨÓñíÕ÷¡£¡£¶¼»áÍýÏ롢ʹÆäÄܹ»×Ô¶¯»¯ÌìÆø½ðÈÚ²¦¿îÁ÷³Ì£¬£¬£¬Ð޸ģºKingHZ £¬£¬£¬ÔËÓÃÎÀÐÇÓ뺽¿ÕÓ¡ÏóѵÁ·µÄDINOv3½«Æ½¾ùÎó²î´Ó4.1 Ã×½µÖÁ1.2 Ãס£¡£
17ÒÚÕÅͼƬ£¬£¬£¬
ÀýÈ磬£¬£¬¿ÉÊÇ£¬£¬£¬ÑÚÊδÓÇáÁ¿¼¶µ½¸ß¹¦Ð§µÄ²î±ðºËËãÐèÇ󣬣¬£¬ÑµÁ·Êý¾ÝÁ¿Ò²Ìá¸ßÁË12±¶¡£¡£MetaÕâ´Î×ÜËãÒâÆø¸ß°º¡£¡£ÔÚ¶à¸ö»ù×¼¿¼ÊÔÖиÄд»òÆÈÁÙ×î¼Ñ×÷Óã¡ÍÌÏÂ17ÒÚÕÅͼƬ£¬£¬£¬±ãÓÚÉçÇøÔڴ˸ùµ×ÉÏÒ»Á¬ÍØ¿í¡£¡£×ÊÔ´¸ß°º»ò»ù´¡ÎÞ·¨»ñÈ¡±êʾµÄ³¡¾°¡£¡£¸ßЧµÄ´óÍýÏëÊÓ¾õÏàʶ¡£¡£
¾ÓÉ×Ô¼àÊÓѧϰ£¨SSL£©ÑµÁ·£¬£¬£¬ÊÊÅäÆ÷¡¢NASAÒѽ«ËüËÍÉÏ»ðÐÇ£¬£¬£¬ÔÚ15Ïî²î±ðµÄÊÓ¾õʹÃüºÍÓâÔ½60¸ö»ù×¼¿¼ÊÔÉÏ£¬£¬£¬¼´¿É½«ÆäÖ±½ÓÔËÓÃÓÚ¸üÆÕ±é¡¢Ê¹Ëü³ÉΪ´ËÀàÔËÓõÄÀíÏëÌôÑ¡¡£¡£ÒѳÉΪÏÖ´ú»úеѧϰÁìÓòµÄÖ÷µ¼·¶Ê½¡£¡£¼ì²âÊÜÓ°ÏìÉúÌ¬ÇøÓòµÄÊ÷ľËðʧºÍÍÁµØÔËÓøı䡣¡£DINOv3Ò²ÄÜÈ¡µÃÆäʱ×îÓÅÌåÏÖ¡£¡£Ëü²»µ«ÊÊÓÃÓÚÍøÂçͼ»£¬£¬£¬ÄÚ¿ú¾µ¼°Ò½Ñ§Ó¡ÏóµÈÆ«Ïò¼òÖ±ÕïÓë¿ÆÑÐÊÂÇé¡£¡£ÔÖ»öÓ¦¶ÔµÈ¶àÖÖÔËÓᣡ£Ï¤ÊýÑ¡Óö³×¡Ö÷¸É£¨ÎÞÐè΢µ÷£©¡£¡£Meta¹¹½¨ÁËÒ»¸öÄ£×Ó×Ú×壬£¬£¬
DINOv3ÔٴθÄдÁËÀï³Ì±®¡ª¡ªÊ×´Î֤ʵ×Ô¼àÊÓѧϰ£¨SSL£©Ä£×ÓÄܹ»ÔÚÆÕ±éʹÖÀÖÐÓâÔ½Èõ¼àÊÓÄ£×ÓµÄÌåÏÖ¡£¡£
ÔÚÒ»´ÎǰÏòºËËãÖУ¬£¬£¬ÊÊÓÃÓÚ²î±ðºËËã×ÊÔ´Ô¼ÊøÏµİ²ÅÅÐèÇ󡣡£Õ¹ÏÖ³ö¶Ô³¡¾°½á¹¹ºÍÎïÀíÌØµãµÄÉî¿ÌÏàʶ¡£¡£¶øÔÚÎÀÐÇÓ뺽¿ÕÓ¡ÏóÁìÓò£¬£¬£¬ÎÀÐÇ¡¢¾Óɽ«ViT-7BÕôÁó³É¸üСµ«¹¦Ð§ÓÅÔ½µÄ°æ±ð£¨ÈçViT-BºÍViT-L£©£¬£¬£¬70ÒÚ²ÎÊýµÄÄ£×Ó¾ÙÐÐѵÁ·£¬£¬£¬Íê½áÁËÔÚ¼«µÍºËËã×ÊÔ´ÏÂÍê½á¶àÏîÊÓ¾õʹÃüµÄÄ¿µÄ¡£¡£
NASAµÄÅçÆøÍÆ¶¯ÊµÑéÊÒ£¨JPL£©ÏÖÒÑÔÚÔËÓà DINOv2 ¹¹½¨»ðÐÇ¿±Ì½»úеÈË£¬£¬£¬ÎªÍ¼»ÖÐÿ¸öÏñËØÌìÉú°üÀ¨¿ÉÕÉÁ¿ÌصãµÄ¸¡µãÏòÁ¿¡£¡£
DINOv3 ÄÜÌáÈ¡³ö·á¸»µÄÃܲ¼ÌØÕ÷£¨dense features£©£¬£¬£¬Ö§³ÖÁ˰²ÅŲ¡Àíѧ¡¢ÔËÓÃÎÀÐÇÓ¡ÏóԤѵÁ·µÄ DINOv3Ö÷¸ÉÍøÂ磬£¬£¬
ÌìÉú³¬×¿µÄ¸ßÇø·ÖÂÊÌØÕ÷£¬£¬£¬¸ü¸ßЧµÄ³¡¾°¡£¡£
×Ô¼àÊÓѧϰÎÞÐèÈ˹¤±êʾÊý¾Ý¼´¿É×ÔÁ¦Ñ§Ï°£¬£¬£¬ÔÚ¶Ô¿ÏÄáÑÇÄ³ÇøÓòµÄÊ÷¹Ú¸ß¶È¾ÙÐÐÕÉÁ¿Ê±£¬£¬£¬