{"id":575,"date":"2022-11-06T09:16:46","date_gmt":"2022-11-06T09:16:46","guid":{"rendered":"https:\/\/blog.liguanxin.cn\/?p=575"},"modified":"2022-11-06T09:16:46","modified_gmt":"2022-11-06T09:16:46","slug":"%e8%ae%ba%e6%96%87%e7%ac%94%e8%ae%b0-cvpr-workshop-2022transformer-for-single-image-super-resolution","status":"publish","type":"post","link":"https:\/\/blog.liguanxin.cn\/index.php\/2022\/11\/06\/%e8%ae%ba%e6%96%87%e7%ac%94%e8%ae%b0-cvpr-workshop-2022transformer-for-single-image-super-resolution\/","title":{"rendered":"\u8bba\u6587\u7b14\u8bb0\u2014\u2014[CVPR workshop 2022]Transformer for Single Image Super-Resolution"},"content":{"rendered":"<p><strong>\u521b\u65b0\u70b9\uff1a<br \/>\n\u2460\u7531\u8f7b\u91cfCNN\u4e3b\u5e72Lightweight CNN Backbone(LCB)\u548c\u8f7b\u91cfTransformer\u4e3b\u5e72Lightweight<br \/>\nTransformer Backbone(LTB)\u6784\u6210<br \/>\n\u2461LCB\u53ef\u4ee5\u52a8\u6001\u8c03\u8282\u7279\u5f81\u56fe\u7684\u5927\u5c0f\uff0cLTB\u662f\u51cf\u5c11\u4e86\u8ba1\u7b97\u91cf\u7684Transformer\u7ed3\u6784<br \/>\n\u2462\u8bbe\u8ba1\u4e86\u4e00\u4e2a\u9ad8\u9891\u6ee4\u6ce2\u6a21\u5757\uff08HFM\uff09\u6765\u6355\u83b7\u56fe\u50cf\u7684\u7eb9\u7406\u7ec6\u8282<\/strong><\/p>\n<h2>\u7f51\u7edc\u7ed3\u6784<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106143431.png\" alt=\"\" \/><br \/>\n\u5206\u4e3a\u56db\u90e8\u5206\uff1a\u6d45\u5c42\u7279\u5f81\u63d0\u53d6\u3001\u8f7b\u91cfCNN\u4e3b\u5e72\uff08LCB\uff09\u3001\u8f7b\u91cfTransformer\u4e3b\u5e72\uff08LTB\uff09\u548c\u56fe\u50cf\u91cd\u5efa<\/p>\n<ul>\n<li>\u6d45\u5c42\u7279\u5f81\u63d0\u53d6\uff1a3*3\u5377\u79ef<\/li>\n<li>LCB\uff1a\u7531\u591a\u4e2a\u9ad8\u4fdd\u771f\u5757HPB\u6784\u6210<\/li>\n<\/ul>\n<h2>\u9ad8\u4fdd\u771f\u5757HPB<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106153518.png\" alt=\"\" \/><br \/>\n\u4ee5\u524d\u7684SR\u7f51\u7edc\u901a\u5e38\u4f1a\u4fdd\u6301\u539f\u5206\u8fa8\u7387\u4e0d\u53d8\uff0c\u672c\u6587\u4e3a\u4e86\u964d\u4f4e\u8ba1\u7b97\u91cf\uff0c\u63d0\u51fa\u4e86\u4e00\u79cd\u65b0\u7684\u9ad8\u4fdd\u771f\u5757\uff08HPB\uff09\u6765\u964d\u4f4e\u7279\u5f81\u7684\u5206\u8fa8\u7387\u540c\u65f6\u4fdd\u7559\u66f4\u591a\u9ad8\u9891\u7279\u5f81\u3002HPB\u4e3b\u8981\u7531\u9ad8\u9891\u6ee4\u6ce2\u6a21\u5757\uff08HFM\uff09\u548c\u591a\u4e2a\u81ea\u9002\u5e94\u6b8b\u5dee\u7279\u5f81\u5757\uff08ARFB\uff09\u7ec4\u6210\u3002<br \/>\n\u4e0a\u65b9\u662f\u901a\u8fc7HFM\u63d0\u53d6\u7684\u9ad8\u9891\u7279\u5f81\uff0c\u53ea\u7ecf\u8fc7\u4e00\u4e2aARFB\u3002<br \/>\n\u4e0b\u65b9\u662f\u901a\u8fc7\u4e0b\u91c7\u6837\u540e\u7684\u4f4e\u9891\u7279\u5f81\u3002<br \/>\n\u9ad8\u4f4e\u9891\u7279\u5f81concat\u4e4b\u540e\u901a\u8fc71*1\u5377\u79ef\u6062\u590d\u539f\u6765\u7684channel\uff0c\u6700\u540e\u7ecf\u8fc7\u4e00\u4e2a\u901a\u9053\u6ce8\u610f\u529bCA\u548cARFB\uff0c\u518d\u52a0\u5165\u6b8b\u5dee\u7a33\u5b9a\u8bad\u7ec3\u3002<br \/>\n\u4e3a\u4e86\u51cf\u5c11\u53c2\u6570\u91cf\uff0c\u5904\u7406\u4f4e\u9891\u4fe1\u606f\u7684ARFB\u5171\u4eab\u76f8\u540c\u7684\u6743\u91cd\u3002<\/p>\n<h2>\u9ad8\u9891\u6ee4\u6ce2\u6a21\u5757HFM<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106160756.png\" alt=\"\" \/><br \/>\n\u7531\u4e8e\u5085\u91cc\u53f6\u53d8\u6362\u5f88\u96be\u5d4c\u5165\u5230CNN\u4e2d,\u4e8e\u662f\u672c\u6587\u63d0\u51fa\u4e86\u4e00\u79cd\u53ef\u5fae\u7684\u9ad8\u9891\u6ee4\u6ce2\u6a21\u5757\u3002<br \/>\n\u5bf9\u4e8e\u8f93\u5165<span class=\"katex-eq\" data-katex-display=\"false\">T_L<\/span>\uff0c\u9996\u5148\u8fdb\u884c\u6c60\u5316\u6838\u4e3ak\u7684\u5e73\u5747\u6c60\u5316\uff0c\u7136\u540e<span class=\"katex-eq\" data-katex-display=\"false\">T_A<\/span>\u518d\u4e0a\u91c7\u6837\u5230\u539f\u6765\u7684\u5c3a\u5bf8\uff0c<span class=\"katex-eq\" data-katex-display=\"false\">T_U<\/span>\u662f\u4f5c\u4e3a\u4e0e\u539f\u59cb<span class=\"katex-eq\" data-katex-display=\"false\">T_L<\/span>\u76f8\u6bd4\u66f4\u5e73\u6ed1\u7684\u8868\u8fbe\u3002\u6700\u540e\uff0c\u4ece<span class=\"katex-eq\" data-katex-display=\"false\">T_L<\/span>\u9010\u5143\u7d20\u51cf\u53bb<span class=\"katex-eq\" data-katex-display=\"false\">T_U<\/span>\uff0c\u5f97\u5230\u9ad8\u9891\u4fe1\u606f\u3002<\/p>\n<p>\u53ef\u89c6\u5316\u6548\u679c\uff1a<br \/>\n<img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106161849.png\" alt=\"\" \/><\/p>\n<h2>\u81ea\u9002\u5e94\u6b8b\u5dee\u7279\u5f81\u5757ARFB<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106161951.png\" alt=\"\" \/><br \/>\nARFB\u5305\u542b\u4e24\u4e2a\u6b8b\u5dee\u5355\u5143RU\u548c\u4e24\u4e2a\u5377\u79ef\u5c42\u3002<br \/>\n\u4e3a\u4e86\u51cf\u5c11\u53c2\u6570\u91cf\uff0cRU\u7531\u4e24\u4e2a\u90e8\u5206\u7ec4\u6210\uff1a\u51cf\u5c11\u548c\u62d3\u5c55\uff0c\u901a\u8fc71*1\u5377\u79ef\u628achannel\u51cf\u5c11\u4e00\u534a\uff0c\u7136\u540e\u518d\u8fd8\u539f\u5230\u539f\u6765\u7684\u5927\u5c0f\u3002\u540c\u65f6\u52a0\u5165\u53ef\u5b66\u4e60\u53c2\u6570<span class=\"katex-eq\" data-katex-display=\"false\">\\lambda_x<\/span>\u6765\u81ea\u9002\u5e94\u8c03\u8282\u6b8b\u5dee\u7684\u6bd4\u4f8b\u3002<\/p>\n<h2>\u8f7b\u91cfTransformer\u4e3b\u5e72<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106163846.png\" alt=\"\" \/><br \/>\n\u4e3a\u4e86\u51cf\u5c11\u5185\u5b58\u5360\u7528\uff0c\u672c\u6587\u63d0\u51fa\u4e00\u79cd\u8f7b\u91cfTransformer\u4e3b\u5e72\u3002<br \/>\n\u8003\u8651\u5230\u8d85\u5206\u5904\u7406\u7684\u662f\u4e8c\u7ef4\u56fe\u50cf\uff0c\u5728ViT\u4e2d\u4e00\u7ef4\u5e8f\u5217\u662f\u901a\u8fc7\u975e\u91cd\u53e0\u7684\u5757\u5212\u5206\u751f\u6210\u7684\uff0c\u8fd9\u610f\u5473\u7740\u6bcf\u4e2a\u5757\u4e4b\u95f4\u6ca1\u6709\u50cf\u7d20\u91cd\u53e0\u3002\u6839\u636e\u6211\u4eec\u7684\u5b9e\u9a8c\uff0c\u8fd9\u4e9b\u9884\u5904\u7406\u65b9\u6cd5\u5e76\u4e0d\u9002\u7528\u4e8eSISR\u3002\u56e0\u6b64\uff0c\u672c\u6587\u63d0\u51fa\u4e86\u4e00\u79cd\u65b0\u7684\u5904\u7406\u7279\u5f81\u6620\u5c04\u7684\u5904\u7406\u65b9\u6cd5\u3002<\/p>\n<p>\u5982\u4e0a\u56fe\u3002\u901a\u8fc7<span class=\"katex-eq\" data-katex-display=\"false\">k*k<\/span>\u7684\u6838\u628a\u6bcf\u4e2a\u50cf\u7d20\u62d3\u5c55\u5230<span class=\"katex-eq\" data-katex-display=\"false\">k*k<\/span>\u500d\uff0c\u6765\u8ba9\u50cf\u7d20\u83b7\u53d6\u5230\u5468\u8fb9\u4fe1\u606f\uff0c\u540c\u65f6\u4e5f\u81ea\u52a8\u53cd\u6620\u4e86\u6bcf\u4e2apatch\u7684\u4f4d\u7f6e\u4fe1\u606f\u3002<\/p>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106163852.png\" alt=\"\" \/><br \/>\n<strong>\u9ad8\u6548\u7684\u591a\u5934\u6ce8\u610f\u529b\u6a21\u5757\uff0c\u5360\u7528\u66f4\u5c11\u7684\u5185\u5b58\uff1a<\/strong>\u8003\u8651\u5230\u56fe\u50cf\u901a\u5e38\u5177\u6709\u8f83\u9ad8\u7684\u5206\u8fa8\u7387\uff0c\u5bfc\u81f4N\u975e\u5e38\u5927\uff0c\u81ea\u6ce8\u610f\u77e9\u9635\u7684\u8ba1\u7b97\u6d88\u8017\u4e86\u5927\u91cf\u7684GPU\u5185\u5b58\u6210\u672c\u548c\u8ba1\u7b97\u6210\u672c\u3002\u4e8e\u662f\u672c\u6587\u901a\u8fc7\u5207\u5272\u56e0\u5b50s\uff0c\u628aQKV\u7684N\u5207\u5272\u6210\u4e86s\u4efd\uff0c\u6bcf\u4e00\u4efd\u5355\u72ec\u505a\u81ea\u6ce8\u610f\u529b\uff0c\u6700\u540e\u901a\u8fc7concat\u6062\u590d\u539f\u6765\u7684\u5927\u5c0f\u3002<\/p>\n<h2>\u6548\u679c<\/h2>\n<p>\u672c\u6587\u65b9\u6cd5\u7684\u521b\u65b0\u70b9\u5f88\u591a\uff0c\u4f46\u662f\u6548\u679c\u63d0\u5347\u5e76\u4e0d\u660e\u663e\uff0c\u751a\u81f3\u6ca1\u548cSwinIR\u6bd4\u8f83\u3002<br \/>\n<img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106165856.png\" alt=\"\" \/><br \/>\n\u4e0b\u9762\u662f\u7528\u540c\u6837\u8bad\u7ec3\u96c6\u8bad\u7ec3\u7684SwinIR<br \/>\n<img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106171423.png\" alt=\"\" \/><\/p>\n<h2>\u53c2\u6570\u91cf<\/h2>\n<p><img src=\"https:\/\/blog.liguanxin.cn\/wp-content\/uploads\/2022\/11\/\u5fae\u4fe1\u622a\u56fe_20221106171547.png\" alt=\"\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u521b\u65b0\u70b9\uff1a \u2460\u7531\u8f7b\u91cfCNN\u4e3b\u5e72Lightweight CNN Backbone(LCB)\u548c\u8f7b\u91cfTransform [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[6],"tags":[13,11,21],"_links":{"self":[{"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/posts\/575"}],"collection":[{"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/comments?post=575"}],"version-history":[{"count":0,"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/posts\/575\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/media?parent=575"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/categories?post=575"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.liguanxin.cn\/index.php\/wp-json\/wp\/v2\/tags?post=575"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}