{"id":74596,"date":"2023-06-14T11:30:07","date_gmt":"2023-06-14T02:30:07","guid":{"rendered":"https:\/\/www.waseda.jp\/inst\/research\/?p=74596"},"modified":"2023-06-14T11:30:07","modified_gmt":"2023-06-14T02:30:07","slug":"multiscanning-based-rnn-transformer-for-hyperspectral-image-classification%ef%bc%88published-in-ieee-transactions-on-geoscience-and-remote-sensing-may-2023%ef%bc%89","status":"publish","type":"post","link":"https:\/\/www.waseda.jp\/inst\/research\/news\/74596","title":{"rendered":"Multiscanning-Based RNN-Transformer for Hyperspectral Image Classification\uff08Published in IEEE Transactions on Geoscience and Remote Sensing, May 2023\uff09"},"content":{"rendered":"\n\n\n\n\n\n\n\n\n
Journal Title
\n\/\u63b2\u8f09\u30b8\u30e3\u30fc\u30ca\u30eb\u540d<\/td>\n		IEEE Transactions on Geoscience and Remote Sensing<\/td>\n<\/tr>\n
Publication Year and Month
\n\/\u63b2\u8f09\u5e74\u6708<\/td>\n		May, 2023<\/td>\n<\/tr>\n
Paper Title
\n\/\u8ad6\u6587\u30bf\u30a4\u30c8\u30eb<\/td>\n		Multiscanning-Based RNN-Transformer for Hyperspectral Image Classification<\/td>\n<\/tr>\n
DOI
\n\/\u8ad6\u6587DOI<\/td>\n		10.1109\/TGRS.2023.3277014<\/a><\/td>\n<\/tr>\n
\u00a0Author of Waseda University
\n\/\u672c\u5b66\u306e\u8457\u8005<\/td>\n		KAMATA, Seiichiro(Professor, Faculty of Science and Engineering, Graduate School of Information, Production, and Systems):Corresponding Author<\/td>\n<\/tr>\n
Related Websites
\n\/\u95a2\u9023Web<\/td>\n		–<\/td>\n<\/tr>\n
Abstract
\n\/\u6284\u9332<\/td>\n		The goal of hyperspectral image (HSI) classification is to assign land-cover labels to each HSI pixel in a patchwise manner. Recently, sequential models, such as recurrent neural networks (RNNs), have been developed as HSI classifiers, which need to scan the HSI patch into a pixel sequence with the scanning order first. However, RNNs have a biased ordering that cannot effectively allocate attention to each pixel in the sequence, and previous methods that use multiple scanning orders to average the features of RNNs are limited by the validity of these orders. To solve this issue, it is naturally inspired by Transformer and its self-attention to discriminatively distribute proper attention for each pixel of the pixel sequence and each scanning order. Hence, in this study, we further develop the sequential HSI classifiers by a specially designed RNN\u2013Transformer (RT) model to feature the multiple sequential characters of the HSI pixels in the HSI patch. Specifically, we introduce a multiscanning-controlled positional embedding strategy for the RT model to complement multiple feature fusion. Furthermore, the RT encoder is proposed for integrating ordering bias and attention reallocation for feature generation at the sequence level. In addition, the spectral\u2013spatial-based soft masked self-attention (SMSA) is proposed for suitable feature enhancement. Finally, an additional fusion Transformer (FT) is deployed for scanning order-level attention allocation. As a result, the whole network can achieve competitive classification performance on four accessible datasets than other state-of-the-art methods. Our study further extends the research on sequential HSI classifiers.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"

Journal Title \/\u63b2\u8f09\u30b8\u30e3\u30fc\u30ca\u30eb\u540d IEEE Transactions on Geoscience and Remote Sensing Publication Year and Month \/\u63b2\u8f09\u5e74\u6708 Ma […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[],"tags":[218,217],"class_list":["post-74596","post","type-post","status-publish","format-standard","hentry","tag-impact-en","tag-impact"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/posts\/74596","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/comments?post=74596"}],"version-history":[{"count":1,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/posts\/74596\/revisions"}],"predecessor-version":[{"id":74597,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/posts\/74596\/revisions\/74597"}],"wp:attachment":[{"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/media?parent=74596"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/categories?post=74596"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.waseda.jp\/inst\/research\/wp-json\/wp\/v2\/tags?post=74596"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}