Brain activity decoding is a technique for estimating what a person was doing from brain activity data measured by MRI or brain waves. Research is progressing with an eye on its application to (technology for moving artificial legs).

 Recently, the accuracy has been improved by using "deep learning", which is a basic technique of artificial intelligence, to decipher this brain activity.On the other hand, the operation of deep neural circuits is so complicated that it is difficult to explain "why the decoder gave the answer to a given data".

 Researchers at Okayama University, Rikkyo University, National Institute for Physiological Sciences, Araya Co., Ltd., and Keio University have developed a new method to intuitively explain the decoding of brain activity by the deep neural circuit that is a black box like this. bottom.This was achieved by combining a technique called anti-real virtual explanation and another technique of deep learning called a deep generative model.

 Specifically, based on the brain activity data that the decoder made a mistake in answering, a virtual brain activity data that looks exactly like the real thing is generated by a deep generative model by hostile learning.If the decoder can correctly judge from the virtual brain activity data, the brain region that caused the wrong answer can be determined by comparing the original brain activity data with the virtual brain activity data.It is possible to visually show the difference between the two and give an "explanation" of the malfunction.

 We also succeeded in extracting the characteristics of brain activity used by deep neural circuits for decoding by generating brain activity data with exaggerated characteristics by a brain activity generator and having the decoder read it.These results are expected to be useful as basic techniques for realizing brain image diagnosis using "explainable" deep learning.

Paper information:[Frontiers in Neuroinformatics] Counterfactual Explanation of Brain Activity ClassifiersUsing Image-To-Image Transfer by Generative Adversarial Network

Keio University
Rikkyo University

Acquire "new" global leadership with "RIKKYO Learning Style"

Since its founding in 1874, Rikkyo University has practiced liberal arts education that fosters internationality and leadership.Currently, we have 10 faculties, 27 departments, 8 specializations and 1 course.With abundance of mind and leadership, we can respond to global issues and social demands, and discover and solve issues from a broad perspective […]

Okayama University

Promote the creation of an environment and system that can fly as a practitioner who can play an active role globally

A national university with 150 faculties, 10 graduate schools, and 8 research institutes, which is about 4 years old.Based on the results of advanced research activities, we can cultivate the ability of students to participate in "creation of knowledge" independently, and foster a rich humanity through close dialogues and discussions between students and faculty members. In a wide range of fields both domestically and internationally […]

University Journal Online Editorial Department

This is the online editorial department of the university journal.
Articles are written by editorial staff who have a high level of knowledge and interest in universities and education.