An Interview with Professors Yonezawa and Leleito from the Graduate School of Engineering, Nagoya University

The rapid advancement of information technology is reshaping how we interact with our environment. At the forefront of these innovations are Associate Professor Takuro Yonezawa and Associate Professor Emmanuel Leleito from Nagoya University’s Graduate School of Engineering. Professor Yonezawa specializes in ubiquitous computing, smart city technologies, and human-computer interaction, while Professor Leleito focuses on urban planning, smart mobility, and disaster resilience. Their research contributes to building resilient infrastructure, fostering innovation, and enhancing urban sustainability—core objectives of SDG 9.

“Information Technology” Leading to a More Comfortable and Safer Life

Professor Yonezawa: I research a field called ubiquitous computing. Ubiquitous computing is the concept that computers exist everywhere around us. The idea behind this field is to make computers capable of understanding human intentions and recognizing environmental conditions so that they can support not just work but also daily life. The research originally started with the idea of creating a smart room, which evolved into the concept of the “Internet of Things (IoT),” a technology that connects objects to the internet. From there, I began considering how cities, communities, and physical spaces would change when applying this idea to an entire town rather than just a room, a topic I have been researching since my student days.

Around 2013, we started working on making entire cities our research field, exploring smart cities—urban areas optimized and made more efficient through cutting-edge technology. To realize a smart city, we need to collect data from the entire town, which means installing sensors throughout the area. In this process, we found that garbage collection trucks, which travel throughout the city, were the most suitable medium for sensor installation. By equipping these trucks with sensors, we discovered that we could efficiently collect a wide variety of information from the entire city. For example, we could determine how much garbage was collected in different areas each day, allowing residents to see how much waste they reduced compared to the previous day. Additionally, this system enables us to monitor environmental data such as air pollution and infrastructure damage.At the same time, in recent years, the digitization of all kinds of spaces has extended the concept of “reality” in daily life beyond physical spaces into information spaces. Nowadays, people use smartphones for about 3–4 hours a day, which in a way disconnects them from physical reality. Traditional media were primarily mass media, providing a relatively uniform sense of reality to everyone. However, with the prevalence of smartphones, each individual now experiences a different reality, leading to a diversification of what we consider real. In the future, we might see people spending most of their time in virtual reality (VR) or living in AI-generated worlds. Today, technology can generate videos from a single photo, and people can even create videos from their past pictures, which could potentially alter their memories. Even if something didn’t happen, repeatedly watching a generated video can make it feel real.

I am researching how we can connect and foster mutual understanding between these increasingly diverse and individualized realities. To do this, we must first understand reality itself, and eventually, we may be able to quantify what reality means to each individual at any given moment. We tend to feel closer to people with whom we share commonalities. By leveraging technology to enhance this innate human ability, we aim to bring together individuals who experience different realities. Furthermore, we are exploring how these ideas can be applied to solving social issues.

Professor Leleito: My research field is urban and regional planning, and my primary focus is on developing tools that support decision-making. When planning something with residents, consensus building is essential. I have been working on developing tools that leverage information technology to make it easier for residents to participate and reach agreements. For instance, in mountainous regions, we analyze past data to determine how schools have been closed over time and predict which schools may close in the future due to declining student populations. Additionally, I research ways to analyze where public services should be located to maximize convenience when municipalities collaborate to provide services to residents. In road construction projects for mountainous areas, we use simulations that consider population distribution and ease of travel to propose which roads should be prioritized for development. We sometimes submit these simulations to the Ministry of Land, Infrastructure, Transport, and Tourism as part of regional planning initiatives.

In urban planning, we also consider how to construct disaster-resistant buildings. For example, we analyze where improvements should be made to enhance disaster prevention, taking into account factors such as wind direction, building materials, and nearby roads. We conduct thousands of simulations to refine our findings. Additionally, we are engaged in disaster education initiatives. Using information technology, we connect children who have experienced earthquakes with those who have not, allowing them to share their knowledge. While elementary and high schools often provide disaster education, universities typically do not, and international students, in particular, may lack basic disaster preparedness knowledge. To address this, we incorporate disaster education into our research so that students can acquire foundational knowledge.

Expanding Perspectives through Mutual Understanding

Professor Yonezawa: I spoke about mutual understanding, but beyond that, I believe it leads to “broadening perspectives.” Ultimately, this makes life more enjoyable. Think back to elementary school—wasn’t every day exciting? As adults, life can feel monotonous and sometimes even anxiety-inducing. The key is how much we can open ourselves to understanding things that are different from us. I am considering how we can use the technologies I mentioned earlier to address such issues and solve social problems.

Professor Leleito: Understanding each other’s cultures is also crucial. This fosters pride in one’s own culture while allowing people to embrace positive aspects of other cultures. For example, someone who previously hesitated to try foreign cuisine may become open to it through deeper cultural understanding. It would be great if we could experience different cultures in more realistic environments. Research is currently advancing in this area, and in the future, it is said that people might be able to share tastes and scents across different locations.

Professor Yonezawa: Another key aspect of our research is privacy and security. As we connect different realities, we need to consider how to protect privacy and security. For instance, in online meetings, using virtual backgrounds can obscure surroundings, but they may also make it difficult to see objects people are holding. On the other hand, showing everything could lead to privacy concerns. Currently, we only have the options to either hide or show everything, with blurring as the only intermediate solution. Our research aims to extract and share only the elements relevant to a person’s actions.

By enabling AI to recognize human activities, we can extract only the meaningful elements and project them into another person’s space. For example, if someone is reading a book, the AI would extract both the person and the book. If they are using a whiteboard, only the whiteboard would be recognized. Connecting all aspects of reality raises privacy concerns, so our goal is to selectively extract meaningful elements. This would allow people to understand what others are doing while protecting privacy, ultimately enhancing mutual understanding. Addressing privacy and security risks in these new interconnected realities is one of the key pillars of our research.

Professor Leleito: Privacy issues are also relevant to smart cities and disaster prevention. To realize smart cities, numerous sensors and cameras must be installed throughout urban areas, posing challenges in balancing the benefits of data collection with privacy concerns. As Professor Yonezawa mentioned, if a camera’s purpose is predefined, it should only monitor the necessary aspects. For example, if monitoring water levels for flood prevention, the system should focus solely on water levels and extract only the relevant information.

The Key to Connecting Different Realities is “Symmetry”

Professor Leleito: As part of the JST CREST Internet of Realities project, spearheaded by Nagoya University, we are hosting an event called “Higashiyama Zoo and Botanical Gardens: Reality of Kenya” (running until the end of March 2025). This event is made possible with the cooperation of Higashiyama Zoo and Botanical Gardens, serving as a testbed for our technological demonstration. Visitors can enjoy a virtual reality (VR) space that merges Higashiyama Zoo and Botanical Gardens with Kenya.

For more details on “Higashiyama Zoo and Botanical Gardens: Reality of Kenya,” visit the following link: https://www.higashiyama.city.nagoya.jp/news/2025/01/post-1215.html

I first began considering the connection between Kenya and Nagoya around 2012. The initiative started when Nagoya University formed a partnership with the University of Nairobi, prompting a project where students at Nagoya University explored how they could contribute to Kenya by addressing issues such as wildlife poaching. Since I am originally from Kenya, I maintained various interactions with people there. In my hometown of Narok County, which is home to Kenya’s most famous safari park, the economy suffered a drastic 90% decline during the COVID-19 pandemic due to the loss of tourism. Upon learning about this situation, I wanted to find a way to address such challenges, leading to the development of this project.

Professor Yonezawa: The Internet of Realities project focuses on “how to connect different realities.” While connecting Japanese people who share similar realities is important, we found it particularly intriguing and challenging to connect Kenya—a place with one of the most distinct realities from Japan, including its environment and people. This curiosity led to the creation of the “Higashiyama Zoo and Botanical Gardens: Reality of Kenya” project. We traveled to Kenya, held discussions with representatives from the Kenya Tourism Board, and spoke with officials in charge of Kenya’s participation in Expo 2025 in Osaka. Experiencing the breathtaking landscapes of Kenya firsthand inspired me to establish a connection between Kenya and Nagoya. Given that Nagoya has the Higashiyama Zoo and Botanical Gardens, we wanted to create an initiative that connects people in Kenya, visitors at Higashiyama Zoo, and even individuals at home, leading to the concept for this demonstration experiment.

In “Higashiyama Zoo and Botanical Gardens: Reality of Kenya,” we have developed two main experiences. The first is the Kenya Wildlife VR Experience, which not only offers VR footage of Kenyan animals but also enhances immersion by simulating environmental elements like wind and animal textures. Instead of watching different footage individually, visitors experience synchronized visuals together and collaborate in tactile simulations, helping us evaluate whether shared experiences can be enriched through interaction. The second experience is the Safari Game Drive VR, where participants can virtually ride together with friends or family and explore both Higashiyama Zoo and Kenya’s vast natural landscapes.

Students have taken the lead in developing a system that merges Kenya’s Maasai Mara National Reserve with Higashiyama Zoo in a shared VR space, allowing visitors to embark on a journey to discover rare animals together. Until now, understanding someone else’s reality typically required physically entering their environment. For example, when we visit Kenya, we gain an understanding of Kenya while simultaneously reinforcing our own identity as Japanese. However, for Kenyan residents, such a visit does not significantly alter their sense of reality since it is their everyday life. Conversely, when Kenyans visit Japan, they gain insights into their Kenyan identity, but their presence does not necessarily help Japanese people understand Kenya. This dynamic creates an asymmetry. Our goal is to explore ways to enhance the symmetry of such experiences.

A key concept behind this demonstration experiment is to investigate how people from vastly different realities can achieve more symmetrical experiences. We aim to foster the feeling of “having the same experience together.” Have you ever participated in an event remotely and felt disconnected? That is a prime example of asymmetry. To address this, we are striving to create an integrated space combining Kenya and Higashiyama Zoo where participants can enjoy shared experiences. We are also testing additional approaches, such as “MetaPo,” a group telepresence robot that enhances shared presence experiences. (For more information: https://ucl.nuee.nagoya-u.ac.jp/metapo)

Professor Leleito: While the “Higashiyama Zoo and Botanical Gardens: Reality of Kenya” event primarily focuses on animals, Kenyan representatives have expressed interest in showcasing various aspects of Kenya at Expo 2025 beyond just wildlife.

Professor Yonezawa: Kenya is known not only for its wildlife but also for its tea and coffee industries.

Professor Leleito: They also want to highlight Kenya’s well-developed infrastructure. While Kenya is famous for its safaris, local university students study hospitality, including cooking techniques and etiquette for interacting with people. We discussed the idea of using VR to connect Kenyan students with Japanese sushi restaurants for observational learning. This is something we would love to implement in the future.

Emphasizing Enjoying the Present, and the Importance of Information Output

Professor Yonezawa: What I want young people to realize is that “the experiences you are having right now are incredibly valuable.” The daily experiences of children today are something that we adults can never relive. I want them to understand just how precious their present moments are.

Professor Leleito: Additionally, as information technology rapidly evolves, adults need to guide children in using information responsibly, particularly in areas such as privacy. Nowadays, children can easily access advanced technology, so I hope they engage with it in a fun and educational way. Enhancing digital literacy in this manner is crucial.

Professor Yonezawa: Many children today admire the glamorous worlds they see online, but beyond that, I hope they develop their own criteria for evaluating things, enjoy their immediate surroundings more, and recognize the immense value in their current environments. Realizing this early on would contribute to a healthier perspective.

Professor Leleito: Children love playing games, don’t they? I suggest that if they spend 30 minutes playing a game, they should spend another 30 minutes creating one. It’s important not just to consume information but also to have opportunities to produce it, maintaining a balance. I hope adults encourage children to adopt this mindset.

Original article: https://www.matsuzakaya.co.jp/nagoya/promo/fair_event/meidairenkei/

Original article copyright: Matsuzakaya