This blog post explores how Pokémon GO used augmented reality technology to enable catching Pokémon in the real world.
Have you heard of the Pokémon game? This game has gained immense popularity worldwide. Its core gameplay involves traveling through the game’s world, catching diverse creatures called ‘Pokémon,’ training them, and embarking on adventures. Since its initial release in 1996, Pokémon has evolved across multiple generations into various series. It has expanded beyond games into anime, card games, movies, and other media, amassing a vast fanbase. Notably, the game enjoys immense popularity not only among children but also adults, becoming a cultural phenomenon that transcends generations.
So, what if you could actually catch the Pokémon from this game in the real world? There is a game that actually made this a reality. The recently wildly popular Pokémon GO is the star of the show. This game allows you to check your surroundings via your smartphone, where Pokémon appear on the screen and can be captured. Pokémon GO caused a huge global sensation upon its release, and it was common to see countless people roaming parks, streets, and even historical sites to catch Pokémon. This game went beyond simple entertainment, offering people a new form of social experience while also being an innovative attempt to blur the boundaries between the real world and the virtual.
How was this made possible? To answer this, we’ll explore a somewhat unfamiliar technology called ‘augmented reality’. The concept most easily associated with, and often confused with, the term ‘augmented reality’ is ‘virtual reality’. Virtual reality is a technology that creates a completely virtual space—a space separate from reality—through displays and other means. For example, wearing a virtual reality headset makes you feel as if you are in a completely different world.
However, augmented reality, as the term suggests, overlays virtual information onto the physical space the user sees, synthesizing it. It differs in that it utilizes the real-world environment rather than a virtual space. An example of augmented reality is synthesizing Pokémon, which do not exist in the real world, with real-world images to display them on a smartphone screen. This makes it appear as if Pokémon are appearing in the actual space where the user is standing, providing an experience where Pokémon seem to exist in the real world. Another example is an application that displays information, such as nearby shops, on the screen when the user takes a photo of their surroundings with the camera.
A clear definition of augmented reality was established by Ronald Azuma. The definition states that augmented reality must combine real-world images with virtual images, enable real-time interaction, and be situated within a three-dimensional space. This definition has become an increasingly accepted standard among researchers alongside technological advancements and serves as a crucial guideline across various augmented reality applications.
The history of augmented reality technology is relatively short; it is a technology that has only recently begun to develop. Research started with the Head Mounted Display (HMD) developed by Ivan Edward Sutherland in 1968. Then, in 1990, Tom Caudell first used the term ‘augmented reality’ to assist in the process of assembling aircraft wiring. Since then, it has evolved into the technology we have today. The development of augmented reality was achieved through the convergence of various technologies, including display technology, sensor technology, and computer vision technology. In particular, the emergence and advancement of smartphones played a crucial role in popularizing augmented reality technology.
There are three key technical factors for implementing augmented reality. First is marker recognition technology, which is used to display virtual images or information at specific locations. To accurately display images or information, the precise location must be determined within the video feed captured by the camera. However, determining three-dimensional coordinates using only a single camera is extremely difficult. To solve this, marker recognition technology uses markers—relative coordinate indicators—to establish a reference point where images and other content are then composited. Simply put, it’s the technology that sets the location where Pokémon appear in Pokémon GO by placing markers at those spots, so that when you point your phone camera there, the Pokémon appear on the display. With recent technological advancements, markerless tracking technology is also being developed, which can determine relative coordinates within the video feed without needing physical markers. This technology is a crucial element for creating a more natural and immersive user experience, holding significant potential for future applications.
Second, image compositing technology is required to integrate information into the video. When information about a Pokémon’s appearance is generated, technology is needed to combine the image and information so it can be viewed on the phone; this is the role of image compositing technology. During this synthesis process, rendering errors, static errors, and dynamic errors can occur. Therefore, calibration is performed using methods such as camera calibration equipment and 3D position sensors, as well as vision-based methods. The technical precision in this process is a critical factor determining how realistically users can experience augmented reality.
Finally, there is the display technology that presents the generated images to the user. This is broadly categorized into HMD, Non-HMD, and Hand-Held types. HMDs were the initial form, being head-mounted display devices. However, for user convenience, they have evolved into Non-HMD devices, and recently, the trend is shifting towards Hand-Held display methods. Smartphones, which integrate GPS, displays, and cameras into a single device, are particularly optimal for implementing augmented reality. This development has significantly increased AR’s accessibility, creating an environment where anyone can easily experience augmented reality. As smartphones become widely adopted, augmented reality technology is also gaining considerable attention and producing tangible results like Pokémon GO.
Augmented reality technology is already being utilized in numerous fields. In gaming, it’s applied in games like Ingress and Pokémon GO, while its potential is expanding across diverse sectors including education, healthcare, tourism, and marketing. For instance, in education, augmented reality serves as a tool to help students visually understand complex scientific concepts. In healthcare, it provides critical information in real-time during surgical procedures. Automotive manufacturers like Germany’s BMW and Renault are also adopting it. This technology is used in simulations during the car design process, allowing designers to experiment with structure, color, and positioning without creating full-scale physical samples. Additionally, in Korea, a service called virtual fitting has been developed, allowing users to try on clothes virtually using augmented reality without physically trying them on. In this way, augmented reality is permeating various areas of daily life, and its range of applications is steadily expanding.
While augmented reality holds immense potential across diverse fields, it currently faces significant requirements, such as advancements in camera technology. If augmented reality technology becomes commercialized and deeply integrated into our lives, we can imagine living more convenient and smarter lives. The potential of augmented reality is limitless, and with future technological developments, we will experience a new dimension of reality unlike anything we’ve known before.
