Researchers from Gwangju Institute of Science and Technology Develop an Intelligent Observer for Esports

Ad blocking detected

Thank you for visiting We have detected you cannot see ads being served on our site due to blocking. Unfortunately, due to the high cost of data, we cannot serve the requested page without the accompanied ads.

If you have installed ad-blocking software, please disable it (sometimes a complete uninstall is necessary). Private browsing Firefox users should be able to disable tracking protection while visiting our website. Visit Mozilla support for more information. If you do not believe you have any ad-blocking software on your browser, you may want to try another browser, computer or internet service provider. Alternatively, you may consider the following if you want an ad-free experience.

Canadian Insider Ultra Club
$500/ year*
Daily Morning INK newsletter
+3 months archive
Canadian Market INK weekly newsletter
+3 months archive
30 publication downloads per month from the PDF store
Top 20 Gold, Top 30 Energy, Top 40 Stock downloads from the PDF store
All benefits of basic registration
No 3rd party display ads

* Price is subject to applicable taxes.

Paid subscriptions and memberships are auto-renewing unless cancelled (easily done via the Account Settings Membership Status page after logging in). Once cancelled, a subscription or membership will terminate at the end of the current term.

Researchers from Gwangju Institute of Science and Technology Develop an Intelligent Observer for Esports

PR Newswire

It utilizes an object detection algorithm that learns human spectating data to find engaging viewports

GWANGJU, South Korea, Nov. 25, 2022 /PRNewswire/ -- Human game observers are a vital part of the Esports industry. They use extensive domain knowledge to decide what to show to the spectators. However, they may miss important events, necessitating the need for automatic observers. Researchers from South Korea have recently proposed a framework that utilizes an object detection method, Mask R-CNN, and human observational data to find the 'Region of Common Interest' in StarCraft—a real-time strategy game.

Esports, already a billion-dollar industry, is growing, partly because of human game observers. They control the camera movement and show spectators the most engaging portions of the game screen. However, these observers might miss significant events occurring concurrently across multiple screens. They are also difficult to afford in small tournaments. Consequently, the demand for automatic observers has grown. Artificial observing methods can either be rule-based or learning-based. Both of them predefine events and their importance, necessitating extensive domain knowledge. Moreover, they cannot capture undefined events or discern changes in the significance of the events.

Recently, researchers from South Korea, led by Dr. Kyung-Jong Kim, Associate Professor in Gwangju Institute of Science and Technology, have proposed an approach to overcome these problems. "We have created an automatic observer using object detection algorithm, Mask R-CNN, to learn human spectating data," explains Dr. Kim. Their findings were made available online on 10 October 2022 and published in Volume 213 Part B of Expert Systems with Applications journal.

The novelty lies in defining the object as the two-dimensional spatial area viewed by the spectator. In contrast, conventional object detection treats a single unit, for instance, a worker or a building, as the object. In this study, the researchers first collected StarCraft in-game human observation data from 25 participants. Next, the viewports—areas viewed by the spectator—were identified and labeled as "one." The rest of the screen was filled with "zeroes." While the in-game features are used as input data, the human observations constituted the target information.

The researchers then fed the data into the convolution neural network (CNN), which learnt the patterns of the viewports to find the "region of common interest" (ROCI)—the most exciting area for the spectators to watch. They then compared the ROCI Mask R-CNN approach with other existing methods quantitatively and qualitatively. The former evaluation showed that CNN's predicted viewports were similar to the collected human observational data. Additionally, the ROCI-based method outperformed others in the long run during the generalization test, which involved different matchup races, starting locations, and playing maps. The proposed observer was able to capture the scenes of interest to humans. In contrast, it could not be done by behavior cloning—an imitation learning technique.

Dr. Kim points out the future applications of their work. "The framework can be applied to other games representing some of the overall game state, not only StarCraft. As services such as multi-screen transmission continue to grow in Esports, the proposed automatic observer will play a role in these deliverables. It will also be actively used in additional content developed in the future."


Title of original paper: Learning to automatically spectate games for Esports using object detection mechanism

Journal: Expert Systems with Applications         

*Corresponding author's email: [email protected]

About the Gwangju Institute of Science and Technology (GIST)

Chang Sung Kang
82 62 715 6253
[email protected]

Cision View original content to download multimedia:

SOURCE Gwangju Institute of Science and Technology

Copyright CNW Group 2022

Comment On!

Upload limit is up to 1mb only
To post messages to your Socail Media account, you must first give authorization from the websites. Select the platform you wish to connect your account to (via Easy Blurb).