Earticle

초록

영어

Collecting large amounts of data in the real world is expensive and has clear limitations. Simulation-generated environments, on the other hand, offer the opportunity to efficiently generate the necessary data and to try different things easily and quickly. In this research, we utilized one of the tools that addresses these challenges, by the Unity Machine Learning tool, to study an efficient automation model that responds to the characteristics of the rogue-like genre. For testing purposes, we implemented a simple game, implanted an agent into the main character of the game, and fed the agent with code to shoot and avoid hostile. The implemented ML Agent successfully recognized the hostile targets and responded by shooting and dodging them. However, instead of learning to prioritize the hostile targets over time by reinforcing itself and shooting the high-risk targets first, it consistently fired in only one of the 360-degree directions given to it at the beginning, which we didn’t expected, so we improved the code. By utilizing the RayPerceptionSensor-Component2D element to directly feed the agent's sensors with information about hostile targets, we found that the agent was able to utilize its ray sensor to detect them and make much more precise aimed shots. In fact, it outperformed the original model by an average of 3.81x, proving that Unity ML Agentcan collect data through reinforcement learning in the roguelike genre.

한국어

실제세계에서 데이터 수집의 비용과 한계를 고려할 때, 시뮬레이션 생성 환경은 데이터 생성 과 다양한 시도에 있어 효율적인 대안이다. 이 연구에서는 Unity ML Agent를 로그라이크 장 르에 적합한 강화학습 모델로 구현하였다. 간단한 게임에Agent를 이식하고, 이 Agent가 적을 인식하고 대응하는 과정을 코드로 작성하였다. 초기 모델은 조준사격의 한계를 보였으나 RayPerceptionSensor-Component2D를 통해 Agent의 센서 정보를 직접 제공함으로써, Agent가 적을 감지하고 조준 사격을 하는 능력을 관찰할 수 있었다. 결과적으로, 개선된 모델 은 평균3.81배 향상된 성능을 보여주었으며, 이는 Unity ML Agent가 로그라이크 장르에서 강화학습을 통한 데이터 수집이 가능함을 입증한다.

목차

ABSTRACT
1. Introduction
1.1 Unity Machine Learning Agents
1.2 Genre Characteristics of Rogue-like Games
1.3 Potential Applications in Rogue-like
2. Related Research
2.1 Comparing the performance of reinforcement learning algorithms ina 2D Rogue-like game using Unity ML-Agents
2.2 Reinforcement learning and applying the A3C algorithm using Unity 3D and the ML-Agents Toolkit
3. Environment Implement
3.1 Feature Improvements and Final Experiments
4. Conclusion
Reference
<국문초록>
<결론 및 향후 연구>

키워드

저자

• Se Yeon KIM [ 김세연 | Department of Game Design and Development, Sangmyung University ]
• Mu Jip KIM [ 김무집 | Department of Game Design and Development, Sangmyung University ]
• Seok-Kyoo KIM [ 김석규 | Department of Game Design and Development, Sangmyung University ] Corresponding Author

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  컴퓨터게임및콘텐츠논문지(구 한국컴퓨터게임학회논문지) [Journal of Computer Games and Contents]

• 간기

  월간

• pISSN

  3091-7409

• eISSN

  3092-3638

• 수록기간

  2002~2026

• 등재여부

  KCI 등재

• 십진분류

  KDC 691 DDC 793