Video thumbnail

RexDeus

AI Agent for Unreal Engine! Our plugin powers dynamic NPCs using OpenAI, AgentKit, and Autonom, enabling real-time player interaction, game world control, and enhanced immersion.

RexDeus

Created At

Agentic Ethereum

Winner of

Coinbase Developer Platform - AgentKit Pool Prize

Prize Pool

Project Description

Our project proposes a new industry standard for seamlessly integrating AI into Unreal Engine, enabling sophisticated AI Agents to function as dynamic NPCs within game environments. We aim to develop an Unreal Engine plugin that acts as a client capable of interfacing with any Unreal Engine project. The core objective is to empower AI agents with advanced behavior, ranging from interaction with players to autonomous decision-making, ultimately enhancing gaming ecosystems by mitigating issues like cheating and exploitative tactics.

This initiative introduces two core AI components: Mother AI and Baby AI.

Mother AI: The central authority controlling the game's procedural elements, such as time cycles, difficulty, item generation, and weather. It governs Baby AI while maintaining distinct data sets for global control.

Baby AI: These are the interactive NPCs with individual memory, statistics, and emotional traits. They can serve various roles—companions, merchants, or adversaries. Players can engage with Baby AI in numerous ways, including forming alliances or rivalries, acquiring game items, and negotiating in-game strategies.

How it's Made

Our project leverages several key technologies to build an advanced AI integration for Unreal Engine:

Unreal Engine: We are developing a plugin to integrate AI agents as NPCs directly into the game environment. This plugin facilitates real‑time communication between the AI agents and Unreal projects.

AgentKit: We use AgentKit to develop and manage our AI agents, giving each agent a programmable on‑chain wallet and a suite of blockchain actions (such as NFT minting). This allows each agent to have its own unique attributes—including memory, emotional traits, and behaviors—without needing to reinvent blockchain interactions.

OpenAI LLM Model: The OpenAI large language model interprets player input, transforming natural language into structured commands. This enables dynamic, context‑aware conversations with the AI agents, allowing NPCs to respond adaptively and offer in‑game advice or challenges.

EigenLayer: We integrate EigenLayer to secure and validate our on‑chain operations. Instead of relying solely on restaking, our AI agents (or their associated wallets) are automatically registered as operators on EigenLayer. This process provides decentralized economic security and trust by ensuring that every smart NPC’s on‑chain identity is verified by a network of trusted operators.

Autonome: Autonome hosts our fully integrated AI agent solution, providing production‑ready infrastructure with TEE plug‑ins for verifiability and enhanced security. It enables seamless management and scaling of multiple agents and their interactions within the gaming ecosystem.

background image mobile

Join the mailing list

Get the latest news and updates