Tired of tracking a new AI model launch every day? Say no more. GenAI for Unreal is the definitive, production-ready plugin that handles the integration layer for you. Focus on your gameplay, while we provide a stable, unified, and powerful interface to the world's leading AI models. The plugin supports all current cutting edge LLM APIs like the OpenAI's ChatGPT inlcuding the latest O3 and O4 mini, Anthrophic's Claude Sonnet/Opus 4, Google's Gemini 2.5 flash/pro, XAI's Grok 4, 3 and 2, Deepseek's R1 and so on.
Now with Grok 4!! 🎉
Disclaimer
This plugin requires an active API key from at least one of the supported AI providers to function. Please see our documentation for more information on how to obtain API keys.
Key Features:
-
Real-time Text Streaming: ⚡️
Bring your characters to life with dynamic, real-time responses. Our streaming support delivers text in chunks as it's generated, perfect for creating live-narrated dialogue, responsive AI companions, and interactive storytelling without the wait. -
Advanced Chat Completions: 🤖
Power your game with dynamic NPC dialogue, procedural quest generation, and real-time narrative adaptation using models from OpenAI, Anthropic, Google, XAI, and DeepSeek. -
Reasoning Models: 🧠
Leverage the unique "think before you speak" capabilities of models like DeepSeek's R1 and XAI's Grok to generate core narrative components and complex logical outputs. -
Multi-Modal Vision/Text Input: 📸
Allow models to "see" your game. Provide screenshots or other images as direct input along with text, perfect for creating AI-powered spectator commentary, dynamic player guides, or environment-aware NPC interactions. -
Structured JSON Output: ❤️🔥
Reliably get complex JSON responses from any supported model. For example, generating JSON for 100 AI-generated NPCs, each with their own unique stories, race, gender, and name. -
High-Quality Image Generation: 🖼️
Integrate state-of-the-art image generation directly in your workflow with support for OpenAI's DALL-E 2, DALL-E 3, and GPT-Image-1 models. -
Text To Speech (TTS): 🔊
Generate dynamic, high-quality voice lines for in-game dialogue, narration, or live conversations with AI characters using OpenAI's TTS models. -
Audio Transcriptions: 📝
Power in-game voice commands or create interactive conversations by converting player speech to text with OpenAI's Whisper and GPT-4o transcription models. -
Effortless Server Proxying: ☁️
Need to route requests through your own backend for security or custom logic? Our server proxy feature allows you to override API endpoints for any provider with a single setting, giving you complete control over your data flow. -
Secure & Centralized Authentication: 🔐
Manage all your API keys in one secure, centralized settings panel. Our system uses a non-portable, encrypted file to keep your keys safe and separate from your source control. -
Blueprint & C++ Ready: 🔗
Enjoy simple, powerful Blueprint nodes for rapid iteration, and access the same robust, self-managing functions in C++ for maximum performance and control. -
Designed for Cross-Platform: 🌐
The plugin exclusively uses standard, high-level Unreal Engine modules for networking and file management, ensuring it works on all platforms supported by the engine.
Available Integrations & Models
A clean, unified API for the best models available today.
- OpenAI:
- Chat:
gpt-4.1,gpt-4o,gpt-4.1-mini,gpt-4.1-nano,gpt-4o-mini. - Reasoning Models:
o4-mini,o3,o3-pro,o3-mini,o1,o1-pro. - Image Generation:
gpt-image-1,dall-e-3,dall-e-2. - Audio TTS:
gpt-4o-mini-tts,tts-1,tts-1-hd. - Audio Transcription:
gpt-4o-transcribe,gpt-4o-mini-transcribe,whisper-1. - Structured Output (JSON Mode) ✔
- Text Streaming ✔
- Multimodal Chat ✔
- Chat:
- Anthropic:
- Chat:
claude-opus-4,claude-sonnet-4,claude-3-7-sonnet,claude-3-5-sonnet,claude-3-5-haiku. - Multimodal Chat ✔
- Chat:
- XAI:
- Chat:
grok-4,grok-3,grok-3-mini,grok-3-fast,grok-3-mini-fast,grok-2-vision-1212,grok-2-1212. - Reasoning Models:
grok-4,grok-3-mini,grok-3-mini-fast. - Text Streaming ✔
- Multimodal Chat ✔
- Chat:
- Google Gemini:
- Chat:
Gemini 2.5 Flash,Gemini 2.5 Pro. - Text Streaming ✔
- Chat:
- DeepSeek:
- Chat:
deepseek-chat. - Reasoning:
deepseek-reasoner. - Text Streaming ✔
- Chat:
Supported Formats
- Audio:
- Input:
mp3,wav,mp4,mpeg,mpga,m4a,webm. - Output:
pcm.
- Input:
- Voice:
- OpenAI:
alloy,echo,fable,onyx,nova,shimmer.
- OpenAI:
Use Cases:
- Truly Dynamic NPCs: Create characters whose dialogue is generated in real-time based on player actions and world events.
- Procedural Content Generation: Instantly generate rich, coherent content at runtime, from quests and item descriptions to entire lore books.
- AI-Powered Game Masters: Use Vision and Reasoning models to create an AI director that adapts the game world in real-time.
- Interactive Voice-Driven Gameplay: Combine TTS and Transcription for real, spoken conversations with in-game characters.
- Rapid Prototyping & World-Building: Use image generation and structured JSON directly in the editor to rapidly create concept art and vast amounts of world data.
Why Choose This Plugin?
- Constantly Evolving: 🧬 We provide rapid updates to support new models and features from frontier AI companies as soon as they're released.
- Production-Ready and Tested: ⚔️ All features are regularly tested with actual API keys for different use cases and scales. The plugin has been tested for over a year with updates based on user feedback.
- Generic & Adaptable by Design: 🌵 The codebase is built with a clean, generic approach, allowing for rapid adaptation to future models and API changes.
- Built by Developers, for Developers: 💻 With years of professional game development experience, we guarantee a stable, well-documented, and performant implementation.
- Dedicated Support: 📧 Email our support team for any questions or custom modification requests. We are happy to assist.
Resources & Support
- Documentation
- Professional Support & Custom Development: For tailored solutions, feature requests, or enterprise support, contact our team directly at: [email protected]