Runtime AI Chatbot Integrator (ElevenLabs, OpenAI, DeepSeek, Claude) +TTS

Seamlessly integrate cutting-edge AI chatbots into your Unreal Engine projects!

ℹ️ Note: The images with text-to-speech examples were created using the Runtime Audio Importer plugin. So, to follow these examples, you will need to install that plugin as well. However, you can also implement your own audio handling solution without using it. For text-to-text functionality, the Runtime Audio Importer is not required.

Transform your games and applications with powerful AI conversation capabilities and natural-sounding speech using the most advanced language models available today. This plugin provides direct access to OpenAI's GPT models, Anthropic's Claude, DeepSeek's advanced reasoning models, plus high-quality TTS from OpenAI and ElevenLabs - all through simple Blueprint nodes!

✨ Key features:

• Multiple AI Providers: Connect to OpenAI, Claude, and DeepSeek through their official APIs

• Latest Models Supported: Access cutting-edge models including GPT-4o, Claude 3.7 Sonnet, and DeepSeek Reasoner

• Flexible Response Handling: Choose between complete responses or real-time streaming (chunk by chunk)

• Advanced Streaming TTS: Get audio chunks as they're generated for OpenAI and ElevenLabs, enabling immediate playback while synthesis continues

• Blueprint Ready: Simple nodes for immediate integration without C++ coding

• Cross-Platform: Works on all platforms supported by Unreal Engine (Windows, Android, Meta Quest, Mac, iOS, Linux, and more)

• Easy Authentication: Simple API key management for all services

Text chat models:

OpenAI:

• GPT-3.5 Turbo

• GPT-4o

• GPT-4o Mini

• GPT-4-32k

• GPT-4 Turbo

• O1

• O1 Mini

• O3 Mini

Claude (Anthropic):

• Claude 3.7 Sonnet

• Claude 3.5 Sonnet

• Claude 3.5 Haiku

• Claude 3 Opus

DeepSeek:

• DeepSeek Chat

• DeepSeek Reasoner (with dedicated reasoning output)

Text-to-Speech voices:

OpenAI TTS:

• Alloy, Ash, Ballad, Coral, Echo

• Fable, Onyx, Nova, Sage, Shimmer, Verse

ElevenLabs TTS:

• Eleven Multilingual V2

• Eleven Monolingual V1

• Eleven Turbo V2

• Eleven Turbo V2.5

• Eleven Flash V2.5

💡 Perfect for:

• Interactive NPCs with intelligent conversations and voices

• In-game assistants and guides that speak naturally

• Creative content generation and narration on-the-fly

• Educational applications with AI tutoring and spoken instructions

• AI-driven gameplay mechanics with voice feedback

• Virtual companions with personality expressed through text and speech

• Voice-overs and dialogue generated dynamically

Note: API usage requires accounts with respective services (OpenAI, Anthropic, DeepSeek, ElevenLabs) and may involve usage costs from these providers.

Technical Details

This plugin provides seamless integration with leading AI language models (OpenAI, Claude, DeepSeek) and TTS models (OpenAI, ElevenLabs) through their official APIs directly in Unreal Engine.

Features:

• Direct API connections to ElevenLabs, OpenAI, Anthropic Claude, DeepSeek services

• Support for multiple response modes (complete responses and chunk-by-chunk streaming)

• Blueprint-friendly implementation with simple node-based setup

• Comprehensive model support across all providers (GPT, Claude, DeepSeek)

• Specialized handling for DeepSeek Reasoner outputs with separate reasoning and chat responses

• Configurable request parameters (temperature, max tokens, system prompts)

• Cross-platform compatibility

• Simple API key management

• Error handling and response validation

• No additional dependencies required beyond the plugin itself