NPC AI Engine - Dialog, actions, voice and lipsync - Convai

Convai enables AI characters in games and virtual worlds to have human-like conversation capabilities and more. With Convai, developers can add a backstory, knowledge bank, voice, and overall intelligence to their character assets to converse naturally with players and carry out actions.

Convai includes the complete conversation pipeline, which includes Speech Recognition, Language Understanding, and Generation, Text-to-Speech, Text-to-Action, and Lipsync. Convai focuses on bringing characters that are as life-like as possible and can be directed by any developer!

Have questions or need assistance?

Visit the Convai Developer Forum – our dedicated community and support team are here to help with bug reports and technical queries. Get the support you need and connect with other developers to enhance your experience.

Resources:

Getting Started Guide to obtain your API key and setting up Convai SDK in your project.

Documentation to guide you through the plugin's features and capabilities.

Convai Website to create custom characters and try them out.

Partner Page to help join our partner program. While Convai provides a free experience to distribute a product (game or experience) using Convai, you must be a partner or a customer.

Highlights:

• Intelligent real-time open-ended conversation with speech-to-text and voice mode, enabling natural and dynamic interactions.
• Improved response time and support for more LLMs
• Hands-Free Mode for interruptible, realistic conversations with
• Vision support for more context-aware character responses
• Narrative Design for guided story and gameplay flows
• Long-Term Memory (LTM) for highly-contextual character behavior
• Dynamic Info/Context for grounded, reactive interactions
• Improved Lip Sync support for ARKit, Reallusion, and MetaHuman-compatible workflows
• Avatar Integrations: Integrated out-of-the-box with the most popular avatar platforms like Reallusion Character Creator 4. Works with custom characters and popular avatar workflows
• Text or Talk: interact with characters using either text or voice
• AR / VR / MR support, with expanding WebGL workflow support in the same SDK
• Production Ready: The asset can be deployed to hundreds of users (under our commercial agreement).

Why Convai?

• Have open-ended conversations with your intelligent characters!

Our characters are responsive and intelligent. They listen to you and understand you. This gives an engaging and open-ended human-like conversation.

• Give your character an interesting background in seconds!

Use the Convai Website to create a character and give it an interesting backstory. Design the character however you want.

• Bring your characters into your projects in a single step!

With Convai's Unity Plugin, all you need is to copy and paste the character ID and click a button, and your characters will be in your project.

• Well-documented, easy-to-read, and highly customizable code to accommodate any game logic you can think of!

You do not need any code to get started and talk to your character, but if you want to create custom logic for your character, our code is easy and customizable enough for you to know what you need to know. Check out our documentation to get started.

This asset is governed by a custom EULA - find it here.