AI Runner: Local AI Inference Engine for Art, Voice, and Chatbots

AI Runner: Local AI Inference Engine for Art, Voice, and Chatbots

Category: Deep Learning
License: Apache-2.0
Model Type: Generative AI
AI Runner is an open-source application that enables users to run AI models locally on their hardware, facilitating the generation of images, real-time voice conversations, and the creation of customizable chatbots. It integrates various AI models, including Stable Diffusion, Kandinsky, and Mistral, to provide a comprehensive suite of tools for creative and conversational AI tasks.

Key Features

  • Image Generation & Editing: Supports multiple versions of Stable Diffusion (1.5, SDXL 1.0, SDXL Turbo) for high-quality image generation. Includes features like inpainting, outpainting, and image filters.
  • Voice Interaction: Real-time voice conversations with LLM-powered chatbots, utilizing speech-to-text and text-to-speech capabilities.
  • Customizable Chatbots: Create chatbots with unique personalities, names, and moods. Supports Retrieval-Augmented Generation (RAG) for enhanced responses.
  • Privacy-Focused: Operates entirely offline by default, ensuring user data remains private.
  • Multi-Language Support: Partial support for multiple languages in text-to-speech, speech-to-text, and user interface.
  • Performance Optimizations: Optimized for performance with features like accelerated transformers and memory enhancements.
  • Extensibility: Offers an extension API and Python library for developers to build upon.