Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

LM inference server implementation based on *.cpp.

GitHub Copilot API wrapper to make it OpenAI compatible

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT, Gemini, Anthropic or Ollama to enhance email management.

A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

Visual inference exploration & experimentation playground

A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS

duck.ai openai compatible api server

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.

An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK

Demonstrates that Spring AI can be configured to work with OpenRouter so that you can work with multiple LLMs through a single Open AI compatible interface. Potentially helpful when evaluating the performance and quality of model responses.

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

OpenAI compatible ChatBot API template with openapi standard

A Discordjs bot that uses OpenAI compatible endpoints for chatting.

LLM based assistant running as a Telegram Bot.

Tool-based LLM integration with Zenodo via the Model Context Protocol (MCP)