AidGenSE (OpenAI API Compatible)
AidGenSE is the service-oriented version of AidGen. It provides generative AI inference capabilities in the form of an HTTP service, with an interface compatible with the OpenAI API, making it easy for upper-layer applications to connect directly to existing ecosystem tools and clients.
Main Features
| Feature | Description |
|---|---|
| Interface compatibility | Compatible with common interfaces such as OpenAI Chat Completions |
| Multi-model management | Supports loading and switching between multiple local models |
| RAG support | Can be combined with retrieval-augmented generation (RAG) to improve answer quality |
| Manual model upload | Supports manually uploading and configuring model files |
