OpenAI-Compatible Integration
Connect Sypha to any AI provider that utilises the OpenAI-standard API protocol, including local and specialized cloud services.
OpenAI-Compatible Integration
Sypha offers a "universal bridge" to any AI service that adheres to the OpenAI-standard API protocol. This empowers you to utilise specialized models from providers beyond the primary registries, including:
- Local Inference Engines: Like Ollama or LM Studio.
- Specialized Cloud Rigs: Such as Perplexity, Together AI, or Anyscale.
- Enterprise Gateways: Custom internal AI proxies or self-hosted deployments.
[!NOTE] This guide focuses on third-party compatible services. For the official OpenAI platform, refer to the Dedicated OpenAI Guide.
Core Configuration Parameters
To bridge a compatible provider, you must define three primary variables:
- Base Service URL: The unique endpoint provided by your service (e.g.,
https://api.together.xyz/v1). - Service API Key: Your authenticated secret provider key.
- Model Identifier: The specific engine name recognized by your provider.
Implementation Steps
- Open Workspace Config: Select the gear icon in the Sypha panel.
- Set Registry: Choose OpenAI Compatible from the provider menu.
- Define the Base URL: Critical: Ensure this points to the provider's specific V1 endpoint.
- Credential Entry: Insert your provider-specific API key.
- Calibrate Model Specifics: Customize advanced parameters if required:
- Maximum Token Output
- Context Window Capacity
- Multi-modal Support (Image/Vision)
- Fiscal Metrics (Input/Output rates)
Advanced Endpoint Flexibility
Sypha supports both standard base paths and full terminal URLs for greater flexibility:
- Standard Mapping:
https://api.service.com/v1 - Granular Mapping:
https://your-custom-proxy.internal/api/v2/chat/completions
Common Resolution Steps
- Credential Mismatch: verify the key format aligns with the provider's expectations.
- Endpoint Reachability: Ensure your development environment can communicate with the provided Base URL (especially for local or VPN-restricted services).
- ID Verification: Reference your provider's documentation to ensure the Model ID is typed exactly as required (e.g.,
mistral-tinyvsMistral-Tiny).
Sypha allows for an unlimited number of OpenAI-compatible configurations, enabling you to switch between local, private, and specialized cloud engines within seconds.