Interface for LLM (Large Language Model) providers.
Implementations provide access to AI models like GPT-4, Claude, etc.
class OpenAIProvider implements LLMProvider { readonly name = 'openai'; readonly models = ['gpt-4', 'gpt-4-turbo', 'gpt-3.5-turbo']; async chat(params: ChatParams): Promise<ChatResponse> { // Call OpenAI API }} Copy
class OpenAIProvider implements LLMProvider { readonly name = 'openai'; readonly models = ['gpt-4', 'gpt-4-turbo', 'gpt-3.5-turbo']; async chat(params: ChatParams): Promise<ChatResponse> { // Call OpenAI API }}
Sends a chat completion request
Chat parameters
The chat completion response
Streams a chat completion response
Async iterable of chat chunks
Generates embeddings for the given input
Embedding parameters
The embedding vectors
Readonly
Unique name of the provider (e.g., 'openai', 'anthropic', 'local')
List of supported models
Interface for LLM (Large Language Model) providers.
Implementations provide access to AI models like GPT-4, Claude, etc.
Example