Skip to main content

Module llm_provider

Module llm_provider 

Source
Expand description

§LLM Provider Module

Thread-safe LLM provider abstraction for multi-agent use. Wraps genai::Client with Arc<RwLock<>> for shared state.

Structs§

GenAIProvider
Thread-safe LLM provider implementation using Arc<RwLock<>>.
LlmResponse
Response from a non-streaming LLM call, carrying text and token usage.

Constants§

EOT_SIGNAL
End of transmission signal