Gradio config: pre-sets

Prebuild config settings for several Large Language Models and providers

Import statements

Config for Together.ai server with Llama-3.3-70B instruct free model

This is a free model, but it has limited context length compared to the paid version of the same model.

model_togetherai_llama33_70b_free = ModelConfig(
    model_name="meta-llama/Llama-3.3-70B-Instruct-Turbo-Free",
    provider="togetherai",
    api_key_env_var="TG_API_KEY"
)

Config for local Ollama server with ministral-8b-instruct

model_ollama_ministral = ModelConfig(
    model_name="nchapman/ministral-8b-instruct-2410",
    provider="ollama"
)