Groq provider support.

[snande]

Is there any ETA on when Groq as a provider would be supported by Koog.
Is there any way to use it right now?
I am really interested in using the openai/gpt-oss-120b models being provided by Groq in my Kotlin projects.
https://console.groq.com/docs/model/openai/gpt-oss-120b

[Ololoshechkin]

Hi! Thanks for your question!

We're planning to add Groq support this year.

In the meantime, as far as I can see, Groq is OpenAI compatible (https://console.groq.com/docs/openai) so please feel free to try implementing the AbstractOpenAILLMClient or even using, for example, existing OpenAILLMClient - if you don't need the custom Groq-specific chat parameters.

Then, you'll only need to create your own instance of LLModel :

val GptOss120B: LLModel = LLModel(
        provider = LLMProvider.OpenAI,      // actually, it's better to create a separate instance of `Groq`, but it should work without it
        id = "openai/gpt-oss-120b",
        capabilities = standardCapabilities, // please check what other capabilities your model supports, and add them to the list here if needed
        contextLength = 131_072,
        maxOutputTokens = 131_072
)

[snande]

Thanks @Ololoshechkin, I will try this out.

[adamglin0]

@snande Here is my code.

val LLMProvider.Companion.Groq by lazy {
    object : LLMProvider("groq", "groq") {}
}

object GroqModels {
    val Kimi_K2_Instruct_0905 = LLModel(
        provider = LLMProvider.Groq,
        id = "moonshotai/kimi-k2-instruct-0905",
        contextLength = 262_144,
        maxOutputTokens = 16_384,
        capabilities = fullCapability
    )
}

update

val groqClient = OpenAILLMClient(
    apiKey = System.getenv("GROQ_API_KEY"),
    settings = OpenAIClientSettings(
        baseUrl = System.getenv("GROQ_OPENAI_URL"),
    )
)

[snande]

Thank you @adamglin0