AWS Bedrock Cross-region Inference Support

[samDobsonDev]

Hi all, how does Koog handle AWS Bedrock cross-region inference support, particularly when using models that require inference profiles? I'm trying to use BedrockModels.AnthropicClaude4Sonnet and I'm getting this error:

Invocation of model ID anthropic.claude-sonnet-4-20250514-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.
ValidationException(message=Invocation of model ID anthropic.claude-sonnet-4-20250514-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.)

Was just wondering how I can modify the ID of the model to be prefixed with inference profile ARN

[samDobsonDev]

This is the code inside BedrockLLMClient preventing me from contacting Bedrock:

// BedrockLLMClient.kt
internal fun getBedrockModelFamily(model: LLModel): BedrockModelFamilies {
    require(model.provider == LLMProvider.Bedrock) { "Model ${model.id} is not a Bedrock model" }
    return when {
        model.id.startsWith("anthropic.claude") -> BedrockModelFamilies.AnthropicClaude
        model.id.startsWith("amazon.nova") -> BedrockModelFamilies.AmazonNova
        model.id.startsWith("ai21.jamba") -> BedrockModelFamilies.AI21Jamba
        model.id.startsWith("meta.llama") -> BedrockModelFamilies.Meta
        else -> throw IllegalArgumentException("Model ${model.id} is not a supported Bedrock model")
    }
}

This is because for my inference profile to work I have to manually prefix the model ID with "eu." by creating my own LLModel like:

public val AnthropicClaude4SonnetWithInferenceProfile: LLModel = LLModel(
    provider = LLMProvider.Bedrock,
    id = "eu.anthropic.claude-sonnet-4-20250514-v1:0",
    capabilities = listOf(
        LLMCapability.Temperature,
        LLMCapability.Completion,
        LLMCapability.Tools,
        LLMCapability.ToolChoice,
        LLMCapability.Schema.JSON.Full,
        LLMCapability.Vision.Image
    )
)