Heavy Tests #1271
Annotations
4 errors
|
MultipleLLMPromptExecutorIntegrationTest.[2] model=LLModel(provider=ai.koog.prompt.llm.GoogleLLMProvider@f538bed, id=gemini-embedding-001, capabilities=[Embed], contextLength=2048, maxOutputTokens=null)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L288
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient
Error from client: GoogleLLMClient
Status code: 429
Error body:
{
"error": {
"code": 429,
"message": "Resource exhausted. Please try again later. Please refer to https://cloud.google.com/vertex-ai/generative-ai/docs/error-code-429 for more details.",
"status": "RESOURCE_EXHAUSTED"
}
}
|
|
MultipleLLMPromptExecutorIntegrationTest.[2] model=LLModel(provider=ai.koog.prompt.llm.AnthropicLLMProvider@13ecd713, id=claude-haiku-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion, Basic, Standard, Thinking], contextLength=200000, maxOutputTokens=64000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L246
org.opentest4j.AssertionFailedError: "i can see you've attempted to send an image, but the image appears to be either extremely small, blank, or failed to load properly. i'm seeing what looks like a tiny colored dot or a failed image load.
could you please:
***. **re-upload the image** - try sending it again
2. **check the image file** - make sure it's not corrupted
3. **provide more details** - tell me what the image is supposed to show, so i can better assist you
once i can see a clear image, i'll be happy to provide a detailed analysis of its content!" should include substring "test"
expected:<test> but was:<i can see you've attempted to send an image, but the image appears to be either extremely small, blank, or failed to load properly. i'm seeing what looks like a tiny colored dot or a failed image load.
could you please:
***. **re-upload the image** - try sending it again
2. **check the image file** - make sure it's not corrupted
3. **provide more details** - tell me what the image is supposed to show, so i can better assist you
once i can see a clear image, i'll be happy to provide a detailed analysis of its content!>
|
|
MultipleLLMPromptExecutorIntegrationTest.[1] model=LLModel(provider=ai.koog.prompt.llm.OpenAILLMProvider@30abfa87, id=gpt-5.4, capabilities=[Completion, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses, Basic, Standard, Thinking], contextLength=1050000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L246
org.opentest4j.AssertionFailedError: "sure — please send the image url, and i’ll analyze its content." should include substring "test"
expected:<test> but was:<sure — please send the image url, and i’ll analyze its content.>
|
|
multiple-llm-executor-tests
Process completed with exit code ***.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
reports-ubuntu-latest-agent-tests
|
465 KB |
sha256:2dda47dbdada13d6039a889b93713ffe9bd09d99ce6e4cecd02319321ca2a17b
|
|
|
reports-ubuntu-latest-anthropic-schema-test
|
335 KB |
sha256:b916fcb1de843014cee57f27f460f3c0adbe1c4562e8d93edea0d06a17f0118a
|
|
|
reports-ubuntu-latest-bedrock-tests
|
332 KB |
sha256:15ac0a8c120e8d9c91cb22af97e294e164be82efaae94ac3e376c69a79909260
|
|
|
reports-ubuntu-latest-capabilities-tests
|
351 KB |
sha256:c64e63b7db6faa6bf04de4787b47f3625d2f2a570cb84d997bf7099cf7e46f75
|
|
|
reports-ubuntu-latest-embeddings-test
|
328 KB |
sha256:95da61f131cc4287328fd35a2683e7ae5274e21954af4055dae90faa1379a37c
|
|
|
reports-ubuntu-latest-java-api-tests
|
403 KB |
sha256:523af0301b182fea46da1816818825613f27a3a107e6bc9ae7c53f6de6cf21a6
|
|
|
reports-ubuntu-latest-multiple-llm-executor-tests
|
400 KB |
sha256:6969901ccca850cb9749d2b4d71d8095d80339c2a65962dc0ce6eee705632c99
|
|
|
reports-ubuntu-latest-other-executor-tests
|
377 KB |
sha256:285d1d0dab31b994ef25c878f5ddbcfa1d84fe10473f416cf9e99ab55432b2cb
|
|