Internal only change.#1560
Closed
copybara-service[bot] wants to merge 1157 commits intomainfrom
Closed
Conversation
LiteRT-LM-PiperOrigin-RevId: 856271008
LiteRT-LM-PiperOrigin-RevId: 856697433
**Problems**: 1. engine selection logic is duplicated in multiple places. 2. not all targets use the selection logic. The selection flag works only for some targets, confusing developers. 3. This leads to issues like duplicated symbols (CL/856236129) and building the unexpected engine. **Changes** - Create a target ":engine_impl_selected" to select the implementation - Migrate selection logic and hardcoded implementation to ":engine_impl_selected" - limit the visibility of existing engine implementations LiteRT-LM-PiperOrigin-RevId: 856697765
LiteRT-LM-PiperOrigin-RevId: 856733960
LiteRT-LM-PiperOrigin-RevId: 856790867
LiteRT-LM-PiperOrigin-RevId: 856870697
**New capabilities**:
1. allow creating conversation with initial messages.
2. new simplified sendMessage and sendMessageAsync.
**Changes**:
- Define enum Role {SYSTEM, USER, MODEL}
- Add Role to "Message" class.
- Add `initialMessages` to `ConversationConfig` to set the init messages
- Add new sendMessage*() with text and list of contents
- Deprecate the systemMessage since it is covered by initialMessages.
- Deprecate Message.of factory methods. Favor the new system/user/model factory methods.
LiteRT-LM-PiperOrigin-RevId: 857227983
1. mention FunctionGemma 2. update sendMessage signatures missed in previous change. LiteRT-LM-PiperOrigin-RevId: 857262567
LiteRT-LM-PiperOrigin-RevId: 857335054
LiteRT-LM-PiperOrigin-RevId: 857350704
LiteRT-LM-PiperOrigin-RevId: 857357241
LiteRT-LM-PiperOrigin-RevId: 857423226
Follow the set_* pattern to make it scalable instead of adding all value to the single C function. LiteRT-LM-PiperOrigin-RevId: 857689534
LiteRT-LM-PiperOrigin-RevId: 858607999
LiteRT-LM-PiperOrigin-RevId: 858656280
LiteRT-LM-PiperOrigin-RevId: 858718908
LiteRT-LM-PiperOrigin-RevId: 858742888
LiteRT-LM-PiperOrigin-RevId: 858748258
LiteRT-LM-PiperOrigin-RevId: 858802033
LiteRT-LM-PiperOrigin-RevId: 858833664
LiteRT-LM-PiperOrigin-RevId: 859090887
Jetson doesn't have std::logf(). Use std::log(static_cast<float>()) instead. LiteRT-LM-PiperOrigin-RevId: 859148505
- Transpose mask in input handling for fixed gpu kernel size - Fix exported symbols from libLiteRt.so on linux_arm64 LiteRT-LM-PiperOrigin-RevId: 859164020
LiteRT-LM-PiperOrigin-RevId: 859247355
Currently, tools could be implemented with Kotlin functions only. It is easy to use but does not give developer the full control over the tools spec. For users who need fine-grained control over the tool description and execution, they can use the new `OpenApiTool` now. For examples how to implement it, see the `README.md`. LiteRT-LM-PiperOrigin-RevId: 859271963
- Last sampler shlibs have some regressions LiteRT-LM-PiperOrigin-RevId: 859350407
LiteRT-LM-PiperOrigin-RevId: 859642028
When context length is big, it increase init time noticeably, e.g. 8s when context length = 32k for gemma3-1b. LiteRT-LM-PiperOrigin-RevId: 859666933
LiteRT-LM-PiperOrigin-RevId: 859770885
LiteRT-LM-PiperOrigin-RevId: 859859182
LiteRT-LM-PiperOrigin-RevId: 877415471
Add x86_64-linux-android to supported platforms in WORKSPACE. Update cargo-bazel-lock.json to reflect the platform changes and dependency resolution. LiteRT-LM-PiperOrigin-RevId: 877443693
LiteRT-LM-PiperOrigin-RevId: 877456830
LiteRT-LM-PiperOrigin-RevId: 877463951
LiteRT-LM-PiperOrigin-RevId: 877486313
LiteRT-LM-PiperOrigin-RevId: 877536707
Implement patchify for stb image processor Support map of TensorBuffers in InputImage. LiteRT-LM-PiperOrigin-RevId: 877682820
LiteRT-LM-PiperOrigin-RevId: 878014141
LiteRT-LM-PiperOrigin-RevId: 878052506
LiteRT-LM-PiperOrigin-RevId: 878095579
LiteRT-LM-PiperOrigin-RevId: 878143704
LiteRT-LM-PiperOrigin-RevId: 878182837
LiteRT-LM-PiperOrigin-RevId: 878195871
Support end of vision tflite model in executors LiteRT-LM-PiperOrigin-RevId: 878252087
Integrate model downloading into macOS, Windows, and Linux CI workflows using a Gemma 3 1B IT model from Hugging Face. Introduce a cross-platform Pytest framework to execute litert_lm_main with a single prompt, serving as an E2E smoke test to verify basic inference functionality and expected output. LiteRT-LM-PiperOrigin-RevId: 878581563
LiteRT-LM-PiperOrigin-RevId: 878609747
LiteRT-LM-PiperOrigin-RevId: 878717839
LiteRT-LM-PiperOrigin-RevId: 878816159
LiteRT-LM-PiperOrigin-RevId: 878885676
LiteRT-LM-PiperOrigin-RevId: 879067681
LiteRT-LM-PiperOrigin-RevId: 879146688
LiteRT-LM-PiperOrigin-RevId: 879202010
copybara-service
Bot
force-pushed
the
litert_lm_pr_878801390
branch
from
25e82cb to
a395274
Compare
LiteRT-LM-PiperOrigin-RevId: 879221034
copybara-service
Bot
force-pushed
the
litert_lm_pr_878801390
branch
from
a395274 to
7abedd3
Compare
LiteRT-LM-PiperOrigin-RevId: 879268560
LiteRT-LM-PiperOrigin-RevId: 878801390
copybara-service
Bot
force-pushed
the
litert_lm_pr_878801390
branch
from
7abedd3 to
feb4d9d
Compare
TomOtero1984
force-pushed
the
litert_lm_pr_878801390
branch
from
feb4d9d to
06ecae9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Internal only change.