Skip to content

Fix transformers 5.x compatibility + GPU inference optimisations #268

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
markstrefford wants to merge 4 commits into
base: main
Choose a base branch
from
+337 −140

Add multi-layer GPU batching and model reuse for faster inference

1a991a6
Select commit
Loading
Failed to load commit list.
Open

Fix transformers 5.x compatibility + GPU inference optimisations #268

Add multi-layer GPU batching and model reuse for faster inference
1a991a6
Select commit
Loading
Failed to load commit list.
GitGuardian / GitGuardian Security Checks succeeded Mar 9, 2026 in 32s

No secrets detected ✅

4 commits were scanned without uncovering any secrets.

Details

Commits scanned: 4

  • Pull request #268: main 👉 main

🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.

View more details on GitGuardian