Skip to content

feat(examples): add two-node QLoRA recipe#2309

Open
HuiyingLi wants to merge 1 commit into
mainfrom
huiyingl/feat/qlora-2node-recipe
Open

feat(examples): add two-node QLoRA recipe#2309
HuiyingLi wants to merge 1 commit into
mainfrom
huiyingl/feat/qlora-2node-recipe

Conversation

@HuiyingLi
Copy link
Copy Markdown
Contributor

@HuiyingLi HuiyingLi commented May 25, 2026

Summary

  • Add a Llama 3.1 8B Instruct SQuAD QLoRA recipe for a 2-node, 16-GPU FSDP2 run.
  • Configure 4-bit NF4 quantization, LoRA adapters, validation every 100 steps, and a 100-step run.

Validation

image

@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented May 25, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@HuiyingLi HuiyingLi force-pushed the huiyingl/feat/qlora-2node-recipe branch from 3c25c47 to fe1cec7 Compare May 25, 2026 02:49
@HuiyingLi HuiyingLi added the docs-only With great power comes great responsibility. label May 25, 2026
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
@HuiyingLi HuiyingLi force-pushed the huiyingl/feat/qlora-2node-recipe branch from fe1cec7 to 5414283 Compare May 25, 2026 03:00
@HuiyingLi
Copy link
Copy Markdown
Contributor Author

/ok to test 5414283

@HuiyingLi HuiyingLi marked this pull request as ready for review May 25, 2026 03:04
@HuiyingLi HuiyingLi enabled auto-merge (squash) May 25, 2026 03:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs-only With great power comes great responsibility.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant