[Misc] [Offload] Update typehints, add docstrings#622

Open

kylesayrs wants to merge 13 commits intomainfrom

kylesayrs/fix-offload-typehints

Commits on Mar 8, 2026

Fix DeviceCache ignoring offload_device for cross-device CUDA offloading
changjonathanc
committed
Update src/compressed_tensors/offload/cache/base.py

changjonathanc
and
kylesayrs
committed
Update src/compressed_tensors/offload/module.py

changjonathanc
and
kylesayrs
committed
Update src/compressed_tensors/offload/cache/device.py

changjonathanc
and
kylesayrs
committed
Address review: revert offload_model, add DiskCache/CPUCache support, update docstrings
changjonathanc
committed
Move assert to OffloadCache.__init__, fix DiskCache caller in from_accelerate
changjonathanc
committed
Add type hint to DiskCache.offload_device parameter
changjonathanc
committed

Commits on Apr 6, 2026

Resolve merge conflicts in 5 file(s)

coderabbitai[bot]
and
CodeRabbit
authored

Commits on Apr 20, 2026

Resolve merge conflicts in 5 file(s)

coderabbitai[bot]
and
CodeRabbit
authored