Skip to content

Commit 491a38c

Browse files
authored
Fix Ulysses PEFT test (#7784)
Fix an issue with Ulysses PEFT test. This unblocks the full CI test.
1 parent 311674f commit 491a38c

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

tests/unit/ulysses_alst/test_ulysses_sp_hf.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -228,7 +228,7 @@ def __init__(self, config):
228228
assert mpu is not None
229229

230230
# Verify that the sequence parallel groups are initialized
231-
sp_group = groups._get_sequence_parallel_group()
231+
sp_group = mpu.get_sequence_parallel_group()
232232
assert sp_group is not None
233-
sp_world_size = groups._get_sequence_parallel_world_size()
233+
sp_world_size = mpu.get_sequence_parallel_world_size()
234234
assert sp_world_size == sequence_parallel_size

0 commit comments

Comments
 (0)