若API未标明支持情况则代表该API暂无验证结果,待验证后更新表格。
API名称 |
是否支持 |
限制与说明 |
---|---|---|
torch.distributed.tensor.parallel.parallelize_module |
||
torch.distributed.tensor.parallel.style.RowwiseParallel |
||
torch.distributed.tensor.parallel.style.ColwiseParallel |
||
torch.distributed.tensor.parallel.style.PairwiseParallel |
||
torch.distributed.tensor.parallel.style.SequenceParallel |
||
torch.distributed.tensor.parallel.style.make_input_replicate_1d |
||
torch.distributed.tensor.parallel.style.make_input_reshard_replicate |
||
torch.distributed.tensor.parallel.style.make_input_shard_1d |
||
torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim |
||
torch.distributed.tensor.parallel.style.make_output_replicate_1d |
||
torch.distributed.tensor.parallel.style.make_output_reshard_tensor |
||
torch.distributed.tensor.parallel.style.make_output_shard_1d |
||
torch.distributed.tensor.parallel.style.make_output_tensor |
||
torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp |
否 |
|
torch.distributed.tensor.parallel.ddp.pre_dp_module_transform |