torch.distributed.tensor.parallel

若API未标明支持情况则代表该API暂无验证结果,待验证后更新表格。

API名称

是否支持

限制与说明

torch.distributed.tensor.parallel.parallelize_module

     

torch.distributed.tensor.parallel.style.RowwiseParallel

     

torch.distributed.tensor.parallel.style.ColwiseParallel

     

torch.distributed.tensor.parallel.style.PairwiseParallel

     

torch.distributed.tensor.parallel.style.SequenceParallel

     

torch.distributed.tensor.parallel.style.make_input_replicate_1d

     

torch.distributed.tensor.parallel.style.make_input_reshard_replicate

     

torch.distributed.tensor.parallel.style.make_input_shard_1d

     

torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim

     

torch.distributed.tensor.parallel.style.make_output_replicate_1d

     

torch.distributed.tensor.parallel.style.make_output_reshard_tensor

     

torch.distributed.tensor.parallel.style.make_output_shard_1d

     

torch.distributed.tensor.parallel.style.make_output_tensor

     

torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp

  

torch.distributed.tensor.parallel.ddp.pre_dp_module_transform