torch.distributed.tensor.parallel

若API“是否支持”“是”“限制与说明”为空,说明此API和原生API支持度保持一致。

API名称

是否支持

限制与说明

torch.distributed.tensor.parallel.parallelize_module

  

torch.distributed.tensor.parallel.style.RowwiseParallel

  

torch.distributed.tensor.parallel.style.ColwiseParallel

  

torch.distributed.tensor.parallel.style.PairwiseParallel

  

torch.distributed.tensor.parallel.style.SequenceParallel

  

torch.distributed.tensor.parallel.style.make_input_replicate_1d

  

torch.distributed.tensor.parallel.style.make_input_reshard_replicate

  

torch.distributed.tensor.parallel.style.make_input_shard_1d

  

torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim

  

torch.distributed.tensor.parallel.style.make_output_replicate_1d

  

torch.distributed.tensor.parallel.style.make_output_reshard_tensor

  

torch.distributed.tensor.parallel.style.make_output_shard_1d

  

torch.distributed.tensor.parallel.style.make_output_tensor

  

torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp

  

torch.distributed.tensor.parallel.ddp.pre_dp_module_transform