API名称 |
是否支持 |
限制与说明 |
|---|---|---|
torch.distributed.tensor.parallel.parallelize_module |
否 |
|
torch.distributed.tensor.parallel.style.RowwiseParallel |
否 |
|
torch.distributed.tensor.parallel.style.ColwiseParallel |
否 |
|
torch.distributed.tensor.parallel.style.PairwiseParallel |
否 |
|
torch.distributed.tensor.parallel.style.make_input_replicate_1d |
否 |
|
torch.distributed.tensor.parallel.style.make_input_shard_1d |
否 |
|
torch.distributed.tensor.parallel.style.make_input_shard_1d_last_dim |
否 |
|
torch.distributed.tensor.parallel.style.make_output_replicate_1d |
否 |
|
torch.distributed.tensor.parallel.style.make_output_tensor |
否 |
|
torch.distributed.tensor.parallel.style.make_output_shard_1d |
否 |
|
torch.distributed.tensor.parallel.multihead_attention_tp.TensorParallelMultiheadAttention |
否 |
|
torch.distributed.tensor.parallel.fsdp.enable_2d_with_fsdp |
否 |