欢迎使用 TorchRec 文档!¶
TorchRec 是一个 PyTorch 领域库,旨在提供大规模推荐系统 (RecSys) 所需的常见稀疏性和并行性原语。它允许作者训练具有跨多个 GPU 分片的巨大嵌入表的模型。
有关安装说明,请访问
https://github.com/pytorch/torchrec#readme
教程¶
在本教程中,我们将介绍名为 DistributedModelParallel(简称 DMP)的主要 torchRec API。与 PyTorch 的 DistributedDataParallel 类似,DMP 包装了一个模型以实现分布式训练。
在 Google Colab 中打开
TorchRec API¶
- torchrec.datasets
- torchrec.datasets.scripts
- torchrec.distributed
- torchrec.distributed.collective_utils
- torchrec.distributed.comm
- torchrec.distributed.comm_ops
- torchrec.distributed.dist_data
- torchrec.distributed.embedding
- torchrec.distributed.embedding_lookup
- torchrec.distributed.embedding_sharding
- torchrec.distributed.embedding_types
- torchrec.distributed.embeddingbag
- torchrec.distributed.grouped_position_weighted
- torchrec.distributed.model_parallel
- torchrec.distributed.quant_embeddingbag
- torchrec.distributed.train_pipeline
- torchrec.distributed.types
- torchrec.distributed.utils
- torchrec.distributed.mc_modules
- torchrec.distributed.mc_embeddingbag
- torchrec.distributed.mc_embedding
- torchrec.distributed.planner
- torchrec.distributed.planner.constants
- torchrec.distributed.planner.enumerators
- torchrec.distributed.planner.partitioners
- torchrec.distributed.planner.perf_models
- torchrec.distributed.planner.planners
- torchrec.distributed.planner.proposers
- torchrec.distributed.planner.shard_estimators
- torchrec.distributed.planner.stats
- torchrec.distributed.planner.storage_reservations
- torchrec.distributed.planner.types
- torchrec.distributed.planner.utils
- torchrec.distributed.sharding
- torchrec.fx
- torchrec.inference
- torchrec.models
- torchrec.modules
- torchrec.modules.activation
- torchrec.modules.crossnet
- torchrec.modules.deepfm
- torchrec.modules.embedding_configs
- torchrec.modules.embedding_modules
- torchrec.modules.feature_processor
- torchrec.modules.lazy_extension
- torchrec.modules.mlp
- torchrec.modules.utils
- torchrec.modules.mc_modules
- torchrec.modules.mc_embedding_modules
- torchrec.optim
- torchrec.quant
- torchrec.sparse