Parallformers: An Efficient Model Parallelization Toolkit for Deployment

Intro

• Introduction
• Supported Models
• Policy Class
• FAQ
• Contributing to Parallelformers

Parallelize

• Parallelize

Parallel modules

• Parallel Engine
• Parallel Process
• Tensor Replacer
• Tensor Slicer

Policy modules

• Auto Policy
• Policy

Utils

• Attribute Utils
• Distributed Utils

Indices and tables

• Index

• Module Index

• Search Page