Packages

Production ML model serving on the BEAM. Serve PyTorch models faster than Python with pre-compiled graph execution, AOTI compiled inference, and OTP fault tolerance.

TorchVision ops for ExTorch — NMS, ROI Align, deformable convolution, and image I/O on the BEAM. Builds libtorchvision from source, no C++ code in this package.