XLA – OpenTeams

Large Scale Training of Hugging Face Transformers on TPUs With PyTorch/XLA FSDP

AI is transforming many industries through advanced capabilities such as understanding and generating language, answering questions, and delivering ac…

OpenTeams August 24, 2023

The Path to Achieve Ultra-Low Inference Latency With LLaMA 65B on PyTorch/XLA

Background & State of the Art

OpenTeams June 28, 2023

OpenTeams bridges the gap between enterprises and the open source community, facilitating adoption and optimization of open source technologies. By fostering trust and enhancing communication, OpenTeams enables companies to leverage the full potential of open source solutions, driving innovation and efficiency in the enterprise.

Tag: XLA

Large Scale Training of Hugging Face Transformers on TPUs With PyTorch/XLA FSDP

The Path to Achieve Ultra-Low Inference Latency With LLaMA 65B on PyTorch/XLA

Resources

Company