Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python tool for converting files and office documents to Markdown.

The agent engineering platform.

Robust Speech Recognition via Large-Scale Weak Supervision

Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

The best ChatGPT that $100 can buy.

Grok open release

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Convert PDF to markdown + JSON quickly with high accuracy

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

DSPy: The framework for programming—not prompting—language models

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

OpenMMLab Detection Toolbox and Benchmark

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

SGLang is a high-performance serving framework for large language models and multimodal models.

Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Fast and memory-efficient exact attention

The official Python SDK for Model Context Protocol servers and clients

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework