Highlights
- Pro
Starred repositories
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
Accessible large language models via k-bit quantization for PyTorch.
Fast, Accurate, Lightweight Python library to make State of the Art Embedding
Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/
Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc…
Ever used asyncio and wished you hadn't? A tiny (~400 lines) event loop for Python.
PyTorch implementation of some attentions for Deep Learning Researchers.
Implementation of 1D, 2D, and 3D FFT convolutions in PyTorch. Much faster than direct convolutions for large kernel sizes.
Stream images from a connected camera over MQTT, view using Streamlit, record to file and sqlite
(Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints" (https://arxiv.org/pdf/2305.13245.pdf)
A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)
Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
Simple but robust implementation of LoRA for PyTorch. Compatible with NLP, CV, and other model types. Strongly typed and tested.
(Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (https://arxiv.org/abs/2307.02486)
key/value store for Python based on Cloudflare workers
Fastest 'Semantle' solver this side of the Mississippi.
RAG application to answer questions about PDF documents using LLMs.
Template repo for Python projects, especially those focusing on machine learning and/or deep learning.
PyTorch implementation of BYOL: a fantastically simple method for self-supervised image representation learning with SOTA performance.
A very simple BERT implementation in PyTorch, which only depends on PyTorch itself.
Minimalist library for training RL agents in PyTorch. Implements many common training algorithms, with a focus on actor-critic methods. Includes SAC, TD3, PPO, A2C, VPG.






