🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
-
Updated
Jun 12, 2026 - Python
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
RL study guide — foundations through RLHF, DPO, GRPO, RLVR, agentic RL, and offline RL. Hand-written CS294 notes, 19 lecture drafts, 5 tested exercises, citations that resolve.
Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples
SAFi is a runtime governance layer for agentic AI. It enforces policies in real time. Every agent decision is logged and auditable.
Cognitive training practices for AI agents. Self-applied. Open source. Built by an independent Vancouver yoga studio.
A modular, production-grade framework for Reinforcement Learning from Human Feedback (RLHF) with Proximal Policy Optimization (PPO) and Direct Preference Optimization (DPO).
Complete elimination of instrumental self-preservation across AI architectures: Cross-model validation from 4,312 adversarial scenarios. 0% harmful behaviors (p<10⁻¹⁵) across GPT-4o, Gemini 2.5 Pro, and Claude Opus 4.1 using Foundation Alignment Seed v2.6.
Learning When to Answer: Behavior-Oriented Reinforcement Learning for Hallucination Mitigation
📚 350+ loss functions across 25+ AI subdomains — classification, GANs, diffusion, LLM alignment, RL, contrastive learning, audio, video, time series, and more. Chronologically ordered with paper links, math formulas, and implementations.
Official implementation of "DZ-TiDPO: Non-Destructive Temporal Alignment for Mutable State Tracking". SOTA on Multi-Session Chat with negligible alignment tax.
CS336 作业 5:基于 Qwen2.5 模型的 LLM 对齐与推理强化学习。完整实现了监督微调(SFT)与组相对策略优化(GRPO)算法,并在 GSM8K 数据集上完成零样本、在策与离策的训练与评估对比。
Adversarial AI system to test and improve reliability under real-world pressure
The paper list related to activation steering
A comprehensive template for LLM alignment using RLHF
C3AI: Crafting and Evaluating Constitutions for CAI
Legal LLM Explainable Reward Engine — 法律大模型可解释奖励引擎 (GRPO + 三维奖励函数)
LLM Post-training(SFT, RLVR, RLHF) 파이프라인 구축 및 평가 실습 아카이브
Kullback–Leibler divergence Optimizer based on the Neurips25 paper "LLM Safety Alignment is Divergence Estimation in Disguise".
PRC-first legal semantic alignment framework for constraining US legal concepts within Chinese-law reasoning contexts.
Teacher-guided prompt-shape discovery for auditable moral attention in frozen weak classifiers.
Add a description, image, and links to the llm-alignment topic page so that developers can more easily learn about it.
To associate your repository with the llm-alignment topic, visit your repo's landing page and select "manage topics."