Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Examples of chatbot implementations with Langchain and Streamlit

PasLLM - LLM inference engine in Object Pascal (synced from my private work repository)

This repository contains the code for all the book that I am writing `My adventures with LLM` book.

RAG Based LLM Chatbot Built using Open Source Stack (Llama 3.2 Model, BGE Embeddings, and Qdrant running locally within a Docker Container)

The GroqCloud API wrapper for Delphi provides access to models from Meta, OpenAI, MistralAI and Google on Groq’s LPUs, offering chat, text generation, image analysis, audio transcription, JSON output, tool integration, and content moderation capabilities.

Empower Truly Autonomous AI Agents through our Experimental Adversarial and Evolutionary Reinforcement Learning Framework. Join our Community: https://t.me/evolveRL_portal

This Repo Contains Script To Fine Tune Open Source Models Using Unsloth by using UI with simple click and progress

Shuffle LLama-3.2 layers and have it prompt an image. Node works with any model - Flux, SD3, SDXL...

Sketch2Graphviz allows you to convert sketches or images of graphs and flowcharts to proper Graphviz code using a LoRA fine-tuned Llama 3.2 11B Vision and Retrieval-Augmented Generation (RAG) through a vector database built with PostgreSQL and PGVector, making a previously tedious, manual task fast and effortless.

A C++23 module-based DNN library for GPU-first LLM inference — explicit forward passes, no hidden execution engine, work at the metal. Validated token-for-token on GPT-2 and Llama 3.x, with compile-time FP8/FP4 weight quantization.

Run Ollama (Llama3.2), Langflow, Postgres, and qdrant server using Docker Compose.

This repository contains a collection of examples demonstrating the usage of LangGraph in various applications. LangGraph is a powerful framework for building dynamic, decision-making workflows with natural language processing capabilities.

"JusTreeAI" - a lightweight LLM assistant for legal tasks. This is a "proof-of-concept" project developed as part of Data Systems Project at UvA. Authored by Team D1.

A gradio web UI demo for Llama3.2-Vision Model

Language Translator is an AI-powered tool for text and voice translation using Hugging Face's MarianMT, Llama 3.2 via the Ollama API, and LibreTranslate. It supports multi-language translation with text-to-speech and speech-to-text functionality.

Effortless Data Extraction, Powered by : Generative AI

Context-aware chatbot using LLaMA 3.1 embeddings and a vector database for efficient query understanding and response generation, with NLP techniques like entity extraction and intent recognition.

Get compliments in the style of Regina George via analyzing video in a @CloudflareDev Worker by breaking it into frames and sending a frame every x seconds to Llama🦙 3.2 Vision hosted on Workers AI!

Simple tool for RAG (Retrieval Augmented Generation) applications to be run over locally stored files