Setup and run a local LLM and Chatbot using consumer grade hardware.

a self-hosted webui for 30+ generative ai

Optimizing performance, building and installing packages required for oobabooga, AI and Data Science on Apple Silicon GPU. The goal is to optimize wherever possible, from the ground up.

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

Tool for test diferents large language models without code.

AgentX is an Open-source library that help people use LLMs on their own computers or help them to serve LLMs as easy as possible that support multi-backends like PyTorch, llama.cpp, Ollama and EasyDeL

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

A financial chatbot powered by an LLM and retrieval-augmented generation.

YouTube API implementation with Meta's Llama 2 to analyze comments and sentiments

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

A basic GUI to interact with Meta's open source LLM. Here I am using quantized version of the llama 7B model. Tbh Its a really really small task, I did it because why not + I was bored

Serving open source models of your choice in as a docker container using llama-cpp-python's OpenAI compatible server

Repository for the Cybersecurity-M project course of professor M. Colajanni

Huginn Hears is a local app that transcribes and summarizes your meetings in Norwegian and English, using state-of-the-art models and open-source libraries. No cloud needed, run everything offline.

MINeD Hackathon 2024 - Project

A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat

llama-cpp-python(llama.cpp)で実行するGGUF形式のLLM用の簡易Webインタフェースです。

UnOfficial Gradio Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji.

Llama.cpp é uma biblioteca desenvolvida em C++ para a implementação eficiente de grandes modelos de linguagem, como o LLaMA da Meta. Otimizada para rodar em diversas plataformas, incluindo dispositivos com recursos limitados, oferece performance, velocidade de inferência e uso eficiente da memória, essenciais para a execução de grandes. modelos