OneDiff: An out-of-the-box acceleration library for diffusion models.

The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

Python Computer Vision & Video Analytics Framework With Batteries Included

Wingman is the fastest and easiest way to run Llama models on your PC or Mac.

带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

Repository for OpenVINO's extra modules

PygmalionAI's large-scale inference engine

Simple first-order logic implementation for .NET.

Friendli: the fastest serving engine for generative AI

The collections of tools for testing and dumping LLMs

🍺 Obrew Server: A local & private Ai inference engine.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

A common base representation of python source code for pylint and other projects

Large scale recommender system inference Microservices and APIs （Dubbo 、gRPC and REST ） with Golang.

Hand recognition Inference SDK🤓🤓

This project offers a versatile platform for hand-related tasks, including dataset generation and custom hand gesture detection using Google's MediaPipe library and accelerated real-time sign language translation with LLMs on edge devices.

A rule engine written in Elixir.

Rule engine implementation in Golang