workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
-
Updated
May 29, 2024 - C++
workbench for learing&practising AI tech in real scenario on Android device, powered by GGML(Georgi Gerganov Machine Learning) and NCNN(Tencent NCNN) and FFmpeg
An embedded vector database designed to run on edge devices. Lightweight and fast with HNSW indexing algorithm.
Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
FEDn: A production-grade, open federated learning framework. This repository contains the open source Python framework, CLI and API.
The BirdsEye RL/RF project enables localization of mobile radio frequency targets, e.g., drones operators, via commericial off-the-shelf sensors.
EdgeFace: Efficient Face Recognition Model for Edge Devices [TBIOM 2024] the winner of compact track of IJCB 2023 Efficient Face Recognition Competition
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
An open source light-weight and high performance inference framework for Hailo devices
High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices
Resources of our survey paper "Enabling AI on Edges: Techniques, Applications and Challenges"
Edge AI > AI app to easily perform transcriptions on regular computers. Quality on par with on-cloud alternatives. Lower costs. Reduced privacy risks.
The Hailo PCIe driver is required for interacting with a Hailo device over the PCIe interface
💜 The best free Telegram bot for ChatGPT, Microsoft Copilot (aka Bing AI / Sidney / EdgeGPT), Microsoft Copilot Designer (aka BingImageCreator), Gemini and Groq with stream writing, requests with images, multiple languages, admin control, data logging and more!
A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.
Tools for working with NengoEdge
A mnist classifier trained with Tinygrad running on $1 of compute (Raspberry Pi Pico | ArduCAM Pico4ML)
Detect loss at self-checkout by seamlessly connecting different sensor devices, including weight scale sensors, cameras, and RFIDs.
Add a description, image, and links to the edge-ai topic page so that developers can more easily learn about it.
To associate your repository with the edge-ai topic, visit your repo's landing page and select "manage topics."