UnrealCV: Connecting Computer Vision to Unreal Engine
-
Updated
Jun 12, 2024 - C++
UnrealCV: Connecting Computer Vision to Unreal Engine
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
A library for differentiable nonlinear optimization
SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
DORA (Dataflow-Oriented Robotic Application) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
Unified Reinforcement Learning Framework
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!
Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"
🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses
[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"
[Incl. GenAD, CVPR 2024 Highlight] Embracing Foundation Models into Autonomous Agent and System
A universal summary of current robotics simulators
ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm
[ICCV 2021] Official implementation of "The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation"
Official GitHub Repository for paper "Visual Graph Memory with Unsupervised Representation for Visual Navigation", ICCV 2021
Open Platform for Embodied Agents
NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"
The repository of ECCV 2020 paper `Active Visual Information Gathering for Vision-Language Navigation`
Add a description, image, and links to the embodied-ai topic page so that developers can more easily learn about it.
To associate your repository with the embodied-ai topic, visit your repo's landing page and select "manage topics."