Merge social nav transformer semantic place #1758
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Port changes over from client-server-hitl to minimize the gap. * Fix typo. * Port hitl server code to main. * Server clean-up pass. * Fix old HSSD path. * Port client-server fetch appstate and features from P0. * Formatting pass and code clean-up. * Code clean-up. * Port VR-based humanoid animation from P0. * Fix VR gaze direction. * Code formatting pass. * Add Unity dataset processing scripts. * Unity dataset processing script clean-up and formatting. * Fix typo. * Remove dead code and fix typing. * Add readme for running VR HITL evaluation. * Fix launch command. * Add link to README_VR.md. * Add docstrings. Add reset code in gui_controller. * Rename 'AppStateFetch' to 'AppStatePickThrowVr'. * Rename README_VR.md to VR_HITL.md, and improve the documentation. * Remove dead code and add doc. * Doc changes. * Update HITL README.md so that app states are better documented. * Clarify the scope of pick_throw_vr. * Move information from VR_HITL to siro_hitl_unity_client * Documentation improvements.
* rename 'colabs/' to 'notebooks/' and refactor links * refactor colabs to running Jupyter notebooks
* refactor sandbox_app.py; move arg-parsing, config-building, and __main__ code to separate files * encapsulate tutorial app-state transition into AppStateRearrangeTutorialTransition class * remove SandboxDriver logic to cycle through a list of AppStates (this is too inflexible as a state machine; see AppStateRearrangeTutorialTransition as an exaple of more freeform app-state transitions) * move gui_agent_controller into SandboxService * Make app_state_rearrange.py its own application (first pass) * move app_state_rearrange.py outside siro_sandbox and rename to rearrange.py * WIP: first pass to convert rearrange app to use hitl_rearrange.yaml hydra config; move --show-tutorial to config * convert pick_throw_vr to standalone app * remove deprecated app_state_socialnav.py (note: more recent version is at https://github.com/facebookresearch/habitat-lab/blob/eundersander/SIRo_hitl_Sep5_demo_refactored/examples/siro_sandbox/app_states/app_state_socialnav_study.py) * convert free_camera app state to standalone app 'basic_viewer' * add missing copyright headers * add READMEs for each example HITL application and update framework README (pick_throw_vr README is ported from existing VR readme) * add desktop system requirements * add VR system requirements * add documentation for AppStateRearrange
facebook-github-bot
added
the
CLA Signed
added 12 commits
January 15, 2024 16:28
…ck grasp to make the learning easier
…f the detected object
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.