HEBI Mobile I/O vs AnySense

HEBI Robotics creates components that allow you to create custom robots quickly, and the HEBI APIs enable you to program these robots using your favorite programming language. The HEBI Mobile IO App is another component in this ecosystem; it integrates with HEBI APIs and tools to provide analog and digital inputs that can be used to control these robots. More information about HEBI robotic components can be found at http://hebi.us, and technical documentation for programming robots using these APIs is provided at http://docs.hebi.us. HEBI Mobile IO shows up as a network device that provides analog and digital "feedback" information, similar to the HEBI IO Board, as well as inertial measurements. This feedback can be accessed using the MATLAB, C, C++, and Python APIs for HEBI components, available for download at http://docs.hebi.us. You can also send commands from these APIs to alter the state and configuration of the HEBI Mobile IO app. Additionally, the camera is used in combination with Apple's ARKit technology to provide a full 6DOF pose estimate of the device as it is moved through the world. NOTE: This app is only useful in combination with HEBI APIs and tools, and does not provide utility as a standalone app.

AnySense is an open-source iPhone app that enables multi-sensory data collection by integrating the iPhone's sensory suite with external sensors via Bluetooth and wired interfaces, enabling both offline data collection and online streaming to robots. The app also supports on-device policy evaluation: you can load a trained CoreML policy, set a 3D goal in AR, and run the policy with AR visualization of predicted actions without a robot. We record RGB and depth videos, metric depth frames, streamed Bluetooth data (e.g. from tactile sensors) into a binary file, and timestamped pose data as a `.txt` file. Example streaming code for Bluetooth data can be found on AnySkin. USB streaming is supported by connecting the iPhone to your computer and using the library - https://github.com/NYU-robot-learning/anysense-streaming.