This codebase consists of code used to run the robotics pipeline of the NatureNeuromorphicComputingForRobotics paper on even vision guided robot grasping.
First run the calibration script from project root. It will pop up a window with the first frame. Select two points to crop out the table. The script will then compute homography matrix based on the detected points and save it. Replace --video with --cam realsense or zed as needed.
python3 -m src.robo_package.calibration.calibrate --video src/robo_package/data/test_sequence.mov
After succesfully saving the calibration data. run the following script for detection and tracking
python3 -m src.robo_package.main --video src/robo_package/data/test_sequence.mov