Question/Issue:
Heya, I’m working on my capstone project where I’m developing a pick and place robotic arm using a Edge Impulse model on a ESP32-CAM to detect objects and send data via serial communication to an Arduino UNO/Sensor Shield. The UNO then controls the arm’s servo motors depending on the output (pick and place object left if ball is detected, pick and place object right if cube is detected).
Currently the camera has a detection accuracy I’m really happy with (high 90%) and the system as a whole is working great. The issue is, the UNO then uses a hardcoded method to move the arm’s servos. This is good if the object is always in the same position but I am wondering what options there are for finding the object’s position dynamically. Can I adjust the model to produce a set of instructions for the arm? Would inverse kinematics be suitable?
Thanks
Project ID:
648862
Context/Use case:
Capstone Project
Expected Outcome:
Find the object’s position dynamically to move the arm instead of moving the robotic arm through a hardcoded servo method. (write.servo1(150), etc.)
Environment:
- Platform: ESP32-CAM, Arduino UNO/Sensor Shield v5,
- Build Environment Details: Arduino IDE 2.3.5
- OS Version: Windows 10
- Edge Impulse Version (Firmware): 2.0.4 ESP32 Arduino Core