Dynamic Positioning for Pick-and-Place Robot Using ESP32-CAM – Alternatives to Hardcoded Servo Moves?

Help
,
#1

Question/Issue:
Heya, I’m working on my capstone project where I’m developing a pick and place robotic arm using a Edge Impulse model on a ESP32-CAM to detect objects and send data via serial communication to an Arduino UNO/Sensor Shield. The UNO then controls the arm’s servo motors depending on the output (pick and place object left if ball is detected, pick and place object right if cube is detected).

Currently the camera has a detection accuracy I’m really happy with (high 90%) and the system as a whole is working great. The issue is, the UNO then uses a hardcoded method to move the arm’s servos. This is good if the object is always in the same position but I am wondering what options there are for finding the object’s position dynamically. Can I adjust the model to produce a set of instructions for the arm? Would inverse kinematics be suitable?

Thanks

Project ID:
648862

Context/Use case:
Capstone Project

Expected Outcome:
Find the object’s position dynamically to move the arm instead of moving the robotic arm through a hardcoded servo method. (write.servo1(150), etc.)

Environment:

  • Platform: ESP32-CAM, Arduino UNO/Sensor Shield v5,
  • Build Environment Details: Arduino IDE 2.3.5
  • OS Version: Windows 10
  • Edge Impulse Version (Firmware): 2.0.4 ESP32 Arduino Core
#2

Very cool!

You can pass the positional information to the uno via UART but please share your code and tag some authors of previous posts if you want help. You should be able to find some examples in our expert network projects to get going:

Best

Eoin