

GUILLENGAP Robot Arm
source link: https://hackaday.io/project/180542-guillengap-robot-arm
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

GUILLENGAP Robot Arm
Collaborative Robot Arm with Artificial Intelligence, and Used as Assistant in: 1) Voice Command System, and 2) Sorting Objects System
Description
VERSION 1...
Robot arm that assist with the task of pick-and-place an object like a box. Here I'm using the "MATRIX Creator" and Raspberry Pi board s, to control a robotic arm by mean of Artificial Intelligence (AI) with voice commands and the "Snips" assistant.
VERSION 2...
Here I´m adding more functions to my first version: a) controlling a bottle, b) controlling a bradboard, and c) controlling a box. Here I continue using AI, but with different hardware (Alexa Echo Dot, ESP32-WROOM-32, and Arduino Nano 33 BLE Sense) and free open source tools (FauxmoESP library).
VERSION 3...
Finally my third version. Here I'm going to sort objects by color using TensorFlow and using Arduino boards, this system detects blue, green and red balls to place them in their corresponding container.
Details
Hi everyone! Below I show you summaries of my project in its two versions.
Version 1...
A video summarizing the journey of this project in the first version. Main goal, Features, Solutions, Content, Hardware and software prerequisites,
Version 2...
A video summarizing the journey of this project in its second version. Here I'm using different hardware and software, and I´m showing three examples: 1) Controlling a Bottle, 2) Controlling a Breadboard, and 3) Controlling a Box.
Version 3...
A video summarizing the journey of the third version. Here I´m going to sort three objects by color and using TensorFlow
Files
circuit_diagram_v2.zip
Circuit diagram of the robot arm, version 2x-zip-compressed - 1.09 MB - 08/17/2021 at 23:31
circuit_diagram.zip
Circuit diagram of the robot arm, version 1x-zip-compressed - 295.79 kB - 06/28/2021 at 01:11
datasheets.zip
All the datashhets files used: 1) MATRIX_Creator.pdf, and 2) MG995_Tower-Pro.pdfx-zip-compressed - 12.30 MB - 06/28/2021 at 00:48
stl_files.zip
All the STL files necessary to create this projectx-zip-compressed - 11.19 kB - 06/27/2021 at 23:13
guillengap_ver1.zip
First code version of the robot armx-zip-compressed - 2.66 kB - 06/27/2021 at 23:09
Components
- 1 × Raspberry Pi 3 Model B+
- 1 × MATRIX Labs MATRIX Creator
- 1 × Alexa Echo Dot (3rd Gen)
- 1 × ESP32-WROOM-32
- 1 × Arduino Nano 33 BLE Sense
Project Logs Collapse
-
Step 11. Robot Arm Second Version - Test
Guillermo Perez Guillen • 07/30/2021 at 20:30 • 0 commentsTESTS
In the video below I show you the tests with a water bottle.
Now in the video below, the robot arm helps me unsolder a breadboard´s wire.
Finally, and as in the first version, I order the robot arm to move a box containing a lamp.
CONCLUSION
This was a good experience as I used a free tool to control my robot arm with the Alexa Echo Dot device. Also increase the functions without problems. The results were satisfactory and you can see them in the videos above.
-
Step 10. Robot Arm Second Version - HW & SW
Guillermo Perez Guillen • 07/29/2021 at 19:40 • 0 commentsAs part of the continuous improvements, in this prototype I experimented with different hardware and software and using free open source tools as shown below.
HARDWARE
The schematic diagram below shows the electrical connections of the electronic components.
How does it work?
- We use voice commands to perform three functions: 1) controlling a bottle; 2) controlling a plate; and 3) controlling a box.
- The voice commands are activated through Alexa Echo Dot, and they reach the ESP32-WROOM-32 board via WiFi.
- Finally, these voice commands are transmitted to the Arduino Nano 33 BLE Sense board, which controls the robot arm.
SOFTWARE
The FauxmoESP
To control the ESP32 with Alexa Echo Dot, you need to install the FauxmoESP library. This library emulates a Belkin Wemo device, allowing you to control your ESP32 using this protocol. This way, the Echo Dot instantly recognizes the device, after uploading the code, without any extra skills or third party services. You can read more about FauxmoESP here.
Installing the ESP32 Board in Arduino IDE
In order to upload code to your ESP32 using Arduino IDE, you should install an add-on for the Arduino IDE that allows you to program the ESP32 using the Arduino IDE and its programming language. You can read more about Installing the ESP32 Board in Arduino IDE here.
Installing the AsyncTCP Library
You also need to install the AsyncTCP Library. You can read more about Installing the AsyncTCP Library here.
Codes
You can get the codes on my Github repository: guillengap-robot-arm
-
Step 9. Test and Conclusion
Guillermo Perez Guillen • 06/28/2021 at 02:33 • 0 commentsBefore we start to do tests, we need to do next actions:
On your Raspberry Pi type node assistant.js
On your computer's terminal type sam status and sam watch
Congrats! now you can test your robotic arm
CONCLUSION
The prototype worked very well, and is very useful to develop more complex actions with the robotic arm. however, I also had some difficulties such as:
- The board worked very well with 5 servos and when I used 6 servos the system was collapsed and the robotic arm made strange movements. Also in the servomotor configuration I changed to the value of: min_pulse_ms: 0.2 and the robotic arm worked much better.
- As I explained at the beginning of this tutorial, I had problems configuring the audio board, but this was successfully solved and now the MATRIX Creator board is very efficient even when it receives keywords at half a meter.
It's easy to say that in the future this prototype can serve as a model in every home, and may be, we will have a robotic arm at our tables to help us in multiple tasks.
Build Instructions Collapse
-
Steps
Follow below steps to repeat the experience of this project
- Step 1. Let's Get Started
- Step 2. Connect Sam to Your Raspberry Pi
- Step 3. Creating a Snips Assistant and App
- Step 4. Adding an Intent
- Step 5. Deploy your Assistant
- Step 6. Creating assistant.js
- Step 7. Wiring the Robotic Arm
- Step 8. Printing and Assembling the Panel
- Step 9. Test and Conclusion
- Step 10. Robot Arm Second Version - HW & SW
- Step 11. Robot Arm Second Version - Test
NOTE: All these steps are detailed in the Logs of this project
Enjoy this project?
Share
Discussions
Recommend
-
69
-
40
-
70
README.md Bare-metal C programming on ARM This repository contains a tutorial ebook concerning programming a bare-metal ARM system. More specifically i...
-
48
In my day job, I work in the Arm Development Solutions Group, developing Arm Compiler and its supporting tools. In my spare time, I’m also the lead developer of the free SSH client
-
49
ARM processors have been around for a while. In mid-2015/2016 there were a couple of attempts by the community to port MongoDB to work with this architecture. At the time, the main storage engine was MMAP and most of the...
-
57
Mac OS X 的 Docker 桌面版中加入了一个 buildx 的试验特性,启用之后,可以直接在 MAC 系统中构建 ARM64 和 ARM7 的镜像。启用方法很简单,打开 Docker 的配置窗口,进行如下配置:
-
20
This article describes an in-line assembler written in Lisp, as an add-on for uLisp. The project is currently a work in progress, but I thought it would be interesting to describe where I've got to, and I'd be interested t...
-
10
The Scandalous History of the Last Rotor Cipher Machine The history of AI is often told as the story of machines getting smarter over time. What’s los...
-
11
Retrotechtacular: The Original Robot Arm
-
3
Ally is building a dead-simple, no-code robot armBrian HeaterThu, October 20, 2022, 3:20 AM·2 min read
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK