2

GUILLENGAP Robot Arm

 3 years ago
source link: https://hackaday.io/project/180542-guillengap-robot-arm
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

GUILLENGAP Robot Arm

Collaborative Robot Arm with Artificial Intelligence, and Used as Assistant in: 1) Voice Command System, and 2) Sorting Objects System

Description

This design utilizes robotics in a unique way, as a personal assistant! This is a collaborative robot arm in three versions to assist you in several tasks.

VERSION 1...
Robot arm that assist with the task of pick-and-place an object like a box. Here I'm using the "MATRIX Creator" and Raspberry Pi board s, to control a robotic arm by mean of Artificial Intelligence (AI) with voice commands and the "Snips" assistant.

VERSION 2...
Here I´m adding more functions to my first version: a) controlling a bottle, b) controlling a bradboard, and c) controlling a box. Here I continue using AI, but with different hardware (Alexa Echo Dot, ESP32-WROOM-32, and Arduino Nano 33 BLE Sense) and free open source tools (FauxmoESP library).

VERSION 3...
Finally my third version. Here I'm going to sort objects by color using TensorFlow and using Arduino boards, this system detects blue, green and red balls to place them in their corresponding container.

Details

Hi everyone! Below I show you summaries of my project in its two versions.

Version 1...

A video summarizing the journey of this project in the first version. Main goal, Features, Solutions, Content, Hardware and software prerequisites, 

Version 2...

A video summarizing the journey of this project in its second version. Here I'm using different hardware and software, and I´m showing three examples:  1) Controlling a Bottle, 2) Controlling a Breadboard, and 3) Controlling a Box.

Version 3...
A video summarizing the journey of the third version. Here I´m going to sort three objects by color and using TensorFlow

Files

circuit_diagram_v2.zip

Circuit diagram of the robot arm, version 2

x-zip-compressed - 1.09 MB - 08/17/2021 at 23:31

Download

circuit_diagram.zip

Circuit diagram of the robot arm, version 1

x-zip-compressed - 295.79 kB - 06/28/2021 at 01:11

Download

datasheets.zip

All the datashhets files used: 1) MATRIX_Creator.pdf, and 2) MG995_Tower-Pro.pdf

x-zip-compressed - 12.30 MB - 06/28/2021 at 00:48

Download

stl_files.zip

All the STL files necessary to create this project

x-zip-compressed - 11.19 kB - 06/27/2021 at 23:13

Download

guillengap_ver1.zip

First code version of the robot arm

x-zip-compressed - 2.66 kB - 06/27/2021 at 23:09

Download

View all 6 files

Components

  • 1 × Raspberry Pi 3 Model B+
  • 1 × MATRIX Labs MATRIX Creator
  • 1 × Alexa Echo Dot (3rd Gen)
  • 1 × ESP32-WROOM-32
  • 1 × Arduino Nano 33 BLE Sense

View all 13 components

Project Logs Collapse

  • Step 11. Robot Arm Second Version - Test

    Guillermo Perez Guillen • 07/30/2021 at 20:30 • 0 comments

    TESTS

    In the video below I show you the tests with a water bottle.

    Now in the video below, the robot arm helps me unsolder a breadboard´s wire.

    Finally, and as in the first version, I order the robot arm to move a box containing a lamp.

    CONCLUSION 

    This was a good experience as I used a free tool to control my robot arm with the Alexa Echo Dot device. Also increase the functions without problems. The results were satisfactory and you can see them in the videos above.

  • Step 10. Robot Arm Second Version - HW & SW

    Guillermo Perez Guillen • 07/29/2021 at 19:40 • 0 comments

    As part of the continuous improvements, in this prototype I experimented with different hardware and software and using free open source tools as shown below.

    HARDWARE

    The schematic diagram below shows the electrical connections of the electronic components.

    How does it work?

    1. We use voice commands to perform three functions: 1) controlling a bottle; 2) controlling a plate; and 3) controlling a box.
    2. The voice commands are activated through Alexa Echo Dot, and they reach the ESP32-WROOM-32 board via WiFi.
    3. Finally, these voice commands are transmitted to the Arduino Nano 33 BLE Sense board, which controls the robot arm.

    SOFTWARE

    The FauxmoESP

    To control the ESP32 with Alexa Echo Dot, you need to install the FauxmoESP library. This library emulates a Belkin Wemo device, allowing you to control your ESP32 using this protocol. This way, the Echo Dot instantly recognizes the device, after uploading the code, without any extra skills or third party services. You can read more about FauxmoESP here.

    Installing the ESP32 Board in Arduino IDE

    In order to upload code to your ESP32 using Arduino IDE, you should install an add-on for the Arduino IDE that allows you to program the ESP32 using the Arduino IDE and its programming language. You can read more about Installing the ESP32 Board in Arduino IDE here.

    Installing the AsyncTCP Library

    You also need to install the AsyncTCP Library. You can read more about Installing the AsyncTCP Library here.

    Codes

    You can get the codes on my Github repository: guillengap-robot-arm

  • Step 9. Test and Conclusion

    Guillermo Perez Guillen • 06/28/2021 at 02:33 • 0 comments

    Before we start to do tests, we need to do next actions:

    On your Raspberry Pi type node assistant.js

    On your computer's terminal type sam status and sam watch

    Congrats! now you can test your robotic arm

    CONCLUSION

    The prototype worked very well, and is very useful to develop more complex actions with the robotic arm. however, I also had some difficulties such as:

    • The board worked very well with 5 servos and when I used 6 servos the system was collapsed and the robotic arm made strange movements. Also in the servomotor configuration I changed to the value of: min_pulse_ms: 0.2 and the robotic arm worked much better.
    • As I explained at the beginning of this tutorial, I had problems configuring the audio board, but this was successfully solved and now the MATRIX Creator board is very efficient even when it receives keywords at half a meter.

    It's easy to say that in the future this prototype can serve as a model in every home, and may be, we will have a robotic arm at our tables to help us in multiple tasks.

View all 11 project logs

Build Instructions Collapse

  • Steps

    Follow below steps to repeat the experience of this project

    • Step 1. Let's Get Started
    • Step 2. Connect Sam to Your Raspberry Pi
    • Step 3. Creating a Snips Assistant and App
    • Step 4. Adding an Intent
    • Step 5. Deploy your Assistant
    • Step 6. Creating assistant.js
    • Step 7. Wiring the Robotic Arm
    • Step 8. Printing and Assembling the Panel
    • Step 9. Test and Conclusion
    • Step 10. Robot Arm Second Version - HW & SW
    • Step 11. Robot Arm Second Version - Test

    NOTE: All these steps are detailed in the Logs of this project

View all instructions

Enjoy this project?

Share

Discussions


Recommend

  • 69
    • www.solidot.org 6 years ago
    • Cache

    ARM 与中国加强合作

  • 40
    • www.solidot.org 6 years ago
    • Cache

    RISC-V 社区回击 ARM

  • 70
    • Github github.com 6 years ago
    • Cache

    GitHub - umanovskis/baremetal-arm

    README.md Bare-metal C programming on ARM This repository contains a tutorial ebook concerning programming a bare-metal ARM system. More specifically i...

  • 48
    • www.tuicool.com 6 years ago
    • Cache

    Porting PuTTY to Windows on Arm

    In my day job, I work in the Arm Development Solutions Group, developing Arm Compiler and its supporting tools. In my spare time, I’m also the lead developer of the free SSH client

  • 49
    • www.tuicool.com 6 years ago
    • Cache

    MongoDB on ARM Processors

    ARM processors have been around for a while. In mid-2015/2016 there were a couple of attempts by the community to port MongoDB to work with this architecture. At the time, the main storage engine was MMAP and most of the...

  • 57
    • www.tuicool.com 5 years ago
    • Cache

    在 OS X 下构建 ARM 64 镜像

    Mac OS X 的 Docker 桌面版中加入了一个 buildx 的试验特性,启用之后,可以直接在 MAC 系统中构建 ARM64 和 ARM7 的镜像。启用方法很简单,打开 Docker 的配置窗口,进行如下配置:

  • 20
    • www.ulisp.com 5 years ago
    • Cache

    uLisp – ARM Assembler in Lisp

    This article describes an in-line assembler written in Lisp, as an add-on for uLisp. The project is currently a work in progress, but I thought it would be interesting to describe where I've got to, and I'd be interested t...

  • 10

    The Scandalous History of the Last Rotor Cipher Machine The history of AI is often told as the story of machines getting smarter over time. What’s los...

  • 11

    Retrotechtacular: The Original Robot Arm

  • 3

    Ally is building a dead-simple, no-code robot armBrian HeaterThu, October 20, 2022, 3:20 AM·2 min read

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK