Coder Social home page Coder Social logo

jimmeex / ur5_t2_4230 Goto Github PK

View Code? Open in Web Editor NEW
4.0 3.0 0.0 3.69 MB

ROS UR5 Pick & Place Simulation Environment

Home Page: https://www.youtube.com/watch?v=OMTVitTJu90

License: MIT License

CMake 4.48% MATLAB 6.44% Python 24.73% C++ 32.79% M 0.11% HTML 0.73% CSS 2.27% JavaScript 26.51% Jupyter Notebook 0.61% Dockerfile 0.91% Shell 0.43%
ros gazebo matlab ur5 computer-vision reactjs python universal-robots docker docker-compose

ur5_t2_4230's People

Contributors

brettsamuelsdev avatar jason-qk avatar jimmeex avatar mashymre avatar mjbozo avatar rowenadai avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

ur5_t2_4230's Issues

Generate Objects

Visuals

  • Add sticker-like "shape" representation on top (could consider all faces)
  • Modify visual colour

Generation

  • Function to spawn object (inputs {location, colour, shape} in Gazebo)

(might add more later)

Motion Optimisations

  • Sometimes the robot will rotate unexpectedly (eg, when the object is very close to the robot)

Generate Gazebo World

Generate all objects with correct position & orientation in Gazebo. This comprises:

  • Conveyor
  • UR5
  • Break Beams
  • RGB-D Camera
  • Objects & Container (start of conveyor)
    I think only the .launch file and spawner.py needs to be edited.

Vision Optimisations

  • Move Figure Outputs to Web GUI
    • imshow() forces the computer to 'focus' on the image window which is intrusive
  • Move Vision to Python-ROS based
    • Convenience in running (just one launch file)
    • Communication between MATLAB && Python-ROS is very slow (current takes around 2 seconds to send & receive)
  • Weird memory-related errors when the system runs for an extensive amount of time

Migration of Components

Migration of components into our github repo to ensure consistency, and that changes in models can be shared amongst the team

  • Migrate RGB-D Kinect Component
  • Migrate UR5 Model

Gazebo Optimisations

  • Weight/Inertia Model to Objects + Containers
  • Sometimes vacuum gripper does not grab a block
  • Conveyor Belt Shift

Control/Main Flow of Gazebo World Components

Controls the Gazebo Environment (conveyor, robot, proximity sensor) based on triggers/inputs from other modules.
Specific functionalities are still vague.

Considerations

  • conveyor_out should stop when a new order is detected by break_beam_out
  • conveyor_out should start on trigger (ie, when the order is finished) [maybe requires a separate "order" node]
  • conveyor_in should stop when a desired object hits the break_beam_in [requires cooperation of vision]
  • conveyor_out should start when the desired object has been collected and put into the container, and the robot returns to the original position for collection [requires co-operation of motion]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.