Coder Social home page Coder Social logo

jimmeex / ur5_t2_4230 Goto Github PK

View Code? Open in Web Editor NEW
4.0 4.0 0.0 3.69 MB

ROS UR5 Pick & Place Simulation Environment

Home Page: https://www.youtube.com/watch?v=OMTVitTJu90

License: MIT License

CMake 4.48% MATLAB 6.44% Python 24.73% C++ 32.79% M 0.11% HTML 0.73% CSS 2.27% JavaScript 26.51% Jupyter Notebook 0.61% Dockerfile 0.91% Shell 0.43%
computer-vision docker docker-compose gazebo matlab python reactjs ros universal-robots ur5

ur5_t2_4230's Issues

Vision Optimisations

  • Move Figure Outputs to Web GUI
    • imshow() forces the computer to 'focus' on the image window which is intrusive
  • Move Vision to Python-ROS based
    • Convenience in running (just one launch file)
    • Communication between MATLAB && Python-ROS is very slow (current takes around 2 seconds to send & receive)
  • Weird memory-related errors when the system runs for an extensive amount of time

Motion Optimisations

  • Sometimes the robot will rotate unexpectedly (eg, when the object is very close to the robot)

Generate Gazebo World

Generate all objects with correct position & orientation in Gazebo. This comprises:

  • Conveyor
  • UR5
  • Break Beams
  • RGB-D Camera
  • Objects & Container (start of conveyor)
    I think only the .launch file and spawner.py needs to be edited.

Gazebo Optimisations

  • Weight/Inertia Model to Objects + Containers
  • Sometimes vacuum gripper does not grab a block
  • Conveyor Belt Shift

Generate Objects

Visuals

  • Add sticker-like "shape" representation on top (could consider all faces)
  • Modify visual colour

Generation

  • Function to spawn object (inputs {location, colour, shape} in Gazebo)

(might add more later)

Migration of Components

Migration of components into our github repo to ensure consistency, and that changes in models can be shared amongst the team

  • Migrate RGB-D Kinect Component
  • Migrate UR5 Model

Control/Main Flow of Gazebo World Components

Controls the Gazebo Environment (conveyor, robot, proximity sensor) based on triggers/inputs from other modules.
Specific functionalities are still vague.

Considerations

  • conveyor_out should stop when a new order is detected by break_beam_out
  • conveyor_out should start on trigger (ie, when the order is finished) [maybe requires a separate "order" node]
  • conveyor_in should stop when a desired object hits the break_beam_in [requires cooperation of vision]
  • conveyor_out should start when the desired object has been collected and put into the container, and the robot returns to the original position for collection [requires co-operation of motion]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.