Smartphone controlled omni directional wheel driven robot

Welcome

This is an individual project, to investigate the possibility of comining smartphone and the omni wheel robot.

Introduction

The app will be able to detect objects from the camera and warn the user if the robot may collide with objects.

The app will make use of openCV library to detect objects. Each frame will be processed by an artificial neural network and objects will be identified. Axis-aligned bounding box will be used to perform collision checks.

If the object appears to be colliding with the robot in the near future, a warning will be shown to users. Users will be notified and turn the robot to another direction.

Image

Omni directional wheel

Omni directional wheels will be used to perform physical movements of the robot.

The edges of these wheels will be replaced by small rollers such that the wheels will be able to roll at a perpendicular direction to its own position.

Object detection and collision check

The app will be able to detect objects from the camera and warn the user if the robot may collide with objects.

The app will make use of openCV library to detect objects. Each frame will be processed by an artificial neural network and objects will be identified. Axis-aligned bounding box will be used to perform collision checks.

If the object appears to be colliding with the robot in the near future, a warning will be shown to users. Users will be notified and turn the robot to another direction.

Image

Gallery