How to combine face detection with mobile robot path planning in order to navigate a robot up to a fallen person's head?

조회 수: 2 (최근 30일)
Our masters project is the design and construction of a home care mobile robot. The robot must navigate up to the head of a fallen person (having detected a fall) and then begin interaction in order to determine the state of the individual. Currently, path planning is being implemented with an A* algorithm in tandem with a lidar turret in order to provide collision avoidance. A MATLAB script is being run in order to detect the face of the fallen person, I would like to combine these separate subsystems such that when the face is detected, this becomes the new target in the path planning script. My idea is to use the bounding box drawn by the face detection script as a target. I'm looking for advice on how to instruct the robot to rotate in order to make the bounding box in the centre of it's vision frame, and then proceed forward in order to reach the fallen person's head.
  댓글 수: 2
Jan
Jan 2018년 3월 21일
The question is very general. Many information are not needed to define the problem clearly. Better post, what the inputs are (a picture?) and what you want to achieve (calculating the its 3D position?). I do not think that the readers can guess how to instruct your robot to change its position without knowing anything about the interface.
Callum McMenemy
Callum McMenemy 2018년 3월 21일
편집: Callum McMenemy 2018년 3월 21일
Thanks for your reply, I will try and be more specific. We are using an android handset which is docked into the front of our mobile robot. The handset is running an IP Webcam app, the video feed from this app is imported via the URL into MATLAB. Face detection and tracking is performed on this live video feed, I have attached a picture showing a fallen person with the bounding box around the head. The problem is confined to two dimensions as we are using a single camera. My initial thinking is that if a variable can be created for the bounding box (which gives the area), then this could be used within the path-planning script. My idea being to use a loop which causes the robot to move forwards as long as the area of the bounding box increases (that is to say the robot is moving closer to the head). We have a wifi module on the mobile robot which is taking care of comms between the robot and the computer, so this query is regarding the integration of the face detection and path planning scripts which are both running in MATLAB

댓글을 달려면 로그인하십시오.

답변 (0개)

카테고리

Help CenterFile Exchange에서 Computer Vision Toolbox에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by