How to remove background from image to detect object?

I am doing my project work on on-tree fruit image processing, where I have to detect only fruit.I take mango fruit for project,but due to background color and fruit color are same I can't identify the proper fruit.

[John BG]

having a look at the same images you are considering for your project would greatly help readers avoid guessing.

[Image Analyst]

Sounds like a situation for deep learning.