Detect broken fishing nets

Hi, i am looking for defects on images with pattern, for example an image with fishing nets. How can i detect that a texel on image is broken? Until now the detection is done by measuring the Area of each texel, the problem is that texel 60 is not broken, nevertheless it is detected due to the fact that it is quite big. Any suggestions?

*The image is this