image segmentation of asymmetric images

I have 120 images of breast thermograms and its ground truth images in a dataset

I need to segment 120 images into left and right part of the breasts.

I used the attached code but the code does not work well with many asymmetric images.

herein i am attaching two images

kindly use their names in the code for knowing the problem i am facing