link lines after hough transform

Hallo, i want to find out a way to connect the beneath lines after performing hough transform.

Those are not all the lines but some of them.

The starting point of each line is depicted by 'o' and the end each line is depicted by 'x'.

I want to connect every segmented line and make one for each fishing net.

Thank you