How to find image region if coordinates are provided?

I have coordinates of lip. I have to find lip region from coordinates. Please guide.

[Debraj Maji]

Hi @Shilpa Sonawane,

If I understand correctly, you are trying to perform facial landmark detection in images. Could you please confirm?

[Image Analyst]

If you have the coordinates of the lip region, then don't you already have the lip region? Exactly what do you want as the output that you don't have yet?

[Shilpa Sonawane]

I am working on lipreading. So need to extract lip region.

[Image Analyst]

When you said "if coordinates are provided", so exactly what coordinates are those that are provided in advance? Where or how did you get them?

[Shilpa Sonawane]

Coordinates are extracted using dlib

[Image Analyst]

So you already have the coordinates of the lips, like the outline (x,y) coordinates, and maybe the location of other facial landmarks. So exactly what else are you looking for?

See lip reading image processing articles here:

http://www.visionbib.com/bibliography/contentspeople.html#Face%20Recognition,%20Detection,%20Tracking,%20Gesture%20Recognition,%20Fingerprints,%20Biometrics

[Shilpa Sonawane]

Thank you.

I have to find relation between lip movement and speech i.e. need to find lip features which have imapct on speech features.

Please guide.

[Image Analyst]

I have no experience with lip reading. My only guidance is to look at the papers of people who do have that experience and have succeeded and published papers on the subject. Their algorithms would be better than anything I could offer you. However it looks like you've Accepted the answer below so everyone assumes you used that and now everything is working.

[Shilpa Sonawane]

Yes Sir, I have applied the process to extract lip region & done it.

Thank you again.

Answer 1

[Hassaan]

A simple example to guide you through the process:

% Let's assume img is your image matrix and lipCoords is an Nx2 array of
% (x, y) coordinates outlining the lip region.
% For example:
% lipCoords = [x1, y1; x2, y2; ... ; xN, yN];

% Create a binary mask
mask = poly2mask(lipCoords(:,1), lipCoords(:,2), size(img, 1), size(img, 2));

% Extract the lip region using the binary mask
lipRegion = img;
lipRegion(~mask) = 0; % This sets all pixels outside the lip region to 0

% Display the original image and the extracted lip region
figure;
subplot(1, 2, 1);
imshow(img);
title('Original Image');

subplot(1, 2, 2);
imshow(lipRegion);
title('Extracted Lip Region');

In the code:

• poly2mask is a function that converts a polygon to a region mask.
• lipCoords is assumed to be an array of coordinates for the lip region.
• mask is the binary mask that represents the lip region.
• lipRegion is the part of the image with the lips isolated.

Please replace img and lipCoords with your actual image and coordinates. If the coordinates are in a different format or if you have a list of points that do not form a closed polygon, you might need to use different methods to create the mask.

------------------------------------------------------------------------------------------------------------------------------------------------

If you find the solution helpful and it resolves your issue, it would be greatly appreciated if you could accept the answer. Also, leaving an upvote and a comment are also wonderful ways to provide feedback.

Professional Interests

• Technical Services and Consulting
• Embedded Systems
• Electrical and Electronics Engineering

[Shilpa Sonawane]

Thank you for guidance. I will apply the steps given by you.

Thank you so much.