How do I access the current point on a plot that is a contour plot?

I want to write a buttondownfcn for obtaining the points on a contour plot. I know doing this on the axes will work but is there a way to do it on the "contour class."

The reason is that I want to implement this in AppDesigner, which doesn't support buttondownfcn on UIAxes.