No. You do not want to rotate a matrix. You have a list of points that lie in the plane, described as cooordinates in each column of the matrix. So every column of that matrix apparently contains the (x,y) coordinates of one point.
Now, you want to rotate those points, apparently around the origin? You tell us you have a "rotation vector". What does that mean to you?