On-screen keyboard control through mouse click using hand gestures

3 views (last 30 days)
Hi, I have done the mouse click function using hand gestures through the following code. The code is performing the clicking functions fine and also opening files by clicking on desktop icons but when i try to click the buttons on the on-screen keyboard the buttons are not pressed and nothing prints on the text file. Can anybody help me solve that why the clicking is not working on the on-screen keyboard and giving no text results whereas other clicking functions like selecting desktop icons opening files through them are working fine.
if pkNo==1
mouse.mouseMove(bc(:,1), bc(:,2));
end
if pkNo==2
cursor.mousePress(InputEvent.BUTTON1_MASK);
pause(0.1);
cursor.mouseRelease(InputEvent.BUTTON1_MASK);
end
if pkNo==3
cursor.mousePress(InputEvent.BUTTON3_MASK);
pause(0.1);
cursor.mouseRelease(InputEvent.BUTTON3_MASK);
end
  3 Comments
Zainab Zaman
Zainab Zaman on 24 Nov 2019
OS: Windows 10
On-Screen Keyboard: Windows 10 on-screen keyboard
import java.awt.Robot;
import java.awt.event.*;
mouse = Robot;
cursor = Robot;
"mouse" for cursor movement.
"cursor" for clicking.
Lalith Durgam
Lalith Durgam on 8 Jan 2020
Bro can u provide me the source code for mouse operations using hand gestures which is our project. My email id: lalithdurgam20@gmail.com

Sign in to comment.

Answers (0)

Categories

Find more on Language Support in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!