A space for expression

Your hands.
A voice.

Explore sign-to-text and voice, one gesture at a time.

On-device tracking. Your camera stays private.
01

Live capture / 01

Camera off
Make yourself heard. Start your camera to begin tracking
HANDSPEAK VISIONSTATIC LETTERS
CAM_01 ● OFFLINELOCAL VISION / PRIVATE BY DESIGN

For words, select Record a word and wait for the countdown. Signing alone does not start a recording.

Camera offExpression: Camera offVisible facial movements · not a measure of emotion

Use a well-lit space and keep your palm facing the camera.

02

Your words / ready to review

Recognized words will appear here…

Hold each sign steadyLetters are added after a stable detection.

Move between signsLower your hand briefly before repeating a letter.

Saved translations

Communication history

Export CSV

No saved sessions yet.

0Saved sessions
0Detections
0%Average confidence
0 msAverage processing
Research evaluation

Help measure the system.

Submit the study’s 5-point evaluation for accuracy, usability, and performance. Responses are stored anonymously.

0 responsesAccuracy —Usability —Performance —
5
5
5
Quick reference

Signs HandSpeak knows

Seven static letters are pretrained. Teach the 5 gesture in AI Studio to add it.

Personalized machine learning

Recognize letters, then personalize your signing.

Seven letters come pretrained from ASL image examples. Start the camera to try them, or capture your own examples to personalize recognition. Teach the 5 gesture before using it. Uncertain poses are left blank instead of guessed. Camera frames stay on your device.

21 landmarksOn-device trainingNo images stored
AI training setLoading pretrained letters…

Start the camera above, hold the selected gesture, then capture samples.

Experimental · pretrained vocabulary

Say it with a sign.

Select Record a word beside the camera. It switches to Words in motion and starts a countdown. Sign one supported word during the capture, then review the result here. Personal training is optional.

Loading pretrained words…

Loading pretrained vocabulary…

Pretrained vocabulary will appear here.

Each recording has a 1.5-second countdown, then captures 2.5 seconds of movement.

Optional: add your own word examples

Record at least three examples for a new word. Removing personal examples keeps the pretrained vocabulary.

Use only the listed words. Other signs can be mistaken for a supported word. This small PopSign ASL model has limited accuracy; review each suggestion before adding or speaking it. Personal examples stay in this browser. Evaluation results · Dataset credit

Built for inclusion

Communication should feel effortless.

HandSpeak Web is a capstone prototype that uses computer vision to help bridge everyday communication between deaf, hard-of-hearing, and hearing individuals. It recognizes selected static letters and offers an experimental pretrained vocabulary for moving signs. Face landmarks are displayed for visual feedback; they are not used to interpret identity, emotions, or ASL grammar.

13Pretrained signs
100%in browser
0frames stored