Add "Dictation Mode" - Audio-only typing test for accessibility and transcription practice #7631
|
Is your feature request related to a problem? Describe the solution you'd like The words on the screen are hidden or blurred initially. The system uses the Web Speech API to dictate the words. Users type what they hear, and the system tracks WPM and Accuracy based on the audio output. Option to adjust the "Dictation Speed" (0.8x, 1.0x, 1.2x). Describe alternatives you've considered Additional context |
Replies: 2 comments 10 replies
|
a very basic variant of this is available as funbox "tts" |
|
Sounds very cool. could you join the discord in #development |
|
Hey, this idea sounds really interesting ... |
|
In my case learning to type on a new layout was a horrible experience using quotes, i noticed that my speed on quotes went up to 40 right away, but my speed from writing my own thoughts was 20 at best, so i realized that if you want to get good at writing your ideas or dictation, you have to practice that specifically, so dictation it's the best tool for me. I personally start a youtube video in the background, and i try to write in the ZEN mode as much as i can remember, sometimes i make up words or sentences to cover no talking parts, that's the most comfortable practice mode for me right now. |
|
To add to this suggestion which was merged with this one #7929 . You can also have a 3rd parameter or some AI stuff that would dictate the speed of read ahead. When a quote it's added in the list, the script can identify the fast and slow parts of the quote depending on the first performances of other typists, and increase the pace where the words are very short and common and it's expected a spike in the speed of the typist. It can slowdown on the hard words, it can detect dots and commas in the quote and wait for the words read ahead to decrease slightly before starting a new sentence. In case it's hard to understand what i mean, a sentence like: "World war 3 it's coming and we are expecting that the global damage will be significant" for a super fast typist the script can identify breaks in a sentence like commas, or changes of the flow like the word "and" "then" "however" "meanwhile" "but" and it will read parts between breaks at a speed above their average speed. So a 150 wpm typist would hear: "World war 3 it's coming: , once they reach the letter "r" from "war" which is exactly 15 characters from the end of the sequence read, the next sequence it's read, or part of it if it's too long. In this case once it types that "r", the tts will say "and we are expecting" until the next break in the flow, once the typist types "e" from "we" (15 char before end) the tts will read "that the global damage" (ai can detect that words global and damage are connected words in this sentence and read them together), and again once it reaches "e" from "the" which is 15 letters before end, will finish the sentence to the dot, it's not a great flow to have tts dictate words like "it's" and take a break, a sentence should be broken down into parts easy to digest and understand the meaning of it. However if parts of the quote are consistently hard for many typists the trigger character can be decreased (in this case lower than 15), or increased for the super easy parts by a percent of their average speed. I think that dictation mode should be the main attraction of this entire website tbh, not just a "fun mode", but the main improvement tool. |
I think this is a good starting compromise if it's too difficult and ambitious ^^ Get one of the AI's to break down quotes like this, and the resulted text will be read by the TTS in sequences, and the next sequence will be triggered depending on the average speed of the typist, 10 characters before the end of this one, or 20 and so on, maybe even allow in settings to manually select a percentage/fixed increase based to your own attention span. Also ignore the "mistakes" that the user might type from using punctuation, but include them in the speed calculation. So we don't get penalized for using punctuation and capitals where we feel it makes sense. (also when pressing the omg i forgot what to type key/shortcut) the current word that's being typed wrong should be deleted if exists, then the tts will first read the remaining of the current sequence, and start the next one when appropriate. |
2026-06-07.09-24-54.mp4Well i got it to work pretty sweet locally, with AI help (i don't know how to code). If a coder wants to help fine tune and implement it poke me in discord. |
|
Hey @KitKat20255! Awesome work on prototyping the TTS sequence flow! Since I've been setting up the core TypeScript schemas and workspace integration for this feature, I'd love to collaborate with you to convert your prototype into a clean, production-ready Pull Request for Monkeytype. I'm reaching out on Discord so we can fine-tune the caret-trigger logic and get this merged into the repository!" |
|
@subhashkumar9661 awesome, what's your user ? |
a very basic variant of this is available as funbox "tts"