3

Computer commands of all kinds — speech, keyboard and mouse — are much easier to use when they’re consistent across programs.

At the base level, it’s important that common elements like drop-down menus act the same. You control drop-down menus without thinking — click on an element or use the Left, Right, Up, Down and Enter keys.

Consistent commands are the real-world equivalent of having the same gravity in every room, or keys turning the same way to unlock.

Web applications are looking more and more like standard computer programs, but sometimes the elements that look familiar don’t act the way we’re used to. Drop-down menus usually respond in a familiar way to the mouse, but often don’t respond to the Up, Down and Enter keys.

But perhaps things are getting better.

The first drop-down menus to show up on Google Docs didn’t respond to Left, Right, Up, Down and Enter. Then most of the folder-view drop-down menus were arrow key/Enter enabled, but not document menus. A few months ago document menus changed from looking tab-like to looking more menu like, but still didn’t respond to arrow keys and Enter. Then, sometime in the last few weeks, the Doc menus were arrow key/Enter enabled (the change didn’t show up on the update notice).

The keyboard shortcuts enable better speech navigation as well. I can say, for instance, “3 Down Enter” to choose an item in an open menu, “3 Down 2 Right Enter” to choose a color on the open color menu, or “7 Right Wait 3″ to take a three-second peak at each of the seven successive menus starting with the file menu open.

This is a great trend.

Now all we need is keyboard shortcuts to open the menus in the first place. We also need the same kind of control in all Web applications, including Google spreadsheets.

Question: when you’re looking for a website you’ve been to before, but haven’t put it on your UC List or in your bookmarks, what’s the fastest way to get back to it?

I’ve got a two-step solution for you, assuming you’re starting in an open browser. It works the same in Firefox and Internet Explorer.

1. Combine the command that puts the cursor in the address bar with the first two letters of whatever you’re looking for. If I’m looking for the Evite site, for instance for instance, I would say “Under Delta e v”

2. If the first choice is what you want say “Down Enter” to finish the job, if it’s the second choice “2 Down Enter” etc.

The second fastest way to look up a word in a dictionary using Utter Command is to select the word, then say “This Dictionary Search”. This command looks up the selection in dictionary.com and returns the results in a browser page.

The fastest way is to combine selecting the word and searching. For instance, “Word Dictionary Search”.

You can use these commands whether or not a browser is open.

Happy searching.

I’ve been getting a lot of questions lately about filling out forms using speech commands.

Here’s how it works:

The UC Keyword List allows you to say “Find” followed by any word or phrase to select that word or phrase in any program that has a Find dialog box. This includes Firefox and Internet Explorer. You can combine the word-finding ability with the Tab key to go straight to any field. For example, “Find First Tab” puts your cursor in the “First Name” field.

To see the forms facility in action, take this self-guided tour:
“Demo 2 File”
“Find Address Tab”
44 State St.
“Find Phone Tab”
555-555-5555

The Keyword List comes loaded with common key words and phrases. Say “Add Keyword” to add your own (say “UC Lesson 10.1″ for detailed instructions).

Keyboard shortcuts are powerful tools for the speech interface because they work across all programs and they can be combined — you can say several keyboard shortcuts in one phrase to speed things up.

This is why we encourage all software makers to make all features available via keyboard shortcuts.

Google is experimenting with adding keyboard shortcuts to search results. Here are the experimental keyboard shortcuts:

And here’s how to speed things up further with Utter Command combinations:

To try these out

1. Go to the Google experimental page www.google.com/experimental/1
2. Under the Keyboard Shortcuts heading click “Join Experiment”
3. Go to regular Google search www.google.com2 or Advanced Google search www.google.com/advanced_search?hl=en3, type a query, then try the shortcuts on the results.

As long as you’re logged in you’ll be able to use these shortcuts in the regular and advanced Google search pages.

Note: the Join Experiment button uses cookies. If your browser is set to remove all cookies at the end of a session and you want to retain this setting add www.google.com to your exceptions list (Firefox: Tools/Options/Privacy/Exceptions; Internet Explorer: Tools/Options/Privacy/Sites).