Outfox: speech, sound, and more for Firefox

| tags: windows, mac, programming, enabling technology, ubuntu

Quick net

Outfox is a Firefox extension that allows in-page JavaScript to access local platform services and devices such as text-to-speech synthesis, sound playback and game controllers. You can read all about it at its Google Code page and discuss it in its Google Group.

Motivation

In our continuing pursuit of the best platform for delivering accessible games and tools to people with disabilities we are now focusing on Firefox to see what we can accomplish from inside the browser. Up until recently, we've used Python. Its a great language and we've delivered thousands of copies of our apps to people all over the world but I kept thinking we could do better. For example, the ability to author games in Hark the Sound has enabled teachers to do things we never imagined but sharing games is so complicated that is almost never happens. In contrast, the exciting response we've seen to Tar Heel Reader with 419 books in 3 languages after just 10 weeks online has convinced me that browser-based apps can have a big place in our work.

Firefox is a nearly perfect platform; it runs everywhere we want to be and it is easy to program but it has a few deficiencies that limit what we can do. Many of our users are blind or visually impaired. For these kids, speech and sound are a must. Speech and sound are important for kids who can see as well. For example, many beginning readers benefit from having text read to them. Unfortunately, sound in the browser gets little respect.

We used SoundManager2 with a web-based text-to-speech server in Tar Heel Reader. It works well enough but the delays associated with fetching speech as mp3s over the web and the requirement to be online to get speech look bad in comparison locally hosted program.

Outfox

Outfox provides a simple programming interface to JavaScript running in the browser so it can access services on the computer that aren't normally available. In this first release, we enable access to speech and multi-channel sound with callbacks into JavaScript at the beginning and ends of words and sounds. Soon we expect to extend it to include joysticks, DDR pads, and such. With access to these capabilities I believe we can implement browser-based versions of our most popular games such as Hark the Sound, Sonic Zoom, and Descent into Madness. If things work as I hope, teachers will have access to hundreds of curriculum-related games and a simple way to write and share their own. I hope we'll get cross-over between the amazing community behind Tar Heel Reader and the community of teachers of the visually impaired and orientation and mobility teachers who use our games for blind children. When we start seeing books about games and games about books, we'll know that synergy is taking hold.

I'm excited about offering Firefox with speech and sound to my students to see what amazing things they'll think of doing. How about self-voicing web pages and maps? How about books with interactive, switch-accessible games embedded?

This initial version is likely buggy on at least one of the three operating systems we're supporting. Please give it a try. Or better yet, download the source, and help us make it better.

Also, help us get it out of the sandbox at Mozilla Addons by trying and commenting on it.