Entries Tagged Motor impaired

I’m thinking about the client-side interface to our Big Words project with the Center for Literacy and Disability Studies. Rebecca is making good progress on the server-side logic for the games, the instructive feedback machinery that is the essence of this approach. But we need a good looking user interface to keep kids coming back.

Continue reading →

Karen says many kids in wheelchairs never get to experience typical theme park rides. What can we do about that?

We could build or buy a platform that can tilt (say) 20 degrees in two directions under computer control. I don’t think it has to be very high performance at all. We roll the kid’s chair onto the platform and strap it down.

John suggests a platform with a center pivot, springs on 2 sides and stepper motors with cables on the other 2 sides. Missy says we should ask Disney who have all this figured out.

A group of our students go out to a theme park (or the state fair) and record wide-angle HD video, acceleration and good audio. Then we synchronize playback on a big screen (or screens). Perhaps a sub woofer adds some low frequency shake (or maybe the platform could do this). I don’t think we need any “wash out” algorithm for the motion platform. Simply, display the best approximation to the direction of the gravity vector that the tilt platform can manage. We might want to rotate the image to undo some of the tilt. That would be an interesting study on its own.

The log flume ride would be perfect for this. We could spray the rider with some water at the end!

Then we can invite kids in for a virtual carnival or theme park field trip. That would be a ton of fun and an exciting project. Later groups of students could do fully computer generated graphics and sound as more advanced projects.

John suggests we could record historic train rides and such for more educational content.

We link to Tar Heel Reader by having kids read about the experience beforehand and write about it afterward!

I’m going to try to resist immediately jumping on this until I find some $ to pay for it.

Tricia from Texas wrote to say:

Who would benefit? students with visual impairment – and students that need more cuing than they get from visual supports on the printed page

Use vibration feedback in TTS, screen readers, digital auditory text

• To cue for bold text, boxed info, important information
• Software could “read” the text/page and insert vibration to cue the student

But more importantly, to allow the student to tag the auditory text – when they “re-read” the text, the tags trigger vibration. Use different types of vibration (intensity, pattern, etc) for different types of tags.

• Tag as a highlighter, tag a phrase or a paragraph
• Tag specific info they need to capture (main characters, literary action)
• Tag for references
• Tag as notetaking – retrieve only tagged information for later?

Karen suggested long ago and I failed to blog about it, that the WiiMote could be useful for “keeping beat with reading. Kid reads along with program, keeps beat. Shakes the controller on the key words. That way you know the kid is reading.”

Seems to me there is great synergy between these ideas. This would make a great student research project.

Paul posted a really nice video about using Tar Heel Reader over at YouTube. The puppet and the stop motion self assembly of the switch interface are great! Check out Reading with Franz.

I saw iDaft today and think it rocks! You play the samples by typing the corresponding keys on your keyboard. Not surprising technically, its just Flash. But it makes me think about combining fun, music, and literacy. What could we do with music and samples like this to make fun and even educational games for kids with disabilities?

How about putting the samples on the 16 pads you get with 2 DDR pads? Then we could have a game that was something like Guitar Hero where you put the samples in the right places. DJ Hero? Or maybe DJ Revolution? I think our blind visitors would have a ton of fun on Maze Day trying to “sing” along with Harder, Better, Faster, Stronger by stepping on the DDR pads. Think Daft Hands or Daft Bodies on the DDR pad.

Or how about making an AAC device more fun by changing the pitch of the voice like this? Or somehow linking a “word wall” to music so when you put words together in appropriate ways they go with the music?

Suppose you could provide a list of words or word combinations to a web site and it would automagically assign them musical pitches like this. What cool games could we make where students play with words while making music? How could we integrate reading into it? Perhaps the “score” (the words to be spoken) is presented something like the Guitar Hero notes so you have to at least recognize the words to know which to play.

How do we make such a game switch accessible?

I’m thinking out loud here. Help me out folks, some of you have to be more musical and creative than I am. Post a comment.

This is a follow up to my post about Accessible Math Ideas from over a year ago. I finally got a smart high school student, William Condon from the NC School of Science and Math, to implement word prediction with built-in math.

Check out CalcuType online and let us know what you think.

You can type using the virtual keyboard, the standard keyboard, or a mouse. The “mover” and “chooser” keys are adjustable and William included a 3rd “completer” key for quick access to completions. However you’re typing the program will suggest completions much like many other available tools. The key difference is when you type a mathematical expression it will suggest the answer as a completion. So if you type (3+5)*2 it will suggest =16. It handles complicated mathematical expressions including square root and trig functions.

One other neat feature William implemented is the ability to write on a worksheet represented as an HTML form.

It still needs work but we’re at the stage where we need feedback from users who need such a tool.

Atool is an extension to our previous CamKeys project. Like CamKeys, atool allows keyboard input based on a cheap webcam. Atool adds DDR pads (or other game controller buttons) as an additional input and it allows playing recorded sounds on input events.
Continue reading →

Tar Heel Reader is a web site designed to help teachers make easy-to-read books for children with disabilities. It has a growing selection of books to read and a simple process for creating new books using pictures found on Flickr.
Continue reading →

Notes from a conversation with Karen. Always great fun.
Continue reading →

Minh-Tri Pham wrote with info on his PyCV package. This could be very useful for locating kid’s faces for games and therapy for kids who are motor impaired. His demo works fine on my Ubuntu system.