TTS and speech recognization are items already in line. It is possible to use these systems now. These can lead to prowerful real-time translation tools.
As for sign language, its not just the hands, but shadows on the face for certain facial expressions are needed for higher quality sign language. There are websites that do advertise simulated facial paralanguage for sign language. Perhaps those could be helpful.