Lipsycho

Open Source

Lipsynching tool for Adobe's Flash written with MaxMSP

January 2001

selcukartut
selcukartut








 


LipSycho

Lipsycho is a lip sychronization tool which has been developed in MAXMSP. The logic is so simple. Macromedia's Flash is a frame by frame
animation tool where you indicate frame per second rates to set the waiting intervals on each frame. For instance, if fps is set to 25, it means
in a second there will be a flow of 25 frames. This is equivalent to say the time interval between each frames is 1/25 seconds, that is 40 milliseconds.
On the other hand any sound source is also time dependent.

Known bugs:
1) Lip synchorization is absoultely more than relating images with its relevant sound amplitude levels. This application is only a simple solution.
2) Macromedia's Flash has problems in refreshing the frames. My experiments has shown that though I set the fps 25, the time spent between
the intervals are not constant at 40 milliseconds, varies i.e. 30 milliseconds. This problem occurs because of system capabilities as well. Streaming image
and audio are not constantly tied. In sum, the application is not satisfying for web.
(discontinued)
click here to download a flash example.
click here to download the application (windows version(2.1) / mac version(1.1))

selcukartut[2001]