Csound Csound-dev Csound-tekno Search About

[Cs-dev] Syncing csound to video

Date2012-01-23 07:12
FromAlex Weiss
Subject[Cs-dev] Syncing csound to video
AttachmentsNone  None  
Hi group

This is somewhat off-topic, but maybe someone can help out. I use csound for a lot of video and film work, so I've been trying to put together a frontend (using the Csound API) that syncs csound playback to video. But no luck so far -- this whole syncing issue is way more pesty than I thought, and I can't find _any_ literature on syncing audio and video in a realtime context. Has anybody ever tried anything like this, or would anybody know at least where to start?

Thanks,

Alex 

Date2012-01-23 07:30
FromErik de Castro Lopo
SubjectRe: [Cs-dev] Syncing csound to video
Alex Weiss wrote:

> But no
> luck so far -- this whole syncing issue is way more pesty than I thought,
> and I can't find _any_ literature on syncing audio and video in a realtime
> context.

Thats because its a bit of a black art.

> Has anybody ever tried anything like this, or would anybody know
> at least where to start?

Over a decade ago I worked for company that produced high end equipment
for post production work. WHile there, I designed the hardware that
synchronised the audio clocks to external audio and video clocks.

Places to start would be to look at the JACK audio connect kit on
Linux (also OSX I think) and see if you can get Csound following
that.

Another possiblity would be to get Csound generating a Linear Time
Code audio track (if LTC is still being used) and have the external
video machines follow that.

Erik
-- 
----------------------------------------------------------------------
Erik de Castro Lopo
http://www.mega-nerd.com/

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2012-01-23 07:39
FromAlex Weiss
SubjectRe: [Cs-dev] Syncing csound to video
AttachmentsNone  None  


On Sun, Jan 22, 2012 at 11:30 PM, Erik de Castro Lopo <mle+la@mega-nerd.com> wrote:

Over a decade ago I worked for company that produced high end equipment
for post production work. WHile there, I designed the hardware that
synchronised the audio clocks to external audio and video clocks.

That sounds both amazing and terrifying!
 

Another possiblity would be to get Csound generating a Linear Time
Code audio track (if LTC is still being used) and have the external
video machines follow that.

That's a great idea for external video hardware, but what I'm trying to do is completely software-based, e.g. I just want to play a QT video file in hard sync to csound. I realize that a lof of the nasty details are OS-dependent, but I think what I'm struggling with are the underlying principles (if there are any, that is...). Oh well...

Date2012-01-23 07:50
FromTito Latini
SubjectRe: [Cs-dev] Syncing csound to video
AttachmentsNone  

Date2012-01-23 07:51
FromErik de Castro Lopo
SubjectRe: [Cs-dev] Syncing csound to video
Alex Weiss wrote:

> On Sun, Jan 22, 2012 at 11:30 PM, Erik de Castro Lopo
> wrote:
> >
> >
> > Over a decade ago I worked for company that produced high end equipment
> > for post production work. WHile there, I designed the hardware that
> > synchronised the audio clocks to external audio and video clocks.
> >
> 
> That sounds both amazing and terrifying!

It worked out really well in the end. Our machine was one of the fastest
to lock onto external sources and had one of the lowest audio clock
jitters at the time. It was a nice little project.

> That's a great idea for external video hardware, but what I'm trying to do
> is completely software-based, e.g. I just want to play a QT video file in
> hard sync to csound. I realize that a lof of the nasty details are
> OS-dependent, but I think what I'm struggling with are the underlying
> principles (if there are any, that is...). Oh well...

What OS are you on? JACK may be a solution.

Erik
-- 
----------------------------------------------------------------------
Erik de Castro Lopo
http://www.mega-nerd.com/

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2012-01-23 08:30
FromAlex Weiss
SubjectRe: [Cs-dev] Syncing csound to video
AttachmentsNone  None  


On Sun, Jan 22, 2012 at 11:51 PM, Erik de Castro Lopo <mle+la@mega-nerd.com> wrote:

What OS are you on? JACK may be a solution.

I'm on OS X, so Tito's suggestion of looking into Xjadeo sounds promising. I'll take a look at the code... Thanks! 

Date2012-01-23 10:31
FromJustin Glenn Smith
SubjectRe: [Cs-dev] Syncing csound to video
Which reminds me - does the latest csound have the ability to control or follow the jack transport yet? If csound could rewind the score when the transport hits 0, and seek with the transport, etc, you could hack together a video scoring app with a simple frontend to edit a notelist (tclcsound and a text widget would suffice) plus xjaedo to view the video.

Alex Weiss wrote:
> On Sun, Jan 22, 2012 at 11:51 PM, Erik de Castro Lopo
> wrote:
>>
>> What OS are you on? JACK may be a solution.
> 
> 
> I'm on OS X, so Tito's suggestion of looking into Xjadeo sounds promising.
> I'll take a look at the code... Thanks!
> 
> 
> 
> ------------------------------------------------------------------------
> 
> ------------------------------------------------------------------------------
> Try before you buy = See our experts in action!
> The most comprehensive online learning library for Microsoft developers
> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> Metro Style Apps, more. Free future releases when you subscribe now!
> http://p.sf.net/sfu/learndevnow-dev2
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel


------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2012-01-23 10:51
Frompeiman khosravi
SubjectRe: [Cs-dev] Syncing csound to video
AttachmentsNone  None  
Yes I second this. I did an audiovisual project a while back using Ardour and Xjadeo. I don't see why it wouldn't work with Csound running Jack.

P

On 23 January 2012 08:30, Alex Weiss <alexweiss86@gmail.com> wrote:


On Sun, Jan 22, 2012 at 11:51 PM, Erik de Castro Lopo <mle+la@mega-nerd.com> wrote:

What OS are you on? JACK may be a solution.

I'm on OS X, so Tito's suggestion of looking into Xjadeo sounds promising. I'll take a look at the code... Thanks! 

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csound-devel



Date2012-01-23 10:53
FromVictor Lazzarini
SubjectRe: [Cs-dev] Syncing csound to video
http://www.csounds.com/manual/html/jacktransport.html

On 23 Jan 2012, at 10:31, Justin Glenn Smith wrote:

> Which reminds me - does the latest csound have the ability to control or follow the jack transport yet? If csound could rewind the score when the transport hits 0, and seek with the transport, etc, you could hack together a video scoring app with a simple frontend to edit a notelist (tclcsound and a text widget would suffice) plus xjaedo to view the video.
> 
> Alex Weiss wrote:
>> On Sun, Jan 22, 2012 at 11:51 PM, Erik de Castro Lopo
>> wrote:
>>> 
>>> What OS are you on? JACK may be a solution.
>> 
>> 
>> I'm on OS X, so Tito's suggestion of looking into Xjadeo sounds promising.
>> I'll take a look at the code... Thanks!
>> 
>> 
>> 
>> ------------------------------------------------------------------------
>> 
>> ------------------------------------------------------------------------------
>> Try before you buy = See our experts in action!
>> The most comprehensive online learning library for Microsoft developers
>> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
>> Metro Style Apps, more. Free future releases when you subscribe now!
>> http://p.sf.net/sfu/learndevnow-dev2
>> 
>> 
>> ------------------------------------------------------------------------
>> 
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
> 
> 
> ------------------------------------------------------------------------------
> Try before you buy = See our experts in action!
> The most comprehensive online learning library for Microsoft developers
> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
> Metro Style Apps, more. Free future releases when you subscribe now!
> http://p.sf.net/sfu/learndevnow-dev2
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net