Csound Csound-dev Csound-tekno Search About

[Csnd] "Green Screen" synthesis

Date2014-02-22 15:12
Fromcameron bobro
Subject[Csnd] "Green Screen" synthesis
Here's a little improvised 3-voice canon using what I call "green screen" synthesis, an approach inspired by the use of motion capture with animation in film. In this case I wanted to get into the uncanny valley but lean toward the acoustic side. 

Like all the pieces at the site, this piece is "microtonal" and cannot be rendered in 12-tET (where it is impossible to, for example, represent distinct minor, middle and major thirds in the same piece) but could be done roughly in 17 equal tones to the octave.

I do all my synthesis sounds using this approach, usually playing clarinet as the acoustic source Csound tracks in amplitude and pitch (as in this piece), sometimes with saz, and sometimes, as you can hear in other pieces, found percussion, which means me whacking on stuff as the original source material.

What's most important, I've found, is making the synthesizer very sensitive in "pantographing" changes in input parameters to changes in various modulations.

thanks for listening

https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro


Date2014-02-22 17:00
FromSteven Yi
SubjectRe: [Csnd] "Green Screen" synthesis
Hi Cameron,

Thanks for sharing that, I enjoyed it very much!  BTW: You might want
to post tracks to the Csound SoundCloud group as well:

https://soundcloud.com/groups/csound

Thanks!
steven

On Sat, Feb 22, 2014 at 10:12 AM, cameron bobro  wrote:
> Here's a little improvised 3-voice canon using what I call "green screen"
> synthesis, an approach inspired by the use of motion capture with animation
> in film. In this case I wanted to get into the uncanny valley but lean
> toward the acoustic side.
>
> Like all the pieces at the site, this piece is "microtonal" and cannot be
> rendered in 12-tET (where it is impossible to, for example, represent
> distinct minor, middle and major thirds in the same piece) but could be done
> roughly in 17 equal tones to the octave.
>
> I do all my synthesis sounds using this approach, usually playing clarinet
> as the acoustic source Csound tracks in amplitude and pitch (as in this
> piece), sometimes with saz, and sometimes, as you can hear in other pieces,
> found percussion, which means me whacking on stuff as the original source
> material.
>
> What's most important, I've found, is making the synthesizer very sensitive
> in "pantographing" changes in input parameters to changes in various
> modulations.
>
> thanks for listening
>
> https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro
>

Date2014-02-22 18:09
FromAaron Krister Johnson
Subject[Csnd] Re: "Green Screen" synthesis
Nice work. I love the organic expressiveness you are able to get through the
tracking opcodes triggering other sounds...what is that almost medieval
sounding brass-like timbre?

Did you improvise this, but work out the end-goal sonority before hand? If
it wasn't pre-thought-out, it was a nicely fortuitous and satisfying ending.

-AKJ



--
View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732747.html
Sent from the Csound - General mailing list archive at Nabble.com.

Date2014-02-22 19:32
Fromfrancesco
Subject[Csnd] Re: "Green Screen" synthesis
Really nice,
thanks for sharing.

ciao,
francesco.




--
View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732748.html
Sent from the Csound - General mailing list archive at Nabble.com.

Date2014-02-22 20:15
FromOeyvind Brandtsegg
SubjectRe: [Csnd] Re: "Green Screen" synthesis
Beautiful.
I totally did not understand what you meant with the green screen
synthesis, but would like to know more. Do tell.
Oeyvind

2014-02-22 20:32 GMT+01:00 francesco :
> Really nice,
> thanks for sharing.
>
> ciao,
> francesco.
>
>
>
>
> --
> View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732748.html
> Sent from the Csound - General mailing list archive at Nabble.com.
>
>
> Send bugs reports to the Sourceforge bug trackers
> csound6:
>             https://sourceforge.net/p/csound/tickets/
> csound5:
>             https://sourceforge.net/p/csound/bugs/
> Discussions of bugs and features can be posted here
> To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"
>
>



-- 

Oeyvind Brandtsegg
Professor of Music Technology
NTNU
7491 Trondheim
Norway
Cell: +47 92 203 205

http://flyndresang.no/
http://www.partikkelaudio.com/
http://soundcloud.com/brandtsegg
http://soundcloud.com/t-emp

Date2014-02-22 23:46
FromJustin Smith
SubjectRe: [Csnd] Re: "Green Screen" synthesis
For CGI, to do synthetic characters like Gollum in LoTR, they record actors in front of a green screen and capture their motion, then a synthesized character is rendered which follows the parameters of that motion. Finally the synthesized image is separated from the monochromatic green background and placed onto the natural background alongside non-CGI characters. In this case I think there's an analogy from motion capture to drive animation to pitch / amplitude tracking of a natural instrument in order to generate synthesis parameters.

Does the analogy go deeper? Is there an analog to the chroma based removal of the original background before compositing?


On Sat, Feb 22, 2014 at 12:15 PM, Oeyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote:
Beautiful.
I totally did not understand what you meant with the green screen
synthesis, but would like to know more. Do tell.
Oeyvind

2014-02-22 20:32 GMT+01:00 francesco <ilterzouomo@fastwebnet.it>:
> Really nice,
> thanks for sharing.
>
> ciao,
> francesco.
>
>
>
>
> --
> View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732748.html
> Sent from the Csound - General mailing list archive at Nabble.com.
>
>
> Send bugs reports to the Sourceforge bug trackers
> csound6:
>             https://sourceforge.net/p/csound/tickets/
> csound5:
>             https://sourceforge.net/p/csound/bugs/
> Discussions of bugs and features can be posted here
> To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"
>
>



--

Oeyvind Brandtsegg
Professor of Music Technology
NTNU
7491 Trondheim
Norway
Cell: +47 92 203 205

http://flyndresang.no/
http://www.partikkelaudio.com/
http://soundcloud.com/brandtsegg
http://soundcloud.com/t-emp


Send bugs reports to the Sourceforge bug trackers
csound6:
            https://sourceforge.net/p/csound/tickets/
csound5:
            https://sourceforge.net/p/csound/bugs/
Discussions of bugs and features can be posted here
To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"




Date2014-02-23 12:58
FromVictor Lazzarini
SubjectRe: [Csnd] "Green Screen" synthesis
yes, this is very nice. Could you tell us more about the source sounds for the 2nd and 3rd voices?
On 22 Feb 2014, at 15:12, cameron bobro  wrote:

> Here's a little improvised 3-voice canon using what I call "green screen" synthesis, an approach inspired by the use of motion capture with animation in film. In this case I wanted to get into the uncanny valley but lean toward the acoustic side. 
> 
> Like all the pieces at the site, this piece is "microtonal" and cannot be rendered in 12-tET (where it is impossible to, for example, represent distinct minor, middle and major thirds in the same piece) but could be done roughly in 17 equal tones to the octave.
> 
> I do all my synthesis sounds using this approach, usually playing clarinet as the acoustic source Csound tracks in amplitude and pitch (as in this piece), sometimes with saz, and sometimes, as you can hear in other pieces, found percussion, which means me whacking on stuff as the original source material.
> 
> What's most important, I've found, is making the synthesizer very sensitive in "pantographing" changes in input parameters to changes in various modulations.
> 
> thanks for listening
> 
> https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro
> 



Date2014-02-24 08:36
Fromcameron bobro
SubjectRe: [Csnd] "Green Screen" synthesis
Thanks Steven and everyone for the nice comments!

Although I joined the csound group on SoundCloud some time ago, I didn't realize that there were more than a couple of pieces up- now I find that there is a large amount of music there, all sounding fantastic. 



 


From: Steven Yi <stevenyi@gmail.com>
To: Csound <csound@lists.bath.ac.uk>
Sent: Saturday, February 22, 2014 6:00 PM
Subject: Re: [Csnd] "Green Screen" synthesis

Hi Cameron,

Thanks for sharing that, I enjoyed it very much!  BTW: You might want
to post tracks to the Csound SoundCloud group as well:

https://soundcloud.com/groups/csound

Thanks!
steven

On Sat, Feb 22, 2014 at 10:12 AM, cameron bobro <misterbobro@yahoo.com> wrote:
> Here's a little improvised 3-voice canon using what I call "green screen"
> synthesis, an approach inspired by the use of motion capture with animation
> in film. In this case I wanted to get into the uncanny valley but lean
> toward the acoustic side.
>
> Like all the pieces at the site, this piece is "microtonal" and cannot be
> rendered in 12-tET (where it is impossible to, for example, represent
> distinct minor, middle and major thirds in the same piece) but could be done
> roughly in 17 equal tones to the octave.
>
> I do all my synthesis sounds using this approach, usually playing clarinet
> as the acoustic source Csound tracks in amplitude and pitch (as in this
> piece), sometimes with saz, and sometimes, as you can hear in other pieces,
> found percussion, which means me whacking on stuff as the original source
> material.
>
> What's most important, I've found, is making the synthesizer very sensitive
> in "pantographing" changes in input parameters to changes in various
> modulations.
>
> thanks for listening
>
> https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro

>


Send bugs reports to the Sourceforge bug trackers
csound6:
            https://sourceforge.net/p/csound/tickets/
csound5:
            https://sourceforge.net/p/csound/bugs/
Discussions of bugs and features can be posted here
To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"






Date2014-02-24 09:56
Fromcameron bobro
SubjectRe: [Csnd] Re: "Green Screen" synthesis
Thanks, AKJ. It's not really triggering, though- the amplitude and pitch of the original provide the control signals. So, the pitch follows the original but can be modified at will, and various modulations can be pantographed from pitch and amplitude, and the original audio (or windowed parts of it, or other voices, parts of other voices...) can be directly incorporated in the synthesis.

For example, simply having FM index follow the amplitude envelope exponentially makes for an immediately more "organic" sound. Bandpassing some range of the acoustic original can provide a context-sensitive audio ring-modulation source, and so on.

This particular example is very simple, but the control signals derived from the original (or parts of the original, or parts of the original in relation to what's going on in other acoustic track, and so on) can be wired up to the point where the technique becomes integral to the composition itself. In the little example linked below, "Gamboge Descent",  the first half of the bass part is simply the introductory tenor melody read backwards and an octave down.

The medieval-sounding voice you mention has sort of a smooth vaguely sawish oscillator which gets steeper (therefore more high content) with amplitude and is frequency modulated by a sine at 3:1, index modulated by amplitude. Some bandpassed original is mixed back in. Without any original mixed back in, and a little brighter timbre, it's basically the same as the quite trumpet-sounding timbre in the tune "an uncanny valley". 

In answer to your question, the thing is improvised in stretches, and chord at the end just seemed obvious at the time. The piece is very simple- it's just a round, with various stretches read off at simple pure ratios *(4/3), *(.5), etc. It is possible to do this with a single recorded acoustic voice, then have more "animated" versions offset in time, but in this case I wanted to take advantage of the timing flexibilities provided by acoustic performance, the sort of micro-stretto and microaugmention that I feel is essential to the original spirit of imitative counterpoint, so I played three clarinet tracks. 

Anyway, I would guess that many people here have already thought of possibilities far beyond what's going on in these simple examples, and of course I've taken the thing much further, but I wanted to start with the simplest examples. 

Heh, I thought a paragraph would do, but now I see that it will take an article and some .csd examples ranging from trivial-but-practical to full-blown implementations, which become a kind of interactive instrument/co-composer.

Say, if someone will instruct me how to upload to the Csound SoundCloud page...

https://soundcloud.com/cameron-bobro/gamboge-descent-cbobro


From: Aaron Krister Johnson <aaron@akjmusic.com>
To: csound@lists.bath.ac.uk
Sent: Saturday, February 22, 2014 7:09 PM
Subject: [Csnd] Re: "Green Screen" synthesis

Nice work. I love the organic expressiveness you are able to get through the
tracking opcodes triggering other sounds...what is that almost medieval
sounding brass-like timbre?

Did you improvise this, but work out the end-goal sonority before hand? If
it wasn't pre-thought-out, it was a nicely fortuitous and satisfying ending.

-AKJ



--
View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732747.html
Sent from the Csound - General mailing list archive at Nabble.com.



Send bugs reports to the Sourceforge bug trackers
csound6:
            https://sourceforge.net/p/csound/tickets/
csound5:
            https://sourceforge.net/p/csound/bugs/
Discussions of bugs and features can be posted here
To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"





Date2014-02-24 10:55
Fromcameron bobro
SubjectRe: [Csnd] "Green Screen" synthesis
Thanks Victor,

just discovered that yahoo sends a goodly portion of the csound list posts straight to the bin with the viagra ads! Arg....

All three voices are pretty much the same patch with some minor tweaks- for example the lowest voice has 3:1 FM ratio rather than 2:1. There's a simple trick modulated phase distortion trick going on which  also varies- one voice will tend toward more"squarish/pulse-y" with amplitude, another (the lowest in this example) to more "sawish". Easier to see in a .csd, I'll try to get one up this weekend (going out of town today).

-Cameron


From: Victor Lazzarini <Victor.Lazzarini@nuim.ie>
To: csound@lists.bath.ac.uk
Sent: Sunday, February 23, 2014 1:58 PM
Subject: Re: [Csnd] "Green Screen" synthesis

yes, this is very nice. Could you tell us more about the source sounds for the 2nd and 3rd voices?

On 22 Feb 2014, at 15:12, cameron bobro <misterbobro@yahoo.com> wrote:

> Here's a little improvised 3-voice canon using what I call "green screen" synthesis, an approach inspired by the use of motion capture with animation in film. In this case I wanted to get into the uncanny valley but lean toward the acoustic side.
>
> Like all the pieces at the site, this piece is "microtonal" and cannot be rendered in 12-tET (where it is impossible to, for example, represent distinct minor, middle and major thirds in the same piece) but could be done roughly in 17 equal tones to the octave.
>
> I do all my synthesis sounds using this approach, usually playing clarinet as the acoustic source Csound tracks in amplitude and pitch (as in this piece), sometimes with saz, and sometimes, as you can hear in other pieces, found percussion, which means me whacking on stuff as the original source material.
>
> What's most important, I've found, is making the synthesizer very sensitive in "pantographing" changes in input parameters to changes in various modulations.
>
> thanks for listening
>
> https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro

>



Send bugs reports to the Sourceforge bug trackers
csound6:
            https://sourceforge.net/p/csound/tickets/
csound5:
            https://sourceforge.net/p/csound/bugs/
Discussions of bugs and features can be posted here
To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound"