[Csnd] "Green Screen" synthesis
Date | 2014-02-22 15:12 |
From | cameron bobro |
Subject | [Csnd] "Green Screen" synthesis |
Here's a little improvised 3-voice canon using what I call "green screen" synthesis, an approach inspired by the use of motion capture with animation in film. In this case I wanted to get into the uncanny valley but lean toward the acoustic side. Like all the pieces at the site, this piece is "microtonal" and cannot be rendered in 12-tET (where it is impossible to, for example, represent distinct minor, middle and major thirds in the same piece) but could be done roughly in 17 equal tones to the octave. I do all my synthesis sounds using this approach, usually playing clarinet as the acoustic source Csound tracks in
amplitude and pitch (as in this piece), sometimes with saz, and sometimes, as you can hear in other pieces, found percussion, which means me whacking on stuff as the original source material. What's most important, I've found, is making the synthesizer very sensitive in "pantographing" changes in input parameters to changes in various modulations. thanks for listening https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro |
Date | 2014-02-22 17:00 |
From | Steven Yi |
Subject | Re: [Csnd] "Green Screen" synthesis |
Hi Cameron, Thanks for sharing that, I enjoyed it very much! BTW: You might want to post tracks to the Csound SoundCloud group as well: https://soundcloud.com/groups/csound Thanks! steven On Sat, Feb 22, 2014 at 10:12 AM, cameron bobro |
Date | 2014-02-22 18:09 |
From | Aaron Krister Johnson |
Subject | [Csnd] Re: "Green Screen" synthesis |
Nice work. I love the organic expressiveness you are able to get through the tracking opcodes triggering other sounds...what is that almost medieval sounding brass-like timbre? Did you improvise this, but work out the end-goal sonority before hand? If it wasn't pre-thought-out, it was a nicely fortuitous and satisfying ending. -AKJ -- View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732747.html Sent from the Csound - General mailing list archive at Nabble.com. |
Date | 2014-02-22 19:32 |
From | francesco |
Subject | [Csnd] Re: "Green Screen" synthesis |
Really nice, thanks for sharing. ciao, francesco. -- View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732748.html Sent from the Csound - General mailing list archive at Nabble.com. |
Date | 2014-02-22 20:15 |
From | Oeyvind Brandtsegg |
Subject | Re: [Csnd] Re: "Green Screen" synthesis |
Beautiful. I totally did not understand what you meant with the green screen synthesis, but would like to know more. Do tell. Oeyvind 2014-02-22 20:32 GMT+01:00 francesco |
Date | 2014-02-22 23:46 |
From | Justin Smith |
Subject | Re: [Csnd] Re: "Green Screen" synthesis |
For CGI, to do synthetic characters like Gollum in LoTR, they record actors in front of a green screen and capture their motion, then a synthesized character is rendered which follows the parameters of that motion. Finally the synthesized image is separated from the monochromatic green background and placed onto the natural background alongside non-CGI characters. In this case I think there's an analogy from motion capture to drive animation to pitch / amplitude tracking of a natural instrument in order to generate synthesis parameters. Does the analogy go deeper? Is there an analog to the chroma based removal of the original background before compositing? On Sat, Feb 22, 2014 at 12:15 PM, Oeyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote: Beautiful. |
Date | 2014-02-23 12:58 |
From | Victor Lazzarini |
Subject | Re: [Csnd] "Green Screen" synthesis |
yes, this is very nice. Could you tell us more about the source sounds for the 2nd and 3rd voices? On 22 Feb 2014, at 15:12, cameron bobro |
Date | 2014-02-24 08:36 |
From | cameron bobro |
Subject | Re: [Csnd] "Green Screen" synthesis |
Thanks Steven and everyone for the nice comments! Although I joined the csound group on SoundCloud some time ago, I didn't realize that there were more than a couple of pieces up- now I find that there is a large amount of music there, all sounding fantastic. From: Steven Yi <stevenyi@gmail.com> To: Csound <csound@lists.bath.ac.uk> Sent: Saturday, February 22, 2014 6:00 PM Subject: Re: [Csnd] "Green Screen" synthesis Hi Cameron, Thanks for sharing that, I enjoyed it very much! BTW: You might want to post tracks to the Csound SoundCloud group as well: https://soundcloud.com/groups/csound Thanks! steven On Sat, Feb 22, 2014 at 10:12 AM, cameron bobro <misterbobro@yahoo.com> wrote: > Here's a little improvised 3-voice canon using what I call "green screen" > synthesis, an approach inspired by the use of motion capture with animation > in film. In this case I wanted to get into the uncanny valley but lean > toward the acoustic side. > > Like all the pieces at the site, this piece is "microtonal" and cannot be > rendered in 12-tET (where it is impossible to, for example, represent > distinct minor, middle and major thirds in the same piece) but could be done > roughly in 17 equal tones to the octave. > > I do all my synthesis sounds using this approach, usually playing clarinet > as the acoustic source Csound tracks in amplitude and pitch (as in this > piece), sometimes with saz, and sometimes, as you can hear in other pieces, > found percussion, which means me whacking on stuff as the original source > material. > > What's most important, I've found, is making the synthesizer very sensitive > in "pantographing" changes in input parameters to changes in various > modulations. > > thanks for listening > > https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro > Send bugs reports to the Sourceforge bug trackers csound6: https://sourceforge.net/p/csound/tickets/ csound5: https://sourceforge.net/p/csound/bugs/ Discussions of bugs and features can be posted here To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound" |
Date | 2014-02-24 09:56 |
From | cameron bobro |
Subject | Re: [Csnd] Re: "Green Screen" synthesis |
Thanks, AKJ. It's not really triggering, though- the amplitude and pitch of the original provide the control signals. So, the pitch follows the original but can be modified at will, and various modulations can be pantographed from pitch and amplitude, and the original audio (or windowed parts of it, or other voices, parts of other voices...) can be directly incorporated in the synthesis. For example, simply having FM index follow the amplitude envelope exponentially makes for an immediately more "organic" sound. Bandpassing some range of the acoustic original can provide a context-sensitive audio ring-modulation source, and so on. This particular example is very simple, but the control signals derived from the original (or parts of the original, or parts of the original in relation to what's going on in other acoustic track, and so on) can be wired up to the point where the technique
becomes integral to the composition itself. In the little example linked below, "Gamboge Descent", the first half of the bass part is simply the introductory tenor melody read backwards and an octave down. The medieval-sounding voice you mention has sort of a smooth vaguely sawish oscillator which gets steeper (therefore more high content) with amplitude and is frequency modulated by a sine at 3:1, index modulated by amplitude. Some bandpassed original is mixed back in. Without any original mixed back in, and a little
brighter timbre, it's basically the same as the quite trumpet-sounding timbre in the tune "an uncanny valley". In answer to your question, the thing is improvised in stretches, and chord at the end just seemed obvious at the time. The piece is very simple- it's just a round, with various stretches read off at simple pure ratios *(4/3), *(.5), etc. It is possible to do this with a single recorded acoustic voice, then have more "animated" versions offset in time, but in this case I wanted to take advantage of the timing
flexibilities provided by acoustic performance, the sort of micro-stretto and microaugmention that I feel is essential to the original spirit of imitative counterpoint, so I played three clarinet tracks. Anyway, I would guess that many people here have already thought of possibilities far beyond what's going on in these simple examples, and of course I've taken the thing much further, but I wanted to start with the simplest examples. Heh, I thought a paragraph would do, but now I see that it will take an article and some .csd examples ranging from trivial-but-practical to full-blown implementations, which become a kind of interactive instrument/co-composer. Say, if someone will instruct me how to upload to the Csound SoundCloud page... https://soundcloud.com/cameron-bobro/gamboge-descent-cbobro From: Aaron Krister Johnson <aaron@akjmusic.com> To: csound@lists.bath.ac.uk Sent: Saturday, February 22, 2014 7:09 PM Subject: [Csnd] Re: "Green Screen" synthesis Nice work. I love the organic expressiveness you are able to get through the tracking opcodes triggering other sounds...what is that almost medieval sounding brass-like timbre? Did you improvise this, but work out the end-goal sonority before hand? If it wasn't pre-thought-out, it was a nicely fortuitous and satisfying ending. -AKJ -- View this message in context: http://csound.1045644.n5.nabble.com/Green-Screen-synthesis-tp5732744p5732747.html Sent from the Csound - General mailing list archive at Nabble.com. Send bugs reports to the Sourceforge bug trackers csound6: https://sourceforge.net/p/csound/tickets/ csound5: https://sourceforge.net/p/csound/bugs/ Discussions of bugs and features can be posted here To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound" |
Date | 2014-02-24 10:55 |
From | cameron bobro |
Subject | Re: [Csnd] "Green Screen" synthesis |
Thanks Victor, just discovered that yahoo sends a goodly portion of the csound list posts straight to the bin with the viagra ads! Arg.... All three voices are pretty much the same patch with some minor tweaks- for example the lowest voice has 3:1 FM ratio rather than 2:1. There's a simple trick modulated phase distortion trick going on which also varies- one voice will tend toward more"squarish/pulse-y" with amplitude, another (the lowest in this example) to more "sawish". Easier to see in a .csd, I'll try to get one up this weekend (going out of town today). -Cameron From: Victor Lazzarini <Victor.Lazzarini@nuim.ie> To: csound@lists.bath.ac.uk Sent: Sunday, February 23, 2014 1:58 PM Subject: Re: [Csnd] "Green Screen" synthesis yes, this is very nice. Could you tell us more about the source sounds for the 2nd and 3rd voices? On 22 Feb 2014, at 15:12, cameron bobro <misterbobro@yahoo.com> wrote: > Here's a little improvised 3-voice canon using what I call "green screen" synthesis, an approach inspired by the use of motion capture with animation in film. In this case I wanted to get into the uncanny valley but lean toward the acoustic side. > > Like all the pieces at the site, this piece is "microtonal" and cannot be rendered in 12-tET (where it is impossible to, for example, represent distinct minor, middle and major thirds in the same piece) but could be done roughly in 17 equal tones to the octave. > > I do all my synthesis sounds using this approach, usually playing clarinet as the acoustic source Csound tracks in amplitude and pitch (as in this piece), sometimes with saz, and sometimes, as you can hear in other pieces, found percussion, which means me whacking on stuff as the original source material. > > What's most important, I've found, is making the synthesizer very sensitive in "pantographing" changes in input parameters to changes in various modulations. > > thanks for listening > > https://soundcloud.com/cameron-bobro/improvised-canon-cameron-bobro > Send bugs reports to the Sourceforge bug trackers csound6: https://sourceforge.net/p/csound/tickets/ csound5: https://sourceforge.net/p/csound/bugs/ Discussions of bugs and features can be posted here To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound" |