[Csnd] the challenge of porting to android
Date | 2011-11-20 20:34 |
From | Brian Redfern |
Subject | [Csnd] the challenge of porting to android |
I'm trying to use the existing java code as my guide, for the csnd.jar wrapper. However that's not enough for an android port for realtime audio. If you are compiling to wav and then listening to the results you can get away with a csound port with no audio support, and the playback happens after compilation. That's one approach, but it doesn't take advantage of the power of my android tablet. Michael Goggins has a working approach, although I can't get the Silencio scripts to run on android yet. What would be necessary is to add support for Open SL ES realtime sound output from csound, so you have a port of csnd.jar for dalvik so java developers can then use csound as their backend synth engine and build front ends for it. People who only have an android 2.2 device likely don't have enough firepower to run csound in realtime on their device. But tons of android devices are fast enough to run it in realtime, at least a port of the OLPC version of csound with java/dalvik bindings rather than python bindings. That way you only need to support Open SL ES for realtime audio output, you don't have to send audio back through JNI as with 2.2 and below. Send bugs reports to the Sourceforge bug tracker https://sourceforge.net/tracker/?group_id=81968&atid=564599 Discussions of bugs and features can be posted here To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound" |
Date | 2011-11-20 20:50 |
From | Steven Yi |
Subject | Re: [Csnd] the challenge of porting to android |
Hi Brian, I'm already very far on with this. I have csnd.jar and libcsound compiled for android, but we ran into a snag where we had to get rid of use of temporary files by csound when parsing orc/sco. John took care of that (you could actually not even use orc/sco/csd files and just pass in strings for those via API) by redoing some internals to csound though the latest I tried with my compile still crashes out somewhere. Otherwise, Victor has some custom OpenSL code and I wrote a custom AndroidCsound class that subclasses Csound and handles setting up pointers for audio callbacks. So we're working on it, but it's crashing at the moment and I'm going to be off and on online this week through Saturday (taking a small holiday with my wife). I'm guess once we can get to rendering and procesing audio live, it'll still take a little bit of time to make sure everything is working correctly and to do documentation/examples before an official release. Thanks, steven On Sun, Nov 20, 2011 at 8:34 PM, Brian Redfern |
Date | 2011-11-20 21:19 |
From | Victor Lazzarini |
Subject | Re: [Csnd] the challenge of porting to android |
Steven and Brian, the new string code is OK and now csound is running well, so it is likely that when Steven and I get together in a week or so, we will be able to progress the Android code. Regards Victor On 20 Nov 2011, at 20:50, Steven Yi wrote: > Hi Brian, > > I'm already very far on with this. I have csnd.jar and libcsound > compiled for android, but we ran into a snag where we had to get rid > of use of temporary files by csound when parsing orc/sco. John took > care of that (you could actually not even use orc/sco/csd files and > just pass in strings for those via API) by redoing some internals to > csound though the latest I tried with my compile still crashes out > somewhere. Otherwise, Victor has some custom OpenSL code and I wrote > a custom AndroidCsound class that subclasses Csound and handles > setting up pointers for audio callbacks. So we're working on it, but > it's crashing at the moment and I'm going to be off and on online this > week through Saturday (taking a small holiday with my wife). I'm > guess once we can get to rendering and procesing audio live, it'll > still take a little bit of time to make sure everything is working > correctly and to do documentation/examples before an official release. > > Thanks, > steven > > > On Sun, Nov 20, 2011 at 8:34 PM, Brian Redfern |
Date | 2011-11-25 11:30 |
From | joachim heintz |
Subject | Re: [Csnd] the challenge of porting to android |
steven (and all the others involved in this project) - i just want to appreciate your work on this. it's so important for the future of csound! though i do not have any mobile device like this, i think i will buy an android if csound is running there. thanks - joachim Am 20.11.2011 21:50, schrieb Steven Yi: > Hi Brian, > > I'm already very far on with this. I have csnd.jar and libcsound > compiled for android, but we ran into a snag where we had to get rid > of use of temporary files by csound when parsing orc/sco. John took > care of that (you could actually not even use orc/sco/csd files and > just pass in strings for those via API) by redoing some internals to > csound though the latest I tried with my compile still crashes out > somewhere. Otherwise, Victor has some custom OpenSL code and I wrote > a custom AndroidCsound class that subclasses Csound and handles > setting up pointers for audio callbacks. So we're working on it, but > it's crashing at the moment and I'm going to be off and on online this > week through Saturday (taking a small holiday with my wife). I'm > guess once we can get to rendering and procesing audio live, it'll > still take a little bit of time to make sure everything is working > correctly and to do documentation/examples before an official release. > > Thanks, > steven > > > On Sun, Nov 20, 2011 at 8:34 PM, Brian Redfern |
Date | 2011-11-25 14:24 |
From | Øyvind Brandtsegg |
Subject | re: [Csnd] the challenge of porting to android |
And related to this, I had the pleasure of getting Csound on iPad and iPhone demonstrated here in Trondheim today. It is totally great. Victor was here for a workshop we organized (DSP Ear Training). It is very very inspiring to see Csound find it's way to these new areas and new platforms. We'll for sure invent applications that makes good use of it, that spreads the word and the sound and the tool to new users. Oeyvind Brandtsegg Professor of Music Technology NTNU 7491 Trondheim Norway ________________________________________ Fra: joachim heintz [jh@joachimheintz.de] Sendt: 25. november 2011 12:30 Til: csound@lists.bath.ac.uk Emne: Re: [Csnd] the challenge of porting to android steven (and all the others involved in this project) - i just want to appreciate your work on this. it's so important for the future of csound! though i do not have any mobile device like this, i think i will buy an android if csound is running there. thanks - joachim Am 20.11.2011 21:50, schrieb Steven Yi: > Hi Brian, > > I'm already very far on with this. I have csnd.jar and libcsound > compiled for android, but we ran into a snag where we had to get rid > of use of temporary files by csound when parsing orc/sco. John took > care of that (you could actually not even use orc/sco/csd files and > just pass in strings for those via API) by redoing some internals to > csound though the latest I tried with my compile still crashes out > somewhere. Otherwise, Victor has some custom OpenSL code and I wrote > a custom AndroidCsound class that subclasses Csound and handles > setting up pointers for audio callbacks. So we're working on it, but > it's crashing at the moment and I'm going to be off and on online this > week through Saturday (taking a small holiday with my wife). I'm > guess once we can get to rendering and procesing audio live, it'll > still take a little bit of time to make sure everything is working > correctly and to do documentation/examples before an official release. > > Thanks, > steven > > > On Sun, Nov 20, 2011 at 8:34 PM, Brian Redfern |
Date | 2011-11-25 15:15 |
From | Rory Walsh |
Subject | Re: [Csnd] the challenge of porting to android |
I'm more interested in the "DSP Ear Training" part of this mail. We discussed it briefly at the LAC. Do you plan to put any material/info online? I think it's a great idea. On 25 November 2011 14:24, Øyvind Brandtsegg |
Date | 2011-11-25 16:08 |
From | luis jure |
Subject | Re: [Csnd] the challenge of porting to android |
on 2011-11-25 at 15:15 Rory Walsh wrote: >I'm more interested in the "DSP Ear Training" part of this mail. We >discussed it briefly at the LAC. Do you plan to put any material/info >online? I think it's a great idea. +1 Send bugs reports to the Sourceforge bug tracker https://sourceforge.net/tracker/?group_id=81968&atid=564599 Discussions of bugs and features can be posted here To unsubscribe, send email sympa@lists.bath.ac.uk with body "unsubscribe csound" |
Date | 2011-11-26 22:44 |
From | Oeyvind Brandtsegg |
Subject | Re: [Csnd] the challenge of porting to android |
Thanks, yes we will make online materials. The course materials are planned as open source and free resources, there might be a small administrative fee to follow the course and get academic credit etc. The planned materials include a short lesson on each dsp technique, with flow chart, audio graph display, csound code, and listening examples. There will also be music examples to show examples of each technique used in released productions, and we are building "listening tests" where you are challenged to guess the technique and parameter settings used to produce short audio clips. We actually have an automatic listening test generator ready (collecting a csound csd from include files covering most dsp techniques (27 effects for now) currently included in the course. We are also working on a "reverse engineering" listening task where you shall try to tweak parameters to approximate a given sound. I the workshop we worked on perspectives on ear training, terminology for describing timbre, e-learning, automatic tutoring, selection of dsp techniques to include, music examples, audio programming and deployment, web framework for the course etc. In addition to Victor, we were Sigurd Saue, Bernt Isak Waerstad, John Paal Inderberg and Jan Tro (all NTNU), Joran Rudi and Notto Thelle (Notam), and Haakon Kvidal (Norwegian Academy of Music). I will of course keep you posted, and hope to get feedback on the material when we have collected it in a presentable manner (during spring 2012). best Oeyvind 2011/11/25 Rory Walsh |
Date | 2011-11-26 23:12 |
From | Steven Yi |
Subject | Re: [Csnd] the challenge of porting to android |
This sounds like a fantastic project, and I'm sure it will be a very valued resource by all. I'll be looking looking forward to how this all develops! On Sat, Nov 26, 2011 at 10:44 PM, Oeyvind Brandtsegg |
Date | 2011-11-26 23:30 |
From | Rory Walsh |
Subject | Re: [Csnd] the challenge of porting to android |
Sounds savage. Can't wait to embarrass myself in the listening tests!! On Saturday, 26 November 2011, Steven Yi <stevenyi@gmail.com> wrote: > This sounds like a fantastic project, and I'm sure it will be a very > valued resource by all. I'll be looking looking forward to how this > all develops! > > On Sat, Nov 26, 2011 at 10:44 PM, Oeyvind Brandtsegg > <oyvind.brandtsegg@ntnu.no> wrote: >> Thanks, yes we will make online materials. >> The course materials are planned as open source and free resources, >> there might be a small administrative fee to follow the course and get >> academic credit etc. >> >> The planned materials include a short lesson on each dsp technique, >> with flow chart, audio graph display, csound code, and listening >> examples. >> There will also be music examples to show examples of each technique >> used in released productions, >> and we are building "listening tests" where you are challenged to >> guess the technique and parameter settings used to produce short audio >> clips. >> We actually have an automatic listening test generator ready >> (collecting a csound csd from include files covering most dsp >> techniques (27 effects for now) currently included in the course. We >> are also working on a "reverse engineering" listening task where you >> shall try to tweak parameters to approximate a given sound. >> I the workshop we worked on perspectives on ear training, terminology >> for describing timbre, e-learning, automatic tutoring, selection of >> dsp techniques to include, music examples, audio programming and >> deployment, web framework for the course etc. In addition to Victor, >> we were Sigurd Saue, Bernt Isak Waerstad, John Paal Inderberg and Jan >> Tro (all NTNU), Joran Rudi and Notto Thelle (Notam), and Haakon Kvidal >> (Norwegian Academy of Music). >> I will of course keep you posted, and hope to get feedback on the >> material when we have collected it in a presentable manner (during >> spring 2012). >> >> best >> Oeyvind >> >> >> 2011/11/25 Rory Walsh <rorywalsh@ear.ie>: >>> I'm more interested in the "DSP Ear Training" part of this mail. We >>> discussed it briefly at the LAC. Do you plan to put any material/info >>> online? I think it's a great idea. >>> >>> >>> On 25 November 2011 14:24, Øyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote: >>>> And related to this, I had the pleasure of getting Csound on iPad and iPhone demonstrated here in Trondheim today. It is totally great. Victor was here for a workshop we organized (DSP Ear Training). It is very very inspiring to see Csound find it's way to these new areas and new platforms. We'll for sure invent applications that makes good use of it, that spreads the word and the sound and the tool to new users. >>>> >>>> Oeyvind Brandtsegg >>>> Professor of Music Technology >>>> NTNU >>>> 7491 Trondheim >>>> Norway >>>> >>>> ________________________________________ >>>> Fra: joachim heintz [jh@joachimheintz.de] >>>> Sendt: 25. november 2011 12:30 >>>> Til: csound@lists.bath.ac.uk >>>> Emne: Re: [Csnd] the challenge of porting to android >>>> >>>> steven (and all the others involved in this project) - >>>> i just want to appreciate your work on this. it's so important for the >>>> future of csound! though i do not have any mobile device like this, i >>>> think i will buy an android if csound is running there. >>>> thanks - >>>> joachim >>>> >>>> >>>> Am 20.11.2011 21:50, schrieb Steven Yi: >>>>> Hi Brian, >>>>> >>>>> I'm already very far on with this. I have csnd.jar and libcsound >>>>> compiled for android, but we ran into a snag where we had to get rid >>>>> of use of temporary files by csound when parsing orc/sco. John took >>>>> care of that (you could actually not even use orc/sco/csd files and >>>>> just pass in strings for those via API) by redoing some internals to >>>>> csound though the latest I tried with my compile still crashes out >>>>> somewhere. Otherwise, Victor has some custom OpenSL code and I wrote >>>>> a custom AndroidCsound class that subclasses Csound and handles >>>>> setting |
Date | 2011-11-27 00:05 |
From | Victor Lazzarini |
Subject | Re: [Csnd] the challenge of porting to android |
We didn't do too badly in the tests during the workshop. Getting six chained effects was hard though. On 26 Nov 2011, at 23:30, Rory Walsh wrote: Sounds savage. Can't wait to embarrass myself in the listening tests!! Dr Victor Lazzarini Senior Lecturer Dept. of Music NUI Maynooth Ireland tel.: +353 1 708 3545 Victor dot Lazzarini AT nuim dot ie |
Date | 2011-11-27 00:21 |
From | Rory Walsh |
Subject | Re: [Csnd] the challenge of porting to android |
Six chained effects! Top of the class! On Sunday, 27 November 2011, Victor Lazzarini <Victor.Lazzarini@nuim.ie> wrote: > We didn't do too badly in the tests during the workshop. Getting six chained effects was hard though. > On 26 Nov 2011, at 23:30, Rory Walsh wrote: > > Sounds savage. Can't wait to embarrass myself in the listening tests!! > > On Saturday, 26 November 2011, Steven Yi <stevenyi@gmail.com> wrote: >> This sounds like a fantastic project, and I'm sure it will be a very >> valued resource by all. I'll be looking looking forward to how this >> all develops! >> >> On Sat, Nov 26, 2011 at 10:44 PM, Oeyvind Brandtsegg >> <oyvind.brandtsegg@ntnu.no> wrote: >>> Thanks, yes we will make online materials. >>> The course materials are planned as open source and free resources, >>> there might be a small administrative fee to follow the course and get >>> academic credit etc. >>> >>> The planned materials include a short lesson on each dsp technique, >>> with flow chart, audio graph display, csound code, and listening >>> examples. >>> There will also be music examples to show examples of each technique >>> used in released productions, >>> and we are building "listening tests" where you are challenged to >>> guess the technique and parameter settings used to produce short audio >>> clips. >>> We actually have an automatic listening test generator ready >>> (collecting a csound csd from include files covering most dsp >>> techniques (27 effects for now) currently included in the course. We >>> are also working on a "reverse engineering" listening task where you >>> shall try to tweak parameters to approximate a given sound. >>> I the workshop we worked on perspectives on ear training, terminology >>> for describing timbre, e-learning, automatic tutoring, selection of >>> dsp techniques to include, music examples, audio programming and >>> deployment, web framework for the course etc. In addition to Victor, >>> we were Sigurd Saue, Bernt Isak Waerstad, John Paal Inderberg and Jan >>> Tro (all NTNU), Joran Rudi and Notto Thelle (Notam), and Haakon Kvidal >>> (Norwegian Academy of Music). >>> I will of course keep you posted, and hope to get feedback on the >>> material when we have collected it in a presentable manner (during >>> spring 2012). >>> >>> best >>> Oeyvind >>> >>> >>> 2011/11/25 Rory Walsh <rorywalsh@ear.ie>: >>>> I'm more interested in the "DSP Ear Training" part of this mail. We >>>> discussed it briefly at the LAC. Do you plan to put any material/info >>>> online? I think it's a great idea. >>>> >>>> >>>> On 25 November 2011 14:24, Øyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote: >>>>> And related to this, I had the pleasure of getting Csound on iPad and iPhone demonstrated here in Trondheim today. It is totally great. Victor was here for a workshop we organized (DSP Ear Training). It is very very inspiring to see Csound find it's way to these new areas and new platforms. We'll for sure invent applications that makes good use of it, that spreads the word and the sound and the tool to new users. >>>>> >>>>> Oeyvind Brandtsegg >>>>> Professor of Music Technology >>>>> NTNU >>>>> 7491 Trondheim >>>>> Norway >>>>> >>>>> ________________________________________ >>>>> Fra: joachim heintz [jh@joachimheintz.de] >>>>> Sendt: 25. november 2011 12:30 >>>>> Til: csound@lists.bath.ac.uk >>>>> Emne: Re: [Csnd] the challenge of porting to android >>>>> >>>>> steven (and all the others involved in this project) - >>>>> i just want to appreciate your work on this. it's so important for the >>>>> future of csound! though i do not have any mobile device like this, i >>>>> think i will buy an android if csound is running there. >>>>> thanks - >>>>> joachim >>>>> >>>>> >>>>> Am 20.11.2011 21:50, schrieb Steven Yi: >>>>>> Hi Brian, >>>>>> >>>>>> I'm already very far on with this. > > Dr Victor Lazzarini > Senior Lecturer > Dept. of Music > NUI Maynooth Ireland > tel.: +353 1 708 3545 > Victor dot Lazzarini AT nuim dot ie > > > |
Date | 2011-11-27 00:46 |
From | Victor Lazzarini |
Subject | Re: [Csnd] the challenge of porting to android |
I didn't say we got that. Five was our best. On 27 Nov 2011, at 00:21, Rory Walsh wrote: Six chained effects! Top of the class! Dr Victor Lazzarini Senior Lecturer Dept. of Music NUI Maynooth Ireland tel.: +353 1 708 3545 Victor dot Lazzarini AT nuim dot ie |
Date | 2011-11-27 00:46 |
From | Rory Walsh |
Subject | Re: [Csnd] the challenge of porting to android |
Ah. Well now, that's totally different! On Sunday, 27 November 2011, Victor Lazzarini <Victor.Lazzarini@nuim.ie> wrote: > I didn't say we got that. Five was our best. > On 27 Nov 2011, at 00:21, Rory Walsh wrote: > > Six chained effects! Top of the class! > > On Sunday, 27 November 2011, Victor Lazzarini <Victor.Lazzarini@nuim.ie> wrote: >> We didn't do too badly in the tests during the workshop. Getting six chained effects was hard though. >> On 26 Nov 2011, at 23:30, Rory Walsh wrote: >> >> Sounds savage. Can't wait to embarrass myself in the listening tests!! >> >> On Saturday, 26 November 2011, Steven Yi <stevenyi@gmail.com> wrote: >>> This sounds like a fantastic project, and I'm sure it will be a very >>> valued resource by all. I'll be looking looking forward to how this >>> all develops! >>> >>> On Sat, Nov 26, 2011 at 10:44 PM, Oeyvind Brandtsegg >>> <oyvind.brandtsegg@ntnu.no> wrote: >>>> Thanks, yes we will make online materials. >>>> The course materials are planned as open source and free resources, >>>> there might be a small administrative fee to follow the course and get >>>> academic credit etc. >>>> >>>> The planned materials include a short lesson on each dsp technique, >>>> with flow chart, audio graph display, csound code, and listening >>>> examples. >>>> There will also be music examples to show examples of each technique >>>> used in released productions, >>>> and we are building "listening tests" where you are challenged to >>>> guess the technique and parameter settings used to produce short audio >>>> clips. >>>> We actually have an automatic listening test generator ready >>>> (collecting a csound csd from include files covering most dsp >>>> techniques (27 effects for now) currently included in the course. We >>>> are also working on a "reverse engineering" listening task where you >>>> shall try to tweak parameters to approximate a given sound. >>>> I the workshop we worked on perspectives on ear training, terminology >>>> for describing timbre, e-learning, automatic tutoring, selection of >>>> dsp techniques to include, music examples, audio programming and >>>> deployment, web framework for the course etc. In addition to Victor, >>>> we were Sigurd Saue, Bernt Isak Waerstad, John Paal Inderberg and Jan >>>> Tro (all NTNU), Joran Rudi and Notto Thelle (Notam), and Haakon Kvidal >>>> (Norwegian Academy of Music). >>>> I will of course keep you posted, and hope to get feedback on the >>>> material when we have collected it in a presentable manner (during >>>> spring 2012). >>>> >>>> best >>>> Oeyvind >>>> >>>> >>>> 2011/11/25 Rory Walsh <rorywalsh@ear.ie>: >>>>> I'm more interested in the "DSP Ear Training" part of this mail. We >>>>> discussed it briefly at the LAC. Do you plan to put any material/info >>>>> online? I think it's a great idea. >>>>> >>>>> >>>>> On 25 November 2011 14:24, Øyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote: >>>>>> And related to this, I had the pleasure of getting Csound on iPad and iPhone demonstrated here in Trondheim today. It is totally great. Victor was here for a workshop we organized (DSP Ear Training). It is very very inspiring to see Csound find it's way to these new areas and new platforms. We'll for sure invent applications that makes good use of it, that spreads the word and the sound and the tool to new users. >>>>>> >>>>>> Oeyvind Brandtsegg >>>>>> Professor of Music Technology >>>>>> NTNU >>>>>> 7491 Trondheim >>>>>> Norway >>>>>> >>>>>> ________________________________________ >>>>>> Fra: joachim heintz [jh@joachimheintz.de] >>>>>> Sendt: 25. november 2011 12:30 >>>>>> Til: csound@lists.bath.ac.uk >>>>>> Emne: Re: [Csnd] the challenge of |