Csound Csound-dev Csound-tekno Search About

[Cs-dev] OSX Lion, OpenMP, and crashes

Date2011-10-14 00:20
FromSteven Yi
Subject[Cs-dev] OSX Lion, OpenMP, and crashes
Hi All,

So I've been battling out issues with getting the Lua opcodes to work
here on OSX Lion.  I also found it strange I was getting crashes here
with -j 2 to turn on multicore when Victor was not seeing the same
crashes.  I think now I have a hunch. I did some search about OpenMP
and Lion and saw here on this thread for Blender:

http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b

"There is a bug in Lion which can cause any program which uses OpenMP
to crash; a bug which does not exist in Snow Leopard. This is a fairly
widely used multithreading routine; just for example sculpting in
Blender will also will cause a crash, as it too uses OpenMP.

It could be related to this."

I know the Lua opcodes use openMP to get a thread ID and other things;
I assume it is the same case for the multicore code.  The Blender guys
seem to have sorted it out by building blender with a self-compiled
version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
if there are other options than this.

Also to note, I am using the latest update of Lion (10.7.2) that just
came out, and OpenMP still crashes (and others have noted that same
https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).

At least though I have some idea as to why the $#@% the lua opcodes
were crashing!  :D

steven

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 06:14
FromVictor Lazzarini
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
The multicore code uses pthreads. But note that these were not being  
activated before, because the code to do that was misssing.
Did you pull it last night and tried again? I pushed some updates in  
main.c to do the threads.

Victor
On 14 Oct 2011, at 00:20, Steven Yi wrote:

> Hi All,
>
> So I've been battling out issues with getting the Lua opcodes to work
> here on OSX Lion.  I also found it strange I was getting crashes here
> with -j 2 to turn on multicore when Victor was not seeing the same
> crashes.  I think now I have a hunch. I did some search about OpenMP
> and Lion and saw here on this thread for Blender:
>
> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>
> "There is a bug in Lion which can cause any program which uses OpenMP
> to crash; a bug which does not exist in Snow Leopard. This is a fairly
> widely used multithreading routine; just for example sculpting in
> Blender will also will cause a crash, as it too uses OpenMP.
>
> It could be related to this."
>
> I know the Lua opcodes use openMP to get a thread ID and other things;
> I assume it is the same case for the multicore code.  The Blender guys
> seem to have sorted it out by building blender with a self-compiled
> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
> if there are other options than this.
>
> Also to note, I am using the latest update of Lion (10.7.2) that just
> came out, and OpenMP still crashes (and others have noted that same
> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>
> At least though I have some idea as to why the $#@% the lua opcodes
> were crashing!  :D
>
> steven
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure  
> contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and  
> makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 11:34
FromMichael Gogins
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
AttachmentsNone  None  

Was out with friends last night, will do tonight.

On Oct 14, 2011 1:12 AM, "Victor Lazzarini" <Victor.Lazzarini@nuim.ie> wrote:
The multicore code uses pthreads. But note that these were not being
activated before, because the code to do that was misssing.
Did you pull it last night and tried again? I pushed some updates in
main.c to do the threads.

Victor
On 14 Oct 2011, at 00:20, Steven Yi wrote:

> Hi All,
>
> So I've been battling out issues with getting the Lua opcodes to work
> here on OSX Lion.  I also found it strange I was getting crashes here
> with -j 2 to turn on multicore when Victor was not seeing the same
> crashes.  I think now I have a hunch. I did some search about OpenMP
> and Lion and saw here on this thread for Blender:
>
> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>
> "There is a bug in Lion which can cause any program which uses OpenMP
> to crash; a bug which does not exist in Snow Leopard. This is a fairly
> widely used multithreading routine; just for example sculpting in
> Blender will also will cause a crash, as it too uses OpenMP.
>
> It could be related to this."
>
> I know the Lua opcodes use openMP to get a thread ID and other things;
> I assume it is the same case for the multicore code.  The Blender guys
> seem to have sorted it out by building blender with a self-compiled
> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
> if there are other options than this.
>
> Also to note, I am using the latest update of Lion (10.7.2) that just
> came out, and OpenMP still crashes (and others have noted that same
> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>
> At least though I have some idea as to why the $#@% the lua opcodes
> were crashing!  :D
>
> steven
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure
> contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and
> makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csound-devel

Date2011-10-14 14:14
FromSteven Yi
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
There's certainly references to omp in main.c, as well as the lua
opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night so am
rebuilding libraries at the moment.  Before that though, I
experimented a bit with the pre-built gcc 4.6 binaries that were on
the hpc site but unfortunately that was a bit problematic. I may try
compiling gcc with macports later after I get my /usr/local/lib sorted
out.

On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
 wrote:
> The multicore code uses pthreads. But note that these were not being
> activated before, because the code to do that was misssing.
> Did you pull it last night and tried again? I pushed some updates in
> main.c to do the threads.
>
> Victor
> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>
>> Hi All,
>>
>> So I've been battling out issues with getting the Lua opcodes to work
>> here on OSX Lion.  I also found it strange I was getting crashes here
>> with -j 2 to turn on multicore when Victor was not seeing the same
>> crashes.  I think now I have a hunch. I did some search about OpenMP
>> and Lion and saw here on this thread for Blender:
>>
>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>
>> "There is a bug in Lion which can cause any program which uses OpenMP
>> to crash; a bug which does not exist in Snow Leopard. This is a fairly
>> widely used multithreading routine; just for example sculpting in
>> Blender will also will cause a crash, as it too uses OpenMP.
>>
>> It could be related to this."
>>
>> I know the Lua opcodes use openMP to get a thread ID and other things;
>> I assume it is the same case for the multicore code.  The Blender guys
>> seem to have sorted it out by building blender with a self-compiled
>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
>> if there are other options than this.
>>
>> Also to note, I am using the latest update of Lion (10.7.2) that just
>> came out, and OpenMP still crashes (and others have noted that same
>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>
>> At least though I have some idea as to why the $#@% the lua opcodes
>> were crashing!  :D
>>
>> steven
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>
> Dr Victor Lazzarini
> Senior Lecturer
> Dept. of Music
> NUI Maynooth Ireland
> tel.: +353 1 708 3545
> Victor dot Lazzarini AT nuim dot ie
>
>
>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel
>

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 15:03
FromVictor Lazzarini
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
yes, but as far as I can see they are not used anywhere. The  
luaopcodes do use them though.

Victor
On 14 Oct 2011, at 14:14, Steven Yi wrote:

> There's certainly references to omp in main.c, as well as the lua
> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night so am
> rebuilding libraries at the moment.  Before that though, I
> experimented a bit with the pre-built gcc 4.6 binaries that were on
> the hpc site but unfortunately that was a bit problematic. I may try
> compiling gcc with macports later after I get my /usr/local/lib sorted
> out.
>
> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>  wrote:
>> The multicore code uses pthreads. But note that these were not being
>> activated before, because the code to do that was misssing.
>> Did you pull it last night and tried again? I pushed some updates in
>> main.c to do the threads.
>>
>> Victor
>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>
>>> Hi All,
>>>
>>> So I've been battling out issues with getting the Lua opcodes to  
>>> work
>>> here on OSX Lion.  I also found it strange I was getting crashes  
>>> here
>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>> crashes.  I think now I have a hunch. I did some search about OpenMP
>>> and Lion and saw here on this thread for Blender:
>>>
>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>
>>> "There is a bug in Lion which can cause any program which uses  
>>> OpenMP
>>> to crash; a bug which does not exist in Snow Leopard. This is a  
>>> fairly
>>> widely used multithreading routine; just for example sculpting in
>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>
>>> It could be related to this."
>>>
>>> I know the Lua opcodes use openMP to get a thread ID and other  
>>> things;
>>> I assume it is the same case for the multicore code.  The Blender  
>>> guys
>>> seem to have sorted it out by building blender with a self-compiled
>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
>>> if there are other options than this.
>>>
>>> Also to note, I am using the latest update of Lion (10.7.2) that  
>>> just
>>> came out, and OpenMP still crashes (and others have noted that same
>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>
>>> At least though I have some idea as to why the $#@% the lua opcodes
>>> were crashing!  :D
>>>
>>> steven
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>> Dr Victor Lazzarini
>> Senior Lecturer
>> Dept. of Music
>> NUI Maynooth Ireland
>> tel.: +353 1 708 3545
>> Victor dot Lazzarini AT nuim dot ie
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure  
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and  
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure  
> contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and  
> makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 15:12
FromMichael Gogins
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
I think what we need to do is figure out how to use OpenMP on OS X. If
we can't do that, then we need to change the OpenMP code to pure
pthreads code.

OpenMP code is reduced by the compiler to pthreads calls anyway.
However, I definitely find that writing multi-threaded code with
OpenMP is far easier and safer than doing it any other way, and OpenMP
has become something of a standard.

So, I would prefer to keep the OpenMP code if at all possible.

Regards,
Mike

On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
 wrote:
> yes, but as far as I can see they are not used anywhere. The
> luaopcodes do use them though.
>
> Victor
> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>
>> There's certainly references to omp in main.c, as well as the lua
>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night so am
>> rebuilding libraries at the moment.  Before that though, I
>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>> the hpc site but unfortunately that was a bit problematic. I may try
>> compiling gcc with macports later after I get my /usr/local/lib sorted
>> out.
>>
>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>  wrote:
>>> The multicore code uses pthreads. But note that these were not being
>>> activated before, because the code to do that was misssing.
>>> Did you pull it last night and tried again? I pushed some updates in
>>> main.c to do the threads.
>>>
>>> Victor
>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>
>>>> Hi All,
>>>>
>>>> So I've been battling out issues with getting the Lua opcodes to
>>>> work
>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>> here
>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>> crashes.  I think now I have a hunch. I did some search about OpenMP
>>>> and Lion and saw here on this thread for Blender:
>>>>
>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>
>>>> "There is a bug in Lion which can cause any program which uses
>>>> OpenMP
>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>> fairly
>>>> widely used multithreading routine; just for example sculpting in
>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>
>>>> It could be related to this."
>>>>
>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>> things;
>>>> I assume it is the same case for the multicore code.  The Blender
>>>> guys
>>>> seem to have sorted it out by building blender with a self-compiled
>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to see
>>>> if there are other options than this.
>>>>
>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>> just
>>>> came out, and OpenMP still crashes (and others have noted that same
>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>
>>>> At least though I have some idea as to why the $#@% the lua opcodes
>>>> were crashing!  :D
>>>>
>>>> steven
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure
>>>> contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>> makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>> Dr Victor Lazzarini
>>> Senior Lecturer
>>> Dept. of Music
>>> NUI Maynooth Ireland
>>> tel.: +353 1 708 3545
>>> Victor dot Lazzarini AT nuim dot ie
>>>
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>
> Dr Victor Lazzarini
> Senior Lecturer
> Dept. of Music
> NUI Maynooth Ireland
> tel.: +353 1 708 3545
> Victor dot Lazzarini AT nuim dot ie
>
>
>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel
>



-- 
Michael Gogins
Irreducible Productions
http://www.michael-gogins.com
Michael dot Gogins at gmail dot com

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 15:29
FromVictor Lazzarini
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
At the moment, the PArCS code uses pthreads. There are some openmp  
sections in csound.c, but these are not being used for multicore.
The luaopcodes do have OpenMP code, but I doubt the crashes Steven has  
been reporting (on startup?) are due to this.
It's easy to test: just comment out the code and set the number of  
threads variable to one in the luaopcodes sources.

Victor


On 14 Oct 2011, at 15:12, Michael Gogins wrote:

> I think what we need to do is figure out how to use OpenMP on OS X. If
> we can't do that, then we need to change the OpenMP code to pure
> pthreads code.
>
> OpenMP code is reduced by the compiler to pthreads calls anyway.
> However, I definitely find that writing multi-threaded code with
> OpenMP is far easier and safer than doing it any other way, and OpenMP
> has become something of a standard.
>
> So, I would prefer to keep the OpenMP code if at all possible.
>
> Regards,
> Mike
>
> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>  wrote:
>> yes, but as far as I can see they are not used anywhere. The
>> luaopcodes do use them though.
>>
>> Victor
>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>
>>> There's certainly references to omp in main.c, as well as the lua
>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night  
>>> so am
>>> rebuilding libraries at the moment.  Before that though, I
>>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>>> the hpc site but unfortunately that was a bit problematic. I may try
>>> compiling gcc with macports later after I get my /usr/local/lib  
>>> sorted
>>> out.
>>>
>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>  wrote:
>>>> The multicore code uses pthreads. But note that these were not  
>>>> being
>>>> activated before, because the code to do that was misssing.
>>>> Did you pull it last night and tried again? I pushed some updates  
>>>> in
>>>> main.c to do the threads.
>>>>
>>>> Victor
>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> So I've been battling out issues with getting the Lua opcodes to
>>>>> work
>>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>>> here
>>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>>> crashes.  I think now I have a hunch. I did some search about  
>>>>> OpenMP
>>>>> and Lion and saw here on this thread for Blender:
>>>>>
>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>
>>>>> "There is a bug in Lion which can cause any program which uses
>>>>> OpenMP
>>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>>> fairly
>>>>> widely used multithreading routine; just for example sculpting in
>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>
>>>>> It could be related to this."
>>>>>
>>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>>> things;
>>>>> I assume it is the same case for the multicore code.  The Blender
>>>>> guys
>>>>> seem to have sorted it out by building blender with a self- 
>>>>> compiled
>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to  
>>>>> see
>>>>> if there are other options than this.
>>>>>
>>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>>> just
>>>>> came out, and OpenMP still crashes (and others have noted that  
>>>>> same
>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>>
>>>>> At least though I have some idea as to why the $#@% the lua  
>>>>> opcodes
>>>>> were crashing!  :D
>>>>>
>>>>> steven
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>> makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>> Dr Victor Lazzarini
>>>> Senior Lecturer
>>>> Dept. of Music
>>>> NUI Maynooth Ireland
>>>> tel.: +353 1 708 3545
>>>> Victor dot Lazzarini AT nuim dot ie
>>>>
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure
>>>> contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>> makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>> Dr Victor Lazzarini
>> Senior Lecturer
>> Dept. of Music
>> NUI Maynooth Ireland
>> tel.: +353 1 708 3545
>> Victor dot Lazzarini AT nuim dot ie
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure  
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and  
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>
>
>
> -- 
> Michael Gogins
> Irreducible Productions
> http://www.michael-gogins.com
> Michael dot Gogins at gmail dot com
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure  
> contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and  
> makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-14 23:20
FromSteven Yi
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
I tried removing the omp code in lua opcodes and it still crashed. I
see what you mean about omp now in main.c.  I'm completely frustrated
by all this at this point and am giving up for the weekend.

Thanks,
steven

On Fri, Oct 14, 2011 at 3:29 PM, Victor Lazzarini
 wrote:
> At the moment, the PArCS code uses pthreads. There are some openmp
> sections in csound.c, but these are not being used for multicore.
> The luaopcodes do have OpenMP code, but I doubt the crashes Steven has
> been reporting (on startup?) are due to this.
> It's easy to test: just comment out the code and set the number of
> threads variable to one in the luaopcodes sources.
>
> Victor
>
>
> On 14 Oct 2011, at 15:12, Michael Gogins wrote:
>
>> I think what we need to do is figure out how to use OpenMP on OS X. If
>> we can't do that, then we need to change the OpenMP code to pure
>> pthreads code.
>>
>> OpenMP code is reduced by the compiler to pthreads calls anyway.
>> However, I definitely find that writing multi-threaded code with
>> OpenMP is far easier and safer than doing it any other way, and OpenMP
>> has become something of a standard.
>>
>> So, I would prefer to keep the OpenMP code if at all possible.
>>
>> Regards,
>> Mike
>>
>> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>>  wrote:
>>> yes, but as far as I can see they are not used anywhere. The
>>> luaopcodes do use them though.
>>>
>>> Victor
>>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>>
>>>> There's certainly references to omp in main.c, as well as the lua
>>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night
>>>> so am
>>>> rebuilding libraries at the moment.  Before that though, I
>>>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>>>> the hpc site but unfortunately that was a bit problematic. I may try
>>>> compiling gcc with macports later after I get my /usr/local/lib
>>>> sorted
>>>> out.
>>>>
>>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>>  wrote:
>>>>> The multicore code uses pthreads. But note that these were not
>>>>> being
>>>>> activated before, because the code to do that was misssing.
>>>>> Did you pull it last night and tried again? I pushed some updates
>>>>> in
>>>>> main.c to do the threads.
>>>>>
>>>>> Victor
>>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> So I've been battling out issues with getting the Lua opcodes to
>>>>>> work
>>>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>>>> here
>>>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>>>> crashes.  I think now I have a hunch. I did some search about
>>>>>> OpenMP
>>>>>> and Lion and saw here on this thread for Blender:
>>>>>>
>>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>>
>>>>>> "There is a bug in Lion which can cause any program which uses
>>>>>> OpenMP
>>>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>>>> fairly
>>>>>> widely used multithreading routine; just for example sculpting in
>>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>>
>>>>>> It could be related to this."
>>>>>>
>>>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>>>> things;
>>>>>> I assume it is the same case for the multicore code.  The Blender
>>>>>> guys
>>>>>> seem to have sorted it out by building blender with a self-
>>>>>> compiled
>>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to
>>>>>> see
>>>>>> if there are other options than this.
>>>>>>
>>>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>>>> just
>>>>>> came out, and OpenMP still crashes (and others have noted that
>>>>>> same
>>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>>>
>>>>>> At least though I have some idea as to why the $#@% the lua
>>>>>> opcodes
>>>>>> were crashing!  :D
>>>>>>
>>>>>> steven
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> All the data continuously generated in your IT infrastructure
>>>>>> contains a
>>>>>> definitive record of customers, application performance, security
>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>> makes
>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>> _______________________________________________
>>>>>> Csound-devel mailing list
>>>>>> Csound-devel@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>> Dr Victor Lazzarini
>>>>> Senior Lecturer
>>>>> Dept. of Music
>>>>> NUI Maynooth Ireland
>>>>> tel.: +353 1 708 3545
>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>> makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure
>>>> contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>> makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>> Dr Victor Lazzarini
>>> Senior Lecturer
>>> Dept. of Music
>>> NUI Maynooth Ireland
>>> tel.: +353 1 708 3545
>>> Victor dot Lazzarini AT nuim dot ie
>>>
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>
>>
>>
>> --
>> Michael Gogins
>> Irreducible Productions
>> http://www.michael-gogins.com
>> Michael dot Gogins at gmail dot com
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>
> Dr Victor Lazzarini
> Senior Lecturer
> Dept. of Music
> NUI Maynooth Ireland
> tel.: +353 1 708 3545
> Victor dot Lazzarini AT nuim dot ie
>
>
>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel
>

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-15 00:53
FromSteven Yi
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
UGH, okay, I found out some more information.  Turns out luajit is
going to be really problematic for OSX 64-bit.  The luatjit site says:

"If you're building a 64 bit application on OSX which links directly
or indirectly against LuaJIT, you need to link your main executable
with these flags:
-pagezero_size 10000 -image_base 100000000
Also, it's recommended to rebase all (self-compiled) shared libraries
which are loaded at runtime on OSX/x64 (e.g. C extension modules for
Lua). See: man rebase"

this blog has some info about it:

http://t-p-j.blogspot.com/2010/11/lupa-on-os-x-with-macports-python-26.html

Now, from the blog, it seems that the initial executable that runs
needs to be linked with the above flags.  The problem I came across is
that with a test build for just x86_64, with the updated flags it the
lua opcodes didn't crash, but the examples in
examples/opcode_demos/lua*.csd didn't really work either.  You also
can't build a universal binary with those flags as the image_base is
too big for i386.

Also, I this is going to cause big problems for hosts.  From the blog,
it seems like if you want to use python with the API, you'd have to
recompile python with the above linker flags to be able to use luajit.
 I don't think that's really feasible to expect this for OSX 64-bit
users, and if they don't do it, they'll likely crash when the module
loads (on csound startup) as I experienced with the csound executable.
 I certainly don't think anyone would recompile Java for this either.
(another post that mentions this issue:
http://lua-users.org/lists/lua-l/2011-04/msg00710.html)

I think then that for OSX, to do an i386/x86_64 build, the Lua opcodes are out.

As for why running with multicore crashes here, I'm not sure. It
crashes in csound_orc_expand_expressions.  I've tried this with csound
compiled with gcc (which on Lion is linked to llvm), and also with
gcc-4.2 (which is gnu gcc) with the same result, testing with
trapped.csd.

Thanks,
steven

On Fri, Oct 14, 2011 at 11:20 PM, Steven Yi  wrote:
> I tried removing the omp code in lua opcodes and it still crashed. I
> see what you mean about omp now in main.c.  I'm completely frustrated
> by all this at this point and am giving up for the weekend.
>
> Thanks,
> steven
>
> On Fri, Oct 14, 2011 at 3:29 PM, Victor Lazzarini
>  wrote:
>> At the moment, the PArCS code uses pthreads. There are some openmp
>> sections in csound.c, but these are not being used for multicore.
>> The luaopcodes do have OpenMP code, but I doubt the crashes Steven has
>> been reporting (on startup?) are due to this.
>> It's easy to test: just comment out the code and set the number of
>> threads variable to one in the luaopcodes sources.
>>
>> Victor
>>
>>
>> On 14 Oct 2011, at 15:12, Michael Gogins wrote:
>>
>>> I think what we need to do is figure out how to use OpenMP on OS X. If
>>> we can't do that, then we need to change the OpenMP code to pure
>>> pthreads code.
>>>
>>> OpenMP code is reduced by the compiler to pthreads calls anyway.
>>> However, I definitely find that writing multi-threaded code with
>>> OpenMP is far easier and safer than doing it any other way, and OpenMP
>>> has become something of a standard.
>>>
>>> So, I would prefer to keep the OpenMP code if at all possible.
>>>
>>> Regards,
>>> Mike
>>>
>>> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>>>  wrote:
>>>> yes, but as far as I can see they are not used anywhere. The
>>>> luaopcodes do use them though.
>>>>
>>>> Victor
>>>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>>>
>>>>> There's certainly references to omp in main.c, as well as the lua
>>>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night
>>>>> so am
>>>>> rebuilding libraries at the moment.  Before that though, I
>>>>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>>>>> the hpc site but unfortunately that was a bit problematic. I may try
>>>>> compiling gcc with macports later after I get my /usr/local/lib
>>>>> sorted
>>>>> out.
>>>>>
>>>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>>>  wrote:
>>>>>> The multicore code uses pthreads. But note that these were not
>>>>>> being
>>>>>> activated before, because the code to do that was misssing.
>>>>>> Did you pull it last night and tried again? I pushed some updates
>>>>>> in
>>>>>> main.c to do the threads.
>>>>>>
>>>>>> Victor
>>>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>>>
>>>>>>> Hi All,
>>>>>>>
>>>>>>> So I've been battling out issues with getting the Lua opcodes to
>>>>>>> work
>>>>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>>>>> here
>>>>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>>>>> crashes.  I think now I have a hunch. I did some search about
>>>>>>> OpenMP
>>>>>>> and Lion and saw here on this thread for Blender:
>>>>>>>
>>>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>>>
>>>>>>> "There is a bug in Lion which can cause any program which uses
>>>>>>> OpenMP
>>>>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>>>>> fairly
>>>>>>> widely used multithreading routine; just for example sculpting in
>>>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>>>
>>>>>>> It could be related to this."
>>>>>>>
>>>>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>>>>> things;
>>>>>>> I assume it is the same case for the multicore code.  The Blender
>>>>>>> guys
>>>>>>> seem to have sorted it out by building blender with a self-
>>>>>>> compiled
>>>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to
>>>>>>> see
>>>>>>> if there are other options than this.
>>>>>>>
>>>>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>>>>> just
>>>>>>> came out, and OpenMP still crashes (and others have noted that
>>>>>>> same
>>>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>>>>
>>>>>>> At least though I have some idea as to why the $#@% the lua
>>>>>>> opcodes
>>>>>>> were crashing!  :D
>>>>>>>
>>>>>>> steven
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>> contains a
>>>>>>> definitive record of customers, application performance, security
>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>> makes
>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>> _______________________________________________
>>>>>>> Csound-devel mailing list
>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>
>>>>>> Dr Victor Lazzarini
>>>>>> Senior Lecturer
>>>>>> Dept. of Music
>>>>>> NUI Maynooth Ireland
>>>>>> tel.: +353 1 708 3545
>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> All the data continuously generated in your IT infrastructure
>>>>>> contains a
>>>>>> definitive record of customers, application performance, security
>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>> makes
>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>> _______________________________________________
>>>>>> Csound-devel mailing list
>>>>>> Csound-devel@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>> makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>> Dr Victor Lazzarini
>>>> Senior Lecturer
>>>> Dept. of Music
>>>> NUI Maynooth Ireland
>>>> tel.: +353 1 708 3545
>>>> Victor dot Lazzarini AT nuim dot ie
>>>>
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure
>>>> contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>> makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>
>>>
>>>
>>> --
>>> Michael Gogins
>>> Irreducible Productions
>>> http://www.michael-gogins.com
>>> Michael dot Gogins at gmail dot com
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>> Dr Victor Lazzarini
>> Senior Lecturer
>> Dept. of Music
>> NUI Maynooth Ireland
>> tel.: +353 1 708 3545
>> Victor dot Lazzarini AT nuim dot ie
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-15 01:14
FromMichael Gogins
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
So  luajit and all other Lua stuff should be omitted for the time
being for 64 bit OS X builds. But it should be fine with OS X 32 bit
builds. "bit" here is "architecture" not "sample size" obviously, we
can have both 64 bit and 32 bit sample builds for 32 bit architecture.

Regards,
Mike

On Fri, Oct 14, 2011 at 7:53 PM, Steven Yi  wrote:
> UGH, okay, I found out some more information.  Turns out luajit is
> going to be really problematic for OSX 64-bit.  The luatjit site says:
>
> "If you're building a 64 bit application on OSX which links directly
> or indirectly against LuaJIT, you need to link your main executable
> with these flags:
> -pagezero_size 10000 -image_base 100000000
> Also, it's recommended to rebase all (self-compiled) shared libraries
> which are loaded at runtime on OSX/x64 (e.g. C extension modules for
> Lua). See: man rebase"
>
> this blog has some info about it:
>
> http://t-p-j.blogspot.com/2010/11/lupa-on-os-x-with-macports-python-26.html
>
> Now, from the blog, it seems that the initial executable that runs
> needs to be linked with the above flags.  The problem I came across is
> that with a test build for just x86_64, with the updated flags it the
> lua opcodes didn't crash, but the examples in
> examples/opcode_demos/lua*.csd didn't really work either.  You also
> can't build a universal binary with those flags as the image_base is
> too big for i386.
>
> Also, I this is going to cause big problems for hosts.  From the blog,
> it seems like if you want to use python with the API, you'd have to
> recompile python with the above linker flags to be able to use luajit.
>  I don't think that's really feasible to expect this for OSX 64-bit
> users, and if they don't do it, they'll likely crash when the module
> loads (on csound startup) as I experienced with the csound executable.
>  I certainly don't think anyone would recompile Java for this either.
> (another post that mentions this issue:
> http://lua-users.org/lists/lua-l/2011-04/msg00710.html)
>
> I think then that for OSX, to do an i386/x86_64 build, the Lua opcodes are out.
>
> As for why running with multicore crashes here, I'm not sure. It
> crashes in csound_orc_expand_expressions.  I've tried this with csound
> compiled with gcc (which on Lion is linked to llvm), and also with
> gcc-4.2 (which is gnu gcc) with the same result, testing with
> trapped.csd.
>
> Thanks,
> steven
>
> On Fri, Oct 14, 2011 at 11:20 PM, Steven Yi  wrote:
>> I tried removing the omp code in lua opcodes and it still crashed. I
>> see what you mean about omp now in main.c.  I'm completely frustrated
>> by all this at this point and am giving up for the weekend.
>>
>> Thanks,
>> steven
>>
>> On Fri, Oct 14, 2011 at 3:29 PM, Victor Lazzarini
>>  wrote:
>>> At the moment, the PArCS code uses pthreads. There are some openmp
>>> sections in csound.c, but these are not being used for multicore.
>>> The luaopcodes do have OpenMP code, but I doubt the crashes Steven has
>>> been reporting (on startup?) are due to this.
>>> It's easy to test: just comment out the code and set the number of
>>> threads variable to one in the luaopcodes sources.
>>>
>>> Victor
>>>
>>>
>>> On 14 Oct 2011, at 15:12, Michael Gogins wrote:
>>>
>>>> I think what we need to do is figure out how to use OpenMP on OS X. If
>>>> we can't do that, then we need to change the OpenMP code to pure
>>>> pthreads code.
>>>>
>>>> OpenMP code is reduced by the compiler to pthreads calls anyway.
>>>> However, I definitely find that writing multi-threaded code with
>>>> OpenMP is far easier and safer than doing it any other way, and OpenMP
>>>> has become something of a standard.
>>>>
>>>> So, I would prefer to keep the OpenMP code if at all possible.
>>>>
>>>> Regards,
>>>> Mike
>>>>
>>>> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>>>>  wrote:
>>>>> yes, but as far as I can see they are not used anywhere. The
>>>>> luaopcodes do use them though.
>>>>>
>>>>> Victor
>>>>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>>>>
>>>>>> There's certainly references to omp in main.c, as well as the lua
>>>>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night
>>>>>> so am
>>>>>> rebuilding libraries at the moment.  Before that though, I
>>>>>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>>>>>> the hpc site but unfortunately that was a bit problematic. I may try
>>>>>> compiling gcc with macports later after I get my /usr/local/lib
>>>>>> sorted
>>>>>> out.
>>>>>>
>>>>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>>>>  wrote:
>>>>>>> The multicore code uses pthreads. But note that these were not
>>>>>>> being
>>>>>>> activated before, because the code to do that was misssing.
>>>>>>> Did you pull it last night and tried again? I pushed some updates
>>>>>>> in
>>>>>>> main.c to do the threads.
>>>>>>>
>>>>>>> Victor
>>>>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>>>>
>>>>>>>> Hi All,
>>>>>>>>
>>>>>>>> So I've been battling out issues with getting the Lua opcodes to
>>>>>>>> work
>>>>>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>>>>>> here
>>>>>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>>>>>> crashes.  I think now I have a hunch. I did some search about
>>>>>>>> OpenMP
>>>>>>>> and Lion and saw here on this thread for Blender:
>>>>>>>>
>>>>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>>>>
>>>>>>>> "There is a bug in Lion which can cause any program which uses
>>>>>>>> OpenMP
>>>>>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>>>>>> fairly
>>>>>>>> widely used multithreading routine; just for example sculpting in
>>>>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>>>>
>>>>>>>> It could be related to this."
>>>>>>>>
>>>>>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>>>>>> things;
>>>>>>>> I assume it is the same case for the multicore code.  The Blender
>>>>>>>> guys
>>>>>>>> seem to have sorted it out by building blender with a self-
>>>>>>>> compiled
>>>>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to
>>>>>>>> see
>>>>>>>> if there are other options than this.
>>>>>>>>
>>>>>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>>>>>> just
>>>>>>>> came out, and OpenMP still crashes (and others have noted that
>>>>>>>> same
>>>>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>>>>>
>>>>>>>> At least though I have some idea as to why the $#@% the lua
>>>>>>>> opcodes
>>>>>>>> were crashing!  :D
>>>>>>>>
>>>>>>>> steven
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>> contains a
>>>>>>>> definitive record of customers, application performance, security
>>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>>> makes
>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>> _______________________________________________
>>>>>>>> Csound-devel mailing list
>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>
>>>>>>> Dr Victor Lazzarini
>>>>>>> Senior Lecturer
>>>>>>> Dept. of Music
>>>>>>> NUI Maynooth Ireland
>>>>>>> tel.: +353 1 708 3545
>>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>> contains a
>>>>>>> definitive record of customers, application performance, security
>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>> makes
>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>> _______________________________________________
>>>>>>> Csound-devel mailing list
>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> All the data continuously generated in your IT infrastructure
>>>>>> contains a
>>>>>> definitive record of customers, application performance, security
>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>> makes
>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>> _______________________________________________
>>>>>> Csound-devel mailing list
>>>>>> Csound-devel@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>> Dr Victor Lazzarini
>>>>> Senior Lecturer
>>>>> Dept. of Music
>>>>> NUI Maynooth Ireland
>>>>> tel.: +353 1 708 3545
>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>> makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Michael Gogins
>>>> Irreducible Productions
>>>> http://www.michael-gogins.com
>>>> Michael dot Gogins at gmail dot com
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure
>>>> contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>> makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>> Dr Victor Lazzarini
>>> Senior Lecturer
>>> Dept. of Music
>>> NUI Maynooth Ireland
>>> tel.: +353 1 708 3545
>>> Victor dot Lazzarini AT nuim dot ie
>>>
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel
>



-- 
Michael Gogins
Irreducible Productions
http://www.michael-gogins.com
Michael dot Gogins at gmail dot com

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-15 01:23
FromSteven Yi
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
But the trick is universal binaries.  Victor has been building
ppc/i386 universal binaries.  I have been working on i386/x86_64
binaries.  There is currently no single architecture binary in the
works.  The need for i386/x86_64 as a universal binary is so that
applications built for one or the other can work with the same
CsoundLib.  I believe after this release the ppc/i386 builds will be
discontinued.

On Sat, Oct 15, 2011 at 1:14 AM, Michael Gogins
 wrote:
> So  luajit and all other Lua stuff should be omitted for the time
> being for 64 bit OS X builds. But it should be fine with OS X 32 bit
> builds. "bit" here is "architecture" not "sample size" obviously, we
> can have both 64 bit and 32 bit sample builds for 32 bit architecture.
>
> Regards,
> Mike
>
> On Fri, Oct 14, 2011 at 7:53 PM, Steven Yi  wrote:
>> UGH, okay, I found out some more information.  Turns out luajit is
>> going to be really problematic for OSX 64-bit.  The luatjit site says:
>>
>> "If you're building a 64 bit application on OSX which links directly
>> or indirectly against LuaJIT, you need to link your main executable
>> with these flags:
>> -pagezero_size 10000 -image_base 100000000
>> Also, it's recommended to rebase all (self-compiled) shared libraries
>> which are loaded at runtime on OSX/x64 (e.g. C extension modules for
>> Lua). See: man rebase"
>>
>> this blog has some info about it:
>>
>> http://t-p-j.blogspot.com/2010/11/lupa-on-os-x-with-macports-python-26.html
>>
>> Now, from the blog, it seems that the initial executable that runs
>> needs to be linked with the above flags.  The problem I came across is
>> that with a test build for just x86_64, with the updated flags it the
>> lua opcodes didn't crash, but the examples in
>> examples/opcode_demos/lua*.csd didn't really work either.  You also
>> can't build a universal binary with those flags as the image_base is
>> too big for i386.
>>
>> Also, I this is going to cause big problems for hosts.  From the blog,
>> it seems like if you want to use python with the API, you'd have to
>> recompile python with the above linker flags to be able to use luajit.
>>  I don't think that's really feasible to expect this for OSX 64-bit
>> users, and if they don't do it, they'll likely crash when the module
>> loads (on csound startup) as I experienced with the csound executable.
>>  I certainly don't think anyone would recompile Java for this either.
>> (another post that mentions this issue:
>> http://lua-users.org/lists/lua-l/2011-04/msg00710.html)
>>
>> I think then that for OSX, to do an i386/x86_64 build, the Lua opcodes are out.
>>
>> As for why running with multicore crashes here, I'm not sure. It
>> crashes in csound_orc_expand_expressions.  I've tried this with csound
>> compiled with gcc (which on Lion is linked to llvm), and also with
>> gcc-4.2 (which is gnu gcc) with the same result, testing with
>> trapped.csd.
>>
>> Thanks,
>> steven
>>
>> On Fri, Oct 14, 2011 at 11:20 PM, Steven Yi  wrote:
>>> I tried removing the omp code in lua opcodes and it still crashed. I
>>> see what you mean about omp now in main.c.  I'm completely frustrated
>>> by all this at this point and am giving up for the weekend.
>>>
>>> Thanks,
>>> steven
>>>
>>> On Fri, Oct 14, 2011 at 3:29 PM, Victor Lazzarini
>>>  wrote:
>>>> At the moment, the PArCS code uses pthreads. There are some openmp
>>>> sections in csound.c, but these are not being used for multicore.
>>>> The luaopcodes do have OpenMP code, but I doubt the crashes Steven has
>>>> been reporting (on startup?) are due to this.
>>>> It's easy to test: just comment out the code and set the number of
>>>> threads variable to one in the luaopcodes sources.
>>>>
>>>> Victor
>>>>
>>>>
>>>> On 14 Oct 2011, at 15:12, Michael Gogins wrote:
>>>>
>>>>> I think what we need to do is figure out how to use OpenMP on OS X. If
>>>>> we can't do that, then we need to change the OpenMP code to pure
>>>>> pthreads code.
>>>>>
>>>>> OpenMP code is reduced by the compiler to pthreads calls anyway.
>>>>> However, I definitely find that writing multi-threaded code with
>>>>> OpenMP is far easier and safer than doing it any other way, and OpenMP
>>>>> has become something of a standard.
>>>>>
>>>>> So, I would prefer to keep the OpenMP code if at all possible.
>>>>>
>>>>> Regards,
>>>>> Mike
>>>>>
>>>>> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>>>>>  wrote:
>>>>>> yes, but as far as I can see they are not used anywhere. The
>>>>>> luaopcodes do use them though.
>>>>>>
>>>>>> Victor
>>>>>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>>>>>
>>>>>>> There's certainly references to omp in main.c, as well as the lua
>>>>>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last night
>>>>>>> so am
>>>>>>> rebuilding libraries at the moment.  Before that though, I
>>>>>>> experimented a bit with the pre-built gcc 4.6 binaries that were on
>>>>>>> the hpc site but unfortunately that was a bit problematic. I may try
>>>>>>> compiling gcc with macports later after I get my /usr/local/lib
>>>>>>> sorted
>>>>>>> out.
>>>>>>>
>>>>>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>>>>>  wrote:
>>>>>>>> The multicore code uses pthreads. But note that these were not
>>>>>>>> being
>>>>>>>> activated before, because the code to do that was misssing.
>>>>>>>> Did you pull it last night and tried again? I pushed some updates
>>>>>>>> in
>>>>>>>> main.c to do the threads.
>>>>>>>>
>>>>>>>> Victor
>>>>>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> So I've been battling out issues with getting the Lua opcodes to
>>>>>>>>> work
>>>>>>>>> here on OSX Lion.  I also found it strange I was getting crashes
>>>>>>>>> here
>>>>>>>>> with -j 2 to turn on multicore when Victor was not seeing the same
>>>>>>>>> crashes.  I think now I have a hunch. I did some search about
>>>>>>>>> OpenMP
>>>>>>>>> and Lion and saw here on this thread for Blender:
>>>>>>>>>
>>>>>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>>>>>
>>>>>>>>> "There is a bug in Lion which can cause any program which uses
>>>>>>>>> OpenMP
>>>>>>>>> to crash; a bug which does not exist in Snow Leopard. This is a
>>>>>>>>> fairly
>>>>>>>>> widely used multithreading routine; just for example sculpting in
>>>>>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>>>>>
>>>>>>>>> It could be related to this."
>>>>>>>>>
>>>>>>>>> I know the Lua opcodes use openMP to get a thread ID and other
>>>>>>>>> things;
>>>>>>>>> I assume it is the same case for the multicore code.  The Blender
>>>>>>>>> guys
>>>>>>>>> seem to have sorted it out by building blender with a self-
>>>>>>>>> compiled
>>>>>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still researching to
>>>>>>>>> see
>>>>>>>>> if there are other options than this.
>>>>>>>>>
>>>>>>>>> Also to note, I am using the latest update of Lion (10.7.2) that
>>>>>>>>> just
>>>>>>>>> came out, and OpenMP still crashes (and others have noted that
>>>>>>>>> same
>>>>>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL).
>>>>>>>>>
>>>>>>>>> At least though I have some idea as to why the $#@% the lua
>>>>>>>>> opcodes
>>>>>>>>> were crashing!  :D
>>>>>>>>>
>>>>>>>>> steven
>>>>>>>>>
>>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>>> contains a
>>>>>>>>> definitive record of customers, application performance, security
>>>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>>>> makes
>>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>>> _______________________________________________
>>>>>>>>> Csound-devel mailing list
>>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>>
>>>>>>>> Dr Victor Lazzarini
>>>>>>>> Senior Lecturer
>>>>>>>> Dept. of Music
>>>>>>>> NUI Maynooth Ireland
>>>>>>>> tel.: +353 1 708 3545
>>>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>> contains a
>>>>>>>> definitive record of customers, application performance, security
>>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>>> makes
>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>> _______________________________________________
>>>>>>>> Csound-devel mailing list
>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>> contains a
>>>>>>> definitive record of customers, application performance, security
>>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>>> makes
>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>> _______________________________________________
>>>>>>> Csound-devel mailing list
>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>
>>>>>> Dr Victor Lazzarini
>>>>>> Senior Lecturer
>>>>>> Dept. of Music
>>>>>> NUI Maynooth Ireland
>>>>>> tel.: +353 1 708 3545
>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> All the data continuously generated in your IT infrastructure
>>>>>> contains a
>>>>>> definitive record of customers, application performance, security
>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>> makes
>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>> _______________________________________________
>>>>>> Csound-devel mailing list
>>>>>> Csound-devel@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Michael Gogins
>>>>> Irreducible Productions
>>>>> http://www.michael-gogins.com
>>>>> Michael dot Gogins at gmail dot com
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>> makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>> Dr Victor Lazzarini
>>>> Senior Lecturer
>>>> Dept. of Music
>>>> NUI Maynooth Ireland
>>>> tel.: +353 1 708 3545
>>>> Victor dot Lazzarini AT nuim dot ie
>>>>
>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> All the data continuously generated in your IT infrastructure contains a
>>>> definitive record of customers, application performance, security
>>>> threats, fraudulent activity and more. Splunk takes this data and makes
>>>> sense of it. Business sense. IT sense. Common sense.
>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>> _______________________________________________
>>>> Csound-devel mailing list
>>>> Csound-devel@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>
>>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>
>
>
> --
> Michael Gogins
> Irreducible Productions
> http://www.michael-gogins.com
> Michael dot Gogins at gmail dot com
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel
>

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

Date2011-10-15 02:24
FromVictor Lazzarini
SubjectRe: [Cs-dev] OSX Lion, OpenMP, and crashes
yes, it looks like lua opcodes are out until luajit gets sorted for  
x86_64 on OSX.

The parcs crash is a concern, though.

Victor

On 15 Oct 2011, at 01:23, Steven Yi wrote:

> But the trick is universal binaries.  Victor has been building
> ppc/i386 universal binaries.  I have been working on i386/x86_64
> binaries.  There is currently no single architecture binary in the
> works.  The need for i386/x86_64 as a universal binary is so that
> applications built for one or the other can work with the same
> CsoundLib.  I believe after this release the ppc/i386 builds will be
> discontinued.
>
> On Sat, Oct 15, 2011 at 1:14 AM, Michael Gogins
>  wrote:
>> So  luajit and all other Lua stuff should be omitted for the time
>> being for 64 bit OS X builds. But it should be fine with OS X 32 bit
>> builds. "bit" here is "architecture" not "sample size" obviously, we
>> can have both 64 bit and 32 bit sample builds for 32 bit  
>> architecture.
>>
>> Regards,
>> Mike
>>
>> On Fri, Oct 14, 2011 at 7:53 PM, Steven Yi   
>> wrote:
>>> UGH, okay, I found out some more information.  Turns out luajit is
>>> going to be really problematic for OSX 64-bit.  The luatjit site  
>>> says:
>>>
>>> "If you're building a 64 bit application on OSX which links directly
>>> or indirectly against LuaJIT, you need to link your main executable
>>> with these flags:
>>> -pagezero_size 10000 -image_base 100000000
>>> Also, it's recommended to rebase all (self-compiled) shared  
>>> libraries
>>> which are loaded at runtime on OSX/x64 (e.g. C extension modules for
>>> Lua). See: man rebase"
>>>
>>> this blog has some info about it:
>>>
>>> http://t-p-j.blogspot.com/2010/11/lupa-on-os-x-with-macports-python-26.html
>>>
>>> Now, from the blog, it seems that the initial executable that runs
>>> needs to be linked with the above flags.  The problem I came  
>>> across is
>>> that with a test build for just x86_64, with the updated flags it  
>>> the
>>> lua opcodes didn't crash, but the examples in
>>> examples/opcode_demos/lua*.csd didn't really work either.  You also
>>> can't build a universal binary with those flags as the image_base is
>>> too big for i386.
>>>
>>> Also, I this is going to cause big problems for hosts.  From the  
>>> blog,
>>> it seems like if you want to use python with the API, you'd have to
>>> recompile python with the above linker flags to be able to use  
>>> luajit.
>>>  I don't think that's really feasible to expect this for OSX 64-bit
>>> users, and if they don't do it, they'll likely crash when the module
>>> loads (on csound startup) as I experienced with the csound  
>>> executable.
>>>  I certainly don't think anyone would recompile Java for this  
>>> either.
>>> (another post that mentions this issue:
>>> http://lua-users.org/lists/lua-l/2011-04/msg00710.html)
>>>
>>> I think then that for OSX, to do an i386/x86_64 build, the Lua  
>>> opcodes are out.
>>>
>>> As for why running with multicore crashes here, I'm not sure. It
>>> crashes in csound_orc_expand_expressions.  I've tried this with  
>>> csound
>>> compiled with gcc (which on Lion is linked to llvm), and also with
>>> gcc-4.2 (which is gnu gcc) with the same result, testing with
>>> trapped.csd.
>>>
>>> Thanks,
>>> steven
>>>
>>> On Fri, Oct 14, 2011 at 11:20 PM, Steven Yi   
>>> wrote:
>>>> I tried removing the omp code in lua opcodes and it still  
>>>> crashed. I
>>>> see what you mean about omp now in main.c.  I'm completely  
>>>> frustrated
>>>> by all this at this point and am giving up for the weekend.
>>>>
>>>> Thanks,
>>>> steven
>>>>
>>>> On Fri, Oct 14, 2011 at 3:29 PM, Victor Lazzarini
>>>>  wrote:
>>>>> At the moment, the PArCS code uses pthreads. There are some openmp
>>>>> sections in csound.c, but these are not being used for multicore.
>>>>> The luaopcodes do have OpenMP code, but I doubt the crashes  
>>>>> Steven has
>>>>> been reporting (on startup?) are due to this.
>>>>> It's easy to test: just comment out the code and set the number of
>>>>> threads variable to one in the luaopcodes sources.
>>>>>
>>>>> Victor
>>>>>
>>>>>
>>>>> On 14 Oct 2011, at 15:12, Michael Gogins wrote:
>>>>>
>>>>>> I think what we need to do is figure out how to use OpenMP on  
>>>>>> OS X. If
>>>>>> we can't do that, then we need to change the OpenMP code to pure
>>>>>> pthreads code.
>>>>>>
>>>>>> OpenMP code is reduced by the compiler to pthreads calls anyway.
>>>>>> However, I definitely find that writing multi-threaded code with
>>>>>> OpenMP is far easier and safer than doing it any other way, and  
>>>>>> OpenMP
>>>>>> has become something of a standard.
>>>>>>
>>>>>> So, I would prefer to keep the OpenMP code if at all possible.
>>>>>>
>>>>>> Regards,
>>>>>> Mike
>>>>>>
>>>>>> On Fri, Oct 14, 2011 at 10:03 AM, Victor Lazzarini
>>>>>>  wrote:
>>>>>>> yes, but as far as I can see they are not used anywhere. The
>>>>>>> luaopcodes do use them though.
>>>>>>>
>>>>>>> Victor
>>>>>>> On 14 Oct 2011, at 14:14, Steven Yi wrote:
>>>>>>>
>>>>>>>> There's certainly references to omp in main.c, as well as the  
>>>>>>>> lua
>>>>>>>> opcodes.  I fantastically rm -rf 'd my /usr/local/lib last  
>>>>>>>> night
>>>>>>>> so am
>>>>>>>> rebuilding libraries at the moment.  Before that though, I
>>>>>>>> experimented a bit with the pre-built gcc 4.6 binaries that  
>>>>>>>> were on
>>>>>>>> the hpc site but unfortunately that was a bit problematic. I  
>>>>>>>> may try
>>>>>>>> compiling gcc with macports later after I get my /usr/local/lib
>>>>>>>> sorted
>>>>>>>> out.
>>>>>>>>
>>>>>>>> On Fri, Oct 14, 2011 at 6:14 AM, Victor Lazzarini
>>>>>>>>  wrote:
>>>>>>>>> The multicore code uses pthreads. But note that these were not
>>>>>>>>> being
>>>>>>>>> activated before, because the code to do that was misssing.
>>>>>>>>> Did you pull it last night and tried again? I pushed some  
>>>>>>>>> updates
>>>>>>>>> in
>>>>>>>>> main.c to do the threads.
>>>>>>>>>
>>>>>>>>> Victor
>>>>>>>>> On 14 Oct 2011, at 00:20, Steven Yi wrote:
>>>>>>>>>
>>>>>>>>>> Hi All,
>>>>>>>>>>
>>>>>>>>>> So I've been battling out issues with getting the Lua  
>>>>>>>>>> opcodes to
>>>>>>>>>> work
>>>>>>>>>> here on OSX Lion.  I also found it strange I was getting  
>>>>>>>>>> crashes
>>>>>>>>>> here
>>>>>>>>>> with -j 2 to turn on multicore when Victor was not seeing  
>>>>>>>>>> the same
>>>>>>>>>> crashes.  I think now I have a hunch. I did some search about
>>>>>>>>>> OpenMP
>>>>>>>>>> and Lion and saw here on this thread for Blender:
>>>>>>>>>>
>>>>>>>>>> http://forum.daz3d.com/viewtopic.php?t=174331&sid=0ab23f5e939d7a70d7b6594c33c45c4b
>>>>>>>>>>
>>>>>>>>>> "There is a bug in Lion which can cause any program which  
>>>>>>>>>> uses
>>>>>>>>>> OpenMP
>>>>>>>>>> to crash; a bug which does not exist in Snow Leopard. This  
>>>>>>>>>> is a
>>>>>>>>>> fairly
>>>>>>>>>> widely used multithreading routine; just for example  
>>>>>>>>>> sculpting in
>>>>>>>>>> Blender will also will cause a crash, as it too uses OpenMP.
>>>>>>>>>>
>>>>>>>>>> It could be related to this."
>>>>>>>>>>
>>>>>>>>>> I know the Lua opcodes use openMP to get a thread ID and  
>>>>>>>>>> other
>>>>>>>>>> things;
>>>>>>>>>> I assume it is the same case for the multicore code.  The  
>>>>>>>>>> Blender
>>>>>>>>>> guys
>>>>>>>>>> seem to have sorted it out by building blender with a self-
>>>>>>>>>> compiled
>>>>>>>>>> version of gcc 4.6 (OSX Lion uses 4.2). I'm still  
>>>>>>>>>> researching to
>>>>>>>>>> see
>>>>>>>>>> if there are other options than this.
>>>>>>>>>>
>>>>>>>>>> Also to note, I am using the latest update of Lion (10.7.2)  
>>>>>>>>>> that
>>>>>>>>>> just
>>>>>>>>>> came out, and OpenMP still crashes (and others have noted  
>>>>>>>>>> that
>>>>>>>>>> same
>>>>>>>>>> https://plus.google.com/101546077160053841119/posts/9h35WKKqffL) 
>>>>>>>>>> .
>>>>>>>>>>
>>>>>>>>>> At least though I have some idea as to why the $#@% the lua
>>>>>>>>>> opcodes
>>>>>>>>>> were crashing!  :D
>>>>>>>>>>
>>>>>>>>>> steven
>>>>>>>>>>
>>>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>>>> contains a
>>>>>>>>>> definitive record of customers, application performance,  
>>>>>>>>>> security
>>>>>>>>>> threats, fraudulent activity and more. Splunk takes this  
>>>>>>>>>> data and
>>>>>>>>>> makes
>>>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Csound-devel mailing list
>>>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>>>
>>>>>>>>> Dr Victor Lazzarini
>>>>>>>>> Senior Lecturer
>>>>>>>>> Dept. of Music
>>>>>>>>> NUI Maynooth Ireland
>>>>>>>>> tel.: +353 1 708 3545
>>>>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>>> contains a
>>>>>>>>> definitive record of customers, application performance,  
>>>>>>>>> security
>>>>>>>>> threats, fraudulent activity and more. Splunk takes this  
>>>>>>>>> data and
>>>>>>>>> makes
>>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>>> _______________________________________________
>>>>>>>>> Csound-devel mailing list
>>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>>>
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>>> contains a
>>>>>>>> definitive record of customers, application performance,  
>>>>>>>> security
>>>>>>>> threats, fraudulent activity and more. Splunk takes this data  
>>>>>>>> and
>>>>>>>> makes
>>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>>> _______________________________________________
>>>>>>>> Csound-devel mailing list
>>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>
>>>>>>> Dr Victor Lazzarini
>>>>>>> Senior Lecturer
>>>>>>> Dept. of Music
>>>>>>> NUI Maynooth Ireland
>>>>>>> tel.: +353 1 708 3545
>>>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ------------------------------------------------------------------------------
>>>>>>> All the data continuously generated in your IT infrastructure
>>>>>>> contains a
>>>>>>> definitive record of customers, application performance,  
>>>>>>> security
>>>>>>> threats, fraudulent activity and more. Splunk takes this data  
>>>>>>> and
>>>>>>> makes
>>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>>> _______________________________________________
>>>>>>> Csound-devel mailing list
>>>>>>> Csound-devel@lists.sourceforge.net
>>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Michael Gogins
>>>>>> Irreducible Productions
>>>>>> http://www.michael-gogins.com
>>>>>> Michael dot Gogins at gmail dot com
>>>>>>
>>>>>> ------------------------------------------------------------------------------
>>>>>> All the data continuously generated in your IT infrastructure
>>>>>> contains a
>>>>>> definitive record of customers, application performance, security
>>>>>> threats, fraudulent activity and more. Splunk takes this data and
>>>>>> makes
>>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>>> _______________________________________________
>>>>>> Csound-devel mailing list
>>>>>> Csound-devel@lists.sourceforge.net
>>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>> Dr Victor Lazzarini
>>>>> Senior Lecturer
>>>>> Dept. of Music
>>>>> NUI Maynooth Ireland
>>>>> tel.: +353 1 708 3545
>>>>> Victor dot Lazzarini AT nuim dot ie
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> All the data continuously generated in your IT infrastructure  
>>>>> contains a
>>>>> definitive record of customers, application performance, security
>>>>> threats, fraudulent activity and more. Splunk takes this data  
>>>>> and makes
>>>>> sense of it. Business sense. IT sense. Common sense.
>>>>> http://p.sf.net/sfu/splunk-d2d-oct
>>>>> _______________________________________________
>>>>> Csound-devel mailing list
>>>>> Csound-devel@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>>>
>>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure  
>>> contains a
>>> definitive record of customers, application performance, security
>>> threats, fraudulent activity and more. Splunk takes this data and  
>>> makes
>>> sense of it. Business sense. IT sense. Common sense.
>>> http://p.sf.net/sfu/splunk-d2d-oct
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>>
>>
>>
>>
>> --
>> Michael Gogins
>> Irreducible Productions
>> http://www.michael-gogins.com
>> Michael dot Gogins at gmail dot com
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure  
>> contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and  
>> makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2d-oct
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure  
> contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and  
> makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2d-oct
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

Dr Victor Lazzarini
Senior Lecturer
Dept. of Music
NUI Maynooth Ireland
tel.: +353 1 708 3545
Victor dot Lazzarini AT nuim dot ie




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2d-oct
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net