After 2 complete rewrites I have finished two opcodes for writing and reading to and from hdf5 files. It can read and write all variable types except for strings, so that is: a,k,i variables and arrays.
It supports arrays of any rank, arrays can be read at a,k,i rate regardless of what they were written as. Also a/k variables can be read as 1D arrays. 
Any amount of variables can be read from and written to a hdf5 file at a time, so you can write stuff like:

hdf5writer “~/Desktop/csoundvars.h5”, aData, kData, kArray, AArray, etc…
aData, kData, kArray[], aArray[], ... hdf5reader  “~/Desktop/csoundvars.h5”, “aData”, “kData”, “kArray”, “aArray”, ...

I was wondering if this can be included in csound as a plugin, and if so what steps do I need to take to help that process. It is currently an Xcode project but it is written in C99 and depends on just the hdf5 library so I think it should just work on other systems. As they are complicated enough opcodes it would be nice if people could test them. 
I think for anyone using MATLAB / Python for DSP research these could be quite handy,
Thanks
Ed
------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/lis

I'd love to help test but I've no idea why I might ever want to use
hdf5? Perhaps you could entice us with a few practical examples?

On 7 October 2014 18:16, Edward Costello  wrote:
> After 2 complete rewrites I have finished two opcodes for writing and reading to and from hdf5 files. It can read and write all variable types except for strings, so that is: a,k,i variables and arrays.
> It supports arrays of any rank, arrays can be read at a,k,i rate regardless of what they were written as. Also a/k variables can be read as 1D arrays.
> Any amount of variables can be read from and written to a hdf5 file at a time, so you can write stuff like:
>
> hdf5writer “~/Desktop/csoundvars.h5”, aData, kData, kArray, AArray, etc…
> aData, kData, kArray[], aArray[], ... hdf5reader  “~/Desktop/csoundvars.h5”, “aData”, “kData”, “kArray”, “aArray”, ...
>
> I was wondering if this can be included in csound as a plugin, and if so what steps do I need to take to help that process. It is currently an Xcode project but it is written in C99 and depends on just the hdf5 library so I think it should just work on other systems. As they are complicated enough opcodes it would be nice if people could test them.
> I think for anyone using MATLAB / Python for DSP research these could be quite handy,
> Thanks
> Ed
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csou

This is useful if you want to move data between Csound and other applications. It can also be used to replace things like the Pvoc file format.
So for instance if you want to do audio feature analysis using Csound opcodes you can store the data as hdf5 files and import them into matlab/pylab for data manipulation or visualisation.
An example could be, you could store in 1 hdf5 file a dataset that contains the audio samples of a file, the FFT/Phase vocoder data, a chromagram, an onset detection feature vector etc.
I don’t know if thats enticing for anyone who isn’t researching audio analysis / synthesis algorithms though.

> On 7 Oct 2014, at 19:33, Rory Walsh  wrote:
> 
> I'd love to help test but I've no idea why I might ever want to use
> hdf5? Perhaps you could entice us with a few practical examples?
> 
> On 7 October 2014 18:16, Edward Costello  wrote:
>> After 2 complete rewrites I have finished two opcodes for writing and reading to and from hdf5 files. It can read and write all variable types except for strings, so that is: a,k,i variables and arrays.
>> It supports arrays of any rank, arrays can be read at a,k,i rate regardless of what they were written as. Also a/k variables can be read as 1D arrays.
>> Any amount of variables can be read from and written to a hdf5 file at a time, so you can write stuff like:
>> 
>> hdf5writer “~/Desktop/csoundvars.h5”, aData, kData, kArray, AArray, etc…
>> aData, kData, kArray[], aArray[], ... hdf5reader  “~/Desktop/csoundvars.h5”, “aData”, “kData”, “kArray”, “aArray”, ...
>> 
>> I was wondering if this can be included in csound as a plugin, and if so what steps do I need to take to help that process. It is currently an Xcode project but it is written in C99 and depends on just the hdf5 library so I think it should just work on other systems. As they are complicated enough opcodes it would be nice if people could test them.
>> I think for anyone using MATLAB / Python for DSP research these could be quite handy,
>> Thanks
>> Ed
>> ------------------------------------------------------------------------------
>> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
> 
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel


------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https:

That makes things clearer. It's likely I'll end up using it at some
stage but not right now ;)

On 7 October 2014 20:02, Edward Costello  wrote:
> This is useful if you want to move data between Csound and other applications. It can also be used to replace things like the Pvoc file format.
> So for instance if you want to do audio feature analysis using Csound opcodes you can store the data as hdf5 files and import them into matlab/pylab for data manipulation or visualisation.
> An example could be, you could store in 1 hdf5 file a dataset that contains the audio samples of a file, the FFT/Phase vocoder data, a chromagram, an onset detection feature vector etc.
> I don’t know if thats enticing for anyone who isn’t researching audio analysis / synthesis algorithms though.
>
>> On 7 Oct 2014, at 19:33, Rory Walsh  wrote:
>>
>> I'd love to help test but I've no idea why I might ever want to use
>> hdf5? Perhaps you could entice us with a few practical examples?
>>
>> On 7 October 2014 18:16, Edward Costello  wrote:
>>> After 2 complete rewrites I have finished two opcodes for writing and reading to and from hdf5 files. It can read and write all variable types except for strings, so that is: a,k,i variables and arrays.
>>> It supports arrays of any rank, arrays can be read at a,k,i rate regardless of what they were written as. Also a/k variables can be read as 1D arrays.
>>> Any amount of variables can be read from and written to a hdf5 file at a time, so you can write stuff like:
>>>
>>> hdf5writer “~/Desktop/csoundvars.h5”, aData, kData, kArray, AArray, etc…
>>> aData, kData, kArray[], aArray[], ... hdf5reader  “~/Desktop/csoundvars.h5”, “aData”, “kData”, “kArray”, “aArray”, ...
>>>
>>> I was wondering if this can be included in csound as a plugin, and if so what steps do I need to take to help that process. It is currently an Xcode project but it is written in C99 and depends on just the hdf5 library so I think it should just work on other systems. As they are complicated enough opcodes it would be nice if people could test them.
>>> I think for anyone using MATLAB / Python for DSP research these could be quite handy,
>>> Thanks
>>> Ed
>>> ------------------------------------------------------------------------------
>>> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>>> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>>> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>>> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>>> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>>> _______________________________________________
>>> Csound-devel mailing list
>>> Csound-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>>
>> ------------------------------------------------------------------------------
>> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
>> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
>> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
>> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Csound-devel mailing list
>> Csound-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/csound-devel
>
>
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.ne

If it needs a new library it must be a plugin.

What is hdf5?

==John ffitch

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

If it needs a new library it must be a plugin.

What is hdf5?

==John ffitch

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csound-devel

Sowing my ignorance.... what is  Numpy?  I prefer to to use matlab on 
efficiency grounds, and never found a use for R.

On Tue, 7 Oct 2014, Edward Costello wrote:

> Its a file format that is designed to store large amounts of data. It is used
> a lot in scientific computing for storing datasets, and there are interfaces
> for reading and writing datasets to hdf5 files for many commonly used
> scientific computing programs such as Matlab, R, Numpy and a few more. You can
> also store multiple datasets in a single
> file.http://en.wikipedia.org/wiki/Hierarchical_Data_Format
>
>       On 7 Oct 2014, at 20:48, john ffitch  wrote:
> 
> If it needs a new library it must be a plugin.
> 
> What is hdf5?
> 
> ==John ffitch
>

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net

I think it’s a library for adding MATLAB like matrix algebra functions to the python language

> On 7 Oct 2014, at 21:39, jpff  wrote:
> 
> Sowing my ignorance.... what is  Numpy?  I prefer to to use matlab on 
> efficiency grounds, and never found a use for R.
> 
> On Tue, 7 Oct 2014, Edward Costello wrote:
> 
>> Its a file format that is designed to store large amounts of data. It is used
>> a lot in scientific computing for storing datasets, and there are interfaces
>> for reading and writing datasets to hdf5 files for many commonly used
>> scientific computing programs such as Matlab, R, Numpy and a few more. You can
>> also store multiple datasets in a single
>> file.http://en.wikipedia.org/wiki/Hierarchical_Data_Format
>> 
>>      On 7 Oct 2014, at 20:48, john ffitch  wrote:
>> 
>> If it needs a new library it must be a plugin.
>> 
>> What is hdf5?
>> 
>> ==John ffitch
>> 
> 
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel


------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://li

Numpy is short for "Numerical Python." It contains arrays, matrices, operations on matrices, and some other stuff. It's efficient and usable. Numpy in turn is part of SciPy which contains a whole grab bag of stuff including a lot of computer algebra. It's intended to give rsearch scientists free access to open-source software that competes with MATLAB, R, etc.

HDF5 is described here:  http://en.wikipedia.org/wiki/Hierarchical_Data_Format. It can apparently be used BY MATLAB, R, etc. so I suppose it could be used as a data interchange format. There are APIs for HDF5. 

By using LuaJIT/FFI and the existing HDF5 C APIs it already is possible to use HDF5, in Csound but native opcodes would simplify the process.

MATLAB is good software but it is expensive. Academics often have institutional access to it.

Regards,

Mike

-----------------------------------------------------

Michael Gogins
Irreducible Productions
http://michaelgogins.tumblr.com
Michael dot Gogins at gmail dot com

On Tue, Oct 7, 2014 at 3:44 PM, Edward Costello <EDWARD.COSTELLO@nuim.ie> wrote:

I think it’s a library for adding MATLAB like matrix algebra functions to the python language

> On 7 Oct 2014, at 21:39, jpff <jpff@codemist.co.uk> wrote:
>
> Sowing my ignorance.... what is  Numpy?  I prefer to to use matlab on
> efficiency grounds, and never found a use for R.
>
> On Tue, 7 Oct 2014, Edward Costello wrote:
>
>> Its a file format that is designed to store large amounts of data. It is used
>> a lot in scientific computing for storing datasets, and there are interfaces
>> for reading and writing datasets to hdf5 files for many commonly used
>> scientific computing programs such as Matlab, R, Numpy and a few more. You can
>> also store multiple datasets in a single
>> file.http://en.wikipedia.org/wiki/Hierarchical_Data_Format
>>
>>      On 7 Oct 2014, at 20:48, john ffitch <jpff@codemist.co.uk> wrote:
>>
>> If it needs a new library it must be a plugin.
>>
>> What is hdf5?
>>
>> ==John ffitch
>>
>
> ------------------------------------------------------------------------------
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> _______________________________________________
> Csound-devel mailing list
> Csound-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/csound-devel


------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csound-devel

------------------------------------------------------------------------------
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk

_______________________________________________
Csound-devel mailing list
Csound-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/csound-devel