On Mon, 26 May 2008, Adam wrote:

>
> May be a simple or silly question, but;  what precision can I expect from
> simple i-rate divides ?  To the right of the decimal point.  As I can't seem
> to get below 0.001
>
> I can't find any mention of precision or resolution, in the manual.
> And feel I should really be knowing what to expect.
>
It uses 32bit fpt arithmetic internally.  Do not confuse the printed 
values with the actual values.  Various printf like stuff can print to 
higher precision.  But all calcy=ulations are done at machine precision, 
which is about about 7 decimal digits -- depending on how you count....

Perhaps a small example of what you are attempting might clarify things?

==John ff