[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Sc-devel] When integers go bad



Also, that's a questionable example because SC doesn't do integer
exponentiation.

(2**6).asCompileString
64.0

I think (??) many other languages behave similarly... but not totally sure.

hjh

On Wed, Feb 27, 2008 at 2:12 PM, Julian Rohrhuber
<rohrhuber@xxxxxxxxxxxxxx> wrote:
> before you get infinities, you get degraded precision.
>
>  a = 3; b = 2147483647.0; b ** a ** (1/a) - b
>
>  -2.6226043701172e-06


-- 
James Harkins /// dewdrop world
jamshark70@xxxxxxxxxxxxxxxxx
http://www.dewdrop-world.net

"Come said the Muse,
Sing me a song no poet has yet chanted,
Sing me the universal."  -- Whitman