double-precision
How accurate/precise is java.lang.Math.pow(x, n) for large n?
I would like to calculate (1.0-p)^n where p is a double be开发者_如何学Ctween 0 and 1 (often very close to 0) and n is a positive integer that might be on the order of hundreds or thousands (perhaps l[详细]
2023-02-22 13:11 分类:问答Subtracting 2 different doubles yields zero
I\'m building a loc-based app, using CLLocationManager and locationManager:didUpdateToLocation: fromLocation:[详细]
2023-02-19 15:10 分类:问答Java Doubles are not good at math [closed]
It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical andcannot be reasonably answered in its current form. For help clari[详细]
2023-02-18 01:42 分类:问答MATLAB: Converting a uint32 (4-byte) value to the corresponding IEEE single-precision floating-point form
In MATLAB (r2009b) I have a uint32 variable containing the value 2147484101. This number (its 4-bytes) has been extracted from a digital machine-vision camera in a grabbing process. According to what[详细]
2023-02-10 18:43 分类:问答How to correctly and standardly compare floats?
Every time I start a new project an开发者_Python百科d when I need to compare some float or double variables I write the code like this one:[详细]
2023-02-02 00:51 分类:问答NSDate and double precision problem
Here is the code NSDate* d = [NSDate dateWithTimeIntervalSince1970:32.4560]; doub开发者_运维技巧le ti = [d timeIntervalSince1970];[详细]
2023-01-30 16:05 分类:问答IEEE-754 floating-point precision: How much error is allowed?
I\'m working on porting the sqrt function (for 64-bit doubles) from fdlibm to a model-checker tool I\'m using at the moment (cbmc).[详细]
2023-01-27 21:32 分类:问答Matlab: Storing large numbers in Matlab
For storing large numbers I am refering to the next: 2.718281828459045534884808148490265011787414550开发者_C百科7812500[详细]
2023-01-25 17:25 分类:问答How can I 'trim' a C# double to the value it will be stored as in an sqlite database?
I noticed that when I store a double value such as e.g. x = 0.56657011973046234 in an sqlite database, and then retrieve it later, I get y = 0.56657011973046201. According to the sqlite spec and the .[详细]
2023-01-25 05:33 分类:问答C# High double precision
I\'m writing a function that calculates the value of PI, and returns it as a double. So far so good. But once the function gets to 14 digits after the decimal place, it can\'t hold an开发者_如何学Pyth[详细]
2023-01-24 04:25 分类:问答