开发者

Excel Floating Point Arihmetic - What Type Does It Actually Use

开发者 https://www.devze.com 2022-12-19 17:58 出处:网络
From a previous questions someone indicated that Excel uses a 64 bit (8 byte) double-precision floating.

From a previous questions someone indicated that Excel uses a 64 bit (8 byte) double-precision floating.

Is that correct - Is there any material on this at all?

I am try开发者_开发技巧ing to tie off numbers and this is killing me!


According to this article yes, it uses 64 bit double precision floating point numbers. The article also describes the rounding errors etc associated with this format.


Have a look at

Floating-point arithmetic

Under the section Precision

A floating-point number is stored in binary in three parts within a 65-bit range: the sign, the exponent, and the mantissa.

Here is another article

Understanding Floating Point Precision, aka “Why does Excel Give Me Seemingly Wrong Answers?”

Have a look at the section Structure of a Floating Point Number

0

精彩评论

暂无评论...
验证码 换一张
取 消