double-precision
double precision integer subtraction with 32-bit registers(MIPS)
I am learning computer arithmetic. The book I use(Patterson and Hennessey) lists the below question. Write mips code to conduct double[详细]
2023-01-20 06:03 分类:问答Does JavaScript have double floating point number precision?
I know it\'s an odd question, but does JavaScri开发者_高级运维pt have the capacity to work with double\'s as opposed to single floats?(64 bit floats vs. 32 bits.)All numbers in JavaScript are 64-bit f[详细]
2023-01-14 08:38 分类:问答Does Fortran have inherent limitations on numerical accuracy compared to other languages?
While working on a simple programming exercise, I produced a while loop (DO loop in Fortran) that was meant to exit when a real variable had reached a precise value.[详细]
2023-01-09 00:40 分类:问答TimeSpan and double rounding errors
I\'m dealing with physical entities, such as time, speed and distance, and performing simple math, such as distance = time * speed, etc. Speed and Distance are double values rounded to 8th digit, and[详细]
2023-01-08 18:00 分类:问答How to set double precision in C++ on MacOSX?
I\'m trying to port _controlfp( _CW_DEF开发者_运维知识库AULT, 0xffffffff ); from WIN32 to Mac OS X / Intel. I have absolutely no idea how to port this instruction... And you? Thanks!Try section 8.6 of[详细]
2022-12-31 17:20 分类:问答Floating point arithmetic is too reliable
I understand that floating point arithmetic as performed in modern computer systems is not always consistent with real arithmetic.I am trying to contrive a small C# program to demonstrate this. eg:[详细]
2022-12-26 19:17 分类:问答The trade-off that comes with using BigDecimal instead of double in Java
I\'m writing code for a neural network, and I\'m wondering whether I should do it or not. I\'m actually somewhat worried that even using double might not wield good results and that I might have to mi[详细]
2022-12-15 04:03 分类:问答