Definition of double precision in English:

double precision

Line breaks: double pre|ci¦sion

noun

[mass noun] Computing
The use of twice the usual number of bits to represent a number, giving greater arithmetic accuracy: [as modifier]: run on a computer in double-precision arithmetic
More example sentences
  • My binary math is a little rusty, but that limit seems to correspond to 32-bit double precision real arithmetic.
  • When writing software, this can be achieved by using statistical software or a programming language offering double precision rather than a spreadsheet, and by obtaining error estimates using the methods reviewed in this paper.
  • The type is notorious because of its single precision overflow behavior, so most people end up using even when double precision is not required.

More definitions of double precision

Definition of double precision in:

Get more from Oxford Dictionaries

Subscribe to remove adverts and access premium resources

Word of the day grammarian
Pronunciation: grəˈmɛːrɪən
noun
a person who studies and writes about grammar