Q: What is a precision number?

Write your answer...

Submit

Still have questions?

Continue Learning about Math & Arithmetic

In mathematics, the word precision is used to describe the total number of digits (the number of significant figures) used in a number to approximate another number. For example, given a number 145.37823 the number 145 approximates the previous number with a precision of 3, and 145.3782 approximates it with a precision of 7. In other words, in maths, at least arithmetically speaking, precision is just another word for significant figures. In statistics, precision is usually a measurement of how well a measurement system gives consistent results, and is the reciprocal of variance.

Always the last number, so in this example the precision is to hundredths.

7

15 is an exact number. It is a precise number.

If a number is given to the true degree of precision, this is always determined by its last digit - in this case, 6.

Related questions

The number of digits in a number is known as precision of a number. Depending on the precision required, the number is quantized to give the final number.

It has no precision, since there is no following number.

In mathematics, the word precision is used to describe the total number of digits (the number of significant figures) used in a number to approximate another number. For example, given a number 145.37823 the number 145 approximates the previous number with a precision of 3, and 145.3782 approximates it with a precision of 7. In other words, in maths, at least arithmetically speaking, precision is just another word for significant figures. In statistics, precision is usually a measurement of how well a measurement system gives consistent results, and is the reciprocal of variance.

Always the last number, so in this example the precision is to hundredths.

The precision is determined by the POSITION of the number 6 - NOT its value.

7

Code for precision tv using RCA universal remote

The phone number of the American Precision Museum Assocation is: 802-674-5781.

15 is an exact number. It is a precise number.

If a number is given to the true degree of precision, this is always determined by its last digit - in this case, 6.

3

For the most part, how many bits in a floating point number. More bits = greater precision.