0
The precision of a number is determined by its last digit. The true value lies with a half of the place value of this last digit. In the above case it is the 6, which is in the thousandths place. So the true value lies within half-of-one-thousandths of the given number. That is, it lies in the interval [234.8955, 234.8965]. I use round-to-even, which is the default rounding mode used in IEEE 754 standard for computing functions and operators.
Still curious? Ask our experts.
Chat with our AI personalities
Devin
Vivi
Maxine
Add your answer:
Earn +20 pts
Which digit in the following number is the one that determines its precision 234.896?
In this case with 234.896 the last digit, '6' determines the precision since in is the last non-zero digit.
Which digit in the number 78.403 is the one that determines its precision?
3
Which digit in the following number is the one that determines its precision 614.3?
3
Which digit in the following number is the one that determines its precision 10.846?
If a number is given to the true degree of precision, this is always determined by its last digit - in this case, 6.
What digit in the following number is the one that determines its precision in 345.82?
Always the last number, so in this example the precision is to hundredths.
