error (rounding or user) in simple math op
조회 수: 5 (최근 30일)
이전 댓글 표시
I just noticed odd behavior in R2012b that really seems like an error though perhaps I'm making a foolish error?
I enter the following >> 2.7+1.8*[1,2,3,4,5,6,7,8,9]
I expect 4.5 6.3 8.1 9.9 11.7 13.5 15.3 17.1 18.9
I get: ans =
Columns 1 through 5
4.500000000000000 6.300000000000001 8.100000000000001 9.900000000000000 11.699999999999999
Columns 6 through 9
13.500000000000000 15.300000000000001 17.100000000000001 18.899999999999999
This seems odd to me for obvious reasons. Even something simple like
>> 1.8*9
ans =
16.199999999999999
how could this be happening?
Thank you
(p.s. its 8.0.0.783 R2012b)
댓글 수: 0
채택된 답변
Azzi Abdelmalek
2013년 1월 8일
편집: Azzi Abdelmalek
2013년 1월 8일
Use
format short
The problem is simply caused by the way, real data are stored in memory
댓글 수: 0
추가 답변 (1개)
José-Luis
2013년 1월 8일
It is due to numerical precision, and is expected behavior.
참고 항목
카테고리
Help Center 및 File Exchange에서 Logical에 대해 자세히 알아보기
제품
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!