Precision/Rounding in Matlab
Show older comments
Perhaps I should read over the famous article, "What Every Computer Scientist Should Know About Floating-Point Arithmetic."
I'm trying to do a simple comparison of two numbers:
>> isequal(52.8/10, 5.28)
ans =
0
>> isequal(5.28,5.28)
ans =
1
Obviously, this is the "wrong" answer. 52.8/10 should be equal to 5.28. It's not.
How do you handle cases like this in matlab? How are you CERTAIN that you are checking for equality correctly?
Thanks.
Answers (1)
the cyclist
on 4 Aug 2011
0 votes
I suggest you look at the Accepted answer to this question, and follow the link in it. http://www.mathworks.com/matlabcentral/answers/69-why-does-1-2-3-1-3-not-equal-zero
2 Comments
Russell
on 4 Aug 2011
the cyclist
on 4 Aug 2011
Glad to hear it. You might want to "Accept" the answer, to help future users.
Categories
Find more on Logical in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!