conversion of double to int
10 ビュー (過去 30 日間)
古いコメントを表示
i had an array of 1*10 double named Q(i). I want to find modulo function of these 10 values with 256. But am getting wrong answers. May be its the problem of types. Will you please help me to solve?
5 件のコメント
Walter Roberson
2017 年 7 月 21 日
Give the command
format long g
And then display the Q value again
採用された回答
Walter Roberson
2017 年 7 月 21 日
2^53 = 9007199254740992 is the largest integer expressed in double precision that you can reliably take mod() 10 of. After that, the difference between adjacent representable double precision numbers becomes more than 1.
You can extend the range by using uint64(), allowing you to get to 18446744073709551615 . Beyond that you would need to use the Symbolic Toolbox, or use one of the extended precision File Exchange contributions.
2 件のコメント
Jan
2017 年 7 月 21 日
@SNEHA P S: Then compare the two values:
Q(7) - 4.078e+09
Note that the short format for the command window does not let you distinguish 4078000000 and 4078000001 or 4077999999.
その他の回答 (0 件)
参考
カテゴリ
Help Center および File Exchange で Numeric Types についてさらに検索
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!