How to improve double precision?
古いコメントを表示
I have made below code
a=11;
b=256;
c=a/b
and the output said c=0, which was not I had expected
So I have used cast operator
a=11;
b=256;
c=double(a/b)
and the result returns the same value; 0
I have searched Matlab document and found that the default precision of double data type is 32
so It should return 0.04296875 instead of 0. But still get 0 for this kind of codes
How to fix it properly?
採用された回答
その他の回答 (0 件)
カテゴリ
ヘルプ センター および File Exchange で Data Type Conversion についてさらに検索
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!