フィルターのクリア

Modulo of realmax in matlab

1 回表示 (過去 30 日間)
Mayank Bajpai
Mayank Bajpai 2020 年 10 月 31 日
コメント済み: Ameer Hamza 2020 年 10 月 31 日
I am getting the same results for the following:
mod(realmax,10^9 + 7) and mod(realmax-10000,10^9 + 7) or subtracting any other number from realmax.
What is the reason for this and how to resolve it?

採用された回答

Ameer Hamza
Ameer Hamza 2020 年 10 月 31 日
MATLAB double datatype is based on IEEE-754 format: https://en.wikipedia.org/wiki/Double-precision_floating-point_format. This is a finite precision datatype, and you cannot represent all possible integer values accurately in this format.
flintmax
gives the maximum consecutive integer values, which can be accurately represented in this format. Above that, only a few integer values are precisely represented. In your case, realmax-10000 will just round off to realmax since double() data type does not have the precision to represent it.
  2 件のコメント
Mayank Bajpai
Mayank Bajpai 2020 年 10 月 31 日
Thanks. Got it :O
Ameer Hamza
Ameer Hamza 2020 年 10 月 31 日
I am glad to be of help!

サインインしてコメントする。

その他の回答 (0 件)

カテゴリ

Help Center および File ExchangeLogical についてさらに検索

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by