How to find differences between 2 large tables that have a mix of string and numbers?

5 ビュー (過去 30 日間)
Hello! I have 2 very large tables that have the same number of rows and columns (20441x30), and I would like to know exactly which cells are different. I have tried 'Compare' in the Home tab, but it only tells me in the difference summary 'added', not which values/variables were added). I have also tried setdiff and ismember (error below), but it has a problem with one of my variables (maybe because it has NaNs too in the table).
Error using cell/union>cellunionR2012a (line 242)
Input A of class double and input B of class cell must be cell arrays of character vectors, unless one is a character
vector.
Do you know how I can compare tables that have a mix of string and numbers?
Thank you!
  1 件のコメント
Dyuman Joshi
Dyuman Joshi 2023 年 7 月 17 日
"(maybe because it has NaNs too in the table)"
FYI - MATLAB treats NaNs (as well as NaTs, <undefined> and <missing>) values as not equal to each other, nor equal to themselves as well.
If you want to compare NaNs (and others) and output true, use isequaln

サインインしてコメントする。

採用された回答

Image Analyst
Image Analyst 2023 年 7 月 17 日
Have you tried iterating over every element of both tables using isequal to determine whether the locations are the same? Something like (untested)
[rows, columns] = size(table1);
matches = false(rows, columns); % Initialize to no matches (no equality).
for col = 1 : columns
for row = 1 : rows
% See if this location is equal.
% Set equality map to true if they're equal.
if isequal(table1{row, col}, table2{row, col})
matches(row, col) = true;
end
end
end
Alternatively you can compare the numeric columns using table2array and subtracting.
If you have any more questions, then attach your data and code to read it in with the paperclip icon after you read this:

その他の回答 (1 件)

Peter Perkins
Peter Perkins 2023 年 7 月 17 日
編集済み: Peter Perkins 2023 年 7 月 17 日
I thnk looping over every row in the tables will not be very performant. I would think this will do better:
matches = false(size(table1));
for var = 1 : width(table1)
matches(:,var) = (table1.(var)==table2.(var)) ...
|| (ismissing(table1.(var)) && ismissing(table2.(var)))
end
That assumes the variables support ismissing; you might need a try/catch in general.
  3 件のコメント
Tanika Bawa
Tanika Bawa 2023 年 7 月 18 日
thank you! =D
Peter Perkins
Peter Perkins 2023 年 7 月 18 日
Yes, Voss is correct, & and |, not && and ||.

サインインしてコメントする。

カテゴリ

Help Center および File ExchangeMatrices and Arrays についてさらに検索

製品


リリース

R2020b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by