Error in adding keys and values. Value max size exceeded for database

Running into error because of "lasso" function and the interplay to Tall Arrays/Datastore.

Here is my code. Pretty straight forward. Pretty close to the instructions. Writing created files to datastore before into folder "test". (Creating a lot of features).

ds = datastore('C:\Users\blabla\Desktop\test',"IncludeSubfolders",true)
X_tall = tall(ds);
lambda = [0.5 0.75 1];
[B,FitInfo]=lasso(X_tall(:,2:end),X_tall(:,1),'Lambda',lambda,'Standardize',true);

I tried already:

• Matlab versions (2019b and 2021b)
• change tempdir, and datastore-path to another location with more free space
• change installation of matlab to location with more free space

Exact error:

Error using tall/gather (line 50)

Unable to access intermediate data in the temporary folder, most likely because it ran out of space. Clear space on the local

drive, or avoid operations that reorder tall arrays (such as SORT or indexing with a tall numeric column vector).

Learn more about errors encountered during GATHER.

Error in tall/lasso (line 73)

[xtx, xty, yty, n, p, muX, muY, sigX] = gather(xtx,xty,yty, n, p, muX, muY, sigX);

Error in lasso_20211103 (line 128)

[B,FitInfo]=lasso(X_tall(:,2:end),X_tall(:,1),'Lambda',lambda,'Standardize',true);

Caused by:

Error in adding keys and values.

Value max size exceeded for database

C:\Users\blabla\AppData\Local\Temp\tp066aa292_7229_45f4_8cc9_a736b269cadb\ExecutionTask_tp3c5c16cd_c3a2_4347_b8d3_9500514faccb_720.db.

(string or blob too big)

Answer 1

[Zakarya Motea]

Close all sessions of matlab and run it again. This should fix the problem.