Community Profile

photo

Rick Amos

MathWorks

Last seen: 1日 前 |  2012 年からアクティブ

Followers: 0   Following: 0

連絡

Developer at MathWorks, working on Parallel Computing Toolbox.

統計

All
  • Knowledgeable Level 2
  • First Answer
  • Solver

バッジを表示

Feeds

表示方法

回答済み
Reading portions of several CSV files
You might want to take a look at tabularTextDatastore and/or tall arrays. These are geared up to do exactly this kind of thing:-...

4年以上 前 | 5

回答済み
tallArray sorting and plot error
Instead of converting State to a character vector, I would recommend using one of the string utilities. These are all supported ...

5年弱 前 | 0

回答済み
Pass fileDatastore explicit AWS credentials
It is currently not possible to pass explicit credentials directly into fileDatastore. Datastore retrieves the credentials in th...

5年弱 前 | 0

回答済み
Too many .mat files when using Write Tall Table
As you've likely guessed, vertical concatenation of 1600 arrays results in at least 1600 files from tall/write. This is the case...

約5年 前 | 0

| 採用済み

回答済み
Generate a Datastore for binary data?
As of R2017b, MATLAB now allows you to write custom datastores. This will allow you to create datastores that handle large binar...

6年以上 前 | 2

回答済み
How to check Hadoop and Matlab Integrated Properly or Not ???
To look at whether MATLAB is running on the Hadoop cluster correctly, your best bet is to look at the Hadoop/Yarn Web UI. By def...

7年弱 前 | 0

| 採用済み

回答済み
How to create tall datastore from multiple data parts?
A datastore can be created from a collection of folders and so the easiest way to achieve this is to place each block of data in...

7年以上 前 | 0

回答済み
Datastore for custom files
For files on Hadoop, the File Datastore makes a temporary copy of the file on the local drive to be read by the ReadFcn. The Rea...

約8年 前 | 0

| 採用済み

回答済み
How to solve ' All the input files must be Sequence files. Invalid file: '' '
This error message occurred because MATLAB could not find the output files generated by the Hadoop Job. For now, this error mess...

8年以上 前 | 1

| 採用済み

回答済み
How to solve" The user home directory '/homes/' for the cluster either did not exist or was not writable by the HADOOP user."
The '/homes/' folder is related to the Hadoop property 'mapreduce.admin.user.home.dir'. This is used by Hadoop to set the HOME e...

9年弱 前 | 1

| 採用済み

回答済み
How to make a MAT-file that can be used to create a Datastore for MapReduce?
In R2014b there is currently not a direct way of creating a MAT file datastore. However, there are several indirect ways that wi...

9年以上 前 | 2

| 採用済み

回答済み
Mapreduce does not seem to use all available cores
In R2014b, there are some limitations with the minimum size of data that can be parallelized. To avoid this limitation, the inpu...

9年以上 前 | 0

| 採用済み

回答済み
MCR problems with linux/hadoop
This behavior arises because Hadoop defines the 'HOME' environment variable of task processes to be '/homes' by default. MATLAB ...

9年以上 前 | 0