Import Large Data Programmatically
You can use aDatabaseDatastore
object to import large data into the MATLAB workspace. To create this object, use thedatabaseDatastore
function. After importing your data into the MATLAB workspace, you can use tall arrays to analyze it. Also, the MapReduce programming technique provides you with greater flexibility in analyzing large data.
To split an SQL query into multiple SQL page queries and import large data in chunks, use thesplitsqlquery
function. You can access large data by using Database Toolbox™ functions or a parallel pool (requires Parallel Computing Toolbox™).
Functions
Topics
- Working with Large Data Sets
Import and export large data sets that are stored in a database.
- Import Large Data Using DatabaseDatastore Object
创建一个
DatabaseDatastore
object for accessing collections of data stored in a relational database. - Analyze Large Data in Database Using Tall Arrays
Find the minimum value in a large data set by using a tall table.
- Analyze Large Data in Database Using MapReduce
Write mapper and reducer functions for analyzing large data using a
DatabaseDatastore
object.