Deploy Tall Arrays to aSparkEnabledHadoopCluster
Supported Platform:Linux®only.
Deploying a MATLAB application that contains tall arrays against a Spark enabled Hadoop cluster consists of two parts :
Creating and packaging a standalone application in the MATLAB desktop environment.
Executing the standalone application on a Spark enabled Hadoop cluster from a Linux shell.
For a complete example on deploying tall arrays to a Spark enabled Hadoop cluster, seeExample on Deploying Tall Arrays to a Spark Enabled Hadoop Cluster. You can follow the same instructions to deploy tall array Spark applications to Cloudera®CDH.
Classes
matlab.mapreduce.DeploySparkMapReducer |
Configure aMATLABtall array application withSparkparameters as key-value pairs |
Functions
mapreducer |
Define execution environment for mapreduce or tall arrays |
Topics
Learn basic Apache Spark™ concepts and see how these concepts relate to deploying MATLAB applications to Spark.
Example on Deploying Tall Arrays to a Spark Enabled Hadoop Cluster
Complete example showing how to deploy a tall array MATLAB application to a Spark enabled Hadoop cluster.