getSparkConf

Class: matlab.compiler.mlspark.SparkContext
Namespace: matlab.compiler.mlspark

Get SparkConf configuration parameters

Syntax

conf = getSparkConf(sc)


Description

conf = getSparkConf(sc) retrieves the SparkConf configuration parameters.

Input Arguments

sc — SparkContext to use

SparkContext object

The SparkContext to use, specified as a SparkContext object.

Output Arguments

conf — Spark configuration parameters

SparkConf object

Spark configuration parameters, returned as a SparkConf object with properties.

Examples

Get SparkConf Configuration Parameters

Retrieve the SparkConf configuration parameters.

%% Connect to Spark
sparkProp = containers.Map({'spark.executor.cores'}, {'1'});
conf = matlab.compiler.mlspark.SparkConf('AppName','myApp', ...
                        'Master','local[1]','SparkProperties',sparkProp);
sc = matlab.compiler.mlspark.SparkContext(conf);

%% getSparkConf
getSparkConf(sc) % Alternate Usage: >> sc.getSparkConf(); 

Version History

Introduced in R2016b