zipWithUniqueId

Class: matlab.compiler.mlspark.RDD
Namespace: matlab.compiler.mlspark

Zip an RDD with generated unique Long IDs

Syntax

result = zipWithUniqueId(obj)


Description

result = zipWithUniqueId(obj) zips obj with generated unique Long IDs.

Input Arguments

obj — Input RDD

RDD object

An input RDD, specified as a RDD object.

Output Arguments

result — Output RDD

RDD object

An output pipelined RDD, returned as a RDD object.

Examples

Zip an RDD With Unique Long IDs

%% Connect to Spark
sparkProp = containers.Map({'spark.executor.cores'}, {'1'});
conf = matlab.compiler.mlspark.SparkConf('AppName','myApp', ...
                        'Master','local[1]','SparkProperties',sparkProp);
sc = matlab.compiler.mlspark.SparkContext(conf);

%% zipWithUniqueId
x = sc.parallelize({'a','b','c','d','e'},3);
out = x.zipWithUniqueId().collect(); % {{'a',0},{'b',1},{'c',4},{'d',2},{'e',5}}

Version History

Introduced in R2016b