pyspark.RDD.getResourceProfile¶

RDD.getResourceProfile()[source]¶

Get the pyspark.resource.ResourceProfile specified with this RDD or None if it wasn’t specified.

New in version 3.1.0.

Returns

pyspark.resource.ResourceProfile: The the user specified profile or None if none were specified

Notes

This API is experimental

pyspark.RDD.getNumPartitions

pyspark.RDD.getStorageLevel