pyspark.sql.functions.regr_r2#

pyspark.sql.functions.regr_r2(y, x)[source]#

Aggregate function: returns the coefficient of determination for non-null pairs in a group, where y is the dependent variable and x is the independent variable.

New in version 3.5.0.

Parameters

yColumn or str: the dependent variable.
xColumn or str: the independent variable.

Returns

Column: the coefficient of determination for non-null pairs in a group.

Examples

>>> from pyspark.sql import functions as sf
>>> x = (sf.col("id") % 3).alias("x")
>>> y = (sf.randn(42) + x * 10).alias("y")
>>> spark.range(0, 1000, 1, 1).select(x, y).select(
...     sf.regr_r2("y", "x")
... ).show()
+------------------+
|     regr_r2(y, x)|
+------------------+
|0.9851908293645...|
+------------------+