pyspark.sql.Column.isNotNull¶
-
Column.isNotNull() → pyspark.sql.column.Column¶ True if the current expression is NOT null.
Changed in version 3.4.0: Supports Spark Connect.
Examples
>>> from pyspark.sql import Row >>> df = spark.createDataFrame([Row(name='Tom', height=80), Row(name='Alice', height=None)]) >>> df.filter(df.height.isNotNull()).collect() [Row(name='Tom', height=80)]