pyspark.sql.DataFrame.drop_duplicates

DataFrame.drop_duplicates(subset=None)

drop_duplicates() is an alias for dropDuplicates().

New in version 1.4.

pyspark.sql.DataFrame.dropDuplicates pyspark.sql.DataFrame.dropna