pyspark.pandas Package¶
When imported (that triggers __init__.py), pyspark.pandas does monkey-patching of pandas.DataFrame and pandas.Series classes (using __class_getitem__ dunder method).
| Pandas | PySpark |
|---|---|
| pandas.DataFrame | pyspark.pandas.frame.DataFrame |
| pandas.Series | pyspark.pandas.series.Series |