shell.py¶

shell.py script is the interactive shell of PySpark.

shell.py defines the following variables:

• sc being pyspark.SparkContext
• spark being pyspark.sql.session.SparkSession
• sql being SparkSession.sql
• sqlContext and sqlCtx for compatibility