Skip to content

Environment Variables

PySpark uses environment variables to configure execution environment.

PYSPARK_GATEWAY_PORT

PYSPARK_GATEWAY_SECRET

PYSPARK_PIN_THREAD

Enables pinned thread mode to synchronize PVM threads with JVM threads based on Py4J's ClientServer (true) or GatewayServer (false)

Default: false

Used when:


Last update: 2021-03-05