Skip to content

Plugin Framework

Plugin Framework is an API for registering custom extensions (plugins) to be executed on the driver and executors.

Plugin Framework uses the following main abstractions:

Plugin Framework was introduced in Spark 2.4.4 (that only offered an API for executors) with further changes in Spark 3.0.0 (to cover the driver).

Resources


Last update: 2020-10-09