Skip to content
The Internals of Apache Spark
SparkListenerEvent
Initializing search
apache-spark-internals
Home
Kubernetes
Monitoring
Tools
RDD
Metrics
Demos
Exercises
Web UI
The Internals of Apache Spark
apache-spark-internals
Home
Home
Welcome
Overview
SparkEnv
SparkConf
SparkContext
SparkContext
SparkContext
Inside Creating SparkContext
HeartbeatReceiver RPC Endpoint
SparkStatusTracker
Local Properties
Configuration Properties
Spark Properties
Shuffle System
Shuffle System
Shuffle System
ShuffleManager
SortShuffleManager
Shuffle Handlers
Shuffle Handlers
ShuffleHandle
BaseShuffleHandle
BypassMergeSortShuffleHandle
SerializedShuffleHandle
Shuffle Readers
Shuffle Readers
ShuffleReader
BlockStoreShuffleReader
Shuffle Writers
Shuffle Writers
ShuffleWriter
BypassMergeSortShuffleWriter
SortShuffleWriter
UnsafeShuffleWriter
ShuffleExternalSorter
ShuffleInMemorySorter
ShuffleBlockResolver
IndexShuffleBlockResolver
FetchFailedException
Spillable Collections
Spillable Collections
Spillable
ExternalAppendOnlyMap
ExternalSorter
ShuffleWriteProcessor
Deploy Mode
RDD Checkpointing
Dynamic Allocation of Executors
Dynamic Allocation of Executors
Dynamic Allocation of Executors
ExecutorAllocationManager
ExecutorAllocationClient
ExecutorAllocationManagerSource
Speculative Execution of Tasks
CompressionCodec
Network
Network
TransportContext
MessageHandler
TransportRequestHandler
TransportConf
SparkTransportConf
TransportClientFactory
TransportServer
RpcHandler
StreamManager
OneForOneStreamManager
ManagedBuffer
RpcResponseCallback
Core
Core
BroadcastManager
BroadcastFactory
TorrentBroadcastFactory
TorrentBroadcast
ContextCleaner
CleanerListener
BlockFetchingListener
RetryingBlockFetcher
BlockFetchStarter
AppStatusListener
AppStatusStore
KVStore
ElementTrackingStore
InMemoryStore
LevelDB
Scheduler
Scheduler
Spark Scheduler
DAGScheduler
Stage
ResultStage
ShuffleMapStage
MapOutputTracker
MapOutputTrackerMaster
ShuffleStatus
MapOutputTrackerMasterEndpoint
MapOutputTrackerWorker
StageInfo
JobListener
JobWaiter
TaskScheduler
TaskSchedulerImpl
SchedulerBackend
CoarseGrainedSchedulerBackend
DriverEndpoint
Task
ShuffleMapTask
ResultTask
TaskSet
TaskSetManager
ActiveJob
SchedulableBuilder
FIFOSchedulableBuilder
FairSchedulableBuilder
Schedulable
Pool
SchedulingMode
TaskInfo
MapStatus
TaskDescription
TaskResultGetter
TaskContext
BarrierTaskContext
TaskContextImpl
TaskResult
TaskSetBlacklist
OutputCommitCoordinator
TaskLocation
ExternalClusterManager
LiveListenerBus
DAGSchedulerEvent
DAGSchedulerEventProcessLoop
DAGSchedulerSource
RPC
RPC
RPC System
RpcEnv
NettyRpcEnv
NettyStreamManager
RpcEnvConfig
RpcEndpoint
RpcEndpointRef
RpcAddress
RpcEndpointAddress
RpcEnvFactory
NettyRpcEnvFactory
RpcEnvFileServer
spark-rpc-netty
RpcUtils
Memory
Memory
Memory System
MemoryManager
StaticMemoryManager
UnifiedMemoryManager
MemoryPool
ExecutionMemoryPool
StorageMemoryPool
TaskMemoryManager
MemoryConsumer
BytesToBytesMap
UnsafeSorterSpillReader
UnsafeExternalSorter
UnsafeInMemorySorter
UnsafeSorterSpillWriter
Storage
Storage
BlockManager
BlockManagerId
BlockManagerInfo
BlockManagerMaster
BlockManagerMasterEndpoint
BlockManagerSlaveEndpoint
BlockId
BlockDataManager
DiskStore
DiskBlockManager
MemoryStore
BlockEvictionHandler
BlockData
BlockInfoManager
BlockInfo
DiskBlockObjectWriter
BlockManagerSource
ShuffleMetricsSource
ShuffleClient
BlockTransferService
NettyBlockTransferService
NettyBlockRpcServer
ExternalShuffleClient
OneForOneBlockFetcher
ShuffleBlockFetcherIterator
RDDInfo
StorageLevel
StorageStatus
Serialization
Serialization
Serialization System
SerializerManager
Serializer
SerializerInstance
SerializationStream
DeserializationStream
Deploy
Deploy
ExternalShuffleService
ExternalShuffleBlockHandler
ExternalShuffleBlockResolver
Executor
Executor
Executor
TaskRunner
ExecutorSource
ExecutorBackend
CoarseGrainedExecutorBackend
TaskMetrics
ShuffleWriteMetrics
ShuffleReadMetrics
Shared Variables
Shared Variables
Broadcast
accumulators
AccumulatorContext
Barrier Execution Mode
Barrier Execution Mode
barrier-execution-mode
RDDBarrier
Data Locality
Deployment Architecture
Deployment Architecture
Architecture
Driver
Master
Workers
Internal IO
Internal IO
SparkHadoopWriter
FileCommitProtocol
HadoopMapReduceCommitProtocol
HadoopMapRedCommitProtocol
HadoopWriteConfigUtil
HadoopMapReduceWriteConfigUtil
HadoopMapRedWriteConfigUtil
Misc
Misc
Deployment Environments
Building from Sources
AppStatusPlugin
KVStoreView
InterruptibleIterator
Utils
Spark Tips and Tricks
Spark Tips and Tricks
Spark Tips and Tricks
Access private members in Scala in Spark shell
Task not serializable Exception
Running Spark Applications on Windows
Spark Local
Spark Local
Spark Local
LocalSchedulerBackend
LocalEndpoint
LauncherBackend
Kubernetes
Kubernetes
KubernetesClusterManager
KubernetesClusterSchedulerBackend
KubernetesDriverEndpoint
ExecutorPodsLifecycleManager
ExecutorPodsSnapshotsStore
Configuration Properties
Monitoring
Monitoring
Logging
SparkListenerBus
SparkListenerEvent
SparkListener
ExecutorAllocationListener
SpillListener
StatsReportListener
AsyncEventQueue
spark-debugging
ConsoleProgressBar
Spark History Server
Spark History Server
Spark History Server
Configuration Properties
HistoryServer
EventLoggingListener
SQLHistoryListener
ApplicationHistoryProvider
FsHistoryProvider
HistoryServerArguments
ApplicationCacheOperations
ApplicationCache
ReplayListenerBus
JsonProtocol
Status REST API
Status REST API
Status REST API
ApiRootResource
ApplicationListResource
OneApplicationResource
StagesResource
OneApplicationAttemptResource
AbstractApplicationResource
BaseAppResource
ApiRequestContext
UIRoot
UIRootFromServletContext
Plugin Framework
Plugin Framework
Plugin Framework
PluginContainer
DriverPluginContainer
ExecutorPluginContainer
SparkPlugin
DriverPlugin
ExecutorPlugin
Tools
Tools
spark-shell
spark-submit
spark-class
SparkLauncher
Internals
Internals
SparkSubmitArguments
SparkSubmitOptionParser
SparkSubmitCommandBuilder
AbstractCommandBuilder
RDD
RDD
Resilient Distributed Dataset
RDD
RDDs
RDDs
CoGroupedRDD
HadoopRDD
MapPartitionsRDD
NewHadoopRDD
OrderedRDDFunctions
ParallelCollectionRDD
CheckpointRDD
ReliableCheckpointRDD
ShuffledRDD
SubtractedRDD
Operators
Operators
Operators
Transformations
PairRDDFunctions
AsyncRDDActions
Actions
Partitioner
RDD Lineage
Caching and Persistence
Partitions and Partitioning
Partition
RDDCheckpointData
LocalRDDCheckpointData
ReliableRDDCheckpointData
Shuffling
Dependencies
NarrowDependency
ShuffleDependency
Aggregator
Partitioners
Partitioners
HashPartitioner
RangePartitioner
Metrics
Metrics
Spark Metrics
Configuration Properties
MetricsSystem
MetricsConfig
Source
Sink
Sources
Sources
JvmSource
Sinks
Sinks
MetricsServlet
Demos
Demos
DiskBlockManager and Block Data
Exercises
Exercises
One-liners using PairRDDFunctions
Learning Jobs and Partitions Using take Action
Spark Standalone - Using ZooKeeper for High-Availability of Master
Spark's Hello World using Spark shell and Scala
WordCount using Spark shell
Your first complete Spark application (using Scala and sbt)
Using Spark SQL to update data in Hive using ORC files
Developing Custom SparkListener to monitor DAGScheduler in Scala
Developing Custom RDD
Working with Datasets from JDBC Data Sources (and PostgreSQL)
Causing Stage to Fail
Web UI
Web UI
Web UI
Configuration Properties
WebUI
WebUIPage
WebUITab
SparkUI
SparkUITab
Jobs Tab
Jobs Tab
Jobs
JobsTab
AllJobsPage
JobPage
Stages Tab
Stages Tab
Stages
StagesTab
AllStagesPage
StagePage
PoolPage
Storage Tab
Storage Tab
Storage
StorageTab
StoragePage
RDDPage
Environment Tab
Environment Tab
Environment
EnvironmentTab
EnvironmentPage
Executors
Executors
Executors
ExecutorsTab
ExecutorsPage
ExecutorThreadDumpPage
BlockStatusListener
EnvironmentListener
ExecutorsListener
JobProgressListener
StorageStatusListener
StorageListener
RDDOperationGraphListener
RDDStorageInfo
LiveEntity
LiveRDD
UIUtils
JettyUtils
SparkListenerEvent
¶
SparkListenerEvent
is...FIXME
Last update: 2020-10-11