

首页  思维导图  详情



Flink Checkpoint

2019-08-26 15:42:37   0  举报





AI智能生成

flink checkpoint 源码跟踪，非常有效的方便记忆

flink

源码

模版推荐

作者其他创作

大纲/内容

CheckpointCoordinator

CheckpointCoordinatorDeActivator

startCheckpointScheduler

ScheduledTrigger（source端的）

triggerCheckpoint

CheckpointStorageLocation

PendingCheckpoint

execution.triggerCheckpoint

RpcTaskManagerGateway

triggerCheckpoint

TaskExecutor.triggerCheckpoint

Task.triggerCheckpointBarrier

invokable.triggerCheckpoint

StreamTask.performCheckpoint -> executeCheckpointing ->AsyncCheckpointRunnable 上传到jobmaster

StreamTask

performCheckpoint ->checkpointState-> executeCheckpointing

AsyncCheckpointRunnable -> reportCompletedSnapshotStates上报到jm

state.backend.local-recovery（默认false） mem不支持，only covers keyed state backends

JobMaster

checkpointCoordinatorGateway.acknowledgeCheckpoint

CheckpointCoordinator

receiveAcknowledgeMessage

completePendingCheckpoint -> finalizeCheckpoint

notifyCheckpointComplete

CheckpointBarrierHandler

BarrierBuffer

getNextNonBlocked

processBarrier

notifyCheckpoint

StreamTask

triggerCheckpointOnBarrier

CheckpointCoordinator 完成checkpoint过程

receiveAcknowledgeMessage SUCCESS

completePendingCheckpoint

pendingCheckpoint.finalizeCheckpoint()

completedCheckpointStore.addCheckpoint(completedCheckpoint)

rememberRecentCheckpointId

dropSubsumedCheckpoints

 Collect

Get Started

Flink

 Collect

Get Started

Flink

 Collect

Get Started

Flink checkpoint

 Collect

Get Started

flink pipe





0 条评论

下一页