Flink Checkpoint
2019-08-26 15:42:37 0 举报
AI智能生成
登录查看完整内容
flink checkpoint 源码跟踪,非常有效的方便记忆
作者其他创作
大纲/内容
Flink Checkpoint
CheckpointCoordinator
CheckpointCoordinatorDeActivator
startCheckpointScheduler
ScheduledTrigger(source端的)
triggerCheckpoint
CheckpointStorageLocation
PendingCheckpoint
execution.triggerCheckpoint
RpcTaskManagerGateway
TaskExecutor.triggerCheckpoint
Task.triggerCheckpointBarrier
invokable.triggerCheckpoint
StreamTask.performCheckpoint -> executeCheckpointing ->AsyncCheckpointRunnable 上传到jobmaster
StreamTask
performCheckpoint ->checkpointState-> executeCheckpointing
AsyncCheckpointRunnable -> reportCompletedSnapshotStates上报到jm
state.backend.local-recovery(默认false) mem不支持,only covers keyed state backends
JobMaster
checkpointCoordinatorGateway.acknowledgeCheckpoint
receiveAcknowledgeMessage
completePendingCheckpoint -> finalizeCheckpoint
notifyCheckpointComplete
CheckpointBarrierHandler
BarrierBuffer
getNextNonBlocked
processBarrier
notifyCheckpoint
triggerCheckpointOnBarrier
CheckpointCoordinator 完成checkpoint过程
receiveAcknowledgeMessage SUCCESS
completePendingCheckpoint
pendingCheckpoint.finalizeCheckpoint()
completedCheckpointStore.addCheckpoint(completedCheckpoint)
rememberRecentCheckpointId
dropSubsumedCheckpoints
0 条评论
回复 删除
下一页