Job Submit Design
2022-08-29 13:52:32 8 举报登录查看完整内容
SeaTunnel Engine 作业提交流程图
作者其他创作
大纲/内容
request resource
ResourceManager
run
Plugin Dir
SeaTunnel Server
getPluginJarPaths
TaskGroup
+ tasks:List<Task>+ pluginJarsUrls:List<URL>
return a JobProxy
New a JobMaster to run this job
Hive Connector
URLClassLoader
load plugin into classloader and then deserialize Task with the Custom Class Loader
PhysicalDag
LogicalDag
load plugin instance
submit task to ExecutionService
scan files
File Connector
SeaTunnelPluginDiscovery
submit JobImmutableInformation to SeaTunnel Server
ExecutionService
SeaTunnel Client
ExecutionDag
Task
JobMaster
JobImmutableInformation
+ pluginJarsUrls:List<URL>+ logicalDag: LogicalDag
load plugin into classloader and then deserialize JobImmutableInformation with the Custom Class Loader
Scheduler
收藏
收藏
0 条评论
回复 删除
下一页
