DistShellAppMaster
2016-07-25 15:15:56 0 举报DistShellAppMaster是一个用于分布式计算的应用程序主节点。它负责协调和管理分布式计算任务，将任务分配给不同的工作节点，并收集和汇总各个节点的计算结果。DistShellAppMaster具有高度可扩展性和容错性，能够处理大规模的分布式计算任务。它还提供了丰富的接口和工具，方便用户进行任务配置、监控和调试。通过使用DistShellAppMaster，用户可以充分利用集群的计算资源，提高计算效率和性能。
作者其他创作
大纲/内容
JVM Process
cp local jar to FileServer
Daemon Actor
Registered
StartExecutorSystems
Remote address [every ActorSystem]
Daemon actor
JVM
wait to create REAL AppMaster[User Define]
MasterWithExecutorSystemProvider Actor
AppManager
向Master请求资源
LaunchExecutorSystem(workerId) -- actorOf
SubmitApplication
ResourceAgentActor
ExecutorSystemLauncherActor
create new ActorSystem
DistShellAppMaster
ShellExecutor
?????
......
UserDefined AppMaster Actor
RegisterActorSystem
MasterConnectionKeeper actor
3. send msgRegisterActorSystem
executorSystemLauncher
wait to crate REALAppMaster
2. StartAppMaster
msg
MasterProxy actor
launchExecutorOnEachWorker
initAppMasterRuntimeEnvironment
ResourceAgent
RequestResource
Deamon
send CreateActor cmd
new ActorSystem
multi request (workers)
DistributedShell的启动过程
LaunchExecutorSystemSuccess
preStart
2. wait for ActorSystemToStart
ExecutorSystemStarted
Request Resources(1)
AppMasterRuntimeEnvironmentactor
main classActorSystemBooterwaitCmd: CreateActor
LaunchExecutor(appId)
ExecutorSystemScheduler
1. send to Woker LaunchExecutor
ExecutorWatcher Actor
AppManger Actor
MainClass:ActorSystemBooter
AppMasterLauncher
all workers to loop
AppSubmitter
create
GetAllWorkersResourceRequest Array
Worker Actor
gear app -jar args
init
1. send LaunchExecutor msg to Worker
prestart
run Main classActorSystemBooter
ResourceAllocatedForSession
UserDefined AppMaster
ClientContextsubmit app
Worker
4. wait for commandCreateActor
ExecutorWatcher
LazyStartAppMaster actor
Master Proxy
ShellExecutor Actor
regiest appMaster to MasterProxy
ResourceAllocated
LaunchExecutorSystem
AppMasterLauncher init
Master Actor
ExecutorSystemLauncher
比Master多个对ExecutorSystem的处理
ExecutorSystemSchedulerActor
create JVM process
拿着进程的句柄，按需kill
executorSystemFactory
watch Master Liveness
1. MasterConnected
actorOf
one agent instance per session
Maser
create actorAppMasterLauncher
0 条评论
下一页
为你推荐
查看更多
抱歉，暂无相关内容