User triger a BTI job
bti-ingestion-service
spark on yarn
bti-lifecycle-backend
git repogit-ingestion-configuration
bti-sync.py
doing actual job
scheduler pull
partition
NiFi processor
convert
scheduler
livy launcher
HDFSjob-confspark-conf
End
heartbeat
livy
Meta DBbti_job_tab
Start
fetch
create table
LoadConfig