DataOpsArch
2022-05-23 13:24:39 0 举报DataOps 相关设计
作者其他创作
大纲/内容
Artifacts
Code on remote GIT
Git Runner
QA CI
人工发布
开发环境数据湖
No-Impact Test
DEV
Integration TestE2E TestManually Tests
Unit Tests
Code 1
PERFORMANCE-ENV
Commit & Push
测试数据库
feature Brach
main
Runtime
dev Brach
- Unit Tests Pass- Coverage Rate Satisfied- QA Report
UAT
Fast CI
- Change Trigger
PROD
+ Feedback Loop
main Brach
Quality Checkpoints
CI: - Build- Zip
Code 2
Code n
数据湖
SynapseDW
LOCAL
临时存储
数据脱敏
Pull Request
Purview
CI CD Flow Pattern
CICD
控制流
ADF 数据流水线
Deployment on Environments
Trigger
SIT
CI（QA）
Unit TestsManually Tests
- Time-scheduled
Deploy on branches
数据流
- Artifacts
- Build Pass- BVT Pass- Code Scan Pass- Reviewer Pass
测试环境数据湖
dev
元数据流
- PR Trigger
配置数据库
Databricks
Data Platform Arch
PR CI
PurviewManaged Identity
Data Quality
PRD-SynapseDW
CD: - Publish- Unzip
CI Agent
feature
配置数据、测试数据in GIT
ADF Managed Identity
Optional
ADF 跨环境数据流水线
CI Types
Code on local GIT
BI Reports & Analysis
Pull request
Output
Performance Test & Load Test
企业数据
收藏
0 条评论
下一页
为你推荐
查看更多
抱歉，暂无相关内容