moni_general
batch_insert_size:500
spark application
redis
拉取需要级联的维度列表/5min
mongodb
校验对应的维度级联关系是否在redis中已经存在,有则不做重复插入,无则插入到mongodb,同时也将md5Code插入到redis
tips:md5Code生成规则是按照dimensions的固定顺序,用&符号拼接md5得到。md5(releationId&ruleId&dimensionVaule1&dimensionValue2*dimensionValue3)