Mlib
DStreams
Batch viewsindex
Query
Spark
Data@tim2
Data@tim4
Input Data
Data@tim3
map
reduce
Shark
Data@tim1
Spark Streaming(Speed Layer)
-------------
RDD
Output Data
map()flatMap()join()unjoin()
---------
(Serving Layer)
Olddata
Haddop+Spark(Batch layer)
DStram Operation
GraphX
HDFS