dtm_worker_detail

2016-09-03 14:27:01   0  举报





仅支持查看

dtm_worker_detail是一个用于记录和管理数据挖掘工作详细信息的系统。它提供了一种有效的方式来跟踪和监控数据挖掘项目的各个阶段，包括数据采集、预处理、模型训练、评估和部署等。通过使用dtm_worker_detail，数据科学家可以更好地组织和管理他们的工作流程，确保项目按时完成并达到预期的结果。此外，dtm_worker_detail还提供了一个可扩展的平台，使用户能够根据自己的需求定制功能和界面。总之，dtm_worker_detail是一个强大而实用的工具，可以帮助数据科学家更高效地完成他们的工作。

作者其他创作

大纲/内容

if out of order

keep OUT/HUP

if NOT AUTOCOMMIT

insert/push_backnode-vecto perserver query order within server

client cache_cmds

push_back send_buf

if COMMIT

send handshake

STATE_SEND_QUERY

send result

OUT

LOCAL_XA_STATE_PREPARING

clear()

LOCAL_XA_STATE_STARTED

epoll

STATE_READ_AUTH_RESULT

STATE_READ_QUERY

original query

read query

IN/HUP

server Ap_vec_self_buf

STATE_CONNECTED_CLIENT

if QUERYof MULTI QUERY

STATE_READ_HANDSHAKE

XA ENDXA PREPARE

if MULTI QUERY

clientp_vec_last_query_servers

client pvs

[load_consistent_view]GET cur_checkpointHGETALL innodb_gid:checkpoint_xidSETEX checkpoint_xid:cur_xid 5 load[del_occupy_list]DEL checkpoint_xid:cur_xid

listen sock

if all prepared

set OUT/HUP

set IN/HUP

LOCAL_XA_STATE_STARTING

send QUERY

check user/pwd

client sock

client pvi

server A sock

send XA START

STATE_SEND_HANDSHAKE

read auth resultdirectly

clientp_map_multi_query

read query result

STATE_CONNECTED_SERVER

GLOBAL_XA_STATE_START

BEFORE LAST QUERY

OUT/HUP

client tranx state

1.SET NAMES2.USE DB

add READVIEW for SELECT

insert/push_backserver(redundant)to perserver query order across server

FOLLOWING SERVERS

1.SET NAMES2.USE DB3. XA START

handle DDL(todo)

STATE_SEND_AUTH_RESULT

GLOBAL_XA_STATE_COMMIT

[save_global_status]LSET xid_status:cur_xid 3 modify_time 4 affected_sids(curr servers) 0 global status

SQL_XA_START_NUM

server A tranx state

if XA START

STATE_READ_QUERY_RESULT

central redis

read auth

incrclient-query result cntserver-recv query num

getview_map[server]

if all local started

if START TRANSACTION

cache set charset

send auth result

set b_c_xid/view_map[this server's sid] from pvi

setview_map[this server's sid] from pvi

LOCAL_XA_STATE_COMMITTED

server A query

p_vec_last_query_servers[client-query result cnt]perserve query order

STATE_SEND_AUTH

if AUTOCOMMIT

if not all prepared

FIRST SERVER

LOCAL_XA_STATE_PREPARED

nothing

send auth

read handshake

worker redis

STATE_READ_AUTH

GLOBAL_XA_STATE_PREPARE

LAST QUERY

[save_global_status]RPUSH xid_status:cur_xid 0(start) 0 b_c_xid modify_time affected_sids(first server)INCR ref_count:b_c_xidSADD ref_count_set:b_c_xid cur_xid

append all server's vec_self_buf to client-send_bufand then free()

load view_mapbase_checkpoint_xid from central redis

client query

lock redis

set 0

cache use db