gdi 相关
2021-11-23 15:25:03 8 举报odi
作者其他创作
大纲/内容
repo meta
user
id stringname stringuser_id stringthirdparty_type stringthirdparty_id string
pythonSDK
webUI
.....
2.download_loading_scrpit(url = 'https://s3.amazonaws.com/.../datasets/glue/glue.py')
repo
glue.zip -> glue.json
dataset_version_info/commit
id stringdataset_id stringversion_name stringversion_desc stringobject_count intdata_size intdata_url string
new pr
dl.fbaipublicfiles.com
jpg
org
id stringname stringorg_id string
caspian
1. head_hf_s3(name = glue.py)
dataset
id stringcreated_at timeupdated_at timename stringhomepage stringowner_name stringcreator_user_id stringcreator_org_id stringreadme text
.py
MetaStore(MySQL)
MetaStore(S3)
DataStore(S3)
4.split_generator()
search
tag
id stringname string
load_dataset
org_user_relation
id stringuser_id stringorg_id string
caspian write server
graviti's user
3.download_and_extract(url = 'dl.fbaipublicfiles.com/glue.zip')
github.com/graviti/datasets
dataset_social_data
id stringdataset_id stringview_count intlike_count intdownload_count int
huggingface's s3
glue.py {url:dl.fbaipublicfiles.com/glue.zip}
glue.json glue.arrow
caspian read server
write
graviti.user
dataset_tags
id stringdataset_id stringtag_id string
read
github data & repo raw data
web & sync server
CLI
github.user
0 条评论
下一页
