DLS DAGs

This repository contains all DAGs that are (or can be) used in the DLS.

To develop your own DAG, please see the airflow documentation and/ or look at the example DAGs in this repository.

The DLS deployments for the eflows4HPC project pull updates from this repository in regular intervals (WIP at the moment), which means newly created or modified DAGs are deployed automatically (although with some delay).

Developement

Run tests with

python -m unittest discover tests

Name		Name	Last commit message	Last commit date
Latest commit History 189 Commits
.github/workflows		.github/workflows
integration		integration
test_tags_delete_or_archive_later		test_tags_delete_or_archive_later
tests		tests
.airflowignore		.airflowignore
.gitignore		.gitignore
GAdemo.py		GAdemo.py
LICENSE		LICENSE
README.md		README.md
b2shareoperator.py		b2shareoperator.py
configver.py		configver.py
conn_deco.py		conn_deco.py
constraints-3.9.txt		constraints-3.9.txt
decors.py		decors.py
docker_cmd.py		docker_cmd.py
docker_in_worker.py		docker_in_worker.py
gitlab2ssh.py		gitlab2ssh.py
image_transfer.py		image_transfer.py
mlflow_stagein.py		mlflow_stagein.py
model_meta_transfer.py		model_meta_transfer.py
model_search_upload.py		model_search_upload.py
model_transfer.py		model_transfer.py
plainhttp.py		plainhttp.py
requirements.txt		requirements.txt
ssh2ssh.py		ssh2ssh.py
taskflow datacat_integration.py		taskflow datacat_integration.py
taskflow.py		taskflow.py
taskflow_stream.py		taskflow_stream.py
testdag.py		testdag.py
uploadflow.py		uploadflow.py
utils.py		utils.py
webdav2unicore.py		webdav2unicore.py
webdav_stagein.py		webdav_stagein.py
webdav_stageout.py		webdav_stageout.py

License

eflows4hpc/dls-dags

Folders and files

Latest commit

History

Repository files navigation

DLS DAGs

Developement

About

Resources

License

Stars

Watchers

Forks

Languages