Skip to content
Snippets Groups Projects
Commit 3abc1757 authored by ranchodeluxe's avatar ranchodeluxe
Browse files

so difficult

parent a4978aa1
No related branches found
No related tags found
1 merge request!61Additions: primary keys, speed ups (preprocessing and postprocessing), tests, scalene, reorg entire fireatlas
......@@ -17,9 +17,10 @@ def Run():
:return: None
"""
data_update_results = FireRunDaskCoordinator.job_data_update_checker()
data_update_results.compute()
data_upload_results = [
FireRunDaskCoordinator.concurrent_copy_inputs_from_local_to_s3([data_update_results,], local_filepath)
FireRunDaskCoordinator.concurrent_copy_inputs_from_local_to_s3([None,], local_filepath)
for local_filepath in glob.glob(f"{settings.LOCAL_PATH}/{settings.PREPROCESSED_DIR}/*/*.txt")
]
dag = delayed(lambda x: x)(data_upload_results)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment