Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
F
fireatlas_nrt
Manage
Activity
Members
Labels
Plan
Issues
14
Issue boards
Milestones
Wiki
Code
Merge requests
2
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
gcorradini
fireatlas_nrt
Commits
5c2f071b
Commit
5c2f071b
authored
1 year ago
by
ranchodeluxe
Browse files
Options
Downloads
Plain Diff
Merge branch 'primarykeyv2' into preprocess-db
parents
50925b3d
a8072c21
Branches
preprocess-db
Branches containing commit
No related tags found
Tags containing commit
3 merge requests
!70
Make it easier to use filepaths as inputs to pipelines
,
!67
Back all `AllFires` and `Fire` objects with 2 dataframes
,
!61
Additions: primary keys, speed ups (preprocessing and postprocessing), tests, scalene, reorg entire fireatlas
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
FireConsts.py
+1
-1
1 addition, 1 deletion
FireConsts.py
FireGpkg_sfs.py
+3
-3
3 additions, 3 deletions
FireGpkg_sfs.py
with
4 additions
and
4 deletions
FireConsts.py
+
1
−
1
View file @
5c2f071b
...
@@ -153,7 +153,7 @@ remove_static_sources_bool = True # remove areas with known flaring/gas sources
...
@@ -153,7 +153,7 @@ remove_static_sources_bool = True # remove areas with known flaring/gas sources
remove_static_sources_sourcefile
=
"
VIIRS_Global_flaring_d.7_slope_0.029353_2017_web_v1.csv
"
remove_static_sources_sourcefile
=
"
VIIRS_Global_flaring_d.7_slope_0.029353_2017_web_v1.csv
"
remove_static_sources_buffer
=
0.01
# Buffer around static source points. Units defined by epsg.
remove_static_sources_buffer
=
0.01
# Buffer around static source points. Units defined by epsg.
opt_rmstatfire
=
Tru
e
# do the removal of small fires with high pixel density
opt_rmstatfire
=
Fals
e
# do the removal of small fires with high pixel density
number_of_multi_proc_workers
=
3
number_of_multi_proc_workers
=
3
...
...
This diff is collapsed.
Click to expand it.
FireGpkg_sfs.py
+
3
−
3
View file @
5c2f071b
...
@@ -276,7 +276,7 @@ def make_sf_nfplist(allfires, t, regnm, fids):
...
@@ -276,7 +276,7 @@ def make_sf_nfplist(allfires, t, regnm, fids):
sfkeys
=
list
(
dd
.
keys
())
sfkeys
=
list
(
dd
.
keys
())
if
t
!=
allfires
.
t
:
if
t
!=
allfires
.
t
:
allfires
=
FireIO
.
load_fobj
(
t
,
regnm
,
activeonly
=
Tru
e
)
allfires
=
FireIO
.
load_fobj
(
t
,
regnm
,
activeonly
=
Fals
e
)
# record all nfps for all fires with fids to make nfplist at t
# record all nfps for all fires with fids to make nfplist at t
gdf_1d
=
None
gdf_1d
=
None
for
fid
in
fids
:
for
fid
in
fids
:
...
@@ -473,14 +473,14 @@ def save_sfts_all(queue: multiprocessing.Queue, t, regnm, layers=["perimeter", "
...
@@ -473,14 +473,14 @@ def save_sfts_all(queue: multiprocessing.Queue, t, regnm, layers=["perimeter", "
tstart
=
time
.
time
()
tstart
=
time
.
time
()
# read allfires object
# read allfires object
logger
.
info
(
f
'
Load allfires..
'
)
logger
.
info
(
f
'
Load allfires..
'
)
allfires
=
FireIO
.
load_fobj
(
t
,
regnm
,
activeonly
=
Tru
e
)
allfires
=
FireIO
.
load_fobj
(
t
,
regnm
,
activeonly
=
Fals
e
)
t_pt
=
FireTime
.
t_nb
(
t
,
nb
=
"
previous
"
)
t_pt
=
FireTime
.
t_nb
(
t
,
nb
=
"
previous
"
)
try
:
try
:
# read allfires object at previous time step
# read allfires object at previous time step
logger
.
info
(
f
'
Load allfires_pt...
'
)
logger
.
info
(
f
'
Load allfires_pt...
'
)
allfires_pt
=
FireIO
.
load_fobj
(
t_pt
,
regnm
,
activeonly
=
Tru
e
)
allfires_pt
=
FireIO
.
load_fobj
(
t_pt
,
regnm
,
activeonly
=
Fals
e
)
except
:
except
:
allfires_pt
=
FireObj
.
Allfires
(
t_pt
)
allfires_pt
=
FireObj
.
Allfires
(
t_pt
)
# find all large active fires and sleepers
# find all large active fires and sleepers
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment