Merging the work of Yehor's thesis inot the main branch from ets_json_params - #8

Open

YehorYudinIPP wants to merge 794 commits into

devfrom

ets_json_params

This pull request is big! We're only showing the most recent 250 commits

Commits on Sep 8, 2023

UQ postprocessing: now can combine timetraces for multiple submissions, and then combine different quantities into a single dataframe pickle
YehorYudinIPP
committed
3dfc7d1
less removal in uq postprocessing
YehorYudinIPP
committed
5caee44

Commits on Sep 11, 2023

Commits on Sep 12, 2023

UQ postprocessing: small corrections in plotting routines
YehorYudinIPP
committed
34c2f97

Commits on Sep 13, 2023

Commits on Sep 14, 2023

Commits on Sep 15, 2023

M3-WF: added implementation of turbulence model selector, and
YehorYudinIPP
committed
af8b6e3

Commits on Sep 25, 2023

Commits on Sep 27, 2023

Changes in time labels for TuTrEq
YehorYudinIPP
committed
a23dc6d
M3-MF: more printing for flux values from surrogate
YehorYudinIPP
committed
faad080

Commits on Sep 28, 2023

Commits on Sep 29, 2023

Commits on Oct 4, 2023

UQ psotprocessing: plotting traces for 8 flux tubes
YehorYudinIPP
committed
19af247
UQ shell scripts: not backing up PFILEs
YehorYudinIPP
committed
f0ab799
M3-MF postprocessing: reading CPOs from arbitrary folders
YehorYudinIPP
committed
af108c9

Commits on Oct 5, 2023

Commits on Oct 6, 2023

Commits on Oct 9, 2023

M3-WF: setup changes
YehorYudinIPP
committed
4ccb424
M3-WF: postprocessing into single CSV file
YehorYudinIPP
committed
5626b2d
UQ postproc: adding reference input values
YehorYudinIPP
committed
6ce7596

Commits on Oct 10, 2023

Commits on Oct 12, 2023

Commits on Oct 13, 2023

Commits on Oct 16, 2023

UQ shell scripts: new run for GEM cases
YehorYudinIPP
committed
4abc1a0
M3-WF: fixes for turbulence model combiner
YehorYudinIPP
committed
bca724c
M3-WF: fixes for new runs
YehorYudinIPP
committed
66bd330

Commits on Oct 18, 2023

M3-WF: plotting
YehorYudinIPP
committed
8e94a62
M3-WF: YYMSL files for smallr dt
YehorYudinIPP
committed
f552a1f
M3-WF: slurm launcher
YehorYudinIPP
committed
0fdb696
M3-WF: shell script
YehorYudinIPP
committed
a721db2

Commits on Oct 20, 2023

Commits on Oct 23, 2023

M3-WF: plotting added intersection with bounds and common evolution plots
YehorYudinIPP
committed
cf7365f
M3-WF: fixed some input permutation issues
YehorYudinIPP
committed
2ec5570
M3-WF: new yymsl and shell files
YehorYudinIPP
committed
b5c9506

Commits on Oct 24, 2023

M3-WF: double check for order of dictionary entries
YehorYudinIPP
committed
f0cc8e7

Commits on Oct 26, 2023

M3-MF: plotting into several multi-page PDFs
YehorYudinIPP
committed
4ee519c

Commits on Oct 31, 2023

GEM0: generating data for larger parameter space region
YehorYudinIPP
committed
cd37836

Commits on Nov 1, 2023

GEM0: Python version can be called for any rho_tor_norm
YehorYudinIPP
committed
9f5863c
GEM0: expanding input space fix
YehorYudinIPP
committed
1f250b3

Commits on Nov 3, 2023

M3-WF: started comparing two turbulence models for profile evolution
YehorYudinIPP
committed
c283d37

Commits on Nov 6, 2023

GEM0: calling for arbitrary rho, more debug:
YehorYudinIPP
committed
30c62bc
minor changes for debugging
YehorYudinIPP
committed
4631761
calling GEM0 arabitrary
YehorYudinIPP
committed
e1c8290

Commits on Nov 7, 2023

Commits on Nov 8, 2023

M3-WF: surrogate interpolates values of input parameters on coretranp grid
YehorYudinIPP
committed
635bdeb

Commits on Nov 10, 2023

M3-WF: fixed interpolation on the transport radial grid
YehorYudinIPP
committed
0bbe733

Commits on Nov 22, 2023

M3-WF: new workflow for GEM0 surrogate
YehorYudinIPP
committed
a98524d
GEM0: fixes in wrapper for correct flux tube location
YehorYudinIPP
committed
75cfbef
Fixes in bash and python package
YehorYudinIPP
committed
1a528a6

Commits on Nov 24, 2023

GEM0: correct pathes + scanning plot function
YehorYudinIPP
committed
eb5dfb9

Commits on Dec 11, 2023

surrogate: plotting code vs ml scans
YehorYudinIPP
committed
8ac2349
M3: plotting functions
YehorYudinIPP
committed
7006960

Commits on Dec 13, 2023

Added a function to compare behaviour of two models
YehorYudinIPP
committed
259ffb4

Commits on Dec 15, 2023

Commits on Dec 18, 2023

Manipulating results from an EasySurrogate for GEM0
YehorYudinIPP
committed
a98c81c

Commits on Dec 19, 2023

GEM0SURR: changing the center of model/surrogate cuts
YehorYudinIPP
committed
c525498

Commits on Jan 5, 2024

Commits on Jan 8, 2024

pyGEM0: added a function to generate LHS sample for arbitrary support for any flux tube
YehorYudinIPP
committed
89b03ee

Commits on Jan 9, 2024

GEM0: correction for LHC sample generation
YehorYudinIPP
committed
500705c

Commits on Jan 10, 2024

Surrogate scans: generality in pathes and parameters, cutting negative temperatures
YehorYudinIPP
committed
8a67cac

Commits on Jan 11, 2024

Running GEM for inner flux tube only
YehorYudinIPP
committed
f60f0af

Commits on Jan 15, 2024

GEM0 cuts: now can allign to surrogate training data
YehorYudinIPP
committed
fe3b4ab
pyGEM0: small changes
YehorYudinIPP
committed
23850af

Commits on Jan 16, 2024

pyGEM0 surrogates comparison for different ANNs
YehorYudinIPP
committed
bb6d6bc

Commits on Jan 17, 2024

Commits on Jan 18, 2024

Commits on Jan 19, 2024

Commits on Jan 22, 2024

Commits on Jan 23, 2024

Commits on Jan 26, 2024

pyGEM0: fix of calling for exact input value at transport grid
YehorYudinIPP
committed
8b22dc6
pyGEM0: fixed dataset generating function
YehorYudinIPP
committed
2b3cb05
M3-WF: fixes for complete workflow processing
YehorYudinIPP
committed
fe20726

Commits on Jan 29, 2024

Commits on Jan 31, 2024

Commits on Feb 2, 2024

Commits on Feb 5, 2024

Making a workflow for surrogate retraining based on stationary state of M3-WF
YehorYudinIPP
committed
f999d64

Commits on Feb 6, 2024

Surrogate conv analysis: prepare signature of all files
YehorYudinIPP
committed
727a4f1
Surrogate retraining loop shell script
YehorYudinIPP
committed
a6bff83

Commits on Feb 7, 2024

Commits on Feb 8, 2024

Commits on Feb 9, 2024

Aleatoric WF: SLURM scripts, params, copying, metrics, sampling, encoding
YehorYudinIPP
committed
cd3aff5

Commits on Feb 12, 2024

M3-WF: updated files for independent workflow
YehorYudinIPP
committed
cd463a8
Updated scripts for aleatoric analysis workflow
YehorYudinIPP
committed
61b66b0
Aleatoric workflow: minor (paths) fixes
YehorYudinIPP
committed
80f0673

Commits on Feb 13, 2024

Change of pathes for util functions + random M3 run id + minor changes
YehorYudinIPP
committed
f85087d

Commits on Feb 14, 2024

Commits on Feb 15, 2024

Aleatoric algo: updates in decoder and in M3 running
YehorYudinIPP
committed
ef32e3b
Minor updates in scripts
YehorYudinIPP
committed
3c6101e

Commits on Feb 19, 2024

Commits on Feb 20, 2024

Commits on Feb 21, 2024

Commits on Feb 22, 2024

Commits on Feb 23, 2024

Commits on Feb 26, 2024

Commits on Feb 27, 2024

Retraining algorithm: small fixes to include equilibrium data for surrogates
YehorYudinIPP
committed
4906384

Commits on Feb 28, 2024

New analysis for aleatoric algo and GEM data
YehorYudinIPP
committed
b54eee2
Retraining algo: enabled switching between data with and without equilibrium
YehorYudinIPP
committed
142428d
Fixes in aleatoric algo analysis
YehorYudinIPP
committed
30f5f6b

Commits on Feb 29, 2024

Commits on Mar 1, 2024

Updated plotting notebook
YehorYudinIPP
committed
bd34a0b

Commits on Mar 4, 2024

Commits on Mar 5, 2024

Aleatoric algo restarting script - fixes for waiting and state comparison
YehorYudinIPP
committed
bc85682

Commits on Mar 6, 2024

Restarting al.algo. : starting multiple SLURM jobs now
YehorYudinIPP
committed
f7b8c1d
Al.Algo. : postprocessing plots changes
YehorYudinIPP
committed
f458f26

Commits on Mar 11, 2024

Modifying files to restart eUQ campaign for AlAlg
YehorYudinIPP
committed
1492016
Postprocessing: cells for surrogate costs
YehorYudinIPP
committed
f95683d

Commits on Mar 12, 2024

Comparison of states: plotting
YehorYudinIPP
committed
535b0cb
Plotting the costs: highlights
YehorYudinIPP
committed
a96e90d
Comparing states: renewing metrics
YehorYudinIPP
committed
c81e08b
Reruning AlAlgo: slurm files
YehorYudinIPP
committed
ca2cb7d

Commits on Mar 13, 2024

Re-running retraining algorithm
YehorYudinIPP
committed
6fedbc5
Checking the error in final state
YehorYudinIPP
committed
d6f8c28

Commits on Mar 14, 2024

Cherry-pick from DPC
YehorYudinIPP
committed
ddd86ec
update old python notebooks
YehorYudinIPP
committed
44f37d1
updated shell scripts
YehorYudinIPP
committed
4cdc28c

Commits on Mar 15, 2024

updated aleatoric algo restart scripts
YehorYudinIPP
committed
4b7cad8
eUQ script to re-analyse aleatoric algo
YehorYudinIPP
committed
8a1f374
Updated aleatoric algo files
YehorYudinIPP
committed
9dc10b5

Commits on Mar 18, 2024

Got data from older GEM runs + new scan plots
YehorYudinIPP
committed
350df87

Commits on Mar 20, 2024

Commits on Mar 21, 2024

Updated postprocessing notebook
YehorYudinIPP
committed
b69830b
Updated script for aleatoric workflow
YehorYudinIPP
committed
de41e45

Commits on Mar 22, 2024

Updated the M3 surrogate files
YehorYudinIPP
committed
be1c19d
Updated the config for GEM-sur-WF
YehorYudinIPP
committed
84cb232
Updated script to run aleatoric algorithm
YehorYudinIPP
committed
9cd316f

Commits on Mar 25, 2024

Commits on Mar 26, 2024

Updating plotting and utility scripts
YehorYudinIPP
committed
8ec5bd6
Postrprocessing notebook: new RetrAlgo and GEM data update(Sobol errors)
YehorYudinIPP
committed
19caaae
AleAlgo: new attempt
YehorYudinIPP
committed
a833362

Commits on Mar 27, 2024

Commits on Apr 8, 2024

Update in postprocessing notebook
YehorYudinIPP
committed
b82e605
Update Aleatoric Algo scripts
YehorYudinIPP
committed
b4c25a8
Enabled surrogates in transformed spaces
YehorYudinIPP
committed
1213b4b
Getting GEM0 Sobols
YehorYudinIPP
committed
783c078
updated gem_da.py
YehorYudinIPP
committed
292573d

Commits on Apr 9, 2024

postprocessing
YehorYudinIPP
committed
94891f0
GEM0 UQ
YehorYudinIPP
committed
0434861

Commits on Apr 18, 2024

Added convergence analysis for the time traces analysis
YehorYudinIPP
committed
ea52a9b
time traces post-processing
YehorYudinIPP
committed
52dedf2

Commits on Apr 19, 2024

Time trace postprocessing: lin scan in convergence criteria, plotting more statistics, different plot limit
YehorYudinIPP
committed
4486a69

Commits on Apr 22, 2024

Commits on Apr 23, 2024

changes in time traces postprocessing
YehorYudinIPP
committed
b23464f
changes in postprocessing notebook
YehorYudinIPP
committed
c113a79

Commits on Jun 25, 2024