Feat/energy consumption - #34

Open

giuliobilli01 wants to merge 151 commits into

mainfrom

feat/energy-consumption

Commits on Mar 10, 2026

Commits on Mar 11, 2026

feat: add logs.sh script to better log access
giuliobilli01
committed
556d2af
feat: add eval_study script
giuliobilli01
committed
8e3a283

Commits on Mar 20, 2026

feat: setup wandb run for energy profiler
giuliobilli01
committed
75b69bf

Commits on Mar 21, 2026

feat: add estimator integration and added comparison
giuliobilli01
committed
0871170
fix: fix get_model_params call
giuliobilli01
committed
d79c120

Commits on Mar 22, 2026

feat: wip
giuliobilli01
committed
fb56e12
feat: add energy evaluation configurations
giuliobilli01
committed
66cb577
feat: update sbatch
giuliobilli01
committed
399099d
fix: fix name error
giuliobilli01
committed
6ce49f2
fix: fix pubmed conf
giuliobilli01
committed
982dff1
fix: fix trust on estimator
giuliobilli01
committed
0646be3
fix: fix trust on estimator
giuliobilli01
committed
8dd9d5f

Commits on Mar 23, 2026

fix: fix tdp unit measure
giuliobilli01
committed
4f891b4
refactor: add wand_logger
giuliobilli01
committed
44592b8

Commits on Mar 25, 2026

fix: fix cpu poweer estimation
giuliobilli01
committed
1aeaae5

Commits on Mar 26, 2026

fix: fix cpu poweer estimation
giuliobilli01
committed
4eb0254

Commits on Mar 29, 2026

Commits on Mar 30, 2026

QLoRa implementation

Andreea Scrob
authored and
Andreea Scrob
committed
1d211a3
fix: correct indentation
andreeascrob
committed
8d711e5
Fix QLoRa error

Andreea Scrob
authored and
Andreea Scrob
committed
159c192
see inconsistency

Andreea Scrob
authored and
Andreea Scrob
committed
266ad93
fix: correct indentation in model input requirement check
andreeascrob
committed
0e98ad2

Commits on Mar 31, 2026

Fix some repetitions

Andreea Scrob
authored and
Andreea Scrob
committed
7c9af2b

Commits on Apr 9, 2026

Resolve merge conflicts + ignore sbatch script

Andreea Scrob
authored and
Andreea Scrob
committed
c1472df

Commits on Apr 10, 2026

.

Andreea Scrob
authored and
Andreea Scrob
committed
db6ce25
feat: add configuration files for qa_pubmed_mcqa with gemma-2-2b and llama-3-8b models
andreeascrob
committed
0573dea
feat: add qa_pubmed_mcqa configuration for llama-3-8b model
andreeascrob
committed
64544b1
chore: remove qa_pubmed_mcqa configuration for llama-3-8b model
andreeascrob
committed
a066b49
fix: correct formatting in qa_pubmed_mcqa_llama-3-8b_QLoRa.yaml
andreeascrob
committed
9c74b90
fix: update model kwargs to use 'torch_dtype' instead of 'dtype'
andreeascrob
committed
78c2590
fix: update completion_only_loss to False and max_length to 1024 in qa_pubmed_mcqa_llama-3-8b_QLoRa.yaml
andreeascrob
committed
c6f5c93
fix: update peft_config parameters and adjust max_length in qa_pubmed_mcqa_llama-3-8b_QLoRa.yaml
andreeascrob
committed
5e2112d

Commits on Apr 13, 2026

feat: add medMcqa_data_builder for fine tuning on medMcqa dataset
giuliobilli01
committed
af37159
fix: fix lm_eval requirements for pyproject install
giuliobilli01
committed
f81b679
fix: fix medmcqa task builder
giuliobilli01
committed
e28b6f1

Commits on Apr 14, 2026

feat: add cli_evaluate metrics aggregator
giuliobilli01
committed
b0cd297
feat: add script to populate old runs
giuliobilli01
committed
61cc180
fix: fix script to populate old runs
giuliobilli01
committed
48ecd99

Commits on Apr 16, 2026

feat: add script to check model modules for PEFT compatibility
andreeascrob
committed
7c1b69f

Commits on Apr 17, 2026

feat: add wandb energy accuracy builder
giuliobilli01
committed
85ffc23
feat: add wandb energy accuracy plot with vega preset
giuliobilli01
committed
d225674

Commits on Apr 18, 2026

feat: update wandb pareto plot
giuliobilli01
committed
b7ea2ee
feat: update wandb pareto plot
giuliobilli01
committed
bfbf0b3

Commits on Apr 19, 2026

chore: from dtype to torch_dtype
giuliobilli01
committed
e52b960
fix: update WANDB_TRAIN_PROJECT to reflect new project name
andreeascrob
committed
112ba11
fix: yaml file

Andreea Scrob
authored and
Andreea Scrob
committed
8fcc867
fix: fix warning condition
giuliobilli01
committed
aa01ceb
feat: update returned fields to create pareto chart for task group and for each task
giuliobilli01
committed
2e8b4fe
fix: fix lm-eval metrics retrieval
giuliobilli01
committed
d08027b
feat: add MedMCQA and MedQA data builders with processing logic
andreeascrob
committed
68aa68b
fix: update quantization and trainer configuration parameters in qa_pubmed_mcqa_gemma-2-2b_zero-shot_QLoRa.yaml
andreeascrob
committed
77f4038

Commits on Apr 20, 2026

fix: handle invalid 'cop' values in MedmcqaDataBuilder processing logic
andreeascrob
committed
3f76070
test QLoRa on pubmed dataset

Andreea Scrob
authored and
Andreea Scrob
committed
cdd1ab8
fix: update test for MedmcqaDataBuilder to ensure data integrity and uniqueness
andreeascrob
committed
a078d4e
feat: add new YAML configuration files for MedMCQA and MedQA tasks
andreeascrob
committed
09f9fe8
fix: update dataset directory in qa_pubmed_gen_qa_gemma configuration
andreeascrob
committed
962bef6
feat: add new configuration for med_mcqa_gemma-2-2b with quantization and logging settings
andreeascrob
committed
56bda92
fix: update dataset directory in qa_pubmed_mcqa_gemma configurations
andreeascrob
committed
233f8b0
fix: correct bf16 and fp16 settings in qa_pubmed_mcqa_gemma configuration
andreeascrob
committed
30db52e
fix: update dataset directory in qa_pubmed_mcqa_llama-3-8b and qa_pubmed_mcqa_medgemma-4b configurations
andreeascrob
committed
69023e2
chore: updated trl version to latest with correct transformers version
giuliobilli01
committed
7eb7e4e
feat: added gemma4 configs
giuliobilli01
committed
528e572

Commits on Apr 22, 2026

Commits on Apr 23, 2026

Commits on Apr 27, 2026

Commits on Apr 29, 2026

Commits on Apr 30, 2026

feat: fixed metrics unit of measure and inference flops
giuliobilli01
committed
e02138e
feat: add config loucher script
giuliobilli01
committed
f043d84

Commits on May 1, 2026

Commits on May 3, 2026

feat: add config to reduce used space
giuliobilli01
committed
18bb8e1
feat: add config with process tracking mode to test
giuliobilli01
committed
f174210

Commits on May 4, 2026

fix: fix completion only loss preserve_tail
giuliobilli01
committed
f8e6aae

Commits on May 6, 2026

feat: update evaluation config for qlora fine tuning
giuliobilli01
committed
92386db

Commits on May 10, 2026

feat: add auto pareto chart calculation
giuliobilli01
committed
e4d9251
chore: changed wandb project for eval configurations
giuliobilli01
committed
d4e9a5d
chore: removed gemma4 configs
giuliobilli01
committed
024217a

Commits on May 12, 2026

fix: fix fields mismatch in pareto calculation
giuliobilli01
committed
f2f6628

Commits on May 13, 2026

fix: fix wandb key
giuliobilli01
committed
78e88ab
feat: update run script
giuliobilli01
committed
0af56da
fix: add file creation for GPU PARAMS and MODEL PARAMS files
giuliobilli01
committed
9ce5b5f

Commits on May 14, 2026

feat: updated pareto plot ui
giuliobilli01
committed
3f3327e
feat: updated pareto plot ui
giuliobilli01
committed
1f538d3

Commits on May 21, 2026

fix: fix energy estimation error for training with peft
giuliobilli01
committed
b1cc391
feat: updated eval configs for flash_attn
giuliobilli01
committed
f84a8f7

Commits on May 27, 2026

feat: add mixed dataset builder
giuliobilli01
committed
d69424a
feat: add mixed dataset configs
giuliobilli01
committed
1863697

Commits on Jun 6, 2026

Commits on Jun 7, 2026

fix: reduce logging steps to 10 and enhance evaluation/checkpointing configurations across multiple YAML files
andreeascrob
committed
f73a595

Commits on Jun 13, 2026

fix: reduce logging steps to 10 and enhance evaluation/checkpointing configurations across multiple YAML files
andreeascrob
committed
93140e7

Commits on Jun 20, 2026

feat: add eval configs for mixed dataset
giuliobilli01
committed
6c1771d

Commits on Jun 24, 2026

Commits on Jun 26, 2026

Commits on Jun 28, 2026

fix: update WANDB training project name to 'open-medical-llm-train-energy'
andreeascrob
committed
a277197
back to QLoRa train project
andreeascrob
committed
06a99eb

Commits on Jun 29, 2026

Commits on Jun 30, 2026

Commits on Jul 1, 2026