master-thesis

Private repo for tasks related to my MSc project:)

Overview

├── benchmark - benchmarking scripts
│   ├── constants
│   └── predictions
├── data - datasets go here
│   └── data-exploration – scripts for researching datasets
├── evaluation - evaluation scripts
├── finetuning
│   └── constants
├── prompting
│   └── constants
├── res - resources, such as images
└── utils - utility scripts

Setup

Install the requirements.txt using pip:

python -m venv master-venv
source master-venv/bin/activate
pip install -r requirements.txt

requirements.txt is created using:

pip freeze > requirements.txt

Fox modules

module purge
module use -a /fp/projects01/ec30/software/easybuild/modules/all/
module load Python/3.12.3-GCCcore-13.3.0  
module load nlpl-llmtools/01-foss-2024a-Python-3.12.3
module load nlpl-datasets/3.6.0-foss-2024a-Python-3.12.3
module load nlpl-transformers/4.55.4-foss-2024a-Python-3.12.3
module load nlpl-nlptools/01-foss-2024a-Python-3.12.3