Repo goals

Repo focussing on personal gains in the field of language modelling.

Torch based, will add further implementations if I have time.

Tokenizers

• gpt2-bpe

To do

add finetuning

List of archs

• gpt2
• llama2
• SigLip(training code to be added)