llama4 implementation from first principles

This implementation is for learning purposes. Due to memory constraints, the implementation does not use original model weights.

Implementation references:

1. https://github.com/priyammaz/PyTorch-Adventures/tree/main
2. https://github.com/hkproj/pytorch-llama
3. https://huggingface.co/blog/moe