This is the GitHub repository for an exposition of Probability Theory, written based on the lecture with the same name given at Imperial College London in spring 2022 by Dr. Igor Krasovsky. This is an ...

The Decoder-only model with RoPE, SwiGLU and a BPE tokenizer is in assignment/assianment1-basics/cs336_basics. I only run one experiment on my mac because I do not ...