This research project explores whether replacing standard MLP layers with KAN (Kolmogorov-Arnold Networks) in transformer architectures improves reasoning capabilities. Built on top of nanochat by ...

Abstract: In natural language processing (NLP), sentence embedding plays a key role in converting sentences into fixed-length vectors or numerical representations. These embeddings capture the ...

gordicaleksa / pytorch-GAT My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an ...

Abstract: Semantic search is the problem of document retrieval based on the meaning of the words and phrases in the query and documents and not solely based on word commonality. A recent approach to ...