NobelGPT

I’m excited to make public my latest project, nobelGPT, which is focused on creating a Polish-language toy GPT model. Using the llama 3.1 and GPT-2/3 architectures, I’ve built a smaller model trained on texts by Polish Nobel laureates. The inspiration for this came from Andrej Karpathy’s videos, which dive deep into GPT architectures.

For more details, check out the project here.