Krishna2709 / Language-Models Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Building Language Models inspired from Sebastian Raschka

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
HuggingFace_Transformers_Tour.ipynb		HuggingFace_Transformers_Tour.ipynb
README.md		README.md
emotions_classificiation_DistilBERT.ipynb		emotions_classificiation_DistilBERT.ipynb
low_rank_adaptation.ipynb		low_rank_adaptation.ipynb
reflection_agent.ipynb		reflection_agent.ipynb
reflexion_agent.ipynb		reflexion_agent.ipynb
text_gen_kv-caching-batching.ipynb		text_gen_kv-caching-batching.ipynb
text_gen_kv-caching.ipynb		text_gen_kv-caching.ipynb
text_gen_quantization.ipynb		text_gen_quantization.ipynb

Repository files navigation

Language-Models

Building Language Models Inspired from

Sebastian Raschka
Andrej Karpathy
Natural Language Processing with Transformers - Lewis Tunstall, Leandro von Werra, Thomas Wolf
Generative Deep Learning - David Foster
DeepLearning.ai

Goal

To understand how language models work
To utilize Tensorflow, PyTorch, and HuggingFace libraries
To design language models from scratch
To train, evaluate, and deploy language models
To implement various techniques like Self-Attention | Flash-Attention ...
To quantize language models and reduce inference time
To convert the models into ONNX format and deploy them on mobile devices
To run language models on edge devices
To optimize open-source models from Anarchy

About

Building Language Models inspired from Sebastian Raschka

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%