Hariprasad Sundaresan's picture
πŸ—οΈ Building on HF

Hariprasad Sundaresan PRO

Hari5115
4 5

AI & ML interests

LLMs, Fine-tuning, Agentic AI, RAG, Multilingual NLP, Transformers

Recent Activity

reacted to pranavupadhyaya52's post with πŸ‘ about 3 hours ago
After several weeks of experimenting, debugging, and iterating, I am excited to share WikiSmartBotLM. WikiSmartBotLM is a compact decoder only language model built from the ground up as an educational and practical project. The goal was not simply to train another language model, but to create one that is easy to understand, modify, and experiment with while following many of the architectural ideas used in modern LLMs. The model is built on a custom Transformer architecture featuring Rotary Positional Embeddings, RMSNorm, SwiGLU feed forward layers, grouped query attention, and an efficient autoregressive decoder optimized for local inference. The repository includes the complete model implementation, configuration files, tokenizer integration, training pipeline, inference scripts, checkpoint conversion utilities, and examples that demonstrate how each component works together. Whether you want to understand the forward pass, train your own model, or build applications on top of WikiSmartBotLM, everything is designed to be approachable. You can directly run the model via the models Huggingfaces space, which I've included in the post. Model Repository: https://huggingface.co/pranavupadhyaya52/Wiki-SmartBotLM-Instruct I hope WikiSmartBotLM becomes a useful resource for anyone who enjoys learning by building. Feedback, issues, feature requests, and contributions are always welcome. https://huggingface.co/spaces/pranavupadhyaya52/WikiSmartBot
View all activity

Organizations

None yet