Ahmed Shmels

Ahmed Shmels

M.Tech graduate in Data Science from IIT Madras (2024), and B.Tech in Computer Science and Engineering from VIT (2022). Research interests focus on reinforcement learning (RL), especially its applications to large language models (LLMs).

Projects

Research & Projects

🎯 Reinforcement Learning (RL)

RL Assignments

Comprehensive RL Implementation Suite: SARSA, Q-Learning, Hierarchical RL & Policy Gradients

Ahmed Shmels
Reinforcement Learning (CS6700), IIT Madras, 2024
Complete implementations of core RL algorithms including SARSA, Q-Learning, Dueling DQN variants, REINFORCE, and Hierarchical RL with SMDP & Intra-Option Q-Learning on various environments.
Assignment 1 (SARSA/Q-Learning) Assignment 2 (Dueling DQN/REINFORCE) Assignment 3 (Hierarchical RL)
RL4LLM Framework

RL4LLM: Reinforcement Learning Framework for Large Language Model Fine-tuning

Ahmed Shmels
Advanced LLM Agents (CS294), UC Berkeley, 2025
Comprehensive toolkit implementing GRPO and other RL algorithms for fine-tuning large language models with human feedback and reward optimization.
💻 Framework 💻 Research Suite

🔤 Natural Language Processing (NLP)

NLP IR System

Advanced Information Retrieval System with Causal NLP Integration

Ahmed Shmels
Natural Language Processing (CS6370), IIT Madras, 2024
Built comprehensive IR system with causal inference tools tailored for NLP tasks, featuring advanced retrieval algorithms and causality-aware language processing.
💻 IR System 💻 Causal-NLP

🤖 Machine Learning (ML)

ML Mathematical Essays

Mathematical Essays on Fundamental Machine Learning Algorithms

Ahmed Shmels
Independent Research Series, 2023-2024
In-depth mathematical explorations and theoretical analysis of core ML algorithms including SVMs, Random Forests, Decision Trees, Naive Bayes, and Regression techniques.
📄 SVM Essay 📄 Random Forest 📄 Decision Trees 📄 Naive Bayes 📄 Logistic Regression 📄 Linear Regression
House Price Prediction

Advanced Regression Techniques for House Price Prediction

Ahmed Shmels
Applied Machine Learning Project, 2023
Comprehensive implementation of advanced regression techniques including regularization, ensemble methods, and feature engineering for accurate house price prediction.
💻 Code 🌐 Demo

🧠 Deep Learning (DL)

Deep Learning Assignments

Complete Deep Learning Implementation Suite: FNN, CNN, and Seq2Seq Models

Ahmed Shmels
Deep Learning (CS6910), IIT Madras, 2024
Built neural networks from scratch including feedforward networks with multiple optimizers, CNNs with interpretability techniques, and sequence-to-sequence models with attention for transliteration tasks.
Assignment 1 (FNN) Assignment 2 (CNN) Assignment 3 (Seq2Seq)

👁️ Computer Vision (CV)

COVID-19 CXR Classification

COVID-19 Detection from Chest X-Rays Using Advanced Transfer Learning

Ahmed Shmels
B.Tech Thesis, VIT Vellore, 2022
Deep learning system for automated COVID-19 detection from chest X-ray images using state-of-the-art transfer learning techniques and ensemble methods.
💻 Code 📄 Thesis
Best Thesis Award
YOLO Aerial Detection

YOLO-based Object Detection Suite: Aerial Imagery and Custom Datasets

Ahmed Shmels
Computer Vision Projects, 2023-2024
Comprehensive YOLO implementations for various applications including aerial car detection, plant disease detection, and custom object detection/segmentation pipelines.
Aerial Detection Custom YOLO Plant Disease Digit Recognition