Projects

Reinforcement Learning (RL)

• RL Assignments (IITM CS6700): Implementations including SARSA, Q-Learning, Hierarchical RL (SMDP & Intra-Option Q-Learning) , Dueling DQN, and REINFORCE.
  • Assignment 1 (SARSA/Q-Learning): Comparison of SARSA & Q-Learning in Grid World variants.
  • Assignment 2 (Dueling DQN/REINFORCE): Training Dueling DQN variants and Monte Carlo REINFORCE.
  • Assignment 3 (Hierarchical RL): Hierarchical RL in Taxi-v3 using SMDP & Intra-Option Q-Learning.
• RL4LLM Framework: Toolkit for RL-based Large Language Model fine-tuning.
• RL-Research Suite: Collection of benchmark Reinforcement Learning environments and algorithms.

Natural Language Processing (NLP)

• NLP Information Retrieval System (IITM CS6370): Project focusing on building an Information Retrieval system.
• Causal-NLP: Development of causal inference tools tailored for Natural Language Processing tasks.

Machine Learning (ML)

• Mathematical Essays on ML Algorithms: In-depth mathematical explorations of fundamental ML models.
  • Support Vector Machine: Mathematical essay on SVMs.
  • Random Forest: Mathematical essay on Random Forests.
  • Decision Trees: Mathematical essay on Decision Trees.
  • Naive Bayes Classifier: Mathematical essay on Naive Bayes.
  • Logistic Regression: Mathematical essay on Logistic Regression.
  • Linear Regression: Mathematical essay on Linear Regression.
• Advanced Regression - House Prices: Application of advanced regression techniques for house price prediction.

Deep Learning (DL)

• DL Assignment 1 (IITM CS6910): Implemented a feedforward neural network from scratch with multiple optimizers and hyperparameter tuning.
• DL Assignment 2 (IITM CS6910): Built a CNN from scratch, performed hyperparameter optimization, and applied interpretability techniques.
• DL Assignment 3 (IITM CS6910): Developed sequence-to-sequence models (RNN/LSTM/GRU) with attention for English-to-Malayalam transliteration.

Computer Vision (CV)

• BSc Thesis - COVID-19 CXR Classification: Classification of COVID-19 from Chest X-Rays using Transfer Learning.
• YOLO Object Detection: Projects utilizing YOLO models for object detection tasks.
  • Finding Cars from Aerial Images (YOLO-NAS/YOLOv8): Using YOLO-NAS and YOLOv8 to detect cars in aerial imagery.
  • Custom Dataset Object Detection/Segmentation/Classification (YOLOv8): Applying YOLOv8 for detection, segmentation, and classification on custom datasets.
• GreenVine - Early Plant Disease Detection: Computer vision project for early detection of plant diseases.
• Digit Recogniser: A computer vision project for recognizing handwritten digits.