Skip to content
View nabeelshan78's full-sized avatar

Highlights

  • Pro

Block or report nabeelshan78

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
nabeelshan78/README.md

Nabeel Shan

AI/ML Researcher & Engineer · B.E. Software Engineering @ NUST ('27)

MITACS Globalink Research Intern @ University of Calgary - Schulich School of Engineering

Seeking a thesis-based MSc for Fall 2027.


Research

I work on large language and vision-language models that reason better and cost less to run.

Most of what I do comes down to one question: where the compute goes. We can spend it after pretraining with reinforcement learning, save it with efficient adaptation and compression, or spend it at inference - letting a model think longer, call a tool, or hand off to another agent. And we need evaluation we can trust to know whether any of it worked, because the failures that matter here rarely raise an error.

Post-Training & Reinforcement Learning RLHF, RL with verifiable rewards, GRPO/GSPO, preference optimisation, reward modelling and reward design
Efficient Adaptation & Inference Parameter-efficient fine-tuning, quantization, and distillation
Test-Time Compute & Agentic Systems Inference-time scaling, verification and self-correction loops, multi-agent orchestration, and tool use
Evaluation & Trustworthy Systems Reward hacking, hallucination, silent capability loss, and evaluation

I build architectures from first principles before reaching for abstractions - Transformers, CNNs, RNNs and PEFT modules implemented and validated from scratch.


Currently

MITACS Globalink Research Intern, University of Calgary - Schulich School of Engineering

Four parallel VLM adaptation pipelines over Qwen3-VL at 2B, 4B and 8B - captioning, object grounding, safety-violation reasoning, and all three jointly - two-phase LoRA SFT -> GRPO against verifiable, code-computed rewards on an H100 SLURM cluster. A single-variable design: does multi-task output help or hurt each sub-task, and does the answer change with model size?

Running alongside it, an accuracy-latency-cost comparison across the three scales and a multi-agent tier - finding where the capability gain stops paying for the inference.


Selected Work

Project Focus Stack
RLHF from Scratch 3-stage alignment pipeline (SFT -> RM -> PPO), 98% reward-model accuracy, +54% mean reward PyTorch, TRL, QLoRA
Transformer Adaptation Playbook Adapters & LoRA built from the papers' math; 5 adaptation strategies benchmarked - Adapters match full FT at 92% fewer params PyTorch
Attention Is All You Need 63M-param Transformer verified at tensor, gradient, and memory-pointer level; exact analytic parameter count PyTorch
First-Principles Deep Learning DNN, CNN, RNN in raw NumPy - no autograd, BPTT and optimizers derived by hand NumPy
PixelSense U-Net from scratch, no pretrained backbone, 23-class segmentation, 0.908 val mIoU TensorFlow/Keras
Math-VLM PaliGemma-3B adapted with QLoRA for handwritten expression → LaTeX PyTorch, PEFT
ResearchFlow Cyclical 4-agent system with self-correcting validation, validator agent re-runs research until it passes, plus two-tier model routing and HITL interrupts LangGraph, Llama-3

Stack

Languages Python C++ SQL Bash
Deep Learning PyTorch TensorFlow/Keras Hugging Face NumPy Scikit-learn
LLM & Agents Transformers PEFT/LoRA TRL LangChain LangGraph RAG
Infrastructure Docker AWS SLURM FastAPI Weights & Biases Git Linux


Experience

  • Research Intern - MITACS Globalink, University of Calgary (Jul 2026 – Present)
  • AI Engineer (Contract) - DeepDocs AI, France (Nov 2025 – Jan 2026)
  • Quantum-AI Research Intern - CETQAP (Jun 2025 – Aug 2025)
  • AI/ML Intern - Software Productivity Strategists (Apr 2025 – May 2025)

Pinned Loading

  1. reinforcement-learning-human-feedback-scratch reinforcement-learning-human-feedback-scratch Public

    End-to-end implementation of Reinforcement Learning with Human Feedback (RLHF) to align a GPT-2 model with human preferences — covering Supervised Fine-Tuning (SFT), Reward Modeling, and PPO-based …

    Jupyter Notebook 2

  2. Transformer-Adaptation-Playbook Transformer-Adaptation-Playbook Public

    An empirical study of Transformer adaptation techniques. Pre-training from scratch (MLM), classic fine-tuning, and from-scratch implementations of PEFT methods (LoRA, Adapters). Tuning both encoder…

    Jupyter Notebook 1

  3. First-Principles-Deep-Learning First-Principles-Deep-Learning Public

    From-scratch NumPy implementations of core deep learning architectures (DNN, CNN, RNN). A journey into the first principles of AI.

    2

  4. attention-is-all-you-need-scratch attention-is-all-you-need-scratch Public

    A rigorous, first-principles PyTorch implementation of the Encoder-Decoder Transformer architecture. Verified at tensor, gradient-graph and memory-pointer level before training. Includes custom Noa…

    Jupyter Notebook 1

  5. researchflow-multiagent-research-assistant researchflow-multiagent-research-assistant Public

    A production-grade, cyclical multi-agent system built with LangGraph and Groq (Llama-3). Orchestrates 4 specialized AI agents to autonomously research, validate, and synthesize multi-step research.…

    Python

  6. safe-llm-adaptation-peft-rlhf safe-llm-adaptation-peft-rlhf Public

    An end-to-end pipeline for adapting FLAN-T5 for dialogue summarization, exploring the full spectrum of modern LLM tuning. Implements and compares Full Fine-Tuning, PEFT (LoRA), and Reinforcement Le…

    Jupyter Notebook 1