Skip to content
View umutonuryasar's full-sized avatar

Block or report umutonuryasar

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
umutonuryasar/README.md

Hi! I'm Umut

Applied AI Research Engineer; vision-language models, computer vision, efficient deep learning.

I work independently on vision-language models: building them from scratch and testing design choices with controlled experiments. Computer vision is my base; model efficiency (knowledge distillation, parameter-efficient fine-tuning) is the background I bring to it.

Background in Electrical & Electronics Engineering.

Selected Work

MicroCLIP — from-scratch CLIP-style VLM Image and text encoders trained from scratch on COCO Captions, with an 11-configuration sweep comparing sigmoid (SigLIP) and softmax contrastive losses under a fixed compute budget. Small-scale non-replication: softmax beat sigmoid at every batch size, and the gap widened as batch size shrank. Live demo · checkpoints on Hugging Face
PyTorch · CLIP · SigLIP · Contrastive Learning · ONNX

RT-DETR Knowledge Distillation — KD for real-time detection Logit-, feature-, and combined-distillation strategies for RT-DETR, with reproducible experiments and deployment-oriented evaluation. First-author preprint: arXiv:2605.31191
Knowledge Distillation · RT-DETR · Object Detection · PyTorch

detrflow — training-to-serving stack for RT-DETR Training, evaluation, benchmarking, and deployment with FastAPI/Gradio serving and Docker.
Computer Vision · FastAPI · Docker · PyTorch

Open Source

  • Hugging Face PEFT — #3293 · Merged — removed redundant CUDA memory overhead in prepare_model_for_kbit_training (~480 MB lower memory, measured independently by the issue reporter)
  • aisuite — #319 · Merged — Python 3.14 compatibility

Pinned Loading

  1. rt-detr-kd rt-detr-kd Public

    Knowledge distillation for efficient RT-DETR: logit, feature, and combined KD with edge deployment analysis on COCO

    Python 1

  2. detrflow detrflow Public

    RT-DETR object detection pipeline with FastAPI serving and Gradio demo

    Python

  3. microclip microclip Public

    Python