captioning

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

JoyCaption is an image captioning Visual Language Model (VLM) being built from the ground up as a free, open, and uncensored model for the community to use in training Diffusion models.

新一代 AI 专业字幕软件，剪映字幕、elevenlabs 语音转文本的最佳本地版平替之一，也是加强版。中英转录识别准确率超过 97%，词语音频对齐率 98%，说话人分割与识别准确率 96%，带有最先进的 ASR 开源模型，100+字幕动画（支持导出透明背景的字幕动画）。说话人识别、专业字幕编辑器、命令行工具、Skill，达芬奇字幕插件（含字幕动画插件），PR 字幕插件，本地转录、远程转录、文稿匹配、智能拆行、AI校正、AI 智能热词、翻译、双语字幕、专业字幕编辑器、字幕合成、自定义大模型 API

Code for "Aligning Linguistic Words and Visual Semantic Units for Image Captioning", ACM MM 2019

CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)

A Tennis dataset and models for event detection & commentary generation

Audio Captioning datasets for PyTorch.

Automated image & video captioning using Qwen-VL, Gemma4 and SAM3.

Medical image captioning using OpenAI's CLIP

VisText is a benchmark dataset for semantically rich chart captioning.

Fully-Convolutional Point Networks for Large-Scale Point Clouds

Python code for handling the Clotho dataset.

What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]

Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.

A Base Tensorflow Project for Medical Report Generation

[CVPR 2023 & IJCV 2025] Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Using LLMs and pre-trained caption models for super-human performance on image captioning.