Issues

• [ALERT] Access to NVIDIA's Self-Hosted Runners is Expiring

  nvidia-runners
  NVIDIA-NeMo/Export-Deploy#759 · Filter by author nvidia-runner-mgmt opened on Aug 30, 2026

• Update ED to use Dynamic Inference Engine from MCore

  NVIDIA-NeMo/Export-Deploy#693 · Filter by author athitten opened on May 22, 2026
  

• Incorrect handling of reasoning traces for nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 in MBridge format

  bug
  NVIDIA-NeMo/Export-Deploy#682 · Filter by author marta-sd opened on May 22, 2026
  1

  

• Server returns empty answer when too many tokens requested

  bug
  NVIDIA-NeMo/Export-Deploy#652 · Filter by author marta-sd opened on Apr 13, 2026
  

• VLM endpoint fails when there are no images in the request

  bug
  NVIDIA-NeMo/Export-Deploy#632 · Filter by author marta-sd opened on Mar 12, 2026
  

• Ray Deployment of moonlight 16B (MBridge) fails

  bug
  NVIDIA-NeMo/Export-Deploy#616 · Filter by author ko3n1g opened on Feb 23, 2026
  

• Stop word support for mcore inference

  enhancement
  NVIDIA-NeMo/Export-Deploy#564 · Filter by author oyilmaz-nvidia opened on Jan 20, 2026
  1

  

• Copy changes in PR 501 and 505 to scripts under new llm dir

  bug
  Bug

  NVIDIA-NeMo/Export-Deploy#504 · Filter by author athitten opened on Nov 6, 2025 · 25.11
  

• Export and Deploy PTQed Megatron-Bridge Models

  enhancement
  NVIDIA-NeMo/Export-Deploy#457 · Filter by author oyilmaz-nvidia opened on Oct 17, 2025
  1

• Create separate scripts for all the deployment paths

  enhancement
  NVIDIA-NeMo/Export-Deploy#438 · Filter by author oyilmaz-nvidia opened on Oct 6, 2025
  

• Check params like use_greedy and repetition_penalty for NemoQueryLLMPyTorch class

  bug
  NVIDIA-NeMo/Export-Deploy#434 · Filter by author oyilmaz-nvidia opened on Oct 4, 2025
  

• Stopword support for in-framework deployment

  enhancement
  NVIDIA-NeMo/Export-Deploy#430 · Filter by author oyilmaz-nvidia opened on Oct 1, 2025
  2

• Go over the docs and update the support matrices

  documentation
  NVIDIA-NeMo/Export-Deploy#425 · Filter by author oyilmaz-nvidia opened on Oct 1, 2025
  

• Move operations like chat templates to the server side for VLM deployment

  enhancement
  NVIDIA-NeMo/Export-Deploy#423 · Filter by author oyilmaz-nvidia opened on Oct 1, 2025 · 25.11
  1

  

• Introduce consistent and intuitive parameter naming for NeMo TensorRTLLM class vs TensorRT-LLM library, and across all export and deploy options

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#412 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Refactor tokenizer handling in nemo.export module

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#411 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Integrate exporting & deploying modelopt (quantized) unified checkpoints

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#410 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025
  1

• Support exporting fp4 models

  enhancement
  Feature

  NVIDIA-NeMo/Export-Deploy#409 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025
  

• Add multi batch size cuda graphs support for M-Bridge in-framework deployment.

  enhancement
  NVIDIA-NeMo/Export-Deploy#408 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Add GenAI-Perf Benchmark tool

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#407 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Support quantized m-bridge checkpoint for vLLM export

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#406 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Find the fastest inference options among vLLM, TensorRT-LLM, and M-Bridge

  enhancement
  Feature

  NVIDIA-NeMo/Export-Deploy#405 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025
  1

• Quantize M-Bridge and HF checkpoints during In-Framework Deployment

  enhancement
  Feature

  NVIDIA-NeMo/Export-Deploy#404 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• Export and Deploy Tutorials

  enhancement
  Task

  NVIDIA-NeMo/Export-Deploy#402 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025

• VLM in-framework support deployment using M-Bridge checkpoint

  enhancement
  Feature

  NVIDIA-NeMo/Export-Deploy#401 · Filter by author oyilmaz-nvidia opened on Sep 24, 2025 · 26.02