fix(jumpstart): support EU Sovereign Cloud without Neo - #6242
Open
evakravi wants to merge 4 commits into
Open
Conversation
Add the missing EU Sovereign Cloud JumpStart buckets to the v2 region map. Resolve draft-model buckets from their provider before a Neo lookup. Raise a clear Neo error when a launched region has no Neo bucket. Report JumpStart lookup failures as JumpStart errors. --- X-AI-Prompt: Can you fix JumpStart bucket resolution when Neo is unavailable and add EU Sovereign Cloud support to SDK v2? X-AI-Tool: claude-code
…site Return None from the Neo accessor when a launched region has no Neo bucket. Raise in the draft-model resolver when a Neo-backed data source has no bucket. --- X-AI-Prompt: Can you move the missing-Neo-bucket exception from the accessor to the function that uses the Neo bucket? X-AI-Tool: claude-code
Raise only when speculative-decoding metadata selects Neo and no Neo bucket exists. Models and configurations without this metadata do not access Neo. --- X-AI-Prompt: Can you raise for a missing Neo bucket only while processing metadata that uses it? X-AI-Tool: claude-code
evakravi
commented
Sep 8, 2026
Exercise the reported DeepSeek setup against live public metadata. Document why draft-model bucket selection can return no Neo bucket. --- X-AI-Prompt: Can you add integration tests for the screenshot error and address the review comments? X-AI-Tool: claude-code
evakravi
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
SageMaker Python SDK v2 omits
eusc-de-east-1from the JumpStart region map.JumpStartModelfails before it reads the public metadata.The error names Neo because the JumpStart bucket accessor contains a copy error. Draft-model bucket selection also reads Neo before it examines provider metadata.
Solution
Add the public and gated JumpStart bucket names for
eusc-de-east-1. Do not add a Neo bucket.Report a JumpStart error when a region has no JumpStart bucket. Return
Nonewhen a launched region has no Neo bucket.Resolve each speculative-decoding data source from its provider. Raise the Neo error only when present metadata selects Neo and the region has no Neo bucket.
Models without speculative-decoding metadata do not access Neo. JumpStart-backed draft-model metadata uses the JumpStart bucket without Neo access.
Tests
The exact DeepSeek integration test failed on
origin/master-v2with the reported Neo error. The same test passes on this branch.The focused suite reports
18 passed, 1 warning in 4.16s.The test creates
deepseek-llm-r1-distill-llama-8bversion3.5.0fromSageMakerPublicHubineusc-de-east-1. The test confirms the JumpStart URI and no Neo bucket.The boundary tests cover no metadata, Neo metadata without a bucket, and JumpStart-backed metadata.
Black and Flake8 pass for the five changed Python files.
Merge Checklist
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.