Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model.deploy() returning None instead of predictor/endpoint object #4619

Open
vaibhavsingh007 opened this issue Apr 25, 2024 · 0 comments
Open
Labels

Comments

@vaibhavsingh007
Copy link

Describe the bug
A clear and concise description of what the bug is.

from sagemaker.model import Model
from sagemaker.predictor import Predictor

instance_type, instance_count = "ml.m5.xlarge", 1

predictor = model.deploy(
    initial_instance_count=instance_count,
    instance_type=instance_type,
    predictor_cls=Predictor
)

Above code snippet from this article returns None for predictor instead of the endpoint object.

To reproduce
A clear, step-by-step set of instructions to reproduce the bug.
The provided code need to be complete and runnable, if additional data is needed, please include them in the issue.

Expected behavior
A clear and concise description of what you expected to happen.

Endpoint object per the article linked above, that can be used to invoke and delete the endpoint.

Screenshots or logs
If applicable, add screenshots or logs to help explain your problem.

System information
A description of your system. Please provide:

  • SageMaker Python SDK version: 2.216.1
  • Framework name (eg. PyTorch) or algorithm (eg. KMeans): Not sure
  • Framework version: NA
  • Python version: 3.9.6
  • CPU or GPU: NA (using Sagemaker Jumpstart, instance_type="ml.m5.xlarge")
  • Custom Docker image (Y/N): N

Additional context
Add any other context about the problem here.

Trying to test with the following jumpstart model:
model_id, model_version = "huggingface-spc-bert-base-cased", "1.0.0"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant