tgi optimum 0.0.18 (general+llm) by jinyoung-lim · Pull Request #4436 · aws/sagemaker-python-sdk

jinyoung-lim · 2024-02-19T18:51:36Z

https://github.com/awslabs/llm-hosting-container/blob/main/huggingface/pytorch/optimum/docker/0.0.18/Dockerfile

Issue #, if available:

Description of changes:

Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

mufaddal-rohawala · 2024-02-19T18:53:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: c3c56c6
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T18:53:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: c3c56c6
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T18:53:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: c3c56c6
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T19:51:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 3d750e1
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T19:55:01Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 3d750e1
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T20:28:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 3d750e1
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T20:30:54Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 3d750e1
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T20:55:16Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 3d750e1
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

codecov · 2024-02-19T20:56:25Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.10%. Comparing base (8b206ba) to head (d6e14ff).
Report is 42 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #4436      +/-   ##
==========================================
+ Coverage   86.94%   87.10%   +0.16%     
==========================================
  Files        1203      387     -816     
  Lines      107211    35808   -71403     
==========================================
- Hits        93211    31191   -62020     
+ Misses      14000     4617    -9383

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

mufaddal-rohawala · 2024-02-19T23:15:45Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ebfa454
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T23:18:08Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ebfa454
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T23:26:42Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ebfa454
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-19T23:40:43Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: ebfa454
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-20T01:08:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ac07b93
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-20T01:09:54Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ac07b93
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-20T01:27:38Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ac07b93
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-20T02:08:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: ac07b93
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-20T03:09:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: ac07b93
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-22T20:35:58Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: f9d53a0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-22T21:21:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: f9d53a0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-22T21:33:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f9d53a0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

jinyoung-lim · 2024-02-23T19:31:32Z

@knikure It seems like the pr test is failing for unrelated tests:

FAILED tests/integ/sagemaker/workflow/test_training_steps.py::test_tensorflow_training_step_with_parameterized_code_input[2.13.0-2.13.0]
FAILED tests/integ/sagemaker/workflow/test_triggers.py::test_pipeline_scheduler_using_training_step[2.13.0-2.13.0]
FAILED tests/integ/test_training_compiler.py::test_pytorch[1.13.1-ml.p3.2xlarge-1]

Could this PR be merged?

mufaddal-rohawala · 2024-02-23T20:28:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 7ba36b7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-23T20:28:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 7ba36b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-23T20:39:26Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 7ba36b7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-23T21:01:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 7ba36b7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-23T21:28:43Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 7ba36b7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-26T20:36:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 6dd7d59
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-26T20:38:20Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 6dd7d59
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-26T21:14:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 6dd7d59
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-26T21:41:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 6dd7d59
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-26T22:15:58Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 6dd7d59
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-27T03:52:11Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: d6e14ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-27T03:52:16Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: d6e14ff
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-27T04:22:28Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: d6e14ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-27T04:30:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: d6e14ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

mufaddal-rohawala · 2024-02-27T04:53:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: d6e14ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

* tgi optimum 0.0.18 * add test * update latest transformer version * add dlc optimum 0.0.18 config * 0.0 defaults to 0.0.16

tgi optimum 0.0.18

c3c56c6

jinyoung-lim requested a review from a team as a code owner February 19, 2024 18:51

jinyoung-lim requested review from mufaddal-rohawala and removed request for a team February 19, 2024 18:51

add test

3d750e1

Merge branch 'master' into tgi-optimum-0.0.18

ebfa454

update latest transformer version

ac07b93

knikure self-assigned this Feb 20, 2024

knikure added the do-not-merge Use when PR needs to be marked as do not merge label Feb 20, 2024

knikure self-requested a review February 20, 2024 16:14

add dlc optimum 0.0.18 config

a8dbcef

jinyoung-lim force-pushed the tgi-optimum-0.0.18 branch from 339f1af to a8dbcef Compare February 20, 2024 18:51

Merge branch 'master' into tgi-optimum-0.0.18

7ba36b7

jinyoung-lim added 2 commits February 26, 2024 11:39

Merge branch 'master' into tgi-optimum-0.0.18

ea78de6

Merge branch 'master' into tgi-optimum-0.0.18

6dd7d59

mohanasudhan approved these changes Feb 26, 2024

View reviewed changes

knikure approved these changes Feb 26, 2024

View reviewed changes

knikure removed the do-not-merge Use when PR needs to be marked as do not merge label Feb 26, 2024

Merge branch 'master' into tgi-optimum-0.0.18

d6e14ff

knikure merged commit 5a22f4d into aws:master Feb 27, 2024

bencrabtree pushed a commit to bencrabtree/sagemaker-python-sdk that referenced this pull request Feb 28, 2024

feat: TGI optimum 0.0.18 (general+llm) (aws#4436)

bdb8ff0

* tgi optimum 0.0.18 * add test * update latest transformer version * add dlc optimum 0.0.18 config * 0.0 defaults to 0.0.16

jiapinw pushed a commit to jiapinw/sagemaker-python-sdk that referenced this pull request Jun 25, 2024

feat: TGI optimum 0.0.18 (general+llm) (aws#4436)

3343186

* tgi optimum 0.0.18 * add test * update latest transformer version * add dlc optimum 0.0.18 config * 0.0 defaults to 0.0.16

Conversation

jinyoung-lim commented Feb 19, 2024

Merge Checklist

General

Tests

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

codecov bot commented Feb 19, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 19, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 20, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 20, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 20, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 20, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 20, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 22, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 22, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 22, 2024

AWS CodeBuild CI Report

Uh oh!

jinyoung-lim commented Feb 23, 2024

Uh oh!

mufaddal-rohawala commented Feb 23, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 23, 2024

AWS CodeBuild CI Report

Uh oh!

mufaddal-rohawala commented Feb 23, 2024

AWS CodeBuild CI Report

codecov bot commented Feb 19, 2024 •

edited

Loading