Skip to content

Bump torchserve from 0.1.1 to 0.8.2#1

Closed
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/torchserve-0.8.2
Closed

Bump torchserve from 0.1.1 to 0.8.2#1
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/torchserve-0.8.2

Conversation

@dependabot
Copy link
Copy Markdown

@dependabot dependabot Bot commented on behalf of github Oct 2, 2023

Bumps torchserve from 0.1.1 to 0.8.2.

Release notes

Sourced from torchserve's releases.

TorchServe v0.8.2 Release Notes

This is the release of TorchServe v0.8.2.

Security

Custom metrics backwards compatibility

  • add_metric is now backwards compatible with versions [< v0.6.1] but the default metric type is inferred to be COUNTER. If the metric is of a different type, it will need to be specified in the call to add_metric as follows: metrics.add_metric(name='GenericMetric', value=10, unit='count', dimensions=[...], metric_type=MetricTypes.GAUGE)
  • When upgrading from versions [v0.6.1 - v0.8.1] to v0.8.2, replace the call to add_metric with add_metric_to_cache.
  • All custom metrics updated in the custom handler will need to be included in the metrics configuration file for them to be emitted by Torchserve. This is shown here.
  • A detailed upgrade guide is included in the metrics documentation.

New Features

New Examples

  1. Example LLama v2 70B chat using HuggingFace Accelerate #2494 @​lxning @​HamidShojanazeri @​agunapal

  2. large model example OPT-6.7B on Inferentia2 #2399 @​namannandan

    • This example demonstrates how NeuronX compiles the model , detects neuron core availability and runs the inference.
  3. DeepSpeed deferred init with OPT-30B #2419 @​agunapal

    • This PR added feature deferred model init in OPT-30B example by leveraging DeepSpeed new version. This feature is able to significantly reduce model loading latency.
  4. Torch TensorRT example #2483 @​agunapal

    • This PR uses Resnet-50 as an example to demonstrate Torch TensorRT.
  5. K8S mnist example using minikube #2323 @​agunapal

    • This example shows how to use a pre-trained custom MNIST model to performing real time Digit recognition via K8S.
  6. Example for custom metrics #2516 @​namannandan

  7. Example for object detection with ultralytics YOLO v8 model #2508 @​agunapal

Improvements

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    You can disable automated security fix PRs for this repo from the Security Alerts page.

Bumps [torchserve](https://github.com/pytorch/serve) from 0.1.1 to 0.8.2.
- [Release notes](https://github.com/pytorch/serve/releases)
- [Changelog](https://github.com/pytorch/serve/blob/master/docker/build_upload_release.py)
- [Commits](pytorch/serve@v0.1.1...v0.8.2)

---
updated-dependencies:
- dependency-name: torchserve
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added the dependencies Pull requests that update a dependency file label Oct 2, 2023
@dependabot @github
Copy link
Copy Markdown
Author

dependabot Bot commented on behalf of github Nov 21, 2023

Superseded by #2.

@dependabot dependabot Bot closed this Nov 21, 2023
@dependabot dependabot Bot deleted the dependabot/pip/torchserve-0.8.2 branch November 21, 2023 01:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants