Skip to content

Conversation

@sreelekha-ira
Copy link

Added a section on validating TensorRT models before deployment, including an example command.

Thanks for submitting a PR to Triton!
Please go the the Preview tab above this description box and select the appropriate sub-template:

If you already created the PR, please replace this message with one of

and fill it out.

Added a section on validating TensorRT models before deployment, including an example command.
@sreelekha-ira
Copy link
Author

Summary

Adds a documentation section describing how to validate a TensorRT .plan model
using Model Navigator before deployment with Triton Inference Server.

This improves onboarding for new users and provides a minimal example for
verifying TensorRT plans with expected input shapes.

What this PR does

  • Adds a new subsection titled "Validating a TensorRT Model Before Deployment"
    under the relevant documentation page.
  • Provides a practical model-navigator validate command example.
  • Lists the key parts of the validation output to help users understand results.
  • Improves discoverability of TensorRT model validation workflows.

Motivation

Many Triton users ask how to verify their TensorRT models before packaging them
into a Triton model repository. This PR gives them a simple, copy-and-paste
example using Model Navigator.

Testing

  • Verified that the new Markdown section renders correctly using GitHub's preview.
  • Confirmed that the example command matches the current Model Navigator CLI.
  • Reviewed for formatting consistency with existing documentation.

Additional Notes

This is a pure documentation update. No code changes or functional updates are made.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant