refresh configuration docs - #4414
Open
dtrawins wants to merge 1 commit into
Open
Conversation
mzegla
reviewed
Jul 29, 2026
| ``` | ||
|
|
||
| Traditional AI models perform data analysis in a single inference operation. They can be used over KServe API or TensorFlow API. | ||
| Classic models perform data analysis in a single inference operation. They can be served using the KServe API or TensorFlow API. |
Collaborator
There was a problem hiding this comment.
Suggested change
| Classic models perform data analysis in a single inference operation. They can be served using the KServe API or TensorFlow API. | |
| Classic models perform data analysis in a single inference operation. They can be served using the KServe API. |
| # OVMS Pull mode {#ovms_docs_pull} | ||
|
|
||
| This document describes how to leverage OpenVINO Model Server (OVMS) pull feature to automate deployment configuration with Generative AI models. When pulling from [Hugging Face Hub](https://huggingface.co/) or when pulling GGUF model, no additional steps are required. However, when pulling models in Pytorch format, you have to install additional python dependencies when using baremetal execution so that optimum-cli is available for ovms executable or rely on the docker image `openvino/model_server:latest-py`. In summary you have 3 options: | ||
| This document describes how to use the OpenVINO Model Server (OVMS) pull feature to automate deployment configuration for Generative AI models. When pulling models from [Hugging Face Hub](https://huggingface.co/) in IR or GGUF format, no additional setup is required. However, when pulling models in PyTorch format, you need additional Python dependencies on a bare-metal host so that `optimum-cli` is available to the OVMS executable, or you can use the `openvino/model_server:latest-py` Docker image. In summary, you have three options: |
Collaborator
There was a problem hiding this comment.
Are we ensuring latest-py tag being up to date? In the last release we did not push latest-py.
Last -py image release was for 2026.1.
| ``` | ||
|
|
||
| > **Note:** These models aren't tested properly and their accuracy or performance may be low. | ||
| > **Note:** These models are tested by OpenVINO team, and their accuracy or performance is not guaranteed. |
Collaborator
There was a problem hiding this comment.
Is that intentional? That would mean that models provided and tested by OV do not come with guaranteed quality. Shouldn't it be are not tested?
| ``` | ||
|
|
||
| *Note:* Use relative or absolute paths. `config_path` is relative to the current folder. `model_path` is relative to the config file. With `model_repository_path`, `model_name` represents a folder relative to model repository path. | ||
| > **Note:** Use relative or absolute paths. `config_path` is relative to the current folder. `model_path` is relative to the config file. With `model_repository_path`, `model_name` represents a folder relative to the model repository path. |
Collaborator
There was a problem hiding this comment.
For model_path I guess it depends if we talk about model path in config.json, or model_path in a single model mode provided from the CLI right? But I guess it's fine if in that section we are talking about add_to_config case.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🛠 Summary
JIRA/Issue if applicable.
Describe the changes.
🧪 Checklist
``