Skip to content

Latest commit

 

History

History
39 lines (31 loc) · 1.43 KB

File metadata and controls

39 lines (31 loc) · 1.43 KB

Write a Client Application {#ovms_docs_server_app}

---
maxdepth: 1
hidden:
---

Generative AI Use Cases <ovms_docs_clients_genai>
KServe API <ovms_docs_clients_kfs>
OpenVINO Model Server C-API <ovms_docs_c_api>

OpenVINO™ Model Server supports multiple APIs, for easy integration with systems using one of them for inference. The APIs are:

  • KServe API for inference
  • OpenAI API for text generation.
  • OpenAI API for embeddings
  • Cohere API for reranking

KServe API works on both gRPC and REST interfaces. The REST API endpoints for generative use cases support both streamed and unary responses.

Check the following articles to learn more about the supported APIs:

In this section you can find short code samples to interact with OpenVINO Model Server endpoints via: