Browse Docs GitHub

Previewof vllm-project/vllm#62585 at 1342f76.

Providers

Unlimited-OCR ERNIE-4.5-21B-A3B-PT ERNIE-4.5-VL-28B-A3B-PT

Black Forest Labs

Seed (ByteDance)

LongCat (Meituan)

MindLab Research

MiniCPM (OpenBMB)

InternVL (OpenGVLab)

Preferred Networks

Hunyuan (Tencent)

Thinking Machines Lab

vLLM Semantic Router

Ernie (Baidu)

baidu·3 recipesHuggingFace

Multimodal

2

ERNIE-4.5-VL-28B-A3B-PT

BF1667GBF161120GFP8640G

Text

1

ERNIE-4.5-21B-A3B-PT

BF16106GBF16640G

GitHub Request a recipe Documentation Supported Models & Hardware Install vLLM JSON API