Docs
LLM Backends

OpenAI (and OpenAI-compatible backends)

  • OpenAITextCompletion
  • OpenAIChatCompletion - vision supported

Use with custom backends via the base_url control on the nodes.

Text Generation WebUI (oobabooga)

  • TextGenWebUICompletion
  • TextGenWebUIEmbeddings

LM Studio

  • LMStudioCompletion
  • LMStudioChatCompletion - vision supported
  • LMStudioEmbeddings

Ollama

  • OllamaTextCompletion - vision supported
  • OllamaChatCompletion - vision supported
  • OllamaEmbeddings

Other backends

  • MakeJSONRequest - for making requests to any JSON API - you can use any external service with this node

More native nodes are coming soon...