Type identifier:
ai:llm:chatMessageCategory: AI Operations
The AI - Chat Message node enables conversations with large language models (LLMs) from multiple providers including OpenAI, Anthropic, Google AI, and Groq. It supports dynamic message templates with variable interpolation, streaming responses, extended thinking, and AI actions (tool use).
For exact supported model identifiers and provider-specific capability differences, use AI - Model Reference.
Handle | Type | Description |
|---|---|---|
| control | Triggers the LLM request. |
| string | (Dynamic mode) Runtime model name input. |
| varies | Dynamic handles for each defined variable. |
Handle | Type | Description |
|---|---|---|
|
| The AI-generated response text. |
| async iterable | (Streaming mode) Real-time response stream. |
|
| (Extended thinking) The AI's thinking process. |
| control | Handles for each defined action. |
| control | Triggered when the response is complete. |
Option | Type | Default | Description |
|---|---|---|---|
Model | enum or dynamic string handle |
| The LLM model to use, literal or runtime input. |
When Model is set to dynamic, the node exposes a model input handle and resolves the model name at runtime.
If the runtime model string is not in the supported model list, the node fails with a clear configuration error.
Available models are listed by provider (OpenAI, Anthropic, Google AI, and Groq) in AI - Model Reference — Chat Message Models. Deprecated model names and their replacements are in AI - Model Reference — Deprecated Models and Fallbacks.
Parameter | Type | Description |
|---|---|---|
Temperature |
| Randomness in responses (0-2). |
Top K |
| Limit token selection to top K candidates. |
Top P |
| Nucleus sampling probability. |
Max Tokens |
| Maximum response length. |
Stop Sequences |
| Sequences that stop generation. |
Note: Sampling parameters (Temperature, Top K, Top P) are not configurable for adaptive-thinking Claude models (
claude-fable-5-1,claude-fable-5,claude-opus-5-5,claude-opus-5,claude-sonnet-5,claude-opus-4-8,claude-opus-4-7) and OpenAI non-chat/reasoning models (gpt-6-astra,gpt-6-sol,gpt-6-luna,gpt-5.6-sol,gpt-5.6-terra,gpt-5.6-luna,gpt-5.5,gpt-5.4,gpt-5.4-mini,gpt-5.4-nano,gpt-5.1,gpt-5-2025-08-07,gpt-5-mini-2025-08-07,gpt-5-nano-2025-08-07).
Option | Type | Default | Description |
|---|---|---|---|
Parse to Content |
|
| Parse Markdown response as Content. |
Stream Response |
|
| Enable streaming response mode. |
For supported models:
Option | Type | Description |
|---|---|---|
Enabled |
| Enable extended thinking mode. |
Tokens Budget |
| Maximum tokens for thinking. |
Adaptive thinking models such as claude-fable-5-1, claude-fable-5, claude-opus-5-5, claude-opus-5, claude-sonnet-5, claude-opus-4-8, and claude-opus-4-7 do not use the Tokens Budget option. Other supported Anthropic models use the configured Tokens Budget.
Option | Type | Description |
|---|---|---|
Max Turns |
| Maximum conversation turns for auto-continuation. |
Array of variables that can be used in message templates. Each variable creates a dynamic input handle.
Array of message templates defining the conversation:
Field | Type | Description |
|---|---|---|
Type |
| Message role. |
Message Template |
| Template with variable placeholders. |
Cached |
| Enable prompt caching (Anthropic). |
Repeating messages support:
Field | Type | Description |
|---|---|---|
Name |
| Action name for the AI to call. |
Description |
| Description of what the action does. |
Input Schema | schema | Expected input structure. |
Force Use |
| Force the AI to use this action. |
Continue With Result |
| Auto-continue after action result. |
If actions are defined and invoked:
doneVariables in templates are replaced with actual values:
Feature | OpenAI | Anthropic | Groq | |
|---|---|---|---|---|
Streaming | ✓ | ✓ | ✓ | ✓ |
Vision | ✓ | ✓ | ✓ | ✓ |
Audio | ✓ | - | - | ✓ |
Thinking | - | ✓ | - | - |
Caching | - | ✓ | - | - |
Configuration:
QuestionMessages:
{Question}Configuration:
Actions:
Configuration:
Use stream output with Stream - Collect to process incrementally.