Scrape Webpage

Scrape Webpage — see the properties below.

This node is also exposed as an AI Agent tool.

This node has 1 input port and 1 output port.

Common Properties

Every node shares these.

Name — the node's display name on the canvas.
Color — the node's colour on the canvas.
Delay Before (sec) — wait this long before the node runs.
Delay After (sec) — wait this long after the node runs.
Continue On Error — carry on instead of failing the flow. Defaults to false.

info

When Continue On Error is true the error is not raised at all, so a Catch node will not see it either.

Property	Field	Description
Client ID	`inClientID`	Client ID from Connect node (optional if credentials provided)
URL	`inURL`	URL of the webpage to scrape

Property	Field	Description
Markdown Content	`outMarkdown`	Markdown-formatted content (if Include Markdown is enabled)
Result	`outResult`	Complete scrape response including text，markdown，and metadata
Text Content	`outText`	Plain text content of the webpage

Property	Field	Description
Credentials	`optCredentials`	Serper API key
Include Markdown	`optIncludeMarkdown`	Include markdown-formatted content in the response
Timeout (seconds)	`optTimeout`	Maximum time in seconds to wait

A Client ID from this package's Connect node, unless you set credentials directly on this node.
Serper API Key — API key for Serper Google Search API
- value — API Key (password, required). Your Serper API key from serper.dev dashboard

Store these in a Vault and reference the vault item from the node, rather than typing the secret into the property.