Diffbot

A workflow step names the app and the action, and the editor fills in the connection when you pick one. This is the Step shape from the workflow spec, carrying Diffbot's real ids.

{
  "manifestVersion": "2",
  "name": "diffbot-example",
  "steps": [
    {
      "id": "crawl-create",
      "uses": {
        "app": "io.w6w.diffbot",
        "action": "crawl-create",
        "connection": "conn_YOUR_CONNECTION_ID"
      },
      "with": {
        "name": "<name>",
        "seeds": "<seeds>",
        "apiUrl": "<apiUrl>"
      }
    }
  ]
}

Here are some of the things you can do

• Create Crawl Job

  perform
  crawl-create

• Get Account Usage

  read
  account-get

• Get Crawl Data

  read
  crawl-data-get

• Get Crawl Job Status

  read
  crawl-get

• Pause / Resume / Restart Crawl

  perform
  crawl-update

+15 more actions available

Every app-specific value here is a blank you have to fill in. An app action is reached through the connection that authenticates it, so the address is a connection id, not the app id — and connections belong to your account, so a public page cannot know yours. Create one for Diffbot, then fill in the three blanks: conn_YOUR_CONNECTION_ID, the action key, and the parameters that action declares. The call itself is real — the shape is transcribed from the studio's own snippet builder, which prints the same kind of blanks — but nothing in it is specific to Diffbot. The Workflow tab is where this app's real ids are.

npm install @w6w/sdk

yarn add @w6w/sdk

pnpm add @w6w/sdk

deno add npm:@w6w/sdk

import { W6wClient, isActionRun } from "@w6w/sdk";

// Reads W6W_BASE_URL and W6W_TOKEN from the environment when omitted.
const client = new W6wClient();

const envelope = await client.run({
  urn: "conn_YOUR_CONNECTION_ID",
  action: "crawl-create",
  payload: {
    name: "<value>",
    seeds: "<value>",
    apiUrl: "<value>",
    // maxToCrawl: "<value>",
    // maxToProcess: "<value>",
    // maxHops: "<value>",
    // urlCrawlPattern: "<value>",
    // urlProcessPattern: "<value>",
    // pageProcessPattern: "<value>",
    // obeyRobots: "<value>",
    // useProxies: "<value>",
    // notifyEmail: "<value>",
    // notifyWebhook: "<value>",
    // repeat: "<value>",
  },
});

if (isActionRun(envelope)) console.log(envelope.value);

npm install -g @w6w/cli

w6w run conn_YOUR_CONNECTION_ID --action crawl-create --payload '{"name":"<value>","seeds":"<value>","apiUrl":"<value>"}'

Give an AI agent Diffbot — without giving it Diffbot's credentials. One MCP endpoint exposes every app, function and workflow the caller is entitled to, as tools it can discover and run. Access is granted per team while we onboard.

{
  "name": "w6w_invoke",
  "arguments": {
    "ref": "app:io.w6w.diffbot#crawl-create",
    "input": {
      "name": "<name>",
      "seeds": "<seeds>",
      "apiUrl": "<apiUrl>"
    }
  }
}

Every tool names its target with a single ref. The app: form above doesn't name a connection at all — the host resolves which of the caller's Diffbot connections to sign with, and refuses rather than guesses when the answer is ambiguous.

What the agent gets

The MCP surface is part of the hosted platform. Diffbot itself is MIT, and the runtime that executes it is source-available (FSL).

Request MCP access