First-party app
Firecrawl

Firecrawl

Turn any web page or site into clean, LLM-ready markdown: scrape a single URL, crawl a whole site, map its URLs, search the web, or extract structured data with an AI prompt.

stable AI & Machine LearningDeveloper ToolsSearch

About

Firecrawl ships in the w6w first-party pack. It declares 10 actions, 2 health checks, and the host runs its code in a sandbox that never sees the credential.

App id
io.w6w.firecrawl
Version
0.1.0
Author
w6w
Licence
MIT
Categories
AI & Machine Learning · Developer Tools · Search

Overview

Firecrawl turns the messy web into clean input for an LLM. Point it at one URL and get back markdown with boilerplate stripped; point it at a whole site and it crawls every reachable page the same way; ask it to map a site and it returns the URL list without fetching content; ask it to search and it runs a web search and can scrape each result too; ask it to extract and an LLM turns a set of pages into the JSON shape you describe with a prompt or a schema.

Crawls and extractions are asynchronous jobs: starting one returns a job id immediately, and a separate action polls it until the pages are done. Scrape and search both work with no API key at all, on a rate-limited free tier — everything else needs a key.

Health checks track Firecrawl’s own status page (api.firecrawl.dev and firecrawl.dev, reported separately) and the team’s remaining credit balance, read from the same endpoint used to verify a connection is live.

Build with Firecrawl

Three routes to the same 10 actions. The Workflow tab is generated from Firecrawl's own manifest and carries its real ids, so it is copy-pasteable; the Code and CLI examples are the same call for any action on any app, so every app-specific value in them is a blank you fill in.

Start Batch Scrape

batch-scrape-start

Scrape an explicit list of URLs. Returns a job id immediately; poll its status.

Get Batch Scrape Status

batch-scrape-status-get

Poll a batch scrape job: status, progress, credits used, and scraped pages.

Cancel Crawl

crawl-cancel

Cancel a running crawl job.

Start Crawl

crawl-start

Start crawling a whole site. Returns a job id immediately; poll Get Crawl Status.

Get Crawl Status

crawl-status-get

Poll a crawl job: status, progress, credits used, and the pages scraped so far.

Start Extract

extract-start

Extract structured data from a set of pages using a prompt and/or a JSON Schema. Returns a job id immediately; poll Get Extract Status.

Get Extract Status

extract-status-get

Poll an extract job and get back the extracted structured data once completed.

Map Site URLs

map

List the URLs Firecrawl can find on a site, without fetching page content.

Scrape URL

scrape

Fetch a single URL and return clean markdown, ready to feed to an LLM.

Search the Web

search

Run a web search and get back results, optionally with each page's content.

A workflow step names the app and the action, and the editor fills in the connection when you pick one. This is the Step shape from the workflow spec, carrying Firecrawl's real ids.

{
  "manifestVersion": "2",
  "name": "firecrawl-example",
  "steps": [
    {
      "id": "batch-scrape-start",
      "uses": {
        "app": "io.w6w.firecrawl",
        "action": "batch-scrape-start",
        "connection": "conn_YOUR_CONNECTION_ID"
      },
      "with": {
        "urls": "<urls>"
      }
    }
  ]
}

Here are some of the things you can do

  • Start Batch Scrape

    perform
    batch-scrape-start
  • Get Batch Scrape Status

    read
    batch-scrape-status-get
  • Start Crawl

    perform
    crawl-start
  • Get Crawl Status

    read
    crawl-status-get
  • Start Extract

    perform
    extract-start

+5 more actions available

Every app-specific value here is a blank you have to fill in. An app action is reached through the connection that authenticates it, so the address is a connection id, not the app id — and connections belong to your account, so a public page cannot know yours. Create one for Firecrawl, then fill in the three blanks: conn_YOUR_CONNECTION_ID, the action key, and the parameters that action declares. The call itself is real — the shape is transcribed from the studio's own snippet builder, which prints the same kind of blanks — but nothing in it is specific to Firecrawl. The Workflow tab is where this app's real ids are.

Install
npm install @w6w/sdk
yarn add @w6w/sdk
pnpm add @w6w/sdk
deno add npm:@w6w/sdk
Code
import { W6wClient, isActionRun } from "@w6w/sdk";

// Reads W6W_BASE_URL and W6W_TOKEN from the environment when omitted.
const client = new W6wClient();

const envelope = await client.run({
  urn: "conn_YOUR_CONNECTION_ID",
  action: "batch-scrape-start",
  payload: {
    urls: "<value>",
    // maxConcurrency: "<value>",
    // formats: "<value>",
    // onlyMainContent: "<value>",
    // maxAge: "<value>",
    // waitFor: "<value>",
    // timeout: "<value>",
    // mobile: "<value>",
    // includeTags: "<value>",
    // excludeTags: "<value>",
    // removeBase64Images: "<value>",
    // blockAds: "<value>",
  },
});

if (isActionRun(envelope)) console.log(envelope.value);
Install the CLI
npm install -g @w6w/cli
CLI
w6w run conn_YOUR_CONNECTION_ID --action batch-scrape-start --payload '{"urls":"<value>"}'

Give an AI agent Firecrawl — without giving it Firecrawl's credentials. One MCP endpoint exposes every app, function and workflow the caller is entitled to, as tools it can discover and run. Access is granted per team while we onboard.

One tool call
{
  "name": "w6w_invoke",
  "arguments": {
    "ref": "app:io.w6w.firecrawl#batch-scrape-start",
    "input": {
      "urls": "<urls>"
    }
  }
}

Every tool names its target with a single ref. The app: form above doesn't name a connection at all — the host resolves which of the caller's Firecrawl connections to sign with, and refuses rather than guesses when the answer is ambiguous.

What the agent gets

Credentials it can't read

The token is attached host-side, at the moment of the call. It is never a tool argument, never in the model's context, and never in a transcript — so a prompt injection has nothing to exfiltrate.

A tool surface scoped to the caller

Tools are derived per end user from what that person has actually connected and is entitled to — not one shared bot identity carrying the union of everyone's access.

A durable workflow in one call

Multi-step work runs on the workflow engine and returns a run handle the agent can poll — retries, branching and state survive the conversation that started them.

Health-aware discovery

Firecrawl's declared health checks are on the surface too, so an agent can tell "the vendor is down" from "your credential expired" before it burns a retry on either.

The MCP surface is part of the hosted platform. Firecrawl itself is MIT, and the runtime that executes it is source-available (FSL).

Request MCP access

Health checks

Firecrawl declares its own checks, so its health is a property of the app rather than something the host guesses at.

service

Firecrawl platform status

Monitor status from status.firecrawl.dev (Better Stack): api.firecrawl.dev and firecrawl.dev, reported separately.

quota

Credit headroom

Remaining vs. plan credits, read from GET /team/credit-usage.