First-party app
Mindee

Mindee

Extract structured data from documents with Mindee's OCR/AI models: enqueue extraction, classification, crop, OCR and split inferences, poll jobs, and read results.

stable AI & Machine LearningDocuments & Files

About

Mindee ships in the w6w first-party pack. It declares 16 actions, 2 health checks, and the host runs its code in a sandbox that never sees the credential.

App id
io.w6w.mindee
Version
0.1.0
Author
w6w
Licence
MIT
Categories
AI & Machine Learning · Documents & Files

Overview

Mindee turns documents into structured data. This app covers Mindee’s V2 Platform API (api-v2.mindee.net): the five inference products a custom Mindee model can run — Extraction (a data schema you define), Classification, Crop, OCR (raw text + word positions) and Split (breaking a multi-document file into ranges) — plus the polling and search surfaces every one of them shares.

Every inference is asynchronous: an enqueue action returns a Job immediately, and a workflow either polls Job Status until it reports Processed/Failed, or relies on a webhook configured on the model itself (Mindee’s V2 API has no webhook-management endpoint; webhooks are created on the Mindee Platform per model and referenced here only by ID). Once processed, the matching *-result-get action reads the structured output using the same ID the enqueue action returned.

Extraction also supports Retrieval-Augmented Generation: upload a reference document, annotate it, and Mindee uses it as context for later extractions against the same model. Model Search lists the models an API key’s organization owns, which is where a workflow gets the model ID every enqueue action needs.

Health checks track Mindee’s own status page, scoped specifically to the API V2 component this app calls, rather than the page’s page-level roll-up.

Build with Mindee

Three routes to the same 16 actions. The Workflow tab is generated from Mindee's own manifest and carries its real ids, so it is copy-pasteable; the Code and CLI examples are the same call for any action on any app, so every app-specific value in them is a blank you fill in.

Enqueue Classification

classification-enqueue

Send a document to a Classification model for asynchronous processing.

Get Classification Result

classification-result-get

Fetch the result of a completed Classification inference.

Enqueue Crop

crop-enqueue

Send a document to a Crop model for asynchronous processing.

Get Crop Result

crop-result-get

Fetch the result of a completed Crop inference.

Enqueue Extraction

extraction-enqueue

Send a document to an Extraction model for asynchronous processing.

Get Extraction Result

extraction-result-get

Fetch the result of a completed Extraction inference.

Get Job Status

job-status-get

Poll the status of an inference job enqueued by any product.

Search Models

model-search

List models belonging to the API key's organization.

Enqueue OCR

ocr-enqueue

Send a document to a Raw Text OCR model for asynchronous processing.

Get OCR Result

ocr-result-get

Fetch the result of a completed Raw Text OCR inference.

Get RAG Document

rag-document-get

Fetch metadata for one uploaded RAG document.

Search RAG Documents

rag-document-search

List RAG documents uploaded against a given Extraction model.

Update RAG Document

rag-document-update

Activate/deactivate a RAG document and/or set its annotation.

Upload RAG Document

rag-document-upload

Upload a reference document for RAG-assisted extraction against a model.

Enqueue Split

split-enqueue

Send a multi-document file to a Split model for asynchronous processing.

Get Split Result

split-result-get

Fetch the result of a completed Split inference.

A workflow step names the app and the action, and the editor fills in the connection when you pick one. This is the Step shape from the workflow spec, carrying Mindee's real ids.

{
  "manifestVersion": "2",
  "name": "mindee-example",
  "steps": [
    {
      "id": "classification-enqueue",
      "uses": {
        "app": "io.w6w.mindee",
        "action": "classification-enqueue",
        "connection": "conn_YOUR_CONNECTION_ID"
      },
      "with": {
        "modelId": "<modelId>"
      }
    }
  ]
}

Here are some of the things you can do

  • Enqueue Classification

    perform
    classification-enqueue
  • Get Classification Result

    read
    classification-result-get
  • Enqueue Crop

    perform
    crop-enqueue
  • Get Crop Result

    read
    crop-result-get
  • Enqueue Extraction

    perform
    extraction-enqueue

+11 more actions available

Every app-specific value here is a blank you have to fill in. An app action is reached through the connection that authenticates it, so the address is a connection id, not the app id — and connections belong to your account, so a public page cannot know yours. Create one for Mindee, then fill in the three blanks: conn_YOUR_CONNECTION_ID, the action key, and the parameters that action declares. The call itself is real — the shape is transcribed from the studio's own snippet builder, which prints the same kind of blanks — but nothing in it is specific to Mindee. The Workflow tab is where this app's real ids are.

Install
npm install @w6w/sdk
yarn add @w6w/sdk
pnpm add @w6w/sdk
deno add npm:@w6w/sdk
Code
import { W6wClient, isActionRun } from "@w6w/sdk";

// Reads W6W_BASE_URL and W6W_TOKEN from the environment when omitted.
const client = new W6wClient();

const envelope = await client.run({
  urn: "conn_YOUR_CONNECTION_ID",
  action: "classification-enqueue",
  payload: {
    modelId: "<value>",
    // file: "<value>",
    // url: "<value>",
    // fileName: "<value>",
    // fileMimeType: "<value>",
    // webhookIds: "<value>",
    // alias: "<value>",
  },
});

if (isActionRun(envelope)) console.log(envelope.value);
Install the CLI
npm install -g @w6w/cli
CLI
w6w run conn_YOUR_CONNECTION_ID --action classification-enqueue --payload '{"modelId":"<value>"}'

Give an AI agent Mindee — without giving it Mindee's credentials. One MCP endpoint exposes every app, function and workflow the caller is entitled to, as tools it can discover and run. Access is granted per team while we onboard.

One tool call
{
  "name": "w6w_invoke",
  "arguments": {
    "ref": "app:io.w6w.mindee#classification-enqueue",
    "input": {
      "modelId": "<modelId>"
    }
  }
}

Every tool names its target with a single ref. The app: form above doesn't name a connection at all — the host resolves which of the caller's Mindee connections to sign with, and refuses rather than guesses when the answer is ambiguous.

What the agent gets

Credentials it can't read

The token is attached host-side, at the moment of the call. It is never a tool argument, never in the model's context, and never in a transcript — so a prompt injection has nothing to exfiltrate.

A tool surface scoped to the caller

Tools are derived per end user from what that person has actually connected and is entitled to — not one shared bot identity carrying the union of everyone's access.

A durable workflow in one call

Multi-step work runs on the workflow engine and returns a run handle the agent can poll — retries, branching and state survive the conversation that started them.

Health-aware discovery

Mindee's declared health checks are on the surface too, so an agent can tell "the vendor is down" from "your credential expired" before it burns a retry on either.

The MCP surface is part of the hosted platform. Mindee itself is MIT, and the runtime that executes it is source-available (FSL).

Request MCP access

Health checks

Mindee declares its own checks, so its health is a property of the app rather than something the host guesses at.

service

Mindee API V2 status

Component status from status.mindee.com, scoped to the API V2 (api-v2.mindee.net) component this app calls — deliberately NOT the page-level indicator, which also covers the unrelated legacy V1 API/Platform and the app.mindee.com Platform UI.

quota

API request-rate headroom