Noindex Checker for Crawled Websites

Find pages in a completed OnPage crawl that are blocked from indexing by robots.txt, HTTP headers, or meta robots directives. This Tool reads crawl findings; it does not start a crawl or tell you whether Google has already indexed a page.

Your AI

Use with your AI

For tasks with several steps, continue in the AI you already use.

CodexClaude CodeCursorWindsurfCline

View instructions

Load https://toolmu.com/SKILL.md. The user supplies one website URL only; never ask for a crawl ID, filters, or a page count. Before starting a website scan, check the scan Tool availability, current price ceiling, balance, and budget; explain the separate scan charge before calling it. Use onpage-task-post-dataforseo with the supplied website URL and its fixed 10-page limit. Take the task ID from that scan result and pass it only between Tools. Wait until the scan is complete before calling this Tool with request.id set to the returned task ID, request.limit set to 10, and request.filters set to [["reason","<>","indexable"]]. If the scan is still running or no reliable completion check is available, explain that it is not ready and do not ask the user to copy technical details. Describe results as scan-time findings, not proof of Google’s current index status.

Task:
Check [website URL] and list up to 10 pages that may not appear in Google search, with a simple reason for each. The website scan may cost extra.

Paste into your connected AI's conversation.

Connection guide

Up to 0.01 credits / call

The final charge is based on confirmed usage. Unused reserved credits return to your available balance.

DataForSEO

Noindex Checker for Crawled Websites

Find pages in a completed OnPage crawl that are blocked from indexing by robots.txt, HTTP headers, or meta robots directives. This Tool reads crawl findings; it does not start a crawl or tell you whether Google has already indexed a page.

You receive

Lists up to 10 pages reported as blocked from search during a website scan, with the recorded reason for each. The scan does not confirm whether Google currently includes a page in its results.

Start with your task

Check [website URL] and list up to 10 pages that may not appear in Google search, with a simple reason for each. The website scan may cost extra.

Inputs & outputs

Inspect the current inputs, availability, and maximum charge before starting.

Input schema

Input schema
Field / Path	Type	Requirement	Meaning
request`request`	`object`	Required	Required fields `id, filters, limit`
id`request.id`	`string`	Required	Minimum length `1` Maximum length `256`
limit`request.limit`	`integer`	Required	Fixed value `10`
filters`request.filters`	`array`	Required	Minimum items `1` Maximum items `3`
[]`request.filters[]`	`array \| string`	—
[]`request.filters[][]`anyOf · 1	`string`	—	Minimum length `1` Maximum length `256`

View raw JSON

{
  "type": "object",
  "required": [
    "request"
  ],
  "properties": {
    "request": {
      "type": "object",
      "required": [
        "id",
        "filters",
        "limit"
      ],
      "properties": {
        "id": {
          "type": "string",
          "maxLength": 256,
          "minLength": 1
        },
        "limit": {
          "type": "integer",
          "const": 10
        },
        "filters": {
          "type": "array",
          "items": {
            "anyOf": [
              {
                "type": "array",
                "items": {
                  "type": "string",
                  "maxLength": 256,
                  "minLength": 1
                },
                "maxItems": 3,
                "minItems": 1
              },
              {
                "type": "string",
                "maxLength": 256,
                "minLength": 1
              }
            ]
          },
          "maxItems": 3,
          "minItems": 1
        }
      },
      "additionalProperties": false
    }
  },
  "additionalProperties": false
}

Result schema

Output fields have not been documented yet.

Additional notes

Find pages in a completed OnPage crawl that are blocked from indexing by robots.txt, HTTP headers, or meta robots directives. This Tool reads crawl findings; it does not start a crawl or tell you whether Google has already indexed a page.