/api/v1/vikitron/robots-txt-checker

Fetches the current robots.txt for a domain and returns its version history. Each record represents a snapshot of the robots.txt content at a given time.

Endpoint Info

Base URLapi.bizkithub.com

AuthBearer Token

Methods1

Authentication Required

This endpoint requires a valid API key passed as a query parameter or Bearer token.

Get your API key

Parameters

1 query parameter

domainstringrequired

Domain name to check.

Example Request

JavaScript fetch

const response = await fetch("https://api.bizkithub.com/api/v1/vikitron/robots-txt-checker?domain=example.com", {
  method: "GET",
  headers: {
    "Content-Type": "application/json"
  }
});

const data = await response.json();
console.log(data);

get

Example Response

200Success

{
  "records": [
    {
      "id": "example_id",
      "content": "example_content",
      "httpCode": 200
    }
  ]
}

cURL

Command line example

curl -X GET "https://api.bizkithub.com/api/v1/vikitron/robots-txt-checker?domain=example.com" \
  -H "Content-Type: application/json"

Need an API key?

All BizKitHub API endpoints require authentication via API key.

Get API Key

Back to API Documentation API Reference