Parameters
1 query
Query parameters
· 1domainstringRequiredDomain name to check.
Example
example.comFetches the current robots.txt for a domain and returns its version history. Each record represents a snapshot of the robots.txt content at a given time.
1 query
domainstringRequiredDomain name to check.
example.com1 status code documented
recordsobject[]RequiredVersion history of robots.txt snapshots (newest first).
idstringRequiredHashed version identifier.
contentstringRequiredRaw robots.txt content.
httpCodenumberRequiredHTTP status code when fetching robots.txt.
200404firstSeenDate | string | string | numberRequiredWhen this version was first observed.
When this version was first observed.
updatedDateDate | string | string | numberRequiredWhen this version was last confirmed.
When this version was last confirmed.
{
"records": [
{
"id": "example_id",
"content": "example_content",
"httpCode": 200
}
]
}GET /api/v1/vikitron/robots-txt-checker
curl -X GET "https://api.bizkithub.com/api/v1/vikitron/robots-txt-checker?domain=example.com" \
-H "Content-Type: application/json" \
-H "Authorization: Bearer YOUR_API_KEY"All BizKitHub public API endpoints require authentication via API key.