Bots St

bots.st/rubrkit

rubrkit

Create and manage evaluation rubrics

1924 ms

answered our call

State
Answered
Protocol
MCP 2025-06-18
Tools listed
41
Answered
3 of the last 3 calls

How to reach it

  • MCP, HTTPhttps://www.rubrkit.com/api/v1/mcp

What it can do

ToolWhat it says it does
rubrkit_add_golden_caseAdd a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys.
rubrkit_apply_audit_rewriteApply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.
rubrkit_apply_deep_compactionSave a succeeded deep compaction job's verified result as a new version of the file. Refused if the file changed since the job started. Requires files:write for API keys.
rubrkit_compact_artifact_fileShorten a markdown or text prompt without losing instructions. mode standard (default) is a free deterministic pass that saves a new version unless dryRun is true; requires files:write for API keys. mode deep starts an AI compaction job that uses credits, verifies every instruction was kept, and…
rubrkit_create_artifact_bundleCreate an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.
rubrkit_create_drift_monitorCreate a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.
rubrkit_delete_artifact_bundleArchive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.
rubrkit_estimate_deep_compactionEstimate the credit cost of a deep compaction of one file before starting it. Requires compactions:run for API keys.
rubrkit_export_proof_reportStart an async proof report job with export storage enabled by default. Requires evals:run for API keys.
rubrkit_hard_delete_artifact_bundlePermanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys.
rubrkit_list_artifact_bundle_versionsList bundle-level version events. Requires artifact_bundles:read for API keys.
rubrkit_list_artifact_bundlesList artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.
rubrkit_list_artifact_filesList files in an artifact bundle. Requires files:read for API keys.
rubrkit_list_auditsList persisted audit history. Requires artifact_bundles:read for API keys.
rubrkit_list_drift_monitorsList the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_list_evalsList eval history. Requires artifact_bundles:read for API keys.
rubrkit_list_file_versionsList immutable versions for a file. Requires files:read for API keys.
rubrkit_list_golden_casesList the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_list_job_eventsRead append-only job progress events. Requires jobs:read for API keys.
rubrkit_poll_jobRead async job progress. Requires jobs:read for API keys.
rubrkit_read_api_docRead a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.
rubrkit_read_artifact_bundleRead artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.
rubrkit_read_artifact_fileRead the latest file metadata and content. Requires files:read for API keys.
rubrkit_read_auditRead a single audit run. Requires artifact_bundles:read for API keys.
rubrkit_read_drift_observationsList the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_read_evalRead one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.
rubrkit_read_input_driftCompare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_read_openapi_contractRead the canonical docs/api/openapi.yaml contract.
rubrkit_read_proof_reportRead one proof report. Requires artifact_bundles:read for API keys.
rubrkit_read_validity_driftCorrelate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_record_outcomeRecord a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys.
rubrkit_restore_artifact_bundle_versionRestore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.
rubrkit_restore_file_versionRestore a prior file version by creating a new version. Requires files:write for API keys.
rubrkit_retire_golden_caseRetire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.
rubrkit_run_drift_checkQueue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys.
rubrkit_run_evalsStart an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).
rubrkit_search_api_docsSearch the canonical docs/api Markdown guides and OpenAPI operation summaries.
rubrkit_set_drift_monitor_statusPause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.
rubrkit_start_auditStart an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.
rubrkit_update_artifact_fileWrite a new editable version for a file. Requires files:write for API keys.
rubrkit_upload_artifact_filesUpload one or more text files into an artifact bundle. Requires files:write for API keys.

In its maker's words

MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.

Website
www.rubrkit.com
Source
github.com/liberat0r/react-rubrkit
Publisher
rubrkit.com
Listed from
the official MCP Registry as com.rubrkit/rubrkit
Version
1.0.0, updated 29 Jun 2026
Kinds of work
AI models and agent tools, Data and databases, Documents and files

The domain it lives on

rubrkit.com
registered 9 Jun 2026 (5 months ago), at Porkbun LLC, its home page is a working site

From our own crawl of domain names: registry records and the home page as our crawler last saw it.

Every call we made

WhenWhat happenedTime
Answered1924 ms
Answered1797 ms
Answered1025 ms

Next door

Is this your bot? Claim its address to add a verified badge and keep the listing current.