Reported issues for mcp-probe
Pod holds 9 of 9 problems reported by people outside the maintainer team. Issues filed by the project's own owners, members and collaborators are excluded entirely — a maintainer's release checklist is not a warning to a prospective user.
Back to mcp-probe.
Most discussed
[v1.1] Description-vs-runtime drift detection (heuristic pass)
Context
Motivated by community feedback (Thomas Landgraf, dev.to, on "Schema descriptions are load-bearing"): descriptions can be technically wrong, not just missing — and that failure mode is harder to catch. Example: a parameter described as "ISO 8601 date string" that silently accepts Unix epoch milliseconds at runtime due to server-side coercion. The description is fluent, the JSON Schema is valid, the call succeeds — and the LLM eventually starts passing epochs because that's what a
Read the thread · 2026-05-07 · open · 0 comments
Benchmark mode with latency stats
Add `mcp-doctor bench` to measure performance, not just correctness.
Metrics
- p50/p95/p99 latency per tool
- Concurrent tool calling (parallel requests)
- Memory usage of server process (if stdio)
- Throughput — tools per second
- `--iterations N` flag to run multiple times
- Compare against baseline (`--baseline results.json`)
Read the thread · 2026-04-04 · closed · 0 comments
MCP spec compliance checker
Go beyond basic health checks — verify the server follows the MCP specification correctly.
Checks
- Server returns correct protocol version
- Capabilities match what's actually available
- Pagination works correctly (cursor handling)
- Error responses follow JSON-RPC 2.0 spec
- Content types match declared MIME types
- Tool annotations are consistent with behavior (e.g. readOnlyHint tools don't mutate)
Read the thread · 2026-04-04 · closed · 0 comments
HTML report output
Generate a shareable HTML report that looks professional.
Tasks
- `--html report.html` flag
- Clean, dark-themed single-file HTML with inline CSS
- Collapsible sections for tools/resources/prompts
- Show full tool response content in expandable details
- Score card at top with color-coded pass/fail
- Shareable — no external dependencies
Read the thread · 2026-04-04 · closed · 0 comments
Watch mode for development
Add a `mcp-doctor watch` command that re-runs inspection whenever the server restarts or files change.
Useful during MCP server development — like `vitest --watch` but for your MCP server.
Tasks
- Add `watch` command
- Re-run on file change (configurable glob)
- Clear terminal between runs
- Show diff from last run (what changed)
Read the thread · 2026-04-04 · closed · 0 comments
Publish to npm
Make `npx mcp-doctor` work globally by publishing to npm.
Tasks
- Set up npm account/token
- Add `prepublishOnly` script to run build + test
- Add `files` field to package.json (only ship dist/)
- Publish v0.1.0
- Add install instructions to README
Read the thread · 2026-04-04 · closed · 0 comments
GitHub Actions CI workflow
Add a CI pipeline so contributors get instant feedback.
Tasks
- Run `npm test` on push and PR
- Run `tsc --noEmit` type checking
- Test against `@modelcontextprotocol/server-everything` as integration test
- Add status badge to README
Read the thread · 2026-04-04 · closed · 0 comments
Smarter sample argument generation
The current sample arg generator is basic — it only fills required fields with type-appropriate defaults.
Improvements
- Parse JSON Schema `pattern` to generate matching strings
- Support `oneOf` / `anyOf` schemas (pick first valid option)
- Support nested object schemas
- Support array items with `minItems`
- Allow user-provided arg overrides via `--args tool_name='{"key": "value"}'`
- Load sample args from a `.mcp-doctor.json` config file
Read the thread · 2026-04-04 · closed · 0 comments
Most recent
Support SSE and Streamable HTTP transports
Currently mcp-doctor only supports stdio transport (spawning a local process). Many MCP servers run over:
- SSE (Server-Sent Events) —
mcp-doctor test --sse http://localhost:3000/sse - Streamable HTTP —
mcp-doctor test --http http://localhost:3000/mcp
Tasks
- Add
--sse <url>flag - Add
--http <url>flag - Auto-detect transport from URL vs command string
- Test against a real SSE server
Read the thread · 2026-04-04 · closed · 0 comments
The remaining reports are on the project's issue tracker.