# Reported issues for mcp-probe

Pod holds 9 of 9 problems reported by people outside the maintainer team. Issues filed by the project's own owners, members and collaborators are excluded entirely — a maintainer's release checklist is not a warning to a prospective user.

Back to [mcp-probe](/mcp/mcp-probe).

## Most discussed

### [v1.1] Description-vs-runtime drift detection (heuristic pass)

## Context

Motivated by community feedback (Thomas Landgraf, dev.to, on "Schema descriptions are load-bearing"): descriptions can be technically **wrong**, not just missing — and that failure mode is harder to catch. Example: a parameter described as "ISO 8601 date string" that silently accepts Unix epoch milliseconds at runtime due to server-side coercion. The description is fluent, the JSON Schema is valid, the call succeeds — and the LLM eventually starts passing epochs because that's what a

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/12) · 2026-05-07 · open · 0 comments

### Benchmark mode with latency stats

Add \`mcp-doctor bench\` to measure performance, not just correctness.

### Metrics
- [ ] p50/p95/p99 latency per tool
- [ ] Concurrent tool calling (parallel requests)
- [ ] Memory usage of server process (if stdio)
- [ ] Throughput — tools per second
- [ ] \`--iterations N\` flag to run multiple times
- [ ] Compare against baseline (\`--baseline results.json\`)

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/8) · 2026-04-04 · closed · 0 comments

### MCP spec compliance checker

Go beyond basic health checks — verify the server follows the MCP specification correctly.

### Checks
- [ ] Server returns correct protocol version
- [ ] Capabilities match what's actually available
- [ ] Pagination works correctly (cursor handling)
- [ ] Error responses follow JSON-RPC 2.0 spec
- [ ] Content types match declared MIME types
- [ ] Tool annotations are consistent with behavior (e.g. readOnlyHint tools don't mutate)

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/7) · 2026-04-04 · closed · 0 comments

### HTML report output

Generate a shareable HTML report that looks professional.

### Tasks
- [ ] \`--html report.html\` flag
- [ ] Clean, dark-themed single-file HTML with inline CSS
- [ ] Collapsible sections for tools/resources/prompts
- [ ] Show full tool response content in expandable details
- [ ] Score card at top with color-coded pass/fail
- [ ] Shareable — no external dependencies

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/6) · 2026-04-04 · closed · 0 comments

### Watch mode for development

Add a \`mcp-doctor watch\` command that re-runs inspection whenever the server restarts or files change.

Useful during MCP server development — like \`vitest --watch\` but for your MCP server.

### Tasks
- [ ] Add \`watch\` command
- [ ] Re-run on file change (configurable glob)
- [ ] Clear terminal between runs
- [ ] Show diff from last run (what changed)

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/5) · 2026-04-04 · closed · 0 comments

### Publish to npm

Make \`npx mcp-doctor\` work globally by publishing to npm.

### Tasks
- [ ] Set up npm account/token
- [ ] Add \`prepublishOnly\` script to run build + test
- [ ] Add \`files\` field to package.json (only ship dist/)
- [ ] Publish v0.1.0
- [ ] Add install instructions to README

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/4) · 2026-04-04 · closed · 0 comments

### GitHub Actions CI workflow

Add a CI pipeline so contributors get instant feedback.

### Tasks
- [ ] Run \`npm test\` on push and PR
- [ ] Run \`tsc --noEmit\` type checking
- [ ] Test against \`@modelcontextprotocol/server-everything\` as integration test
- [ ] Add status badge to README

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/3) · 2026-04-04 · closed · 0 comments

### Smarter sample argument generation

The current sample arg generator is basic — it only fills required fields with type-appropriate defaults.

### Improvements
- [ ] Parse JSON Schema \`pattern\` to generate matching strings
- [ ] Support \`oneOf\` / \`anyOf\` schemas (pick first valid option)
- [ ] Support nested object schemas
- [ ] Support array items with \`minItems\`
- [ ] Allow user-provided arg overrides via \`--args tool_name='{"key": "value"}'\`
- [ ] Load sample args from a \`.mcp-doctor.json\` config file

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/2) · 2026-04-04 · closed · 0 comments

## Most recent

### Support SSE and Streamable HTTP transports

Currently mcp-doctor only supports stdio transport (spawning a local process). Many MCP servers run over:

- **SSE** (Server-Sent Events) — `mcp-doctor test --sse http://localhost:3000/sse`
- **Streamable HTTP** — `mcp-doctor test --http http://localhost:3000/mcp`

### Tasks
- [ ] Add `--sse <url>` flag
- [ ] Add `--http <url>` flag  
- [ ] Auto-detect transport from URL vs command string
- [ ] Test against a real SSE server

[Read the thread](https://github.com/Incultnitollc/mcp-probe/issues/1) · 2026-04-04 · closed · 0 comments

The remaining reports are on [the project's issue tracker](https://github.com/incultnitollc/mcp-probe/issues).