=== NEW SERVERS ADDED (7) === - servers/closebot — 119 tools, 14 modules, 4,656 lines TS (Stage 7) - servers/google-console — Google Search Console MCP (Stage 7) - servers/meta-ads — Meta/Facebook Ads MCP (Stage 8) - servers/twilio — Twilio communications MCP (Stage 8) - servers/competitor-research — Competitive intel MCP (Stage 6) - servers/n8n-apps — n8n workflow MCP apps (Stage 6) - servers/reonomy — Commercial real estate MCP (Stage 1) === FACTORY INFRASTRUCTURE ADDED === - infra/factory-tools — mcp-jest, mcp-validator, mcp-add, MCP Inspector - 60 test configs, 702 auto-generated test cases - All 30 servers score 100/100 protocol compliance - infra/command-center — Pipeline state, operator playbook, dashboard config - infra/factory-reviews — Automated eval reports === DOCS ADDED === - docs/MCP-FACTORY.md — Factory overview - docs/reports/ — 5 pipeline evaluation reports - docs/research/ — Browser MCP research === RULES ESTABLISHED === - CONTRIBUTING.md — All MCP work MUST go in this repo - README.md — Full inventory of 37 servers + infra docs - .gitignore — Updated for Python venvs TOTAL: 37 MCP servers + full factory pipeline in one repo. This is now the single source of truth for all MCP work.
1.9 KiB
Copyright (c) 2025 Scott Wilcox
SPDX-License-Identifier: AGPL-3.0-or-later
MCP Testing Scripts
This directory contains utility scripts for testing MCP servers across different transports.
Scripts Overview
-
compliance_report.py: Generates detailed compliance reports for MCP servers, comparing their implementation against the protocol specification. Tests for MUST, SHOULD, and MAY requirements.
-
http_test.py: Command-line interface for running the HTTP testing module. Tests MCP servers that use HTTP as the transport layer.
-
run_stdio_tests.py: Command-line interface for running tests against STDIO-based MCP servers.
-
basic_interaction.py: Provides a simple interactive client for basic interaction with MCP servers. Useful for manual testing and exploration of server functionality.
Usage Examples
Compliance Report
# Generate a compliance report for a STDIO server
python -m mcp_testing.scripts.compliance_report --server-command "/path/to/server" --protocol-version 2025-03-26 --output-dir "./reports"
HTTP Testing
# Test an HTTP MCP server
python -m mcp_testing.scripts.http_test --server-url http://localhost:9000/mcp --debug
STDIO Testing
# Run tests against a STDIO MCP server
python -m mcp_testing.scripts.run_stdio_tests --server-command "python /path/to/server.py" --debug
Basic Interaction
# Interactively test a STDIO server
python -m mcp_testing.scripts.basic_interaction --server-command "python /path/to/server.py"
# Interactively test an HTTP server
python -m mcp_testing.scripts.basic_interaction --server-url http://localhost:9000/mcp
Extending the Scripts
These scripts can be extended to support:
- New protocol versions
- Additional transport layers
- More detailed testing requirements
- Custom reporting formats
See the main README for details on how to contribute new tests and extensions.