=== NEW SERVERS ADDED (7) === - servers/closebot — 119 tools, 14 modules, 4,656 lines TS (Stage 7) - servers/google-console — Google Search Console MCP (Stage 7) - servers/meta-ads — Meta/Facebook Ads MCP (Stage 8) - servers/twilio — Twilio communications MCP (Stage 8) - servers/competitor-research — Competitive intel MCP (Stage 6) - servers/n8n-apps — n8n workflow MCP apps (Stage 6) - servers/reonomy — Commercial real estate MCP (Stage 1) === FACTORY INFRASTRUCTURE ADDED === - infra/factory-tools — mcp-jest, mcp-validator, mcp-add, MCP Inspector - 60 test configs, 702 auto-generated test cases - All 30 servers score 100/100 protocol compliance - infra/command-center — Pipeline state, operator playbook, dashboard config - infra/factory-reviews — Automated eval reports === DOCS ADDED === - docs/MCP-FACTORY.md — Factory overview - docs/reports/ — 5 pipeline evaluation reports - docs/research/ — Browser MCP research === RULES ESTABLISHED === - CONTRIBUTING.md — All MCP work MUST go in this repo - README.md — Full inventory of 37 servers + infra docs - .gitignore — Updated for Python venvs TOTAL: 37 MCP servers + full factory pipeline in one repo. This is now the single source of truth for all MCP work.
5.8 KiB
5.8 KiB
Changelog
All notable changes to the MCP Validator will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
[0.3.0] - 2025-01-21
Added
- OAuth 2.1 Authentication Framework: Complete implementation for 2025-06-18 protocol
- Bearer token extraction and validation from Authorization headers
- WWW-Authenticate headers for 401 responses with authentication challenges
- Resource server capabilities in reference HTTP server
- MCP-Protocol-Version header support for protocol negotiation
- CORS support, origin validation, and DNS rebinding attack prevention
- Environment variable configuration for OAuth settings
- GitHub Actions Templates: Production-ready CI/CD workflows
http-validation.ymlfor HTTP-based MCP serversstdio-validation.ymlfor STDIO-based MCP servers- Multi-protocol testing (2025-03-26 and 2025-06-18)
- OAuth 2.1 authentication testing support
- Automated PR comments with detailed compliance reports
- 3-step setup process with comprehensive documentation
- Enhanced Test Coverage: Achieved 70% coverage for 2025-06-18 protocol module
- 16 comprehensive test cases for 2025-06-18 features
- OAuth capability negotiation and token handling tests
- Structured tool output validation tests
- Batch request rejection tests
- Elicitation support framework tests
- End-to-end workflow testing from initialization to tool execution
- JSON Schema: Complete
mcp_schema_2025-06-18.jsonwith OAuth 2.1 requirements - Production-Ready Reference Server: Enhanced HTTP server with OAuth 2.1 resource server capabilities
Changed
- HTTP Transport: Major improvements for 2025-06-18 protocol
- Fixed session ID extraction from response body and URL parameters
- Added MCP-Protocol-Version header to all requests
- Improved URL construction for
/messagesendpoint - Enhanced error handling with structured responses
- Fixed initialization request format for 2025-06-18
- Protocol Adapters: Enhanced 2025-06-18 adapter with OAuth token handling
- CLI Tools: Updated all commands to default to 2025-06-18 protocol
- Documentation: Comprehensive updates with OAuth 2.1 setup and GitHub Actions guidance
Fixed
- Reference HTTP Server: Fixed undefined
servervariable (lines 617 and 676) - Session Management: Corrected session ID extraction and URL parameter handling
- Unit Tests: Resolved missing TransportError class causing test failures
- CLI Tests: Fixed protocol version expectations for 2025-06-18 default
- Transport Layer: Fixed initialization flow and notification handling
Security
- OAuth 2.1 Compliance: Full RFC 6749, RFC 6750, and OAuth 2.1 draft compliance
- Bearer Token Validation: Secure token extraction and validation
- Origin Validation: DNS rebinding attack prevention
- CORS Support: Proper cross-origin resource sharing configuration
[0.2.0] - 2025-01-11
Added
- MCP Protocol 2025-06-18 Support: Full implementation of the latest MCP specification
- Structured tool output with
contentarrays andstructuredContentfields - Elicitation support for server-initiated user interactions
- Enhanced error handling with structured error responses
- Tool schema improvements with
inputSchema,outputSchema, andtitlefields
- Structured tool output with
- JSON-RPC Batching Restrictions: Proper rejection of batch requests in 2025-06-18 protocol
- New Test Cases: 7 additional test cases specifically for 2025-06-18 features
test_structured_tool_output: Validates structured tool response formattest_elicitation_support: Tests elicitation capability frameworktest_no_batch_requests: Ensures batch requests are properly rejectedtest_enhanced_error_handling: Verifies improved error response structuretest_resource_lifecycle: Tests resource management improvementstest_tool_output_validation: Validates stricter tool output requirementstest_session_management: Tests enhanced session handling
- Enhanced Reference HTTP Server: Updated to support all three protocol versions (2024-11-05, 2025-03-26, 2025-06-18)
- Backward compatibility with older protocol versions
- Protocol-specific response formatting
- Dynamic feature detection based on negotiated protocol version
Changed
- Default Protocol Version: Updated default from 2025-03-26 to 2025-06-18 across all CLI tools
- Tool Response Format: Enhanced tool result structure for 2025-06-18 compatibility
- Error Response Structure: Improved error messages and categorization
- Test Coverage: Expanded test suite to cover new protocol features
- Documentation: Updated README with 2025-06-18 examples and feature descriptions
Backward Compatibility
- All existing protocol versions (2024-11-05, 2025-03-26) remain fully supported
- Automatic protocol version detection and handling
- Legacy tool response formats maintained for older protocols
[0.1.0] - 2023-07-15
Added
- Initial public release
- Support for testing MCP protocol versions 2024-11-05 and 2025-03-26
- Minimal reference implementation for STDIO transport
- Minimal reference implementation for HTTP transport
- Comprehensive test suite for protocol compliance
- Dynamic tool testing
- Timeout handling for problematic servers
- Detailed compliance reporting
- Support for pip-installed MCP servers
Changed
- Improved timeout handling for problematic servers
- Enhanced reporting format with more detailed diagnostics
- Streamlined test execution with better progress indicators
Fixed
- Properly handle servers that don't implement shutdown method
- Timeout gracefully for servers with tool list issues
- Correctly display status for skipped tests in reports