76 lines
4.6 KiB
JSON
76 lines
4.6 KiB
JSON
{
|
|
"evaluator": "MCP Pipeline Evaluator Agent 2",
|
|
"timestamp": "2026-02-05T09:15:00-05:00",
|
|
"evaluations": [
|
|
{
|
|
"mcp": "GoHighLevel-MCP",
|
|
"stage": 9,
|
|
"evidence": "PRODUCTION READY. Compiles cleanly (tsc + React UI build). 38+ tool files covering entire GHL API (contacts, conversations, calendar, campaigns, invoices, etc.). MCP Apps implemented (JSON render + React app). Tests exist and PASS (jest suite with 30+ passing tests for blog-tools alone). Comprehensive README with setup instructions, use cases, tool combos. Already has .env.example with clear API key setup. Built dist/ directory exists. This is the most mature GHL MCP.",
|
|
"blockers": [],
|
|
"next_action": "Deploy to npm registry as stable release. This is already production-grade."
|
|
},
|
|
{
|
|
"mcp": "ghl-mcp-apps-only",
|
|
"stage": 7,
|
|
"evidence": "HAS APPS. Compiles cleanly. src/apps/index.ts exists (26KB file). UI infrastructure present. BUT: Zero tools defined (tools: {} in server.ts). No tests. No README. No documentation. API key setup exists (.env.example). This is literally what it says - apps only, no tools.",
|
|
"blockers": [
|
|
"No tools implemented - just apps",
|
|
"No tests",
|
|
"No documentation",
|
|
"Limited utility without tools"
|
|
],
|
|
"next_action": "Either add tools (merge from GoHighLevel-MCP) or document this as an 'apps-only reference implementation' for building UIs. Current state is a demo, not a usable server."
|
|
},
|
|
{
|
|
"mcp": "ghl-mcp-public",
|
|
"stage": 3,
|
|
"evidence": "SCAFFOLDED BUT BROKEN. Has 40 tool files, tests directory, good README, API setup. BUT: Does NOT compile - 'error TS2688: Cannot find type definition file for jest'. Missing @types/jest in package.json. Tools are copied from the main repo but can't be built. Tests exist but can't run. No MCP Apps. No dist/ directory.",
|
|
"blockers": [
|
|
"Build fails - missing @types/jest",
|
|
"Can't generate dist/ output",
|
|
"Tests can't run",
|
|
"No MCP Apps",
|
|
"Needs npm install --save-dev @types/jest"
|
|
],
|
|
"next_action": "Fix build: Add '@types/jest' to devDependencies. Run npm install. Verify tsc compiles. Run tests. Then re-evaluate - might jump to Stage 5-6 after fixes."
|
|
},
|
|
{
|
|
"mcp": "GHL-MCP-Funnel",
|
|
"stage": 1,
|
|
"evidence": "CONCEPT ONLY. This is NOT an MCP server - it's a landing page (index.html). README explicitly says 'Landing page for the GoHighLevel MCP hosted service.' Single HTML file with Tailwind CSS, no package.json, no TypeScript, no server code. Marketing material for the actual GoHighLevel-MCP project.",
|
|
"blockers": [
|
|
"Not an MCP server - just HTML marketing",
|
|
"No code, no tools, no infrastructure",
|
|
"Wrong category - this is a website, not a server"
|
|
],
|
|
"next_action": "Move to /marketing or /docs folder. This doesn't belong in the MCP evaluation pipeline. It's documentation, not code."
|
|
},
|
|
{
|
|
"mcp": "google-ads-mcp",
|
|
"stage": 8,
|
|
"evidence": "INTEGRATION READY. Compiles cleanly with tsup (generates clean dist/). 49 tools across 10 files (accounts, campaigns, ad-groups, ads, keywords, reporting, bidding, conversions, advanced). 7 MCP Apps implemented and built (campaign-dashboard, performance-overview, keyword-analyzer, etc.). UI dist/ exists with compiled app-ui. Excellent README with setup, tool annotations, safety guardrails. Missing: tests. But code is clean, organized, and ready to connect to real Google Ads API. Just needs OAuth setup.",
|
|
"blockers": [
|
|
"No tests (but tools are well-structured)",
|
|
"Needs user to obtain Google Ads OAuth credentials (developer token, client ID/secret, refresh token)"
|
|
],
|
|
"next_action": "Add test suite (follow GoHighLevel-MCP's jest pattern). Add OAuth setup walkthrough. Consider publishing to npm once tests exist. This is ready for beta users TODAY."
|
|
}
|
|
],
|
|
"summary": {
|
|
"production_ready": ["GoHighLevel-MCP"],
|
|
"integration_ready": ["google-ads-mcp"],
|
|
"has_apps": ["GoHighLevel-MCP", "ghl-mcp-apps-only", "google-ads-mcp"],
|
|
"broken": ["ghl-mcp-public"],
|
|
"not_mcps": ["GHL-MCP-Funnel"],
|
|
"average_stage": 5.6,
|
|
"median_stage": 7,
|
|
"recommendations": [
|
|
"Promote GoHighLevel-MCP as the reference implementation - it's the gold standard",
|
|
"Fix ghl-mcp-public's build (1-hour fix), then re-evaluate",
|
|
"Either delete or rename GHL-MCP-Funnel - it's not an MCP",
|
|
"Add tests to google-ads-mcp - it's 95% done",
|
|
"ghl-mcp-apps-only needs purpose clarification - is it a demo or a real server?"
|
|
]
|
|
}
|
|
}
|