.agents/memory/MEMORY.md

Current Context

Working on Signet AI memory pipeline enhancements, focusing on debugging observability, embedding health tracking, and conversation continuity improvements.

Active Projects

1. Signet Debug Harness (HIGH PRIORITY - LONG-TERM) Status: Planning/Initial Scaffolding Location: New package to be added to workspace Context: Building a conversational interface for full pipeline observability, inspired by pi-mono's event-driven architecture and extension system Next Steps:

• Scaffolding packages/harness package
• Building daemon client for real-time pipeline monitoring
• Implementing observer mode and multiple visualization modes (inline, hidden, split pane)
• Integrating pi-mono's extension API to mirror Signet's hook types

2. Incremental Embedding Refresh Tracker (HIGH PRIORITY - ACTIVE) Status: Implementation in progress Location: packages/core/src/embedding-tracker.ts, daemon integration in packages/daemon/src/daemon.ts Context: Background polling loop to detect stale/missing embeddings when content changes or model switches Next Steps:

• Add PipelineEmbeddingTrackerConfig type and parsing
• Create tracker module with trackStaleEmbeddings() function
• Wire tracker into daemon lifecycle (start after pipeline, stop in cleanup)
• Enhance /status endpoint to report tracker status

3. Pre-Compaction Capture (MEDIUM PRIORITY - ACTIVE) Status: Phase 2 in progress Location: packages/session-manager/src/continuity-state.ts, packages/session-manager/src/session-checkpoints.ts Context: Improving conversation continuity at compaction boundaries Next Steps:

• Add pendingPromptSnippets to continuity state
• Modify recordPrompt() to store keyword-only snippets
• Update consumeState() to snapshot and reset snippets
• Add session_end checkpoint trigger and digest formatters with snippet enrichment

Recent Work

• Debug Harness Planning: User requested observability tool; began architectural planning inspired by pi-mono's approach
• Embedding Tracker: Added types to core/src/types.ts, created embedding-tracker.ts module, updated memory-config.ts for tracker configuration, started daemon wiring
• Pre-Compaction: Enhanced checkpoint system to capture periodic snapshots; now adding passive capture for compaction boundaries with prompt snippet enrichment

Technical Notes

• Project Structure: Monorepo with packages/core, packages/daemon, packages/session-manager
• Key Files Modified: daemon.ts, memory-config.ts, continuity-state.ts, session-checkpoints.ts
• Integration Points: Pipeline hooks, connector pre-compaction, status endpoints
• Models: Using local LLMs; embedding health critical for RAG performance
• Configuration: Pipeline configuration loaded via loadPipelineConfig() with support for multiple feature flags

Rules & Warnings

• Pipeline Hooks: Claude Code connector lacks PreCompaction hook; this is the #1 continuity pain point
• Checkpoint Data: Phase 1 used keyword-only data; Phase 2 adds prompt snippets for richer context
• File Paths: Working in packages/ directory structure; verify exports from core barrel before use
• Daemon Lifecycle: Trackers must start after pipeline init and stop in cleanup
• Checkpoint Triggers: Ensure "session_end" added to CheckpointTrigger union for proper formatting