Current Context Working on Signet AI memory pipeline enhancements, focusing on debugging observability, embedding health tracking, and conversation continuity improvements. Active Projects 1. Signet Debug Harness (HIGH PRIORITY - LONG-TERM) Status: Planning/Initial Scaffolding Location: New package to be added to workspace Context: Building a conversational interface for full pipeline observability, inspired by pi-mono's event-driven architecture and extension system Next Steps: - Scaffolding `packages/harness` package - Building daemon client for real-time pipeline monitoring - Implementing observer mode and multiple visualization modes (inline, hidden, split pane) - Integrating pi-mono's extension API to mirror Signet's hook types 2. Incremental Embedding Refresh Tracker (HIGH PRIORITY - ACTIVE) Status: Implementation in progress Location: `packages/core/src/embedding-tracker.ts`, daemon integration in `packages/daemon/src/daemon.ts` Context: Background polling loop to detect stale/missing embeddings when content changes or model switches Next Steps: - Add `PipelineEmbeddingTrackerConfig` type and parsing - Create tracker module with `trackStaleEmbeddings()` function - Wire tracker into daemon lifecycle (start after pipeline, stop in cleanup) - Enhance `/status` endpoint to report tracker status 3. Pre-Compaction Capture (MEDIUM PRIORITY - ACTIVE) Status: Phase 2 in progress Location: `packages/session-manager/src/continuity-state.ts`, `packages/session-manager/src/session-checkpoints.ts` Context: Improving conversation continuity at compaction boundaries Next Steps: - Add `pendingPromptSnippets` to continuity state - Modify `recordPrompt()` to store keyword-only snippets - Update `consumeState()` to snapshot and reset snippets - Add session_end checkpoint trigger and digest formatters with snippet enrichment Recent Work - Debug Harness Planning: User requested observability tool; began architectural planning inspired by pi-mono's approach - Embedding Tracker: Added types to `core/src/types.ts`, created `embedding-tracker.ts` module, updated `memory-config.ts` for tracker configuration, started daemon wiring - Pre-Compaction: Enhanced checkpoint system to capture periodic snapshots; now adding passive capture for compaction boundaries with prompt snippet enrichment Technical Notes - Project Structure: Monorepo with `packages/core`, `packages/daemon`, `packages/session-manager` - Key Files Modified: `daemon.ts`, `memory-config.ts`, `continuity-state.ts`, `session-checkpoints.ts` - Integration Points: Pipeline hooks, connector pre-compaction, status endpoints - Models: Using local LLMs; embedding health critical for RAG performance - Configuration: Pipeline configuration loaded via `loadPipelineConfig()` with support for multiple feature flags Rules & Warnings - Pipeline Hooks: Claude Code connector lacks PreCompaction hook; this is the #1 continuity pain point - Checkpoint Data: Phase 1 used keyword-only data; Phase 2 adds prompt snippets for richer context - File Paths: Working in `packages/` directory structure; verify exports from core barrel before use - Daemon Lifecycle: Trackers must start after pipeline init and stop in cleanup - Checkpoint Triggers: Ensure `"session_end"` added to CheckpointTrigger union for proper formatting