DataZoom

Product dashboard

Product dashboard

Last updated 5/3/2026

DataZoom — Product Dashboard

Repository: midwestco/datazoom · Generated: 2025 · Methodology: PRD-Driven Context Engineering


Lifecycle Gate Status

DimensionGateStatusNotes
Overall Product Stagev0.9 — Scale🟡 In ProgressProduction-deployed; CI/CD active; infra hardening ongoing
Core RAG Pipelinev1.0✅ CompleteRAG retrieval, citation system, and embedding pipeline shipped
Cap Table Modulev0.8🟡 In ProgressReview workflow, manual transactions, and feature flags in final validation
E-Signature Modulev0.7🟡 In ProgressTemplate designer and signing portal PRs open (#101, #108)
Multi-Tenant Authv1.0✅ CompleteClerk multi-org isolation confirmed
Cloud Worker Infrav0.8🟡 In ProgressTLS/BullMQ fixes merged; RunPod pod warmup tracking shipped
Analytics / Activityv1.0✅ CompleteUnified calendar, activity feed, and metrics API all merged
Billing / Walletv0.6🔴 PendingImplementation plan exists; no test coverage yet confirmed

Repository Statistics

MetricCountLocation
Total files500midwestco/datazoom
API routes50product/app/api/**
UI components100product/app/(app)/**
Test files35product/lib/__tests__/**, product/lib/cap-table/__tests__/**, product/lib/due-diligence/__tests__/**
Infrastructure files11docker/, .github/workflows/, fly/
Docker service definitions7docker-compose.yml, docker-compose.module1.yml
Documentation action plans50+docs/action_plans/**, docs/cap-table/action_plans/**, docs/activity_page/action_plans/**
CI/CD workflows2.github/workflows/build-images.yml, .github/workflows/knip.yml

Test coverage distribution:

  • Cap Table: 7 test files (calc.test.ts, feature-gate.test.ts, fixture-corpus.test.ts, observability.test.ts, cap-table-extract-trigger.test.ts, cap-table-read-apis.test.ts, cap-table-ui-shell.test.ts)
  • RAG/AI: 4 test files (rag-retrieval.test.ts, rag-retrieval-enhanced.test.ts, citation-system.test.ts, model-router.test.ts)
  • Due Diligence: 3 test files (chat-output.test.ts, template-events-contract.test.ts, template-events-route.test.ts)
  • Transactions / Workflow: 3 test files (manual-transaction.test.ts, manual-transaction-form.test.ts, review-workflow.test.ts)
  • Signature Attribution: 1 test file (conversion-attribution.test.ts)
  • Smoke / Regression: 1 test file (app-smoke-regression.test.ts)

Squad / Agent Status

Squad IDSquad NameOwnershipStatusCurrent FocusBlocker
SQ-01Core RAG & AIproduct/lib/__tests__/rag-*, product/app/api/advisor/, product/app/api/analysis/✅ ActiveModel router improvements; enhanced retrievalNone
SQ-02Cap Tableproduct/lib/cap-table/, product/app/api/cap-table/, product/app/(app)/cap-table/🟡 ActiveSnapshot read model optimization (Plan 14); rollout feature flag (Plan 12)Review queue UI stabilization
SQ-03Document Pipelinedocker/Dockerfile.worker, docker/Dockerfile.gpu, docker-compose.yml, product/app/api/admin/pipeline/🟡 ActiveBullMQ/Redis TLS fixes merged; pod warmup tracking shippedCloud worker CI tag mismatch (commit 960f88c fix in progress)
SQ-04E-Signaturedocs/action_plans/e_sign/, product/lib/signature/__tests__/🔴 BlockedPDF preview + schema normalization (PR #108 open)Upload fixes unresolved (PR #101 open)
SQ-05Activity & Analyticsproduct/app/(app)/activity/, product/app/api/activity/, docs/activity_page/✅ CompleteUnified calendar shipped; daily tracking merged (PR #104)None
SQ-06Due Diligence & Contextproduct/app/(app)/context/, product/lib/due-diligence/, product/app/api/business-types/🟡 ActiveBusiness type profile linkage fixes; template event contract testsLinkage mismatch API (/api/company-settings/linkage-mismatches) under validation
SQ-07Infrastructure & Deployment.github/workflows/, fly/, docker/cloud-worker/🟡 ActiveFly registry + ghcr.io auth fixes; RunPod orchestrator stabilizationSSL cert reqs for Upstash TLS resolved in b718932
SQ-08Billing & Walletdocs/billing_wallet/🔴 PendingImplementation plan authored; no code shippedNo assigned engineer; no test files exist

Active EPICs

EPIC IDTitleOwner SquadRoutes / ComponentsPhaseStatus
EPIC-01RAG Document Analysis CoreSQ-01/api/advisor, /api/analysis/party, /api/analysis/regenerate, /api/ai/track-interactionv1.0✅ Shipped
EPIC-02Cap Table Automation PipelineSQ-02/api/cap-table/extract, /api/cap-table/auto-populate, /api/cap-table/review/:id/approve, /api/cap-table/review/:id/reject, /api/cap-table/transactionsv0.8🟡 Final Validation
EPIC-03Cloud Worker & LLM InfrastructureSQ-03/api/admin/pipeline, /api/admin/pipeline/cloud, /api/admin/pipeline/health, /api/admin/pipeline/retryv0.8🟡 Stabilizing
EPIC-04E-Signature ModuleSQ-04product/lib/signature/__tests__/conversion-attribution.test.ts; templates, portal, stamping engine per docs/action_plans/e_sign/v0.6🔴 Blocked
EPIC-05Unified Activity & CalendarSQ-05/api/activity, /api/activity/unified/calendar, /api/activity/unified/feed, /api/activity/unified/day, /api/activity/metricsv1.0✅ Shipped
EPIC-06Due Diligence & Business ProfilesSQ-06/api/business-types, /api/business-types/:typeKey/checklist, /api/business-type-profiles, /api/clauses/comparev0.7🟡 Active
EPIC-07Multi-Tenant Auth & CollaborationSQ-01/SQ-07/api/clerk/proxy, /api/collaboration/token, /api/company-settingsv1.0✅ Shipped
EPIC-08Billing Wallet SystemSQ-08TBD — plan at docs/billing_wallet/BILLING_WALLET_IMPLEMENTATION_MASTER.mdv0.2🔴 Pre-Dev

KPIs

KPI IDMetricDescriptionTargetCurrent StatusData Source
KPI-01RAG Query Latency (p95)End-to-end latency from question submission to first AI token via /api/advisor< 4 s🟡 Unconfirmed — Modal cold-start warmup tracking added (580b80b)product/app/api/advisor/route.ts, pod warmup status
KPI-02Document Embedding Success RatePercentage of uploaded documents that complete chunking and vector embedding without error≥ 98%🟡 Monitored via /api/admin/pipeline/healthproduct/app/api/admin/pipeline/health/route.ts, docker/Dockerfile.worker
KPI-03Cap Table Extraction AccuracyFraction of AI-extracted equity events approved without human correction in review queue≥ 85%🟡 Calibration report template in docs/cap-table/calibration_report_template.md/api/cap-table/review, product/lib/cap-table/__tests__/fixture-corpus.test.ts
KPI-04Review Queue ThroughputNumber of cap table extraction candidates approved or rejected per day≥ 20/day🔴 Not yet measured — observability test exists (observability.test.ts)/api/cap-table/review, activity log
KPI-05Citation Coverage RatePercentage of AI responses that include at least one document citation≥ 90%🟡 Test coverage in product/lib/__tests__/citation-system.test.tsCitation system; /api/advisor response schema
KPI-06Semantic Search Relevance (Top-3 Hit Rate)Proportion of user queries where the correct document chunk appears in the top 3 vector results≥ 80%🟡 Covered by rag-retrieval-enhanced.test.tsdocument_chunks table; pgvector IVFFlat index
KPI-07E-Signature Conversion RatePercentage of initiated signing workflows completed by all required parties≥ 70%🔴 Not measurable — module in pre-launch state (PR #101, #108 open)product/lib/signature/__tests__/conversion-attribution.test.ts
KPI-08Activity Feed FreshnessTime delta between a user action (upload, delete, analysis) and its appearance in the unified activity feed< 30 s🟢 Unified refresh endpoint live at /api/activity/unified/refreshproduct/app/api/activity/unified/refresh/route.ts
KPI-09Multi-Tenant Org Isolation FailuresCount of cross-organization data leakage incidents0 per quarter🟢 Clerk org-based isolation confirmed; RLS policies in docs/cap-table/action_plans/02_cap_table_rls_and_policies.mdSupabase RLS; Clerk auth middleware
KPI-10Test File Coverage RatioRatio of test files to total API route files, indicating code confidence≥ 0.60🔴 Current: 0.70 (35 test files / 50 API routes) — but cap table and e-sign routes have gapsproduct/lib/__tests__/, product/lib/cap-table/__tests__/
KPI-11Cloud Worker Pipeline ReliabilityPercentage of document ingest jobs that complete without manual retry≥ 99%🟡 BullMQ TLS fix merged (b718932); retry endpoint exists at /api/admin/pipeline/retryproduct/app/api/admin/pipeline/retry/route.ts; BullMQ job queue
KPI-12Model Routing AccuracyPercentage of queries correctly dispatched to cloud (Modal/Qwen2.5:32B) vs. local (Ollama) model based on complexity≥ 95%🟡 Covered by product/lib/__tests__/model-router.test.tsproduct/app/api/admin/routing-stats/route.ts

Health Indicators

Overall System Health: 🟡 AMBER

DomainIndicatorHealthDetail
Production DeployDeployment pipeline🟢 HealthyNext.js 15 app on Vercel; Docker images on ghcr.io/midwestco/datazoom-*; Fly.io orchestrator active
DatabasePostgreSQL + pgvector🟢 HealthySupabase with pgvector; IVFFlat index on document_chunks(embedding); RLS policies in place
AI / LLMModal (cloud) + Ollama (local)🟡 DegradedPod warmup tracking added; TLS race condition fixed (6c89d22); cold-start latency under observation
Message QueueBullMQ + Upstash Redis🟡 Recoveringredis.asyncio TLS fix merged (b718932); ssl_cert_reqs=None workaround active
CI/CDGitHub Actions🟡 Recoveringcrane copy tag mismatch fixed (960f88c); retry logic added; cloud worker image build stabilizing
Test Suite35 test files🟡 PartialCore RAG and cap table covered; billing wallet has zero test coverage; upload path untested (PR #101 open)
E-SignatureTemplate + signing portal🔴 BlockedTwo open PRs (#101 upload fixes, #108 PDF preview); no production sign-off
Billing WalletWallet system🔴 Not StartedPlan authored at docs/billing_wallet/; no routes, components, or tests exist
ObservabilityMixpanel + activity log🟢 HealthyMixpanel events plan in docs/archive/MIXPANEL_TRACKING_PLAN.md; unified activity feed and metrics API shipped
SecurityAuth + multi-tenant isolation🟢 HealthyClerk org-based isolation; Supabase RLS; local-only data processing option documented

Open Risk Register

Risk IDDescriptionSeverityLinked Commit / PRMitigation
RISK-01Upload pipeline broken; blocks e-signature onboarding loopHighPR #101 (open)Assign SQ-04 fix as P0 before e-sign GA
RISK-02BullMQ TLS with Upstash uses ssl_cert_reqs=None — suppresses cert validationMediumb718932Replace with proper cert bundle before SOC 2 audit
RISK-03Cloud worker image tag mismatch in CI causes intermittent deploy failuresMedium960f88cRetry logic added; monitor next 5 deployments
RISK-04Billing wallet has no code, routes, or testsHighdocs/billing_wallet/Assign engineer; create EPIC-08 sprint plan
RISK-05Cap table extraction accuracy below 85% threshold not yet empirically confirmedMediumdocs/cap-table/calibration_report.mdComplete calibration run against fixture-corpus.test.ts baseline
RISK-06Test coverage ratio (0.70) masks zero coverage on billing and upload routesMediumproduct/lib/__tests__/Add upload.test.ts and wallet.test.ts before next gate review