From de3bd8c13f99912154c4dcf1453f53339c24f32a Mon Sep 17 00:00:00 2001 From: Apple Date: Mon, 16 Feb 2026 02:15:20 -0800 Subject: [PATCH] docs: sync consolidation and session starter --- PROJECT-MASTER-INDEX.md | 67 +++++++++++++++- docs/SESSION_STARTER.md | 83 ++++++++++++++++++++ docs/consolidation/README.md | 36 +++++++++ docs/consolidation/SOURCES.md | 26 ++++++ docs/consolidation/docs_registry_curated.csv | 16 ++++ 5 files changed, 225 insertions(+), 3 deletions(-) create mode 100644 docs/SESSION_STARTER.md create mode 100644 docs/consolidation/README.md create mode 100644 docs/consolidation/SOURCES.md create mode 100644 docs/consolidation/docs_registry_curated.csv diff --git a/PROJECT-MASTER-INDEX.md b/PROJECT-MASTER-INDEX.md index 31e0ad30..6e49f34b 100644 --- a/PROJECT-MASTER-INDEX.md +++ b/PROJECT-MASTER-INDEX.md @@ -1,10 +1,18 @@ # 📚 MASTER INDEX — MicroDAO / DAARION / DAGI -**Оновлено:** 2026-02-10 +**Оновлено:** 2026-02-11 **Призначення:** Єдина точка входу до всієї документації проекту --- +## Session Start (Canonical) + +- Старт кожної нової сесії: `docs/SESSION_STARTER.md` +- Консолідація та маркування старих/нових/фактичних доків: `docs/consolidation/README.md` +- Керований список ключових документів і статусів: `docs/consolidation/docs_registry_curated.csv` + +--- + ## 🗂️ Де що лежить ### Основні репозиторії @@ -27,6 +35,19 @@ | **Docker Network** | `dagi-network` | | **Hardware** | Hetzner GEX44, NVIDIA RTX 4000 SFF Ada (20GB VRAM) | + +### NODA1 Sync Policy (Repo ↔ Runtime) + +**Канонічна правда:** GitHub `origin/main`. + +На NODA1: +- `/opt/microdao-daarion` — **єдиний deploy root** (канон runtime). +- `/root/microdao-daarion` не використовується як runtime tree. +- Перед/після змін запускати `ops/drift-check.sh` (контроль дріфту mount/labels). + +**Safe deploy runbook:** `NODA1-SAFE-DEPLOY.md` + +**Runtime snapshot:** `scripts/node1/snapshot_node1.sh` ### Агент НОДА1 (Cursor) **Де створено:** Агент налаштований у проєкті `/Users/apple/github-projects/microdao-daarion/`, а **не** в `Desktop/MicroDAO` або `node1`. Тому раніше він не знаходився. @@ -149,7 +170,7 @@ python3 tools/agents smoke --id # Smoke test ## 🤖 Агенти (повний перелік) -### TOP-LEVEL (User-facing, 11 agents) +### TOP-LEVEL (User-facing, 13 agents) | Агент | ID | Роль | Telegram | Visibility | |-------|-----|------|----------|------------| @@ -164,6 +185,8 @@ python3 tools/agents smoke --id # Smoke test | **EONARCH** | eonarch | Consciousness Evolution Guide | public | public | | **YAROMIR** | yaromir | Private Tech Lead | whitelist | private | | **SOUL** | soul | Spiritual Mentor | public | public | +| **SENPAI** | senpai | Trading Advisor & Capital Markets | public | public | +| **SOFIIA** | sofiia | Chief AI Architect | public | public | ### INTERNAL (Service agents, 2 agents) @@ -172,6 +195,9 @@ python3 tools/agents smoke --id # Smoke test | **MONITOR** | monitor | Node Observability & Alerts | node_local | | **DevTools** | devtools | Development Tools | global | +**NODA1 runtime (verified 2026-02-11):** 15 active agents = 13 user-facing + 2 internal (`monitor`, `devtools`). +**Canonical registry in repo:** 16 agents (додатково `comfy` як internal, поза user-facing health на NODA1). + **Webhook URL формат:** `https://gateway.daarion.city/{agent_id}/telegram/webhook` --- @@ -183,6 +209,8 @@ python3 tools/agents smoke --id # Smoke test | Документ | Шлях | Опис | |----------|------|------| | **NODA1-AGENT-ARCHITECTURE.md** | `docs/` | **Повна схема підключення агентів** | +| **NODA1-SAFE-DEPLOY.md** | `/` | Canonical деплой-процес для NODA1 | +| **ops/README.md** | `ops/` | Операційний runbook (up/down/logs/drift-check/policy) | | **agent_registry.yml** | `config/` | **Canonical Source of Truth для агентів** | | **README.md (config)** | `config/` | Як додавати нових агентів | | INFRASTRUCTURE.md | `docs/` | Порти, сервіси, конфігурація | @@ -276,6 +304,31 @@ python3 tools/agents smoke --id # Smoke test --- +## 🛠️ Зміни 2026-02-11 + +### ✅ NODA1 Runtime Alignment + Routing Fixes + +1. **Deployment drift fixed** + - Єдиний deploy root: `/opt/microdao-daarion` + - `drift-check` активний; runtime mounts/labels вирівняні + +2. **Router policy stabilized** + - `monitor` і `devtools` за замовчуванням ідуть у local (`swapper+ollama`, `qwen3-8b`) + - `devtools` має умовний cloud fallback (`deepseek-cloud`) для heavy task types + +3. **Memory service schema drift fixed** + - `GET /stats` повертає `200` (раніше було `500` через відсутні таблиці) + +4. **Senpai market-data stack confirmed** + - `senpai-md-consumer` healthy, NATS connected, features/signals counters зростають + +5. **AgroMatrix live check** + - Router infer `200` (backend: `deepseek-cloud`) + - Колекції: `agromatrix_messages=359`, `agromatrix_docs=327`, `agromatrix_memory_items=0` + - Facts у Postgres: `264` + +--- + ## 🛠️ Зміни 2026-02-09 ### ✅ SenpAI Market Data Integration @@ -390,6 +443,14 @@ curl http://144.76.224.179:9102/health # Router curl http://144.76.224.179:9300/health # Gateway curl http://144.76.224.179:8000/health # Memory curl http://144.76.224.179:6333/healthz # Qdrant +curl http://144.76.224.179:8000/stats # Memory stats +``` + +### Агентний smoke (Router infer API v2) +```bash +curl -sS -H "Content-Type: application/json" \ + -d '{"prompt":"ping","max_tokens":16,"temperature":0,"metadata":{"agent_id":"agromatrix"}}' \ + http://144.76.224.179:9102/v1/agents/agromatrix/infer ``` ### Qdrant collections @@ -496,4 +557,4 @@ curl http://localhost:8892/metrics --- **Автор:** Cursor Agent -**Останнє оновлення:** 2026-02-09 (market data integration) +**Останнє оновлення:** 2026-02-11 (runtime alignment + routing policy + memory schema fix) diff --git a/docs/SESSION_STARTER.md b/docs/SESSION_STARTER.md new file mode 100644 index 00000000..028fe8bb --- /dev/null +++ b/docs/SESSION_STARTER.md @@ -0,0 +1,83 @@ +# SESSION STARTER (Documentation + Runtime Truth) + +Date: 2026-02-16 +Purpose: single context file to start any new session without losing architectural state. + +## Canonical Repo + +- Main working repo: `/Users/apple/github-projects/microdao-daarion` +- Runtime on NODE1: `/opt/microdao-daarion` + +Important: keep docs and runtime aligned via explicit drift checks, not assumptions. + +## Core Entry Documents + +1. `PROJECT-MASTER-INDEX.md` (entry point to docs map) +2. `config/README.md` (how to add/modify agents) +3. `docs/NODA1-AGENT-ARCHITECTURE.md` (node1 architecture and agent wiring) +4. `NODA1-SAFE-DEPLOY.md` (safe deployment flow) +5. `docs/consolidation/README.md` (docs hub) +6. `docs/consolidation/docs_registry_curated.csv` (curated doc truth table) + +## Session Bootstrap (Services + Docs) + +1. Run integrations bootstrap report: +```bash +bash scripts/docs/session_bootstrap.sh +``` +Output: +- `docs/consolidation/INTEGRATIONS_STATUS_LATEST.md` +- `docs/consolidation/INTEGRATIONS_STATUS_.md` + +2. Dry-run docs sync to remotes: +```bash +bash scripts/docs/docs_sync.sh --dry-run +``` + +3. Apply docs sync (only after review): +```bash +bash scripts/docs/docs_sync.sh --apply --targets github,gitea +``` + +## Runtime-First Facts (must re-check each session) + +1. NODE1 branch/SHA: +```bash +ssh root@ "cd /opt/microdao-daarion && git rev-parse --abbrev-ref HEAD && git rev-parse HEAD" +``` + +2. Core health: +```bash +curl -sS http://127.0.0.1:9102/health +curl -sS http://127.0.0.1:9300/health +``` + +3. Canary suite: +```bash +cd /opt/microdao-daarion +./ops/canary_all.sh +./ops/canary_senpai_osr_guard.sh +``` + +4. Router endpoint contract: +- Active: `POST /v1/agents/{agent_id}/infer` +- Not active: `POST /route` (returns 404 on current runtime) + +## NODE3/NODE4 Policy + +- NODE3 and NODE4 remain part of target architecture. +- If currently unreachable, mark as `DEGRADED` (not removed). +- Re-enable dependent flows only after connectivity + health checks pass. + +## Documentation Status Model + +- `new-canonical`: active docs in canonical repo. +- `runtime-fact`: docs/snapshots that reflect current live runtime behavior. +- `legacy-worktree`: old but useful strategic docs in `.worktrees/*`. +- `legacy-desktop`: docs from old Desktop repo (`MicroDAO 3`). +- `needs-triage`: unresolved status. + +## Governance Rule + +No deployment/reconfiguration based only on docs text. +Always confirm against live runtime facts (health, canary, config hashes, active endpoints). diff --git a/docs/consolidation/README.md b/docs/consolidation/README.md new file mode 100644 index 00000000..02da6cbc --- /dev/null +++ b/docs/consolidation/README.md @@ -0,0 +1,36 @@ +# Docs Consolidation Hub + +Single entry point for documentation reconciliation across: +- canonical repo docs +- legacy repo copies +- worktree docs +- NODE1 runtime docs snapshot +- local notebooks + +## Files + +- `docs_inventory.csv` — machine-readable inventory with classification. +- `docs_inventory_summary.txt` — class-level counts. +- `docs_registry_curated.csv` — manually curated truth table for key docs (startup + runtime + legacy refs). +- `_node1_runtime_docs/` — runtime docs snapshot pulled from NODE1. + +## Classification + +- `runtime-fact` — observed in NODE1 runtime snapshot. +- `new-canonical` — canonical docs in active repo (`docs/runbooks`, master index, safe deploy). +- `legacy-worktree` — docs from `.worktrees/*`. +- `legacy-desktop` — docs from `/Users/apple/Desktop/MicroDAO/MicroDAO 3`. +- `needs-triage` — requires manual decision. + +## Rebuild inventory + +```bash +python3 /Users/apple/github-projects/microdao-daarion/scripts/docs/build_docs_hub_inventory.py +``` + +## Service Automation + +```bash +bash /Users/apple/github-projects/microdao-daarion/scripts/docs/session_bootstrap.sh +bash /Users/apple/github-projects/microdao-daarion/scripts/docs/docs_sync.sh --dry-run +``` diff --git a/docs/consolidation/SOURCES.md b/docs/consolidation/SOURCES.md new file mode 100644 index 00000000..138be77a --- /dev/null +++ b/docs/consolidation/SOURCES.md @@ -0,0 +1,26 @@ +# Documentation Sources Map + +This file tracks where documentation is collected from for consolidation. + +## Primary +- Canonical repo: `/Users/apple/github-projects/microdao-daarion` +- Legacy repo: `/Users/apple/Desktop/MicroDAO/MicroDAO 3` +- Worktrees: + - `/Users/apple/github-projects/microdao-daarion/.worktrees/origin-main` + - `/Users/apple/github-projects/microdao-daarion/.worktrees/docs-node1-sync` +- NODE1 runtime snapshot mirror: + - `/Users/apple/github-projects/microdao-daarion/docs/consolidation/_node1_runtime_docs` +- Local notebooks: + - `/Users/apple/notebooks` + +## Connectivity/Integrations (verified 2026-02-16) +- GitHub CLI: authenticated (`gh auth status` -> account `IvanTytar`, scopes include `repo`) +- Gitea web UI: reachable at `http://127.0.0.1:3000` (HTTP 200) +- Jupyter CLI: not found in current PATH (`jupyter: command not found`), notebooks directory exists at `/Users/apple/notebooks` +- Pieces: Cursor extension found (`meshintelligenttechnologiesinc.pieces-vscode-3.0.1-universal`) +- NODE1 SSH: intermittent (periodic `connection refused`), use retry/backoff for snapshot refresh. +- NODE3/NODE4: currently unreachable from this workstation and from NODE1. + +## Automation Scripts +- `scripts/docs/session_bootstrap.sh` — refreshes integration status and writes `INTEGRATIONS_STATUS_LATEST.md`. +- `scripts/docs/docs_sync.sh` — safe docs sync automation with `--dry-run` by default and explicit `--apply`. diff --git a/docs/consolidation/docs_registry_curated.csv b/docs/consolidation/docs_registry_curated.csv new file mode 100644 index 00000000..8d6d4722 --- /dev/null +++ b/docs/consolidation/docs_registry_curated.csv @@ -0,0 +1,16 @@ +path,title,status,source,notes,last_verified +/Users/apple/github-projects/microdao-daarion/docs/SESSION_STARTER.md,Session Starter,new-canonical,canonical-repo,Primary startup context for new sessions,2026-02-16 +/Users/apple/github-projects/microdao-daarion/PROJECT-MASTER-INDEX.md,Master Index,new-canonical,canonical-repo,Single entry point for docs navigation,2026-02-16 +/Users/apple/github-projects/microdao-daarion/config/README.md,Agent Registry README,new-canonical,canonical-repo,Canonical process for adding/modifying agents,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/NODA1-AGENT-ARCHITECTURE.md,NODA1 Agent Architecture,new-canonical,canonical-repo,Architecture and wiring for NODE1 agents,2026-02-16 +/Users/apple/github-projects/microdao-daarion/NODA1-SAFE-DEPLOY.md,NODA1 Safe Deploy,new-canonical,canonical-repo,Safe deploy workflow and rollback gates,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/runbooks/AGENT_REGISTRY_NODE1_DECISION_2026-02-16.md,Agent Registry Decision,runtime-fact,canonical-repo,Decision log aligned to live NODE1 runtime,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/runbooks/NODE_ARCH_RECONCILIATION_PLAN_2026-02-16.md,Node Arch Reconciliation Plan,runtime-fact,canonical-repo,Runtime-first reconciliation plan across nodes,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/consolidation/_node1_runtime_docs/PROJECT-MASTER-INDEX.md,Runtime Snapshot Master Index,runtime-fact,node1-snapshot,Snapshot from /opt/microdao-daarion,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/consolidation/_node1_runtime_docs/config/README.md,Runtime Snapshot Config README,runtime-fact,node1-snapshot,Snapshot from /opt/microdao-daarion,2026-02-16 +/Users/apple/github-projects/microdao-daarion/docs/consolidation/_node1_runtime_docs/docs/NODA1-AGENT-ARCHITECTURE.md,Runtime Snapshot NODA1 Architecture,runtime-fact,node1-snapshot,Snapshot from /opt/microdao-daarion,2026-02-16 +/Users/apple/github-projects/microdao-daarion/.worktrees/origin-main/IMPLEMENTATION-STATUS.md,Implementation Status,legacy-worktree,worktree-origin-main,Legacy strategic doc kept for reference only,2026-02-16 +/Users/apple/github-projects/microdao-daarion/.worktrees/origin-main/ARCHITECTURE-150-NODES.md,Architecture 150 Nodes,legacy-worktree,worktree-origin-main,Legacy scale architecture reference,2026-02-16 +/Users/apple/github-projects/microdao-daarion/.worktrees/origin-main/infrastructure/auth/AUTH-IMPLEMENTATION-PLAN.md,Auth Implementation Plan,legacy-worktree,worktree-origin-main,Legacy auth rollout plan,2026-02-16 +/Users/apple/github-projects/microdao-daarion/.worktrees/origin-main/infrastructure/matrix-gateway/README.md,Matrix Gateway README,legacy-worktree,worktree-origin-main,Legacy matrix gateway reference,2026-02-16 +/Users/apple/Desktop/MicroDAO/MicroDAO 3/NODA1-CURRENT-STATUS-2026-01-26.md,NODA1 Current Status 2026-01-26,legacy-desktop,desktop-legacy,Old status snapshot from legacy repo,2026-02-16