# DAARION Data Cleanup Plan

> **Date:** 2025-11-28  
> **Status:** Completed  
> **Goal:** Remove test/mock data, enforce "every agent has a MicroDAO"

---

## 0. Backup

### Production Database Backup (NODE1)

```bash
# SSH to NODE1 and create backup
ssh root@144.76.224.179

# Create backup directory
mkdir -p /opt/backups

# Backup daarion database
docker exec dagi-postgres pg_dump -U postgres -Fc daarion > /opt/backups/daarion_before_cleanup_$(date +%Y%m%d_%H%M%S).dump

# Verify backup
ls -la /opt/backups/
```

**Backup created:** `[TO BE FILLED]`

---

## 1. Database Schema Discovery

### Key Tables

#### agents
```sql
-- Columns discovered:
-- id, display_name, kind, status, node_id, is_public, public_slug, 
-- public_title, public_tagline, public_skills, public_district,
-- avatar_url, capabilities, model, created_at, updated_at
```

#### microdaos
```sql
-- id, slug, name, description, district, base_node_id, created_at
```

#### microdao_agents
```sql
-- id, microdao_id, agent_id, role, is_core, created_at
```

#### node_cache
```sql
-- id, node_id, node_name, hostname, roles, environment, status, gpu, last_sync
```

---

## 2. Orphan Agents Analysis

### Agents without MicroDAO membership
```sql
SELECT a.id, a.display_name, a.kind, a.node_id
FROM agents a
LEFT JOIN microdao_agents ma ON ma.agent_id = a.id
WHERE ma.agent_id IS NULL
ORDER BY a.display_name;
```

**Results:** `[TO BE FILLED]`

### Agents without node_id
```sql
SELECT id, display_name FROM agents WHERE node_id IS NULL OR node_id = '';
```

**Results:** `[TO BE FILLED]`

### Agents not in router-config
```sql
-- Compare with router-config.yml agent_ids
```

**Results:** `[TO BE FILLED]`

---

## 3. MicroDAO Analysis

### MicroDAO with 0 agents
```sql
SELECT m.id, m.slug, m.name, COUNT(ma.agent_id) AS agents_count
FROM microdaos m
LEFT JOIN microdao_agents ma ON ma.microdao_id = m.id
GROUP BY m.id
HAVING COUNT(ma.agent_id) = 0
ORDER BY m.name;
```

**Results:** `[TO BE FILLED]`

### MicroDAO without orchestrator
```sql
SELECT m.id, m.slug, m.name
FROM microdaos m
WHERE NOT EXISTS (
    SELECT 1 FROM microdao_agents ma 
    WHERE ma.microdao_id = m.id AND ma.role = 'orchestrator'
);
```

**Results:** `[TO BE FILLED]`

---

## 4. Cleanup Actions Log

| Step | Action | SQL/Script | Status |
|------|--------|------------|--------|
| 1 | Add is_archived to agents | migrations/023_agents_add_archived.sql | ✅ Done |
| 2 | Add is_archived to microdaos | migrations/023_agents_add_archived.sql | ✅ Done |
| 3 | Archive test agents (ag_*) | Direct SQL | ✅ Done (4 agents) |
| 4 | Archive temp MicroDAOs | Direct SQL | ✅ Done (7 DAOs) |
| 5 | Move all NODE2 agents to DAARION DAO | Direct SQL | ✅ Done (50 agents) |
| 6 | Update API filters | repo_city.py | ✅ Done |

## 4.1 Final Database State

**Agents:**
- Total active: 59
- Archived: 4 (ag_atlas, ag_builder, ag_greeter, ag_oracle)
- NODE1: 9 agents
- NODE2: 50 agents

**MicroDAOs:**
- Active: 9
  - DAARION DAO: 51 agents
  - Clan Network, Druid Circle, Energy Union, Eonarch DAO, GreenFood DAO, Nutra Health, Soul Protocol, Yaromir Tribe: 1 agent each
- Archived: 7 (Core Operations, Developer Hub, Finance Department, Marketing Guild, Research Lab, Security Team, Vision Studio)

---

## 5. Verification Checklist

- [x] `/agents` shows only non-archived agents (59) with node badges (НОДА1/НОДА2) and MicroDAO badges
- [x] `/citizens` shows only public, non-archived agents (5 public citizens)
- [x] `/microdao` shows only non-archived DAOs (9) with agents - DAARION DAO has 51 agents
- [x] `/nodes` shows only real nodes (NODE1, NODE2)
- [x] Test agents (ag_*) are archived and not visible in UI