daarion-admin/microdao-daarion
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
254267afa3511a63ca5f4adb98149c36a0a27520
microdao-daarion/site/integration/VISION_PARSER_TTS_PLAN/index.html

1307 lines
61 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
<!doctype html>
<html lang="en" class="no-js">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<link rel="canonical" href="https://IvanTytar.github.io/microdao-daarion/integration/VISION_PARSER_TTS_PLAN/">
<link rel="icon" href="../../assets/images/favicon.png">
<meta name="generator" content="mkdocs-1.5.3, mkdocs-material-9.5.18">
<title>🚀 План інтеграції: Vision, Parser, TTS та Grafana - DAARION Documentation</title>
<link rel="stylesheet" href="../../assets/stylesheets/main.66ac8b77.min.css">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link rel="stylesheet" href="https://fonts.googleapis.com/css?family=Roboto:300,300i,400,400i,700,700i%7CRoboto+Mono:400,400i,700,700i&display=fallback">
<style>:root{--md-text-font:"Roboto";--md-code-font:"Roboto Mono"}</style>
<script>__md_scope=new URL("../..",location),__md_hash=e=>[...e].reduce((e,_)=>(e<<5)-e+_.charCodeAt(0),0),__md_get=(e,_=localStorage,t=__md_scope)=>JSON.parse(_.getItem(t.pathname+"."+e)),__md_set=(e,_,t=localStorage,a=__md_scope)=>{try{t.setItem(a.pathname+"."+e,JSON.stringify(_))}catch(e){}}</script>
</head>
<body dir="ltr">
<input class="md-toggle" data-md-toggle="drawer" type="checkbox" id="__drawer" autocomplete="off">
<input class="md-toggle" data-md-toggle="search" type="checkbox" id="__search" autocomplete="off">
<label class="md-overlay" for="__drawer"></label>
<div data-md-component="skip">
<a href="#vision-parser-tts-grafana" class="md-skip">
Skip to content
</a>
</div>
<div data-md-component="announce">
</div>
<header class="md-header md-header--shadow" data-md-component="header">
<nav class="md-header__inner md-grid" aria-label="Header">
<a href="../.." title="DAARION Documentation" class="md-header__button md-logo" aria-label="DAARION Documentation" data-md-component="logo">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54Z"/></svg>
</a>
<label class="md-header__button md-icon" for="__drawer">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M3 6h18v2H3V6m0 5h18v2H3v-2m0 5h18v2H3v-2Z"/></svg>
</label>
<div class="md-header__title" data-md-component="header-title">
<div class="md-header__ellipsis">
<div class="md-header__topic">
<span class="md-ellipsis">
DAARION Documentation
</span>
</div>
<div class="md-header__topic" data-md-component="header-topic">
<span class="md-ellipsis">
🚀 План інтеграції: Vision, Parser, TTS та Grafana
</span>
</div>
</div>
</div>
<script>var media,input,key,value,palette=__md_get("__palette");if(palette&&palette.color){"(prefers-color-scheme)"===palette.color.media&&(media=matchMedia("(prefers-color-scheme: light)"),input=document.querySelector(media.matches?"[data-md-color-media='(prefers-color-scheme: light)']":"[data-md-color-media='(prefers-color-scheme: dark)']"),palette.color.media=input.getAttribute("data-md-color-media"),palette.color.scheme=input.getAttribute("data-md-color-scheme"),palette.color.primary=input.getAttribute("data-md-color-primary"),palette.color.accent=input.getAttribute("data-md-color-accent"));for([key,value]of Object.entries(palette.color))document.body.setAttribute("data-md-color-"+key,value)}</script>
<label class="md-header__button md-icon" for="__search">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.516 6.516 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5Z"/></svg>
</label>
<div class="md-search" data-md-component="search" role="dialog">
<label class="md-search__overlay" for="__search"></label>
<div class="md-search__inner" role="search">
<form class="md-search__form" name="search">
<input type="text" class="md-search__input" name="query" aria-label="Search" placeholder="Search" autocapitalize="off" autocorrect="off" autocomplete="off" spellcheck="false" data-md-component="search-query" required>
<label class="md-search__icon md-icon" for="__search">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M9.5 3A6.5 6.5 0 0 1 16 9.5c0 1.61-.59 3.09-1.56 4.23l.27.27h.79l5 5-1.5 1.5-5-5v-.79l-.27-.27A6.516 6.516 0 0 1 9.5 16 6.5 6.5 0 0 1 3 9.5 6.5 6.5 0 0 1 9.5 3m0 2C7 5 5 7 5 9.5S7 14 9.5 14 14 12 14 9.5 12 5 9.5 5Z"/></svg>
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M20 11v2H8l5.5 5.5-1.42 1.42L4.16 12l7.92-7.92L13.5 5.5 8 11h12Z"/></svg>
</label>
<nav class="md-search__options" aria-label="Search">
<button type="reset" class="md-search__icon md-icon" title="Clear" aria-label="Clear" tabindex="-1">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M19 6.41 17.59 5 12 10.59 6.41 5 5 6.41 10.59 12 5 17.59 6.41 19 12 13.41 17.59 19 19 17.59 13.41 12 19 6.41Z"/></svg>
</button>
</nav>
</form>
<div class="md-search__output">
<div class="md-search__scrollwrap" data-md-scrollfix>
<div class="md-search-result" data-md-component="search-result">
<div class="md-search-result__meta">
Initializing search
</div>
<ol class="md-search-result__list" role="presentation"></ol>
</div>
</div>
</div>
</div>
</div>
</nav>
</header>
<div class="md-container" data-md-component="container">
<main class="md-main" data-md-component="main">
<div class="md-main__inner md-grid">
<div class="md-sidebar md-sidebar--primary" data-md-component="sidebar" data-md-type="navigation" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
<nav class="md-nav md-nav--primary" aria-label="Navigation" data-md-level="0">
<label class="md-nav__title" for="__drawer">
<a href="../.." title="DAARION Documentation" class="md-nav__button md-logo" aria-label="DAARION Documentation" data-md-component="logo">
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24"><path d="M12 8a3 3 0 0 0 3-3 3 3 0 0 0-3-3 3 3 0 0 0-3 3 3 3 0 0 0 3 3m0 3.54C9.64 9.35 6.5 8 3 8v11c3.5 0 6.64 1.35 9 3.54 2.36-2.19 5.5-3.54 9-3.54V8c-3.5 0-6.64 1.35-9 3.54Z"/></svg>
</a>
DAARION Documentation
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="../../public/" class="md-nav__link">
<span class="md-ellipsis">
Home
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../public/getting-started/" class="md-nav__link">
<span class="md-ellipsis">
Getting Started
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../public/architecture-overview/" class="md-nav__link">
<span class="md-ellipsis">
Architecture
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../public/daiS_daos_overview/" class="md-nav__link">
<span class="md-ellipsis">
DAIS & DAOS
</span>
</a>
</li>
<li class="md-nav__item md-nav__item--section md-nav__item--nested">
<input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_5" >
<label class="md-nav__link" for="__nav_5" id="__nav_5_label" tabindex="">
<span class="md-ellipsis">
Internal
</span>
<span class="md-nav__icon md-icon"></span>
</label>
<nav class="md-nav" data-md-level="1" aria-labelledby="__nav_5_label" aria-expanded="false">
<label class="md-nav__title" for="__nav_5">
<span class="md-nav__icon md-icon"></span>
Internal
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item md-nav__item--nested">
<input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_5_1" >
<label class="md-nav__link" for="__nav_5_1" id="__nav_5_1_label" tabindex="0">
<span class="md-ellipsis">
Infra
</span>
<span class="md-nav__icon md-icon"></span>
</label>
<nav class="md-nav" data-md-level="2" aria-labelledby="__nav_5_1_label" aria-expanded="false">
<label class="md-nav__title" for="__nav_5_1">
<span class="md-nav__icon md-icon"></span>
Infra
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="../../internal/infra/INFRA_AUTOMATION_PACK_V1/" class="md-nav__link">
<span class="md-ellipsis">
Infra Automation Pack v1
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../internal/infra/monitoring_overview/" class="md-nav__link">
<span class="md-ellipsis">
Monitoring Overview
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../internal/infra/nodes_registry_v0/" class="md-nav__link">
<span class="md-ellipsis">
Nodes Registry v0
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item md-nav__item--nested">
<input class="md-nav__toggle md-toggle " type="checkbox" id="__nav_5_2" >
<label class="md-nav__link" for="__nav_5_2" id="__nav_5_2_label" tabindex="0">
<span class="md-ellipsis">
Specs
</span>
<span class="md-nav__icon md-icon"></span>
</label>
<nav class="md-nav" data-md-level="2" aria-labelledby="__nav_5_2_label" aria-expanded="false">
<label class="md-nav__title" for="__nav_5_2">
<span class="md-nav__icon md-icon"></span>
Specs
</label>
<ul class="md-nav__list" data-md-scrollfix>
<li class="md-nav__item">
<a href="../../internal/specs/matrix_presence_aggregator/" class="md-nav__link">
<span class="md-ellipsis">
Matrix Presence Aggregator
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../internal/specs/city_map_spec/" class="md-nav__link">
<span class="md-ellipsis">
City Map Spec
</span>
</a>
</li>
<li class="md-nav__item">
<a href="../../internal/specs/node_join_protocol_draft/" class="md-nav__link">
<span class="md-ellipsis">
Node Join Protocol (Draft)
</span>
</a>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</div>
</div>
</div>
<div class="md-sidebar md-sidebar--secondary" data-md-component="sidebar" data-md-type="toc" >
<div class="md-sidebar__scrollwrap">
<div class="md-sidebar__inner">
<nav class="md-nav md-nav--secondary" aria-label="Table of contents">
<label class="md-nav__title" for="__toc">
<span class="md-nav__icon md-icon"></span>
Table of contents
</label>
<ul class="md-nav__list" data-md-component="toc" data-md-scrollfix>
<li class="md-nav__item">
<a href="#_1" class="md-nav__link">
<span class="md-ellipsis">
✅ Поточний стан
</span>
</a>
<nav class="md-nav" aria-label="✅ Поточний стан">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#_2" class="md-nav__link">
<span class="md-ellipsis">
Що вже працює:
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#_3" class="md-nav__link">
<span class="md-ellipsis">
Що не інтегровано:
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#_4" class="md-nav__link">
<span class="md-ellipsis">
📋 План імплементації
</span>
</a>
<nav class="md-nav" aria-label="📋 План імплементації">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#1-vision-encoder-integration" class="md-nav__link">
<span class="md-ellipsis">
1. Vision Encoder Integration 🖼️ (Пріоритет: 🔴 ВИСОКИЙ)
</span>
</a>
<nav class="md-nav" aria-label="1. Vision Encoder Integration 🖼️ (Пріоритет: 🔴 ВИСОКИЙ)">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#11-router_handlerpy" class="md-nav__link">
<span class="md-ellipsis">
1.1. Оновити router_handler.py
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#12-_analyze_photo" class="md-nav__link">
<span class="md-ellipsis">
1.2. Додати метод _analyze_photo()
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#13-vision-encoder" class="md-nav__link">
<span class="md-ellipsis">
1.3. Перевірити Vision Encoder сервіс
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#2-parser-service-integration" class="md-nav__link">
<span class="md-ellipsis">
2. Parser Service Integration 📄 (Пріоритет: 🔴 ВИСОКИЙ)
</span>
</a>
<nav class="md-nav" aria-label="2. Parser Service Integration 📄 (Пріоритет: 🔴 ВИСОКИЙ)">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#21-router_handlerpy" class="md-nav__link">
<span class="md-ellipsis">
2.1. Оновити router_handler.py
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#22-_parse_document" class="md-nav__link">
<span class="md-ellipsis">
2.2. Додати метод _parse_document()
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#23-rag" class="md-nav__link">
<span class="md-ellipsis">
2.3. Інтеграція з RAG (опційно)
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#3-tts-integration" class="md-nav__link">
<span class="md-ellipsis">
3. TTS Integration 🔊 (Пріоритет: 🟡 СЕРЕДНІЙ)
</span>
</a>
<nav class="md-nav" aria-label="3. TTS Integration 🔊 (Пріоритет: 🟡 СЕРЕДНІЙ)">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#31" class="md-nav__link">
<span class="md-ellipsis">
3.1. Додати опцію для голосових відповідей
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#32-router_handlerpy" class="md-nav__link">
<span class="md-ellipsis">
3.2. Оновити router_handler.py
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#33-_text_to_speech" class="md-nav__link">
<span class="md-ellipsis">
3.3. Додати метод _text_to_speech()
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#34-send_voice-telegram_listenerpy" class="md-nav__link">
<span class="md-ellipsis">
3.4. Додати send_voice() в telegram_listener.py
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#4-grafana-dashboards" class="md-nav__link">
<span class="md-ellipsis">
4. Grafana Dashboards 📊 (Пріоритет: 🟢 НИЗЬКИЙ)
</span>
</a>
<nav class="md-nav" aria-label="4. Grafana Dashboards 📊 (Пріоритет: 🟢 НИЗЬКИЙ)">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#41-daarion-services-overview" class="md-nav__link">
<span class="md-ellipsis">
4.1. Створити дашборд "DAARION Services Overview"
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#42" class="md-nav__link">
<span class="md-ellipsis">
4.2. Створити файл дашборду
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#43-grafana" class="md-nav__link">
<span class="md-ellipsis">
4.3. Імпортувати в Grafana
</span>
</a>
</li>
</ul>
</nav>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#_5" class="md-nav__link">
<span class="md-ellipsis">
🗓️ Порядок імплементації
</span>
</a>
<nav class="md-nav" aria-label="🗓️ Порядок імплементації">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#phase-1-vision-parser" class="md-nav__link">
<span class="md-ellipsis">
Phase 1 (Сьогодні): Vision + Parser
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#phase-2-tts" class="md-nav__link">
<span class="md-ellipsis">
Phase 2 (Завтра/Пізніше): TTS
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#phase-3-grafana" class="md-nav__link">
<span class="md-ellipsis">
Phase 3 (Опційно): Grafana
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#summary" class="md-nav__link">
<span class="md-ellipsis">
📝 Зміни в файлах (Summary)
</span>
</a>
<nav class="md-nav" aria-label="📝 Зміни в файлах (Summary)">
<ul class="md-nav__list">
<li class="md-nav__item">
<a href="#vision-parser" class="md-nav__link">
<span class="md-ellipsis">
Для Vision + Parser:
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#tts" class="md-nav__link">
<span class="md-ellipsis">
Для TTS:
</span>
</a>
</li>
<li class="md-nav__item">
<a href="#grafana" class="md-nav__link">
<span class="md-ellipsis">
Для Grafana:
</span>
</a>
</li>
</ul>
</nav>
</li>
<li class="md-nav__item">
<a href="#_6" class="md-nav__link">
<span class="md-ellipsis">
🚀 Готовий почати?
</span>
</a>
</li>
</ul>
</nav>
</div>
</div>
</div>
<div class="md-content" data-md-component="content">
<article class="md-content__inner md-typeset">
<h1 id="vision-parser-tts-grafana">🚀 План інтеграції: Vision, Parser, TTS та Grafana<a class="headerlink" href="#vision-parser-tts-grafana" title="Permanent link">&para;</a></h1>
<p><strong>Дата</strong>: 2025-11-18<br />
<strong>Статус</strong>: 📋 В плануванні</p>
<hr />
<h2 id="_1">✅ Поточний стан<a class="headerlink" href="#_1" title="Permanent link">&para;</a></h2>
<h3 id="_2">Що вже працює:<a class="headerlink" href="#_2" title="Permanent link">&para;</a></h3>
<ul>
<li>✅ Голосові повідомлення (STT через Whisper)</li>
<li>✅ Фото detection (metadata → NATS)</li>
<li>✅ PDF detection (metadata → NATS)</li>
<li>✅ Prometheus metrics (Router + Gateway)</li>
<li>✅ 3 боти (DAARWIZZ, Helion, GREENFOOD)</li>
<li>✅ Helion 502 фікс (timeout 120s)</li>
</ul>
<h3 id="_3">Що не інтегровано:<a class="headerlink" href="#_3" title="Permanent link">&para;</a></h3>
<ul>
<li>⚠️ Vision Encoder (сервіс готовий, але не викликається)</li>
<li>⚠️ Parser Service для PDF (сервіс готовий, але не викликається)</li>
<li>⚠️ TTS для голосових відповідей</li>
<li>⚠️ Grafana дашборди (Grafana працює, дашборди порожні)</li>
</ul>
<hr />
<h2 id="_4">📋 План імплементації<a class="headerlink" href="#_4" title="Permanent link">&para;</a></h2>
<h3 id="1-vision-encoder-integration">1. <strong>Vision Encoder Integration</strong> 🖼️ (Пріоритет: 🔴 ВИСОКИЙ)<a class="headerlink" href="#1-vision-encoder-integration" title="Permanent link">&para;</a></h3>
<p><strong>Мета</strong>: Бот може описувати що на фото.</p>
<p><strong>Кроки</strong>:</p>
<h4 id="11-router_handlerpy">1.1. Оновити <code>router_handler.py</code><a class="headerlink" href="#11-router_handlerpy" title="Permanent link">&para;</a></h4>
<p>Додати обробку <code>metadata.photo</code>:</p>
<div class="codehilite"><pre><span></span><code><span class="c1"># В методі _handle_telegram_event():</span>
<span class="k">if</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span> <span class="ow">and</span> <span class="s2">&quot;photo&quot;</span> <span class="ow">in</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span><span class="p">:</span>
<span class="n">photo_info</span> <span class="o">=</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span><span class="p">[</span><span class="s2">&quot;photo&quot;</span><span class="p">]</span>
<span class="c1"># Викликати Vision Encoder</span>
<span class="n">vision_result</span> <span class="o">=</span> <span class="k">await</span> <span class="bp">self</span><span class="o">.</span><span class="n">_analyze_photo</span><span class="p">(</span>
<span class="n">photo_url</span><span class="o">=</span><span class="n">photo_info</span><span class="p">[</span><span class="s2">&quot;file_url&quot;</span><span class="p">],</span>
<span class="n">caption</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">text</span> <span class="ow">or</span> <span class="s2">&quot;&quot;</span>
<span class="p">)</span>
<span class="c1"># Додати результат Vision до контексту для LLM</span>
<span class="n">enhanced_text</span> <span class="o">=</span> <span class="sa">f</span><span class="s2">&quot;</span><span class="si">{</span><span class="n">event</span><span class="o">.</span><span class="n">text</span><span class="w"> </span><span class="ow">or</span><span class="w"> </span><span class="s1">&#39;&#39;</span><span class="si">}</span><span class="se">\n\n</span><span class="s2">[VISION]: </span><span class="si">{</span><span class="n">vision_result</span><span class="si">}</span><span class="s2">&quot;</span>
<span class="n">event</span><span class="o">.</span><span class="n">text</span> <span class="o">=</span> <span class="n">enhanced_text</span>
</code></pre></div>
<h4 id="12-_analyze_photo">1.2. Додати метод <code>_analyze_photo()</code><a class="headerlink" href="#12-_analyze_photo" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="k">async</span> <span class="k">def</span><span class="w"> </span><span class="nf">_analyze_photo</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">photo_url</span><span class="p">:</span> <span class="nb">str</span><span class="p">,</span> <span class="n">caption</span><span class="p">:</span> <span class="nb">str</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="nb">str</span><span class="p">:</span>
<span class="w"> </span><span class="sd">&quot;&quot;&quot;Викликати Vision Encoder Service&quot;&quot;&quot;</span>
<span class="k">try</span><span class="p">:</span>
<span class="k">async</span> <span class="k">with</span> <span class="n">httpx</span><span class="o">.</span><span class="n">AsyncClient</span><span class="p">(</span><span class="n">timeout</span><span class="o">=</span><span class="mf">60.0</span><span class="p">)</span> <span class="k">as</span> <span class="n">client</span><span class="p">:</span>
<span class="n">response</span> <span class="o">=</span> <span class="k">await</span> <span class="n">client</span><span class="o">.</span><span class="n">post</span><span class="p">(</span>
<span class="s2">&quot;http://dagi-vision-encoder:9500/analyze&quot;</span><span class="p">,</span> <span class="c1"># TODO: перевірити endpoint</span>
<span class="n">json</span><span class="o">=</span><span class="p">{</span>
<span class="s2">&quot;image_url&quot;</span><span class="p">:</span> <span class="n">photo_url</span><span class="p">,</span>
<span class="s2">&quot;prompt&quot;</span><span class="p">:</span> <span class="n">caption</span> <span class="ow">or</span> <span class="s2">&quot;Опиши що на цьому зображенні&quot;</span>
<span class="p">}</span>
<span class="p">)</span>
<span class="n">response</span><span class="o">.</span><span class="n">raise_for_status</span><span class="p">()</span>
<span class="n">result</span> <span class="o">=</span> <span class="n">response</span><span class="o">.</span><span class="n">json</span><span class="p">()</span>
<span class="k">return</span> <span class="n">result</span><span class="o">.</span><span class="n">get</span><span class="p">(</span><span class="s2">&quot;description&quot;</span><span class="p">,</span> <span class="s2">&quot;&quot;</span><span class="p">)</span>
<span class="k">except</span> <span class="ne">Exception</span> <span class="k">as</span> <span class="n">e</span><span class="p">:</span>
<span class="n">logger</span><span class="o">.</span><span class="n">error</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;❌ Vision Encoder error: </span><span class="si">{</span><span class="n">e</span><span class="si">}</span><span class="s2">&quot;</span><span class="p">)</span>
<span class="k">return</span> <span class="s2">&quot;[Не вдалося проаналізувати зображення]&quot;</span>
</code></pre></div>
<h4 id="13-vision-encoder">1.3. Перевірити Vision Encoder сервіс<a class="headerlink" href="#13-vision-encoder" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="c1"># Перевірити чи працює</span>
docker<span class="w"> </span>ps<span class="w"> </span><span class="p">|</span><span class="w"> </span>grep<span class="w"> </span>vision-encoder
<span class="c1"># Перевірити API</span>
curl<span class="w"> </span>-X<span class="w"> </span>POST<span class="w"> </span>http://localhost:9500/analyze<span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-H<span class="w"> </span><span class="s2">&quot;Content-Type: application/json&quot;</span><span class="w"> </span><span class="se">\</span>
<span class="w"> </span>-d<span class="w"> </span><span class="s1">&#39;{&quot;image_url&quot;: &quot;https://example.com/image.jpg&quot;, &quot;prompt&quot;: &quot;Describe this image&quot;}&#39;</span>
</code></pre></div>
<p><strong>Файли для зміни</strong>:
- <code>/opt/telegram-infrastructure/telegram-gateway/app/router_handler.py</code></p>
<p><strong>Очікуваний результат</strong>:</p>
<div class="codehilite"><pre><span></span><code>Ти → 🖼️ [Фото кота] + &quot;Хто це?&quot;
Бот → На зображенні зображений рудий кіт, який сидить на підвіконні і дивиться у вікно...
</code></pre></div>
<hr />
<h3 id="2-parser-service-integration">2. <strong>Parser Service Integration</strong> 📄 (Пріоритет: 🔴 ВИСОКИЙ)<a class="headerlink" href="#2-parser-service-integration" title="Permanent link">&para;</a></h3>
<p><strong>Мета</strong>: Бот може читати PDF і відповідати на питання.</p>
<p><strong>Кроки</strong>:</p>
<h4 id="21-router_handlerpy">2.1. Оновити <code>router_handler.py</code><a class="headerlink" href="#21-router_handlerpy" title="Permanent link">&para;</a></h4>
<p>Додати обробку <code>metadata.document</code>:</p>
<div class="codehilite"><pre><span></span><code><span class="c1"># В методі _handle_telegram_event():</span>
<span class="k">if</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span> <span class="ow">and</span> <span class="s2">&quot;document&quot;</span> <span class="ow">in</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span><span class="p">:</span>
<span class="n">doc_info</span> <span class="o">=</span> <span class="n">event</span><span class="o">.</span><span class="n">metadata</span><span class="p">[</span><span class="s2">&quot;document&quot;</span><span class="p">]</span>
<span class="c1"># Викликати Parser Service</span>
<span class="n">parsed_content</span> <span class="o">=</span> <span class="k">await</span> <span class="bp">self</span><span class="o">.</span><span class="n">_parse_document</span><span class="p">(</span>
<span class="n">doc_url</span><span class="o">=</span><span class="n">doc_info</span><span class="p">[</span><span class="s2">&quot;file_url&quot;</span><span class="p">],</span>
<span class="n">file_name</span><span class="o">=</span><span class="n">doc_info</span><span class="p">[</span><span class="s2">&quot;file_name&quot;</span><span class="p">]</span>
<span class="p">)</span>
<span class="c1"># Якщо є питання - відповісти на основі parsed_content</span>
<span class="k">if</span> <span class="n">event</span><span class="o">.</span><span class="n">text</span> <span class="ow">and</span> <span class="n">event</span><span class="o">.</span><span class="n">text</span> <span class="o">!=</span> <span class="sa">f</span><span class="s2">&quot;[DOCUMENT] </span><span class="si">{</span><span class="n">doc_info</span><span class="p">[</span><span class="s1">&#39;file_name&#39;</span><span class="p">]</span><span class="si">}</span><span class="s2">&quot;</span><span class="p">:</span>
<span class="c1"># Додати parsed content до контексту</span>
<span class="n">enhanced_text</span> <span class="o">=</span> <span class="sa">f</span><span class="s2">&quot;Користувач запитує про документ &#39;</span><span class="si">{</span><span class="n">doc_info</span><span class="p">[</span><span class="s1">&#39;file_name&#39;</span><span class="p">]</span><span class="si">}</span><span class="s2">&#39;:</span><span class="se">\n</span><span class="si">{</span><span class="n">event</span><span class="o">.</span><span class="n">text</span><span class="si">}</span><span class="se">\n\n</span><span class="s2">[DOCUMENT_CONTENT]:</span><span class="se">\n</span><span class="si">{</span><span class="n">parsed_content</span><span class="p">[:</span><span class="mi">2000</span><span class="p">]</span><span class="si">}</span><span class="s2">&quot;</span>
<span class="n">event</span><span class="o">.</span><span class="n">text</span> <span class="o">=</span> <span class="n">enhanced_text</span>
<span class="k">else</span><span class="p">:</span>
<span class="c1"># Просто парсинг без питання</span>
<span class="k">await</span> <span class="n">telegram_listener</span><span class="o">.</span><span class="n">send_message</span><span class="p">(</span>
<span class="n">agent_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">agent_id</span><span class="p">,</span>
<span class="n">chat_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">chat_id</span><span class="p">,</span>
<span class="n">text</span><span class="o">=</span><span class="sa">f</span><span class="s2">&quot;✅ Документ &#39;</span><span class="si">{</span><span class="n">doc_info</span><span class="p">[</span><span class="s1">&#39;file_name&#39;</span><span class="p">]</span><span class="si">}</span><span class="s2">&#39; оброблено.</span><span class="se">\n\n</span><span class="s2">Задай питання про нього!&quot;</span>
<span class="p">)</span>
<span class="k">return</span>
</code></pre></div>
<h4 id="22-_parse_document">2.2. Додати метод <code>_parse_document()</code><a class="headerlink" href="#22-_parse_document" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="k">async</span> <span class="k">def</span><span class="w"> </span><span class="nf">_parse_document</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">doc_url</span><span class="p">:</span> <span class="nb">str</span><span class="p">,</span> <span class="n">file_name</span><span class="p">:</span> <span class="nb">str</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="nb">str</span><span class="p">:</span>
<span class="w"> </span><span class="sd">&quot;&quot;&quot;Викликати Parser Service для PDF&quot;&quot;&quot;</span>
<span class="k">try</span><span class="p">:</span>
<span class="k">async</span> <span class="k">with</span> <span class="n">httpx</span><span class="o">.</span><span class="n">AsyncClient</span><span class="p">(</span><span class="n">timeout</span><span class="o">=</span><span class="mf">90.0</span><span class="p">)</span> <span class="k">as</span> <span class="n">client</span><span class="p">:</span>
<span class="c1"># Виклик DAGI Router з mode: &quot;doc_parse&quot;</span>
<span class="n">response</span> <span class="o">=</span> <span class="k">await</span> <span class="n">client</span><span class="o">.</span><span class="n">post</span><span class="p">(</span>
<span class="sa">f</span><span class="s2">&quot;</span><span class="si">{</span><span class="bp">self</span><span class="o">.</span><span class="n">_router_url</span><span class="si">}</span><span class="s2">/route&quot;</span><span class="p">,</span>
<span class="n">json</span><span class="o">=</span><span class="p">{</span>
<span class="s2">&quot;mode&quot;</span><span class="p">:</span> <span class="s2">&quot;doc_parse&quot;</span><span class="p">,</span>
<span class="s2">&quot;agent&quot;</span><span class="p">:</span> <span class="s2">&quot;parser&quot;</span><span class="p">,</span>
<span class="s2">&quot;payload&quot;</span><span class="p">:</span> <span class="p">{</span>
<span class="s2">&quot;context&quot;</span><span class="p">:</span> <span class="p">{</span>
<span class="s2">&quot;doc_url&quot;</span><span class="p">:</span> <span class="n">doc_url</span><span class="p">,</span>
<span class="s2">&quot;file_name&quot;</span><span class="p">:</span> <span class="n">file_name</span><span class="p">,</span>
<span class="s2">&quot;output_mode&quot;</span><span class="p">:</span> <span class="s2">&quot;markdown&quot;</span> <span class="c1"># або &quot;chunks&quot; для RAG</span>
<span class="p">}</span>
<span class="p">}</span>
<span class="p">}</span>
<span class="p">)</span>
<span class="n">response</span><span class="o">.</span><span class="n">raise_for_status</span><span class="p">()</span>
<span class="n">result</span> <span class="o">=</span> <span class="n">response</span><span class="o">.</span><span class="n">json</span><span class="p">()</span>
<span class="c1"># Витягнути parsed content</span>
<span class="k">if</span> <span class="s2">&quot;data&quot;</span> <span class="ow">in</span> <span class="n">result</span> <span class="ow">and</span> <span class="s2">&quot;markdown&quot;</span> <span class="ow">in</span> <span class="n">result</span><span class="p">[</span><span class="s2">&quot;data&quot;</span><span class="p">]:</span>
<span class="k">return</span> <span class="n">result</span><span class="p">[</span><span class="s2">&quot;data&quot;</span><span class="p">][</span><span class="s2">&quot;markdown&quot;</span><span class="p">]</span>
<span class="k">return</span> <span class="n">result</span><span class="o">.</span><span class="n">get</span><span class="p">(</span><span class="s2">&quot;text&quot;</span><span class="p">,</span> <span class="s2">&quot;&quot;</span><span class="p">)</span>
<span class="k">except</span> <span class="ne">Exception</span> <span class="k">as</span> <span class="n">e</span><span class="p">:</span>
<span class="n">logger</span><span class="o">.</span><span class="n">error</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;❌ Parser Service error: </span><span class="si">{</span><span class="n">e</span><span class="si">}</span><span class="s2">&quot;</span><span class="p">)</span>
<span class="k">return</span> <span class="s2">&quot;[Не вдалося прочитати документ]&quot;</span>
</code></pre></div>
<h4 id="23-rag">2.3. Інтеграція з RAG (опційно)<a class="headerlink" href="#23-rag" title="Permanent link">&para;</a></h4>
<p>Для збереження документів у RAG:</p>
<div class="codehilite"><pre><span></span><code><span class="c1"># Після парсингу викликати RAG ingest</span>
<span class="k">await</span> <span class="n">client</span><span class="o">.</span><span class="n">post</span><span class="p">(</span>
<span class="sa">f</span><span class="s2">&quot;</span><span class="si">{</span><span class="bp">self</span><span class="o">.</span><span class="n">_router_url</span><span class="si">}</span><span class="s2">/route&quot;</span><span class="p">,</span>
<span class="n">json</span><span class="o">=</span><span class="p">{</span>
<span class="s2">&quot;mode&quot;</span><span class="p">:</span> <span class="s2">&quot;doc_parse&quot;</span><span class="p">,</span>
<span class="s2">&quot;agent&quot;</span><span class="p">:</span> <span class="s2">&quot;parser&quot;</span><span class="p">,</span>
<span class="s2">&quot;payload&quot;</span><span class="p">:</span> <span class="p">{</span>
<span class="s2">&quot;context&quot;</span><span class="p">:</span> <span class="p">{</span>
<span class="s2">&quot;doc_url&quot;</span><span class="p">:</span> <span class="n">doc_url</span><span class="p">,</span>
<span class="s2">&quot;file_name&quot;</span><span class="p">:</span> <span class="n">file_name</span><span class="p">,</span>
<span class="s2">&quot;output_mode&quot;</span><span class="p">:</span> <span class="s2">&quot;chunks&quot;</span><span class="p">,</span>
<span class="s2">&quot;ingest&quot;</span><span class="p">:</span> <span class="kc">True</span><span class="p">,</span>
<span class="s2">&quot;dao_id&quot;</span><span class="p">:</span> <span class="n">event</span><span class="o">.</span><span class="n">agent_id</span><span class="p">,</span>
<span class="s2">&quot;user_id&quot;</span><span class="p">:</span> <span class="n">event</span><span class="o">.</span><span class="n">user_id</span>
<span class="p">}</span>
<span class="p">}</span>
<span class="p">}</span>
<span class="p">)</span>
</code></pre></div>
<p><strong>Файли для зміни</strong>:
- <code>/opt/telegram-infrastructure/telegram-gateway/app/router_handler.py</code></p>
<p><strong>Очікуваний результат</strong>:</p>
<div class="codehilite"><pre><span></span><code>Ти → 📄 whitepaper.pdf
Бот → ✅ Документ &#39;whitepaper.pdf&#39; оброблено. Задай питання про нього!
Ти → &quot;Про що цей документ?&quot;
Бот → Це whitepaper проєкту MicroDAO, який описує...
</code></pre></div>
<hr />
<h3 id="3-tts-integration">3. <strong>TTS Integration</strong> 🔊 (Пріоритет: 🟡 СЕРЕДНІЙ)<a class="headerlink" href="#3-tts-integration" title="Permanent link">&para;</a></h3>
<p><strong>Мета</strong>: Бот може відповідати голосом.</p>
<p><strong>Кроки</strong>:</p>
<h4 id="31">3.1. Додати опцію для голосових відповідей<a class="headerlink" href="#31" title="Permanent link">&para;</a></h4>
<p>Користувач може вибрати режим відповіді (текст або голос).</p>
<p><strong>Варіант 1</strong>: Команда <code>/voice</code> перемикає режим</p>
<div class="codehilite"><pre><span></span><code><span class="c1"># Зберігати в Memory Service:</span>
<span class="n">user_preferences</span> <span class="o">=</span> <span class="p">{</span>
<span class="s2">&quot;reply_mode&quot;</span><span class="p">:</span> <span class="s2">&quot;voice&quot;</span> <span class="c1"># або &quot;text&quot;</span>
<span class="p">}</span>
</code></pre></div>
<p><strong>Варіант 2</strong>: Реагувати голосом на голосові</p>
<div class="codehilite"><pre><span></span><code><span class="c1"># Якщо користувач надіслав voice → відповісти voice</span>
<span class="k">if</span> <span class="n">message</span><span class="o">.</span><span class="n">voice</span> <span class="ow">or</span> <span class="n">message</span><span class="o">.</span><span class="n">audio</span><span class="p">:</span>
<span class="n">reply_mode</span> <span class="o">=</span> <span class="s2">&quot;voice&quot;</span>
<span class="k">else</span><span class="p">:</span>
<span class="n">reply_mode</span> <span class="o">=</span> <span class="s2">&quot;text&quot;</span>
</code></pre></div>
<h4 id="32-router_handlerpy">3.2. Оновити <code>router_handler.py</code><a class="headerlink" href="#32-router_handlerpy" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="k">async</span> <span class="k">def</span><span class="w"> </span><span class="nf">_send_response</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">event</span><span class="p">,</span> <span class="n">answer</span><span class="p">:</span> <span class="nb">str</span><span class="p">,</span> <span class="n">reply_mode</span><span class="p">:</span> <span class="nb">str</span> <span class="o">=</span> <span class="s2">&quot;text&quot;</span><span class="p">):</span>
<span class="k">if</span> <span class="n">reply_mode</span> <span class="o">==</span> <span class="s2">&quot;voice&quot;</span><span class="p">:</span>
<span class="c1"># Синтезувати голос через TTS</span>
<span class="n">audio_bytes</span> <span class="o">=</span> <span class="k">await</span> <span class="bp">self</span><span class="o">.</span><span class="n">_text_to_speech</span><span class="p">(</span><span class="n">answer</span><span class="p">)</span>
<span class="c1"># Відправити voice message через Telegram</span>
<span class="k">await</span> <span class="n">telegram_listener</span><span class="o">.</span><span class="n">send_voice</span><span class="p">(</span>
<span class="n">agent_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">agent_id</span><span class="p">,</span>
<span class="n">chat_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">chat_id</span><span class="p">,</span>
<span class="n">audio_bytes</span><span class="o">=</span><span class="n">audio_bytes</span>
<span class="p">)</span>
<span class="k">else</span><span class="p">:</span>
<span class="c1"># Звичайний текст</span>
<span class="k">await</span> <span class="n">telegram_listener</span><span class="o">.</span><span class="n">send_message</span><span class="p">(</span>
<span class="n">agent_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">agent_id</span><span class="p">,</span>
<span class="n">chat_id</span><span class="o">=</span><span class="n">event</span><span class="o">.</span><span class="n">chat_id</span><span class="p">,</span>
<span class="n">text</span><span class="o">=</span><span class="n">answer</span>
<span class="p">)</span>
</code></pre></div>
<h4 id="33-_text_to_speech">3.3. Додати метод <code>_text_to_speech()</code><a class="headerlink" href="#33-_text_to_speech" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="k">async</span> <span class="k">def</span><span class="w"> </span><span class="nf">_text_to_speech</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">text</span><span class="p">:</span> <span class="nb">str</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="nb">bytes</span><span class="p">:</span>
<span class="w"> </span><span class="sd">&quot;&quot;&quot;Викликати TTS Service&quot;&quot;&quot;</span>
<span class="k">try</span><span class="p">:</span>
<span class="k">async</span> <span class="k">with</span> <span class="n">httpx</span><span class="o">.</span><span class="n">AsyncClient</span><span class="p">(</span><span class="n">timeout</span><span class="o">=</span><span class="mf">60.0</span><span class="p">)</span> <span class="k">as</span> <span class="n">client</span><span class="p">:</span>
<span class="n">response</span> <span class="o">=</span> <span class="k">await</span> <span class="n">client</span><span class="o">.</span><span class="n">post</span><span class="p">(</span>
<span class="s2">&quot;http://dagi-tts:9001/tts&quot;</span><span class="p">,</span> <span class="c1"># TODO: перевірити endpoint</span>
<span class="n">json</span><span class="o">=</span><span class="p">{</span>
<span class="s2">&quot;text&quot;</span><span class="p">:</span> <span class="n">text</span><span class="p">,</span>
<span class="s2">&quot;voice&quot;</span><span class="p">:</span> <span class="s2">&quot;ukrainian_female&quot;</span> <span class="c1"># або &quot;english_male&quot;</span>
<span class="p">}</span>
<span class="p">)</span>
<span class="n">response</span><span class="o">.</span><span class="n">raise_for_status</span><span class="p">()</span>
<span class="k">return</span> <span class="n">response</span><span class="o">.</span><span class="n">content</span> <span class="c1"># Audio bytes (OGG/MP3)</span>
<span class="k">except</span> <span class="ne">Exception</span> <span class="k">as</span> <span class="n">e</span><span class="p">:</span>
<span class="n">logger</span><span class="o">.</span><span class="n">error</span><span class="p">(</span><span class="sa">f</span><span class="s2">&quot;❌ TTS error: </span><span class="si">{</span><span class="n">e</span><span class="si">}</span><span class="s2">&quot;</span><span class="p">)</span>
<span class="k">return</span> <span class="sa">b</span><span class="s2">&quot;&quot;</span> <span class="c1"># Fallback to text</span>
</code></pre></div>
<h4 id="34-send_voice-telegram_listenerpy">3.4. Додати <code>send_voice()</code> в <code>telegram_listener.py</code><a class="headerlink" href="#34-send_voice-telegram_listenerpy" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="k">async</span> <span class="k">def</span><span class="w"> </span><span class="nf">send_voice</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">agent_id</span><span class="p">:</span> <span class="nb">str</span><span class="p">,</span> <span class="n">chat_id</span><span class="p">:</span> <span class="nb">int</span><span class="p">,</span> <span class="n">audio_bytes</span><span class="p">:</span> <span class="nb">bytes</span><span class="p">):</span>
<span class="w"> </span><span class="sd">&quot;&quot;&quot;Відправити голосове повідомлення&quot;&quot;&quot;</span>
<span class="n">bot_token</span> <span class="o">=</span> <span class="n">bots_registry</span><span class="o">.</span><span class="n">get_token_by_agent</span><span class="p">(</span><span class="n">agent_id</span><span class="p">)</span>
<span class="n">bot</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_bots</span><span class="o">.</span><span class="n">get</span><span class="p">(</span><span class="n">bot_token</span><span class="p">)</span>
<span class="k">if</span> <span class="ow">not</span> <span class="n">bot</span> <span class="ow">or</span> <span class="ow">not</span> <span class="n">audio_bytes</span><span class="p">:</span>
<span class="c1"># Fallback to text</span>
<span class="k">return</span>
<span class="kn">from</span><span class="w"> </span><span class="nn">io</span><span class="w"> </span><span class="kn">import</span> <span class="n">BytesIO</span>
<span class="n">audio_file</span> <span class="o">=</span> <span class="n">BytesIO</span><span class="p">(</span><span class="n">audio_bytes</span><span class="p">)</span>
<span class="n">audio_file</span><span class="o">.</span><span class="n">name</span> <span class="o">=</span> <span class="s2">&quot;voice.ogg&quot;</span>
<span class="k">await</span> <span class="n">bot</span><span class="o">.</span><span class="n">send_voice</span><span class="p">(</span>
<span class="n">chat_id</span><span class="o">=</span><span class="n">chat_id</span><span class="p">,</span>
<span class="n">voice</span><span class="o">=</span><span class="n">audio_file</span>
<span class="p">)</span>
</code></pre></div>
<p><strong>Файли для зміни</strong>:
- <code>/opt/telegram-infrastructure/telegram-gateway/app/router_handler.py</code>
- <code>/opt/telegram-infrastructure/telegram-gateway/app/telegram_listener.py</code></p>
<p><strong>Очікуваний результат</strong>:</p>
<div class="codehilite"><pre><span></span><code>Ти → 🎤 [Голосове] &quot;Привіт&quot;
Бот → 🔊 [Голосове] &quot;Привіт! Як справи?&quot;
</code></pre></div>
<hr />
<h3 id="4-grafana-dashboards">4. <strong>Grafana Dashboards</strong> 📊 (Пріоритет: 🟢 НИЗЬКИЙ)<a class="headerlink" href="#4-grafana-dashboards" title="Permanent link">&para;</a></h3>
<p><strong>Мета</strong>: Візуалізація метрик (запити, помилки, latency).</p>
<p><strong>Кроки</strong>:</p>
<h4 id="41-daarion-services-overview">4.1. Створити дашборд "DAARION Services Overview"<a class="headerlink" href="#41-daarion-services-overview" title="Permanent link">&para;</a></h4>
<p><strong>Панелі</strong>:
1. <strong>Total Requests</strong> (counter)
- <code>rate(http_requests_total[5m])</code>
2. <strong>Request Duration</strong> (histogram)
- <code>histogram_quantile(0.95, rate(http_request_duration_seconds_bucket[5m]))</code>
3. <strong>Error Rate</strong> (%)
- <code>rate(http_requests_total{status_code=~"5.."}[5m]) / rate(http_requests_total[5m])</code>
4. <strong>Active Bots</strong> (gauge)
- Custom metric: <code>telegram_gateway_active_bots</code>
5. <strong>STT Requests</strong> (counter)
- <code>rate(http_requests_total{job="dagi-stt"}[5m])</code>
6. <strong>Router Latency</strong> (graph)
- <code>http_request_duration_seconds{job="dagi-router"}</code></p>
<h4 id="42">4.2. Створити файл дашборду<a class="headerlink" href="#42" title="Permanent link">&para;</a></h4>
<p><code>/opt/microdao-daarion/monitoring/grafana/dashboards/daarion_overview.json</code></p>
<div class="codehilite"><pre><span></span><code><span class="p">{</span>
<span class="w"> </span><span class="nt">&quot;dashboard&quot;</span><span class="p">:</span><span class="w"> </span><span class="p">{</span>
<span class="w"> </span><span class="nt">&quot;title&quot;</span><span class="p">:</span><span class="w"> </span><span class="s2">&quot;DAARION Services Overview&quot;</span><span class="p">,</span>
<span class="w"> </span><span class="nt">&quot;panels&quot;</span><span class="p">:</span><span class="w"> </span><span class="p">[</span>
<span class="w"> </span><span class="p">{</span>
<span class="w"> </span><span class="nt">&quot;title&quot;</span><span class="p">:</span><span class="w"> </span><span class="s2">&quot;Total Requests/sec&quot;</span><span class="p">,</span>
<span class="w"> </span><span class="nt">&quot;targets&quot;</span><span class="p">:</span><span class="w"> </span><span class="p">[</span>
<span class="w"> </span><span class="p">{</span>
<span class="w"> </span><span class="nt">&quot;expr&quot;</span><span class="p">:</span><span class="w"> </span><span class="s2">&quot;rate(http_requests_total[5m])&quot;</span>
<span class="w"> </span><span class="p">}</span>
<span class="w"> </span><span class="p">]</span>
<span class="w"> </span><span class="p">},</span>
<span class="w"> </span><span class="c1">// ... інші панелі</span>
<span class="w"> </span><span class="p">]</span>
<span class="w"> </span><span class="p">}</span>
<span class="p">}</span>
</code></pre></div>
<h4 id="43-grafana">4.3. Імпортувати в Grafana<a class="headerlink" href="#43-grafana" title="Permanent link">&para;</a></h4>
<div class="codehilite"><pre><span></span><code><span class="c1"># Через UI: http://144.76.224.179:3000</span>
<span class="c1"># Login: admin / admin</span>
<span class="c1"># Dashboards → Import → Upload JSON</span>
</code></pre></div>
<p><strong>Файли для створення</strong>:
- <code>/opt/microdao-daarion/monitoring/grafana/dashboards/daarion_overview.json</code>
- <code>/opt/microdao-daarion/monitoring/grafana/dashboards/telegram_bots.json</code></p>
<p><strong>Очікуваний результат</strong>:
- Красиві графіки в Grafana
- Real-time моніторинг всіх сервісів</p>
<hr />
<h2 id="_5">🗓️ Порядок імплементації<a class="headerlink" href="#_5" title="Permanent link">&para;</a></h2>
<h3 id="phase-1-vision-parser">Phase 1 (Сьогодні): Vision + Parser<a class="headerlink" href="#phase-1-vision-parser" title="Permanent link">&para;</a></h3>
<ol>
<li>✅ Vision Encoder integration (~30 хв)</li>
<li>✅ Parser Service integration (~30 хв)</li>
<li>✅ Тестування фото + PDF</li>
</ol>
<h3 id="phase-2-tts">Phase 2 (Завтра/Пізніше): TTS<a class="headerlink" href="#phase-2-tts" title="Permanent link">&para;</a></h3>
<ol>
<li>✅ TTS integration (~45 хв)</li>
<li>✅ <code>send_voice()</code> в telegram_listener</li>
<li>✅ Тестування голосових відповідей</li>
</ol>
<h3 id="phase-3-grafana">Phase 3 (Опційно): Grafana<a class="headerlink" href="#phase-3-grafana" title="Permanent link">&para;</a></h3>
<ol>
<li>✅ Створення дашбордів (~1 год)</li>
<li>✅ Налаштування alerts</li>
<li>✅ Документація</li>
</ol>
<hr />
<h2 id="summary">📝 Зміни в файлах (Summary)<a class="headerlink" href="#summary" title="Permanent link">&para;</a></h2>
<h3 id="vision-parser">Для Vision + Parser:<a class="headerlink" href="#vision-parser" title="Permanent link">&para;</a></h3>
<ul>
<li><code>telegram-gateway/app/router_handler.py</code>: +100 рядків</li>
<li><code>_analyze_photo()</code></li>
<li><code>_parse_document()</code></li>
<li>Обробка <code>metadata.photo</code> та <code>metadata.document</code></li>
</ul>
<h3 id="tts">Для TTS:<a class="headerlink" href="#tts" title="Permanent link">&para;</a></h3>
<ul>
<li><code>telegram-gateway/app/router_handler.py</code>: +50 рядків</li>
<li><code>_text_to_speech()</code></li>
<li><code>_send_response()</code> з підтримкою voice</li>
<li><code>telegram-gateway/app/telegram_listener.py</code>: +20 рядків</li>
<li><code>send_voice()</code></li>
</ul>
<h3 id="grafana">Для Grafana:<a class="headerlink" href="#grafana" title="Permanent link">&para;</a></h3>
<ul>
<li><code>monitoring/grafana/dashboards/*.json</code>: 2 нові файли</li>
</ul>
<hr />
<h2 id="_6">🚀 Готовий почати?<a class="headerlink" href="#_6" title="Permanent link">&para;</a></h2>
<p><strong>Рекомендую порядок</strong>:
1. <strong>Vision Encoder</strong> (найпростіше, одразу побачиш результат)
2. <strong>Parser Service</strong> (корисно для документів)
3. <strong>TTS</strong> (якщо треба голосові відповіді)
4. <strong>Grafana</strong> (коли все працює)</p>
<p><strong>Який пункт імплементуємо першим?</strong> 🖼️📄🔊📊</p>
<hr />
<p><em>Створено: 2025-11-18</em><br />
<em>Автор: Assistant (via Cursor)</em></p>
</article>
</div>
<script>var target=document.getElementById(location.hash.slice(1));target&&target.name&&(target.checked=target.name.startsWith("__tabbed_"))</script>
</div>
</main>
<footer class="md-footer">
<div class="md-footer-meta md-typeset">
<div class="md-footer-meta__inner md-grid">
<div class="md-copyright">
Made with
<a href="https://squidfunk.github.io/mkdocs-material/" target="_blank" rel="noopener">
Material for MkDocs
</a>
</div>
</div>
</div>
</footer>
</div>
<div class="md-dialog" data-md-component="dialog">
<div class="md-dialog__inner md-typeset"></div>
</div>
<script id="__config" type="application/json">{"base": "../..", "features": ["navigation.sections", "navigation.instant", "content.code.copy"], "search": "../../assets/javascripts/workers/search.b8dbb3d2.min.js", "translations": {"clipboard.copied": "Copied to clipboard", "clipboard.copy": "Copy to clipboard", "search.result.more.one": "1 more on this page", "search.result.more.other": "# more on this page", "search.result.none": "No matching documents", "search.result.one": "1 matching document", "search.result.other": "# matching documents", "search.result.placeholder": "Type to start searching", "search.result.term.missing": "Missing", "select.version": "Select version"}}</script>
<script src="../../assets/javascripts/bundle.3220b9d7.min.js"></script>
</body>
</html>
Reference in New Issue View Git Blame Copy Permalink