From 6844dff07dc22eba2047e47f64c505b646c8c271 Mon Sep 17 00:00:00 2001 From: happybell80 Date: Thu, 19 Mar 2026 19:33:53 +0900 Subject: [PATCH] docs(research): update Gemini Embedding 2 hybrid indexing findings --- ...ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md | 21 ++++++++++++++++++- 1 file changed, 20 insertions(+), 1 deletion(-) diff --git a/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md b/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md index 9413a62..5d475f9 100644 --- a/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md +++ b/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md @@ -330,4 +330,23 @@ tags: [research, companyx, rag, answer-composition, scenario, troubleshooting] - ~~**skill-embedding ๋ฐฐํฌ ์ด๋ฏธ์ง€์™€ ๋ ˆํฌ ์ฝ”๋“œ ์ผ์น˜ ์—ฌ๋ถ€ ๋ฏธํ™•์ธ**~~ โ†’ **ํ™•์ธ ์™„๋ฃŒ (2026-03-17)**: ํ™œ์„ฑ ์„œ๋น„์Šค๋Š” `skill-embedding-repo/`(`GeminiEmbedder`, Gemini Embedding 2 ๊ธฐ๋ฐ˜). ๋ ˆ๊ฑฐ์‹œ `skill-embedding/`(ONNX)์™€๋Š” ๋ณ„๋„ ๋ ˆํฌ. ํ•ด์†Œ. - ~~**Phase 5A ํŒŒ์ดํ”„๋ผ์ธ ์ „ํ™˜ + ์ธํ„ฐํŽ˜์ด์Šค ๊ณ„์•ฝ**~~ โ†’ **์ฝ”๋“œ ๊ตฌํ˜„ ์™„๋ฃŒ (2026-03-17)**: `task_type`(RETRIEVAL_DOCUMENT/QUERY) ์ „๋‹ฌ + `metadata` pass-through ์–‘์ชฝ(skill-embedding, skill-rag-file) ๊ตฌํ˜„. ๋ฐฐํฌ/์žฌ๊ธฐ๋™์€ ๋ฏธ์™„๋ฃŒ. -์ƒ์„ธ: [260317_companyx_grounding_์ฝ”๋“œ๊ฒ€ํ† _๋ฐ_๋ฌธ์„œํ˜„ํ–‰ํ™”](../worklog/260317_companyx_grounding_์ฝ”๋“œ๊ฒ€ํ† _๋ฐ_๋ฌธ์„œํ˜„ํ–‰ํ™”.md) +### 260317_companyx_grounding_์ฝ”๋“œ๊ฒ€ํ† _๋ฐ_๋ฌธ์„œํ˜„ํ–‰ํ™”](../worklog/260317_companyx_grounding_์ฝ”๋“œ๊ฒ€ํ† _๋ฐ_๋ฌธ์„œํ˜„ํ–‰ํ™”.md) + +--- + +## 2026-03-19 ์ตœ์‹  ๋ฆฌ์„œ์น˜: Gemini Embedding 2 ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ๊ฒ€์ƒ‰ ์ด์Šˆ ๋ฐ ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ํ•ด๊ฒฐ์ฑ… + +#### 1. ๋ฌธ์ œ ๋ฐœ๊ฒฌ (๊ด€์ธก ๋ฐ ๊ฒ€์ฆ) +* **ํ˜„์ƒ:** PDF ๋ฐ”์ด๋„ˆ๋ฆฌ ์ง์ ‘ ์ž„๋ฒ ๋”ฉ(`pdf_original_bytes`) ์‹œ, ํ…์ŠคํŠธ ์ฟผ๋ฆฌ์— ๋Œ€ํ•œ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๊ฐ€ ๋นˆ ๋ฐฐ์—ด(`[]`)๋กœ ๋ฐ˜ํ™˜๋˜๊ฑฐ๋‚˜ ์œ ์‚ฌ๋„๊ฐ€ ๊ทนํžˆ ๋‚ฎ์Œ. +* **๊ทผ๋ณธ ์›์ธ:** + - **ํŽ˜์ด์ง€ ์ œํ•œ:** Gemini Embedding 2๋Š” PDF ์ง์ ‘ ์ž„๋ฒ ๋”ฉ ์‹œ 1ํšŒ ์ตœ๋Œ€ 6ํŽ˜์ด์ง€ ์ œํ•œ์ด ์žˆ์–ด ๋Œ€ํ˜• ๋ฌธ์„œ์˜ ์ •๋ณด ์†์‹ค ๋ฐœ์ƒ. + - **๋ฒกํ„ฐ ๊ณต๊ฐ„ ํŽธ์ฐจ:** ๋ฐ”์ด๋„ˆ๋ฆฌ ๊ธฐ๋ฐ˜ ๋ฒกํ„ฐ(์‹œ๊ฐ์  ๋ฌธ๋งฅ ํฌํ•จ)์™€ ํ…์ŠคํŠธ ๊ธฐ๋ฐ˜ ์ฟผ๋ฆฌ ๋ฒกํ„ฐ ๊ฐ„์˜ ๊ณต๊ฐ„์  ๊ฑฐ๋ฆฌ๊ฐ€ ๋ฉ€์–ด ๊ธฐ์กด ๊ฒ€์ƒ‰ ์ž„๊ณ„๊ฐ’ ๋ฏธ๋‹ฌ. + +#### 2. ํ•ด๊ฒฐ ๋ฐฉ์•ˆ: ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ์ž„๋ฒ ๋”ฉ (Hybrid Indexing) +* **์ „๋žต:** ๋™์ผ PDF ๋ฌธ์„œ์— ๋Œ€ํ•ด '์›๋ณธ ๋ฐ”์ด๋„ˆ๋ฆฌ ์ž„๋ฒ ๋”ฉ(์‹œ๊ฐ์  ๋งฅ๋ฝ)'๊ณผ 'ํ…์ŠคํŠธ ์ถ”์ถœ ์ž„๋ฒ ๋”ฉ(์ •๋ฐ€ ํ‚ค์›Œ๋“œ)'์„ ๋ณ‘ํ–‰ ์ˆ˜ํ–‰. +* **์‹ค์ธก ๋ฐ์ดํ„ฐ:** ์ตœ์‹  50๊ฐœ ํ…์ŠคํŠธ ์ค‘์‹ฌ ๋ฌธ์„œ(MOU, ํˆฌ์ž๊ณ„ํš์„œ ๋“ฑ)์— ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๋ชจ๋“œ ์ ์šฉ ๊ฒฐ๊ณผ, ํ…์ŠคํŠธ ์ฟผ๋ฆฌ์— ๋Œ€ํ•œ ๊ฒ€์ƒ‰ ์ ์ค‘๋ฅ (Recall)์ด ์ •์ƒ ๋ณต๊ตฌ๋จ์„ ํ™•์ธ. + +#### 3. ๊ฒฐ๋ก  ๋ฐ ํ–ฅํ›„ ์กฐ์น˜ +* **์ธ๋ฑ์‹ฑ ํŒŒ์ดํ”„๋ผ์ธ ์ˆ˜์ •:** `IndexingPipelineService`๋ฅผ ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๋ชจ๋“œ๋กœ ์ƒ์‹œ ์ „ํ™˜ (๋ฐฐํฌ ์™„๋ฃŒ). +* **์žฌ์ธ๋ฑ์‹ฑ:** ๊ธฐ์กด Company X์˜ ํ…์ŠคํŠธ ๋ฐ€์ง‘ ๋ฌธ์„œ๋“ค์„ ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๋ฐฉ์‹์œผ๋กœ ์žฌ์ธ๋ฑ์‹ฑํ•˜์—ฌ RAG ๋‹ต๋ณ€ ํ•ฉ์„ฑ์˜ '๊ทผ๊ฑฐ ๋ฐ์ดํ„ฐ' ์‹ ๋ขฐ์„ฑ ํšŒ๋ณต. +