From a6fda1b0244d7e03df51bb83a970ab9506b0db80 Mon Sep 17 00:00:00 2001 From: Claude-51124 Date: Sun, 15 Mar 2026 08:59:38 +0900 Subject: [PATCH] Document Company X grounding closure path --- .../311_backend_coding_principles.md | 48 +++++ book/600_appendix/650_์šฉ์–ด์ง‘.md | 6 + ...€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md | 138 +++++++++++++ journey/plans/README.md | 5 + ...ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md | 192 ++++++++++++++++++ journey/research/README.md | 1 + ...ธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md | 24 +++ ...panyx_rag_answer_composition_regression.md | 30 +++ 8 files changed, 444 insertions(+) create mode 100644 journey/plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md create mode 100644 journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md diff --git a/book/300_architecture/311_backend_coding_principles.md b/book/300_architecture/311_backend_coding_principles.md index 620540d..d4a3af9 100644 --- a/book/300_architecture/311_backend_coding_principles.md +++ b/book/300_architecture/311_backend_coding_principles.md @@ -321,6 +321,14 @@ utils - โŒ ๋ณต์žกํ•œ ๊ทœ์น™ ์ฒด์ธ ๊ตฌ์ถ• (LLM์ด ๋” ์ •ํ™•ํ•˜๊ณ  ์œ ์ง€๋ณด์ˆ˜ ์šฉ์ด) - โŒ ์ƒˆ๋กœ์šด ํŒจํ„ด๋งˆ๋‹ค ๊ทœ์น™ ์ถ”๊ฐ€ํ•˜๋Š” ๋ฐฉ์‹ (LLM์ด ์ž๋™์œผ๋กœ ์ฒ˜๋ฆฌ) - โŒ "๊ทœ์น™์œผ๋กœ ์ฒ˜๋ฆฌ ๊ฐ€๋Šฅํ•˜๋ฉด ๊ทœ์น™ ์‚ฌ์šฉ" ์‚ฌ๊ณ ๋ฐฉ์‹ (LLM ์šฐ์„  ์‚ฌ๊ณ ) +- โŒ ์งˆ๋ฌธ๋ณ„ `if` ๋ถ„๊ธฐ์™€ ์งˆ๋ฌธ๋ณ„ ํ”„๋กฌํ”„ํŠธ/๋‹ต๋ณ€ ๋ฌธ์žฅ์„ ์ฝ”๋“œ์— ๋ˆ„์ ํ•ด ์‹œ๋‚˜๋ฆฌ์˜ค๋ฅผ ๋‹ซ๋Š” ๋ฐฉ์‹ +- โŒ ๋Œ€ํ‘œ ์งˆ๋ฌธ ๋ช‡ ๊ฐœ๋งŒ ํ†ต๊ณผ์‹œํ‚ค๋Š” ํŠน๋ก€ ์ฒ˜๋ฆฌ๋กœ `์™„๋ฃŒ` ํŒ๋‹จํ•˜๋Š” ๋ฐฉ์‹ +- โŒ `๊ฒ€์ƒ‰ hit ์žˆ์Œ = ์„ฑ๊ณต`์ฒ˜๋Ÿผ ์ทจ๊ธ‰ํ•˜๊ณ  ์งˆ๋ฌธ ์ ํ•ฉ๋„/๊ทผ๊ฑฐ ๋ถ€์กฑ ํŒ์ •์„ ์ƒ๋žตํ•˜๋Š” ๋ฐฉ์‹ + +### ์ถ”๊ฐ€ ๊ฐ•์ œ ๊ทœ์น™ +- LLM/RAG ์‘๋‹ต ๊ฒฝ๋กœ๋Š” `์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ`, `๊ทผ๊ฑฐ ์ฑ„ํƒ ๊ทœ์น™`, `๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ์‹คํŒจ ๊ทœ์น™`์„ ๊ณตํ†ต ๊ตฌ์กฐ๋กœ ๋จผ์ € ์ •์˜ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ์ด ๋Š˜์–ด๋‚ ์ˆ˜๋ก ๋ถ„๊ธฐ์™€ ํ”„๋กฌํ”„ํŠธ๊ฐ€ ๋Š˜์–ด๋‚˜๋Š” ๊ตฌ์กฐ๋Š” ์„ค๊ณ„ ์‹คํŒจ๋กœ ๊ฐ„์ฃผํ•ฉ๋‹ˆ๋‹ค. +- ํŠน์ • ์งˆ๋ฌธ ๋Œ€์‘์ด ํ•„์š”ํ•˜๋ฉด ์งˆ๋ฌธ๋ณ„ ํŠน๋ก€๋ฅผ ์ถ”๊ฐ€ํ•˜๊ธฐ ์ „์— ๊ณตํ†ต ๊ณ„์•ฝ์œผ๋กœ ์˜ฌ๋ฆด ์ˆ˜ ์—†๋Š”์ง€ ๋จผ์ € ๊ฒ€ํ† ํ•ฉ๋‹ˆ๋‹ค. ### ์žฅ์  - **์œ ์—ฐ์„ฑ**: ์ƒˆ๋กœ์šด ํŒจํ„ด์— ๋Œ€ํ•œ ๊ทœ์น™ ์ถ”๊ฐ€ ์—†์ด LLM์ด ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ์ฒ˜๋ฆฌ @@ -400,6 +408,46 @@ utils - **์‹ค์ œ ํ…Œ์ŠคํŠธ ํ•„์ˆ˜**: ์ฝ”๋“œ ์ˆ˜์ • ํ›„ ์ถ”์ธกํ•˜์ง€ ๋ง๊ณ  ์‹ค์ œ๋กœ ํ…Œ์ŠคํŠธ (curl, Slack ์ง์ ‘ ์‚ฌ์šฉ, DB ์กฐํšŒ) - **์ปจํ…Œ์ด๋„ˆ ํ…Œ์ŠคํŠธ ํŒŒ์ผ ๋ฐ˜์˜**: tests ๋””๋ ‰ํ† ๋ฆฌ๋Š” ๋ณผ๋ฅจ ๋งˆ์šดํŠธ ์•„๋‹˜ (๋นŒ๋“œ ์‹œ COPY). ์ƒˆ ํ…Œ์ŠคํŠธ ํŒŒ์ผ ์ถ”๊ฐ€ ์‹œ `docker cp [ํŒŒ์ผ๊ฒฝ๋กœ] [์ปจํ…Œ์ด๋„ˆ๋ช…]:/code/tests/` ์‚ฌ์šฉ ๋˜๋Š” ์ปจํ…Œ์ด๋„ˆ ์žฌ๋นŒ๋“œ +## 18-1. ๋ณ€๊ฒฝ ์‹คํ–‰ ์›Œํฌํ”Œ๋กœ์šฐ + +**ํ•ต์‹ฌ ์›์น™**: ๋ณ€๊ฒฝ์€ `๊ณ„ํš -> ๊ตฌํ˜„ -> ํ…Œ์ŠคํŠธ -> push -> ๋ฐฐํฌ ๋Œ€๊ธฐ -> ์‹ค์ œ ๊ฒ€์ฆ -> worklog` ์ˆœ์„œ๋ฅผ ๊ธฐ๋ณธ์œผ๋กœ ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. + +### ๊ธฐ๋ณธ ์ˆœ์„œ +1. **๊ณ„ํš ํ™•์ธ** +- ์—ด๋ฆฐ `troubleshooting/scenario`์™€ ๋Œ€์‘ `research/plans`๋ฅผ ๋จผ์ € ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. +- ์ด๋ฒˆ ๋ณ€๊ฒฝ์ด ์–ด๋–ค ๋ฌธ์„œ๋ฅผ ๋‹ซ๊ธฐ ์œ„ํ•œ ์‹คํ–‰์ธ์ง€ ๋จผ์ € ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. + +2. **๊ตฌํ˜„** +- ๊ณ„ํš ๋ฒ”์œ„ ์•ˆ์—์„œ๋งŒ ์ˆ˜์ •ํ•ฉ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ ํŠน๋ก€ ํ•˜๋“œ์ฝ”๋”ฉ, ๊ด‘๋ฒ”์œ„ ํด๋ฐฑ, ์ž„์‹œ ์šฐํšŒ๋กœ ๋‹ซ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + +3. **ํ…Œ์ŠคํŠธ** +- ๊ด€๋ จ ๋‹จ์œ„ ํ…Œ์ŠคํŠธ, ํ†ตํ•ฉ ํ…Œ์ŠคํŠธ, ์ตœ์†Œ ์žฌํ˜„ ์งˆ๋ฌธ์…‹์„ ๋จผ์ € ๋Œ๋ฆฝ๋‹ˆ๋‹ค. +- ๊ฐ€๋Šฅํ•˜๋ฉด ์‹คํŒจ ์ผ€์ด์Šค๋„ ํ•จ๊ป˜ ๊ฒ€์ฆํ•ฉ๋‹ˆ๋‹ค. + +4. **push** +- ์ž๋™ ๋ฐฐํฌ ๋ ˆํฌ๋Š” `git push origin main`์„ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. +- ์ˆ˜๋™ ๋ฐฐํฌ ๋ ˆํฌ๋Š” ํ•ด๋‹น ์„œ๋น„์Šค ๋ฐฐํฌ ์ ˆ์ฐจ๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค. + +5. **๋ฐฐํฌ ๋Œ€๊ธฐ** +- Actions/๋ฐฐํฌ ํŒŒ์ดํ”„๋ผ์ธ ์™„๋ฃŒ๋ฅผ ๊ธฐ๋‹ค๋ฆฝ๋‹ˆ๋‹ค. +- ์„ฑ๊ณต ๋ฉ”์‹œ์ง€๋งŒ์œผ๋กœ ์™„๋ฃŒ ํŒ๋‹จํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + +6. **์‹ค์ œ ๊ฒ€์ฆ** +- `docker ps`, ํ—ฌ์Šค์ฒดํฌ, ์‹ค์ œ API ์‘๋‹ต, ์‹ค์ œ ๋กœ๊ทธ๋ฅผ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. +- ์ด๋ฒˆ ๋ณ€๊ฒฝ์˜ ์žฌํ˜„ ์งˆ๋ฌธ์…‹/์‹œ๋‚˜๋ฆฌ์˜ค ๊ธฐ์ค€ ์งˆ๋ฌธ์„ ์šด์˜ ๊ฒฝ๋กœ์—์„œ ๋‹ค์‹œ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. + +7. **๋ฌธ์„œ ๋งˆ๊ฐ** +- ๋ฌธ์ œ ์—†์ด ๋๋‚ฌ์œผ๋ฉด `worklog`๋ฅผ ๋‚จ๊น๋‹ˆ๋‹ค. +- ์‹คํ–‰ ์ค‘ ์ƒˆ ๋ฌธ์ œ๊ฐ€ ์ƒ๊ธฐ๋ฉด `worklog`๊ฐ€ ์•„๋‹ˆ๋ผ `troubleshooting`์œผ๋กœ ๋˜๋Œ๋ฆฝ๋‹ˆ๋‹ค. +- `plans`๋Š” ์™„๋ฃŒ ๋ณด๊ณ ์„œ๋กœ ๊ธธ๊ฒŒ ๋ฎ์–ด์“ฐ์ง€ ์•Š๊ณ , ์ƒํƒœ์™€ ์—ฐ๊ฒฐ ๋ฌธ์„œ๋งŒ ๊ฐฑ์‹ ํ•ฉ๋‹ˆ๋‹ค. + +### ์™„๋ฃŒ ๊ธˆ์ง€ ๊ธฐ์ค€ +- ํ…Œ์ŠคํŠธ ์ „ `push`ํ•˜๊ณ  ๋๋ƒˆ๋‹ค๊ณ  ๋งํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ๋ฐฐํฌ ์™„๋ฃŒ ๋ฉ”์‹œ์ง€๋งŒ ๋ณด๊ณ  ๋๋ƒˆ๋‹ค๊ณ  ๋งํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ์‹ค์ œ ์žฌํ˜„ ์งˆ๋ฌธ/์‹ค์ œ ์‘๋‹ต/์‹ค์ œ ๋กœ๊ทธ ํ™•์ธ ์—†์ด `ํ•ด๊ฒฐ`์ด๋ผ๊ณ  ๋งํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ๋ฌธ์ œ๊ฐ€ ๋‚จ์•„ ์žˆ์œผ๋ฉด `worklog`๋กœ ๋ณด๋‚ด์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + ## 19. ๋ฆฌํŒฉํ† ๋ง ์‹œ ๋กœ์ง ์ƒ์‹ค ๋ฐฉ์ง€ ์›์น™ ### ํ•„์ˆ˜ ์ฒดํฌ๋ฆฌ์ŠคํŠธ (์ฝ”๋“œ ์ด๋™/๋ฆฌํŒฉํ† ๋ง ์ „) diff --git a/book/600_appendix/650_์šฉ์–ด์ง‘.md b/book/600_appendix/650_์šฉ์–ด์ง‘.md index 78d3537..451853f 100644 --- a/book/600_appendix/650_์šฉ์–ด์ง‘.md +++ b/book/600_appendix/650_์šฉ์–ด์ง‘.md @@ -19,6 +19,12 @@ LLM ์ถœ๋ ฅ์„ ํ›„์ฒ˜๋ฆฌํ•˜์—ฌ ๋กœ๋น™์˜ ๊ณ ์œ ํ•œ ์„ฑ๊ฒฉ๊ณผ ์œค๋ฆฌ์  ๊ธฐ์ค€์„ ### ๊ฒฝํ—˜์น˜ (Experience Points, XP) ๋กœ๋น™์ด ์ž‘์—…์„ ์ˆ˜ํ–‰ํ•˜๊ฑฐ๋‚˜ ์‚ฌ์šฉ์ž์™€ ์ƒํ˜ธ์ž‘์šฉํ•  ๋•Œ ํš๋“ํ•˜๋Š” ํฌ์ธํŠธ. ์ผ์ •๋Ÿ‰ ๋ˆ„์  ์‹œ ๋ ˆ๋ฒจ์—…์ด ๋ฐœ์ƒํ•จ. +### ๊ณตํ†ต ๊ณ„์•ฝ (Common Contract) +ํŠน์ • ๊ธฐ๋Šฅ ๊ฒฝ๋กœ๊ฐ€ ๋”ฐ๋ผ์•ผ ํ•˜๋Š” ๊ณตํ†ต `์ž…๋ ฅ-ํŒ๋‹จ-์ถœ๋ ฅ` ์•ฝ์†. ์งˆ๋ฌธ๋ณ„ ์˜ˆ์™ธ ๋ฌธ์žฅ์„ ๊ณ„์† ์ถ”๊ฐ€ํ•˜๋Š” ๋Œ€์‹ , ์งˆ๋ฌธ ์œ ํ˜• ๋ถ„๋ฅ˜, ๊ทผ๊ฑฐ ์ฑ„ํƒ ๊ธฐ์ค€, ์‹คํŒจ ์กฐ๊ฑด ๊ฐ™์€ ๊ทœ์น™์„ ํ•œ ๋ฒˆ ์ •์˜ํ•ด ์ฝ”๋“œยทํ”„๋กฌํ”„ํŠธยทํ…Œ์ŠคํŠธ๊ฐ€ ํ•จ๊ป˜ ๋”ฐ๋ฅด๋„๋ก ๊ณ ์ •ํ•œ ๊ธฐ์ค€์„ ๋œปํ•œ๋‹ค. +๊ด€๋ จ ๋ฌธ์„œ: +- [311_backend_coding_principles.md](../300_architecture/311_backend_coding_principles.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜](../../journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md) + ## ใ„ท ### ๋””์ง€ํ„ธ ๋™๋ฃŒ (Digital Colleague) diff --git a/journey/plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md b/journey/plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md new file mode 100644 index 0000000..05a578d --- /dev/null +++ b/journey/plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md @@ -0,0 +1,138 @@ +--- +tags: [plans, companyx, rag, answer-composition, scenario, troubleshooting] +--- + +# Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๊ณ„ํš + +**์ž‘์„ฑ์ผ**: 2026-03-15 +**์ƒํƒœ**: planned +**๋ชฉํ‘œ**: Company X ๋‚ด๋ถ€๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ๊ฒฝ๋กœ๋ฅผ `๋Œ€ํ‘œ ์งˆ๋ฌธ ํŠน๋ก€ ์ฒ˜๋ฆฌ`์—์„œ `๊ณตํ†ต ๊ณ„์•ฝ ๊ธฐ๋ฐ˜ ๋‹ต๋ณ€ํ•ฉ์„ฑ` ๊ตฌ์กฐ๋กœ ๋ฐ”๊ฟ”, ๋Œ€์‘ troubleshooting ๋ฌธ์„œ์™€ scenario ๋ฌธ์„œ๋ฅผ ํ•จ๊ป˜ ๋‹ซ์Šต๋‹ˆ๋‹ค. + +## ๊ด€๋ จ ๋ฌธ์„œ +- [Company X RAG ๋‹ต๋ณ€ ํ•ฉ์„ฑ ํšŒ๊ท€](../troubleshooting/260312_companyx_rag_answer_composition_regression.md) +- [Company X ๋‚ด๋ถ€ ๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ์‚ฌ์šฉ์ž ์‹œ๋‚˜๋ฆฌ์˜ค](../scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜](../research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md) +- [Company X RAG ์Šคํ‚ฌ ๋ฌธ์„œ](../../skills/companyx-rag/SKILL.md) + +## 1. ์ด๋ฒˆ ๊ณ„ํš์˜ ๊ฒฐ์ • +- ์ด ๋ฌธ์ œ๋Š” `๊ฒ€์ƒ‰ ์ธํ”„๋ผ ํ™•์žฅ`๋ณด๋‹ค `๋‹ต๋ณ€ ํ•ฉ์„ฑ ๊ณ„์•ฝ ๋ถ€์žฌ` ๋ฌธ์ œ๋กœ ๋‹ค๋ฃน๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ `if` ๋ถ„๊ธฐ, ์งˆ๋ฌธ๋ณ„ direct answer, ์งˆ๋ฌธ๋ณ„ ํ”„๋กฌํ”„ํŠธ ์ถ”๊ฐ€๋กœ ๋‹ซ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- `Company X grounding` ๊ฒฝ๋กœ์— ๊ณตํ†ต ๊ณ„์•ฝ 3๊ฐœ๋ฅผ ๋จผ์ € ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. + 1. ์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ + 2. ๊ทผ๊ฑฐ ์ฑ„ํƒ ๊ณ„์•ฝ + 3. ๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ์‹คํŒจ ๊ณ„์•ฝ +- ์„ฑ๊ณต ๊ธฐ์ค€์€ `๊ฒ€์ƒ‰ hit ์กด์žฌ`๊ฐ€ ์•„๋‹ˆ๋ผ `์ง์ ‘ ๋‹ต + ์งˆ๋ฌธ ์ ํ•ฉ ๊ทผ๊ฑฐ ๋˜๋Š” ๋ช…์‹œ์  ๋ถ€์กฑ ์•ˆ๋‚ด`๋กœ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค. + +## 2. ๋ฒ”์œ„ +- ํฌํ•จ: + - `rb8001/app/services/companyx_grounding_service.py` + - Company X ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ์˜ ์‘๋‹ต ๊ณ„์•ฝ + - `SKILL.md`์™€ ์ฝ”๋“œ ๊ณ„์•ฝ ์ •ํ•ฉํ™” + - ํ…Œ์ŠคํŠธ ๋ณด๊ฐ• +- ์ œ์™ธ: + - Company X ์ „์ฒด ๋ฌธ์„œ์…‹ ๋Œ€๊ทœ๋ชจ ํ™•๋Œ€ + - ๋‹ค๋ฅธ RAG ๊ฒฝ๋กœ ๊ณตํ†ตํ™” + - Prompt DB ์ „๋ฉดํ™” + - `skill-rag-file` ์ž์ฒด ๋ฆฌํŒฉํ† ๋ง + +## 3. ๊ณตํ†ต ๊ณ„์•ฝ ๊ณ ์ •์•ˆ + +### A. ์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ +- ์ตœ์†Œ ์œ ํ˜•์€ ์•„๋ž˜ 4๊ฐœ๋กœ ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. + - ์„ค๋ช…ํ˜• + - ์‚ฌ์‹ค ํ™•์ธํ˜• + - ์ˆ˜์น˜ ํ™•์ธํ˜• + - ์žฌ์ •๋ฆฌํ˜• +- ํŒ๋‹จ ๊ฒฐ๊ณผ๋Š” ์ฝ”๋“œ ๋‚ด๋ถ€ enum ๋˜๋Š” ๋™๋“ฑํ•œ ์ƒ์ˆ˜๋กœ ๋‹ค๋ฃน๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ ๋ฌธ์ž์—ด ํŠน๋ก€๊ฐ€ ์•„๋‹ˆ๋ผ ์œ ํ˜•๋ณ„ ์ฒ˜๋ฆฌ๋กœ ๋ฌถ์Šต๋‹ˆ๋‹ค. + +### B. ๊ทผ๊ฑฐ ์ฑ„ํƒ ๊ณ„์•ฝ +- ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๊ฐ€ ์žˆ๋‹ค๊ณ  ๋ฐ”๋กœ ๊ทผ๊ฑฐ๋กœ ์ฑ„ํƒํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ์ฑ„ํƒ ๊ธฐ์ค€: + - ์งˆ๋ฌธ์˜ ํ•ต์‹ฌ ์—”ํ‹ฐํ‹ฐ์™€ ์ง์ ‘ ๊ด€๋ จ์ด ์žˆ์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + - ์งˆ๋ฌธ ์œ ํ˜•์— ๋งž๋Š” ๋ฌธ์„œ์—ฌ์•ผ ํ•ฉ๋‹ˆ๋‹ค. + - ์ƒ์œ„ ๊ฒฐ๊ณผ๋ผ๋„ ์งˆ๋ฌธ๊ณผ ๋ฌด๊ด€ํ•˜๋ฉด ๋ฒ„๋ฆฝ๋‹ˆ๋‹ค. +- `relevance_score`๋Š” ํ›„๋ณด ์‹ ํ˜ธ์ผ ๋ฟ, ์ตœ์ข… ์„ฑ๊ณต ํŒ์ • ๊ธฐ์ค€์ด ์•„๋‹™๋‹ˆ๋‹ค. + +### C. ์‹คํŒจ ๊ณ„์•ฝ +- ์•„๋ž˜ ๊ฒฝ์šฐ๋Š” ์„ฑ๊ณต์ฒ˜๋Ÿผ ๋ฐ˜ํ™˜ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + - ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ 0๊ฐœ + - ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋Š” ์žˆ์œผ๋‚˜ ์งˆ๋ฌธ๊ณผ ๋ฌด๊ด€ + - ์ˆ˜์น˜/๊ทœ์ • ์งˆ๋ฌธ์ธ๋ฐ ๋‹จ์ • ๊ฐ€๋Šฅํ•œ ๊ทผ๊ฑฐ๊ฐ€ ์—†์Œ +- ์‹คํŒจ ์‘๋‹ต์€ ์•„๋ž˜ ์…‹ ์ค‘ ํ•˜๋‚˜๋กœ ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. + - `๋ฌธ์„œ ์—†์Œ` + - `์งˆ๋ฌธ๊ณผ ๋งž๋Š” ๋ฌธ์„œ ๋ฏธํ™•์ธ` + - `๋‚ด๋ถ€ ๋ฌธ์„œ๋งŒ์œผ๋กœ๋Š” ๋‹จ์ • ๋ถˆ๊ฐ€` + +## 4. ๊ตฌํ˜„ ์›์น™ +- `SKILL.md`์˜ ๋‹ต๋ณ€ ์ˆœ์„œ(`direct answer -> evidence documents -> short evidence summary`)๋ฅผ ์ฝ”๋“œ ๊ณ„์•ฝ์œผ๋กœ ๋‚ด๋ฆฝ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ direct answer ํ•˜๋“œ์ฝ”๋”ฉ์„ ๋” ๋Š˜๋ฆฌ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ ์œ ํ˜• ํŒ์ •๊ณผ ๊ทผ๊ฑฐ ์ฑ„ํƒ ํŒ์ •์€ ๋ณ„๋„ ํ•จ์ˆ˜๋กœ ๋ถ„๋ฆฌํ•ฉ๋‹ˆ๋‹ค. +- `๊ฒ€์ƒ‰๋จ`๊ณผ `๋‹ตํ•  ์ˆ˜ ์žˆ์Œ`์„ ๊ฐ™์€ ์ƒํƒœ๋กœ ์ทจ๊ธ‰ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ๋ฉ”ํƒ€ ๋Œ€ํ™”(`์–ด๋–ค ๋ถ€๋ถ„์ด ๋” ํ•„์š”ํ•˜์‹ ์ง€...`)๋Š” ์‹คํŒจ ๊ธฐ๋ณธ ๊ฒฝ๋กœ๋กœ ์‚ฌ์šฉํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + +## 5. ๊ตฌํ˜„ ๋‹จ๊ณ„ + +### Phase 1. ๊ตฌ์กฐ ๋ถ„๋ฆฌ +- `companyx_grounding_service`์—์„œ ์•„๋ž˜ ์ฑ…์ž„์„ ๋ถ„๋ฆฌํ•ฉ๋‹ˆ๋‹ค. + - ์งˆ๋ฌธ ์œ ํ˜• ํŒ์ • + - query candidate ์ƒ์„ฑ + - retrieval ๊ฒฐ๊ณผ ์ˆ˜์ง‘ + - ๊ทผ๊ฑฐ ์ฑ„ํƒ ํŒ์ • + - direct answer ์ƒ์„ฑ + - failure answer ์ƒ์„ฑ +- ๋ชฉํ‘œ: + - ํ˜„์žฌ ์งˆ๋ฌธ๋ณ„ ํŠน๋ก€ ๋ถ„๊ธฐ์™€ generic fallback์ด ์–ด๋””์„œ ์ž‘๋™ํ•˜๋Š”์ง€ ์ฝ”๋“œ์ƒ ๊ฒฝ๊ณ„๋ฅผ ๋ช…ํ™•ํžˆ ๋‚˜๋ˆ•๋‹ˆ๋‹ค. + +### Phase 2. ์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ ๋„์ž… +- ์ตœ์†Œ 4๊ฐœ ์œ ํ˜• ๋ถ„๋ฅ˜ ํ•จ์ˆ˜๋ฅผ ์ถ”๊ฐ€ํ•ฉ๋‹ˆ๋‹ค. +- ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ๋Š” ๊ฐ ์œ ํ˜•์— ๋ช…์‹œ ๋งคํ•‘๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. + - `์ปดํผ๋‹ˆ์—‘์Šค์˜ ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?` -> ์ˆ˜์น˜ ํ™•์ธํ˜• + - `๊ทธ๋Ÿผ ์ปดํผ๋‹ˆ์—‘์Šค ๋‚ด๋ถ€ ๊ทœ์ • ์ƒ ํœด๊ฐ€๋Š” ์–ผ๋งˆ๋‚˜ ์“ธ ์ˆ˜ ์žˆ์–ด?` -> ์‚ฌ์‹ค ํ™•์ธํ˜• ๋˜๋Š” ๊ทœ์ • ํ™•์ธํ˜• ์„ฑ๊ฒฉ + - `์˜ค๋Š˜์ „ํ†ต ํ”„๋กœ๊ทธ๋žจ์„ Company X๊ฐ€ ์˜๋กœํŽ€์น˜๋ž‘ ๊ฐ™์ด ์šด์˜ํ•œ๋‹ค๋Š” ๊ทผ๊ฑฐ ์žˆ์–ด?` -> ์‚ฌ์‹ค ํ™•์ธํ˜• + +### Phase 3. ๊ทผ๊ฑฐ ์ฑ„ํƒ ํŒ์ • ์ถ”๊ฐ€ +- ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ๊ทธ๋Œ€๋กœ ์ƒ์œ„ 3๊ฐœ ๋…ธ์ถœํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ ์œ ํ˜•์— ๋งž์ง€ ์•Š๋Š” ์ฒญํฌ๋Š” ๋ฒ„๋ฆฝ๋‹ˆ๋‹ค. +- ํ•„์š” ์ตœ์†Œ ํŒ์ •: + - ์—”ํ‹ฐํ‹ฐ ์ผ์น˜ ์—ฌ๋ถ€ + - ๋ฌธ์„œ ์„ฑ๊ฒฉ ์ผ์น˜ ์—ฌ๋ถ€ + - ๋‹ต๋ณ€ ๊ฐ€๋Šฅ ๊ทผ๊ฑฐ์ธ์ง€ ์—ฌ๋ถ€ +- `ํœด๊ฐ€` ์งˆ๋ฌธ์— `todaytradition` ์ฒญํฌ๊ฐ€ ์žกํžˆ๋Š” ๊ฒฝ์šฐ๋Š” `๋ฌด๊ด€ํ•œ ๊ฒฐ๊ณผ`๋กœ ์‹คํŒจ ์ฒ˜๋ฆฌํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + +### Phase 4. direct/failure ์‘๋‹ต ๊ณ„์•ฝ ์žฌ๊ตฌ์„ฑ +- direct answer๋Š” ์œ ํ˜•๋ณ„ ํ…œํ”Œ๋ฆฟ๊ณผ ์ฑ„ํƒ๋œ ๊ทผ๊ฑฐ ์ƒํƒœ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ ํ•˜๋“œ์ฝ”๋”ฉ ๋ฌธ์žฅ์„ ์ถ”๊ฐ€ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- failure answer๋Š” `๋ฌธ์„œ ์—†์Œ / ๋ฌธ์„œ ๋ฏธํ™•์ธ / ๋‹จ์ • ๋ถˆ๊ฐ€` ์ค‘ ํ•˜๋‚˜๋กœ ๋ถ„๋ช…ํžˆ ๋–จ์–ด์ ธ์•ผ ํ•ฉ๋‹ˆ๋‹ค. + +### Phase 5. ํ…Œ์ŠคํŠธ ๊ณ ์ • +- ์ตœ์†Œ ํ…Œ์ŠคํŠธ: + - ๋Œ€ํ‘œ ์„ฑ๊ณต ์งˆ๋ฌธ์€ ๊ณ„์† ์„ฑ๊ณต + - ํˆฌ์ž์‚ฌ ์งˆ๋ฌธ์€ generic ๋ฌธ์žฅ ๊ธˆ์ง€ + - ํœด๊ฐ€ ์งˆ๋ฌธ์€ ๋ฌด๊ด€ํ•œ ์ฒญํฌ ๋ฐ˜ํ™˜ ๊ธˆ์ง€ + - ๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ๋ช…์‹œ์  ์‹คํŒจ ์‘๋‹ต + - ์žฌ์ •๋ฆฌํ˜• ์งˆ๋ฌธ์€ ๊ทผ๊ฑฐ ๋ชฉ๋ก ์žฌ์‚ฌ์šฉ ๋˜๋Š” ์žฌ๊ตฌ์„ฑ +- ํ…Œ์ŠคํŠธ๋Š” ์งˆ๋ฌธ๋ณ„ ์˜ˆ์™ธ ์„ฑ๊ณต์ด ์•„๋‹ˆ๋ผ ๊ณตํ†ต ๊ณ„์•ฝ ์ค€์ˆ˜ ์—ฌ๋ถ€๋ฅผ ๊ฒ€์ฆํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + +## 6. ๊ฒ€์ฆ ๊ธฐ์ค€ +- ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ์—์„œ ์•„๋ž˜๊ฐ€ ํ™•์ธ๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. + 1. ์ง์ ‘ ๋‹ต์ด ๋จผ์ € ๋‚˜์˜จ๋‹ค. + 2. ์งˆ๋ฌธ๊ณผ ๋งž๋Š” ๊ทผ๊ฑฐ๋งŒ ๋ถ™๋Š”๋‹ค. + 3. ๊ทผ๊ฑฐ๊ฐ€ ๋ถ€์กฑํ•˜๋ฉด ๋ช…์‹œ์ ์œผ๋กœ ๋ถ€์กฑํ•˜๋‹ค๊ณ  ๋‹ตํ•œ๋‹ค. +- `๊ฒ€์ƒ‰ hit ์žˆ์Œ = success` ๊ฒฝ๋กœ๊ฐ€ ์ œ๊ฑฐ๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ๋ณ„ ํŠน๋ก€ ์ถ”๊ฐ€ ์—†์ด๋„ ์žฌ์˜คํ”ˆ ์งˆ๋ฌธ์…‹์ด ํ†ต๊ณผํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- `SKILL.md` ์š”๊ตฌ์‚ฌํ•ญ๊ณผ ์‹ค์ œ ์‘๋‹ต ํ˜•์‹์ด ์ผ์น˜ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + +## 7. ์™„๋ฃŒ ํŒ์ • ๊ธฐ์ค€ +1. [260312_companyx_rag_answer_composition_regression.md](../troubleshooting/260312_companyx_rag_answer_composition_regression.md)์—์„œ ์ •์˜ํ•œ ์žฌํ˜„ ์งˆ๋ฌธ์…‹์ด ๋” ์ด์ƒ ํšŒ๊ท€ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +2. [260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md](../scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md)์˜ ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ๊ฐ€ ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ๋ฅผ ๋งŒ์กฑํ•ฉ๋‹ˆ๋‹ค. +3. `companyx_grounding_service`์— ์งˆ๋ฌธ๋ณ„ direct answer ํŠน๋ก€๋ฅผ ์ถ”๊ฐ€ํ•˜์ง€ ์•Š๊ณ  ๊ณตํ†ต ๊ณ„์•ฝ ๊ตฌ์กฐ๋กœ ๋ฐ”๋€๋‹ˆ๋‹ค. +4. ํ…Œ์ŠคํŠธ๊ฐ€ ์ถ”๊ฐ€๋˜๊ณ  ํ†ต๊ณผํ•ฉ๋‹ˆ๋‹ค. +5. ์‹คํ–‰ ๊ฒฐ๊ณผ๋Š” `worklog 1๊ฑด`์œผ๋กœ ๋งˆ๊ฐํ•˜๊ณ , ์‹œ๋‚˜๋ฆฌ์˜ค/ํŠธ๋Ÿฌ๋ธ” ๋ฌธ์„œ์™€ ์–‘๋ฐฉํ–ฅ ๋งํฌ๋ฅผ ์—ฐ๊ฒฐํ•ฉ๋‹ˆ๋‹ค. + +## 8. ํ›„์† ๊ฒฝ๊ณ„ +- ์ด ๊ณ„ํš์ด ๋‹ซํ˜€๋„ Company X ์ „์ฒด ๋ฌธ์„œ๊ตฐ ํ™•๋Œ€๋‚˜ ๋ฒ”์šฉ RAG ์ •์ฑ… ๊ณตํ†ตํ™”๋Š” ๋ณ„๋„ ๊ณ„ํš์œผ๋กœ ๋‹ค๋ฃน๋‹ˆ๋‹ค. +- `Prompt DB`๋‚˜ ์ „์—ญ ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ ๊ตฌ์กฐ ๋ณ€๊ฒฝ์€ ์ด๋ฒˆ ๊ณ„ํš ๋ฒ”์œ„ ๋ฐ–์ž…๋‹ˆ๋‹ค. + +## ํ•œ ์ค„ ๊ฒฐ๋ก  +- ์ด๋ฒˆ ๊ณ„ํš์€ `๋Œ€ํ‘œ ์งˆ๋ฌธ ํŠน๋ก€ ์ฒ˜๋ฆฌ ์ œ๊ฑฐ` ์ž์ฒด๊ฐ€ ์•„๋‹ˆ๋ผ, Company X ๊ทผ๊ฑฐ์‘๋‹ต์„ `์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ + ๊ทผ๊ฑฐ ์ฑ„ํƒ ๊ณ„์•ฝ + ์‹คํŒจ ๊ณ„์•ฝ`์œผ๋กœ ์žฌ๊ตฌ์„ฑํ•ด ์‹œ๋‚˜๋ฆฌ์˜ค์™€ ํŠธ๋Ÿฌ๋ธ”์„ ํ•จ๊ป˜ ๋‹ซ๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค. diff --git a/journey/plans/README.md b/journey/plans/README.md index 197453a..3575cde 100644 --- a/journey/plans/README.md +++ b/journey/plans/README.md @@ -59,6 +59,11 @@ **์ฐธ๊ณ **: `plans/archive/250808_๊ฐ์ •์‹œ์Šคํ…œ_ํ˜„์‹ค์ ์šฉ_5๋‹จ๊ณ„_๋กœ๋“œ๋งต.md` +### 6. Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ (260315) +**์ƒํƒœ**: planned +**๋ชฉํ‘œ**: Company X ๋‚ด๋ถ€๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต์„ ์งˆ๋ฌธ๋ณ„ ํŠน๋ก€ ์ฒ˜๋ฆฌ์—์„œ ๊ณตํ†ต ๊ณ„์•ฝ ๊ธฐ๋ฐ˜ ๋‹ต๋ณ€ํ•ฉ์„ฑ ๊ตฌ์กฐ๋กœ ์ „ํ™˜ +**์ฐธ๊ณ **: `plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md` + --- ## ๐ŸŸก ๋ถ€๋ถ„ ์™„๋ฃŒ ํ•ญ๋ชฉ (๋‚จ์€ ์ž‘์—…๋งŒ) diff --git a/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md b/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md new file mode 100644 index 0000000..00ed4b2 --- /dev/null +++ b/journey/research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md @@ -0,0 +1,192 @@ +--- +tags: [research, companyx, rag, answer-composition, scenario, troubleshooting] +--- + +# Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜ + +## ์ƒ์œ„ ์›์น™ +- [Writing Principles](../../book/300_architecture/312_writing-principles.md) +- [Company X RAG ๋‹ต๋ณ€ ํ•ฉ์„ฑ ํšŒ๊ท€](../troubleshooting/260312_companyx_rag_answer_composition_regression.md) +- [Company X ๋‚ด๋ถ€ ๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ์‚ฌ์šฉ์ž ์‹œ๋‚˜๋ฆฌ์˜ค](../scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md) + +## ๋ชฉ์  +- `Company X` ๊ทผ๊ฑฐ์‘๋‹ต ์ด์Šˆ๋ฅผ `ํŠธ๋Ÿฌ๋ธ”์ŠˆํŒ… + ์‹œ๋‚˜๋ฆฌ์˜ค` ํ•œ ๋ฌธ์ œ๋กœ ๋ณด๊ณ , ๋‘˜์„ ํ•จ๊ป˜ ๋‹ซ๊ธฐ ์œ„ํ•œ ์›์ธ ๊ธฐ์ค€์„ ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. +- ํ˜„์žฌ ์‹คํŒจ๊ฐ€ `๊ฒ€์ƒ‰ ์ธํ”„๋ผ ๋ฌธ์ œ`์ธ์ง€, `๋‹ต๋ณ€ ํ•ฉ์„ฑ ๋ฌธ์ œ`์ธ์ง€, `์งˆ๋ฌธ๋ณ„ ํ•˜๋“œ์ฝ”๋”ฉ ๊ตฌ์กฐ ๋ฌธ์ œ`์ธ์ง€ ๋‹จ์ผ ๊ฒฝ๋กœ๋กœ ์ขํž™๋‹ˆ๋‹ค. +- ์ด ๋ฌธ์„œ๋Š” ํ•ด๊ฒฐ์•ˆ ํ™•์žฅ๋ณด๋‹ค `๋‹ค์Œ plan 1๊ฑด`์„ ๋งŒ๋“ค ์ˆ˜ ์žˆ์„ ์ •๋„๋กœ ์ง์ ‘ ์›์ธ์„ ํ™•์ •ํ•˜๋Š” ๋ฐ๋งŒ ์ง‘์ค‘ํ•ฉ๋‹ˆ๋‹ค. + +## ์กฐ์‚ฌ ์งˆ๋ฌธ +1. ํ˜„์žฌ ์‹คํŒจ์˜ ์ง์ ‘ ๋ ˆ์ด์–ด๋Š” ๊ฒ€์ƒ‰์ธ๊ฐ€, ๋‹ต๋ณ€ ํ•ฉ์„ฑ์ธ๊ฐ€ +2. `์ปดํผ๋‹ˆ์—‘์Šค์˜ ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?`, `๋‚ด๋ถ€ ๊ทœ์ • ์ƒ ํœด๊ฐ€๋Š” ์–ผ๋งˆ๋‚˜ ์“ธ ์ˆ˜ ์žˆ์–ด?`๊ฐ€ ์™œ ๊นจ์ง€๋Š”๊ฐ€ +3. ํ˜„์žฌ Company X ๊ฒฝ๋กœ๋Š” ์ผ๋ฐ˜ ๊ทœ์น™ ๊ธฐ๋ฐ˜์ธ๊ฐ€, ์งˆ๋ฌธ๋ณ„ ํ•˜๋“œ์ฝ”๋”ฉ ๊ธฐ๋ฐ˜์ธ๊ฐ€ +4. ํŠธ๋Ÿฌ๋ธ” ๋ฌธ์„œ์™€ ์‹œ๋‚˜๋ฆฌ์˜ค ๋ฌธ์„œ๋ฅผ ํ•จ๊ป˜ ๋‹ซ์œผ๋ ค๋ฉด ๋ฌด์—‡์„ plan์—์„œ ๊ณ ์ •ํ•ด์•ผ ํ•˜๋Š”๊ฐ€ + +## ๋ฒ”์œ„ / ๋น„๋ฒ”์œ„ +- ๋ฒ”์œ„: + - `rb8001`์˜ Company X grounding ์ง„์ž…/๊ฒ€์ƒ‰/์‘๋‹ต ํ•ฉ์„ฑ ๊ฒฝ๋กœ + - ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ์— ๋Œ€ํ•œ ์ฒ˜๋ฆฌ ๊ตฌ์กฐ + - ํ”„๋กฌํ”„ํŠธ/if ๋ถ„๊ธฐ/์งˆ๋ฌธ ์ ํ•ฉ๋„ ์„ ๋ณ„ ๊ตฌ์กฐ +- ๋น„๋ฒ”์œ„: + - Company X ์ „์ฒด ๋ฌธ์„œ์…‹ ํ™•๋Œ€ ์ž‘์—… + - `skill-rag-file` ์ธ๋ฑ์‹ฑ ์„ฑ๋Šฅ ์ผ๋ฐ˜๋ก  + - ๋‹ค๋ฅธ ํ”„๋กœ์ ํŠธ๋‚˜ ๋‹ค๋ฅธ RAG ๊ฒฝ๋กœ ์ „๋ฉด ๋ฆฌํŒฉํ† ๋ง + - ์ตœ์ข… ์ˆ˜์ •์•ˆ ๊ตฌํ˜„ ์ž์ฒด + +## ์‚ฌ์‹ค(Facts) + +### 1. Company X ์งˆ๋ฌธ์€ ์˜๋„ ๋ถ„๋ฅ˜ ์ „์— ์ „์šฉ grounding ๊ฒฝ๋กœ๋กœ ์šฐ์„  ์ง„์ž…ํ•œ๋‹ค +- `route_message()`๋Š” ์‚ฌ์šฉ์ž ์ปจํ…์ŠคํŠธ ์ƒ์„ฑ ์งํ›„ `try_companyx_grounding()`์„ ๋จผ์ € ํ˜ธ์ถœํ•ฉ๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/message_service.py:81-93` +- ์˜๋ฏธ: + - Company X ์งˆ๋ฌธ์€ ์ผ๋ฐ˜ intent/skill ๊ฒฝ๋กœ ์ „์— ๋ณ„๋„ ์ฒ˜๋ฆฌ๋ฉ๋‹ˆ๋‹ค. + - ๋”ฐ๋ผ์„œ ์ด๋ฒˆ ์‹คํŒจ๋Š” `์ผ๋ฐ˜ ์˜๋„ ๋ถ„๋ฅ˜๊ฐ€ Company X ์งˆ๋ฌธ์„ ๋†“์ณค๋‹ค`๋งŒ์œผ๋กœ ์„ค๋ช…๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + +### 2. Company X ๊ฒฝ๋กœ ์ง„์ž… ์กฐ๊ฑด์€ ํŒ€ ID + ๋ฌธ์ž์—ด marker ๊ธฐ๋ฐ˜ ํœด๋ฆฌ์Šคํ‹ฑ์ด๋‹ค +- `should_handle_companyx_grounding()`์€ `team_id == COMPANYX_TEAM_ID`์™€ `_looks_like_companyx_grounding_question(message)`๋กœ๋งŒ ํŒ๋‹จํ•ฉ๋‹ˆ๋‹ค. +- `_looks_like_companyx_grounding_question()`์€ `๊ทผ๊ฑฐ`, `๋‚ด๋ถ€ ๋ฌธ์„œ`, `๊ณต๋™ ์šด์˜`, `์ปดํผ๋‹ˆ์—‘์Šค`, `companyx` ๊ฐ™์€ marker ํฌํ•จ ์—ฌ๋ถ€๋ฅผ ๋ด…๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:28-60` +- ์˜๋ฏธ: + - ์งˆ๋ฌธ ์œ ํ˜•์ด๋‚˜ ํ•„์š”ํ•œ ๋‹ต๋ณ€ ๋ฐฉ์‹๋ณด๋‹ค ๋ฌธ์ž์—ด ํฌํ•จ ์—ฌ๋ถ€๊ฐ€ ์šฐ์„ ์ž…๋‹ˆ๋‹ค. + - `์ปดํผ๋‹ˆ์—‘์Šค`๋งŒ ๋“ค์–ด๊ฐ€๋„ grounding ๊ฒฝ๋กœ๋กœ ์ง„์ž…ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. + +### 3. ๊ฒ€์ƒ‰ ์งˆ์˜ ํ™•์žฅ์€ ์‚ฌ์‹ค์ƒ ์งˆ๋ฌธ 2์ข…๋งŒ ๋ณ„๋„ ํ•˜๋“œ์ฝ”๋”ฉ๋ผ ์žˆ๋‹ค +- `_build_query_candidates()`๋Š” ๊ธฐ๋ณธ์ ์œผ๋กœ ์›๋ฌธ ์งˆ๋ฌธ 1๊ฐœ๋ฅผ ๊ทธ๋Œ€๋กœ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. +- ์ถ”๊ฐ€ ์งˆ์˜ ํ™•์žฅ์€ ์•„๋ž˜ ๊ฒฝ์šฐ์—๋งŒ ์žˆ์Šต๋‹ˆ๋‹ค. + - `์˜ค๋Š˜์ „ํ†ต + ์˜๋กœํŽ€์น˜` + - `X-COURSE` +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:63-91` +- ์˜๋ฏธ: + - `ํˆฌ์ž์‚ฌ ๋ช‡ ๊ฐœ`, `ํœด๊ฐ€ ๊ทœ์ •` ๊ฐ™์€ ์žฌ์˜คํ”ˆ ์งˆ๋ฌธ์€ ์ „์šฉ query expansion์ด ์—†์Šต๋‹ˆ๋‹ค. + - ๋Œ€ํ‘œ ์งˆ๋ฌธ๋งŒ ์ƒ๋Œ€์ ์œผ๋กœ ์œ ๋ฆฌํ•œ ๊ตฌ์กฐ์ž…๋‹ˆ๋‹ค. + +### 4. ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋Š” ์งˆ๋ฌธ ์ ํ•ฉ๋„ ์žฌํ‰๊ฐ€ ์—†์ด relevance score ์ˆœ์œผ๋กœ๋งŒ ํ•ฉ์ณ์ง„๋‹ค +- `_search_companyx_documents()`๋Š” ํ›„๋ณด ์งˆ์˜๋ณ„ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ๋ณ‘ํ•ฉํ•œ ๋’ค `relevance_score` ๋‚ด๋ฆผ์ฐจ์ˆœ์œผ๋กœ๋งŒ ์ •๋ ฌํ•ฉ๋‹ˆ๋‹ค. +- ์งˆ๋ฌธ ์œ ํ˜•, ๋ฌธ์„œ ์ข…๋ฅ˜, ๋ฌธ์„œ-์งˆ๋ฌธ ์ •ํ•ฉ์„ฑ ์žฌํ‰๊ฐ€ ๋‹จ๊ณ„๋Š” ์—†์Šต๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:113-127` +- ์˜๋ฏธ: + - ๊ฒ€์ƒ‰ hit๊ฐ€ ์žˆ์–ด๋„ ๊ทธ hit๊ฐ€ ์งˆ๋ฌธ์— ๋งž๋Š” ๊ทผ๊ฑฐ์ธ์ง€ ๋‹ค์‹œ ๊ฒ€์ฆํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + +### 5. ์ง์ ‘ ๋‹ต ์ƒ์„ฑ์€ ์งˆ๋ฌธ๋ณ„ if ๋ถ„๊ธฐ ํ•˜๋“œ์ฝ”๋”ฉ์ด๊ณ , ๊ธฐ๋ณธ๊ฐ’์€ generic ๋ฌธ์žฅ์ด๋‹ค +- `_build_direct_answer()`๋Š” ์•„๋ž˜ ๊ฒฝ์šฐ๋งŒ ๋ณ„๋„ ๋ฌธ์žฅ์„ ๊ฐ€์ง‘๋‹ˆ๋‹ค. + - `์˜ค๋Š˜์ „ํ†ต + ์˜๋กœํŽ€์น˜` + - `X-COURSE` +- ๊ทธ ์™ธ ๋ชจ๋“  ์งˆ๋ฌธ์€ ๊ธฐ๋ณธ๊ฐ’ `Company X ๋‚ด๋ถ€ ๋ฌธ์„œ์—์„œ ๊ด€๋ จ ๊ทผ๊ฑฐ๋ฅผ ์ฐพ์•˜์Šต๋‹ˆ๋‹ค.`๋ฅผ ๋ฐ˜ํ™˜ํ•ฉ๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:136-153` +- ์˜๋ฏธ: + - `ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?` ๊ฐ™์€ ์ˆ˜์น˜ํ˜• ์งˆ๋ฌธ์€ ๋‹ต์„ ๊ณ„์‚ฐํ•˜๊ฑฐ๋‚˜ `๋‹จ์ • ๋ถˆ๊ฐ€`๋ฅผ ํŒ๋‹จํ•˜์ง€ ์•Š๊ณ  generic ๋ฌธ์žฅ์œผ๋กœ ๋๋‚ฉ๋‹ˆ๋‹ค. + - ํ˜„์žฌ ๊ตฌ์กฐ๋Š” ์งˆ๋ฌธ ์œ ํ˜•๋ณ„ ๋‹ต๋ณ€ ๊ณ„์•ฝ์ด ์•„๋‹ˆ๋ผ ์ผ๋ถ€ ์งˆ๋ฌธ๋ณ„ ๋ฌธ์žฅ ํ•˜๋“œ์ฝ”๋”ฉ์ž…๋‹ˆ๋‹ค. + +### 6. ์‹คํŒจ ์ฒ˜๋ฆฌ๋Š” `๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๊ฐ€ 0๊ฐœ์ผ ๋•Œ`๋งŒ ์ž‘๋™ํ•˜๊ณ , `๊ฒ€์ƒ‰์€ ๋์ง€๋งŒ ๋ฌด๊ด€ํ•œ ๊ฒฝ์šฐ`๋ฅผ ๋‹ค๋ฃจ์ง€ ์•Š๋Š”๋‹ค +- `_build_grounded_response()`์˜ ์‹คํŒจ ๋ฌธ์žฅ์€ `if not results`์ผ ๋•Œ๋งŒ ๋ฐ˜ํ™˜๋ฉ๋‹ˆ๋‹ค. +- ๊ฒฐ๊ณผ๊ฐ€ 1๊ฐœ๋ผ๋„ ์žˆ์œผ๋ฉด ์งˆ๋ฌธ ์ ํ•ฉ์„ฑ ๊ฒ€์ฆ ์—†์ด `๊ทผ๊ฑฐ ๋ฌธ์„œ:` ๋ชฉ๋ก์„ ๋ถ™์ž…๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:155-171` +- ์˜๋ฏธ: + - ํœด๊ฐ€ ์งˆ๋ฌธ์— ๋ฌด๊ด€ํ•œ `companyx_todaytradition.pdf` ์ฒญํฌ๊ฐ€ ์žกํžˆ๋ฉด, ์‹œ์Šคํ…œ์€ ์ด๋ฅผ ์‹คํŒจ๊ฐ€ ์•„๋‹ˆ๋ผ ์„ฑ๊ณต์ฒ˜๋Ÿผ ์ถœ๋ ฅํ•ฉ๋‹ˆ๋‹ค. + - ์ฆ‰ ํ˜„์žฌ ์‹คํŒจ ๊ฒฝ๊ณ„๋Š” `no result`๋งŒ ์žˆ๊ณ  `irrelevant result`๋Š” ์—†์Šต๋‹ˆ๋‹ค. + +### 7. ํ˜„์žฌ Company X ์‘๋‹ต์€ LLM ๊ธฐ๋ฐ˜ ํ•ฉ์„ฑ์ด ์•„๋‹ˆ๋ผ ๊ทœ์น™ ๊ธฐ๋ฐ˜ ๋ฌธ์ž์—ด ์กฐํ•ฉ์ด๋‹ค +- Company X ์ „์šฉ ๊ฒฝ๋กœ๋Š” ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ๊ฐ€์ ธ์˜จ ๋’ค `_build_direct_answer()`์™€ ์ฒญํฌ ์š”์•ฝ ๋ฌธ์ž์—ด์„ ์ด์–ด๋ถ™์—ฌ ์‘๋‹ต์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `rb8001/app/services/companyx_grounding_service.py:130-171` +- ์˜๋ฏธ: + - ํ˜„์žฌ ์ด ๋ฌธ์ œ์˜ ๋ณธ์งˆ์€ `ํ”„๋กฌํ”„ํŠธ๊ฐ€ ์•ฝํ•ด์„œ`๋ผ๊ธฐ๋ณด๋‹ค, `๊ทœ์น™ ์„ค๊ณ„๊ฐ€ ์งˆ๋ฌธ ์œ ํ˜•์„ ๊ฐ๋‹นํ•˜์ง€ ๋ชปํ•˜๋Š” ์ƒํƒœ`์ž…๋‹ˆ๋‹ค. + - ๋‹ค๋งŒ ๊ตฌํ˜„ ํ˜•ํƒœ๋Š” ์งˆ๋ฌธ๋ณ„ ๋ฌธ์žฅ/๋ถ„๊ธฐ ํ•˜๋“œ์ฝ”๋”ฉ์— ์˜์กดํ•˜๊ณ  ์žˆ์–ด ์œ ์ง€๋ณด์ˆ˜์„ฑ์ด ๋‚ฎ์Šต๋‹ˆ๋‹ค. + +### 8. ์Šคํ‚ฌ ๋ฌธ์„œ๊ฐ€ ์š”๊ตฌํ•˜๋Š” ๊ณ„์•ฝ๊ณผ ํ˜„์žฌ ๊ตฌํ˜„ ๊ณ„์•ฝ์€ ์ผ์น˜ํ•˜์ง€ ์•Š๋Š”๋‹ค +- `SKILL.md`๋Š” ๋‹ต๋ณ€ ์ˆœ์„œ๋ฅผ `direct answer -> evidence documents -> short evidence summary`๋กœ ๊ณ ์ •ํ•ฉ๋‹ˆ๋‹ค. +- ๋˜ํ•œ `documents are missing, say the evidence is insufficient`๋ฅผ ์š”๊ตฌํ•ฉ๋‹ˆ๋‹ค. +- ์œ„์น˜: + - `DOCS/skills/companyx-rag/SKILL.md` +- ํ˜„์žฌ ๊ตฌํ˜„์€ ์•„๋ž˜ ์ฐจ์ด๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. + - `์ง์ ‘ ๋‹ต`์ด generic ๋ฌธ์žฅ์œผ๋กœ ๋Œ€์ฒด๋  ์ˆ˜ ์žˆ์Œ + - `๋ฌธ์„œ ๋ถ€์กฑ`๊ณผ `๋ฌด๊ด€ํ•œ ๋ฌธ์„œ ๋ฐ˜ํ™˜`์„ ๊ตฌ๋ถ„ํ•˜์ง€ ์•Š์Œ + - ์ฆ๊ฑฐ ๋ฌธ์„œ ์ ํ•ฉ์„ฑ ๊ฒ€์ฆ ์—†์ด score ์ƒ์œ„ ์ฒญํฌ๋ฅผ ๊ทธ๋Œ€๋กœ ๋…ธ์ถœํ•จ +- ์˜๋ฏธ: + - ๋ฌธ์ œ์˜ ์ง์ ‘ ์›์ธ์€ ์Šคํ‚ฌ ๋ฌธ์„œ ๋ถ€์žฌ๊ฐ€ ์•„๋‹ˆ๋ผ, ๊ตฌํ˜„์ด ์Šคํ‚ฌ ๊ณ„์•ฝ์„ ๋๊นŒ์ง€ ์ง€ํ‚ค์ง€ ๋ชปํ•˜๋Š” ๋ฐ ์žˆ์Šต๋‹ˆ๋‹ค. + +### 9. ๋Œ€ํ‘œ ์„ฑ๊ณต ์งˆ๋ฌธ์€ ๊ตฌ์กฐ์ ์œผ๋กœ ์šฐ๋Œ€๋ผ ์žˆ๊ณ , ์žฌ์˜คํ”ˆ ์งˆ๋ฌธ์€ ์ผ๋ฐ˜ํ™” ๊ฒฝ๋กœ์— ๋†“์—ฌ ์žˆ๋‹ค +- `์˜ค๋Š˜์ „ํ†ต + ์˜๋กœํŽ€์น˜` ์งˆ๋ฌธ์€ + - ๋ณ„๋„ query expansion์ด ์žˆ๊ณ  + - ๋ณ„๋„ direct answer ํ•˜๋“œ์ฝ”๋”ฉ์ด ์žˆ์œผ๋ฉฐ + - ๋Œ€ํ‘œ ๊ทผ๊ฑฐ ๋ฌธ์„œ์…‹๋„ ์ด๋ฏธ worklog์— ๋‚จ์•„ ์žˆ์Šต๋‹ˆ๋‹ค. +- ๊ด€๋ จ ๋ฌธ์„œ: + - [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต 1์ฐจ ๊ตฌํ˜„ ๋ฐ ๋ถ€๋ถ„ ๊ฒ€์ฆ](../worklog/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_๊ตฌํ˜„๋ฐ์‹œ๋‚˜๋ฆฌ์˜ค๊ฒ€์ฆ.md) +- ๋ฐ˜๋ฉด ์žฌ์˜คํ”ˆ ์งˆ๋ฌธ 2๊ฐœ๋Š” + - ์ „์šฉ query expansion์ด ์—†๊ณ  + - ์งˆ๋ฌธ ์œ ํ˜• ๋ถ„๊ธฐ ๊ทœ์น™๋„ ์—†๊ณ  + - generic fallback ๋ฌธ์žฅ์œผ๋กœ ๋งˆ๊ฐ๋ฉ๋‹ˆ๋‹ค. +- ์˜๋ฏธ: + - ํ˜„์žฌ ์„ฑ๊ณต์€ ์ผ๋ฐ˜ํ™”๋œ ์„ฑ๊ณต์ด ์•„๋‹ˆ๋ผ `๋Œ€ํ‘œ ์งˆ๋ฌธ ์ตœ์ ํ™” ์„ฑ๊ณต`์— ๊ฐ€๊น์Šต๋‹ˆ๋‹ค. + +### 10. ๋”ฐ๋ผ์„œ ์ง€๊ธˆ ์‹คํŒจ๋Š” `๊ฒ€์ƒ‰ ๋ถ€์žฌ`๋ณด๋‹ค `๋‹ต๋ณ€ ํ•ฉ์„ฑ + ์‹คํŒจ ํŒ์ • ๋ถ€์žฌ + ์งˆ๋ฌธ๋ณ„ ํ•˜๋“œ์ฝ”๋”ฉ ํŽธํ–ฅ`์˜ ๊ฒฐํ•ฉ์ด๋‹ค +- ์•ž์„  ์‚ฌ์‹ค์„ ํ•ฉ์น˜๋ฉด ํ˜„์žฌ ๊ฒฝ๋กœ๋Š” ์•„๋ž˜ ๊ตฌ์กฐ์ž…๋‹ˆ๋‹ค. + 1. marker ๊ธฐ๋ฐ˜์œผ๋กœ Company X ๊ฒฝ๋กœ ์ง„์ž… + 2. ์ผ๋ถ€ ์งˆ๋ฌธ๋งŒ ์œ ๋ฆฌํ•œ query expansion + 3. relevance score๋งŒ์œผ๋กœ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ ์ฑ„ํƒ + 4. ์ผ๋ถ€ ์งˆ๋ฌธ๋งŒ direct answer ํ•˜๋“œ์ฝ”๋”ฉ + 5. ๊ฒฐ๊ณผ๊ฐ€ ํ•˜๋‚˜๋ผ๋„ ์žˆ์œผ๋ฉด ์„ฑ๊ณต์ฒ˜๋Ÿผ ๋ฌธ์„œ ๋ชฉ๋ก ๋…ธ์ถœ +- ์˜๋ฏธ: + - ์ด๋ฒˆ ์ด์Šˆ์˜ ์ง์ ‘ ๋ ˆ์ด์–ด๋Š” `answer composition`์ž…๋‹ˆ๋‹ค. + - ๊ทธ๋Ÿฌ๋‚˜ ๋” ๊นŠ๊ฒŒ ๋ณด๋ฉด `์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ์ด ์—†๋Š” ๊ทœ์น™ ํ•˜๋“œ์ฝ”๋”ฉ ๊ตฌ์กฐ`๊ฐ€ ์ƒ์œ„ ์›์ธ์ž…๋‹ˆ๋‹ค. + +## ํ•ด์„(Interpretation) + +### 1. ์ด ๋ฌธ์ œ๋Š” ๊ฒ€์ƒ‰ ์ธํ”„๋ผ ์žฅ์• ๊ฐ€ ์•„๋‹ˆ๋ผ ์‘๋‹ต ์ •์ฑ… ๋ถ€์žฌ ๋ฌธ์ œ๋‹ค +- Company X ์ „์šฉ ๊ฒฝ๋กœ๋Š” ์‹ค์ œ๋กœ ์กด์žฌํ•˜๊ณ , ๊ฒ€์ƒ‰ ํ˜ธ์ถœ๋„ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค. +- ์‹คํŒจ๊ฐ€ ๋‚˜๋Š” ์ง€์ ์€ `์งˆ๋ฌธ์— ๋Œ€ํ•œ ์ง์ ‘ ๋‹ต์„ ์–ด๋–ป๊ฒŒ ๋งŒ๋“ค๊ณ , ์–ด๋–ค ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๋ฅผ ๊ทผ๊ฑฐ๋กœ ์ฑ„ํƒํ•˜๋ฉฐ, ์–ธ์ œ ๋ชจ๋ฅธ๋‹ค๊ณ  ๋งํ• ์ง€`๊ฐ€ ๋น„์–ด ์žˆ๋‹ค๋Š” ์ ์ž…๋‹ˆ๋‹ค. + +### 2. ์ง€๊ธˆ ๊ตฌ์กฐ๋Š” ์‹œ๋‚˜๋ฆฌ์˜ค๋ฅผ ๋‹ซ๊ธฐ ์–ด๋ ค์šด ํ˜•ํƒœ๋‹ค +- ์‹œ๋‚˜๋ฆฌ์˜ค๋Š” `์„ค๋ช…ํ˜•`, `์‚ฌ์‹ค ํ™•์ธํ˜•`, `์ˆ˜์น˜ ํ™•์ธํ˜•`, `์žฌ์ •๋ฆฌํ˜•`์„ ๋ชจ๋‘ ์š”๊ตฌํ•ฉ๋‹ˆ๋‹ค. +- ํ•˜์ง€๋งŒ ํ˜„์žฌ ๊ตฌํ˜„์€ ์‹ค์งˆ์ ์œผ๋กœ `๋Œ€ํ‘œ ์‚ฌ์‹ค ํ™•์ธํ˜• 2์ข…`๋งŒ ํŠน๋ก€ ์ฒ˜๋ฆฌํ•ฉ๋‹ˆ๋‹ค. +- ๋”ฐ๋ผ์„œ ์ƒˆ ์งˆ๋ฌธ์ด ๋“ค์–ด์˜ฌ์ˆ˜๋ก `if`์™€ ๋ฌธ์žฅ ํ•˜๋“œ์ฝ”๋”ฉ์ด ๋Š˜์–ด๋‚  ๊ฐ€๋Šฅ์„ฑ์ด ๋†’๊ณ , ์‹œ๋‚˜๋ฆฌ์˜ค๋ฅผ ์ผ๋ฐ˜ ๊ทœ์น™์œผ๋กœ ๋‹ซ์„ ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค. + +### 3. ํŠธ๋Ÿฌ๋ธ” ๋ฌธ์„œ๊ฐ€ ์ง€์ ํ•œ ํšŒ๊ท€์˜ ์ง์ ‘ ์›์ธ์€ ์งˆ๋ฌธ ์ ํ•ฉ๋„ ๊ฒ€์ฆ ๋ถ€์žฌ๋‹ค +- ์žฌ์˜คํ”ˆ ์งˆ๋ฌธ๋“ค์€ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๊ฐ€ 0๊ฐœ๋ผ์„œ ์‹คํŒจํ•œ ๊ฒƒ์ด ์•„๋‹™๋‹ˆ๋‹ค. +- ๊ฒฐ๊ณผ๊ฐ€ ์žˆ์–ด๋„ ์งˆ๋ฌธ๊ณผ ๋ฌด๊ด€ํ•œ ์ฒญํฌ๋ฅผ success์ฒ˜๋Ÿผ ์ถœ๋ ฅํ–ˆ์Šต๋‹ˆ๋‹ค. +- ์ฆ‰ ์ด๋ฒˆ ํšŒ๊ท€๋ฅผ ๋‹ซ๋Š” ํ•ต์‹ฌ์€ `retrieval result exists`๊ฐ€ ์•„๋‹ˆ๋ผ `retrieval result is fit for this question`๋ฅผ ํŒ์ •ํ•˜๋Š” ๋‹จ๊ณ„์ž…๋‹ˆ๋‹ค. + +### 4. ์Šคํ‚ฌ ๋ฌธ์„œ๋Š” ๋ฐฉํ–ฅ์ด ๋งž์ง€๋งŒ, ๊ตฌํ˜„ ๊ณ„์•ฝ์œผ๋กœ ๋‚ด๋ ค์˜ค์ง€ ์•Š์•˜๋‹ค +- `SKILL.md`๋Š” ์ด๋ฏธ ์ง์ ‘ ๋‹ต, ๊ทผ๊ฑฐ ๋ฌธ์„œ, ๋ถ€์กฑ ์‹œ ๋ช…์‹œ๋ฅผ ์š”๊ตฌํ•ฉ๋‹ˆ๋‹ค. +- ๋ฌธ์ œ๋Š” ๊ทธ ๊ณ„์•ฝ์ด ์ฝ”๋“œ์—์„œ ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ํŒ์ • ๊ทœ์น™์œผ๋กœ ๋ณ€ํ™˜๋˜์ง€ ์•Š์€ ๊ฒƒ์ž…๋‹ˆ๋‹ค. +- ๋”ฐ๋ผ์„œ ๋‹ค์Œ plan์€ ์ƒˆ ๋ฌธ๊ตฌ๋ฅผ ๋” ์“ฐ๋Š” ๊ฒŒ ์•„๋‹ˆ๋ผ, ์Šคํ‚ฌ ๊ณ„์•ฝ์„ ์ฝ”๋“œ๊ฐ€ ํŒ์ • ๊ฐ€๋Šฅํ•œ ๊ตฌ์กฐ๋กœ ๋ฐ”๊พธ๋Š” ๋ฐ ์ง‘์ค‘ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + +### 5. ํ•˜๋“œ์ฝ”๋”ฉ ํ”„๋กฌํ”„ํŠธ/๋ฌธ์žฅ ์ฆ์‹์€ ์ด ๋ฌธ์ œ์˜ ํ•ด๋ฒ•์ด ์•„๋‹ˆ๋‹ค +- ํ˜„์žฌ๋„ ๋Œ€ํ‘œ ์งˆ๋ฌธ ์„ฑ๊ณต์€ ์ด๋ฏธ ํ•˜๋“œ์ฝ”๋”ฉ ํŠน๋ก€์— ๊ธฐ๋Œ€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. +- ์ด ์ƒํƒœ์—์„œ `ํˆฌ์ž์‚ฌ`, `ํœด๊ฐ€`, `ํˆฌ์ž ๊ฑด์ˆ˜`, `๊ทœ์ •`, `๋ณต์ง€` ์‹์œผ๋กœ ์งˆ๋ฌธ๋ณ„ ๋ฌธ์žฅ์„ ๋” ์ถ”๊ฐ€ํ•˜๋ฉด, + - ์‹œ๋‚˜๋ฆฌ์˜ค๋Š” ๊ฒ‰๋ณด๊ธฐ๋กœ๋งŒ ๋‹ซํžˆ๊ณ  + - ํŠธ๋Ÿฌ๋ธ”์€ ๋‹ค๋ฅธ ์งˆ๋ฌธ์—์„œ ๋‹ค์‹œ ์—ด๋ฆฌ๋ฉฐ + - ํ”„๋กฌํ”„ํŠธ์™€ if ๋ถ„๊ธฐ ์ค‘๋ณต๋งŒ ์Œ“์ด๊ฒŒ ๋ฉ๋‹ˆ๋‹ค. + +## ๋ฏธํ™•์ • ํ•ญ๋ชฉ(Unresolved) +1. `skill-rag-file`์˜ ๋ฐ˜ํ™˜ score๋งŒ์œผ๋กœ ์งˆ๋ฌธ ์ ํ•ฉ๋„๋ฅผ ํŒ์ •ํ•  ์ˆ˜ ์žˆ๋Š”์ง€, ๋ณ„๋„ rerank๊ฐ€ ํ•„์š”ํ•œ์ง€๋Š” ์•„์ง ๋ฏธํ™•์ •์ž…๋‹ˆ๋‹ค. +2. ์ˆ˜์น˜ํ˜• ์งˆ๋ฌธ์˜ `๋‹จ์ • ๊ฐ€๋Šฅ / ๋‹จ์ • ๋ถˆ๊ฐ€`๋ฅผ ๋ฌธ์„œ ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ๋งŒ์œผ๋กœ ๋จผ์ € ํŒ์ •ํ• ์ง€, ํ›„์† ์š”์•ฝ ๊ณ„์ธต์„ ๋‘˜์ง€๋Š” ์•„์ง ๋ฏธํ™•์ •์ž…๋‹ˆ๋‹ค. +3. `์žฌ์ •๋ฆฌํ˜• ์งˆ๋ฌธ`์„ ์ด์ „ ์‘๋‹ต ์žฌ์‚ฌ์šฉ์œผ๋กœ ์ฒ˜๋ฆฌํ• ์ง€, ๋‹ค์‹œ ๊ฒ€์ƒ‰ํ•ด๋„ ๋˜๋Š”์ง€๋Š” ์•„์ง ๋ฏธํ™•์ •์ž…๋‹ˆ๋‹ค. +4. Company X ์ „์šฉ ๊ทœ์น™์„ ๋…๋ฆฝ ๊ณ„์•ฝ ๋ชจ๋“ˆ๋กœ ๋‘˜์ง€, ๋ฒ”์šฉ grounding ์ •์ฑ…์œผ๋กœ ์˜ฌ๋ฆด์ง€๋Š” ์•„์ง ๋ฏธํ™•์ •์ž…๋‹ˆ๋‹ค. + +## ๊ฒฐ๋ก  +- ์ด ์ด์Šˆ์˜ ์ง์ ‘ ์›์ธ์€ `Company X ๊ฒ€์ƒ‰ ์‹คํŒจ`๊ฐ€ ์•„๋‹ˆ๋ผ `์งˆ๋ฌธ ์ ํ•ฉ ๊ทผ๊ฑฐ ์„ ๋ณ„ ์—†๋Š” ๋‹ต๋ณ€ ํ•ฉ์„ฑ`์ž…๋‹ˆ๋‹ค. +- ๋” ๊ทผ๋ณธ ์›์ธ์€ `์งˆ๋ฌธ ์œ ํ˜• ๊ณ„์•ฝ ์—†์ด ์ผ๋ถ€ ์งˆ๋ฌธ๋งŒ ํ•˜๋“œ์ฝ”๋”ฉ ํŠน๋ก€ ์ฒ˜๋ฆฌํ•˜๋Š” ๊ตฌ์กฐ`์ž…๋‹ˆ๋‹ค. +- ๋”ฐ๋ผ์„œ ๋‹ค์Œ plan์€ `ํ”„๋กฌํ”„ํŠธ ๋ฌธ์žฅ ์ถ”๊ฐ€`๊ฐ€ ์•„๋‹ˆ๋ผ ์•„๋ž˜ 3๊ฐ€์ง€๋ฅผ ๊ณ ์ •ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + 1. ์งˆ๋ฌธ ์œ ํ˜•๋ณ„ ํŒ์ • ๊ณ„์•ฝ + 2. ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ์˜ ์งˆ๋ฌธ ์ ํ•ฉ๋„ ํŒ์ • ๊ณ„์•ฝ + 3. ๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ๋ช…์‹œ์  ์‹คํŒจ ๊ณ„์•ฝ + +## ๋‹ค์Œ plan์ด ๋ฐ˜๋“œ์‹œ ๊ณ ์ •ํ•ด์•ผ ํ•  ํ•ญ๋ชฉ +1. ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ๋ฅผ ๊ณตํ†ต ๊ฒ€์ฆ์…‹์œผ๋กœ ๊ณ ์ •ํ•  ๊ฒƒ +2. `success`์˜ ์ •์˜๋ฅผ `๊ฒ€์ƒ‰ hit ์กด์žฌ`๊ฐ€ ์•„๋‹ˆ๋ผ `์ง์ ‘ ๋‹ต + ์งˆ๋ฌธ ์ ํ•ฉ ๊ทผ๊ฑฐ ๋˜๋Š” ๋ช…์‹œ์  ๋ถ€์กฑ ์•ˆ๋‚ด`๋กœ ๋ฐ”๊ฟ€ ๊ฒƒ +3. ์งˆ๋ฌธ๋ณ„ direct answer ํ•˜๋“œ์ฝ”๋”ฉ ์ถ”๊ฐ€๋ฅผ ๊ธˆ์ง€ํ•˜๊ณ , ์งˆ๋ฌธ ์œ ํ˜•๋ณ„ ๊ณตํ†ต ๊ณ„์•ฝ์œผ๋กœ ๋Œ€์ฒดํ•  ๊ฒƒ +4. `๋ฌด๊ด€ํ•œ ์ฒญํฌ ๋ฐ˜ํ™˜`์„ `์‹คํŒจ`๋กœ ํŒ์ •ํ•˜๋Š” ๊ฒฝ๊ณ„๋ฅผ ์ถ”๊ฐ€ํ•  ๊ฒƒ +5. ์Šคํ‚ฌ ๋ฌธ์„œ ๊ณ„์•ฝ๊ณผ ์ฝ”๋“œ ๊ณ„์•ฝ์„ 1:1๋กœ ๋งž์ถœ ๊ฒƒ + +## ๊ด€๋ จ ๋ฌธ์„œ +- [Company X RAG ๋‹ต๋ณ€ ํ•ฉ์„ฑ ํšŒ๊ท€](../troubleshooting/260312_companyx_rag_answer_composition_regression.md) +- [Company X ๋‚ด๋ถ€ ๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ์‚ฌ์šฉ์ž ์‹œ๋‚˜๋ฆฌ์˜ค](../scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md) +- [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต ํ˜„ํ™ฉ ๋ฆฌ์„œ์น˜](./260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_ํ˜„ํ™ฉ_๋ฆฌ์„œ์น˜.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๊ณ„ํš](../plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md) +- [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต 1์ฐจ ๊ตฌํ˜„ ๋ฐ ๋ถ€๋ถ„ ๊ฒ€์ฆ](../worklog/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_๊ตฌํ˜„๋ฐ์‹œ๋‚˜๋ฆฌ์˜ค๊ฒ€์ฆ.md) +- [Company X RAG ์Šคํ‚ฌ ๋ฌธ์„œ](../../skills/companyx-rag/SKILL.md) diff --git a/journey/research/README.md b/journey/research/README.md index 87fad06..ea610cc 100644 --- a/journey/research/README.md +++ b/journey/research/README.md @@ -13,6 +13,7 @@ - [์ž๊ฐ€์ˆ˜์ • ์—์ด์ „ํŠธ ํ”„๋ ˆ์ž„์›Œํฌ ๋ฐ Workspace CLI ๊ฒ€์ฆ ๋ฆฌ์„œ์น˜ (260311)](./260311_์ž๊ฐ€์ˆ˜์ •_์—์ด์ „ํŠธ_ํ”„๋ ˆ์ž„์›Œํฌ_๋ฐ_workspace_cli_๊ฒ€์ฆ_๋ฆฌ์„œ์น˜.md) - [NAVER WORKS ๋ธŒ๋ฆฌํ•‘ ์ธ์‚ฌ์ดํŠธ ์„œ๋‘ ๋ˆ„์ถœ ์ข…๋ฃŒ ๋ฆฌ์„œ์น˜ (260311)](./260311_naverworks_briefing_insight_preamble_leak_closure_research.md) - [์ธ๊ฐ„ ์—…๋ฌดํ–‰๋™๊ณผ ์›์ž์Šคํ‚ฌ ๋ถ„๋ฅ˜ ๋ฆฌ์„œ์น˜ (260312)](./260312_์ธ๊ฐ„_์—…๋ฌดํ–‰๋™๊ณผ_์›์ž์Šคํ‚ฌ_๋ถ„๋ฅ˜_๋ฆฌ์„œ์น˜.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜ (260315)](./260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md) - [์Šคํ‚ฌ ๊ณ„์•ฝ ๋ฌธ์„œ ๊ธฐ๋ฐ˜ ์ปจํ…์ŠคํŠธ ์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ ๋ฆฌ์„œ์น˜ (260314)](./260314_์Šคํ‚ฌ_๊ณ„์•ฝ_๋ฌธ์„œ_๊ธฐ๋ฐ˜_์ปจํ…์ŠคํŠธ_์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜_๋ฆฌ์„œ์น˜.md) ### [๊ธฐ์–ต(Memory)](./memory/README.md) diff --git a/journey/scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md b/journey/scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md index b4da30f..ee937df 100644 --- a/journey/scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md +++ b/journey/scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md @@ -23,6 +23,11 @@ tags: [robeing, companyx, rag, scenarios, user-experience] - ์ˆ˜์น˜ ํ™•์ธํ˜• ์งˆ๋ฌธ: "์ด๋ฒˆ ๋‹ฌ ํ™•์ • ํˆฌ์ž ๊ฑด์ˆ˜ ๋ช‡ ๊ฑด์ด์•ผ?" - ์žฌ์ •๋ฆฌํ˜• ์งˆ๋ฌธ: "๊ทผ๊ฑฐ ๋ฌธ์„œ๋ช…๋งŒ ๋‹ค์‹œ ์ •๋ฆฌํ•ด์ค˜." +## ์ด ์‹œ๋‚˜๋ฆฌ์˜ค์˜ ์šด์˜ ๋ฒ”์œ„ +- ๋Œ€์ƒ์€ `Company X ์†Œ์† ์‚ฌ์šฉ์ž`์˜ `๋‚ด๋ถ€ ๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ๊ฒฝํ—˜`์ž…๋‹ˆ๋‹ค. +- ํ•ต์‹ฌ์€ ๊ฒ€์ƒ‰ ์„ฑ๊ณต ์ž์ฒด๋ณด๋‹ค `๋‹ต๋ณ€์„ ์–ด๋–ป๊ฒŒ ๋งˆ๋ฌด๋ฆฌํ•ด ์‚ฌ์šฉ์ž์—๊ฒŒ ์‹ ๋ขฐ ๊ฐ€๋Šฅํ•œ ํ˜•ํƒœ๋กœ ๋ณด์—ฌ์ฃผ๋А๋ƒ`์ž…๋‹ˆ๋‹ค. +- ๋”ฐ๋ผ์„œ ์ด ์‹œ๋‚˜๋ฆฌ์˜ค๋Š” `๊ฒ€์ƒ‰๋จ`๋งŒ์œผ๋กœ ๋‹ซํžˆ์ง€ ์•Š๊ณ , `์ง์ ‘ ๋‹ต + ๋งž๋Š” ๊ทผ๊ฑฐ + ๋ถ€์กฑ ์‹œ ๋ช…์‹œ์  ํ•œ๊ณ„ ๊ณ ์ง€`๊นŒ์ง€ ์ถฉ์กฑํ•ด์•ผ ๋‹ซํž™๋‹ˆ๋‹ค. + ## ์žฅ๋ฉด 1. ํ”„๋กœ๊ทธ๋žจ ์ž๋ฃŒ๋ฅผ ๋น ๋ฅด๊ฒŒ ์ฐพ๊ณ  ์„ค๋ช…๋ฐ›๊ณ  ์‹ถ๋‹ค 1. ์‚ฌ์šฉ์ž๊ฐ€ ๋ฌป์Šต๋‹ˆ๋‹ค. "X-COURSE๊ฐ€ ๋ญ์•ผ? ๋‚ด๋ถ€ ์ž๋ฃŒ ๊ธฐ์ค€์œผ๋กœ ์„ค๋ช…ํ•ด์ค˜." 2. ๋กœ๋น™์€ Company X ๋‚ด๋ถ€ ๋ฌธ์„œ์—์„œ `X-COURSE` ๊ด€๋ จ ์†Œ๊ฐœ์„œ, ์šด์˜ ๋ฌธ์„œ, ์ œ์•ˆ์„œ ๋“ฑ์„ ๋จผ์ € ์ฐพ์Šต๋‹ˆ๋‹ค. @@ -86,6 +91,17 @@ tags: [robeing, companyx, rag, scenarios, user-experience] - ๊ทผ๊ฑฐ๊ฐ€ ๋ถ€์กฑํ•˜๋ฉด ์ถ”์ • ๋Œ€์‹  ๋ถ€์กฑํ•œ ์ด์œ ์™€ ๋‹ค์Œ ํ™•์ธ ๋Œ€์ƒ์„ ๋งํ•ฉ๋‹ˆ๋‹ค. - ์‚ฌ์šฉ์ž๊ฐ€ ์žฌ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๊ฒŒ ๊ทผ๊ฑฐ ๋ฌธ์„œ ๋ชฉ๋ก์„ ๋‹ค์‹œ ๋ฝ‘์•„์ค„ ์ˆ˜ ์žˆ์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. +## ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ๊ณผ ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ +1. `์ปดํผ๋‹ˆ์—‘์Šค์˜ ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ์ˆ˜์น˜๋ฅผ ๋งํ•  ์ˆ˜ ์žˆ์œผ๋ฉด ๋ฌธ์„œ ๊ทผ๊ฑฐ์™€ ํ•จ๊ป˜ ๋งํ•˜๊ณ , ๋งํ•  ์ˆ˜ ์—†์œผ๋ฉด `๋‚ด๋ถ€ ๋ฌธ์„œ๋งŒ์œผ๋กœ๋Š” ๋‹จ์ • ๋ถˆ๊ฐ€`๋ฅผ ๋ถ„๋ช…ํžˆ ๋‹ตํ•ฉ๋‹ˆ๋‹ค. + +2. `๊ทธ๋Ÿผ ์ปดํผ๋‹ˆ์—‘์Šค ๋‚ด๋ถ€ ๊ทœ์ • ์ƒ ํœด๊ฐ€๋Š” ์–ผ๋งˆ๋‚˜ ์“ธ ์ˆ˜ ์žˆ์–ด?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ํœด๊ฐ€ ๊ทœ์ • ๋ฌธ์„œ๊ฐ€ ํ™•์ธ๋˜์ง€ ์•Š์œผ๋ฉด `๊ด€๋ จ ๋‚ด๋ถ€ ๊ทœ์ •์„ ์•„์ง ํ™•์ธํ•˜์ง€ ๋ชปํ–ˆ๋‹ค`๊ณ  ๋‹ตํ•ฉ๋‹ˆ๋‹ค. + +3. `์˜ค๋Š˜์ „ํ†ต ํ”„๋กœ๊ทธ๋žจ์„ Company X๊ฐ€ ์˜๋กœํŽ€์น˜๋ž‘ ๊ฐ™์ด ์šด์˜ํ•œ๋‹ค๋Š” ๊ทผ๊ฑฐ ์žˆ์–ด?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ์ง์ ‘ ๋‹ต + ๊ทผ๊ฑฐ ๋ฌธ์„œ๋ช… + ๊ทผ๊ฑฐ ์š”์•ฝ์ด ํ•จ๊ป˜ ๋‚˜์™€์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์˜๋ฏธ: ์ด๋ฏธ ์ผ๋ถ€ ๋™์ž‘ ํ™•์ธ๋œ ์งˆ๋ฌธ์ด๋ฏ€๋กœ, ์žฌ์˜คํ”ˆ ์ดํ›„์—๋„ ๊ณ„์† ์œ ์ง€๋ผ์•ผ ํ•˜๋Š” ๊ธฐ์ค€ ์งˆ๋ฌธ์ž…๋‹ˆ๋‹ค. + ## ๊ธˆ์ง€ ๋‹ต๋ณ€ - ๋‚ด๋ถ€ ๋ฌธ์„œ์— ์—†๋Š” ์ตœ์‹  ์ˆ˜์น˜๋ฅผ ์ถ”์ •ํ•ด ๋‹จ์ •ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. - ๊ทผ๊ฑฐ ๋ฌธ์„œ ์—†์ด "์•Œ๊ณ  ์žˆ๋‹ค", "๊ทธ๋Ÿด ๊ฒƒ์ด๋‹ค" ๊ฐ™์€ ํ‘œํ˜„์œผ๋กœ ๋„˜๊ธฐ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. @@ -116,6 +132,12 @@ tags: [robeing, companyx, rag, scenarios, user-experience] - ์‚ฌ์šฉ์ž๊ฐ€ ๋‹ต๋ณ€ ํ›„ "๊ทผ๊ฑฐ ๋ฌธ์„œ๊ฐ€ ๋ญ๋ƒ"๋ฅผ ๋‹ค์‹œ ๋ฌป๋Š” ๋นˆ๋„๊ฐ€ ์ค„์–ด๋“ญ๋‹ˆ๋‹ค. - ์„ค๋ช…ํ˜•, ์‚ฌ์‹ค ํ™•์ธํ˜•, ์ˆ˜์น˜ ํ™•์ธํ˜•, ์žฌ์ •๋ฆฌํ˜• ์งˆ๋ฌธ ๋ชจ๋‘์—์„œ ๋‹ต๋ณ€ ํ˜•์‹์ด ํฌ๊ฒŒ ํ”๋“ค๋ฆฌ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +## ๋‹ซํž˜ ํŒ์ • ๊ธฐ์ค€ +- ์žฌ์˜คํ”ˆ ๊ธฐ์ค€ ์งˆ๋ฌธ 3๊ฐœ์—์„œ ๊ฐ๊ฐ ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ๊ฐ€ ์‹ค์ œ ์‘๋‹ต์œผ๋กœ ์žฌํ˜„๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์„ฑ๊ณต ์งˆ๋ฌธ 1๊ฐœ๋งŒ ๋งž๊ณ  ๋‹ค๋ฅธ ์งˆ๋ฌธ์—์„œ ๋ฌด๊ด€ํ•œ ์ฒญํฌ๋ฅผ ๋ฐ˜ํ™˜ํ•˜๋Š” ์ƒํƒœ๋Š” ๋‹ซํž˜์œผ๋กœ ๋ณด์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- ์‚ฌ์šฉ์ž๊ฐ€ ์ถ”๊ฐ€ ์งˆ๋ฌธ์„ ํ–ˆ์„ ๋•Œ๋„ ๋ฉ”ํƒ€ ๋Œ€ํ™”๋กœ ๋น ์ง€์ง€ ์•Š๊ณ , ๊ทผ๊ฑฐ ์žฌ์ •๋ฆฌ ๋˜๋Š” ๊ทผ๊ฑฐ ๋ถ€์กฑ ์•ˆ๋‚ด๋กœ ์ด์–ด์ ธ์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์ด ์‹œ๋‚˜๋ฆฌ์˜ค๋Š” ๋Œ€์‘ troubleshooting ๋ฌธ์„œ์™€ ํ•จ๊ป˜ ๋งŒ์กฑํ•˜๋Š” ๋‹จ์ผ research์™€ ๋‹จ์ผ plan์ด ์ž‘์„ฑ๋ผ์•ผ ๋‹ค์Œ ๋‹จ๊ณ„๋กœ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค. + ## ํ˜„์žฌ ์žฌ์˜คํ”ˆ ์ด์œ  - ๋Œ€ํ‘œ ์งˆ๋ฌธ ์ผ๋ถ€๋Š” ๋™์ž‘ํ–ˆ์ง€๋งŒ, Slack ์‹ค์‘๋‹ต `์ปดํผ๋‹ˆ์—‘์Šค์˜ ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?`์—์„œ ๊ธฐ๋Œ€ ํ˜•์‹์ด ๊นจ์กŒ์Šต๋‹ˆ๋‹ค. - ์‹ค์ œ ์‘๋‹ต์€ ์ง์ ‘ ๋‹ต ์—†์ด ๊ด€๋ จ์„ฑ ๋‚ฎ์€ ์ฒญํฌ๋งŒ ๋ฐ˜ํ™˜ํ–ˆ๊ณ , ์ด๋Š” ์ด ์‹œ๋‚˜๋ฆฌ์˜ค์˜ ์™„๋ฃŒ ๊ธฐ์ค€์„ ๋งŒ์กฑํ•˜์ง€ ๋ชปํ•ฉ๋‹ˆ๋‹ค. @@ -126,4 +148,6 @@ tags: [robeing, companyx, rag, scenarios, user-experience] - [Company X ๋‚ด๋ถ€ ๋ฌธ์„œ RAG ์‘๋‹ต ์•„์ด๋””์–ด](../ideas/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_์‘๋‹ต_์•„์ด๋””์–ด.md) - [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต ๊ตฌํ˜„ ๋ฐ ์‹œ๋‚˜๋ฆฌ์˜ค ๊ฒ€์ฆ](../worklog/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_๊ตฌํ˜„๋ฐ์‹œ๋‚˜๋ฆฌ์˜ค๊ฒ€์ฆ.md) - [Company X RAG ๋‹ต๋ณ€ ํ•ฉ์„ฑ ํšŒ๊ท€](../troubleshooting/260312_companyx_rag_answer_composition_regression.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜](../research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๊ณ„ํš](../plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md) - [์ปดํผ๋‹ˆ์—‘์Šค(Company X) ๊ฐœ์š”](../../book/500_business/560_์ปดํผ๋‹ˆ์—‘์Šค_๊ฐœ์š”.md) diff --git a/journey/troubleshooting/260312_companyx_rag_answer_composition_regression.md b/journey/troubleshooting/260312_companyx_rag_answer_composition_regression.md index e72fa2c..633ebbf 100644 --- a/journey/troubleshooting/260312_companyx_rag_answer_composition_regression.md +++ b/journey/troubleshooting/260312_companyx_rag_answer_composition_regression.md @@ -8,6 +8,13 @@ tags: [robeing, companyx, rag, troubleshooting, answer-quality] - [Company X ๋‚ด๋ถ€ ๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต ์‚ฌ์šฉ์ž ์‹œ๋‚˜๋ฆฌ์˜ค](../scenarios/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_๊ทผ๊ฑฐ์‘๋‹ต_์‚ฌ์šฉ์ž์‹œ๋‚˜๋ฆฌ์˜ค.md) - [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต ๊ตฌํ˜„ ๋ฐ ์‹œ๋‚˜๋ฆฌ์˜ค ๊ฒ€์ฆ](../worklog/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_๊ตฌํ˜„๋ฐ์‹œ๋‚˜๋ฆฌ์˜ค๊ฒ€์ฆ.md) - [Company X ๋‚ด๋ถ€๋ฌธ์„œ RAG ๊ทผ๊ฑฐ์‘๋‹ต ๊ตฌํ˜„๊ณ„ํš](../plans/260312_companyx_๋‚ด๋ถ€๋ฌธ์„œ_rag_๊ทผ๊ฑฐ์‘๋‹ต_๊ตฌํ˜„๊ณ„ํš.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๋ฆฌ์„œ์น˜](../research/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๋ฆฌ์„œ์น˜.md) +- [Company X RAG ๋‹ต๋ณ€ํ•ฉ์„ฑ ์‹œ๋‚˜๋ฆฌ์˜คยทํŠธ๋Ÿฌ๋ธ” ๋™์‹œ์ข…๊ฒฐ ๊ณ„ํš](../plans/260315_companyx_rag_๋‹ต๋ณ€ํ•ฉ์„ฑ_์‹œ๋‚˜๋ฆฌ์˜ค๋™์‹œ์ข…๊ฒฐ_๊ณ„ํš.md) + +## ์ด ๋ฌธ์„œ๊ฐ€ ๋‹ค๋ฃจ๋Š” ๋ฒ”์œ„ +- ๋Œ€์ƒ์€ `Company X ๋‚ด๋ถ€๋ฌธ์„œ ๊ทผ๊ฑฐ์‘๋‹ต`์˜ `๋‹ต๋ณ€ ํ•ฉ์„ฑ ๋‹จ๊ณ„`์ž…๋‹ˆ๋‹ค. +- ๊ฒ€์ƒ‰ ์ธํ”„๋ผ ์ž์ฒด ์žฅ์• , ๊ถŒํ•œ ์ฐจ๋‹จ, ๋ฌธ์„œ ์—…๋กœ๋“œ ์‹คํŒจ๋Š” ๋ณธ ๋ฌธ์„œ์˜ 1์ฐจ ๋ฒ”์œ„๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค. +- ํ•ต์‹ฌ์€ `์งˆ๋ฌธ์— ๋งž๋Š” ์ง์ ‘ ๋‹ต`, `์งˆ๋ฌธ ์ ํ•ฉ ๊ทผ๊ฑฐ ์„ ๋ณ„`, `๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ์‹คํŒจ ์ฒ˜๋ฆฌ`๊ฐ€ ์‹ค์ œ ์‘๋‹ต์—์„œ ๊นจ์ง„ ๋ฌธ์ œ์ž…๋‹ˆ๋‹ค. ## ๋ฌธ์ œ - Company X RAG ์—ฐ๊ฒฐ ์ž์ฒด๋Š” ๋˜์—ˆ์ง€๋งŒ, ์‹ค์ œ Slack ์‹ค์‘๋‹ต์ด ์‹œ๋‚˜๋ฆฌ์˜ค์˜ ๊ธฐ๋Œ€ ๋‹ต๋ณ€ ํ˜•์‹์„ ๋งŒ์กฑํ•˜์ง€ ๋ชปํ–ˆ์Šต๋‹ˆ๋‹ค. @@ -34,12 +41,30 @@ tags: [robeing, companyx, rag, troubleshooting, answer-quality] - ๊ทœ์ •ํ˜• ์งˆ๋ฌธ์ฒ˜๋Ÿผ ์•„์˜ˆ ๋ฌธ์„œ๊ตฐ์ด ๋‹ค๋ฅผ ๊ฐ€๋Šฅ์„ฑ์ด ํฐ ์งˆ์˜์—์„œ๋„, `๊ทผ๊ฑฐ ์—†์Œ` ๋Œ€์‹  ๋ฌด๊ด€ํ•œ ์ฒญํฌ๋ฅผ ์–ต์ง€๋กœ ๋ฐ˜ํ™˜ํ–ˆ์Šต๋‹ˆ๋‹ค. - ์ฆ‰ ํ˜„์žฌ ๊ตฌํ˜„์€ `์งˆ๋ฌธ๋ณ„ ๋‹ต๋ณ€ ํ•ฉ์„ฑ ํ’ˆ์งˆ`์ด ์•ˆ์ •ํ™”๋˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. +## ์žฌํ˜„ ์งˆ๋ฌธ์…‹๊ณผ ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ +1. `์ปดํผ๋‹ˆ์—‘์Šค์˜ ํˆฌ์ž์‚ฌ๋Š” ๋ช‡๊ฐœ์•ผ?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ์ง์ ‘ ๋‹ต์ด ๋จผ์ € ๋‚˜์™€์•ผ ํ•˜๋ฉฐ, ๋‚ด๋ถ€ ๋ฌธ์„œ๋งŒ์œผ๋กœ ๋‹จ์ • ๋ถˆ๊ฐ€ํ•˜๋ฉด ๊ทธ ์‚ฌ์‹ค์„ ๋ช…ํ™•ํžˆ ๋งํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ๊ธˆ์ง€ ๊ฒฐ๊ณผ: `๊ด€๋ จ ๊ทผ๊ฑฐ๋ฅผ ์ฐพ์•˜์Šต๋‹ˆ๋‹ค` ๊ฐ™์€ ๋ฉ”ํƒ€ ๋ฌธ์žฅ๋งŒ ๋ฐ˜ํ™˜ํ•˜๊ฑฐ๋‚˜, ๊ฐœ์ˆ˜์™€ ๋ฌด๊ด€ํ•œ ์ฒญํฌ๋ฅผ ๊ทธ๋Œ€๋กœ ๋…ธ์ถœํ•˜๋Š” ๊ฒƒ + +2. `๊ทธ๋Ÿผ ์ปดํผ๋‹ˆ์—‘์Šค ๋‚ด๋ถ€ ๊ทœ์ • ์ƒ ํœด๊ฐ€๋Š” ์–ผ๋งˆ๋‚˜ ์“ธ ์ˆ˜ ์žˆ์–ด?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ํœด๊ฐ€ ๊ทœ์ • ๋ฌธ์„œ๊ฐ€ ์—†๊ฑฐ๋‚˜ ํ™•์ธ๋˜์ง€ ์•Š์œผ๋ฉด `๋‚ด๋ถ€ ๋ฌธ์„œ ๊ธฐ์ค€์œผ๋กœ๋Š” ํ™•์ธ๋˜์ง€ ์•Š๋Š”๋‹ค`๊ณ  ๋‹ตํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ๊ธˆ์ง€ ๊ฒฐ๊ณผ: ํœด๊ฐ€์™€ ๋ฌด๊ด€ํ•œ ์‚ฌ์—…๊ณ„ํš์„œ ์ฒญํฌ๋ฅผ ๊ทผ๊ฑฐ์ฒ˜๋Ÿผ ๋ถ™์ด๋Š” ๊ฒƒ + +3. `์˜ค๋Š˜์ „ํ†ต ํ”„๋กœ๊ทธ๋žจ์„ Company X๊ฐ€ ์˜๋กœํŽ€์น˜๋ž‘ ๊ฐ™์ด ์šด์˜ํ•œ๋‹ค๋Š” ๊ทผ๊ฑฐ ์žˆ์–ด?` +- ๊ธฐ๋Œ€ ๊ฒฐ๊ณผ: ์ง์ ‘ ๋‹ต + ๊ทผ๊ฑฐ ๋ฌธ์„œ๋ช… + ์งง์€ ๊ทผ๊ฑฐ ์š”์•ฝ์ด ํ•จ๊ป˜ ๋‚˜์™€์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์˜๋ฏธ: ์ด ์งˆ๋ฌธ์€ ์ด๋ฏธ ์ผ๋ถ€ ์„ฑ๊ณตํ•œ ๊ธฐ์ค€ ์งˆ๋ฌธ์œผ๋กœ, ํšŒ๊ท€ ์—ฌ๋ถ€๋ฅผ ํ•จ๊ป˜ ๋ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. + ## ์›์ธ ๊ฐ€์„ค 1. retrieval ๊ฒฐ๊ณผ๋ฅผ ์งˆ๋ฌธ ์ ํ•ฉ๋„ ๊ธฐ์ค€์œผ๋กœ ์žฌ์ •๋ ฌ/ํ•„ํ„ฐ๋งํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. 2. ์ˆ˜์น˜ํ˜• ์งˆ๋ฌธ๊ณผ ์‚ฌ์‹ค ํ™•์ธํ˜• ์งˆ๋ฌธ์„ ๋ถ„๋ฆฌํ•˜์ง€ ์•Š๊ณ  ๊ฐ™์€ ์‘๋‹ต ํฌ๋งท์œผ๋กœ ์ฒ˜๋ฆฌํ•ฉ๋‹ˆ๋‹ค. 3. `์ง์ ‘ ๋‹ต ์ƒ์„ฑ` ์ „์— `๊ทผ๊ฑฐ ์ฒญํฌ ์„ ๋ณ„`์ด ์ถฉ๋ถ„ํžˆ ์ •๊ตํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. 4. ์ ์ ˆํ•œ ๊ทผ๊ฑฐ๊ฐ€ ์—†์„ ๋•Œ `๋ชจ๋ฅธ๋‹ค/๋ฌธ์„œ ๋ฏธํ™•์ธ`๋กœ ๋น ์ง€๋Š” ์‹คํŒจ ๊ฒฝ๋กœ๊ฐ€ ์•ฝํ•ฉ๋‹ˆ๋‹ค. +## ๋ฒ”์œ„ ๋ฐ–์œผ๋กœ ๊ณ ์ •ํ•˜๋Š” ๊ฒƒ +- Company X ์ „์ฒด ๋ฌธ์„œ์…‹ ํ™•๋Œ€ ์ž์ฒด๋ฅผ ์ด๋ฒˆ ํšŒ๊ท€์˜ ์ง์ ‘ ์›์ธ์œผ๋กœ ๋‹จ์ •ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- `skill-rag-file` ๊ฒ€์ƒ‰ API ์ž์ฒด๊ฐ€ ํ•ญ์ƒ ์‹คํŒจํ•œ๋‹ค๊ณ  ๋ณด์ง€ ์•Š์Šต๋‹ˆ๋‹ค. +- `rb8001` ๋ฉ”๋ชจ๋ฆฌ ์ปฌ๋ ‰์…˜์˜ `768/384` ์ฐจ์› ๋“œ๋ฆฌํ”„ํŠธ๋Š” ๋ณ„๋„ ์ด์Šˆ์ด๋ฉฐ, ์ด๋ฒˆ ํšŒ๊ท€์˜ ์ง์ ‘ ์›์ธ์œผ๋กœ ์„ž์ง€ ์•Š์Šต๋‹ˆ๋‹ค. + ## ํ•„์š”ํ•œ ์กฐ์น˜ 1. ์งˆ๋ฌธ ์œ ํ˜•๋ณ„ ์‘๋‹ต ๊ทœ์น™ ๋ถ„๊ธฐ - ์ˆ˜์น˜ ํ™•์ธํ˜• @@ -50,5 +75,10 @@ tags: [robeing, companyx, rag, troubleshooting, answer-quality] 4. Slack ์‹ค์‘๋‹ต ๊ธฐ์ค€์œผ๋กœ ์‹œ๋‚˜๋ฆฌ์˜ค ์งˆ๋ฌธ์…‹ ์žฌ๊ฒ€์ฆ 5. ๊ทผ๊ฑฐ ๋ถ€์กฑ ์‹œ ๋ฉ”ํƒ€ ๋Œ€ํ™”๊ฐ€ ์•„๋‹ˆ๋ผ `๋ฌธ์„œ ์—†์Œ ๋˜๋Š” ๋ฏธํ™•์ธ`์œผ๋กœ ๋‹ตํ•˜๋Š” ์‹คํŒจ ๊ฒฝ๋กœ ๊ณ ์ • +## ๋‹ซํž˜ ํŒ์ • ๊ธฐ์ค€ +- ์œ„ ์žฌํ˜„ ์งˆ๋ฌธ์…‹์—์„œ `์ง์ ‘ ๋‹ต ์—†์Œ`, `๋ฌด๊ด€ํ•œ ์ฒญํฌ ๋…ธ์ถœ`, `๋ฉ”ํƒ€ ๋Œ€ํ™”๋กœ ํšŒํ”ผ`๊ฐ€ ๋” ์ด์ƒ ์žฌํ˜„๋˜์ง€ ์•Š์•„์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์„ฑ๊ณต ์งˆ๋ฌธ์€ ๊ณ„์† ์„ฑ๊ณตํ•ด์•ผ ํ•˜๊ณ , ๊ทผ๊ฑฐ ๋ถ€์กฑ ์งˆ๋ฌธ์€ ์–ต์ง€ ๋‹ต๋ณ€ ๋Œ€์‹  ๋ช…์‹œ์  ๋ถ€์กฑ ์•ˆ๋‚ด๋กœ ๊ณ ์ •๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. +- ์ด ๋ฌธ์„œ์™€ ์‹œ๋‚˜๋ฆฌ์˜ค ๋ฌธ์„œ๋ฅผ ํ•จ๊ป˜ ๋งŒ์กฑ์‹œํ‚ค๋Š” ๋‹จ์ผ research ๋ฌธ์„œ๊ฐ€ ํ›„์†์œผ๋กœ ์ž‘์„ฑ๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค. + ## ์ƒํƒœ - ์—ด๋ฆผ