From c6a7f402b146ae598c0a6b33a49ed03f6a6f2371 Mon Sep 17 00:00:00 2001 From: happybell80 Date: Mon, 23 Mar 2026 00:53:21 +0900 Subject: [PATCH] docs: close 260323 grounding routing rollback follow-up --- ...˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md | 4 +- journey/troubleshooting/README.md | 2 - ...…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md | 49 +++++++++++++++++++ 3 files changed, 52 insertions(+), 3 deletions(-) create mode 100644 journey/worklog/260323_companyx_grounding_๋งˆ์ปค๊ธฐ๋ฐ˜๋ผ์šฐํŒ…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md diff --git a/journey/plans/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md b/journey/plans/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md index 5d504fd..993a7a8 100644 --- a/journey/plans/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md +++ b/journey/plans/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md @@ -1,7 +1,7 @@ --- status: closed closed_date: 2026-03-21 -closed_reason: P0 3๊ฑด(prefix/threshold/RRF) + P1 2๊ฑด(์ฒญํฌ์žฌ๋ถ„ํ• /๋ผ์šฐํŒ…์™„ํ™”) ์ „๋ถ€ ๊ตฌํ˜„ยท๋ฐฐํฌยท๊ฒ€์ฆ ์™„๋ฃŒ. keyword 0โ†’5๊ฑด, grounding 5โ†’11, ์˜๋กœํŽ€์น˜ MOU top-1. +closed_reason: P0 3๊ฑด(prefix/threshold/RRF) + P1 2๊ฑด(์ฒญํฌ์žฌ๋ถ„ํ• /๋ผ์šฐํŒ…์™„ํ™”) ๊ตฌํ˜„ยท๋ฐฐํฌยท๊ฒ€์ฆ ์™„๋ฃŒ. ๋‹ค๋งŒ P1-5(team_id ๋‹จ๋… grounding)๋Š” 2026-03-23 ๋งˆ์ปค ๊ธฐ๋ฐ˜ ์ง„์ž…์œผ๋กœ ๋กค๋ฐฑ๋จ. --- # 260321 ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰ ํ’ˆ์งˆ ๊ฐœ์„  ๊ณ„ํš @@ -15,6 +15,7 @@ closed_reason: P0 3๊ฑด(prefix/threshold/RRF) + P1 2๊ฑด(์ฒญํฌ์žฌ๋ถ„ํ• /๋ผ์šฐํŒ… - [260321 ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰ keyword recall=0 ๋ฐ grounding ์‹คํŒจ ์›์ธ ํ™•์ • ๋ฆฌ์„œ์น˜](../research/rag/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_keyword_recall0_๋ฐ_grounding_์‹คํŒจ_์›์ธํ™•์ •_๋ฆฌ์„œ์น˜.md) - [260320 ๋กœ๋น™ ๋‹คํ˜•์‹๋ฌธ์„œ RAG ์ ์šฉ1 ๊ณ„ํš](./260320_๋กœ๋น™_๋‹คํ˜•์‹๋ฌธ์„œ_RAG_์ ์šฉ1_๊ณ„ํš.md) +- [260323 Company X grounding ๋งˆ์ปค ๊ธฐ๋ฐ˜ ๋ผ์šฐํŒ… ๋ณต์› ๋ฐ fallback ๋ณต๊ตฌ ๊ฒ€์ฆ ์™„๋ฃŒ](../worklog/260323_companyx_grounding_๋งˆ์ปค๊ธฐ๋ฐ˜๋ผ์šฐํŒ…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md) ## ์›์ธ โ†’ ์กฐ์น˜ ๋งคํ•‘ @@ -66,6 +67,7 @@ closed_reason: P0 3๊ฑด(prefix/threshold/RRF) + P1 2๊ฑด(์ฒญํฌ์žฌ๋ถ„ํ• /๋ผ์šฐํŒ… - ๋”ฐ๋ผ์„œ grounding ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ 0๊ฑด์ด๋ฉด ๊ธฐ์กด์ฒ˜๋Ÿผ ์ผ๋ฐ˜ ์ฑ—๋ด‡ ๊ฒฝ๋กœ๋กœ ์ž์—ฐ fallback - **๋ฒ”์œ„ ์œ„ํ—˜**: ์ผ๋ฐ˜ ๋Œ€ํ™”("์ ์‹ฌ ๋ญ ๋จน์„๊นŒ?")๋„ ๊ฒ€์ƒ‰ API๋ฅผ ํƒœ์šฐ๊ฒŒ ๋จ. ๋ถˆํ•„์š”ํ•œ API ํ˜ธ์ถœ + ์‘๋‹ต ์ง€์—ฐ ๋ฐœ์ƒ ๊ฐ€๋Šฅ - **๋กค๋ฐฑ ๊ธฐ์ค€**: ๋ฐฐํฌ ํ›„ ์ผ๋ฐ˜ ๋Œ€ํ™” ์‘๋‹ต ์ง€์—ฐ์ด 1์ดˆ ์ด์ƒ ์ฆ๊ฐ€ํ•˜๊ฑฐ๋‚˜, grounding ๊ฒฝ๋กœ ์ง„์ž…๋ฅ ์ด 80% ์ด์ƒ์ด๋ฉด ๋งˆ์ปค ์ฒดํฌ ๋ณต์› +- **ํ›„์† ์ด๋ ฅ**: ์œ„ ์œ„ํ—˜์ด ์‹ค์ œ ํ˜‘์—… ๊ฒ€ํ† ์—์„œ ํ™•์ธ๋˜์–ด 2026-03-23 `91b92da`์—์„œ `team_id + marker` ๊ธฐ์ค€์œผ๋กœ ๋กค๋ฐฑ๋๋‹ค. ํ˜„์žฌ ์šด์˜ ๊ธฐ์ค€์€ ์ด ๋ฌธ์„œ๊ฐ€ ์•„๋‹ˆ๋ผ 260323 ์›Œํฌ๋กœ๊ทธ์™€ `SKILL.md`, `companyx_grounding_pipeline.md`๋ฅผ ๋”ฐ๋ฅธ๋‹ค. ## ์‹คํ–‰ ์ˆœ์„œ diff --git a/journey/troubleshooting/README.md b/journey/troubleshooting/README.md index a2cfe29..2269b53 100644 --- a/journey/troubleshooting/README.md +++ b/journey/troubleshooting/README.md @@ -39,8 +39,6 @@ - ์ƒํƒœ: ์—ด๋ฆผ - [260311_prompt_db_partial_adoption_and_hardcoded_prompts.md](./260311_prompt_db_partial_adoption_and_hardcoded_prompts.md) - ์ƒํƒœ: ์—ด๋ฆผ -- [260312_companyx_rag_answer_composition_regression.md](./260312_companyx_rag_answer_composition_regression.md) - - ์ƒํƒœ: ๋ฒ”์œ„ ์กฐ์ • ์ค‘ - [260312_rb8001_memory_chromadb_768_384_dimension_drift.md](./260312_rb8001_memory_chromadb_768_384_dimension_drift.md) - ์ƒํƒœ: ์—ด๋ฆผ diff --git a/journey/worklog/260323_companyx_grounding_๋งˆ์ปค๊ธฐ๋ฐ˜๋ผ์šฐํŒ…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md b/journey/worklog/260323_companyx_grounding_๋งˆ์ปค๊ธฐ๋ฐ˜๋ผ์šฐํŒ…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md new file mode 100644 index 0000000..6d7693e --- /dev/null +++ b/journey/worklog/260323_companyx_grounding_๋งˆ์ปค๊ธฐ๋ฐ˜๋ผ์šฐํŒ…๋ณต์›_๋ฐ_fallback๋ณต๊ตฌ_๊ฒ€์ฆ์™„๋ฃŒ.md @@ -0,0 +1,49 @@ +--- +type: worklog +tags: [worklog, companyx, grounding, routing, fallback, rb8001] +work_date: 2026-03-23 +--- + +# 260323 Company X grounding ๋งˆ์ปค ๊ธฐ๋ฐ˜ ๋ผ์šฐํŒ… ๋ณต์› ๋ฐ fallback ๋ณต๊ตฌ ๊ฒ€์ฆ ์™„๋ฃŒ + +## ๋ฐฐ๊ฒฝ + +- `260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md`์˜ P1-5์—์„œ Company X team_id ์‚ฌ์šฉ์ž๋Š” ๋งˆ์ปค ์—†์ด๋„ grounding์„ ์šฐ์„  ์‹œ๋„ํ•˜๋„๋ก ์™„ํ™”ํ–ˆ๋‹ค. +- ์ดํ›„ ์ผ๋ฐ˜ ๋Œ€ํ™”๊นŒ์ง€ grounding ๊ฒฝ๋กœ์— ๊ณผ์ž‰ ์ง„์ž…ํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ํ˜‘์—… ๊ฒ€ํ† ๊ฐ€ ๋‚˜์™”๊ณ , 23/24 ์„œ๋ฒ„ ์—์ด์ „ํŠธ๊ฐ€ ์ตœ์ข…์ ์œผ๋กœ ๋งˆ์ปค ๊ธฐ๋ฐ˜ ๋ณต์›์— ํ•ฉ์˜ํ–ˆ๋‹ค. + +## ์กฐ์น˜ + +1. `rb8001` `91b92da` + - `should_handle_companyx_grounding()`๋ฅผ `team_id + marker(intent/domain)` ๊ธฐ์ค€์œผ๋กœ ๋ณต์› + - `try_companyx_grounding()`์—์„œ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ 0๊ฑด์ด๋ฉด `None`์„ ๋ฐ˜ํ™˜ํ•ด ์ผ๋ฐ˜ ์Šคํ‚ฌ ๊ฒฝ๋กœ๋กœ fallback ๋ณต๊ตฌ +2. `DOCS` `c1d9cc2` + - `skills/companyx-rag/SKILL.md` Trigger๋ฅผ ๋งˆ์ปค ๊ธฐ๋ฐ˜ ์ง„์ž…์œผ๋กœ ์ •๋ ฌ + - `workflow/03_rag/companyx_grounding_pipeline.md` ์ฒ˜๋ฆฌ ์ˆœ์„œ์™€ ์‹คํŒจ ๋ถ„๊ธฐ๋ฅผ ํ˜„์žฌ ์ฝ”๋“œ ๊ธฐ์ค€์œผ๋กœ ์ •๋ ฌ + +## ๊ฒ€์ฆ + +- ์ฝ”๋“œ ์‹ค๋ฌผ ํ™•์ธ: + - `rb8001` HEAD `91b92da` + - `should_handle_companyx_grounding()`๋Š” `team_id == COMPANYX_TEAM_ID`์ด๋ฉด์„œ marker ๋งค์นญ์ผ ๋•Œ๋งŒ grounding ์ง„์ž… + - `try_companyx_grounding()`๋Š” `top_results` 0๊ฑด์ผ ๋•Œ `None` ๋ฐ˜ํ™˜ +- ๋ฌธ์„œ ์‹ค๋ฌผ ํ™•์ธ: + - `DOCS` HEAD `c1d9cc2` + - `SKILL.md`, `companyx_grounding_pipeline.md`๊ฐ€ ์ฝ”๋“œ ๊ธฐ์ค€๊ณผ ์ผ์น˜ +- ํ†ตํ•ฉ ํ…Œ์ŠคํŠธ ์™„๋ฃŒ ๋ณด๊ณ : + - `[24]_260323_ํ†ตํ•ฉํ…Œ์ŠคํŠธ_์™„๋ฃŒ_24codex.md` + - Company X ์‚ฌ์šฉ์ž + marker ์žˆ์Œ โ†’ grounding ์ง„์ž… PASS + - Company X ์‚ฌ์šฉ์ž + marker ์—†์Œ โ†’ ์ผ๋ฐ˜ ๊ฒฝ๋กœ PASS + - ๋น„ Company X ์‚ฌ์šฉ์ž + marker ์žˆ์Œ โ†’ ์ผ๋ฐ˜ ๊ฒฝ๋กœ PASS + - ๊ฒ€์ƒ‰ 0๊ฑด fallback ๋ถ„๊ธฐ โ†’ patch ๊ธฐ๋ฐ˜ ํ†ตํ•ฉ ํ˜ธ์ถœ PASS + +## ๊ฒฐ๊ณผ + +- ํ˜„์žฌ ์šด์˜ ๊ธฐ์ค€์€ `team_id ๋‹จ๋… ์ง„์ž…`์ด ์•„๋‹ˆ๋ผ `team_id + marker`๋‹ค. +- ์ผ๋ฐ˜ ์งˆ๋ฌธ์€ grounding์— ๊ณผ์ž‰ ์ง„์ž…ํ•˜์ง€ ์•Š๊ณ , ๋ฌธ์„œ ์งˆ๋ฌธ๋งŒ grounding์œผ๋กœ ๋“ค์–ด๊ฐ„๋‹ค. +- ๋ฌธ์„œ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ๊ฐ€ 0๊ฑด์ด๋ฉด grounding ์‹คํŒจ ์‘๋‹ต์œผ๋กœ ๊ณ ์ •ํ•˜์ง€ ์•Š๊ณ  ์ผ๋ฐ˜ ๊ฒฝ๋กœ๋กœ ๋˜๋Œ๋ฆฐ๋‹ค. + +## ๊ด€๋ จ ๋ฌธ์„œ + +- [260321 ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰ ํ’ˆ์งˆ ๊ฐœ์„  ๊ณ„ํš](../plans/260321_ํ•˜์ด๋ธŒ๋ฆฌ๋“œ๊ฒ€์ƒ‰_ํ’ˆ์งˆ๊ฐœ์„ _๊ณ„ํš.md) +- [260322 ๊ฒ€์ƒ‰ ํ’ˆ์งˆ 2์ฐจ โ€” ํŒŒ์ผ๋ช… ๋ณด์กฐ ๊ฒ€์ƒ‰ + ๋Œ€ํ™” ๋งฅ๋ฝ ์ „๋‹ฌ](../plans/260322_๊ฒ€์ƒ‰ํ’ˆ์งˆ2์ฐจ_ํŒŒ์ผ๋ช…๋ณด์กฐ๊ฒ€์ƒ‰_๋Œ€ํ™”๋งฅ๋ฝ์ „๋‹ฌ_๊ณ„ํš.md) +- [Company X RAG LLM ํŒ๋‹จ ๊ณผ๋ณด์ˆ˜ + ๋Œ€ํ™” ๋งฅ๋ฝ ๋ฏธ์—ฐ๊ฒฐ](../troubleshooting/260322_companyx_rag_LLMํŒ๋‹จ๋ณด์ˆ˜_๋Œ€ํ™”๋งฅ๋ฝ๋ฏธ์—ฐ๊ฒฐ.md)