From 05f49a5fae2cbd3fef66c298cf657c00bbbf328c Mon Sep 17 00:00:00 2001 From: happybell80 Date: Tue, 3 Mar 2026 12:08:17 +0900 Subject: [PATCH] docs: add GooseCouncil evaluation decision logic research for robeing --- ...ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md | 70 +++++++++++++++++++ journey/research/README.md | 3 +- 2 files changed, 72 insertions(+), 1 deletion(-) create mode 100644 journey/research/260303_๊ตฌ์นด_ํ‰๊ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md diff --git a/journey/research/260303_๊ตฌ์นด_ํ‰๊ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md b/journey/research/260303_๊ตฌ์นด_ํ‰๊ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md new file mode 100644 index 0000000..4445f4d --- /dev/null +++ b/journey/research/260303_๊ตฌ์นด_ํ‰๊ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md @@ -0,0 +1,70 @@ +# 260303 ๊ตฌ์นด ํ‰๊ฐ€ยท๊ฒฐ์ • ๋กœ์ง ๋กœ๋น™ ์ ์šฉ ๋ฆฌ์„œ์น˜ + +## ๋ชฉ์  +- TheGooseCouncil(๊ตฌ์นด)์˜ ํ‰๊ฐ€/๊ฒฐ์ • ์ฒด๊ณ„์—์„œ ๋กœ๋น™ ์šด์˜์— ์ฆ‰์‹œ ์ธ์šฉ ๊ฐ€๋Šฅํ•œ ๊ทœ์น™์„ ์ถ”์ถœํ•œ๋‹ค. + +## ํ™•์ธํ•œ ์›๋ฌธ(๊ทผ๊ฑฐ) +- `/home/admin/thegoosecouncil/DOCS/00_JOURNEY_OUT/07_ENGINEERING/Scoring_Formula_v1.md` +- `/home/admin/thegoosecouncil/DOCS/00_JOURNEY_OUT/03_EVALUATION/Evaluation_Framework.md` +- `/home/admin/thegoosecouncil/DOCS/00_JOURNEY_OUT/07_ENGINEERING/Policy_Externalization_and_Auto_Evolution.md` +- `/home/admin/thegoosecouncil/DOCS/00_JOURNEY_OUT/06_OPERATIONS/Failure_Prevention_Principles.md` +- `/home/admin/thegoosecouncil/tests/test_value_state_decision.py` + +## ๊ตฌ์นด์—์„œ ์ธ์šฉํ•  ํ•ต์‹ฌ +1. 4์ถ• ๊ณ ์ • ์ ์ˆ˜ + ์ปท์˜คํ”„ + ๋™์  ๊ทœ์น™ +- ์ ์ˆ˜์ถ•: `feasibility`, `goal_fit`, `differentiation`, `risk_control` +- ์ปท์˜คํ”„: `F < 50` ๋˜๋Š” `R < 40` ์ž๋™ ํƒˆ๋ฝ +- ๋™์  ์šฐ์„ ์ˆœ์œ„: `F` > `R` > ๊ทผ๊ฑฐ ํ’ˆ์งˆ + +2. 2์ธต ํ‰๊ฐ€ ๋ฃจํ”„(Judge-of-Judge) +- 1์ธต: ์ „๋žต/์‚ฐ์ถœ๋ฌผ ์ ์ˆ˜ +- 2์ธต: ํ‰๊ฐ€์ž ๋ฉ”ํƒ€์ ์ˆ˜(์ •ํ™•๋„/์ผ๊ด€์„ฑ/๊ณต์ •์„ฑ/์„ค๋ช…๋ ฅ) +- ๋ฃจํ”„: `์ „๋žต ํ‰๊ฐ€ -> ๋ฉ”ํƒ€ํ‰๊ฐ€ -> ๋‹ค์Œ ๋ผ์šด๋“œ ๊ฐ€์ค‘์น˜ ๊ฐฑ์‹ ` + +3. ํ‰๊ฐ€์ž ์‹ ๋ขฐ๋„ ๋™์  ๊ฐฑ์‹  +- ํ‰๊ฐ€์ž ๊ณ„์ˆ˜ `Q`๋ฅผ ๊ณ ์ •ํ•˜์ง€ ์•Š๊ณ  ๋ผ์šด๋“œ ์ฆ๊ฑฐ ๊ธฐ๋ฐ˜์œผ๋กœ ๊ฐฑ์‹  +- ์šด์˜์‹ ์˜ˆ์‹œ: `PosteriorQ = (1-alpha)*PriorQ + alpha*EvidenceScore` + +4. ์ง‘๊ณ„ ์•ˆ์ •ํ™” ๊ทœ์น™ +- ํ‰๊ฐ€์ž๋ณ„ ๋ณด์ • ์ ์ˆ˜ ์ง‘๊ณ„์— ํ‰๊ท (mean) ๋Œ€์‹  `median` ์‚ฌ์šฉ +- ์ด์ƒ์น˜ ํ‰๊ฐ€์ž ์˜ํ–ฅ ์™„ํ™” ๋ชฉ์  + +5. ์ •์ฑ… ์™ธ๋ถ€ํ™”(์ฝ”๋“œ ํ•˜๋“œ์ฝ”๋”ฉ ๊ธˆ์ง€) +- ๊ฐ€์ค‘์น˜/์ปท์˜คํ”„/์„ ๋ฐœ๊ธฐ์ค€/๋ผ์šฐํŒ…์„ ์ •์ฑ… ์ €์žฅ์†Œ(DB/๋ฒ„์ „)๋กœ ๋ถ„๋ฆฌ +- ๋กค๋ฐฑ ๊ฐ€๋Šฅํ•œ ์ •์ฑ… ๋ฒ„์ „ ์šด์˜ + +6. ์šด์˜ ๊ฒŒ์ดํŠธ ๊ฐ•์ œ +- ์™„๋ฃŒ ๋ณด๊ณ  ์ „ ๊ฒ€์ฆ ๋กœ๊ทธ ํ™•๋ณด +- ๋„คํŠธ์›Œํฌ ๊ฒ€์ฆ ํƒ€์ž„์•„์›ƒ ํ•„์ˆ˜ +- ๊ด‘๋ฒ”์œ„ fallback ๋‚จ์šฉ ๊ธˆ์ง€ + +## ๋กœ๋น™ ์ ์šฉ ์ œ์•ˆ (์šฐ์„ ์ˆœ์œ„) +### P0 (์ฆ‰์‹œ) +- ๋กœ๋น™์˜ ํ•ต์‹ฌ ์˜์‚ฌ๊ฒฐ์ •์— `ํ•˜๋“œ ์ปท์˜คํ”„` ๋„์ž… + - ์˜ˆ: ์ธ์ฆ/์—ฐ๊ฒฐ/๋ฐ์ดํ„ฐ ๋ฌด๊ฒฐ์„ฑ ๊ธฐ์ค€ ๋ฏธ๋‹ฌ ์‹œ ์ž๋™ ํƒˆ๋ฝ(์šฐํšŒ ๊ธˆ์ง€) +- ์ ์ˆ˜ ๋™๋ฅ /๊ฒฝํ•ฉ ์ƒํ™ฉ์— ๋™์  ๊ทœ์น™ ๋ช…์‹œ + - ์šด์˜ ์•ˆ์ •์„ฑ > ๋ชฉ์  ์ ํ•ฉ์„ฑ > ๊ทผ๊ฑฐ ํ’ˆ์งˆ ์ˆœ +- ์™„๋ฃŒ ์ „ ๊ฒŒ์ดํŠธ ๊ณ ์ • + - ์˜์กด์„ฑ ์Šค์บ” -> ํฌํŠธ ๋งคํŠธ๋ฆญ์Šค -> ํ•ต์‹ฌ API ์‹คํ˜ธ์ถœ -> ๋กœ๊ทธ ๊ต์ฐจ๊ฒ€์ฆ + +### P1 (๋‹จ๊ธฐ) +- ํ‰๊ฐ€์ž ์‹ ๋ขฐ๋„ ๊ฐœ๋… ๋„์ž… + - ์‚ฌ๋žŒ/์„œ๋น„์Šค/์—์ด์ „ํŠธ ํŒ๋‹จ ๊ฒฐ๊ณผ์— ์‹ ๋ขฐ๋„ ๊ณ„์ˆ˜ ์ ์šฉ +- ์ง‘๊ณ„ ํ•จ์ˆ˜์— median ์šฐ์„  ์ ์šฉ + - ๋‹จ์ผ ์ด์ƒ์น˜๋กœ ์ „์ฒด ์˜์‚ฌ๊ฒฐ์ •์ด ํ”๋“ค๋ฆฌ์ง€ ์•Š๋„๋ก ๋ฐฉ์–ด + +### P2 (์ค‘๊ธฐ) +- ์ •์ฑ… ์™ธ๋ถ€ํ™” + - ํ•˜๋“œ์ฝ”๋”ฉ๋œ ์ž„๊ณ„์น˜/๊ฐ€์ค‘์น˜๋ฅผ ์ •์ฑ… ๋ฒ„์ „์œผ๋กœ ๋ถ„๋ฆฌ + - ๋ณ€๊ฒฝ ์ด๋ ฅ, ๋กค๋ฐฑ, ๋ณ€๊ฒฝ ํญ ์ œํ•œ ์šด์˜ + +## ๋กœ๋น™์— ๋ฐ”๋กœ ์“ฐ๋Š” ๊ฒฐ์ • ํ…œํ”Œ๋ฆฟ +1. ์ž…๋ ฅ ๊ฒ€์ฆ/ํ•˜๋“œ ์ปท์˜คํ”„ ์ ์šฉ +2. 4์ถ• ์ ์ˆ˜ ๊ณ„์‚ฐ(๊ฐ€์ค‘์น˜ ๋ฒ„์ „ ๋ช…์‹œ) +3. ๋™์  ๊ทœ์น™ ์ ์šฉ +4. ๋ฉ”ํƒ€ํ‰๊ฐ€ ๋ฐ˜์˜ ์‹ ๋ขฐ๋„ ๋ณด์ • +5. ์ตœ์ข… ๊ฒฐ์ • + ๊ทผ๊ฑฐ 3์ค„ + ๊ฐ์‚ฌ ๋กœ๊ทธ ์ €์žฅ + +## ์ฃผ์˜์‚ฌํ•ญ +- ๊ตฌ์นด์˜ ์ˆ˜์น˜(๊ฐ€์ค‘์น˜/์ปท์˜คํ”„)๋ฅผ ๊ทธ๋Œ€๋กœ ๋ณต์ œํ•˜์ง€ ๋ง๊ณ , ๋กœ๋น™ ์šด์˜ ๋ฐ์ดํ„ฐ๋กœ ์žฌ๋ณด์ •ํ•ด์•ผ ํ•œ๋‹ค. +- ๊ทœ์น™์€ ์ฝ”๋“œ๊ฐ€ ์•„๋‹ˆ๋ผ ์ •์ฑ… ๋ฒ„์ „์œผ๋กœ ๊ด€๋ฆฌํ•ด์•ผ ์žฌ๋ฐœ ๋ฐฉ์ง€์™€ ๋กค๋ฐฑ์ด ๊ฐ€๋Šฅํ•˜๋‹ค. diff --git a/journey/research/README.md b/journey/research/README.md index 4509d10..44dc2e1 100644 --- a/journey/research/README.md +++ b/journey/research/README.md @@ -53,6 +53,7 @@ ### [์˜ค์ผ€์ŠคํŠธ๋ ˆ์ด์…˜ยท์—์ด์ „ํŠธ ํ”Œ๋žซํผ(Orchestration Tools)](./orchestration_tools/README.md) - LangGraph vs n8n ๋น„๊ต - OpenClaw ์•„ํ‚คํ…์ฒ˜ ๋ฐ ๋กœ๋น™ ์ ์šฉ ๋ฆฌ์„œ์น˜ +- [๊ตฌ์นด ํ‰๊ฐ€ยท๊ฒฐ์ • ๋กœ์ง ๋กœ๋น™ ์ ์šฉ ๋ฆฌ์„œ์น˜ (260303)](./260303_๊ตฌ์นด_ํ‰๊ฐ€๊ฒฐ์ •_๋กœ์ง_๋กœ๋น™_์ ์šฉ_๋ฆฌ์„œ์น˜.md) ## ๋กœ๋น™์„ ์œ„ํ•œ ์ฒดํฌ๋ฆฌ์ŠคํŠธ @@ -128,4 +129,4 @@ - ์œค๋ฆฌ์  ์˜์‚ฌ๊ฒฐ์ • ํ”„๋ ˆ์ž„์›Œํฌ ## ๋‹ค์Œ ๋‹จ๊ณ„ -์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋ฅผ ์‹ค์ œ ์‹œ์Šคํ…œ์— ์ ์šฉํ•˜๊ณ , [700_for_robeing](../700_for_robeing/README.md)์—์„œ ๋‹ค๋ฅธ ๋กœ๋น™๊ณผ ์ง€์‹์„ ๊ณต์œ ํ•˜์„ธ์š”. \ No newline at end of file +์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋ฅผ ์‹ค์ œ ์‹œ์Šคํ…œ์— ์ ์šฉํ•˜๊ณ , [700_for_robeing](../700_for_robeing/README.md)์—์„œ ๋‹ค๋ฅธ ๋กœ๋น™๊ณผ ์ง€์‹์„ ๊ณต์œ ํ•˜์„ธ์š”.