devops-pdt613/market-assistant
1
0
Fork 0
mirror of https://github.com/primedigitaltech/market-assistant.git synced 2026-07-22 08:01:34 +08:00
Code Issues Packages Projects Releases Wiki Activity
66 Commits 2 Branches 0 Tags
Commit Graph

66 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hub-gif
f915653104 feat(dataset): 库内浏览支持跳转页、排序与类目价格筛选 
新增 JdLeafCategoryNorm 与 price 解析字段；数据集 API 支持 sort/order、category_norm_id、price 区间与类目路径模糊；摘要返回类目选项；前端 JobDatasetModal 增加筛选与分页跳转。

Made-with: Cursor
 2026-04-16 09:51:26 +08:00
hub-gif
da11f49572 chore: 将 Cursor 规则纳入版本库并约定提交说明使用中文 
Made-with: Cursor
 2026-04-15 17:58:25 +08:00
hub-gif
9cea35a665 fix(report): drop §4 brand/shop tables, align CR with pie charts 
Remove duplicate Markdown tables under 4.1/4.2; compute CR from strip-normalized names matching list_*_mix_top pies. Smaller figsize for list brand/shop pies; default pie slightly compact. Deduplicate test_mix_top_remainder test; assert _structure_names_for_pie_counter length.

Made-with: Cursor
 2026-04-15 17:54:53 +08:00
hub-gif
b5012a366e fix(pipeline): scope comment-evidence rules to COMMENT_GROUPS only 
Revert duplicate-opening and benefit-claim constraints from matrix, scenario, price, promo, §8.5 report, and strategy prompts. Strengthen COMMENT_GROUPS_SYSTEM: comment-only sourcing, no keyword boilerplate as user voice, varied openings, evidence-anchored benefits.

Made-with: Cursor
 2026-04-15 17:42:51 +08:00
hub-gif
6280e436d8 feat(pipeline): JD 流水线 CSV 纯中文表头与模块目录重构 
- 统一 csv_schema 与搜索/合并/评价/商详导出为纯中文列名，入库与视图按中文表头解析

- 竞品分析报告兼容新旧表头；新增 csv_header_rewrite 与 rewrite_pipeline_csv_headers 管理命令

- 调整 pipeline 至 jd、llm、reporting、demos 子包并更新任务与测试引用

- 新增购买者优惠摘要抽取、合并表 regen/ingest 命令、0016 迁移及相关测试

Made-with: Cursor
 2026-04-15 16:02:29 +08:00
hub-gif
5cafa75ab7 feat(pipeline): 新增 Markdown 文档导出、单测与价格分组 LLM 演示脚本 
补充 md_document_export 的 DOCX/PDF 导出能力及回归测试，并加入 run_price_groups_llm_demo 便于本地演示。

Made-with: Cursor
 2026-04-15 09:32:32 +08:00
hub-gif
43b72cb32e feat: 关注词与场景延伸、报告体验与导出修复 
- 流水线：评价关注词与使用场景的大模型延伸（jd_runner、竞品报告、测试）

- 界面：报告生成与查看的通俗化文案；策略稿集中度按店铺/品牌区分

- 导出：PDF 插图限制最大尺寸避免 LayoutError；报告 Word/PDF 改为 blob 下载；策略稿导出错误解析；PDF 补充 Linux 中文字体路径

Made-with: Cursor
 2026-04-14 18:23:25 +08:00
hub-gif
3d6193af06 feat(brief): plain-language concentration keys and copy 
- Add first_share/top_three_combined_share plus cr1/cr3 readers
- Brief/schema/footnotes and LLM prompts avoid dev jargon where possible
- Frontend JD analysis/dataset hints in business-friendly wording

Made-with: Cursor
 2026-04-14 17:28:52 +08:00
hub-gif
c3fdb2b970 fix(report): align shop/brand pie denominators with §4 CR table via mix tail bucket 
Made-with: Cursor
 2026-04-14 17:28:52 +08:00
hub-gif
e20250e7a6 fix(pipeline): add JdJobSearchRow.total_sales for API dataset export 
Made-with: Cursor
 2026-04-14 17:28:52 +08:00
hub-gif
36aa36c60b refactor(pipeline): inline total_sales fallback; remove temp backfill script; add refresh command 
Made-with: Cursor
 2026-04-14 17:28:52 +08:00
hub-gif
b4e97a4c34 feat(pipeline): backfill totalSales column from pc_search_raw without re-crawl 
Made-with: Cursor
 2026-04-14 17:28:52 +08:00
hub-gif
8611e78a26 feat(jd-pipeline): matrix chart and brief use totalSales for sales volume 
Made-with: Cursor
 2026-04-14 17:28:17 +08:00
hub-gif
2473a7cdac fix(charts): show review counts on matrix x-axis as 万/亿, not scientific notation 
Made-with: Cursor
 2026-04-14 17:27:38 +08:00
hub-gif
23d6a0932b fix(charts): independent Y axes for focus vs scenario combo bars 
Made-with: Cursor
 2026-04-14 17:27:38 +08:00
hub-gif
d99d9d2ab0 feat(report): combine focus-keyword and scenario charts per matrix group 
Made-with: Cursor
 2026-04-14 17:27:38 +08:00
hub-gif
5fe4ac4ffe feat(pipeline): add LLM summaries for usage scenarios (§8.4) 
Made-with: Cursor
 2026-04-14 17:27:38 +08:00
hub-gif
d2135e9a6e feat(report): drop chapter 7 product claims (detail attributes summary) 
Made-with: Cursor
 2026-04-14 17:27:19 +08:00
hub-gif
f994555f9f feat(pipeline): remove llm section bridges from report generation 
Made-with: Cursor
 2026-04-14 17:27:19 +08:00
hub-gif
c244a2902e refactor(report): drop §5 markdown tables, charts + CSV only 
Made-with: Cursor
 2026-04-14 17:27:03 +08:00
hub-gif
9d1ff31b23 fix(report): default LLM flags, embed §5 matrix charts, slim table 
Merge missing keys from get_default_report_config into effective report_config so llm_* switches default on when absent. §5 embeds chart_matrix_prices_reviews per fine category (price + review-volume bars, Y=title) and replaces the wide matrix with a compact table. Matrix chart Y-labels allow longer titles (48 chars).

Made-with: Cursor
 2026-04-14 17:27:03 +08:00
hub-gif
4bb94173a5 feat(pipeline): LLM chapters demo script; shrink comment-group prompts 
Add run_report_llm_chapters_demo.py to exercise matrix/price/sentiment/comment_groups/bridges and report supplement. generate_comment_group_summaries_llm now compacts per-group text in tiers so large multi-group runs stay under context limits with default max_tokens.

Made-with: Cursor
 2026-04-14 17:27:03 +08:00
hub-gif
c6560bd12b fix(report): use detail_category_path only for matrix and fine-category stats 
Made-with: Cursor
 2026-04-14 17:25:54 +08:00
hub-gif
e73f1ffe8d fix(ui): add clear local lock for regenerate-report button 
Made-with: Cursor
 2026-04-14 17:13:01 +08:00
hub-gif
f7a4754e56 feat(report): wire LLM group summaries, improve matrix labels and chart Y-axis 
Made-with: Cursor
 2026-04-14 17:13:01 +08:00
hub-gif
11b9c24334 docs(report): clarify LLM keyword/scenario extension in brief notes 
Made-with: Cursor
 2026-04-14 17:12:32 +08:00
hub-gif
4cae885200 Revert "docs(report): note LLM keyword/scenario extension in competitor brief" 
This reverts commit 70b0b247f4d8ffd66120237ee6154f993fb2d733.
 2026-04-14 17:12:32 +08:00
hub-gif
30a985f749 docs(report): note LLM keyword/scenario extension in competitor brief 
Made-with: Cursor
 2026-04-14 17:12:32 +08:00
hub-gif
6a9b6af321 test(pipeline): restore llm_keyword_suggest parse unit tests 
Made-with: Cursor
 2026-04-14 17:12:31 +08:00
hub-gif
6f04326400 fix(frontend): track multiple in-flight generation keys (regen vs preview) 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
4847003a05 fix(frontend): keep regen in-flight lock on client disconnect (tab switch) 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
fdf5901f76 fix(frontend): persist generation in-flight key in sessionStorage (HMR/reload) 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
a1b02e3ed7 chore(django): fail fast with hint when pipeline 0012/0013 migration files missing 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
34fe9079ee chore(migrations): add 0013 rebuild checkpoint table (was untracked) 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
cd863864a0 fix(frontend): disable report regen while any job regen is in flight 
Made-with: Cursor
 2026-04-14 17:12:03 +08:00
hub-gif
134faffbe8 feat: default LLM for report regen, job report_config, and API defaults 
Made-with: Cursor
 2026-04-14 13:28:18 +08:00
hub-gif
48ed337310 refactor(frontend): simplify report build page, drop LLM checkboxes 
Made-with: Cursor
 2026-04-14 13:25:51 +08:00
hub-gif
f3fe8cd5fd fix(pipeline): restore LLM report regenerate (views b675903); extend report_config keys 
Made-with: Cursor
 2026-04-14 13:22:42 +08:00
hub-gif
c45ec66d4c feat(report): remove §5 competitor matrix table, keep per-group charts 
Made-with: Cursor
 2026-04-14 13:18:40 +08:00
hub-gif
a1d0fa6686 fix(report): shop/brand pie totals, matrix price charts, drop LLM §8.5 merge 
Made-with: Cursor
 2026-04-14 13:16:29 +08:00
hub-gif
2548ba1df5 fix(pipeline): align models and serializers with pause/resume checkpoint 
Made-with: Cursor
 2026-04-14 13:11:21 +08:00
hub-gif
b6759039c8 fix(llm): tier compact brief for §8.5 to fit 32k context window 
Regenerate-report §8.5 payload exceeded ~32k ctx; try decreasing
compact_brief_for_llm max_chars then truncate JSON with notice.

Made-with: Cursor
 2026-04-14 11:36:28 +08:00
hub-gif
4be389bf8d fix(api): return 400 for LLM config ValueError on regenerate-report 
503 was misleading for missing OPENAI_API_KEY/LLM_BASE_URL and prompt-too-large;
log warning with job id. Keep 503 for unexpected ValueError.

Made-with: Cursor
 2026-04-14 11:26:56 +08:00
hub-gif
1f6abe49ee feat(pipeline): wire matrix/price/comment group LLM into report body 
- build_matrix/price_groups_llm_payload from merged rows
- jd_runner: call generate_*_group_summaries_llm when report_config or
  MA_ENABLE_LLM_*; write matrix/price/comment_groups_llm.json sidecars
- build_competitor_markdown: insert §5.1, §6.2, §8.6 with disclaimers
- §1.3 note for optional llm_*_group_summaries flags

Made-with: Cursor
 2026-04-14 11:15:17 +08:00
hub-gif
15ba8b3370 fix(llm): restore matrix/comment/price group advisor prompts and callers 
Re-add MATRIX/COMMENT/PRICE_GROUPS_SYSTEM and generate_*_group_summaries_llm
removed in afe2748; align comment-group prompt with shop in attribution
prefix. Default report_config now includes the three llm_*_summaries flags.

Made-with: Cursor
 2026-04-14 11:08:24 +08:00
hub-gif
dd5fa8a407 feat(comments): attribute sentiment LLM samples to shop and SKU 
- Add _comment_lines_with_product_context and build_comment_groups_llm_payload
- build_comment_sentiment_llm_payload: lexicon on plain text, samples with
  【细类｜SKU｜品名｜店铺】 prefix; jd_runner passes parallel attributed lines
- Tighten §8.2/§8.5 prompts so negatives tie to shop + product; tests assert 店铺

Made-with: Cursor
 2026-04-14 11:04:35 +08:00
hub-gif
afe2748129 fix(llm): drop unused group-summary helpers reintroduced by patch 
Keep only REPORT_SYSTEM / SENTIMENT prompt tightening; remove dead
matrix/comment/price LLM helpers not referenced by views or jd_runner.

Made-with: Cursor
 2026-04-14 10:57:13 +08:00
hub-gif
efd8aa7cfc fix(llm): require aggregate-only complaints in §8.5 without fake quotes 
§8.5 brief lacks per-SKU review text; tighten REPORT_SYSTEM so lexicon
hits are described as cross-SKU substring stats and forbid quoted
fabricated examples. Align sentiment helper: no quoted specifics absent
from samples.

Made-with: Cursor
 2026-04-14 10:55:12 +08:00
hub-gif
708f28f40e fix(report): restore jd_competitor_report after mistaken chart revert 
9cc8de9 accidentally rewrote jd_competitor_report.py and merged an oversized
report_charts.py. Reset both to f19d112 baseline; keep only obsolete cleanup
for removed global bar chart filenames.

Made-with: Cursor
 2026-04-14 10:51:38 +08:00
hub-gif
9cc8de9006 revert(report): drop global focus/scenario bar charts 
Remove chart_comment_focus_global_bar / chart_usage_scenarios_global_bar
generation and markdown embed; delete leftovers on chart regen.

Made-with: Cursor
 2026-04-14 10:48:54 +08:00