Commit Graph

  • 87e3d0848a
    Merge pull request #209 from xbsheng/chore/text 程序员阿江-Relakkes 2024-04-04 18:11:42 +08:00
  • 2d24cf0f44 chore: 修改错别字 xbsheng 2024-04-04 17:32:23 +08:00
  • 6160428909
    Merge pull request #202 from zhihuiio/patch-1 程序员阿江-Relakkes 2024-04-04 13:12:50 +08:00
  • 208978b88f
    Merge pull request #206 from leantli/fix/max_notes_count 程序员阿江-Relakkes 2024-04-04 00:46:42 +08:00
  • 68a60faa7f chore: 简化判断方式 leantli 2024-04-04 00:11:22 +08:00
  • 3de57459c1 docs: 增加交流2群二维码 Relakkes 2024-04-03 13:40:38 +08:00
  • 85382ac7ed docs:更新许可证协议,不允许商用。 Relakkes 2024-04-03 12:34:34 +08:00
  • 133f978477 fix: 修复爬取视频/帖子最大数设置值较低导致不爬取的问题 leantli 2024-04-03 12:18:23 +08:00
  • e4836847cd docs: update README.md Relakkes 2024-04-01 22:08:26 +08:00
  • 085702820a
    Update requirements.txt zhihuiio 2024-04-01 20:28:50 +08:00
  • 285ab7abe6
    Update README.md 程序员阿江-Relakkes 2024-04-01 12:54:53 +08:00
  • bb732ed2ff docs: 增加MediaCrawler视频课程链接 Relakkes 2024-03-31 23:51:37 +08:00
  • 6d8c8fb22e feat: add mysql table Relakkes 2024-03-31 15:02:52 +08:00
  • 807af1abed
    Merge pull request #201 from Schofi/main 程序员阿江-Relakkes 2024-03-31 14:40:11 +08:00
  • e950e0d6e3 feat: add abstract api client to all platform Relakkes 2024-03-30 21:27:25 +08:00
  • 67ec49498a refactor: rename xhs to xiaohongshu Relakkes 2024-03-30 21:17:33 +08:00
  • 81317482f8
    Update README.md Schofi 2024-03-30 18:29:41 +08:00
  • aa257aab51 docs: update README.md Relakkes 2024-03-30 14:14:10 +08:00
  • aca1924bd7
    Merge pull request #183 from BaoZhuhan/fix-markdown relakkes 2024-03-19 23:13:34 +08:00
  • 1389ad0f81 Merge branch 'fix-markdown' of github.com:BaoZhuhan/MediaCrawler into fix-markdown BaoZhuhan 2024-03-19 22:59:33 +08:00
  • 4c20b02273 fix : 修复”常见问题.md“语法问题 BaoZhuhan 2024-03-19 22:54:21 +08:00
  • 96caede849
    Merge pull request #182 from BaoZhuhan/fix-markdown relakkes 2024-03-19 22:51:45 +08:00
  • d4c8d8dd08 fix : 修复”常见问题.md“ BaoZhuhan 2024-03-19 22:50:28 +08:00
  • 1e6470b162 fix :修复了“常见问题.md” BaoZhuhan 2024-03-19 22:48:39 +08:00
  • 13596fc1e4 fix: 修复了“常见问题.md"的语法问题。 BaoZhuhan 2024-03-19 22:37:15 +08:00
  • 4ea9700db0 docs: 增加赞助名单 Relakkes 2024-03-19 21:50:25 +08:00
  • 3a318faee1
    Update README.md relakkes 2024-03-19 13:27:58 +08:00
  • 5f5147a236 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:55:40 +08:00
  • 8e8f5d41e4 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:03:45 +08:00
  • ea66839d72
    Update README.md relakkes 2024-03-18 13:40:36 +08:00
  • 67443737f5 docs: 添加捐赠者名单 Relakkes 2024-03-17 22:16:58 +08:00
  • 96309dcfee fix: 小红书创作者功能数据获取优化 Relakkes 2024-03-17 14:50:10 +08:00
  • 78a9bf9f38 docs: 添加捐赠者名单 Relakkes 2024-03-17 01:05:10 +08:00
  • 569202af78 feat: update user-agent list Relakkes 2024-03-17 01:03:56 +08:00
  • 59cd9f67a0 feat: 支持评论模式是否开启爬取选项 Relakkes 2024-03-16 11:52:42 +08:00
  • 2d12ecb930 docs: 增加捐赠名单 Relakkes 2024-03-14 22:06:18 +08:00
  • b48e4d297d docs: 将python3命令修改为python Relakkes 2024-03-12 23:09:45 +08:00
  • 9e2d1396b8 docs: 增加视频入门教程链接 Relakkes 2024-03-10 03:49:58 +08:00
  • 9ca0a2b717 docs: update README.md Relakkes 2024-03-09 15:37:51 +08:00
  • 41fee4ff4f feat:小红书支持获取评论中的图片链接 #145 Relakkes 2024-03-07 22:30:44 +08:00
  • 861019022a docs: 增加捐赠者名单 Relakkes 2024-03-05 22:45:32 +08:00
  • 7606c1d993 docs: 增加捐赠者名单 Relakkes 2024-03-05 00:03:51 +08:00
  • 149b6bcdc8 fix: 修复抖音关键词搜索为中文的情况下,有bug Relakkes 2024-03-03 19:36:36 +08:00
  • 7002061d70
    Merge pull request #142 from jayeeliu/main relakkes 2024-03-02 23:30:31 +08:00
  • 2b1ad18e18 Revert "feat: add aerich for migrate db" jayeeliu@gmail.com 2024-03-02 23:05:34 +08:00
  • 5f7cd715db feat: add aerich for migrate db jayeeliu@gmail.com 2024-03-02 15:58:35 +08:00
  • 9a5460ccca
    Merge branch 'NanmiCoder:main' into main jayeeliu 2024-03-02 01:51:02 +08:00
  • 61ba8c5cc7 feat: 小红书支持通过博主ID采集笔记和评论,小红书type=search时支持配置按哪种排序方式获取笔记数据,小红书笔记增加视频地址和标签字段 jayeeliu@gmail.com 2024-03-02 01:49:42 +08:00
  • 384c8f9f7e fix: issue #140 Relakkes 2024-02-26 23:47:02 +08:00
  • 67d2b7cff8
    Merge pull request #136 from jayeeliu/main relakkes 2024-02-22 21:32:19 +08:00
  • c09f9fef68 fix: 增加db.close(),解决抓取命令执行完不退出的问题 ccgo 2024-02-22 00:11:41 +08:00
  • 4f5f83d3fa feat: 增加sqlite配置示例 ccgo 2024-02-22 00:07:40 +08:00
  • 03ca445221 docs: update README.md Relakkes 2024-02-18 13:06:12 +08:00
  • 192e72588d fix: #123 Relakkes 2024-01-26 23:42:26 +08:00
  • f1d3bc6e28
    Merge pull request #124 from aa65535/patch-1 relakkes 2024-01-25 14:33:09 +08:00
  • 79c0f3bd68
    修复小红书评论重复插入 Jian Chang 2024-01-25 13:01:04 +08:00
  • eb89a6ada8
    docs: 添加赞赏者信息 relakkes 2024-01-21 16:42:37 +08:00
  • e940a41033 refactor: 移除评论中指定数量和过滤特定关键词的逻辑 Relakkes 2024-01-17 23:02:05 +08:00
  • e0f9a487e4 refactor: 代码优化 Relakkes 2024-01-16 00:40:07 +08:00
  • e490123fcd
    Merge pull request #112 from NanmiCoder/feature/stored_in_json relakkes 2024-01-14 22:45:00 +08:00
  • 4dfa0d3fbf feat: 数据保存支持JSON格式 Relakkes 2024-01-14 22:40:01 +08:00
  • 894dabcf63 refactor: 数据存储重构,分离不同类型的存储实现 Relakkes 2024-01-14 22:06:31 +08:00
  • e31aebbdfb fix: 修复代理Bug Relakkes 2024-01-13 15:50:02 +08:00
  • 0240de7324 docs: 添加捐赠信息 Relakkes 2024-01-10 23:59:14 +08:00
  • f85bd0c2b9 docs: 添加捐赠信息 Relakkes 2024-01-07 18:33:08 +08:00
  • 4de14ad6a8 fix: 修复微博PC端登录后COOKIE在手机端无法使用的bug Relakkes 2024-01-06 19:18:07 +08:00
  • fe073801f8 feat: 小红书增加获取图片地址的方法 Relakkes 2024-01-04 00:11:05 +08:00
  • 80ecc53cd3 fix: #107 Relakkes 2024-01-03 23:08:30 +08:00
  • 38d6f10bf0 feat: 微博二维码登录done Relakkes 2023-12-30 18:54:21 +08:00
  • 27a2041929 doc: update README.md Relakkes 2023-12-30 15:16:33 +08:00
  • eee81622ac feat: 微博支持评论 & 指定帖子 Relakkes 2023-12-25 00:02:11 +08:00
  • b1441ab4ae feat: 微博帖子支持保存到数据库中 Relakkes 2023-12-24 18:19:26 +08:00
  • c5b64fdbf5 feat: 微博爬虫帖子搜索完成 Relakkes 2023-12-24 17:57:48 +08:00
  • 9785abba5d docs: update README.md Relakkes 2023-12-23 01:41:19 +08:00
  • aba9f14f50 refactor: 规范日志打印 feat: B站指定视频ID爬取(bvid) Relakkes 2023-12-23 01:04:08 +08:00
  • 273c9a316b fix: 修复日志打印时参数格式错误 Relakkes 2023-12-22 23:10:44 +08:00
  • bced7f6802 doc: update README.md Relakkes 2023-12-22 23:04:08 +08:00
  • 2e032d09dc refactor: xhs add log Relakkes 2023-12-19 23:05:12 +08:00
  • e2aaf0e5c1 doc: update README.md Relakkes 2023-12-17 18:57:43 +08:00
  • f85fd97d25 fix: #10 Relakkes 2023-12-16 00:12:20 +08:00
  • 40cbd9f4d7
    Merge pull request #96 from PeanutSplash/main relakkes 2023-12-14 00:57:17 +08:00
  • 5c6a636352 fix-bug:修复抖音评论筛选 peanutsplash 2023-12-14 00:55:06 +08:00
  • c4d68f868a
    Merge pull request #94 from PeanutSplash/main relakkes 2023-12-14 00:01:44 +08:00
  • f17a85305e 添加功能:(哔哩哔哩,快手,小红书)每个视频/帖子抓取评论最大条数限制,评论关键词筛选 peanutsplash 2023-12-13 23:53:12 +08:00
  • 5c42076ff8 doc: update README.md Relakkes 2023-12-09 23:50:33 +08:00
  • 05016305e8 doc: update README.md Relakkes 2023-12-09 23:49:19 +08:00
  • 97d7a0c38b feat: Bilibili comment done Relakkes 2023-12-09 21:10:01 +08:00
  • a136ea2739 refactor: delete account_config.py Relakkes 2023-12-09 13:56:18 +08:00
  • 2d0f12f058 doc: fixed pydantic version Relakkes 2023-12-09 13:31:53 +08:00
  • fd640f2008 doc: update README.md Relakkes 2023-12-09 00:30:31 +08:00
  • d37d5ccd12 doc: add SPONSORED BY text Relakkes 2023-12-09 00:28:29 +08:00
  • 385662a7b6 doc: 新增代理IP使用文档 Relakkes 2023-12-09 00:06:57 +08:00
  • a40a91d7f7 doc: update README.md Relakkes 2023-12-08 00:27:59 +08:00
  • 72a68fbf1e doc:将文档拆出去 Relakkes 2023-12-08 00:25:06 +08:00
  • 1cec23f73d feat: 代理IP功能 Done Relakkes 2023-12-08 00:10:04 +08:00
  • c530bd4219 feat: 代理IP缓存到redis中 Relakkes 2023-12-06 23:49:56 +08:00
  • f71d086464 fix: B站get_wbi_keys函数类型标注问题 Relakkes 2023-12-05 23:32:35 +08:00
  • a6e877de42 fix: 修复B站搜索Field命名 bug refactor: ping接口统一更换为pong Relakkes 2023-12-05 22:47:36 +08:00
  • 6ae511bb52
    Merge pull request #89 from PeanutSplash/main relakkes 2023-12-05 12:42:32 +08:00
  • ab1a10bac1 添加功能:抖音每个视频抓取评论最大条数限制,抖音评论关键词筛选 peanutsplash 2023-12-05 11:21:47 +08:00