Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

提示公众号cookie或token错误，是被反爬了吗 #50

Open
jyzhao1008 opened this issue Sep 4, 2023 · 2 comments
Open

提示公众号cookie或token错误，是被反爬了吗 #50

jyzhao1008 opened this issue Sep 4, 2023 · 2 comments

Comments

@jyzhao1008
Copy link

jyzhao1008 commented Sep 4, 2023 •
edited
Loading

我改了下test_WechatUrls.py，用自己注册的公众号的token和cookies，想抓大概20多个公众号8月份至今的所有文章url，之前试过直接每个号抓50个，第一遍好像能抓完，结果没保存下来，后来再抓就报cookie或token错误了，过了一天我改成每个号只抓5个的话也差最后3个公众号抓不到报错，不过我发现有些好设置抓5个，但返回了7-10个文章，还有我用create_time转datetime发现和点开url网页页面上的时间不一致。
主要是有没有啥办法能不被反爬ban掉，可以抓的慢一点，不太方便再搞更多的公众号了。
@wnma3mz
Copy link
Owner

wnma3mz commented Sep 4, 2023

  1. 没有不被ban掉的方法
  2. 还有一个update_time参数

@jyzhao1008
Copy link
Author

好的，了解了，感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wnma3mz @jyzhao1008