Commit Graph

80 Commits

Author SHA1 Message Date
任平生
9d9926d0bf fix(utils): 修复抓取微信已删除文章时遇到的报错 (#9589)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接

* fix(utils): 修复抓取微信已删除文章时遇到的报错

* refactor: migrate to v2

Co-authored-by: blankyu(于海洋) <blankyu@tencent.com>
2022-04-21 21:40:16 +08:00
Rongrong
2dab2ad5bc fix(route)(wechat/ce): anti-crawler and pubDate (#9495)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-09 00:00:02 +08:00
Rongrong
eb9026e470 fix(route)(wechat/ershicimi): outdated URL (#9494)
* fix(route)(wechat/ershicimi): outdated URL

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* fix: pubDate
2022-04-08 18:08:48 +08:00
Rongrong
a79cc20ec1 feat(utils): add utils for WeChat MP (#9487)
Motivation:
There are multiple routes that need to fetch articles from WeChat MP.
However, letting them fetch articles by themselves could potentially
lead to cache key collisions. Even if cache key collisions do not occur,
un-normalized URL could potentially lead to duplicated requests.
What's more, articles from WeChat MP have weird formats and need to be
fixed. Creating a universal function to do this work can create some
ease for new route contributors.

Note:
In order to make this PR atomic as much as possible, I did not touch
those broken routes. Once this PR is merged, I will try to fix them.

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-07 21:46:15 +08:00
Tony
521862793e feat(route)!: remove wechat/csm wechat/wjdn (#9472) 2022-04-05 22:13:24 +08:00
Fatpandac
840494ab63 fix(route): wechat/tgchannel content text format error (#9095)
* fix(route): wechat/tgchannel content text format error

* fix(route): remove mess code

* fix(route): fix css style
2022-03-07 19:21:16 +08:00
Rongrong
7bffa64e48 feat(route)(wechat/tgchannel): efb-patch-middleware format support; using search to filter mpName (#9183)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-02-23 20:34:11 +08:00
Fatpandac
91729ee0e0 fix(route): wechat/tgchannel content text format error (#9088) 2022-02-13 21:56:47 +08:00
Rongrong
ce9743012a feat(route): 公众号(Telegram 频道来源)增加筛选 (#7648) 2022-01-22 19:03:18 +00:00
DIYgod
efa0018b3f chore: update dependencies 2021-11-28 00:33:37 +00:00
Daniel Li (李丹阳)
d77a039f05 style(eslint): add no-implicit-coercion rule (#8175)
* refactor: add no-implicit-coercion rule for ESLint

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* Update docs/en/joinus/quick-start.md

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update docs/joinus/quick-start.md

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/av01/tag.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/gov/taiwan/mnd.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/ps/product.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* refactor: minify html string

Co-authored-by: Sukka <isukkaw@gmail.com>
2021-09-15 21:22:11 +08:00
Sukka
d82847f541 style/chore(eslint): enforce new rules (#8040)
* style: prefer object shorthand syntax
* refactor: prefer Array#map over Array#forEach
* style: prefer arrow callback
* chore(eslint): update rules
* style: auto fix by eslint
2021-08-17 22:23:23 +08:00
Sukka
6e3b58ed1d refactor: avoid promise overhead (#8028) 2021-08-16 11:45:53 -07:00
Raidou
ce15d05215 fix(route): 腾讯较真查证平台 (#7934) 2021-08-12 01:04:11 -07:00
tylinux
39db632846 feat(route): 微信公众号新增 wechat-feeds 来源 (#7419)
Co-authored-by: GitHub Action <action@github.com>
2021-05-14 23:17:06 -04:00
DIYgod
7f1c43094e feat: remove some routes for security reasons, !!! no-eval no-new-func !!! 2021-01-25 18:43:47 +08:00
oppilate
dfdb9630b7 chore: optimize performance (replace he with entities) (#6497) 2020-12-22 18:38:10 +00:00
Laam Pui
237625808d feat: add wxnmh.com #5324 (#6063) 2020-11-03 11:28:36 +00:00
Ethan Shen
cdb583b821 fix: 腾讯柠檬精选 Mac Apps (#6033) 2020-10-29 15:38:21 +00:00
Ethan Shen
2145b9b23c fix: 微信公众号二十次幂来源 (#5908) 2020-10-18 16:50:39 +01:00
Henry Wang
5743604804 feat: 王者荣耀公告全文 (#5880) 2020-10-13 13:33:30 +01:00
MisteryMonster
bccc5ebc22 feat: 添加微信公众号文章话题 Tag (#5639) 2020-09-20 21:01:59 +01:00
0x11
4a84851c73 fix: (tencent/wechat/csm)图片路径 (#5577)
修正搜狗搜索图片路径为真实的微信公众号路径
2020-09-02 19:49:14 +01:00
Ethan Shen
59a1c0198e feat: add 腾讯大数据报告 (#5424)
Co-authored-by: Henry Wang <hi@henry.wang>
2020-08-18 21:15:49 +01:00
Henry Wang
065ddbfd07 fix: ProductHunt Today (#5140) 2020-07-07 17:39:45 +08:00
Henry Wang
4b51ba54f4 feat: add 腾讯柠檬精选 (#5066) 2020-06-28 11:20:10 +08:00
BugWriter2
8e62240e43 feat: 添加外接大脑作为获取公众号途径 (#4964) 2020-06-11 11:35:52 +08:00
hoilc
e84a046c0e feat: add 企鹅电竞 (#4925) 2020-06-07 22:55:46 +08:00
MisteryMonster
0851b32dbe feat: Add wechat mp homepage (#4696) 2020-05-09 11:55:39 +08:00
Henry Wang
0e4485576b fix: wemp 一次抓取过多文章导致超时 (#4641) 2020-05-02 13:10:27 +08:00
Ethan Shen
e1c794f42c feat: add wechat miniprogram changelogs (#4578) 2020-04-29 15:16:06 +08:00
lightyears
4a3ac0ce45 fix: 修正微信公众号路由(传送门来源以及CareerEngine来源)中的图片链接 (#4590) 2020-04-28 23:42:08 +08:00
talengu
1bb6cb51cf feat: fix tencent->video 更多链接支持 (#4563) 2020-04-28 11:12:05 +08:00
DIYgod
0e7b14e718 chore(deps-dev): bump prettier from 1.19.1 to 2.0.2 2020-04-02 21:21:46 +08:00
Henry Wang
955b022706 feat: 移除腾讯大家 (#4104)
RIP 腾讯大家
2020-02-29 20:04:28 +08:00
DIYgod
4be7802b27 feat: factcheck author 2020-02-03 19:36:34 +08:00
DIYgod
a54608cba2 fix: /coronavirus/qq/fact 2020-02-02 15:36:03 +08:00
Henry Wang
f3a78c2c27 feat: 微信公众号 CareerEngine 来源 (#3806) 2020-02-01 17:23:16 +08:00
Henry Wang
022ee918db fix: 二十次幂改版 (#3803) 2020-02-01 17:18:35 +08:00
Henry Wang
f87d381609 feat: 微信开放平台相关路由代码简化 (#3804) 2020-01-31 17:37:58 +08:00
Henry Wang
3e492d0033 refactor: 代码优化 (#3465) 2019-11-22 18:11:41 +08:00
DIYgod
ba8070b1b2 chore: format 2019-11-11 12:13:38 +08:00
hoilc
a2600c4c79 feat: 添加腾讯新闻较真查证平台 (#3209) 2019-10-08 16:36:07 +08:00
Hendricks Zheng
2a164517aa feat: add 企鹅号全文输出 (#3072) 2019-09-15 12:51:08 +08:00
Chenyang Shi
d218976538 feat: add 企鹅号 (#2959) 2019-08-30 00:10:41 +08:00
DIYgod
9a3bea3525 feat: remove referrerpolicy in routes 2019-08-28 14:38:19 +08:00
DIYgod
a34b9ae542 feat: remove addNoReferrer 2019-08-28 14:33:05 +08:00
Cloud
5538882355 fix: remove wemp limit (#2785) 2019-08-08 21:50:44 +08:00
枪鱼
fcce45388f feat: original link from WeChat and better performance (#2660)
* fix: original link from wechat

* fix: original link from wechat

* fix: original link from wechat

* fix: original link from WeChat and better performance
2019-07-22 15:55:02 +08:00
sanmmmm
26d08ee047 feat: 公众号增加二十次幂输出 (#2654) 2019-07-20 12:54:32 +08:00