Kernix0421

Ai Research Scraper

Data Analysisv1.8.14
By Kernix0421Updated 2026-05-1123 versions · latest released 2026-02-12ai-research-scraper@clawhub_kernix0421/ai-research-scraper
Web Scraping#研究

According to AlphaMoat, as of 2026-09, Ai Research Scraper has 3,586 downloads and 2 stars — ranked #3,036 of 5,078 AI skills overall, and #231 of 399 in Data Analysis.

Installs
162
Downloads
3.6K
Stars
2
Overall Rank
#3,036
Top 60% overall · Top 58% in Data Analysis
PlatformInstallsDownloadsStarsComments
ClawHub ↗1083.3K2-
SkillHub ↗1623.6K2—

Platforms count differently and update at different times.

What this skill does

用于抓取AI领域最新研究信息的技能,重点关注AI产品发展。从知名AI网站获取信息,提供简洁概括和链接,限制数据量以便快速阅读。

Monthly Trend

Downloads3.6K
2.2K3.0K3.7K2026-03 · Downloads 2.3K2026-05 · Downloads 2.8K2026-06 · Downloads 2.9K2026-07 · Downloads 3.2K2026-08 · Downloads 3.3K2026-09 · Downloads 3.6K26-0326-09
Stars2
1222026-03 · Stars 12026-05 · Stars 22026-06 · Stars 22026-07 · Stars 22026-08 · Stars 22026-09 · Stars 226-0326-09

The counting method changed in 2026-09: skills with the same name are now counted separately by author, and the full catalog is covered. Dashed lines show months before the change; they are not compared with later months, and no growth is computed across the change.

MonthDownloadsMoMStars
2026-093.6K—2
2026-083.3K+3.6%2
2026-073.2K+10.7%2
2026-062.9K+4.5%2
2026-052.8K—2
2026-032.3K—1

SKILL.md (original)

The author’s original file, shown as plain text without edits or review by AlphaMoat. Links are not clickable; check commands before running them. Fetched 2026-10-23.

2.7 KB · ClawHub v1.8.14
---
name: ai-research-scraper
description: 用于抓取AI领域最新研究信息的技能,重点关注AI产品发展。从知名AI网站获取信息,提供简洁概括和链接,限制数据量以便快速阅读。
---

# AI Research Scraper

## 概述

这个技能专门用于从知名AI领域网站抓取最新研究信息,重点关注AI产品发展方面。它会限制抓取的数据量和token使用,提供简洁的信息概括,并包含原始网页链接,方便用户进一步查阅详细内容。
Show all (94 lines)

## 使用场景

- 当您需要快速了解AI领域最新产品动态时
- 当您想跟踪特定AI产品的发展信息时
- 当您需要获取AI技术发展的最新研究成果摘要时

## 支持的网站

当前支持的AI领域知名网站包括:
- TechCrunch AI板块
- VentureBeat AI板块
- MIT Technology Review AI板块
- Google AI Blog
- Microsoft AI Blog
- NVIDIA Blog

## 功能特点

- **数据量控制**:限制摘要长度,确保信息简洁
- **重点突出**:聚焦AI产品发展信息
- **链接完整**:每个摘要都包含原始网页链接
- **定时更新**:支持定期抓取最新信息
- **可配置性**:支持添加或修改目标网站
- **网络优化**:增加超时时间和重试机制,提高抓取成功率
- **缓存机制**:添加1小时缓存,避免重复抓取相同内容
- **稳定源**:优化网站列表,使用更稳定的AI领域网站源
- **备用搜索**:支持使用tavily-search技能替代,避免网络超时问题
- **简化处理**:暂时移除翻译功能,避免API错误和网络超时问题

## 使用方法

### 快速开始

使用默认配置抓取AI产品发展相关信息:

```bash
python3 /root/.openclaw/workspace/skills/ai-research-scraper/scripts/scraper.py
```

### 配置选项

#### 自定义网站列表

编辑 `references/websites.txt` 文件,添加或删除目标网站。每行格式:

```
网站名称|网站URL|RSS/Feed URL(可选)
```

#### 控制摘要长度

```bash
python3 /root/.openclaw/workspace/skills/ai-research-scraper/scripts/scraper.py --max-tokens 500
```

#### 指定时间范围

```bash
python3 /root/.openclaw/workspace/skills/ai-research-scraper/scripts/scraper.py --days 7
```

#### 指定主题重点

```bash
python3 /root/.openclaw/workspace/skills/ai-research-scraper/scripts/scraper.py --topic product-development
```

## 脚本和资源

### Scripts

- `scripts/scraper.py`: 主要的网页抓取和信息提取脚本
- `scripts/example.py`: 示例脚本(可删除或修改)

### References

- `references/websites.txt`: 包含要抓取的网站列表
- `references/api_reference.md`: API参考文档(待完善)

### Assets

- `assets/`: 资源文件夹(可用于存放模板或其他静态资源)

Popular in Data Analysis

AdMapixData Analysis

AdMapix raw data layer for ad creatives, apps, rankings, downloads/revenue, and market metadata. Returns structured JSON from the AdMapix API; the calling ag...

↓ 365.6K★ 304fly0pants
Tavily SearchData Analysis

Search the public web through Tavily and return structured results with URLs and snippets. Use when an agent needs current information, source discovery, link lookup, news or finance search, or a fallback for unavailable built-in web search. Do not use for private or authenticated pages.

↓ 121.9K★ 286Xiaoran Li
Data AnalysisData Analysis

Data analysis and visualization. Query databases, generate reports, automate spreadsheets, and turn raw data into clear, actionable insights. Use when (1) yo...

↓ 101.2K★ 244Iván
Stock AnalysisData Analysis

Analyze stocks and cryptocurrencies using Yahoo Finance data. Supports portfolio management, watchlists with alerts, dividend analysis, 8-dimension stock scoring, viral trend detection (Hot Scanner), and rumor/early signal detection. Use for stock analysis, portfolio tracking, earnings reactions, crypto monitoring, trending stocks, or finding rumors before they hit mainstream.

↓ 75.3K★ 299udiedrichsen
Stock WatcherData Analysis

Manages a local stock watchlist and summarizes recent quotes for its codes from the Tonghuashun stock pages.

↓ 64.8K★ 122Robin797860
全国招标中标查询及分析【知了标讯】Data Analysis

全网招中标数据查询与分析助手。当用户涉及以下任何场景时,必须使用此SKILL:查询招标/中标公告、搜索标讯、查找临期/即将到期项目、商机预测、推荐潜在投标供应商、分析公司主营业务/历史中标、查询公司上下游合作客户与供应商、分析竞争对手/竞对企业、查询Top采购单位/Top中标单位/Top中标品牌、招中标数据统计分析(按月/季/年/省份/品牌等维度)、查询品牌型号历史中标单价/价格趋势、市场分析/行业分析/采购寻源/渠道拓展等采购与投标相关场景。即使用户没有提到「知了标讯」,只要涉及招投标、采购、中标、供应商、竞争对手等关键词,都应使用本SKILL。

↓ 56.5K★ 13user_98035bfb
BlogwatcherData Analysis

Monitor blogs and RSS/Atom feeds for updates using the blogwatcher CLI.

↓ 54.0K★ 75Peter Steinberger
Model UsageData Analysis

Use CodexBar CLI local cost usage to summarize per-model usage for Codex or Claude, including the current (most recent) model or a full model breakdown. Trigger when asked for model-level usage/cost data from codexbar, or when you need a scriptable per-model summary from codexbar cost JSON.

↓ 49.5K★ 114Peter Steinberger

Data month: 2026-09 · Downloads, stars and installs are aggregated monthly from public skill registries (ClawHub, SkillHub). See methodology.