據 AlphaMoat 統計,截至 2026-10,Pdf To Structured 累計下載 8,664 次、獲 10 個星標,按累計下載量在本次參與排名的 10,914 個 AI 技能中排名第 3,209 位,在「辦公效率」分類(909 個)中排名第 345 位。
列表預設按累計下載量排序,也可按星標排序;詳情頁排名按累計下載量計算。
| 平台 | 累計下載 | 星標 | 評論 |
|---|---|---|---|
| ClawHub ↗ | 5131 | 9 | - |
| SkillHub ↗ | 8664 | 10 | — |
各平台的計數口徑不同,統計時間不一致。
面向規格書、物料清單、進度表與報告等工程文件,按抽取、轉換、載入三步處理:讀取 PDF、解析並結構化內容,再儲存為表格或 JSON。原生 PDF 用 pdfplumber 解析,掃描件走 OCR。 文件、圖片或查詢內容提交至已設定的雲端服務時可能離開本機;處理敏感資料前先確認服務方與資料權限。
資料釋出於 2026-10-27
以下是根據技能文件生成的示例,不代表實際執行結果。
2026-09 起統計方法調整:同名技能按作者分別統計,並覆蓋全部技能。圖中虛線為調整前的月份,與之後的資料不直接比較,也不計算跨越調整的增長。
| 月份 | 累計下載 | 環比 | 星標 |
|---|---|---|---|
| 2026-10 | 8664 | — | 10 |
| 2026-09 | 5967 | — | 10 |
| 2026-08 | 5422 | +3.9% | 10 |
| 2026-07 | 5216 | +6.4% | 10 |
| 2026-06 | 4903 | +2.6% | 9 |
| 2026-05 | 4778 | — | 9 |
| 2026-03 | 4022 | — | 8 |
以下是作者釋出的原始檔案,按純文字顯示,本站未做修改或稽核;其中的連結不可點選,命令請核實後再執行。抓取於 2026-10-23。
--- name: "pdf-to-structured" description: "Extract structured data from construction PDFs. Convert specifications, BOMs, schedules, and reports from PDF to Excel/CSV/JSON. Use OCR for scanned documents and pdfplumber for native PDFs." --- # PDF to Structured Data Conversion ## Overview Based on DDC methodology (Chapter 2.4), this skill transforms unstructured PDF documents into structured formats suitable for analysis and integration. Construction projects generate vast amounts of PDF documentation - specifications, BOMs, schedules, and reports - that need to be extracted and processed.
**Book Reference:** "Преобразование данных в структурированную форму" / "Data Transformation to Structured Form"
> "Преобразование данных из неструктурированной в структурированную форму — это и искусство, и наука. Этот процесс часто занимает значительную часть работы инженера по обработке данных."
> — DDC Book, Chapter 2.4
## ETL Process Overview
The conversion follows the ETL pattern:
1. **Extract**: Load the PDF document
2. **Transform**: Parse and structure the content
3. **Load**: Save to CSV, Excel, or JSON
## Quick Start
```python
import pdfplumber
import pandas as pd
# Extract table from PDF
with pdfplumber.open("construction_spec.pdf") as pdf:
page = pdf.pages[0]
table = page.extract_table()
df = pd.DataFrame(table[1:], columns=table[0])
df.to_excel("extracted_data.xlsx", index=False)
```
## Installation
```bash
# Core libraries
pip install pdfplumber pandas openpyxl
# For scanned PDFs (OCR)
pip install pytesseract pdf2image
# Also install Tesseract OCR: https://github.com/tesseract-ocr/tesseract
# For advanced PDF operations
pip install pypdf
```
## Native PDF Extraction (pdfplumber)
### Extract All Tables from PDF
```python
import pdfplumber
import pandas as pd
def extract_tables_from_pdf(pdf_path):
"""Extract all tables from a PDF file"""
all_tables = []
with pdfplumber.open(pdf_path) as pdf:
for page_num, page in enumerate(pdf.pages):
tables = page.extract_tables()
for table_num, table in enumerate(tables):
if table and len(table) > 1:
# First row as header
df = pd.DataFrame(table[1:], columns=table[0])
df['_page'] = page_num + 1
df['_table'] = table_num + 1
all_tables.append(df)
if all_tables:
return pd.concat(all_tables, ignore_index=True)
return pd.DataFrame()
# Usage
df = extract_tables_from_pdf("material_specification.pdf")
df.to_excel("materials.xlsx", index=False)
```
### Extract Text with Layout
```python
import pdfplumber
def extract_text_with_layout(pdf_path):
"""Extract text preserving layout structure"""
full_text = []
with pdfplumber.open(pdf_path) as pdf:
for page in pdf.pages:
text = page.extract_text()
if text:
full_text.append(text)
return "\n\n--- Page Break ---\n\n".join(full_text)
# Usage
text = extract_text_with_layout("project_report.pdf")
with open("report_text.txt", "w", encoding="utf-8") as f:
f.write(text)
```
### Extract Specific Table by Position
```python
import pdfplumber
import pandas as pd
def extract_table_from_area(pdf_path, page_num, bbox):
"""
Extract table from specific area on page
Args:
pdf_path: Path to PDF file
page_num: Page number (0-indexed)
bbox: Bounding box (x0, top, x1, bottom) in points
"""
with pdfplumber.open(pdf_path) as pdf:
page = pdf.pages[page_num]
cropped = page.within_bbox(bbox)
table = cropped.extract_table()
if table:
return pd.DataFrame(table[1:], columns=table[0])
return pd.DataFrame()
# Usage - extract table from specific area
# bbox format: (left, top, right, bottom) in points (1 inch = 72 points)
df = extract_table_from_area("drawing.pdf", 0, (50, 100, 550, 400))
```
## Scanned PDF Processing (OCR)
### Extract Text from Scanned PDF
```python
import pytesseract
from pdf2image import convert_from_path
import pandas as pd
def ocr_scanned_pdf(pdf_path, language='eng'):
"""
Extract text from scanned PDF using OCR
Args:
pdf_path: Path to scanned PDF
language: Tesseract language code (eng, deu, rus, etc.)
"""
# Convert PDF pages to images
images = convert_from_path(pdf_path, dpi=300)
extracted_text = []
for i, image in enumerate(images):
text = pytesseract.image_to_string(image, lang=language)
extracted_text.append({
'page': i + 1,
'text': text
})
return pd.DataFrame(extracted_text)
# Usage
df = ocr_scanned_pdf("scanned_specification.pdf", language='eng')
df.to_csv("ocr_results.csv", index=False)
```
### OCR Table Extraction
```python
import pytesseract
from pdf2image import convert_from_path
import pandas as pd
import cv2
import numpy as np
def ocr_table_from_scanned_pdf(pdf_path, page_num=0):
"""Extract table from scanned PDF using OCR with table detection"""
# Convert specific page to image
images = convert_from_path(pdf_path, first_page=page_num+1,
last_page=page_num+1, dpi=300)
image = np.array(images[0])
# Convert to grayscale
gray = cv2.cvtColor(image, cv2.COLOR_RGB2GRAY)
# Apply thresholding
_, binary = cv2.threshold(gray, 150, 255, cv2.THRESH_BINARY_INV)
# Extract text with table structure
custom_config = r'--oem 3 --psm 6'
text = pytesseract.image_to_string(gray, config=custom_config)
# Parse text into table structure
lines = text.strip().split('\n')
data = [line.split() for line in lines if line.strip()]
if data:
# Assume first row is header
df = pd.DataFrame(data[1:], columns=data[0] if len(data[0]) > 0 else None)
return df
return pd.DataFrame()
# Usage
df = ocr_table_from_scanned_pdf("scanned_bom.pdf")
print(df)
```
## Construction-Specific Extractions
### Bill of Materials (BOM) Extraction
```python
import pdfplumber
import pandas as pd
import re
def extract_bom_from_pdf(pdf_path):
"""Extract Bill of Materials from construction PDF"""
all_items = []
with pdfplumber.open(pdf_path) as pdf:
for page in pdf.pages:
tables = page.extract_tables()
for table in tables:
if not table or len(table) < 2:
continue
# Find header row (look for common BOM headers)
header_keywords = ['item', 'description', 'quantity', 'unit', 'material']
for i, row in enumerate(table):
if row and any(keyword in str(row).lower() for keyword in header_keywords):
# Found header, process remaining rows
headers = [str(h).strip() for h in row]
for data_row in table[i+1:]:
if data_row and any(cell for cell in data_row if cell):
item = dict(zip(headers, data_row))
all_items.append(item)
break
return pd.DataFrame(all_items)
# Usage
bom = extract_bom_from_pdf("project_bom.pdf")
bom.to_excel("bom_extracted.xlsx", index=False)
```
### Project Schedule Extraction
```python
import pdfplumber
import pandas as pd
from datetime import datetime
def extract_schedule_from_pdf(pdf_path):
"""Extract project schedule/gantt data from PDF"""
with pdfplumber.open(pdf_path) as pdf:
all_tasks = []
for page in pdf.pages:
tables = page.extract_tables()
for table in tables:
if not table:
continue
# Look for schedule-like table
headers = table[0] if table else []
# Check if it looks like a schedule
schedule_keywords = ['task', 'activity', 'start', 'end', 'duration']
if any(kw in str(headers).lower() for kw in schedule_keywords):
for row in table[1:]:
if row and any(cell for cell in row if cell):
task = dict(zip(headers, row))
all_tasks.append(task)
df = pd.DataFrame(all_tasks)
# Try to parse dates
date_columns = ['Start', 'End', 'Start Date', 'End Date', 'Finish']
for col in date_columns:
if col in df.columns:
df[col] = pd.to_datetime(df[col], errors='coerce')
return df
# Usage
schedule = extract_schedule_from_pdf("project_schedule.pdf")
print(schedule)
```
### Specification Parsing
```python
import pdfplumber
import pandas as pd
import re
def parse_specification_pdf(pdf_path):
"""Parse construction specification document"""
specs = []
with pdfplumber.open(pdf_path) as pdf:
full_text = ""
for page in pdf.pages:
text = page.extract_text()
if text:
full_text += text + "\n"
# Parse sections (common spec format)
section_pattern = r'(\d+\.\d+(?:\.\d+)?)\s+([A-Z][^\n]+)'
sections = re.findall(section_pattern, full_text)
for num, title in sections:
specs.append({
'section_number': num,
'title': title.strip(),
'level': len(num.split('.'))
})
return pd.DataFrame(specs)
# Usage
specs = parse_specification_pdf("technical_spec.pdf")
print(specs)
```
## Batch Processing
### Process Multiple PDFs
```python
import pdfplumber
import pandas as pd
from pathlib import Path
def batch_extract_tables(folder_path, output_folder):
"""Process all PDFs in folder and extract tables"""
pdf_files = Path(folder_path).glob("*.pdf")
results = []
for pdf_path in pdf_files:
print(f"Processing: {pdf_path.name}")
try:
with pdfplumber.open(pdf_path) as pdf:
for page_num, page in enumerate(pdf.pages):
tables = page.extract_tables()
for table_num, table in enumerate(tables):
if table and len(table) > 1:
df = pd.DataFrame(table[1:], columns=table[0])
df['_source_file'] = pdf_path.name
df['_page'] = page_num + 1
# Save individual table
output_name = f"{pdf_path.stem}_p{page_num+1}_t{table_num+1}.xlsx"
df.to_excel(Path(output_folder) / output_name, index=False)
results.append(df)
except Exception as e:
print(f"Error processing {pdf_path.name}: {e}")
# Combined output
if results:
combined = pd.concat(results, ignore_index=True)
combined.to_excel(Path(output_folder) / "all_tables.xlsx", index=False)
return len(results)
# Usage
count = batch_extract_tables("./pdf_documents/", "./extracted/")
print(f"Extracted {count} tables")
```
## Data Cleaning After Extraction
```python
import pandas as pd
def clean_extracted_data(df):
"""Clean common issues in PDF-extracted data"""
# Remove completely empty rows
df = df.dropna(how='all')
# Strip whitespace from string columns
for col in df.select_dtypes(include=['object']).columns:
df[col] = df[col].str.strip()
# Remove rows where all cells are empty strings
df = df[df.apply(lambda row: any(cell != '' for cell in row), axis=1)]
# Convert numeric columns
for col in df.columns:
# Try to convert to numeric
numeric_series = pd.to_numeric(df[col], errors='coerce')
if numeric_series.notna().sum() > len(df) * 0.5: # More than 50% numeric
df[col] = numeric_series
return df
# Usage
df = extract_tables_from_pdf("document.pdf")
df_clean = clean_extracted_data(df)
df_clean.to_excel("clean_data.xlsx", index=False)
```
## Export Options
```python
import pandas as pd
import json
def export_to_multiple_formats(df, base_name):
"""Export DataFrame to multiple formats"""
# Excel
df.to_excel(f"{base_name}.xlsx", index=False)
# CSV
df.to_csv(f"{base_name}.csv", index=False, encoding='utf-8-sig')
# JSON
df.to_json(f"{base_name}.json", orient='records', indent=2)
# JSON Lines (for large datasets)
df.to_json(f"{base_name}.jsonl", orient='records', lines=True)
# Usage
df = extract_tables_from_pdf("document.pdf")
export_to_multiple_formats(df, "extracted_data")
```
## Quick Reference
| Task | Tool | Code |
|------|------|------|
| Extract table | pdfplumber | `page.extract_table()` |
| Extract text | pdfplumber | `page.extract_text()` |
| OCR scanned | pytesseract | `pytesseract.image_to_string(image)` |
| Merge PDFs | pypdf | `writer.add_page(page)` |
| Convert to image | pdf2image | `convert_from_path(pdf)` |
## Troubleshooting
| Issue | Solution |
|-------|----------|
| Table not detected | Try adjusting table settings: `page.extract_table(table_settings={})` |
| Wrong column alignment | Use visual debugging: `page.to_image().draw_rects()` |
| OCR quality poor | Increase DPI, preprocess image, use correct language |
| Memory issues | Process pages one at a time, close PDF after processing |
## Resources
- **Book**: "Data-Driven Construction" by Artem Boiko, Chapter 2.4
- **Website**: https://datadrivenconstruction.io
- **pdfplumber Docs**: https://github.com/jsvine/pdfplumber
- **Tesseract OCR**: https://github.com/tesseract-ocr/tesseract
## Next Steps
- See `image-to-data` for image processing
- See `cad-to-data` for CAD/BIM data extraction
- See `etl-pipeline` for automated processing workflows
- See `data-quality-check` for validating extracted data
透過 MCP 在騰訊文件裡新建、編輯與管理線上文件的完整操作手冊。
WPS Office 全家桶 - 四引擎(WPS/MS Office/LibreOffice/純Python)智慧識別使用者已安裝軟體,純Python模式支援排序/篩選/圖表/公式/統計,含文件模板(程式碼生成)、最佳實踐案例、故障排除大章(20+避坑+15 FAQ+15錯誤ID 統一索引)、自動重試、硬體自適應、環境自檢、Skill更新提醒;v5.1新增:kingdoc雲端橋接(白名單探測+配置預檢+subprocess上傳+差異檢查)、條件格式/資料驗證跨引擎IO(JSON中間格式保真往返)、會議紀要三段式要素化(待辦清單+決策記錄+風險異議)+說話人標註(MFCC聚類);v5.2新增:公文一鍵排版(GB/T 9704 規則庫約束+結構識別套版+紅頭預留位+聯合行文)、批次水印與敏感資訊打碼(身份證/手機號/銀行卡/電子郵件雙軌識別+黑色矩形覆蓋+打碼清單)、跨文件知識檢索與問答(本地TF-IDF零依賴+跳轉+可選zwjh記憶橋接);刪除:與contract-review重複的輕量合同審查模組,改為文件互鏈引導;v5.2.5修復:MS Office引擎下Excel/PPT建立必然失敗(錯用Word COM物件),新增get_ms_excel/get_ms_ppt及三槽位統一釋放release_ms,MS Office路徑透傳filepath引數;v5.3.5修復:SKILL.md frontmatter 修復 tags 塊序列誤混入聯絡方式行導致標準 YAML 解析失敗;v5.4.0新增:留存型功能——定時任務與報告中心(schedule_register 升級為三平台統一排程層 schtasks/cron/launchd,錯過策略 skip/run_once,登錄檔 JSON 可匯出匯入;新建 report_center.py 報告中心,templates/reports/*.json 引數化模板 + ECharts 單檔案 HTML 輸出(圖表內聯、無服務端、雙擊即開);report_generator 升級支援 --format html;wps.py CLI 統一埋點 SQLite,自動供 report_center 生成周度使用摘要附在報告末尾;watch.py 職責收窄為純事件採集);v5.3.0新增:統一CLI入口 wps(registry.json登錄檔分發,office --app/--action 與 convert 子命令、--list 一屏列出全部命令,薄路由層不改指令碼內部邏輯)、全命令 --json 機器可讀輸出(固定 ok/error_id/elapsed/data 四欄位,對齊 E001-E015,wps_error.py 新增 emit_json 統一齣口)、_worker 啟動最佳化(wps_pure 改惰性載入,pywin32/python-docx/openpyxl 經核查已惰性匯入,ENGINE_CACHE 程序級單例複用,COM 釋放統一走 release_ms 三槽位)、轉換三入口合併為 convert(format_converter/md_converter/wps_docx_to_ppt 內部按目標格式路由,舊指令碼保留為相容別名並提示新命令,v6.0.0 移除)
按主題與風格自動生成 PPT 檔案的技能。
體制內資深辦公室主任+管理學博士,自學程式設計開發的智慧公文寫作Skill,讓所有辦公室同仁少掉頭髮、少加無用的班,材料一稿過關,省下的時間留給自己、享受生活!————————我們能給你帶來的核心價值:1、顛覆傳統寫作:邏輯建模38類公文全鏈條,特有模板化引導問答模式,分分鐘省心生成高質量大稿。--------2、替你“向上管理”:獨有審稿人畫像機制,文稿一鍵結構性修改,精準匹配審稿人畫像,過稿率提升至少10倍!----------3、杜絕AI編造:缺失的數字、文號、人名、日期一律用[待補]標註,絕不杜撰,守住公文底線。-----------4、演算法格式托底:數十萬全量智控知識庫+6500行前沿核心控制程式碼,格式精準對齊GB/T 9704,出稿零失誤。——————————————————本skill歷史版本開放了5%知識庫的免費試用版,下載即可使用,但需注意:知識庫有著作權,僅用於個人使用,不可用於其他任何目的。有興趣的可以試試。——————————————————————單次付費版skill已釋出,2元一次使用全量知識庫。具體在釋出者“熵衍資訊”主頁skill裡。
WPS Office 全家桶 - 四引擎(WPS/MS Office/LibreOffice/純Python)智慧識別使用者已安裝軟體,純Python模式支援排序/篩選/圖表/公式/統計,含文件模板(程式碼生成)、最佳實踐案例、故障排除大章(20+避坑+15 FAQ+15錯誤ID 統一索引)、自動重試、硬體自適應、環境自檢、Skill更新提醒;v5.0新增:定時任務註冊管理(schtasks/crontab)、目錄輪詢監聽(YAML規則+大檔案分片)、使用統計與穩定性中心(SQLite埋點+引擎健康+引擎偏好)、COM三步自愈(regsvr32→修復安裝→手動指引)、對話式資料查詢(NL2SQL式意圖解析+查詢計劃+連續追問)、multi-agent編排引擎橋接(白名單探測+流水線模板註冊)
當用戶要處理 Word/Excel/PPT、做文件模板與排版、批次合併圖表、公文一鍵套紅頭、會議紀要要素化、或跨引擎辦公自動化時,WPS全家桶·辦公管家.Skill 立即出動。 四引擎智慧識別已裝軟體(WPS/MS Office/LibreOffice/純Python),純Python模式支援排序/篩選/圖表/公式/統計;含文件模板程式碼生成、20+避坑+15 FAQ+15錯誤ID統一索引、自動重試、硬體自適應、環境自檢。 當用戶提到批次水印、敏感資訊打碼(身份證/手機號/銀行卡/電子郵件)、跨文件檢索問答等訊號時,主動亮劍。
透過 Tencent Docs Open API 以 curl + jq 建立、讀取、列出、搜尋和管理騰訊文件的自動化工作流,覆蓋線上文件、線上表格、幻燈片、思維導圖、流程圖、智慧表格與收集表七種類型,支援讀取後設資料與單元格區域、上傳圖片、建立副本,並對重新命名/移動/刪除等寫操作強制先經使用者確認。Use when the user 提到騰訊文件 / Tencent Docs / docs.qq.com、貼上 docs.qq.com 連結,或想在其騰訊文件空間中建立、讀取、整理文件時使用。Triggers include 騰訊文件、線上文件、線上表格、思維導圖、流程圖、智慧表格、收集表。如需文案寫作完整工作流套件,淘寶搜尋「AI靈匣」店鋪獲取完整版。
透過 kdocs-cli 操作金山文件雲文件的官方技能。
為建築專案設計資料模型:實體、關係與庫表結構。
將 CAD/BIM 檔案轉換為結構化資料,提取 Revit、IFC、DWG、DGN 檔案中的元素資料。
分析建築專案資料中的異常、離群值和偏差。
dwg-to-excel 介紹用 DwgExporter 提取 DWG 資料。
追蹤施工系統中的資料來源、轉換過程和流轉路徑。
資料月份:2026-10 · 下載/星標數聚合自公開技能註冊庫(ClawHub、SkillHub),按月更新。口徑說明見資料方法。