Skip to content

cuitengweii/Python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

202 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python 宸ヤ綔鍖猴紙Collection锛?

鏈粨搴撳凡鎸夐」鐩噸鏋勪负涓夊ぇ涓氬姟鏉垮潡锛屽苟缁熶竴閲囩敤鈥滄ā鍧楀綊绫?+ 鍓嶇紑寮忓懡鍚嶁€濄€?

涓夊ぇ涓氬姟鏉垮潡

涓氬姟鏉垮潡 瑙勮寖妯″潡鍚? 鐩綍
GasGx GasGx_Article Link Collection Module Collection/gasgx/gasgx_article_link_collection_module
GasGx GasGx_Article Content Collection Module Collection/gasgx/gasgx_article_content_collection_module
GasGx GasGx_Canadian Natural Gas Data Acquisition Module Collection/gasgx/gasgx_canadian_natural_gas_data_acquisition_module
CyberCar `CyberCar 瑙嗛閲囬泦涓庡彂甯冩ā鍧梎 Collection/cybercar/cybercar_video_capture_and_publishing_module
Other Other_* 鐙珛瀛愭ā鍧? Collection/other/*

宸ヤ綔鍖虹粨鏋?

  • Collection/gasgx/锛欸asGx 鐩稿叧閲囬泦涓庢暟鎹ā鍧?- Collection/cybercar/锛欳ybertruck 瑙嗛閲囬泦涓庡彂甯冩ā鍧?- Collection/other/锛氬叾瀹冪嫭绔嬪瓙妯″潡
  • Collection/shared/锛氳法椤圭洰鍏叡鑳藉姏
  • Collection/configs/锛氱粺涓€閰嶇疆
  • Collection/data/锛氳繍琛屼骇鐗?- scripts/銆乣Collection/scripts/`锛氳嚜鍔ㄥ寲鑴氭湰

蹇€熷惎鍔?

1. 鍚姩 GasGx 閾炬帴閲囬泦妯″潡

# 鍗曟鎶撳彇閾炬帴骞舵姇閫掑埌 scrape_queue
python -m Collection.gasgx.gasgx_article_link_collection_module.cli --once

# 浜哄伐 LinkedIn 閾炬帴 JSONL 鎵归噺鍏ラ槦
python -m Collection.gasgx.gasgx_article_link_collection_module.manual_queue_ingest --input Collection/data/runtime/manual_linkedin_links.jsonl --update-existing-manual

2. 鍚姩 GasGx 姝f枃閲囬泦妯″潡

# 鎺ㄨ崘鍏ュ彛锛氭牴鐩綍涓诲叆鍙h剼鏈?python gasgx_article_content_collection_worker.py

# 绛変环鍏ュ彛锛氭ā鍧?CLI
python -m Collection.gasgx.gasgx_article_content_collection_module.cli

# 浠呴妫€骞堕€€鍑?python -m Collection.gasgx.gasgx_article_content_collection_module.cli --dry-run

# Windows Runner锛堣鍒掍换鍔℃帹鑽愬叆鍙o級
powershell -ExecutionPolicy Bypass -File Collection\scripts\windows\run_gasgx_article_content_collection_module.ps1

3. 鍚姩 GasGx 鍔犳嬁澶уぉ鐒舵皵鏁版嵁閲囬泦妯″潡

# 杩涘叆妯″潡鐩綍鍚庢墽琛屽崟娆¢噰闆?cd Collection/gasgx/gasgx_canadian_natural_gas_data_acquisition_module
python collector.py --once

4. 鍚姩 CyberCar 瑙嗛閲囬泦涓庡彂甯冩ā鍧楋紙鎺ㄨ崘锛?

# 閲囬泦锛坈ollect-only锛?powershell -ExecutionPolicy Bypass -File Collection\scripts\windows\run_cybercar_hourly.ps1

# 鍙戝竷锛坧ublish-only 璋冨害锛?powershell -ExecutionPolicy Bypass -File Collection\scripts\windows\run_cybercar_distribution_hourly.ps1

# Telegram 澶?bot 鍗曡繘绋?guard锛堝懡浠?+ 棰勫鎸夐挳鍥炶皟锛?powershell -ExecutionPolicy Bypass -File Collection\scripts\windows\run_telegram_multi_bot_guard_worker.ps1

璋冭瘯鍏ュ彛锛堟寜闇€锛夛細

python -m Collection.cybercar.cybercar_video_capture_and_publishing_module.hourly_distribution --collect-only
python -m Collection.cybercar.cybercar_video_capture_and_publishing_module.hourly_distribution --publish-only
python -m Collection.cybercar.cybercar_video_capture_and_publishing_module.cli --print-effective-config

5. 鍚姩 Script Control Center Worker锛堣嚜鍔ㄧ櫥璁拌剼鏈?+ 鎵ц璇锋眰锛?

python -m Collection.other.script_control_center.script_runner_worker

鍏煎鍏ュ彛锛堝巻鍙插懡鍚嶄粛鍙敤锛?

  • p17.py锛氬吋瀹瑰叆鍙o紝鍐呴儴宸茶浆鍙戝埌 gasgx_article_content_collection_worker.py
  • watch_p17.ps1锛氬吋瀹圭洃鍚剼鏈紝鍐呴儴宸茶浆鍙戝埌 watch_gasgx_article_content_collection_worker.ps1
  • scripts/windows/run_p17_worker.bat锛氬吋瀹规壒澶勭悊锛屽唴閮ㄥ凡杞彂鍒版柊鑴氭湰
  • scripts/windows/run_link_discovery_queue.bat锛氬吋瀹规壒澶勭悊锛屽唴閮ㄥ凡杞彂鍒?run_gasgx_article_link_collection_module.bat
  • Collection/scripts/run_p17.sh锛氬吋瀹?shell 鑴氭湰锛屽唴閮ㄥ凡杞彂鍒?run_gasgx_article_content_collection_worker.sh

鏂囨。鍏ュ彛

  • Collection/README.md锛欳ollection 宸ヤ綔鍖烘€昏
  • Collection/gasgx/gasgx_article_link_collection_module/README.md锛欸asGx 閾炬帴閲囬泦妯″潡璇存槑
  • Collection/gasgx/gasgx_article_content_collection_module/README.md锛欸asGx 姝f枃閲囬泦妯″潡璇存槑
  • Collection/gasgx/gasgx_canadian_natural_gas_data_acquisition_module/README.md锛欸asGx 鍔犳嬁澶ф暟鎹ā鍧楄鏄?- Collection/cybercar/cybercar_video_capture_and_publishing_module/README.md锛欳ybertruck 妯″潡璇存槑
  • Collection/docs/TELEGRAM_MACHINE_README.md锛歍elegram 鏈哄櫒鍙鍗忚绱㈠紩
  • Collection/docs/TELEGRAM_MULTI_BOT_GUARD_RUNBOOK.md锛氬 bot guard 杩愯鎵嬪唽
  • docs/standards/MODULE_GOVERNANCE_STANDARD.md锛氬瓙妯″潡娌荤悊鏍囧噯锛堟柊澧炴ā鍧楀噯鍏ワ級
  • docs/standards/CODEX_REPLY_STANDARD.md锛欳odex 鍗忎綔鍥炲瑙勮寖 v1锛堝伐浣滃尯鎵€鏈夋敼鍔ㄩ粯璁ゆ墽琛屽叚娈垫爣鍑嗭級
  • docs/standards/CODEX_WORKFLOW.md锛歏S Code + Codex 瀛愭ā鍧楀紑鍙戜笌瀹氫綅浣滀笟娴侊紙Impact Map / Change Receipt锛?- docs/standards/CODEX_WORKFLOW.md锛氬崟妯″潡瀹炴垬鏍蜂緥锛堜粠瀹氫綅鍒伴獙鏀剁殑瀹屾暣绀轰緥锛?- docs/projects/gasgx_backend/sop/LINKEDIN_MANUAL_INGEST_SOP.md锛氫汉宸?LinkedIn 閲囬泦鍒颁簩闃舵鍒嗙被鍥炴墽鐨勫崗浣?SOP
  • .vscode/tasks.json锛歏S Code 涓€閿换鍔★紙Impact Map / 鏍¢獙 / smoke / 瀹炴垬鍛戒护锛?- PROJECT_STRUCTURE_DETAILED.md锛氭牴鐩綍璇︾粏缁撴瀯璇存槑锛堝惈鍏叡鑳藉姏璇﹁В锛?- Collection/other/script_control_center/README.md锛氳剼鏈帶鍒朵腑蹇冭鏄庯紙缁熶竴灞曠ず涓庢帶鍒讹級
  • Collection/other/omnicode_ui_prototype/README.md锛歄ther 妯″潡绀轰緥璇存槑
  • docs/锛氳繍琛屾墜鍐屼笌缁撴瀯璇存槑

鏂囨。缁存姢瑙勫垯

  • 妯″潡鍛藉悕銆佸叆鍙h剼鏈€侀厤缃」鍙戠敓鍙樺寲鏃讹紝蹇呴』鍚屾鏇存柊瀵瑰簲 README銆?- 娉ㄩ噴鍜岃鏄庣粺涓€浣跨敤涓枃锛岀‘淇濆洟闃熷崗浣滃拰鑷姩鍖栨祦绋嬪彲鐩存帴鐞嗚В銆?- 鎻愪氦鍓嶅彲鎵ц锛歚scripts/windows/run_repo_contract_checks.bat`

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors