🌐 Sites Processing
📖 Overview
The Sites module handles thumbnail generation and business information synchronization for client websites.
Environment Flags:
QM_SITES_BUILD_THUMBNAILS=true- Thumbnail generationQM_SITE_UPDATE_BUSINESS=true- Business info updates
Source Location: queue-manager/crons/sites/
Processing Pattern: On-demand + Periodic updates
🗄️ Collections Used
site
- Operations: Read/Update
- Model:
shared/models/site.js - Usage: Website records and metadata
site-thumbnail
- Operations: Create/Update
- Model:
shared/models/site-thumbnail.js - Usage: Store generated thumbnails
🔧 Jobs in This Module
Build Thumbnails
Overview: Generates website thumbnails using Puppeteer.
Key Features:
- Screenshot Capture: Full-page and above-the-fold captures
- Multiple Sizes: Desktop, tablet, mobile views
- S3 Storage: Uploads to cloud storage
- Lazy Generation: On-demand or scheduled
- Cache Management: Updates on site changes
Processing:
- Query sites needing thumbnails
- Load site URL in headless browser
- Capture screenshots at different viewports
- Optimize images (compression, resize)
- Upload to S3
- Update site record with URLs
Update Business
Overview: Synchronizes business information across site platforms.
Key Features:
- NAP Consistency: Name, Address, Phone updates
- Hours of Operation: Business hours sync
- Service Updates: Services/products synchronization
- Multi-Platform: Updates Duda, WordPress, custom sites
Module Status: Active
Execution Pattern: On-demand + Scheduled
Last Updated: 2025-10-10