Activity

Summary

• Switches Reddit fetching from RSS feeds to JSON API using residential proxies
• Extracts richer data: score, num_comments, author, upvote_ratio, selftext
• Adds getScraperClient() helper to BaseFetcher for proxy-enabled fetchers
• Updates fetch tier from frequent (1hr) to standard (4hr) to conserve proxy bandwidth

Changes

• BaseFetcher.php - Added proxy client helper
• RedditFetcher.php - Rewritten for JSON API
• SourceSeeder.php - Updated Reddit source config
• Migration to update existing Reddit sources

Test plan

• Add WEBSHARE_API_TOKEN to Coolify
• Deploy and run migration
• Verify fetch with php artisan firehose:fetch --source=reddit_laravel
• Check raw_items table for richer Reddit data