🔧 Component | 💬 Description |
---|---|
scrape_url_content | Scrapes all HTML, PHP, CSS, JS files from the provided URL |
filter_code_lines | Cleans up unnecessary or duplicate lines for better analysis |
pagespeed_api_call | Calls Google PageSpeed API (Mobile + Desktop) |
count_tokens | Ensures token-safe LLM execution |
initialize_llm_chain | Prepares LLM chain for checklist and performance evaluation |
batch_checklist_items | Groups checklist items in chunks of 10 |
stream_to_queue | Streams intermediate results into Redis Queue for real-time UI |
parse_pagespeed_metrics | Extracts useful metrics from PageSpeed JSON |
create_excel_report | Builds styled Excel report using all collected data |
upload_to_s3 | Uploads the Excel file to AWS and returns the S3 path |
calculate_cost | Calculates and logs token usage + pricing |
store_response | Saves all results in DB for auditing or analytics |