Website crawler for technical SEO audits