Normalize URL encoding mode

Hello there,

📢 We updated our URL normalization settings:

URLs can exist in multiple formats while pointing to the same page. Oncrawl applies normalization rules to ensure consistent crawling and analysis.

We are introducing two new options for better control of this behavior:

1️⃣ Normalize URL encoding

Normalize encoded and decoded URLs to reduce duplicates and inconsistencies across paths and query parameters.

2️⃣ Rewrite // to /

Normalize repeated slashes in URLs. Disable this option to identify broken or malformed URLs.