IBX-12127: Fixed valid URLs being marked as invalid by ibexa:check-urls

[tbialcz]

🎫 Issue	IBX-12127

Description:

ibexa:check-urls checked links with a bare cURL HEAD request without any headers (since the original implementation, EZP-28505). WAFs like Cloudflare block such requests, so working links were marked as invalid.

Now the request sends browser-like User-Agent/Accept headers, and a failed HEAD is retried once with GET. New optional handler options: method, fallback_to_get, user_agent, headers.

Also fixed in the same code: the https handler was reading http options, and the curl_multi loop could skip trailing URLs.

For QA:

1. Add RichText links to https://www.tiendanimal.es/ and to a URL that rejects HEAD requests (e.g. a local php -S server returning 403 for HEAD), publish.
2. Run php bin/console ibexa:check-urls — both links are Valid in Link manager (before the fix: Invalid).
3. Add a genuinely broken link (404 or dead host), re-run — it is marked Invalid.

Documentation:

Yes — document the new url_checker.handlers.http|https options: method, fallback_to_get, user_agent, headers.

[sonarqubecloud]

Quality Gate passed

Issues
4 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud