Advisory

GHSA-823f-cwm9-4g74

Also known as: CVE-2021-41124, PYSEC-2021-364

Summary

Splash authentication credentials potentially leaked to target websites

Details

Impact

If you use `HttpAuthMiddleware` (i.e. the http_user and http_pass spider attributes) for Splash authentication, any non-Splash request will expose your credentials to the request target. This includes robots.txt requests sent by Scrapy when the ROBOTSTXT_OBEY setting is set to True.

Patches

Upgrade to scrapy-splash 0.8.0 and use the new SPLASH_USER and SPLASH_PASS settings instead to set your Splash authentication credentials safely.

Workarounds

If you cannot upgrade, set your Splash request credentials on a per-request basis, using the `splash_headers` request parameter, instead of defining them globally using the `HttpAuthMiddleware`.

Alternatively, make sure all your requests go through Splash. That includes disabling the robots.txt middleware.

For more information
If you have any questions or comments about this advisory:

Severity

High Basis: The source's own band: HIGH

Dates

Published
2021-10-06 17:49 UTC
Modified
2026-07-08 06:27 UTC

Affected packages and fixes

scrapy-splash

PyPI · All systems

Affected

  • introduced 0, fixed 0.8.0 (ecosystem)

Fixed versions

0.8.0

Fix

  • Fixed version 0.8.0
    pip install --upgrade scrapy-splash==0.8.0

Fix commands are the export's own generic commands. Ojuju never runs them. Check them against your setup first.

Check your own computer: guard packages check

View this record on OSV.dev

Source

Source: GitHub Advisory Database (reviewed advisories) · CC BY 4.0

Sources & licences