scrapy-splash
Affected
- introduced
0, fixed0.8.0(ecosystem)
Fixed versions
0.8.0
Fix
- Fixed version
0.8.0pip install --upgrade scrapy-splash==0.8.0
Advisory
Also known as: CVE-2021-41124, PYSEC-2021-364
Splash authentication credentials potentially leaked to target websites
Impact
If you use `HttpAuthMiddleware` (i.e. the http_user and http_pass spider attributes) for Splash authentication, any non-Splash request will expose your credentials to the request target. This includes robots.txt requests sent by Scrapy when the ROBOTSTXT_OBEY setting is set to True.
Patches
Upgrade to scrapy-splash 0.8.0 and use the new SPLASH_USER and SPLASH_PASS settings instead to set your Splash authentication credentials safely.
Workarounds
If you cannot upgrade, set your Splash request credentials on a per-request basis, using the `splash_headers` request parameter, instead of defining them globally using the `HttpAuthMiddleware`.
Alternatively, make sure all your requests go through Splash. That includes disabling the robots.txt middleware.
For more information
If you have any questions or comments about this advisory:
High Basis: The source's own band: HIGH
0, fixed 0.8.0 (ecosystem)0.8.0
0.8.0pip install --upgrade scrapy-splash==0.8.0Fix commands are the export's own generic commands. Ojuju never runs them. Check them against your setup first.
Check your own computer: guard packages check
Source: GitHub Advisory Database (reviewed advisories) · CC BY 4.0