Skip to content

Fix dailykos false positives via status_code detection#3017

Open
sevenmoonlightsteps wants to merge 1 commit into
sherlock-project:masterfrom
sevenmoonlightsteps:fix/dailykos-false-positive
Open

Fix dailykos false positives via status_code detection#3017
sevenmoonlightsteps wants to merge 1 commit into
sherlock-project:masterfrom
sevenmoonlightsteps:fix/dailykos-false-positive

Conversation

@sevenmoonlightsteps

Copy link
Copy Markdown

Summary

dailykos is on the false-positive exclusions list. Its entry probed the signup
endpoint (/signup/check_nickname?nickname={}) and matched the message
{"result":true,"message":null}. That inverted-logic check is fragile: when the
endpoint drifts it stops returning the message and every username reads as taken,
producing false positives.

The profile page itself is a clean, stable signal:
https://www.dailykos.com/user/{} returns HTTP 200 for an existing user and
404 for a missing one. This switches dailykos to status_code detection on
that URL and drops the now-unneeded errorMsg and urlProbe.

Validation

Per the false-positive remediation guide, validated against the live site with
--local (no false positive and no false negative):

  • false negative: username_claimed blue -> Found (200)
  • false positive: random usernames (e.g. xkq7mztab9, zzqwx88notreal) -> Not Found (404)
  • pytest tests/test_validate_targets.py --chunked-sites=dailykos -m online -> 2 passed

No dailykos-specific false-positive issue exists, so Fixes: is omitted per the guide.

The dailykos entry probed the signup endpoint
(/signup/check_nickname?nickname={}) and matched the message
{"result":true,"message":null}. That inverted-logic check is fragile and
drifts, producing false positives.

The profile page itself is a clean signal: https://www.dailykos.com/user/{}
returns HTTP 200 for an existing user and 404 for a missing one. Switch to
status_code detection on that URL and drop the errorMsg/urlProbe.

Validated against the live site (no false positive or false negative):
existing user "blue" -> Found; random usernames -> Not Found.

Claude-Session: https://claude.ai/code/session_01WYhk8kfDEd5fKmCGu8zHrV
@github-actions

Copy link
Copy Markdown
Contributor

Automatic validation of changes

Target F+ Check F- Check
dailykos ✔️   Pass ✔️   Pass

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant