sttil/skool-lesson-scrape
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Fix login-detection glob requiring a path segment after the community

Browse source 
wait_for_url("**/{community}/**") requires characters both before and
after the community slug. The community home page itself is exactly
https://www.skool.com/<community> with nothing trailing, so the first
real run navigated there correctly (confirmed in the logs: chase-ai
redirect, then /navaigate) but still timed out waiting for a pattern
that could never match. Switched to a plain substring predicate.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01ViRGe7WHuUXUpHqvUfuW5r
This commit is contained in:
sososttil 2026-07-26 09:18:40 -04:00
parent 7d16130712
commit f0479d604a
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
scrape.py
View file

@ -91,7 +91,7 @@ async def run(community: str, output_dir: Path, discover: bool = False):
print("Opening Skool — please log in when the browser window appears.") print("Opening Skool — please log in when the browser window appears.")
print("The script will continue automatically once you land on the community.\n") print("The script will continue automatically once you land on the community.\n")
await page.goto("https://www.skool.com/login") await page.goto("https://www.skool.com/login")
await page.wait_for_url(f"**/{community}/**", timeout=300_000) await page.wait_for_url(lambda url: f"/{community}" in url, timeout=300_000)
print("Logged in.\n") print("Logged in.\n")
await page.goto(classroom) await page.goto(classroom)