jbell730/anya - anya

17 Commits

1 Branch

1.9 MiB

Commit Graph

Author	SHA1	Message	Date
Jared Bell	ad03cd96ce	Add SSR/embedded-JSON extraction and restore Forbes services/ssr.py walks JSON-LD and Next.js __NEXT_DATA__ for article-like objects (headline, or title+url, or name with article signals), recovering JS-rendered sites without a browser. prepare_headlines favors embedded JSON over regex link scraping. Forbes is re-added as a live proof.	3 days ago

Author

SHA1

Message

Date

Jared Bell

ad03cd96ce

Add SSR/embedded-JSON extraction and restore Forbes

services/ssr.py walks JSON-LD and Next.js __NEXT_DATA__ for article-like
objects (headline, or title+url, or name with article signals), recovering
JS-rendered sites without a browser. prepare_headlines favors embedded JSON
over regex link scraping. Forbes is re-added as a live proof.

3 days ago

1 Commits (12315ffcce96bb1e550c897df2353dc8d17b6179)