If I were using an AI I'd do it like this:

1. Query GraphQL for every new post
2. Extract the post, the link if there, the comments
3. Use an LLM to: summarize the post, the underlying article and the discussions
4. Use NER to: extract named entities
5. Populate a graphdb that links all named entities across all articles
6. Read every summary instead of every linked article
7. Continue at 4 above, lol.