pull down to refresh

I'm not saying it's the best model, I'm just saying I think it's likely. The big publishing companies love gatekeeping themselves as it protects their revenues. The knowledge is still gatekept right now, but by the publishers. The push towards more capable LLMs is strong. I think OpenAI and the other big firms will make some kind of deal for their AIs to legally access scientific journals, and whether it's a lump sum or per-usage deal, it's probably going to be billions of dollars flowing to scientific publishers.
Also, based on a skim I did the other day of the current patterns, many publishers allow not-for-profit scanning and indexing for machine learning purposes. So there will likely be open source efforts that don't get sued as long as they open source their models and don't charge for them as products.
reply
I think that's what I saw for some of the medical journals giving goog free access because their medical chat app is free to use.
With the note that it is only free to use for US physicians...
reply
Yes.
make some kind of deal for their AIs to legally access scientific journals
That has already happened, so I think it makes it all the more important to figure out how to remove the gate keepers from the knowledge supply chain.
If you disrupt knowledge (that's what AGI is supposed to do, right?) only to insert yourself as a middleman, you're going to be in trouble. Especially since the rest of the world has working AI - even if it's mediocre, that just means it takes longer - to help them realize undermining it.
reply
Can you link/speak more about these deals with publishers? I'd be curious to read about scope of the deals
reply
I'll work on getting you a list. The most prominent is probably Elsevier Health -> OpenEvidence from 2 years ago.
reply
reply
Those are mostly MSM publishers though - something that the AI companies chase because it's in their interest to buy the journalists. There is less threat coming from scientific publications (and both Anthropic and Meta have allegedly been training on libgen) so these deals are less visible.
reply
Springer is a big deal, I saw a deal with them. They're privately held too, so less likely to disclose all the terms.
reply
We are working with partners such as Reuters, Axel Springer, Hearst Magazines, USA TODAY Network and Financial Times, and plan to add more sources over time.
reply