Setting up my own AI model - how hard would it be? \ stacker news ~AI

pull down to refresh

Setting up my own AI model - how hard would it be?

225 sats \ 6 comments \ @Signal312 15h AI

I'm a complete non-expert here, so forgive me if this is obtuse. But here's what I'm interested in learning about.

I'd like to put together an AI that would be able to facilitate my side of a debate/discussion on a certain topic. For instance, the Carnivore diet. I would ask it a question that I get asked a lot as a carnivore.

For instance: "Why is scurvy not a problem on the carnivore diet?". And then the AI would give me lot of resources about how to answer that question.

So I was wondering how hard it would be to put together lots of information (mostly text from books, maybe comments from online, transcripts from podcasts, etc) and input it into some AI tool, to get it into a format where I could ask questions. It would be like a regular AI, but it would prioritize the information that I've input.

Is that something that's possible, for someone who doesn't know much about AI expect as a user?

view all related items

30 sats \ 0 replies \ @TheMorningStar 1h

Possible? Definitely yes. But not worth the time and money.

73 sats \ 3 replies \ @SimpleStacker 10h

It wouldn't be easy, nor worth the cost.

Existing AI providers like OpenAI already have the ability for you to do this, i.e. upload a corpus of documents that you want it to answer from. And it would probably be cheaper to use their services than for you to set up and train your own model.

30 sats \ 0 replies \ @roytheholographicuniverse 9h

Second this. Just use OpenAI deep research and just give it the scenario of how you'd like to facilitate a mock debate -- share links you have in mind and just let it do it's thing. If you have some authority in mind, you can even ask it to speak to you as if it were that person -- it's pretty amazing.

5 sats \ 1 reply \ @Signal312 OP 9h

Thanks for the info.

I thought of this because I'd heard that Alex Epstein (author of the book Fossil Future, among others) did something like this, creating a model based on his own writings and other "climate crisis critical" documents. I should look more carefully at that .

34 sats \ 0 replies \ @SimpleStacker 9h

Yeah, I know because I tried to build my own RAG system and it was kinda difficult to get it working well. It's a bit more complex than simply downloading something from HuggingFace and hitting play. And then I realized that OpenAI has a tool for this already, and realized I was wasting my time trying to build my own.

Building your own might be something you only do if you want to keep your documents and interactions with the AI private.

114 sats \ 0 replies \ @0393c53fc8 14h

Choose the starting model you will finetune
Build your dataset
Rent a bigass GPU and train

Here's an example: https://erichartford.com/based-30b