Well, let's say it is less likely for a big cloud provider to leak customers chatlogs vs a random node on the internet.
I think for this to be somewhat a little bit more private, you could run as many layers as possible on the user machine (or your centralized gateway) and then offload the rest to a group of nodes, so that a single node does not run the inference from start to finish.
I'm new on stacker news
Welcome! By the way, I noticed your reply only because you've sent the zap. Since your comment was a freebie it was hidden automatically, you should connect a wallet or buy some credits on sn to make sure you reach people you reply to
Well, let's say it is less likely for a big cloud provider to leak customers chatlogs vs a random node on the internet.
I think for this to be somewhat a little bit more private, you could run as many layers as possible on the user machine (or your centralized gateway) and then offload the rest to a group of nodes, so that a single node does not run the inference from start to finish.
Welcome! By the way, I noticed your reply only because you've sent the zap.
Since your comment was a freebie it was hidden automatically, you should connect a wallet or buy some credits on sn to make sure you reach people you reply to