Are there any performance hits to running something like ComfyUI in a docker container instead of on bare metal?
I ask because a lot of these UIs have similar file structures to each other (e.g. the model folders are all organized the same) and I think it would be beneficial to use docker containers with volumes all to the same folder. These models are several gigs of memory and it's silly to store multiple copies, and a docker setup would be easier to configure.
The best UI I've seen so far is https://pinokio.computer which isolates all of the environments, programs, and models into a single directory. But it still runs on bare metal. Is there a reason for this design decision? Is there a better UI out there?
10 sats \ 1 reply \ @anon 16 Aug
I haven’t gone down that path yet, I don’t know if you can get away with not using a dedicated GPU somewhere (via API) but I know this web deploy uses docker.
reply
Thanks for sharing!
reply
containers have near bare-metal performance as they're not a hypervisor infront of the hardware
I don't know anything about representing a gpu to docker though if thats your usecase, it may or may not be tricky
personally I like lxc better than docker when containerizing, thats another option to try
reply