One issue with Samurai is that whirlpool has a low participant count in each mix, and the wallet's default mode of operation dox's a user's addresses to the samurai servers.
So even if you are running dojo (ie, to not dox yourself to their server), the chance of the other mix participants also running dojo isn't that great, and thus your addresses can be doxx'd (by the samurai server) by a simple process of elimination. Running through repeated mixes doesn't do much to fix this.
For a 'privacy wallet', this is pretty egregious imo. There are known ways to fix this issue, that Samurai hasn't implemented for.. some reason?