Whomever owns the oracles gets to manipulate the market to their will. This is basically the same problem with paul sztorc's "truthcoin" system- at the end of the day there is no way to actually verify information about the outside world.