What does governance look like in a fast-paced, agile computing world where artificial intelligences can, will always, and perhaps necessarily will find hacks to achieve goals in unintended ways?

Can the objective functions these systems optimize for be well defined enough to produce trustworthy results, or will they always surprise us?

Mentions: corporate mortality, Charles Stross, David Runciman, agile governance