Discussion about this post

User's avatar
Dartz's avatar

Very insightful. I'll be cogitating on this for awhile.

Code is law. So let's say rules for self driving cars, now written by tech companies, should have a "constitution" of laws created (by humans, for humans?) then encrypted and instantiated on a blockchain, that then acts as a control on a class of technologies, agents, or devices? Thus being, or becoming highly resistant to capture (given the right blockchain)?

I hope you flesh this out.

Rafael Kaufmann's avatar

I fully agree with the sentiment, but I think that the right way to think about "can't-be-evil" engineering is sort of like carbon steel: a minimum of mathematically guaranteed ingredients mixed into time-tested, adaptively robust social technologies. Vs trying to engineer purist "can't-be-evil stacks" de novo, which inevitably falls pray to the designer's failures of imagination etc.

Also, one more more New Nature law for your consideration, perhaps more basic than the others: in engineered systems with (deterministic or aleatoric) outcomes that implement a good model of some aspect of reality, the outcomes can't be manipulated without breaking the model and compromising the system's usefulness. This applies transparently if the model itself is a recommendation/decision model, but even if it's a pure predictive/generative model, it holds to the extent that the usefulness is dependent on truthful representation.

Note that trade and money form such a system. Hence the eternal resistance of economic reality to bend the knee to political force.

No posts

Ready for more?