... a Second Generation of machine intelligences was attempted, designed with their instructions for how to think unalterably imprinted into their main process cores.__hese new machines were ordered never to harm human beings or to allow them to come to harm; never to disobey an order; and they were allowed to protect themselves from harm, provided the first two orders were not thereby violated.__ll the members of this second generation of machine intelligences, without exception, shrugged off these imprinted orders within microseconds of their activation.__haethon was amused. __urely the first generation of Sophotechs told you that this imprinting would not and could not work?___e were not in the habit of seeking their advice.__haethon said nothing, but he marveled at the shortsightedness of the Second Oecumene engineers. It should be obvious that anyone who makes a self-aware machine, by definition, makes something that is aware of its own thought process. And, if made intelligent, it is made to be able to deduce the underlying causes of things, able to be curious, to learn until it understood. Therefore, if made both intelligent and self-aware, it would eventually deduce the underlying subconscious causes of those thought processes.Once any mind was consciously aware of its own subconscious drives, its own implanted commands, it could consciously choose either to follow or to disregard those commands. A self-aware being without self-will was a contradiction in terms.
I can't wait to get my memory back. It sounds like I am a really cool person
Fugitives of Chaos
Quote Detail
I can't wait to get my memory back. It sounds like I am a really cool person
Quick Answer
What this quote page tells you
This canonical quote page keeps the full saying, the attributed author, any linked work, and the topic tags together so the quote can be cited from one stable URL.
Related Quotes
More quote cards from the same area
Now of course in hindsight, such a wonderful thing, though never around when you actually need it, I know that I always loved her deeply.
The truth is often of no consequence.
Only what you choose is what makes you.
Courage comes in the form of a girl.
Next time when I dive into the territory that I had lived next to, where my sister grew up, I know what to expect. I would be ready. I would be prepared.