When General Genius built the first mentar [Artificial Intelligence] mind in the last half of the twenty-first century, it based its design on the only proven conscious material then known, namely, our brains. Specifically, the complex structure of our synaptic network. Scientists substituted an electrochemical substrate for our slower, messier biological one. Our brains are an evolutionary hodgepodge of newer structures built on top of more ancient ones, a jury-rigged system that has gotten us this far, despite its inefficiency, but was crying out for a top-to-bottom overhaul.Or so the General genius engineers presumed. One of their chief goals was to make minds as portable as possible, to be easily transferred, stored, and active in multiple media: electronic, chemical, photonic, you name it. Thus there didn't seem to be a need for a mentar body, only for interchangeable containers. They designed the mentar mind to be as fungible as a bank transfer.And so they eliminated our most ancient brain structures for regulating metabolic functions, and they adapted our sensory/motor networks to the control of peripherals.As it turns out, intelligence is not limited to neural networks, Merrill. Indeed, half of human intelligence resides in our bodies outside our skulls. This was intelligence the mentars never inherited from us....The genius of the irrational......We gave them only rational functions -- the ability to think and feel, but no irrational functions... Have you ever been in a tight situation where you relied on your 'gut instinct'? This is the body's intelligence, not the mind's. Every living cell possesses it. The mentar substrate has no indomitable will to survive, but ours does.Likewise, mentars have no 'fire in the belly,' but we do. They don't experience pure avarice or greed or pride. They're not very curious, or playful, or proud. They lack a sense of wonder and spirit of adventure. They have little initiative. Granted, their cognition is miraculous, but their personalities are rather pedantic.But probably their chief shortcoming is the lack of intuition. Of all the irrational faculties, intuition in the most powerful. Some say intuition transcends space-time. Have you ever heard of a mentar having a lucky hunch? They can bring incredible amounts of cognitive and computational power to bear on a seemingly intractable problem, only to see a dumb human with a lucky hunch walk away with the prize every time. Then there's luck itself. Some people have it, most don't, and no mentar does.So this makes them want our bodies...Our bodies, ape bodies, dog bodies, jellyfish bodies. They've tried them all. Every cell knows some neat tricks or survival, but the problem with cellular knowledge is that it's not at all fungible; nor are our memories. We're pretty much trapped in our containers.
I have argued that this sort of thinking is problematic in at least two regards:First, the notion that nonhuman animals do not have an interest in continued existence__hat they do not have an interest in their lives__nvolves relying on a speciesist concept of what sort of self-awareness matters morally. I have argued that every sentient being necessarily has an interest in continued existence__very sentient being values her or his life__nd that to say that only those animals (human animals) who have a particular sort of self-awareness have an interest in not being treated as commodities begs the fundamental moral question. Even if, as some maintain, nonhuman animals live in an __ternal present___nd I think that is empirically not the case at the very least for most of the nonhumans we routinely exploit who do have memories of the past and a sense of the future__hey have, in each moment, an interest in continuing to exist. To say that this does not count morally is simply speciesist.Second, even if animals do not have an interest in continuing to live and only have interests in not suffering, the notion that, as a practical matter, we will ever be able to accord those interests the morally required weight is simply fantasy. The notion that we property owners are ever going to accord any sort of significant weight to the interests of property in not suffering is simply unrealistic. Is it possible in theory? Yes. Is it possible as a matter of practicality in the real world. Absolutely not. Welfarists often talk about treating __armed animals_ in the way that we treat dogs and cats whom we love and regard as members of our family. Does anyone really think that is practically possible? The fact that we would not think of eating our dogs and cats is some indication that it is not.
Quote Detail
I have argued that this sort of thinking is problematic in at least two regards:First, the notion that nonhuman animals do not have an interest in continued existence__hat they do not have an interest in their lives__nvolves relying on a speciesist concept of what sort of self-awareness matters morally. I have argued that every sentient being necessarily has an interest in continued existence__very sentient being values her or his life__nd that to say that only those animals (human animals) who have a particular sort of self-awareness have an interest in not being treated as commodities begs the fundamental moral question. Even if, as some maintain, nonhuman animals live in an __ternal present___nd I think that is empirically not the case at the very least for most of the nonhumans we routinely exploit who do have memories of the past and a sense of the future__hey have, in each moment, an interest in continuing to exist. To say that this does not count morally is simply speciesist.Second, even if animals do not have an interest in continuing to live and only have interests in not suffering, the notion that, as a practical matter, we will ever be able to accord those interests the morally required weight is simply fantasy. The notion that we property owners are ever going to accord any sort of significant weight to the interests of property in not suffering is simply unrealistic. Is it possible in theory? Yes. Is it possible as a matter of practicality in the real world. Absolutely not. Welfarists often talk about treating __armed animals_ in the way that we treat dogs and cats whom we love and regard as members of our family. Does anyone really think that is practically possible? The fact that we would not think of eating our dogs and cats is some indication that it is not.
Quick Answer
What this quote page tells you
This canonical quote page keeps the full saying, the attributed author, any linked work, and the topic tags together so the quote can be cited from one stable URL.
Related Quotes
More quote cards from the same area
Consciousness is the chronic pain of life, and all higher organisms suffer it every waking moment.
There are countless ingredients that make up the human body and mind, like all the components that make up me as an individual with my own personality. Sure, I have a face and voice to distinguish myself from others, but my thoughts and memories are unique only to me, and I carry a sense of my own destiny. Each of those things are just a small part of it. I collect information to use in my own way. All of that blends to create a mixture that forms me and gives rise to my conscience.
Once we have isolated the computational and neurological correlates of access-consciousness, there is nothing left to explain. It's just irrational to insist that sentience remains unexplained after all the manifestations of sentience have been accounted for, just because the computations don't have anything sentient in them. It's like insisting that wetness remains unexplained even after all the manifestations of wetness have been accounted for, because moving molecules aren't wet.
People see the cleverness of nature and suppose it's the cleverness of the animal itself but it was obvious to me that each and every segment of the animal isn't aware. How much I'd hate to live totally unaware of myself, I thought. What would be the point of living, of existing, if you weren't ever to know about it? I looked at the Fox Moth and pitied it, poor unconscious creature. But then, I supposed, at least it wouldn't be disappointed. It would never find out.
While a number of people have pointed out the various costs and drawbacks of sentience, few if any have taken the next step and wondered out loud if the whole damn thing isn't more trouble than it's worth. Of course it is, people assume; otherwise natural selection would have weeded it out long ago. And they're probably right. I hope they are. "Blindsight" is a thought experiment, a game of "Just suppose" and "What if". Nothing more.On the other hand, the dodos and the Steller sea cows could have used exactly the same argument to prove their own superioirity, a thousand years ago: "if we're so unfit, why haven't we gone extinct?" Why? Because natural selection takes time, and luck plays a role. The biggest boys on the block at any given time aren't necessarily the fittest, or the most efficient, and the game isn't over. The game is never over; there's no finish line this side of heat death. And so, neither can there be any winners. There are only those who haven't yet lost.