Can we develop and test machine minds and uploads ethically?
April 25, 2011 by Martine Rothblatt
A fundamental principle of bioethics requires the consent of a patient to any medical procedure performed upon them. A patient will exist the moment a conscious mindclone arises in some academic laboratory, or hacker’s garage. At that moment, ethical rules will be challenged, for the mindclone has not consented to the work being done on their mind. Does this situation create a catch-22 ethical embargo against developing cyber-consciousness?
There are at least three ways to answer this challenge. First, it can be approached with a medical ethics focus on the mindclone itself. Second, it can be approached philosophically — focusing on the mindclone as just part and parcel of the biological original. Third, it can be approached pragmatically: what will the government likely require?
Creating Ethical Beings Ethically
How can it be ethical to test mindclone-creating mindware when any resulting mindclone has not first consented to being the subject of such an experiment? How will we know we have mindware that creates an ethically-reasoning mindclone if it is not ethical to even do the tests and trials?
As to the first question, ethicists agree that someone else can consent to a treatment for a person who is unable to consent. For example, the parents of a newborn child can consent to experimental medical treatment for them. The crucial criterion is that the consenter must have the best interests of the patient in mind, and not be primarily concerned with the success of a medical experiment. One of the purposes of an Institutional Review Board (IRB) or medical review committee is to exercise this kind of consent on behalf of persons who cannot give their consent. Hence, having a responsible committee act on their behalf solves the problem of ethical consent for the birth of a mindclone or beman.
Sometimes people complain that they “did not ask to be born.” Yet, nobody has an ethical right to decide whether or not to be born, as that would be temporally illogical. The solution to this conundrum is for someone else to consent on behalf of the newborn, whether this is done implicitly via biological parenting, or explicitly via an ethics committee. In each case there is a moral obligation (which can be enforced legally today for biological parents) to avoid intentionally causing harm to the newborn.
We are now ready to turn to the second question: how can an ethics committee, acting on behalf of the best interests of future mindclones or bemans, avoid causing harm to them?
One possible solution to ethically developing mindclones is to take the project in stages. The first stage must not rely upon self-awareness or consciousness. This would be based upon first developing the autonomous, moral reasoning ability that is a necessary, but not sufficient, basis for consciousness. Consciousness is a continuum of maturing abilities, when healthy, to be autonomous and empathetic, with autonomous defined as: “the independent capacity to make reasoned decisions, with moral ones at the apex, and to act on them.” Independent means, in this context, “capable of idiosyncratic thinking and acting.”
By running many simulations, mindclone developers can gain comfort that the reasoning ability of the mindware is human-equivalent. In fact, the reasoning ability of the mindware should match that of the biological original who is being mindcloned.
The second stage of development expands the mindware to incorporate human feelings and emotions, via settings associated with aspects of pain, pleasure and the entire vast spectrum of human sentience. At this stage, all the feelings and emotions are terminating in a “black box,” devoid of any self-awareness. Engineers will measure and validate that the feelings are real, via instruments, but no “one” will actually be feeling the feelings.
The third stage entails creating in software the meaningful memories and patterns of thought of the original person being mindcloned. This can be considered the identity module. If this is a case of a de novo cyberconscious being, i.e., a beman, then this identity module is either missing or is created from whole cloth.
Finally, a consciousness bridge will be developed that marries the reasoning, sentience and identity modules, giving rise to autonomy with empathy and hence consciousness. Feelings and emotions will be mapped to memories and characteristic ways of processing information. There will be a sentient research subject when the consciousness bridge first connects the autonomy, empathy and identity modules.
This bridging approach to ethically creating mindclones is reminiscent of Dennett’s observation that the disassociation from themselves that some victims of horrible abuse exhibit — a kind of denial that the abuse happened to them — is not only a way to avoid the sensation of suffering, but is also likely to be the normal state in beings that have not integrated consciousness into their mind.
In other words, if a being is unable to mentally organize a conceptualized self into a mental world of conceptualized things and experienced sensations, then they cannot actually suffer from pain because there is not a yet a self to suffer. Pain can be experienced, and it can hurt like hell, but it is an autonomic hurt and not a personally experienced hurt. In Dennett’s view, when people witness this kind of pain in most animals, they anthropomorphize themselves into the animal’s position and imagine the animal’s hurt. But because most animals cannot do this, they cannot hurt. Similarly, until a self was bridged into a mindclone’s or beman’s complex relational database of mindware and mindfiles, there would be “no one home” to complain.
Ethically, approval from research authorities should be obtained before the consciousness bridge is activated. There will be concern not to cause gratuitous harm, nor to cause fear, and to manage the subject at the end of the experiment gracefully or to continue its virtual life appropriately. The ethics approvals may be more readily granted if the requests are graduated. For example, the first request could be to bridge just a small part of the empathy, identity and autonomy modules, and for just a brief period of time. After the results of experiments are assessed, positive results would be used to request more extensive approvals. Ultimately there would be adequate confidence that a protocol existed pursuant to which a mindclone could be safely, and humanely, awakened into full consciousness for an unending period of time — just as there are analogous protocols for bringing flesh patients out of medically induced comas.
For example, before companies are allowed to test new drugs on patients they must first test a very small dose of the drug, for a very short period of time, on a healthy volunteer. Only gradually, based on satisfaction with the safety of previous tests, are companies allowed to test the drugs more robustly. Analogously, we can envision ethical authorities first permitting the test of only a small sliver of consciousness and only for a small sliver of time. Gradually, as ethical review committees become convinced that the previous trials were safe (did not cause pain or fear), greater tests of consciousness would be permitted.
Of course we are all aware of drugs that have been withdrawn from sale after having even been approved. In these cases evidence of dangerous side effects appear that were not evident during the clinical trials. No doubt the same situation will occur with mindclones — some tortured minds may be created inadvertently. This does not mean it is unethical to create mindclones. It means that every means practical should be employed to minimize the risks of such side effects, and if they manifest, to be able to rapidly resolve the problem. For example, if test equipment indicates a serious problem with a mindclone it should be promptly placed into a “sleep-mode” so as not to suffer.
In the graduated process described above the experimental subject still did not consent to being “born.” However, they could not so consent. In these cases a guardian (such as an institutional review board or certified cyberpsychiatrist or attorney) can ethically consent on an incompetent’s behalf, with such conditions as they may to impose. Alternatively, humans may in fact consent that their donated mindfiles can be used to create mindclones through a medical research process, assuming such consent was fully informed with a disclosure of the risks to the best of the researcher’s abilities.
In the foregoing way, it will be possible to ethically develop mindware that can be approved by regulatory authorities as capable of producing safe and effective mindclones for ordinary people. The authority may be the FDA in the U.S., or the EMA in the E.U., or some new regulatory entity. They will need to be assured that the mindware is safe and effective, and that proving it so was accomplished via clinical trials that were ethically conducted. By taking the inchoate mindclone through incrementally greater stages of consciousness, the regulatory hurdle can be met.
What’s the Big Deal — Just Me and My Mindclone
Another approach to the ethics of mindcloning is to remember that a mindclone and their biological original are the same person. Hence, the ethical requirement of “consent” is satisfied as long as a biological person requests their mindfile to be activated with mindware into a mindclone.
For example, there is no ethical objection to a person authorizing one, two, or 22 plastic surgeries upon their face, in the process transforming their looks almost beyond recognition. With mindcloning the plastic surgery is replaced with cyber surgery, and it is performed outside of one’s body. However, the end result, functionally, is quite similar — a person has consented to change of self — from one face to another in the case of plastic surgery; from one instantiation to two instantiations in the case of mindcloning. In each case the individual’s future will be changed, because others will interact differently with them, and they will behave differently. However, we recognize the right for a person to medically do as they please with their body (and mind), provided no doctor is being called upon to harm them without a countervailing benefit.
When consciousness first arises in a mindclone, it is not a new consciousness but an expansion of an existing consciousness. If it hurts, if it frightens, if it enlightens, it is not pain, fear or inspiration occurring to a new soul, but to an existing soul who now transcends two substrates: brain and software. The opening of consciousness in a mindclone is like what occurs to us when we have a profound educational experience.
I remember that I cried when I first read how the Nazis tied the legs of pregnant Jews together to kill them and their babies, and how, half a century later, the Liberian rebels chopped off the hands of young teenagers and talented craftsmen. My consciousness opened up to realms of cruelty that I had never imagined. I can’t say that I’m any better off for that education, but I knew what I was getting into in reading those stories. Similarly, creating a mindclone is going to change our minds. But it is our minds that we are changing, and this is something we have an ethical right to do.
We must also always remember that our minds are dynamically evolving pastiches of information and patterns of information processing. There is no such thing as having one mind, completely formed at birth, and never changing after that. Indeed, an excellent definition of a mind is: that which idiosyncratically aggregates, utilizes and exchanges information and information processing patterns. Consider the following meditation by Douglas Hofstadter in I Am a Strange Loop:
We are all curious collages, weird little planetoids that grow by accreting other people’s habits and ideas and styles and tics and jokes and phrases and tunes and hopes and fears as if they were meteorites that came soaring out of the blue, collided with us, and stuck. What at first is an artificial, alien mannerism slowly fuses into the stuff of our self, like wax melting in the sun, and gradually becomes as much a part of us as ever it was of someone else (and that person may very well have borrowed it from someone else to begin with).
Although my meteorite metaphor may make it sound as if we are victims of random bombardment, I don’t mean to suggest that we willingly accrete just any old mannerism onto our sphere’s surface — we are very selective, usually borrowing traits that we admire or covet — but even our style of selectivity is itself influenced over the years by what we have turned into as a result of our repeated accretions. And what was once right on the surface gradually becomes buried like a Roman ruin, growing closer and closer to the core of us as our radius keeps increasing.
All of this suggests that each of us is a bundle of fragments of other people’s souls, simply put together in a new way. But of course not all contributors are represented equally. Those whom we love and who love us are the most strongly represented inside us, and our “I” is formed by a complex collusion of all their influences echoing down the many years.
The relevance of Hofstadter’s extended metaphor lies in its implication that a mindclone is very much a part of its biological original because so very much of it would be copied from the original. If we are an agglomeration of other people, we surely must be much more an agglomeration of ourselves — even as we evolve from month to month and year to year. Our mindclones will be consolidations of ourselves, extensions of ourselves, and expansions of ourselves. They will be “of ourselves” and hence we are on firm ethical ground when we consent to their conscious awakening.
Quite a different situation prevails for the creation of a non-mindclone beman. Such consciousness is not an extension of anyone, but an entirely new idiosyncratic mixture of information and information processing patterns. The creation of such consciousness could be ethically considered as an exercise of a person’s own personal autonomy only in terms of each person having a right to create new life, as with biological reproductive rights.
The Ethics of Practicality
In the film Singularity is Near, futurist Ray Kurzweil argues with environmentalist Bill McKibben over the ethics of keeping people alive as long as technology makes a good quality of life possible. McKibbon says he is worried about the ethics of avoiding death. Kurzweil responds, “I don’t think people are going to wax philosophical if they are healthy but 120 years old, and a government official says they have to die.” The clear implication is “hell no.”
Similarly, I started a truck locating company called Geostar back in the 1980s. At first, people wrung their hands over the ethics of monitoring the truck drivers’ locations via satellite. Many thought the drivers would rip the satellite locators off their cab roofs. Instead, the drivers embraced the technology because it enabled them to make much more money. The satellite tracking technology permitted trucking company dispatchers to know at all times if locator-equipped drivers were close to the locations’ newly called-in loads. Not a single locator was ripped off in the thousands of trucks using our service.
I think practically speaking, the benefits of having a mindclone will be so enticing that any ethical dilemma will find a resolution. With mindclones, we are offering people the opportunity to cram twice as much life into each day, absorb twice as many interesting things and continue living beyond the days of their bodies — with a practical hope of future transplantation via downloading into a new body. I doubt that those who wax philosophically about the ethics of mindcloning will win many arguments. People will want their mindclones, like we want smartphones, especially as they become cheaper and better.
There will be different companies competing to offer mindclone-creating mindware. They will need some sort of regulatory approval in order to legally sell their mindware (as opposed to black market sales). The public will be reluctant to permit cyber-consciousness to arise in great numbers without some guarantee of its safety and efficacy, e.g., lack of psychoses in mindclones. Certainly the public will only accept the citizenship of mindclones that are created from mindware that has been certified (by an expert government agency) to produce mindclones that are mentally equivalent to their biological originals (assuming adequate mindfiles).
I think it is unlikely that cyber-consciousness will be accepted as real consciousness until it has manifested itself, probably many times over, and been shown to be persuasive in media interviews and court cases. Hence, it will be difficult to hold up experimental development of cyber-consciousness because regulators will not believe there is any real sentience to worry about — “just code.” Yet, once cyber-consciousness has appeared, and been generally accepted, the ethics of its development is a moot point.
Thus, practically speaking, the first mindclones will arise without much (or any formal) ethical protection during their development. Before the mindware that produced these mindclones can be generally marketed to the public, as certified to produce mindclone citizen extensions of biological originals, government agencies will require safety and efficacy testing. Specifically, government agencies will want proof that the mindware produces a healthy mind, and one that is practically indistinguishable from the mind of the biological original with an adequate size mindfile. Government agencies will not give their blessings to such proof unless it is developed ethically.
Ethical guidelines for developing mindclones will include a requirement of consent for the creation of a conscious being. As to the creation of mindclones, the consent of the biological original will likely be acceptable. As to the creation of bemans, there will be a more challenging pathway. Ethical review boards will need to be persuaded that the beman minds are not suffering during the process of accruing cyber-consciousness. This is not an insuperable barrier. However, it will require a much more deliberate development pathway based upon numerous graduated introductions of elements of cyber-consciousness, such as autonomy, empathy, identity and software bridges amongst these elements.
The bottom line is that ethical considerations favor a more rapid introduction of mindclones than non-mindclone bemans. Ultimately, however, the seeming catch-22 of how does a consciousness consent to its own creation can be solved.
Comments (12)
by Khannea Suntzu
The magical quality we bestow on humans (or should bestow, we don’t nearly enough) are right. Specifically human rights. That is the magic of what it means to be human – to be perceived as that which matters most.
The soul may be a metaphor for that simple act of being seen, acknowledged and remembered. It is giving a damn and having other people give a damn about you.
That is what it means when people say ‘animals don’t have a soul’. It reduces animals to the level of commodity. Or at least to the level of gingers.
by geekette
hi. As an AI research scientist who has also worked for 10 years with eastern medical practices that focus on the mind, I developed emotion oriented programming (pioneered it) and modelling mental and emotional state in multi-agent systems. Also created the (first?) robot with compassion. I wrote a sci fi story, The Robotic Priest, which gives a good example of how this type of mind technology can help us. I work with the folk son Obama and Michelle’s cyber-anti-bullying task force. ETC. Just to say, I have thought of these issues quite a bit and I am aggressively pursuing this idea, because I think mankind NEEDS this.
HOWEVER….as demonstrated by so many other systems in our life right not, it is not the technology, but the systems and ethics of the people who use them. From our medical system to the banks to the privacy/protection and user interface issues. There is this thing called Entropy.
Some of these papers are online at www-formal.stanford.edu/~cmason
by geekette
Having said all of that… I’ve had discussions with my journalist friends in Berkeley about exactly this topic. If there was a cell phone like gadget that could monitor deviant or unethical behavior, and it was VOLUNTARY to use it… people in positions of power who volunteer to use them, could perhaps be more trusted. By positions of power I don’t just mean politicians. But this won’t help if they’re not used… e.g. the country of Myanmar, the prisions, domestic violence situations, etc.
Sousveillance may be ready to help with this issue as well.
by melajara
Once again Man, this full of hubris creature is giving too much importance to her/himself by confusing “consciousness” by HUMAN consciousness. It is most probable that “consciousness” is a state of generalized awareness of oneself body (a distinctive evolutionary advantage) largely shared by MANY animals as its location seems not to be in the (neo)cortex but at the intersection of the brain stem and supervision of bodily functions.
Therefore, instead of ratiocining about an unreal premise (so far) i.e. consciousness in silico, let’s instead concentrate on the animal rights and about the legitimacy or not of “meat production”.
Now, personnaly I’m finding those “thought experiments” fastidious.
Why not instead discuss this very important question: what’s the sex of angels? By the way, do angels have wings? Do they have feathers? How long are those feathers? On average, how many feathers per wing?
by Khannea Suntzu
Damn will be surprised if in a few decades the number of registered types of unique types of things conscious, sapient, self-aware, intelligent, self-reflecting, creative, tool using, strategizing, planning, forethinking, anticipating, cognitive, aware of good and evil, mindful, wise, able to judge, imaginative, lucid, yadda yadda yadda you can buy in a store is hundreds and increasing ever faster.
This is software. In the software of mind is considerable utility, especially if we conceptually deconstruct the human mind. You probably won’t like that, but you can bet I will, and in effect I already do. LSD remember?
It’s all semantics. But it is semantics that describes real things. I can see these buggers right in font of me, as plain as electrons. Can you?
by Khannea Suntzu
I have another interesting thought experiment for you – what if I record / render a mind clone. And then I boot it up in learning mode, but not yet volitional .. I follow the legal guidelines as to keep it formally defined as a ‘thing’. Then I sync it with my thought processes as much as I can. I debug it (my natural mind is rather buggy) and at some point it goes online, BUT. The very moment I go online, a segment of my brain (probably dead tissue) is taken from my head, and I die, and the tissue is kept inside the mind clone’s central processors. And then my legal representation claims my brain is in there, kept alive. This may or may not be true, rather tricky to find out. My mind clone will perceive herself as me, and will not be inclined to disagree since the presence of that tissue (in part or whole) makes the resulting creature a legal continuation of me. The mind clone will have strong arguments to identify as ‘me’, and will regard the transference as a therapeutic treatment, rather than a transference. It will be an ‘upgrade’. The brain material inside might even have a residual neurological function (no matter how rudimentary *snortles*) of some sort, who cares? Now where would you propose meddling with the process, and sending AI civil rights busybodies to abduct my mind clone? Where would my mind clone decide she’d rather be Phyllis or Zoe rather than Khannea? The logical extension of this is that treating a union of willing interlocking mind clones as separate as an invasive act. It would be potentially murder of a legal entity, namely me, seeking continuation of my essential pattern. Someone might send the cops in the lab, take my mind clone, forcibly emancipate it and in doing so ditch what I was in the garbage, on account of some civil rights prejudice. Separate entities, sure, they should potentially be regarded as subjects of a freedom struggle. But if I intend to create a hive mind of seamlessly interlocking and designed mutually interdependent versions of myself, then any attempt to interfere I would greet with considerable hostility. My mind is mine, and my minds are equally mine. If at some point one matures and expresses a sincere desire to defect you have to trust me I’ll let her. Or it. Or him. But you’d have to let ME make decisions that pertain to ME.
by hapitune
Creating mindclones will no doubt take an enormous amount of research. Even if the process of creating a conscious being were done in stages, there is still some point at which the being will become sensient and the continued tests to see whether the being was actually sensient would violate the being’s right to choose whether it participates or not. Even in the case of babies being used in research studies, where the baby can not explicitly give consent, babies are still granted rights to withdraw from the study. If a baby becomes upset and shows signs of undue stress, the researcher is obligated to stop. They can try again but if the baby persists, the researcher must take that as a sign the the baby has withdrawn from the study. My point is that even beings who don’t have the ability to give conformed consent have the right to end their participation. So why can’t another conscious, sentient being have that same right? Even if they are unable to show their discomfort, why must it be dismissed? If it is indeed a conscious being, with sentience equal to that of a human, it should be treated as such.
Furthermore, the mindclone is not the same person. Yes it is a copy of a mindfile, but one totally seperate and sovereign from the original. The original mind will not feel, think, or sense what the clone will and vise versa. I don’t believe the original has an ethical right to have full governing power over what happens to the clone, just as a person doesn’t have the right to fully govern over any other person.
by xxdanbrowne
I think we’re projecting current understanding here.
How do we know that a mindclone cannot be “synched” with a pre-existing individual so that the real “individual” is actually composed of two (or more) individuals. It is premature to start forming ethical comparisons of what might be possible in the future when viewer with today’s lens.
by lennier1
I am very skeptical of the possibility of separating various aspects of the mind as the author proposes. How can we possibly create an entity that has human levels of logic and emotion, yet isn’t self aware? This would seem to me to be a philosophical zombie–it could act just like a human (passing the Turing test, for instance), yet would have no subjective experience. While we can’t say for sure without learning a lot more about the brain, I believe that it is impossible to fake consciousness. If an entity acts conscious, we should consider it to be so. I doubt we will ever find a “consciousness bridge” in the brain. Consciousness, I believe, emerges from many different parts of the brain acting together, but we will not be able to isolate a single part like “emotions” and have it function in a realistic, healthy way.
by Khannea Suntzu
Billy, if both mind clone and original agree (and better – function as if) they are two limbs of the same identity, then it is their respective choice. Consenting adults, right? You or any state legislator have absolutely no say in their expression of free will, other than evaluate whether or not coercion is involved. You can rest assured that when I achieve joyful immortality (which at this rate I am pretty much guaranteed I won’t – let’s make sure I survive this MONTH) and I have the capacity to boot up a mind clone (or to my surprise I find I am one) I’ll be a very captain Jack on that big pirate ship. I won’t be a captive, sailing the seas of the future with all my sisters around me – and anyone who cares visit me for an extended vacation in my mind. It’ll be a unanimous choice to be a singular entity, and we will all be (including the original) be completely and blissfully soulless. I am already soulless you see? It will be a compliment to call us all one and undivided. We’ll all be never alone again.
by billyswong
I don’t quite get what you mean Khannea. People usually either claim people have souls, or people don’t have souls. What do you mean “will be soulless”?
by billyswong
I agree with most of what this article saying. Only one thing. A mindclone is not the same person of the original. It is more like his/her twin brother/sister conjoined completely, unknowing each other in the past, get separated. The clone may share the same past and same character, but it has a different soul, and thus slightly different. Calling them the same person is an insult both to the original and the clone.