Amara, thank you for posting this very interesting research. It obviously has many implications across our social worlds. Their is a lot of related research that illustrates the untrustworthiness of our opinions. I believe this successfully adds to that literature.

However, this is also very compelling research related to Kurzweils’ predictions. I think it is important to consider the implications of false beliefs in a society where some individuals will be far more empowered than ever before through cybernetic augmentations. It is preferable to hope that the ability to access the abundance of data on the internet will prevent such cyborgs of the future, and AI for that matter, from making erroneous conclusions and holding fallacious beliefs, such as these. Yet, as knowledge and ideas transfer relatively quickly now, we cannot underestimate the initial power held by those who alone hold important knowledge and ideas first. I see this as one of the most vital considerations before empowering super-intelligent people and machines to make decisions that result in actions. Their increased intelligence will presume their superior accuracy and negate “less” intelligent voices. The results of such actions will likely be devastating to those less powerful, whether they are a minority or not. In either case, it would be a shame.

It will be vital to keep in mind the inherent bias that will always exist for each intelligent being, whether it is perceived to be autonomous or not. We cannot afford to fall victim to the tendency to surrender our will in the face of superiority of any kind (whether it is a brutish boss, or super-intelligent leader). Every self aware being has the right to have its voice heard and the responsibility to protect its needs and interests. We have not realized this potential today, but it will only become more crucial as powerful people and regimes increase exponentially. Individual voices should remain sacred and not be marginalized. This does not imply that everyone always gets their own way, interests will always overlap. What I am stating is simply that every consideration should be made to appease the concerns of all individual interests, including those that may not be empowered to initiate such a dialogue. This would indeed require super-intelligence, but I hope it will be the goal before such beings are able to implement their desires.

There are a number of ways this can be accomplished. All significant actions must seek out continuing dialogue with any potentially effected party, and keep the door open for new ones. So called “win-win” solutions must be sought, without a proclivity towards haste. Any cultural differences, whether national, regional, organizational, linguistic, social, etc. must be taken into consideration. Context cannot be forgotten, nor can the understanding that context is in continual flux. As dialogue develops, individuals modify their position and understanding. Kurzweil is very aware of this as he understands well the importance of educating and preparing people for new paradigms and technology. The power for communication between people has increased drastically, unfortunately the importance of utilizing it effectively is still very much under-appreciated. Think of how often we get into disputes simply because we neglected to clarify our understanding, assumptions, values, or positions. The capacity to effectively process the billions of potential signals from other humans would be an incredible, and very worthwhile achievement for humankind.

The focus must remain on empowering creations and actions that strive to foster an equal playing field for all. For instance, achieving super-human intelligence is not equitable if it is trusted to remain in the hands of a few. Knowledge creation can disarmingly create the perception that it may remain static, however, this is never the case. New information implies potential harm when it is applied unevenly. The obvious reason is that our individual opinions are often wrong and application of these opinions can have deleterious effects on others. Therefore, I think one of the biggest challenges to the oncoming rise of machines and super-intelligence will be the extremely difficult task of balancing equitable distribution and application of this technology. This should be a prime concern.

(A little background: I am finishing my graduate work at American University’s School of International Service and have focused on cross-cultural communication in conflict resolution.)