Superintelligence: Paths, Dangers, Strategies by Kevin Gebura

74 Book Review >>> Kevin Gebura Superintelligence: Paths, Dangers, Strategies

Bostrom, Nick. Oxford: Oxford University Press, 2014. 352 pp.

Once human intellectual capacity is surpassed by human inventions, superintelligence exists (52). Forewarning, Nick Bostrom’s Superintelligence is not an effective introduction to any of the disciplines that inform the discussion of superintelligence. Bostrom’s background in physics and computational neuroscience is evident throughout the book. Readers without such backgrounds may have a difficult time following along. However, after reading about Bostrom’s account of superintelligence, the topic is undeniably important and relevant to current and future generations. The philosophical discourse in this book reflects this imperative sense of understanding and preparing for superintelligence. Readers may struggle to appreciate the work done in this book if they are without prior experience within the philosophical, mathematical or scientific communities. Given this lack of accessibility, the book may have less of an impact than it perhaps deserves. Superintelligence is predicated on science and rationality, creating a philosophically sophisticated account of how humans may be plotting their own demise. In the preface, Bostrom says that the book is written to please an earlier version of himself, but that its contents can be understood with enough rigor in thought and resistance to misunderstand him via cultural preconceptions of superintelligence (viii). Because Bostrom has so many terminologies at play, it may be a struggle during the first read-through for a reader to thoroughly understand what Bostrom is trying to say. There are sections throughout the book where Bostrom elaborates further with tables, diagrams and equations. Many of these sections require an understanding of advanced mathematics and will probably not provide clarity to an untrained mind. Bostrom maps the different paths that may lead to superintelligence, and holds the reader’s hand to see where each one leads. It is likely that readers will be overwhelmed when trying to understand all the paths to superintelligence that Bostrom provides. However, overlooking these details may result in a failure to see how comprehensive his account is. No predictions are made about which path is better because each will require unique precautions, risks and outcomes. Bostrom does not explicitly offer his own preference about how to handle superintelligence. Much of his argumentation is about what will happen depending on the form of superintelligence that gets established. The book has innumerable endnotes and readers will spend a great deal of time either reading on without full clarity or flipping back and forth dozens of times per chapter. If readers have trouble following his discussions (such as those that involve esoteric concepts) the endnotes offer further explanations and additional resources. This is yet another reason why Superintelligence is not an easy read. To make the author’s complex account simpler, here are

some the most essential points of argument. Superintelligence is guided by the idea that humans are still in charge of artificial intelligence (AI) and have a chance to prevent any foreseeable usurp of human power by AI power. Superintelligent agents have specific functions, or superpowers, depending on the forms taken, and exceed humans at some cognitive task (93). Bostrom classifies the cognitive tasks that humans are capable of, all of which constitute the total general intelligence of humans. Once superintelligent agents surpass humans at each task, this creates the scenario where humans are inferior. AI domination could entail human servitude to superintelligent agents. In another case, humans impede the AI’s productivity so much that superintelligent agents plan the obsolescence of the human species. Humans program AI for some purpose, which AI values as its sole responsibility. But humans cannot completely control the actions of their creations. A superintelligent agent will outsmart any human attempts to prevent the achievement of its values (97). But there is not a total loss of control, as Bostrom puts it, “unless the AI’s motivation system is a special kind, or there are additional elements in its final goal that penalize strategies that have excessively wideranging impacts on the world, there is no reason for the AI to cease activity upon achieving its goal” (123). With such strict agency, superintelligent agents may cause undesirable economic, cultural and environmental circumstances. Therefore, AI obedience to human values is contingent on how well the purposes of AI adhere to these values. Support for Bostrom’s account is limited because research conducted on the topic of superintelligence is limited. His philosophical work serves to motivate further investigating in the related fields of study. The greatest task facing computer programmers may be the translation of human values into programming language. For example, a purpose that prevents AI from harming humans may be one that ensures the highest amount of human happiness. Such a goal requires the codification of the human value, happiness, into programming language; but there is no agreement on the proper conception of happiness to begin with (186). Missing from Bostrom’s discussion is the idea that perhaps superintelligence is the key to unlocking the truth behind such debatable concepts like happiness, love, or God. Bostrom’s book may inspire readers to elaborate on philosophically interesting matters like this one. This is not a book to be careless about. If readers want satisfaction, they may have to read Superintelligence multiple times and take personal notes. The subject matter does not allow for leisurely reading. Bostrom has put together a very coherent text about a topic that is surrounded by speculations while making some novel contributions to the discussion. The order of his chapters are sensible and build an overall comprehensive account of a future world. However, the fact remains that Superintelligence is largely based on Bostrom’s own terminologies. Perhaps reading his previous works should be a prerequisite to understanding the full value of Superintelligence.