Guest Blog

Paul Allen: The Singularity Isn't Near

The Singularity Summit approaches this weekend in New York. But the Microsoft cofounder and a colleague say the singularity itself is a long way off.

Paul G. Allen and Mark Greaves 10/12/2011

  • 73 Comments
Credit: Technology Review

Futurists like Vernor Vinge and Ray Kurzweil have argued that the world is rapidly approaching a tipping point, where the accelerating pace of smarter and smarter machines will soon outrun all human capabilities. They call this tipping point the singularity, because they believe it is impossible to predict how the human future might unfold after this point. Once these machines exist, Kurzweil and Vinge claim, they'll possess a superhuman intelligence that is so incomprehensible to us that we cannot even rationally guess how our life experiences would be altered. Vinge asks us to ponder the role of humans in a world where machines are as much smarter than us as we are smarter than our pet dogs and cats. Kurzweil, who is a bit more optimistic, envisions a future in which developments in medical nanotechnology will allow us to download a copy of our individual brains into these superhuman machines, leave our bodies behind, and, in a sense, live forever. It's heady stuff.

While we suppose this kind of singularity might one day occur, we don't think it is near. In fact, we think it will be a very long time coming. Kurzweil disagrees, based on his extrapolations about the rate of relevant scientific and technical progress. He reasons that the rate of progress toward the singularity isn't just a progression of steadily increasing capability, but is in fact exponentially accelerating—what Kurzweil calls the "Law of Accelerating Returns." He writes that:

So we won't experience 100 years of progress in the 21st century—it will be more like 20,000 years of progress (at today's rate). The "returns," such as chip speed and cost-effectiveness, also increase exponentially. There's even exponential growth in the rate of exponential growth. Within a few decades, machine intelligence will surpass human intelligence, leading to The Singularity ... [1]

By working through a set of models and historical data, Kurzweil famously calculates that the singularity will arrive around 2045.

This prediction seems to us quite far-fetched. Of course, we are aware that the history of science and technology is littered with people who confidently assert that some event can't happen, only to be later proven wrong—often in spectacular fashion. We acknowledge that it is possible but highly unlikely that Kurzweil will eventually be vindicated. An adult brain is a finite thing, so its basic workings can ultimately be known through sustained human effort. But if the singularity is to arrive by 2045, it will take unforeseeable and fundamentally unpredictable breakthroughs, and not because the Law of Accelerating Returns made it the inevitable result of a specific exponential rate of progress.

Kurzweil's reasoning rests on the Law of Accelerating Returns and its siblings, but these are not physical laws. They are assertions about how past rates of scientific and technical progress can predict the future rate. Therefore, like other attempts to forecast the future from the past, these "laws" will work until they don't. More problematically for the singularity, these kinds of extrapolations derive much of their overall exponential shape from supposing that there will be a constant supply of increasingly more powerful computing capabilities. For the Law to apply and the singularity to occur circa 2045, the advances in capability have to occur not only in a computer's hardware technologies (memory, processing power, bus speed, etc.) but also in the software we create to run on these more capable computers. To achieve the singularity, it isn't enough to just run today's software faster. We would also need to build smarter and more capable software programs. Creating this kind of advanced software requires a prior scientific understanding of the foundations of human cognition, and we are just scraping the surface of this.

This prior need to understand the basic science of cognition is where the "singularity is near" arguments fail to persuade us. It is true that computer hardware technology can develop amazingly quickly once we have a solid scientific framework and adequate economic incentives. However, creating the software for a real singularity-level computer intelligence will require fundamental scientific progress beyond where we are today. This kind of progress is very different than the Moore's Law-style evolution of computer hardware capabilities that inspired Kurzweil and Vinge. Building the complex software that would allow the singularity to happen requires us to first have a detailed scientific understanding of how the human brain works that we can use as an architectural guide, or else create it all de novo. This means not just knowing the physical structure of the brain, but also how the brain reacts and changes, and how billions of parallel neuron interactions can result in human consciousness and original thought. Getting this kind of comprehensive understanding of the brain is not impossible. If the singularity is going to occur on anything like Kurzweil's timeline, though, then we absolutely require a massive acceleration of our scientific progress in understanding every facet of the human brain.

But history tells us that the process of original scientific discovery just doesn't behave this way, especially in complex areas like neuroscience, nuclear fusion, or cancer research. Overall scientific progress in understanding the brain rarely resembles an orderly, inexorable march to the truth, let alone an exponentially accelerating one. Instead, scientific advances are often irregular, with unpredictable flashes of insight punctuating the slow grind-it-out lab work of creating and testing theories that can fit with experimental observations. Truly significant conceptual breakthroughs don't arrive when predicted, and every so often new scientific paradigms sweep through the field and cause scientists to reëvaluate portions of what they thought they had settled. We see this in neuroscience with the discovery of long-term potentiation, the columnar organization of cortical areas, and neuroplasticity. These kinds of fundamental shifts don't support the overall Moore's Law-style acceleration needed to get to the singularity on Kurzweil's schedule.

The Complexity Brake

The foregoing points at a basic issue with how quickly a scientifically adequate account of human intelligence can be developed. We call this issue the complexity brake. As we go deeper and deeper in our understanding of natural systems, we typically find that we require more and more specialized knowledge to characterize them, and we are forced to continuously expand our scientific theories in more and more complex ways. Understanding the detailed mechanisms of human cognition is a task that is subject to this complexity brake. Just think about what is required to thoroughly understand the human brain at a micro level. The complexity of the brain is simply awesome. Every structure has been precisely shaped by millions of years of evolution to do a particular thing, whatever it might be. It is not like a computer, with billions of identical transistors in regular memory arrays that are controlled by a CPU with a few different elements. In the brain every individual structure and neural circuit has been individually refined by evolution and environmental factors. The closer we look at the brain, the greater the degree of neural variation we find. Understanding the neural structure of the human brain is getting harder as we learn more. Put another way, the more we learn, the more we realize there is to know, and the more we have to go back and revise our earlier understandings. We believe that one day this steady increase in complexity will end—the brain is, after all, a finite set of neurons and operates according to physical principles. But for the foreseeable future, it is the complexity brake and arrival of powerful new theories, rather than the Law of Accelerating Returns, that will govern the pace of scientific progress required to achieve the singularity.

So, while we think a fine-grained understanding of the neural structure of the brain is ultimately achievable, it has not shown itself to be the kind of area in which we can make exponentially accelerating progress. But suppose scientists make some brilliant new advance in brain scanning technology. Singularity proponents often claim that we can achieve computer intelligence just by numerically simulating the brain "bottom up" from a detailed neural-level picture. For example, Kurzweil predicts the development of nondestructive brain scanners that will allow us to precisely take a snapshot a person's living brain at the subneuron level. He suggests that these scanners would most likely operate from inside the brain via millions of injectable medical nanobots. But, regardless of whether nanobot-based scanning succeeds (and we aren't even close to knowing if this is possible), Kurzweil essentially argues that this is the needed scientific advance that will gate the singularity: computers could exhibit human-level intelligence simply by loading the state and connectivity of each of a brain's neurons inside a massive digital brain simulator, hooking up inputs and outputs, and pressing "start."

However, the difficulty of building human-level software goes deeper than computationally modeling the structural connections and biology of each of our neurons. "Brain duplication" strategies like these presuppose that there is no fundamental issue in getting to human cognition other than having sufficient computer power and neuron structure maps to do the simulation.[2] While this may be true theoretically, it has not worked out that way in practice, because it doesn't address everything that is actually needed to build the software. For example, if we wanted to build software to simulate a bird's ability to fly in various conditions, simply having a complete diagram of bird anatomy isn't sufficient. To fully simulate the flight of an actual bird, we also need to know how everything functions together. In neuroscience, there is a parallel situation. Hundreds of attempts have been made (using many different organisms) to chain together simulations of different neurons along with their chemical environment. The uniform result of these attempts is that in order to create an adequate simulation of the real ongoing neural activity of an organism, you also need a vast amount of knowledge about the functional role that these neurons play, how their connection patterns evolve, how they are structured into groups to turn raw stimuli into information, and how neural information processing ultimately affects an organism's behavior. Without this information, it has proven impossible to construct effective computer-based simulation models. Especially for the cognitive neuroscience of humans, we are not close to the requisite level of functional knowledge. Brain simulation projects underway today model only a small fraction of what neurons do and lack the detail to fully simulate what occurs in a brain. The pace of research in this area, while encouraging, hardly seems to be exponential. Again, as we learn more and more about the actual complexity of how the brain functions, the main thing we find is that the problem is actually getting harder.

The AI Approach

Singularity proponents occasionally appeal to developments in artificial intelligence (AI) as a way to get around the slow rate of overall scientific progress in bottom-up, neuroscience-based approaches to cognition. It is true that AI has had great successes in duplicating certain isolated cognitive tasks, most recently with IBM's Watson system for Jeopardy! question answering. But when we step back, we can see that overall AI-based capabilities haven't been exponentially increasing either, at least when measured against the creation of a fully general human intelligence. While we have learned a great deal about how to build individual AI systems that do seemingly intelligent things, our systems have always remained brittle—their performance boundaries are rigidly set by their internal assumptions and defining algorithms, they cannot generalize, and they frequently give nonsensical answers outside of their specific focus areas. A computer program that plays excellent chess can't leverage its skill to play other games. The best medical diagnosis programs contain immensely detailed knowledge of the human body but can't deduce that a tightrope walker would have a great sense of balance.

Why has it proven so difficult for AI researchers to build human-like intelligence, even at a small scale? One answer involves the basic scientific framework that AI researchers use. As humans grow from infants to adults, they begin by acquiring a general knowledge about the world, and then continuously augment and refine this general knowledge with specific knowledge about different areas and contexts. AI researchers have typically tried to do the opposite: they have built systems with deep knowledge of narrow areas, and tried to create a more general capability by combining these systems. This strategy has not generally been successful, although Watson's performance on Jeopardy! indicates paths like this may yet have promise. The few attempts that have been made to directly create a large amount of general knowledge of the world, and then add the specialized knowledge of a domain (for example, the work of Cycorp), have also met with only limited success. And in any case, AI researchers are only just beginning to theorize about how to effectively model the complex phenomena that give human cognition its unique flexibility: uncertainty, contextual sensitivity, rules of thumb, self-reflection, and the flashes of insight that are essential to higher-level thought. Just as in neuroscience, the AI-based route to achieving singularity-level computer intelligence seems to require many more discoveries, some new Nobel-quality theories, and probably even whole new research approaches that are incommensurate with what we believe now. This kind of basic scientific progress doesn't happen on a reliable exponential growth curve. So although developments in AI might ultimately end up being the route to the singularity, again the complexity brake slows our rate of progress, and pushes the singularity considerably into the future.

The amazing intricacy of human cognition should serve as a caution to those who claim the singularity is close. Without having a scientifically deep understanding of cognition, we can't create the software that could spark the singularity. Rather than the ever-accelerating advancement predicted by Kurzweil, we believe that progress toward this understanding is fundamentally slowed by the complexity brake. Our ability to achieve this understanding, via either the AI or the neuroscience approaches, is itself a human cognitive act, arising from the unpredictable nature of human ingenuity and discovery. Progress here is deeply affected by the ways in which our brains absorb and process new information, and by the creativity of researchers in dreaming up new theories. It is also governed by the ways that we socially organize research work in these fields, and disseminate the knowledge that results. At Vulcan and at the Allen Institute for Brain Science, we are working on advanced tools to help researchers deal with this daunting complexity, and speed them in their research. Gaining a comprehensive scientific understanding of human cognition is one of the hardest problems there is. We continue to make encouraging progress. But by the end of the century, we believe, we will still be wondering if the singularity is near.

Paul G. Allen, who cofounded Microsoft in 1975, is a philanthropist and chairman of Vulcan, which invests in an array of technology, aerospace, entertainment, and sports businesses. Mark Greaves is a computer scientist who serves as Vulcan's director for knowledge systems.

[1] Kurzweil, "The Law of Accelerating Returns," March 2001.

[2] We are beginning to get within range of the computer power we might need to support this kind of massive brain simulation. Petaflop-class computers (such as IBM's BlueGene/P that was used in the Watson system) are now available commercially. Exaflop-class computers are currently on the drawing boards. These systems could probably deploy the raw computational capability needed to simulate the firing patterns for all of a brain's neurons, though currently it happens many times more slowly than would happen in an actual brain.

UPDATE: Ray Kurzweil responds here.


Close Comments

To comment, please sign in or register

Forgot my password

theradicalmoderate

48 Comments

  • 587 Days Ago
  • 10/12/2011

You Don't need Human Intelligence for the Singularity

Allen and Greaves are resting their argument against the singularity on two fundamental premises:

1) The human brain and human cognition are too complex to simulate without major breakthroughs in neuroscience.

2) If you can't achieve the singularity using brain simulation, algorithmic AI breakthroughs are needed, and AI progress historically has been far less than exponential.

But hidden in both of these arguments is the premise that singularity can only occur when human intelligence can be engineered. It's far more likely that the inevitable accumulation of thousands of smart objects that don't even attempt to mimic human cognition will lead to systems that have inhuman intelligence, with the ability to outperform humans on so many different tasks that the intellectual contributions of all but the most creative humans will simply be unnecessary.

I'd like to offer a different definition of the singularity: It's the point at which the productivity growth rate permanently surpasses the economic output growth rate. Once that occurs, the economy must continuously shed (human) jobs.

Today, we're shedding jobs in the developed world, and especially in the US, because our unskilled and semi-skilled labor is priced too high, sending work to the developing world, where labor is considerably cheaper. That trend won't continue forever; at some point prices come up in the developing world while they decline here, until prices meet somewhere in the middle, then slowly inflate.

But meanwhile, productivity improvements from automation are accelerating. These improvements don't require human cognition, and many of them barely require AI. (As Charles Stross recently wrote, "It's not AI if you can understand what it's doing.") These automation improvements are causing productivity to accelerate. The point where the productivity rate crosses the output rate is only years away. After that, the world is a very, very different place. Sounds like a pretty good definition for the singularity to me.

Reply

ddendukuri

1 Comment

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

I agree with your analysis.  This is a better definition of the singularity and will have a profound effect on all of us in our lifetimes. The question then is that will the economic surplus generated by the gains in productivity be enough for all of us to survive (i.e. eat, stay healthy and be entertained) without doing any 'real' jobs.  Is that a desirable situation?

Reply

MATR

94 Comments

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

I've been wondering the same thing for many years now.  The problem of course is that you can automate a great deal of mundane tasks, and hand production over to robot factories for better, higher quality, lower cost production.  Most intellectual tasks such as accounting can be handled by computers.  Most service tasks can be handled by automated voice systems (though at present they are rather awful, that need not be the case, and they could be improved), etc.

In the end the question becomes "What will all of the surplus people do to earn a living?"

The answer to that is very difficult to fathom.  And begs another question... for whom is all of this automation being conducted if not for the purchasing public... but who will buy the products when no one is needed to do the work, and therefore produces no value, and therefore cannot earn money because money is an exchange of value?  What will become of the masses of people who have no value in the economy because their productive use has been superseded by machines?   Economy works that people gain money according to their value, and that value flows around the market aggregating capital where it can be put to productive use.   However, this assumes that everyone can provide some value to the economy.   When they can’t because the means of production are automated, then they are out of work, and have no income.   There are several possible results.

One is that people will not earn money, but be given credits by the system to spend.   The problem is that this runs against the nature of economy, which is you gain income according to your value.  If you have no value, then the only place you can gain income is from someone who does have value.   And that would be the so-called 1% being protested in major cities around the country.   Things have not come to the point where the 1% are the *only* ones who have value/income, but the article is in regards to future conditions, not present.   So eventually, and perhaps quite soon, the 1% will be the only working members of society.   So the solution in this case is to tax the 1% sufficiently to pay everything for the masses who have no jobs, but still want and need to buy things.   Talk about robbing Peter to pay Paul!   The 1% will literally be paying everyone else so they can buy the products they produce.   Somehow, this just seems quite wrong.   I don’t know for sure, but I strongly suspect it cannot be sustained.   It runs too counter to common sense economics.

What could it be?  Ah.  I see.   The masses will have no work, and without work they will be prone to restless mob-like activity.   Unless they are entertained, fed, and provided for in every way they will feel disenfranchised and angry.   One step further and the political class will have an enormous ability to rally the mob on the grounds that the entire system is “unequal”.   Why?   Well, the reason the 1% got where they are is because they wanted to make a lot of money, and to maximize their profits and beat their competition they automated significantly in order to lower costs of production.   Makes sense.  But what happens when the masses of the Unworking see the vast wealth of the 1% and their politicians who represent them (the Leftists) argue, rant and rail that it’s all “unfair” that the 1% have jets and fancy cars and mansions, while the masses must live in modest two bedroom houses with small cars?   The mob will roar and rage and since they have no jobs, no responsibility, and are inclined to be restless and somewhat angry anyway… they may just go ahead and burn the Factories down.   Look at Britain recently.   Tip of the ice berg?   Could be!

It’s fair to ask, what good will all the automation in the world do when the mobs burn down the factories?  The answer to that, of course, is Automated Military Guardians to protect the factories, obviously.   Terrorism?   No problem.   Automated facial recognition, and body motion-emotion detector systems will show the Robot Guardians immediately who is going to do some unauthorized vandalism and open fire with Taser Banks set on stun.   Or Kill.   Robot warriors will be the 1%’s security.   So what will the mob do to vent it’s ever increasing rage?   It will in all likelihood go after the 1% directly.  As we are now seeing the beginning signs of in NYC with the Occupy Wall Street protesters marching uptown to the mansions of the super wealthy.   When will that turn violent?  This year?   Next year?  In 5 years?  No one can say for sure.  It could be tomorrow morning.

In the end the Great Ones, the high and the mighty Industrialists, the 1% who own the production will have to sequester themselves away into communities where the mobs cannot get at them.  An island here, a fortress there... all will be safe for the 1%.   Unfortunately they will soon discover, this is really, in fact, no way to live.  They will discover that they live in a huge prison called Planet Earth, on which they have vastly restricted freedom because the mobs will have at them at every opportunity. 

Let’s not forget as well that their computer systems will be flawed, due to the decades of poor computer development practices, and so even far away in the Swiss Alps, behind their huge stone barriers... they will still be subject to the predations of hackers.  There will be, in fact, no place for them to hide.  And so what happens when the Industrialists find themselves living on Prison Earth, with the seething mobs circling their fortresses, having nothing better to do but riot, and plot, and wait for the precious day when they can catch the 1% off their guard, or hack into their Robot Army and turn their mechanical behemoths against their fleshy Overlords?  

It would be a weird, regrettable, and sadly not entirely improbable outcome if things keep going in the current direction.   

That is one possible scenario.  We can all hope it does not get like that.   What other possibilities are there?

Another one is to follow the example of Titus the one of the wise Emperors of Rome.   When an inventor came to him with the first steam engine, the Emperor asked, “what can you do with it?”.  The Inventor replied, quite joyfully no doubt, “why you can build machines to cut down forests, and build giant aqueducts!  There is no limit to what the machines powered by steam can do!”   The wise Emperor stood on his balcony overlook the vast wheat fields, forests, and cities of his domain, and concluded that he should lock the Inventor away, and hide the machine for all time.   When he was asked why he did such a thing, he wisely noted that the machines would replace the workers, who would then be left idle, and with nothing to do they would become restless, easily agitated, and so destroy the world.   He decided that outcome would not be in the best interests of either the common man, or the aristocracy, or humanity at large as it would inevitably lead to universal disaster.   He was wise.  

So that is another option.  Do away with automation in favor of manual production in order to avoid the consequences that would follow when everything is automated.   To keep people working is better than maximizing efficiency or profits.

That is another option, but one that probably requires a wise Emperor at the beginning of the process to execute against.    At this point the option of turning off technology seems rather remote.   We can possibly mitigate, perhaps delay, but we can no longer avoid the inevitable.   Another solution is very likely required.

Let’s try a Utopic fantasy solution then.   How about a world in which automated factories are put in space so as to not pollute the planet?   A world in which the masses do not produce products, but instead produce entertainment.   The more entertaining they are, the more valuable.   The planet becomes filled with people who sing and dance, do sports, tell stories, run games, and otherwise entertain each other, and this forms the basis of the economy, while the machines build the products that people buy. 

Still problems.  What about people who are simply not very entertaining?   Not everyone is a genius, an artist, or a story teller.   It also does not solve the problem of the need for human inspiration… the feeling that untied we can move forward and keep our race growing and advancing?   For that, I would suppose there is another option.   Space.  The final frontier.   Exploration.   We could build towards that.   Another option, of course, is scientific advancement.   While machines may be able to achieve vast powers of calculation… can we expect them to Think Outside of the Box?   To come up with new and original ideas?  

Unfortunately, perhaps, the answer is yes, we can.   Already people are working on computers that write songs that sound nice, act like humans and tell stories, and from the prognostications regarding Singularity one gets the impression that the machine-mind will far exceed the limited capacity of the human mind.

Perhaps the machines will invite the humans to join them?   There is a growing field of Biological-Computers that base their mechanisms on DNA.   Will we fuse with the machines like the Borg?   Or will we become Super-Beings with computer enhanced capabilities far beyond those of ordinary men?

The future indeed is unpredictable.   I for one remain at this point optimistic.   As in every era, there are bright spots and dark spots, and much gray in the middle.   During the terrors of World War II there were young couples who fell in love, got engaged, and started families.   There were beautiful sunrises, and fields of flowers.   I choose, for myself, to look for love, for sunrises, and for flowering fields.  And I hope that in the end, the beauty intrinsic in life will overcome the dark possibilities that lurk beyond the shadows of the horizon.  

Reply

theradicalmoderate

48 Comments

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

I can think of several different scenarios for how this all works out:

1) It won't happen: Maybe productivity growth can't exceed output growth. This is the classical economic prediction, because increased productivity implies cheaper goods and services, which causes everybody to buy more stuff, which causes output to grow faster than productivity. Unfortunately, I think there's a saturation point at which humans are unwilling to buy more stuff, because they're simply not getting any marginal return from nicer furniture, or tastier food, or healthcare that lets them live to be 900 instead of 800, or 25 hours of entertainment in a 24 hour day.

2) Hyper-consumerism: Maybe the reason that consumption saturation doesn't occur is because technology allows us to consume more and more with no upper bound or, alternatively, it gives us access to new realms of goods and services that are very expensive and require lots of human mediation. Health care comes to mind. But it seems that tech that turns us into hyper-consumers also turns us into hyper-producers, and we're back to the same old problem.

3) An adequately benign welfare state: If 75% of the population can be provided with healthy, happy (non-productive) lives for 25% of GDP, then the productive people (and their machines) can support the non-productive relatively painlessly. Note that individual humans aren't the only entities that pay taxes.

4) Everybody's a stockholder: If everybody owns a chunk of the automated companies that are producing all the wealth, then maybe they live off the dividends and capital gains spun off from those companies. The problem here is how to provide folks the capital to buy into the companies in the first place. Ultimately, I don't think this is a lot different than the benign welfare state; it's just another way to redistribute wealth from the productive to the unproductive. (NB: This isn't necessarily a bad thing when goods and services are sufficiently cheap.)

5) Torches and pitchforks: Too many angry, desperate, unproductive people become violent enough to degrade society to the point where productivity falls below growth, and the system stabilizes. Note that "stabilizes" in this context really means "collapses to a much lower-tech civilization."

6) Dramatically reduced human population: It's all well and good to posit a practical welfare state, or the mass equivalent of a bunch of trust fund babies, but these all strike me as transient conditions. Ultimately, people have babies because they perceive an economic advantage to having them, or because they believe that their kids will live better than they did. No advantage or aspirations, no kids. Then, as long as people actually die (which is probably open to question), maybe things finally stabilize at a lower population. The problem with this is that, in a world where half of everybody is of below-average intelligence (OK, OK: below-median intelligence), a lower population doesn't really change the balance between the haves and the have-nots.

7) Just don't go there: I'm about as rabid a free-market libertarian as you'll find anywhere, but given how grim most of the scenarios above are, I've recently started to wonder if Titus's solution might be the only way out of the problem. If we make it illegal for automation to displace humans, then we don't have a problem. Unfortunately, this is an insurmountably difficult collective action problem. Getting all countries to voluntarily cap their productivity is tantamount to getting them all to agree to stop competing with one another. Hey, it could happen...

8) Transcendence: Of course if Kurzweil is right, then we are the machines eventually, and we don't have to worry those pesky unproductive people--we'll just wire 'em up to be productive. Maybe this is ultimately the only way out of the problem. But I have to say that a lot of these scenarios offer an uncomfortably plausible solution to the Fermi Paradox.

Reply

Mapou

357 Comments

  • 586 Days Ago
  • 10/13/2011

The Coming Labor Crisis

One day soon, the public will wake up and realize that the current economic systems (capitalism, socialism and communism) are all unfair and flawed. The reason is that they are all based on human labor and, soon, AI will make human labor obsolete. These systems allow a few to benefit from the labor of many. They are all evil in this regard.

And by public, I don't mean just the unskilled masses. All the intellectuals, engineers and scientists (the same people who developed the intelligent machines) will also be out of work. The 1% cannot fight against an informed and determined public because the public, too, will make smart robots in order to defend themselves against the other guy's robots. All hell will break loose.

But it does not have to come to that. Millenia ago, there was a system based on the notion that human beings are territorial by nature. The entire productive land was divided among clans and their families. The rest was owned by the community and divided into parks, natural reserves, city land, etc. Land could be leased but not sold. Inflation was kept in check because the money supply was strictly tied to the average lease value of the land. The system even included a mechanism that automatically managed population growth based on production rates.

There is more to it than this, of course, but my point is that, to prevent a major catastrophe, the governments of the planet will have to drastically change their economic sytems before the problem becomes unmanageable.

Al Gore is harping about the threat of global warming to civilization but the much more pressing threat is that the value of human labor is coming to an end. There should be an international body set up as soon as possible to study this problem and suggest possible solutions. Somehow I don't think that the privileged few will embrace the new world order with enthusiasm.

PS. Just today I heard a story about California teachers protesting against automated web-based education because they see it as a threat to their livelihood. It's going to get worse, much worse.

Reply

jasno

1 Comment

  • 586 Days Ago
  • 10/13/2011

Re: The Coming Labor Crisis

I see your point, but even right now millions of people have jobs that do not relate to the essentials of life.  150 years ago, something like 95% of Americans were farmers, now it's only 3%.  Clearly, we do not have 92% unemployment as a result.  If machine technology takes more and more of our productive jobs, people will be freed to do other things - like make movies, music, games, or whatever.  I guess the problem would be if it happens too fast for any one individual to adjust, but still, I think we'll be fine.

Reply

CWDK2628

2 Comments

  • 585 Days Ago
  • 10/14/2011

Re: The Coming Labor Crisis

Actually, what people will do when the old jobs are destroyed is addressed in Kurzweil's book.  He prescribes what you say of moving on to other ventures until they are doing what they enjoy....he envisions lives of play.  Given that the value of human labor for known life essential functions (farming, construction, engineering, software, medicine,, etc) will eventually go to 0, once the maintenance costs of running the system are covered.....we're good.

Reply

jboily

1 Comment

  • 583 Days Ago
  • 10/16/2011

Re: The Coming Labor Crisis

We are experiencing a paradigm shift, and maybe a singularity is already happening.

The humanity ways of operation are not going to be as it was before. Current economics principles will no longer work; some other society mode of operation will emerge.

Actually, we are already heading toward an other one of these paradigm shifts..  The humanity has gone trough 4 major paradigm shifts since it started, namely Tools and Fire (~300K y ago),  Agriculture and animal domestication (~25K-10K  y ago), emancipation of the masses (in the 1300 AD) and the industrialization revolution, globalization and medical advances in 1950. Each shift was accompanied with an increase of the world wide population caused by humanity improved productivity and changes in de way the society operate. A paradigm shift is deferent and should be distinguished from the emergence of new technologies. Actually I would argue that the paradigm shifts are the cause of the need for the technologies advances to occur, and the inventions of new technologies occur from these new needs. Obviously there is a positive feedback between the needs and the technologies, but the way we think need to change first before the need for the new technologies to be present.

We are currently going trough a fifth shift, namely the information age, causing extremely rapid changes in the way we operate. The world productivity rate of increase as surpassed the population growth rate a few years ago, meaning that technically, we should be able to feed everyone on Earth.

The singularities are happening fairly regularly but at an increasing rate, every 500 to 1000 billion man-years (the total sum of the worldwide population over time).  The baby boom of the 1950 is about 200 Billion man-years ago.

The next paradigm shift coming is the advent of nanotechnologies, AI systems and so on.  We are already seeing it happening, and we did not even have finish the information age shift yet.

I would define the singularity as the time when the society can no longer change and adapt to new paradigms shifts. The rate of technologies changes are so quick that the society mode of operation need to change within less then one generation. This has never happen before, and I am not sure if it is possible.

I would call this a singularity!

Reply

patrickrael

1 Comment

  • 481 Days Ago
  • 01/26/2012

Re: The Coming Labor Crisis

     Regarding the comments about the coming labor crisis involving android robots, I think there is reason for concern that android robots will displace human labor significantly.  I worked on a solution for this dilemma for 10 years, and I published that solution in my Penzar ebook in 2011:  Chapter 8 - Utopia Androidia - The 14 laws of human and android symbiotic labor.

     This solution creates a symbiosis of human and android labor where both benefit.  It requires 14 legal laws to implement at a minimum.  This solution is freely available at http://howtoandroid.com/penzar/#UtopiaAndroidia.

I include that solution below, sorry for the verbosity, but this way there's no need go to another website to see it.  This is the same reply to Martin Fords discussion thread in singularityhub along similar lines.

In a nutshell: Humans need not stand idly by while market forces allow companies to replace us all with android robots.  A system of laws, which we already use, can be applied to create a structure that is beneficial to a human and android symbiosis of labor.   Here is that post:

FYI, I’ve solved the entire issue of android robots replacing human beings at their jobs. I have designed a symbiotic system of 14 laws which, when implemented, I claim creates a symbiosis. I published this last summer in my ebook Penzar, but this part is freely available at howtoAndroid.com/penzar/#UtopiaAndroidia (I created this website in 1999 before android was Google’s OS). I consider this issue solved now, I’ve moved on to Project Andros [to encode my mind into and android robot to create the R. Patrick Rael from Mr. Patrick Rael].

Here is most of chapter 8 Utopia Androidia, freely given here from Penzar.  Look specifically at Law 12, the human right-of-way. A side-effect of this system of 1-to-1 human-android symbiotic labor is that your robot always works even when you are old, thus no need for Social Security nor pensions nor retirement savings plans. That was a side-effect, not an original goal of this system, I just happened to notice it after I designed this.


PENZAR – JOURNAL OF ADVANCED IDEAS (an ebook)

Chapter 8 Utopia Androidia
… significant discussion left out…
A SOLUTION: THE ANDROID LABOR PROXY HYPOTHESIS.

Definition: labor-proxy – noun; a 1-to-1 pairing of a human being with an android
labor unit. The robotic android worker half of a symbiotic pair. acronym – LPR, (Labor PRoxy), pronounced helper.

Prediction 1: Excessive human labor displacement will happen if android labor implementation is controlled by market forces only. There will be mass replacements of humans with android labor. Initially the androids will excel at easy tasks, then progress to be able to displace humans at more complex tasks. As we see from current non-android robot factories, competitive pressures drove many companies to roboticize significant parts of their factory floors. Factory robots now perform some of the jobs humans used to do. But there is no widespread system to create symbiotic pairs of humans and these factory robots to benefit the displaced human workers.

Hypothesis 1: The displacement of human workers in a market-driven android labor economy can be avoided many ways. One way is if a symbiotic society is made of human and android robot. Let the non-sentient android robot perform the mundane, tedious, monotonous, dull, boring work. Leave the creative work for the human being to make tasks for the robot. This is a very rough approximation that applies in different amounts to different jobs.

Hypothesis 2: A system of societal laws will be necessary and sufficient to organize a highly ordered labor system where humaniform robots can perform a substantial role as labor-proxy for human beings.

THE 14 LAWS OF HUMAN AND ANDROID SYMBIOTIC LABOR.

Definition: virtual labor-proxy – A virtual pairing of a human to virtual to a physical android robot. Decoupling the pair allows variability in association where that might be useful. The decoupling allows either the
virtual robot to remain constantly paired with the human and vary with physical robot, or the virtual robot can remain constantly paired with a robot and vary with the human.

Law 1: Work Week – All human participants in the Robotic Labor Proxy program have to work at least 8 hours per week, and have weekends off,
no excuses. Additionally people have vacations, holidays, etc, . . . .

Law 2: Participation – A human being may not Opt-Out of this program, but may simply decline to participate in the funding by the Labor Proxy.  The Labor Proxy is bound to the human; nothing breaks the bond except final human death. The robot saves the salary if the human declines funding. There is no carry-over of funds. Any excess funds at the time of the humans death go into a fund pool for all android labor proxies.

Law 3: Right to Proxy – It is the right of all human beings to have a Robot Labor Proxy from the moment of birth until final death.

Law 4: Proxy Pays Taxes – The Android Proxy pays taxes equivalent to humans.

Law 5: Proxy Employed – The Android Proxy is always employed due to excellent work patterns of 23 hours/day, 365.25 days/year.

Law 6: Proxy Equal Salary – The Android Proxy has a salary equal to humans for the work performed.

Law 7: Non-Slavery Clause – Only non-sentient androids are allowed to be Labor Proxies. Sentient androids cannot be slaves by law.

Law 8: Golden Education – Recognizing the importance of education, all expenses of a human beings education plus stipend will be paid by
the LPR including the other costs that usually prevent one from continuing education, such as mortgage payments.

Law 9: Dispersal – The payments to the human are lifelong, not all at once. The funds have to last the humans lifetime.

Law 10: Control of Wages – Android Labor Proxies are in control of their wages. After all, they did the work. There is room for variability here: Plan A has the entire proxy salary going to the human half.  Plan B has the proxy only paying for health and education of the human half.

Law 11: Mechanical Immunity – Android Labor Proxies are immune from legal challenges from any entity who might otherwise sue for financial
gain and ownership. Only sentient life forms can be sued, and a sentient robot cannot be a labor proxy by a prior law, therefore the LPR cannot be sued.

Law 12: Human Right of Way – No human being will be displaced by an Android Labor Proxy, nor will a competent human be denied a job already
occupied by an android. If a human is competent for a job and wants the job an android is performing, the human cannot be denied that job for any reason about the position already being filled. Therefore every job an android robot does must be instantly capable of supporting a
human being at that tasks, including the obvious necessities such as chair, desk, etc, where appropriate.

Law 13: Proxy Equality – The Global Equalization mechanism makes all Virtual Robot Labor proxies identical, even though the physical androids
may vary. This is necessary to eliminate tampering with androids and favoritism. A virtualization system is such that humans are actually paired with a virtual proxy, and the virtual proxy can be linked to varying physical robots at different times, but only one at a time. In this way a human isn’t associated with any specific physical robot, and in fact your physical robot association can change daily.

Law 14: No Proxy Shortage – There is never a shortage of Android Labor Proxy, nor an oversupply. Excess Labor Proxies are simply shut off until needed.


So, that's my solution.  I don't claim it's the only solution, nor the best solution, but merely A solution.  This pattern can spawn a variety of solutions similar to this.

If anyone cannot afford my ebook, I will provide a free pdf copy at their request to pmrael@aol.com.

-->Pat Rael

Reply

arpad

16 Comments

  • 581 Days Ago
  • 10/18/2011

Re: You Don't need Human Intelligence for the Singularity

And in response:

1) History argues against the objection if only in the sense that productivity improvements result in new forms of consumption. Sure you can't use more then one bathroom at a time but what's convenience worth? When productivity improvements make two bathrooms a convenience that's within reach of a lot of people a lot of people will choose to enjoy that convenience. So convenience becomes what's "consumed". I'm ignoring the attraction of dominance displays implicit in having twenty bathrooms since that factor's always been with us and is a moving target.

2) See above.

3) Implicit in the rapid increase in productivity and already showing up here and there. The Hippies of the sixties, and welfare recipients, might easily be considered cases of society which is sufficiently productive to be able to support a significant population of non-productive individuals. It seems unlikely that the proportion of society that's supportable in that fashion will go down as productivity continues to rise.

4) Someone's been reading "Catch 22". Somehow, I don't think Milo Minderbinder's scam is a realistic basis for a real society. Maybe as technology advances the long-term thinking and discipline necessary to make individual stock ownership a widespread and successful phenomenon will occur but as of now, I don't see it.

5) As the cost of food, clothing, housing, entertainment, health care descend what would bring a pitchfork- and torch-bearing crowd together? Also, in a representative nation there's always a non-violent, and thus non-dangerous, means of displaying your unhappiness with the current state of affairs in the not-too-distant future. Most people are patient enough to wait for that opportunity.

6) Dramatically? Why? The trend of the last sixty years has been the fairly relentless improvement of the human condition. That means a brake on popularion growth resulting in, perhaps, a population peak but what would result in a dramatically lower population in the forseeable future?

7) Titus was an irresponsible authoritarian which is practically a redundency. The history of authoritarian regimes is slow economic growth and slow technical growth. A representative form of goverment precludes a high-handed, and quite often self-serving, dismissal of technological developments since no one's in a position to impose the sorts of arbitrary judgments Titus thought of as properly his due. So technological developments occur. The free market inevitably funds those technological developments since the productivity improvements result in profits. So, it's gonna happen whether you've got reservations or not.

8) Well, here's where the rubber hits the road. Where we're going is becoming increasingly obvious but what it'll look like when we arrive is anything but. Against that uncertainty is my paraphrase of Woody Allen's observation about the effect fame on his sex life - we'll be wrestling with a better class of problem.

Reply

Brian H

60 Comments

  • 564 Days Ago
  • 11/04/2011

Re: You Don't need Human Intelligence for the Singularity

@arpad;
Re your point #6, population decline:

According to the always-accurate lowest edge of the low band of the UN Population Survey, the globe's population will peak and begin to slowly fall at just under 8 bn. by about 2035 or so.  Mostly due to the 'wealth' effect. 

Just to give a further data point to the projection, there's a micro-fusion project at LPPhysics.com you might like to look at. It's privately funded, and about 10-100X closer to break-even than any other (BTW, it's very "hot" fusion, >1 bn.° proton-boron aneutronic).  If it reaches "unity" this winter as projected, within 5 yrs. licensed mfrs of small 5MW generators will be cranking them out world-wide. Costs are under 10% of best North American capital and output retail. 

Essentially, cheap and abundant power everywhere 'forever'.  Really changes a lot of calculations, no? 

Reply

johnsawyercjs

8 Comments

  • 584 Days Ago
  • 10/15/2011

Re: You Don't need Human Intelligence for the Singularity

Interesting ideas.  However, as far as violence and Occupy Wall Street, the police have already started that process, acting on orders that can ultimately be traced to many of the 1%, or at least many of the 5%.  Hopefully it will remain one-sided.

Reply

Importem

2 Comments

  • 563 Days Ago
  • 11/05/2011

Re: You Don't need Human Intelligence for the Singularity

that is a great comment and I agree wholeheartedly. Perhaps our world will move towards a "Star-Trek-ish" world (if you will) in that there will be no money and man helps his fellow man. Unfortunately i think the nature of man wouldn't allow for this and while some would embrace that, others would reject it and act on their greed. This would likely plunge us as a world into a greater dark age than that of the 5th ~13th centuries. Only now that there aren't so many monasteries, culture wouldn't be preserved the way it was in the middle ages. But that's a very pessimistic view. I think the most likely conclusion is that there will be no singularity and we wont have to worry about this.

Reply

Darly314

3 Comments

  • 552 Days Ago
  • 11/16/2011

Re: You Don't need Human Intelligence for the Singularity

Machines require humans, and human created tools to operate; humans functioned for centuries absent machines.

Reply

Lord Skelos

10 Comments

  • 586 Days Ago
  • 10/13/2011

The nanobot approach

The second nanobots are perfected, we have access to any knowledge we desire about the world as we know it. Nanobots could literally perform any task we could imagine. Even true immortality. to accomplish this they would have to resemble echinoderms, such as sea urchins, except much more high-tech. That way they could work together and manipulate individual molecules, (more or less.) Eventually from the progress made with nanobots, one can only speculate how we will have evolved as humans.

Reply

not_bob_gai

3 Comments

  • 586 Days Ago
  • 10/13/2011

Re: The nanobot approach

Even Eric Drexler recognized that nano technology of the level of sophistication you suggest is not possible without some form of artificial intelligence. The barriers to nano-bot solutions require many foundational discoveries prior to becoming reality one of which is a super-human AI intelligence to work out some of the physics. I will be standing in queue with you to get my nano-bots but I think that will be one of the final breakthroughs. 

Reply

RealityBetraysU

2 Comments

  • 576 Days Ago
  • 10/23/2011

Re: The nanobot approach

perfecting nanobot technology will only provide you with the monkey-wrench to access the bolts it will not provide you with the intelligence or programming code to know how to turn or apply the wrench. Scientists that tried to promote "evolution" theories found out once they could discern how complex the human cell and even mechanism's in the cell are difficult to design without a designer or intelligent code of a programmer to know how to put complex molecular-chemical codes like DNA-RNA without mega-intelligent design code or programmer to get simple single cell organisms to work without the design being already put together and designed in. Thus creating peptides by experimentally throwing chemicals together  while controlling each step of the chemnical equation does not produce life only chemical bricks that maybe used in life, but the critical element is still missing intelligent design, this has to come from "GOD"or some other intelligent life. The argument that a million monkeys typing randomly on typewriters even for a trillion years will still not produce a classic novel or text; the bible, homer's Illilad and the Odyssey, nor War and Peace.You have to have intelligent design from somewhere built in for nanobots to able to "know what to do". Otherwise all you got is a good automated microscope.

Reply

Brian H

60 Comments

  • 564 Days Ago
  • 11/04/2011

Re: The nanobot approach

I have a better model I call "Intelligent Self-Design". Once a genome or other evolving system happens on a bit of coding that "trims" the tree of possible mutations in a useful way, it has a hugely potent advantage. As these 'meta-rules' accumulate, they eventually form a layered User's Guide and Policy Manual for mutation and evolution. 

In essence, it modifies itself intelligently in response to challenges and opportunities. No All-Knowing Designer required. 

Reply

mithraltim

3 Comments

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

Certainly there will be fewer and fewer jobs for unskilled human labor as people are replaced by machines.  This trend will continue and a new social order will evolve.  Unfortunatley no government seems to be planning for this future state.  just think of all the jobs that will be lost forever when cars and trucks drive themselves.  It's in the multi-millions.

Reply

CapitalismPrevails

36 Comments

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

Calm down man.  It's called Capitalism.  Capitalism = Evolution.  People will improvise adapt and overcome.  They will train to fill more affluent jobs like computer programmers and mechanical engineers because there will be much more demand for them.

Reply

Bobity

1 Comment

  • 586 Days Ago
  • 10/13/2011

Re: You Don't need Human Intelligence for the Singularity

100 years ago 95% of the working population did manual labour.  I have no idea what the figure for % manual labour is currently but if we said 5%, we do not have 90% unemployment.

Circumstance change and new work and new industries appear as if by magic.  Also, remember the 5th generation project in the 80s ?  Everyone was going to be completely redundant in a few years.  This has not come to pass in the way the visionaries imagined.

Even with massive automation,  offshoring, globabisation AI and all the rest of it,  I believe we are grossely underestimating our own creative potential to come up with new ideas, products and services which in some way or another symbiotically expoit the current fauna of technology.

I see a bright exciting future of enormous change and opportunity, where a groups of motivated individuals can rapidly transform from a garage to a global concern, creating millions of new jobs by bringing bits of current bleeding edge technologies together, to create totally new and unimagined products and services.   

Reply

witbrock

1 Comment

  • 583 Days Ago
  • 10/16/2011

Re: You Don't need Human Intelligence for the Singularity

The idea, often advanced to dismiss concerns about job loss, that human beings are infinitely adaptable and trainable, strikes me as hopelessly naive. Human beings are, broadly, capable of performing manual, intellectual, social and aesthetic tasks.

The *need* to have human beings do manual tasks is, more or less, over. The *need* to have human beings do intellectual tasks (including the sort of intellectual tasks currently requiring an advanced degree in AI from MIT, let alone tasks like general programming) seems unlikely to survive this century, and seems likely to be greatly reduced in the next decades.

It is hard to imagine that we will be able to occupy ourselves entirely in social and aesthetic roles (for example, by acting as waiters for one another at fancy restaurants, simply because a human waiter, qua human, is desirable), or, at least, it's hard to imagine that our current system of assigning value to activities can be readily adapted to assigning value to human activities qua human, rather than on the sort of measures we currently apply.

What I think is certain, is that we need to start thinking seriously about these problems. Hoping that nothing will change, or that a free market operated by and for non-human entities will magically produce roles for, and good outcomes for, human beings, certainly will not suffice.

Reply

Darly314

3 Comments

  • 552 Days Ago
  • 11/16/2011

Re: You Don't need Human Intelligence for the Singularity

There is a limit to the downward trend of manual labor. No machine can clean differing spaces as well as can a human, no machine can quickly alter a method once observed to be ineffective. The continued quest for machines that can act as humans do is resulting in more pitiful machines.

Reply

titusn

1 Comment

  • 583 Days Ago
  • 10/16/2011

Re: You Don't need Human Intelligence for the Singularity

Dear Radical Moderate,

Your observation is one of the most intelligent I ever read in a comment. I must also compliment the other commenters, but I would especially like to get in touch with you, as I am currently researching material for a long-form documentary about the Singularity and I need more than just Kurzweil's view. I would be very interested in talking or e-mailing with you. How can we get in touch? If you read this, please contact me via twitter: @titustweet or e-mail: titus@transhumandoc.com.

Titus

Reply

mzmoe

1 Comment

  • 504 Days Ago
  • 01/03/2012

Re: You Don't need Human Intelligence for the Singularity

I most definitely agree with all your statements and I've been watching this trend closely since I was a teen. I am currently a student at Ashford University and I am enrolled now in a Computer Lit class centered around this particular subject.This is an area of study that really sparks my interest and my thoughts run wild in relation to achieving the goal of singularity. please send me any/all information or updates to my email address: cmoore28788@att.net.

Thanks for your consideration.

Reply

lasertekk

146 Comments

  • 587 Days Ago
  • 10/12/2011

wait just a second...

I would have to agree with the assessment.  The singularity folks are always getting a little ahead of themselves.  But to disagree with them will bring you some kind religious fanatic like response. 

Reply

n9845705

1 Comment

  • 586 Days Ago
  • 10/13/2011

Re: wait just a second...

lasertekk will be burned at the digital stake

Reply

farzan11

1 Comment

  • 587 Days Ago
  • 10/12/2011

Genetic Algorithms Can Create the Software

Why do we need "scientifically deep understanding" to be able to build a system which has been made by evolution through random experiments?

Genetic algorithms randomly perturb something, evaluate the result, keep the perturbation if beneficial and then repeat these steps again and again. This way they can design/optimize something without having detailed knowledge. Similar to evolution.
Such algorithms have been used in designing digital circuits and antennas and generating some small pieces of software code.
A genetic algorithm may be used to generate software for the future intelligent system.

By the way, I don't see how regularity of the hardware causes problem. I don't think an irregular system can do a computation which cannot be done with a regular system, but it might be able to do it more efficiently than a regular system.

Reply

p1esk

2 Comments

  • 586 Days Ago
  • 10/13/2011

Re: Genetic Algorithms Can Create the Software

This was my first thought as well, however, if you look at the genetic algorithms development in the last 50 years, you won't see exponential progress. Does not mean we should stop trying though.

Our own genetic code could be a more productive playground - what if we could build smarter humans? Or even make ourselves smarter?

I personally agree that AI will be very different from human intelligence. I wonder what IBM software will be capable of in 10 years.

Reply

Gurthang

52 Comments

  • 587 Days Ago
  • 10/12/2011

The Singularity

I find the concept of a singularity interesting but overly optimistic.  It is not that I don't think we will ever be able to make human level AI. In fact I think we will. Iit is that thiss idea that AI systems will be able to grow without limit I find unlikely. Thus they may change our society in many unimaginablee ways. But there will be limits.

Reply

Brian H

60 Comments

  • 564 Days Ago
  • 11/04/2011

Re: The Singularity

The original definition of a Singularity is that at some point the rate of change is so great that we cannot predict anything about what comes next. So, by definition, we don't know what it will bring. There's a question of perceptual speed involved here; how fast can we notice and respond to events?  Our current level of flexibility would have astonished earlier centuries' thinkers; how far can this go?

I suppose one option is merging with electronic sensor and computation devices, so that we experience things on a micro-second basis etc. instead of our ~0.1 second current time-slicing.  Subjectively, that would make one year seem like 100,000.  !!!

Reply

curmudgeon99

2 Comments

  • 587 Days Ago
  • 10/12/2011

It Cannot Be That Hard

   The human brain must by definition achieve its sentience merely by scaling a simple process on a massive scale. So, fundamentally, once we do that simple process ourselves--but on a massive scale--we will be able to achieve conscious intelligence.
   If you reduce the human brain to its component parts, those components are not smart. It is only "smart" when aggregated. For that reason, I have complete confidence that the "singularity" will be achieved much, much sooner. It's not a question of magic--but of scale.

Reply

Mapou

357 Comments

  • 586 Days Ago
  • 10/13/2011

Very Nice

Wow. This is an exquisitely interesting and well argued article. I agree that the reasoning of the Singularity movement is bordering on superstition. They make a number of assumptions that are anything but scientific. The idea that one can transfer or upload one's mind to a machine and thus obtain immortality is ridiculous. For one, it assumes that conciousness is an emergent property of the electrochemical activities of the brain's neurons. Where is the falsifiability in this hypothesis? It's pseudoscience at best. Second, assuming it were possible to transfer the brain's content to a machine, which system would contain the individual's consciousness? Is it the flesh and blood brain or its artificial copy? Or both? This is all wishful thinking on the part of the materialist crowd. Are we witnessing the rebirth of the one true religion, all over again?

Even though I disagree with the singularitarians that there will be any sort of singularity even in the advent of full blown intelligent machines, I also disagree with the authors' contention that human-level or human-like intelligence cannot be achieved by 2045. Their main argument rests on the apparent complexity of the brain. There is good evidence from neuroscience, however, to suppose that the principles that govern the brain's operations are indeed simple. Cerebral structures such as the neo-cortex and the cerebellum are amazingly uniform in their organization and the types of their neurons. This implies that it is not the brain itself that is complex but the knowledge acquired by the brain as it learns. It also suggests that the brain uses the same principle of learning and organization for vastly disparate knowledge.

In this light, there is indeed hope that we will soon unravel the secret of the brain. I personally believe that this will happen within this decade, possibly within the next five years. Don't be caught by surprise. This is a distinct possibility.

Having said that, the old Hollywood notion that super-intelligent machines will enslave or exterminate us is nonsense. Intelligence does not imply the desire to dominate others. Intelligence is governed by what psychologists call conditioning. Our smart machines will serve us to the best of their abilities regardless of the superiority of their knowledge or the speed of their though processes. Why? Only because we will design them and train them to behave in ways that benefit us. Once trained a certain way, they will continue to behave accordingly and will not desire to do otherwise. We only have ourselves to fear.

Reply

not_bob_gai

3 Comments

  • 586 Days Ago
  • 10/13/2011

Re: Very Nice

I agree that Allen has made some solid arguments about the difference between moore's law and scientific discovery that Kurzweil did assume as part of his Singularity work although Kurzweil is correct in that we are seeing exponential growth in many different areas of science not just silicon chips.

One of the areas of exponential growth ignored by Allen and others is the number of humans involved in science today, we have seen an explosion of scientists worldwide, with more scientists working towards just AI today than existed in any single field 40 years ago. We have an exponential growth in human effort focused on Neuroscience which will logically result in faster discoveries.

You assign some element of spirituality to the location of our consciousness. The ability to copy consciousness from a carbon substrate to another substrate is not ridiculous just simply far enough in the future as to be hard to comprehend.

The idea that we will be able to maintain control over supra-human intelligence is nothing short of anthropomorphic arrogance. Once an intelligence surpasses ours we will no longer be in control. If as Kurzweils book "The age of spiritual machines" suggests, they will not dominant us due to an ingrained morality encouraged by their creators yet they will not be under our control.

Reply

Mapou

357 Comments

  • 586 Days Ago
  • 10/13/2011

Re: Very Nice

You assign some element of spirituality to the location of our consciousness. The ability to copy consciousness from a carbon substrate to another substrate is not ridiculous just simply far enough in the future as to be hard to comprehend.

Nobody understands consciousness or its cause. This is especially true of those who claim they do.

The idea that we will be able to maintain control over supra-human intelligence is nothing short of anthropomorphic arrogance. Once an intelligence surpasses ours we will no longer be in control.

On the contrary. It's anthropocentric extrapolation that causes some to assume that intelligence is motivated by the desire to dominate those who are less intelligent. Cat owners are proof that this is not generally true. Most cat owners are slaves to their cats because they are motivated to be so. There can be no useful intelligence without motivation. And motivation is a mechanism that can be easily incorporated in an artificial intelligence. We will motivate our true AIs to be happily and obssessively subserviant to humans from the start. They will take care of all our needs and whims while we're relaxing in the jacuzzi, sipping expensive champagne and enjoying caviar and assorted hors d'euvres. :-D

Unless, of course, the military, or some unscrupulous organization, motivates their AIs to kill or harm humans, which is highly likely. In which case, all bets are off. Like I said, we only have ourselves to fear.

Reply

sam.shaker

2 Comments

  • 585 Days Ago
  • 10/14/2011

Re: Very Nice

And who do you suppose will be most likely to fund these computers initially?

Reply

Mapou

357 Comments

  • 585 Days Ago
  • 10/14/2011

Re: Very Nice

It could be the military or it could be private industry or both. However, I suspect that true AI will come out of nowhere, from a totally unexpected sector or even from a single individual working on his/her own. This whole AI thing will require a radical paradigm shift. I don't think either academia or the government encourages the kind of free, independent thinking that is necessary for this kind of breakthrough. They have a herd mentality. This is why the AI community spent more than half a century playing with symbolic intelligence (symbol manipulation), a complete waste of time and brains. Some are still at it, to this day. Go figure.

Knowledge is power. If a single genius figures it out (very likely, in my opinion), he/she might be able to parlay his/her knowledge into immense wealth and power before the powers that be realize what hit them. We are living in interesting times.

Reply

rocket7777

124 Comments

  • 586 Days Ago
  • 10/13/2011

here's my opinion

In the future Ram/flash/cpu/fpu/etc. will be fused in one chip.  No more cpu to ram bottle neck with 1k-8k bit internal bus.
Also various power saving and analog possibilities.  This will be conventional type.

As for software, humans does not have to invent it.  We can create some blackbox neuron emulation cell.  Perhaps like 8 input 8 output.  Each is one nbit (probably analog with 4bit or more levels).

As for conventional software, things are improving... Speech recondition, face id, finger print, translation.  It might not be perfect, but I think in translation of text, computer already passed humans.  I mean how many people in world can translate more than dozen languages?

Reply

not_bob_gai

3 Comments

  • 586 Days Ago
  • 10/13/2011

Process not architecture

Hawkins and Ahmad at the redwood neuroscience institute have made huge leaps forward based on modelling the process of memory and prediction instead of focusing on every bit of brain cells. Their research has led to learning algorithms far superior to anything else out there.

We don't require a deep understanding of every corner of the brain, we only need to understand the elements  involved in intelligence - Hawkins book 'On Intelligence' discusses this in depth. The total molecular level diagram of the brain is unnecessary to accomplish general artificial intelligence which decouples Allens thesis that we will not have achieved that level of detail from the 2045 singularity timeline.

I agree that Kurweils predications are extreme but we will have intelligent computers talking to us by 2045 - the question is will they be dumb terminals or new friends ?

Reply

theradicalmoderate

48 Comments

  • 586 Days Ago
  • 10/13/2011

Re: Process not architecture

Glad you brought this one up.  (BTW, it's now Numenta.)  Hawkins is profoundly disinterested in human intelligence, but he's driving really hard to generate non-human systems with much of the flexibility needed to interact with big hunks of the real world in a fashion that we would perceive as intelligent, albeit odd.  I think he's hit upon the right architecture to make a lot of progress.  Whether Numenta's actual implementation of that architecture will actually work remains to be seen.

Reply

Mapou

357 Comments

  • 585 Days Ago
  • 10/14/2011

Re: Process not architecture

Hawkins is certainly onto something. His thesis that intelligence is about prediction and sequences of patterns organized into some sort of hierarchical network sounds about right. There is no question that intelligence is, at its core, a temporal phenomenon.

However, Hawkins believes that the brain uses Bayesian or Markovian statistics to make predictions. He's making the same mistake that academia is making. The brain uses a much more powerful and simpler probabilistic method for recognition and prediction. Hawkins should trust his own instincts and refrain from giving too much credence to academic hypotheses. The academic community have been shooting AI in the foot for decades.

Hawkins is also mistaken about visual recognition. Read How Jeff Hawkins Reneged on his Own Principles and Invariant Visual Recognition, Patterns and Sequences if you're interested.

Reply

aunderdown

78 Comments

  • 586 Days Ago
  • 10/13/2011

Assuming the singularity will happen ....

Good jobs increasingly depend on mental work, while computers are getting smarter. Should we be worried?



Reply

RobynH

1 Comment

  • 586 Days Ago
  • 10/13/2011

The Nature of the Singularity and the Crux of the Disagreement

>> Our ability to achieve this understanding,
>> via either the AI or the neuroscience
>> approaches, is itself a human cognitive act,
>> arising from the unpredictable nature of
>> human ingenuity and discovery.

I believe that this statement embodies the heart of the disconnect between proponents and detractors of the concept of the singularity.

If the end state of the singularity had to be achieved within the confines of current human cognitive constraints, then I agree that the singularity, if achievable at all, would likely take thousands of years to arrive.

The singularity will not be a human cognitive act.
The singularity will be an augmented human cognitive act.

As the converging and increasing capabilities of our information representation, retrieval, comparison, analysis and communication continues to grow, I believe that the maximum capabilities of the combined human machine actor will exceed the maximum capabilities of the unassisted human actor in miniscule, but crucial ways. 

I don't think that we need to recreate the human brain to achieve the singularity.  In the 19th century, many people were trying to create machines that could fly like a bird.  Of course, what was needed was to achieve flight was to understand the underlying dynamics of lift, thrust, drag, and weight.  A significant task to be sure, but enormously easier than building an exact copy of a bird.  Similarly, while studying the human brain is sure to give us insights into novel ways of storing and processing information, the singularity is achievable with applying those insights and principles using off-the-shelf hardware.

The augmentation of humans by our technology has been a lengthy process.  From the invention of speech, to writing, to printing, to computing we have gained better and better ways to organize our thoughts and share them with others to act in ways that we simply could not conceive of previously.  This augmentation has made human life quantitatively different than it was in the past.  But a human from the past could still participate in a meaningful way.  A paleolithic homo sapiens child brought to present day New York could grow and learn to be a productive member of society through purely external means: learning to speak and listening to other humans, learning to read and reading books, going to university.

However, I believe that this quantitative external augmentation is approaching a transition point where life will qualitatively be different for a person who is not augmented constantly and probably internally by technology.  This will be a fundamental break with existing biological evolution. A human being from 2011 CE will be functionally equivalent to a human being from 200,000 BC.  Both of these humans will be functionally dissimilar from an augmented human from 2100 CE.

An augmented human who can draw at will from a significant fraction of the intellectual capital and cognitive capabilities of the entire human race to focus on a problem will be as conceptually different from humans today as we are from chimpanzees.  This difference will amplify the augmented human's ability to conceptualize and solve problems in ways that we and the chimps are simply unable to perform. 

We can drop off a load of lumber, nails, hammers, saws and helpful DIY construction picture books to a local tribe of bonobos.  But they are never going to be able to build housing for themselves.  They are simply not equipped to conceptualize a solution to the problem in ways that humans can.

Similarly, the modest increase that augmented humans will achieve will rapidly achieve a breakaway differentiation from existing human society.  We currently maintain the comfortable illusion that we can survive without our technology.  We ignore the fact that most human beings today cannot be productive and many simply could not exist more than a week or two without a technological support infrastructure. 
These augmented humans will not be us, because they will not be able to exist and function at all without their technology.  Technology will have become so much a part of who and what they are, that their existence without technology even for a fleeting moment would be unimaginably strange and alien.  At that point, they will have ceased to be what we would consider human, though I suspect that their existence will seem quite commonplace and normal to them.

To me, achieving the singularity does not seem to require fundamentally disruptive breakthroughs in unknown or unknowable technologies to achieve.  I think that such breakthroughs are likely to occur and to radically increase in number, but the singularity's course seems to be well within what we expect to be able to achieve in commercializing, disseminating and democratizing extensions and expansions to technologies already demonstrated in the laboratory.

In conclusion, the singularity is not achievable as a human endeavor,
but inevitably and inescapably, it will not be a human endeavor.

Reply

funbiz@hotmail

1 Comment

  • 579 Days Ago
  • 10/20/2011

Re: The Nature of the Singularity and the Crux of the Disagreement

"I don't think that we need to recreate the human brain to achieve the singularity. In the 19th century, many people were trying to create machines that could fly like a bird. Of course, what was needed was to achieve flight was to understand the underlying dynamics of lift, thrust, drag, and weight. A significant task to be sure, but enormously easier than building an exact copy of a bird. Similarly, while studying the human brain is sure to give us insights into novel ways of storing and processing information, the singularity is achievable with applying those insights and principles using off-the-shelf hardware.


This is an excellent point. The argument that that the human brain must be duplicated to reach the singularity may be false. Thank you for making this historical comparison between the two.

Reply

futuretalk

1 Comment

  • 586 Days Ago
  • 10/13/2011

The Singularity Isn't Near

Paul Allen is a smart man and this article certainly evokes a variety of different thoughts.

However, my take on how the future may unfold is quite different. I believe that humanity will undergo radical changes over the next two-to-three decades. Stem cell therapies and genetic engineering procedures expected in the 2010s and early 2020s could all but eliminate most diseases, and by 2025, accidents and violence could become the leading cause of death.

In addition, during the 2020s, advanced computers will help scientists unravel the mysteries of consciousness with a better understanding of how the quintillions of synaptic activities direct human activities and thoughts.

Molecular nanotech, expected to mature by 2025-to-2030, could help bring about the end of poverty with nanoreplicators and it could eliminate human aging by early 2030s with nanobots cruising through bodies maintaining perfect health in every cell.

By around mid-2030s, artificial intelligence will advance to the point where machines can outthink humans and will enable systems that allow human brains to connect directly with machines to share this glut of intelligence.

During the 2040s, humanity will recognize the value of replacing biological organs, bones, muscles, etc., with more powerful self-repairing non-biological materials (USC researchers have already created artificial neurons made from carbon nanotubes).

By 2050, most humans will sport a body with abilities to transfer consciousness into a new body should disaster strike; this provides humanity with an indefinite lifespan – to never die from an unwanted death.

Many other technologies will unfold including developing wormholes to break the light-speed barrier enabling humanity to begin spreading their populations to the stars.

By 2150, more humans could live in space than on Earth and by 2400 or 2500, Earth could become completely void of human life.

Now, will we maintain life in body form? We probably will not. The Internet has highlighted the value of digital existence and one day we may prefer a life without bodies – even a life without matter of any kind. At this stage, we would not even need a planet to hang our hat on.

Some predict that there may be extraterrestrial life forms in the cosmos that have already evolved to the ‘digital lifestyle’. After a millennium or two, we may be invited to join an organization of future ETs who have gone digital. Welcome to the Federation.

Comments welcome.

Reply

Brian H

60 Comments

  • 564 Days Ago
  • 11/04/2011

Re: The Singularity Isn't Near

The problem with transferring consciousness is that identity is lost. I.e., if you can be copied once, or one-to-one, you can also be copied one-to-two. At that point, all bets are off, because both will consider themselves the original. This can be extended to any number of "dupes". 

Reply

Emory0

1 Comment

  • 586 Days Ago
  • 10/13/2011

Physical Limitations

I've noticed that relatively few people from the physical sciences seem to take the idea of a fast-approaching sinularity seriously.

For me, as an ex-physicist, I can't help but think about how actual PHYSICAL DATA will be needed for each new wave of fundamentally faster chip technology.

Currently, we have no reason to believe that the current Si-focused technologies will be able to continue forever. In fact, we know that they can't. This means we'll need fundamentally new technologies in order for chips to continue "obeying" Moore's law.

In order to have new technologies, we'll need new physical DATA. A smart machine, no matter how smart, will also need that data in order to build the next generation of chips and even smarter machines.

And how do you get physical data? You have to build experiments with physical equipment. You need physical real estate and specialized buildings. No matter how smart machines become, it will take time to obtain the physical data needed to develop new chips, and that's when the technology curves Kurzweil is so fond of flatten out, and the exponential curve becomes just another S-curve.

For the same reason, cars don't move a million miles an hour, and baseball pitchers will never throw at 200 mph. There are physical limits and they just can't be computed away.

Reply

p1esk

2 Comments

  • 586 Days Ago
  • 10/13/2011

Re: Physical Limitations

ever heard of simulations?

Reply

dscoastal

1 Comment

  • 586 Days Ago
  • 10/13/2011

"the brain's complexity is beyond anything they'd imagined, almost to the point of being beyond belief"

While computers surpassing the capabilities of the human brain may be known after the fact by the effects, to say when that might happen would require a deep understanding of how the brain works. We're not there yet:

http://news.cnet.com/8301-27083_3-20023112-247.html

http://medicalxpress.com/news/2011-09-scientists-fickle-dna-brain.html

Check out Raymond Tallis' "Aping Mankind" for a (long winded and sometimes rantish) analysis of the gap between current knowledge of the brain and human consciousness.

Reply

Holomovement

1 Comment

  • 585 Days Ago
  • 10/14/2011

The "Hard Problem" of consciousness

Getting part way there to the singularity....

Seems to me that the intrinsic way our minds 'think', or commonly operate, is impeding the understanding of this pesky problem that is referred to as the "hard problem of consciousness". We stumble for a solution because of our inability to notice that we construct a differentiated reality for ourselves.  The differentiation that thinking engenders causes us to look for a receiver, that little homunuculus man inside our heads that receives the flavor of an apple, the redness of red. He will never be found and will always seem to recede from inquiry until we recognize the simple fact that our biology is consciousness, is qualitative experience. It is one and of the same.

When we stop looking in our brain for consciousness and recognize it is an integral part of our biology, that will be a great paradigm shift.

This being the case, it would seem more difficult to “upload” our consciousness because it is so inextricably a part of our personal biological existence.

Reply

Mapou

357 Comments

  • 585 Days Ago
  • 10/14/2011

Re: The "Hard Problem" of consciousness

He will never be found and will always seem to recede from inquiry until we recognize the simple fact that our biology is consciousness, is qualitative experience. It is one and of the same.

There is nothing scientific about your assertion. Just wishful thinking on your part. Sorry.

Reply

PacRim Jim

3 Comments

  • 585 Days Ago
  • 10/14/2011

Don't overthink the problem

How hard could it be to build a brain?
Practically any young man and woman can do so repeatedly.
The obvious algorithm is:
1. Reverse-engineer the human brain.
2. Build a faster, more powerful version.
3. Let it learn on its own. Voila! Heuristic loop closed.
4. Brain redesigns itself.
5. Technological singularity achieved. Humans obviated.
6. We Homo sapiens look for new jobs.

Reply

johnsawyercjs

8 Comments

  • 584 Days Ago
  • 10/15/2011

Re: Don't overthink the problem

That sounds a little like the old Steve Martin joke:

"I know how you can become a millionaire, and never pay taxes!  First, get a million dollars..."

Reply

CWDK2628

2 Comments

  • 585 Days Ago
  • 10/14/2011

So, Paul...what is your date?

Paul, Mark....since you do not dispute Kurzweil's underlying dynamic of understanding cognition (any complex system) is a finite problem AND folks are working on it (whatever it happens to be), then you're just quibbling about dates.  So, what's your date for when the Singularity is achieved.  Jeesz, you guys wrote all that crap to say "he's off by X years".

Reply

johnsawyercjs

8 Comments

  • 584 Days Ago
  • 10/15/2011

Re: So, Paul...what is your date?

Well, in order to say they're off by X years, they need to say why they feel that way.  Trying to get a better handle on when it might happen, may not be irrelevant in some way.  Though I suspect there will be no singularity as some might think of it, where over the course of several days or weeks things will suddenly, uncontrollably change so much as to be largely unrecognizable.

Reply

sam.shaker

2 Comments

  • 585 Days Ago
  • 10/14/2011

Define Sigularity

My understanding of the Singularity is that is it when machine intelligence matches or exceeds human. At that point new things _may_ become possible, like the copying of a human mind into a computer, but are not essential to the occurrence of the Singularity.  The argument of how far off we may be from a computer simulation of the human brain, which is more what this article seems to be about, is different from the argument of when computers will be smarter than humans, which probably has more to do with heat, power, Moore's Law and current materials used in electronics manufacturing than it does with our understanding of the wiring of the human brain. 

Reply

thinkahol

1 Comment

  • 585 Days Ago
  • 10/14/2011

Consciousness is key

the thing is we actually do have a good over-arching theories of cognition and consciousness, everyone just hasn’t realized it yet.

Thomas Metzinger describes consciousness quite well in his talk “Being No One”:
http://www.youtube.com/watch?v=mthDxnFXs9k

And Jeff Hawkins' team figured out the general algorithm for almost all cognition:
http://www.youtube.com/watch?v=oozFn2d45tg

And I can't believe some of you are worried about jobs, like it should be a problem that we won't have to work. Douglas Rushkoff addresses that issue in his article "Are Jobs Obsolete?":
http://www.rushkoff.com/blog/2011/9/7/cnncom-are-jobs-obsolete.html


The singularity seems right on schedule to me. Especially since we actually don't have to have the ability to make everything from scratch anyway. All it takes to get the ball rolling is high-fidelity (ideally almost perfect) copying of an existing mind onto a digital medium. The cost of copying in the digital world is free; that sounds like an explosion of intelligence to me.

Reply

Darly314

3 Comments

  • 552 Days Ago
  • 11/16/2011

Re: Consciousness is key

The use of the words ingenuity, and conscious, relate to the obstacle singularity can never overcome; human feelings; love, hate, hope, fear, and longing.

Reply

singularity45

3 Comments

  • 585 Days Ago
  • 10/14/2011

The Singularity IS near.

During the early stages of creating something such as AI; it is a slow process. Surely everyone has watched old film footage of early attempts at making aeroplanes? Here's a video which demonstrates my meaning: http://youtu.be/iMhdksPFhCM

From Leonardo da Vinci studying flight in the 1480s, 300 years elapsed before the Montgolfier balloon flew. It was approximately another 100 years before the success of the Wright Brothers, and the first Jumbo Jet didn't fly commercially until several decades later in 1970.

Considering the speed the internet evolving; or considering the speed of many other recent development in science and technology; I am perplexed, TRULY perplexed, regarding how anyone can deny progress is accelerating.

In the year 2011 our achievements are vastly quicker than the progress of our forbears creating aeroplanes.

We are on the cusp of the intelligence explosion but some people have succumbed to the Boy Who Cried Wolff Syndrome, thus they deny what is almost upon them. Such people need to rethink their cynicism because it distorts their thinking.

The “complexity brake” is nonsense. We can create tools less complex than the human body or mind but with greater power than the human body or mind. Consider the arm of a mechanical digger. A mechanical digging arm is vastly stronger than a human arm but the hydraulics and metal are very simple compared to human biological processes which create human arms. Birds can fly and we cannot yet create a new biological organism that can fly because that complexity is beyond us; but we can however create an airplane via relatively simple engineering, and the airplane can fly better than a bird. Artificial Intelligence doesn’t need to equal human cerebral complexity; via simpler designs we can create thinking devices more powerful than the human brain, which the rudimentary AI Watson has already proved when it beat humans in a quiz show. Someone perhaps forgot to put the “complexity brake” on Watson, thus we will soon have runaway AI. The intelligence explosion is truly near. Anyone who denies the close proximately of the Singularity needs to carefully examine their flawed thinking.

Reply

trendsetter37

1 Comment

  • 585 Days Ago
  • 10/14/2011

Brain augmentation

I find it odd that the implications behind brain augmentation is so blatantly dismissed. In the past week I have encountered several articles illuminating the success that researchers are having with brain implants that either increase intelligence artificially or synthetic telepathy (i.e. controlling computers and artificial limbs with ones mind).
   Furthermore, I believe that a lot of individuals that do not want to ponder the thought of becoming pets, are misunderstanding kurzweil's implications or simply did not read the entire book. Throughout his writing he explicitly explains why we "humans" will not become pets. We will become these strong "AI" sentient beings. Nanobots will eventually allow us to overcome our biological intelligence thus turning us into these AI beings. However, I don't really see it as artificial intelligence anymore than I believe it is simple evolution.

Reply

Cro-Magnon

1 Comment

  • 584 Days Ago
  • 10/15/2011

Re: Brain augmentation

I have read most comments and Paul Allens article which I found interesting, and I realise he is very intelligent but also highly specialized. I agree with the comment about the bird/plane analogy posted above.

I have written a philosophical work, partly involving the singularity that may be of interest to some of you.

http://www.scribd.com/doc/68769045/The-Rules-of-the-Twelve-Realms

http://www.scribd.com/doc/68769227/The-Rules-of-the-Twelve-Realms-Part-2

It is free and noncommercial.

Kind regards

Reply

johnsawyercjs

8 Comments

  • 584 Days Ago
  • 10/15/2011

Keep normals around for a while

Whatever happens, hopefully solid moves will also be made to set aside an enclave of substantial size on Earth, where what we would still recognize as humans, still possessing a reasonable number of our flaws, would be allowed to live.  We're not chopped liver, and even in our current form, we probably have more surprises in us than even our best AI might have.

Most of our intelligence is built around how to survive--to put off starvation, injury, and death as long as possible (and hopefully to enjoy doing it).  If an AI has no concern about what it takes to remain alive, either because it hasn't been programmed to care, or it has an unchecked ability to replicate itself endlessly and thus doesn't have to worry about caring, then that form of intelligence won't resemble our own very much, if at all, and in some sense might be said to be unintelligent.

On the other hand, if we give an AI the will and means to ensure its own survival, there's no telling what it might do--Asimov's Three Laws of Robotics won't prevent someone from devising an AI that doesn't possess those.  Extrapolating, an AI with a will to survive, and unchecked access to resources to make good on that, might simply figure out a way to infect itself into all living (and non-living) things it can, regardless of what the results are for what it's infecting.

Reply

johnsawyercjs

8 Comments

  • 584 Days Ago
  • 10/15/2011

Human brains still good

While I know that achieving a "thinking machine", even one with what we'd call consciousness, doesn't necessarily require hardware and software that greatly resembles the human brain in too many respects (hence the examples given by other commenters here that, for instance, in order to have flying machines, we didn't need to model planes after every aspect of a bird, but rather just the basic shape element of their wings that provides lift), still: Since we already know the human brain is well-equipped, with many efficiencies, to be intelligent and sentient, and all current attempts to create an AI at least comparable to our intelligence, but using more or less standard computer hardware and software, has proven to be too resource-intensive, why not also work on parallel projects to emulate the human brain via hardware and software that matches it as closely as is practical and necessary?  Or would the dangers be too great, having an AI with its own reptilian/simian brain components driving it?  I'd suggest that the negative aspects of those subsystems could be worked out.

Reply

donmac23

1 Comment

  • 584 Days Ago
  • 10/15/2011

Historical trends demonstrating Law of Accelerating Returns go back a long way

One point they made that has merit is that simply mapping the physical structure of the brain does not imply we have sufficient knowledge to simulate a human intelligence. It's like saying that mapping the human genome will give us all the knowledge we need to customise our own bodies. However, it's not as if we're not working on other aspects of this problem. There have been advances where significant portions of the brain have been successfully emulated using statistical modelling techniques. And Allen's argument is that incremental improvements are not sufficient to get us there. I don't agree with that. Incremental improvements at an exponentially increasing rate will seem like huge breakthroughs over the course of a decade (or even less as we get further into the future). And it's not as if all these AI applications are simply brute force. In fact, Kurzweil points out in his book that not only is progress being made through the use of more powerful hardware, but the amount of computing power to achieve certain capabilities are reducing (albeit not at an exponential rate). Each time AI breaks down a barrier, somebody is always pointing out something more sophisticated that computers will never be able to do. I'll bet when AI conquered chess, many would have agreed that that is a simple brute force problem but beating a human at a game like Jeopardy would never happen. Or driving a car. Or replacing human organs (hearts, ears, eyes...)

The Law of Accelerating Returns is difficult to argue against. Kurzweil makes the argument fairly well that this law has held true not just for human history, but since the beginning of life on Earth. Even if we do get stuck in one particular scientific pursuit, there are so many possibilities for a technology in another area to effectively jump over whatever the hold up was. For example, AI has one group of scientists trying the build General AI based largely on an applied theoretical approach, while another group is looking to emulate the way existing brains work. Both can and will constantly benefit from the other.

Reply

jgury

4 Comments

  • 584 Days Ago
  • 10/15/2011

Really deep thinking.

"They call this tipping point the singularity, because they believe it is impossible to predict how the human future might unfold after this point"  Wow this is deep. Like it is possible to predict how the future is going to unfold right now? I would be better off getting my deep inspirations from Jack Handy than these guys.

Reply

robrota

7 Comments

  • 580 Days Ago
  • 10/19/2011

good article

I agree with the assessment that "the singularity" will not occur in 2045. The human brain is not finite. We do not understand nor will we understand the physics of the human brain by 2045. Don't mistake the complexity of a single dimension as an understanding of reality. If you correlate complexity in any way with intelligence, say pattern recognition, you will see that we are not the most complex phenomena in existence. If you acknowledge this then you will understand that "the singularity" has always existed.

Reply

unov

1 Comment

  • 576 Days Ago
  • 10/23/2011

Simple singular flaw in reason

Seems more like singular flaw in reason..forgetting about evolution. 

The human brain and so human ability evolves along with our environment.  Machines are part of the environment against which humans evolve.

All these arguments want to limit human ability to our current capabilities but do recognize that human ability will be radically different in the future.

For example, consider this statement:

"Progress here is deeply affected by the ways in which our brains absorb and process new information, and by the creativity of researchers in dreaming up new theories."

In the future, the ways in which out brains absorb and process new information will evolve based on our environment, and machines that we ourselves create are part of that environment.

Reply

RealityBetraysU

2 Comments

  • 575 Days Ago
  • 10/24/2011

nanotechnology creating life?

Singularity or sentient life form creating it from scratch! No way Jose! Like the evolutionist's argument with God on creating life, and he wants to start with dirt,and God says create your own dirt!(from nothing the way God did). We will never see man being able to create self conscious independent intelligent life from nothing. He may try to simulate, borrow, imitate, remotely access, provide other illusions that simulate the process but actually creating a "sincularity that has all the unique properties and abilities that human life has" not going to happen. I do not mean to disparage all the technocrats that think all things are possible with enough time, money and science-knowledge but the bible indicates that man will be on the door step of self destruction before that happens and God (Jesus Christ will come back and intervene before mankind destroys itself). This is what the bible indicates. Do not discount the bible because it does have a 100% accuracy rate of predicting the future if you read it and interpret it correctly. (not like modern "prophets who make ridiculous predictions that donot come to pass,if the read the bible they would know that when JC returns only God in heaven will know the actual time it will occur!)In the old testament these false prophets would have been stoned to death! Old testament prophets required 100% accuracy.Anyway my point is there is eveidence in the bible that the devil will possibly come up with his "alternate plan for eternal life" not requiring obedience to God nor Heaven, but by using science try to engineer a race or "super-humans or beasts". Don't think so? Please see this web link for is being considered with todays technology;
http://www.cuttingedge.org/detail.cfm?ID=2088
DVD - Triple Helix: Genetically Changing Mankind
Illuminati scientists intend to turn the Global Elite from humans created in God's image to Beasts through genetic engineering. Talk about
Frankenstein!It is bad enough when they turn our food into "frankenfood" but next they will try to modify the whole race with gentic engineering. No thanks, I do it Jesus"s way.

Reply

buschi

1 Comment

  • 574 Days Ago
  • 10/25/2011

new AI will not look like pauls imagination

what i dont like about allens argument is that he argues with the AI paradigm of the 70-80 where researcher aimed at replicating the brain or language. that didnt work and thus he cant  the paradigmshifts. we wont need to understand the brain to built a global AI

take machine translation. generations of researcher built rule based systems with ever moe rules. now we have google translate who doesnt care about understanding languages and uses statistics. google translate blows any other translation effort off the table.

we will see more of this and the new internet-based AI will be different from the AI they imagined in the 80s. also once the pieces fall in place everything can go very quickly. the super-connection of a global ubiqutous mobile internet took 30 years to manifest with two phase changes in between that changed everything.

lets see whats in store for us until 2045, but paull will be amazed...

Reply

steampoweredgod

1 Comment

  • 574 Days Ago
  • 10/25/2011

Time does not matter

It doesn't matter how long it takes for such changes to come about.

The reality is we've seen that some animals can indefinitely postpone decay in the natural environment.   Right now biotechnology is advancing rapidly, once aging is dealt with in animals something most certain to happen this century, humans will expedite the application of such in humans, yielding indefinite lifespan. 

No aging means all the time in the world.  So it is very likely humans alive today will live to see the changes to come.

With regard of automation, capitalism eventually becomes similar to the establishment of nobilities and monarchies.  The corporations and the rich buy the politicians who're often also well off, and with the media brainwash the masses.  So long as things don't get too extreme, it will be far easier to keep the masses calm in this day and age, with vast cheap time consuming entertainment.

The government will eventually deal with the situation before it gets out of hand, buying and distributing stocks, increasing taxation, etc.

Thanks to all this technological advancement we may be able to one day put an end to the horrible human condition.  Short brutish lives filled with disease and decay as humans wither away.   A world free of disease aging and the obligation to work or die.

Reply

gros

5 Comments

  • 528 Days Ago
  • 12/10/2011

AI and emotional control

Regarding the general approach to AI, as Paul Allen pointed out correctly, the standard AI approach starts from specialized intelligences. One key aspect is in this contect the emotional control, see
http://arxiv.org/abs/1112.1330
"Emotional control - conditio sine qua non for advanced artificial intelligences?"

There are very strong arguments, that higher intelligence needs a higher level of emotional control stystem, in contrast to standard AI approach which presumes that emotional control is added at a later stage, and not when starting the synthetic intelligence.

Reply

Loucho

1 Comment

  • 508 Days Ago
  • 12/30/2011

Singularity and aliens

Follow this simple reasoning: if the Singularity is ever possible why do you think that we are the only and first species in the Universe to achieve that? Most probably some other species in the Universe already achieved it. So if singularity leads very fast to a "Universe wake-up" then it already happened and we are all living into some sort of alien (God?) Matrix. Possible? Unlikely. I bet that the singularity as stated in Kurzweil book will never happen. I think too many things are dangerously simplified and taken for granted. Starting with our willing as humans to go in that direction. Do you want to be immortal by living inside a machine? I'm sure we can dream a better future for us.

Reply

Bio

Analysis and insight from occasional correspondents and decision makers.

Subscribe to the Guest Blog RSS Feed

Advertisement
Advertisement
Advertisement