AI 2.0

In the movie Memento, former insurance investigator Leonard Shelby tracks down the criminal who attacked him and murdered his wife. Leonard, though, is not a “normal” guy. He has to deal with a rare and untreatable form of memory loss that he suffered during an attack.

Despite the fact he can remember aspects of his life prior to the attack, Leonard can’t remember what happened 15 minutes ago, where he’s going or why. In his own words, “I know who I am. I just can’t form new memories.”

Like Leonard, people with his type of amnesia do lose the ability to form memories, which Leonard ingeniously mitigates by snapping numerous Polaroid photos of important places he’s been, people he has met and things he has seen.

Poor Leonard wakes up every day without knowing more than he did the day before. His learning is “frozen.”

You may not know this, but virtually 100% of the artificial intelligence developed and fielded today has “Leonard’s disease.” Once it has been deployed, it does not matter how much you teach it day after day — the AI does not know more or get smarter than the day it was deployed.

Traditional AI Only Knows What It Has Been Taught In The Factory

As more and more machines — from smart cameras and cell phones to industrial co-robots and self-driving cars — are equipped with some form of intelligence, AI is sitting on a pile of invaluable, day-to-day training data that it is simply discarding.

To realize how devastatingly bad this is, imagine what human brains would behave like in today’s AI systems. Were our brains designed like currently engineered AI, we would only know what we learned in college. Day after day, we would go to work, be exposed to new situations and challenges, go to sleep and wake up having learned nothing.

Somebody is acknowledging the problem, though. The U.S. Defense Advanced Research Projects Agency (DARPA), whose innovations usually trail anything commercially available by many years (such as GPS and the internet), is launching a program devoted to lifelong learning in AI systems. (Full disclosure: I was the PI (principal investigator) on a DARPA project for a number of years.)

But the world has changed significantly since DARPA was originally founded. Now, startups can innovate at a pace and depth that makes these multiyear, multimillion-dollar proposals obsolete in the face of what small companies can build with a restricted schedule and capital budget.

More Intelligent Artificial Intelligence With Lifelong-DNN

Traditional DNN is fixed, and to add new data, the whole data set needs to be retrained. A Lifelong Deep Neural Network (Lifelong-DNN), on the other hand, is AI 2.0. This technology learns day after day, similar to human learning. Lifelong-DNN is inspired by brain neurophysiology and mimics in software the ability of cortical and subcortical circuits to work “in tandem” to add new information on the fly.

Neurala has been making strides with this technology when we introduced the idea of using graphics processing units (GPUs) to speed up neural network computations in 2006. Several companies, in fact, are working on “catastrophic forgetting” via “transfer learning” (i.e., training a network to do one thing and then figuring out a way to train it to do another without forgetting the first). James Kirkpatrick (Google Deepmind) and Ian J. Goodfellow (Google Brain) are doing tremendous work in this area of AI, but this is really quite a broad field, with many organizations doing transfer learning. Note that in the general transfer learning case, you’re still learning via thousands to millions of examples while also looking for a way to protect the learning you’ve previously done.

AI 2.0: Solving The Problem Of Forgetting

The key here is the ability to capture in software the dual nature of learning in the mammalian brain, where several neurotransmitter systems act in synergy to enable both slow learning, the kind where many different repetitions are needed to master a task and fast learning, based on one-shot learning of crucial information.

Unlike Leonard Shelby, AI 2.0, with its Lifelong-DNN, never forgets what it has learned. Lifelong-DNN makes it possible for AI to learn throughout its “life.” As a result, it will open up new worlds of applications and capabilities.

87 thoughts on “The Next-Generation AI Brain: How AI Is Becoming More Human”
  1. My spouse and i have been really lucky that Louis managed to finish off his research through your precious recommendations he made through your web pages. It is now and again perplexing to just find yourself handing out solutions which people today may have been selling. Therefore we know we need the writer to give thanks to for that. The specific illustrations you have made, the simple web site navigation, the relationships you will help to instill – it’s got most powerful, and it’s really leading our son in addition to the family reason why the subject is fun, which is really pressing. Thank you for the whole lot!

  2. Bạn có biết các giống mèo hiện tại chưa. Mèo là động vật được nhiều người yêu dấu nhất hiện tại. Tuy nhiên bạncòn chưa có đủ kinh nghiệm để phân biệt các giống mèo. Việc lựa chọn một chú mèo về làm thú nuôi không đơn thuần chỉ là mua và bán nếu bạn không biết tính tình và lối sống của chúng thì chắc chắn rằng chúng sẽ bị bệnh ngay lập tức.

  3. The American Dream is, and always will be, to come up with an idea, start a startups and small businesses and become rich from your own efforts. Based upon this motivation, thousands of startups and small startups and small businesseses fail each year, due primarily to not being familiar with the basics involved in running a startups and small businesses.

  4. I’ve been exploring for a little bit for any high-quality articles or blog posts in this
    sort of space . Exploring in Yahoo I at last stumbled upon this site.
    Reading this info So i am satisfied to express that I have an incredibly excellent
    uncanny feeling I found out exactly what I needed.
    I most undoubtedly will make certain to don?t overlook this site and give
    it a glance regularly.

  5. I really love your website.. Excellent colors & theme. Did you make this amazing site yourself?
    Please reply back as I’m attempting to create my own personal blog and would like to learn where you got this from or what the theme is called.
    Many thanks!

  6. Hello, i read your blog from time to time
    and i own a similar one and i was just wondering if you get a lot
    of spam feedback? If so how do you protect against it, any plugin or
    anything you can recommend? I get so much lately it’s driving me mad so any support
    is very much appreciated.

  7. It’s appropriate time to make some plans for the future and it is time to be happy.
    I’ve read this post and if I could I desire to suggest you
    few interesting things or suggestions. Maybe you could write next articles referring to this article.
    I wish to read more things about it!

  8. I’ve been surfing on-line greater than three hours today, yet I never discovered any interesting article like yours.
    It is beautiful worth sufficient for me. Personally, if
    all site owners and bloggers made just right content as you probably did, the net will likely be a lot more
    useful than ever before.

  9. I will right away grasp your rss feed as I can not find your e-mail subscription hyperlink or newsletter service.
    Do you’ve any? Please permit me recognise so that I may
    subscribe. Thanks.

  10. Hola! I’ve been following your blog for some time
    now and finally got the courage to go ahead and give you a shout out from
    Dallas Tx! Just wanted to mention keep up the good job!

  11. Hi there, I think your web site could possibly be having internet browser compatibility issues.
    When I take a look at your site in Safari, it looks fine however,
    when opening in IE, it’s got some overlapping issues.
    I merely wanted to provide you with a quick heads up! Aside from that, wonderful site!

  12. It is appropriate time to make a few plans for the future and it’s time
    to be happy. I’ve learn this submit and if I may I wish to recommend you some fascinating issues
    or advice. Maybe you can write subsequent articles relating
    to this article. I wish to read even more issues approximately it!

  13. Woah! I’m really enjoying the template/theme of this site.
    It’s simple, yet effective. A lot of times it’s very
    hard to get that “perfect balance” between user friendliness and visual appearance.
    I must say that you’ve done a awesome job with this. In addition, the blog loads super quick for me on Safari.
    Superb Blog!

  14. I’ve been browsing online more than 4 hours today, yet I never found any interesting
    article like yours. It is pretty worth enough for me. In my view, if all site owners and bloggers
    made good content as you did, the web will be a lot more useful than ever before.

  15. It’s appropriate timee to make slme pans for thhe future and itt iis timke to bee happy.
    I’ve redad thus post aand iff I coud I want tto sugggest yyou ffew interesting tnings orr
    advice. Perhps yyou coud write nextt artiles rdferring too this article.
    I want tto read mpre things ablut it!

Leave a Reply to JbnvAxord Cancel reply

Your email address will not be published.

I accept that my given data and my IP address is sent to a server in the USA only for the purpose of spam prevention through the Akismet program.More information on Akismet and GDPR.