Massimiliano Versace

AI, from academia to real-world

Articles

The Next-Generation AI Brain: How AI Is Becoming More Human

Bymaxversace

Apr 18, 2018 , , , , , ,
AI 2.0

In the movie Memento, former insurance investigator Leonard Shelby tracks down the criminal who attacked him and murdered his wife. Leonard, though, is not a “normal” guy. He has to deal with a rare and untreatable form of memory loss that he suffered during an attack.

Despite the fact he can remember aspects of his life prior to the attack, Leonard can’t remember what happened 15 minutes ago, where he’s going or why. In his own words, “I know who I am. I just can’t form new memories.”

Like Leonard, people with his type of amnesia do lose the ability to form memories, which Leonard ingeniously mitigates by snapping numerous Polaroid photos of important places he’s been, people he has met and things he has seen.

Poor Leonard wakes up every day without knowing more than he did the day before. His learning is “frozen.”

You may not know this, but virtually 100% of the artificial intelligence developed and fielded today has “Leonard’s disease.” Once it has been deployed, it does not matter how much you teach it day after day — the AI does not know more or get smarter than the day it was deployed.

Traditional AI Only Knows What It Has Been Taught In The Factory

As more and more machines — from smart cameras and cell phones to industrial co-robots and self-driving cars — are equipped with some form of intelligence, AI is sitting on a pile of invaluable, day-to-day training data that it is simply discarding.

To realize how devastatingly bad this is, imagine what human brains would behave like in today’s AI systems. Were our brains designed like currently engineered AI, we would only know what we learned in college. Day after day, we would go to work, be exposed to new situations and challenges, go to sleep and wake up having learned nothing.

Somebody is acknowledging the problem, though. The U.S. Defense Advanced Research Projects Agency (DARPA), whose innovations usually trail anything commercially available by many years (such as GPS and the internet), is launching a program devoted to lifelong learning in AI systems. (Full disclosure: I was the PI (principal investigator) on a DARPA project for a number of years.)

But the world has changed significantly since DARPA was originally founded. Now, startups can innovate at a pace and depth that makes these multiyear, multimillion-dollar proposals obsolete in the face of what small companies can build with a restricted schedule and capital budget.

More Intelligent Artificial Intelligence With Lifelong-DNN

Traditional DNN is fixed, and to add new data, the whole data set needs to be retrained. A Lifelong Deep Neural Network (Lifelong-DNN), on the other hand, is AI 2.0. This technology learns day after day, similar to human learning. Lifelong-DNN is inspired by brain neurophysiology and mimics in software the ability of cortical and subcortical circuits to work “in tandem” to add new information on the fly.

Neurala has been making strides with this technology when we introduced the idea of using graphics processing units (GPUs) to speed up neural network computations in 2006. Several companies, in fact, are working on “catastrophic forgetting” via “transfer learning” (i.e., training a network to do one thing and then figuring out a way to train it to do another without forgetting the first). James Kirkpatrick (Google Deepmind) and Ian J. Goodfellow (Google Brain) are doing tremendous work in this area of AI, but this is really quite a broad field, with many organizations doing transfer learning. Note that in the general transfer learning case, you’re still learning via thousands to millions of examples while also looking for a way to protect the learning you’ve previously done.

AI 2.0: Solving The Problem Of Forgetting

The key here is the ability to capture in software the dual nature of learning in the mammalian brain, where several neurotransmitter systems act in synergy to enable both slow learning, the kind where many different repetitions are needed to master a task and fast learning, based on one-shot learning of crucial information.

Unlike Leonard Shelby, AI 2.0, with its Lifelong-DNN, never forgets what it has learned. Lifelong-DNN makes it possible for AI to learn throughout its “life.” As a result, it will open up new worlds of applications and capabilities.

By maxversace

Related Post

Articles Media Coverage Press Release

FLIR e Neurala annunciano collaborazione per soddisfare la crescente domanda di telecamere equipaggate con Deep Learning per la manifattura industriale

Mar 24, 2021 maxversace
Articles

Rebounding From The Pandemic: What Our Past Teaches Us About The Future

Dec 23, 2020 maxversace
Articles Media Coverage

Coping With Black Friday 2020 — and Manufacturers’ ‘Crazy Thursday’

Dec 9, 2020 maxversace
229 thoughts on “The Next-Generation AI Brain: How AI Is Becoming More Human”

  1. My spouse and i have been really lucky that Louis managed to finish off his research through your precious recommendations he made through your web pages. It is now and again perplexing to just find yourself handing out solutions which people today may have been selling. Therefore we know we need the writer to give thanks to for that. The specific illustrations you have made, the simple web site navigation, the relationships you will help to instill – it’s got most powerful, and it’s really leading our son in addition to the family reason why the subject is fun, which is really pressing. Thank you for the whole lot!

    Reply

  20. Bạn có biết các giống mèo hiện tại chưa. Mèo là động vật được nhiều người yêu dấu nhất hiện tại. Tuy nhiên bạncòn chưa có đủ kinh nghiệm để phân biệt các giống mèo. Việc lựa chọn một chú mèo về làm thú nuôi không đơn thuần chỉ là mua và bán nếu bạn không biết tính tình và lối sống của chúng thì chắc chắn rằng chúng sẽ bị bệnh ngay lập tức.

    Reply

  34. The American Dream is, and always will be, to come up with an idea, start a startups and small businesses and become rich from your own efforts. Based upon this motivation, thousands of startups and small startups and small businesseses fail each year, due primarily to not being familiar with the basics involved in running a startups and small businesses.

    Reply

  64. I’ve been exploring for a little bit for any high-quality articles or blog posts in this
    sort of space . Exploring in Yahoo I at last stumbled upon this site.
    Reading this info So i am satisfied to express that I have an incredibly excellent
    uncanny feeling I found out exactly what I needed.
    I most undoubtedly will make certain to don?t overlook this site and give
    it a glance regularly.

    Reply

  66. I really love your website.. Excellent colors & theme. Did you make this amazing site yourself?
    Please reply back as I’m attempting to create my own personal blog and would like to learn where you got this from or what the theme is called.
    Many thanks!

    Reply

  67. Hello, i read your blog from time to time
    and i own a similar one and i was just wondering if you get a lot
    of spam feedback? If so how do you protect against it, any plugin or
    anything you can recommend? I get so much lately it’s driving me mad so any support
    is very much appreciated.

    Reply

  69. It’s appropriate time to make some plans for the future and it is time to be happy.
    I’ve read this post and if I could I desire to suggest you
    few interesting things or suggestions. Maybe you could write next articles referring to this article.
    I wish to read more things about it!

    Reply

  70. I’ve been surfing on-line greater than three hours today, yet I never discovered any interesting article like yours.
    It is beautiful worth sufficient for me. Personally, if
    all site owners and bloggers made just right content as you probably did, the net will likely be a lot more
    useful than ever before.

    Reply

  71. I will right away grasp your rss feed as I can not find your e-mail subscription hyperlink or newsletter service.
    Do you’ve any? Please permit me recognise so that I may
    subscribe. Thanks.

    Reply

  73. Hola! I’ve been following your blog for some time
    now and finally got the courage to go ahead and give you a shout out from
    Dallas Tx! Just wanted to mention keep up the good job!

    Reply

  74. Hi there, I think your web site could possibly be having internet browser compatibility issues.
    When I take a look at your site in Safari, it looks fine however,
    when opening in IE, it’s got some overlapping issues.
    I merely wanted to provide you with a quick heads up! Aside from that, wonderful site!

    Reply

  77. It is appropriate time to make a few plans for the future and it’s time
    to be happy. I’ve learn this submit and if I may I wish to recommend you some fascinating issues
    or advice. Maybe you can write subsequent articles relating
    to this article. I wish to read even more issues approximately it!

    Reply

  78. Woah! I’m really enjoying the template/theme of this site.
    It’s simple, yet effective. A lot of times it’s very
    hard to get that “perfect balance” between user friendliness and visual appearance.
    I must say that you’ve done a awesome job with this. In addition, the blog loads super quick for me on Safari.
    Superb Blog!

    Reply

  79. I’ve been browsing online more than 4 hours today, yet I never found any interesting
    article like yours. It is pretty worth enough for me. In my view, if all site owners and bloggers
    made good content as you did, the web will be a lot more useful than ever before.

    Reply

  82. It’s appropriate timee to make slme pans for thhe future and itt iis timke to bee happy.
    I’ve redad thus post aand iff I coud I want tto sugggest yyou ffew interesting tnings orr
    advice. Perhps yyou coud write nextt artiles rdferring too this article.
    I want tto read mpre things ablut it!

    Reply

  98. Good blog post. The things i would like to contribute is that pc memory needs to be purchased when your computer still cannot cope with whatever you do along with it. One can mount two good old ram boards of 1GB each, for example, but not certainly one of 1GB and one of 2GB. One should always check the car maker’s documentation for own PC to be sure what type of memory space is required.

    Reply

  99. What i do not realize is if truth be told how you’re not actually much more smartly-favored than you might be right now. You are so intelligent. You understand therefore considerably in the case of this topic, produced me for my part believe it from so many various angles. Its like men and women don’t seem to be interested until it is one thing to accomplish with Woman gaga! Your personal stuffs nice. Always handle it up!

    Reply

  101. It is the best time to make a few plans
    for the longer term and it is time to be happy.

    I’ve learn this put up and if I may just I desire to recommend you some interesting issues or tips.
    Perhaps you can write subsequent articles relating to this article.
    I want to learn more issues approximately it!

    Reply

  103. It’s the best time to make a few plans for the future
    and it’s time to be happy. I’ve learn this put up and if
    I may just I want to suggest you some interesting issues
    or suggestions. Perhaps you can write next articles referring to this article.
    I wish to read even more things approximately
    it!

    Reply

  106. You’ve made some decent points there. I checked on the internet to learn more about the issue
    and found most individuals will go along with your views on this website.

    Reply

  107. It is the best time to make some plans for the future and
    it is time to be happy. I have read this post and if I could I desire to suggest you few interesting things
    or advice. Perhaps you could write next articles referring to this article.
    I desire to read even more things about it!

    Reply

  112. I’ve been browsing online more than 2 hours today, yet I never
    found any interesting article like yours.
    It is pretty worth enough for me. In my opinion, if all web owners and bloggers made good content as you did, the internet will be much more useful than ever before.

    Reply

  123. It’s appropriate time to make some plans for the
    future and it’s time to be happy. I have read this post and if I could I wish to suggest you few interesting things
    or advice. Perhaps you could write next articles referring to this article.
    I wish to read more things about it!

    Reply

  125. I like the helpful information you provide in your articles.
    I will bookmark your weblog and check again here frequently.
    I am quite certain I will learn lots of new stuff right here!
    Best of luck for the next!

    Reply

  127. Hola! I’ve been following your website for some time now and finally got the bravery
    to go ahead and give you a shout out from New Caney Texas!

    Just wanted to tell you keep up the excellent work!

    Reply

  128. I’ve been browsing on-line greater than 3 hours these days, yet
    I by no means found any attention-grabbing article like yours.
    It’s beautiful worth enough for me. Personally, if all
    web owners and bloggers made just right content material as you did, the internet
    might be much more helpful than ever before.

    Reply

  129. Each Monday during the NBA season, All Tar Heels will review the prior week for each Tar Heel in the NBA and preview the week ahead. This week, we are looking at games from April 12-18 and looking ahead to games from April 19-25.

    Reply

  130. Each Monday during the NBA season, All Tar Heels will review the prior week for each Tar Heel in the NBA and preview the week ahead. This week, we are looking at games from April 12-18 and looking ahead to games from April 19-25.

    Reply

  132. Each Monday during the NBA season, All Tar Heels will review the prior week for each Tar Heel in the NBA and preview the week ahead. This week, we are looking at games from April 12-18 and looking ahead to games from April 19-25.

    Reply

  134. Hi, I do think this is a great website. I stumbledupon it 😉 I will come back yet again since i have book-marked it.
    Money and freedom is the best way to change,
    may you be rich and continue to help others.

    Reply

  135. Hello there! This post could not be written much better!
    Going through this article reminds me of my previous roommate!
    He continually kept talking about this. I’ll send this
    post to him. Fairly certain he will have a great read.
    I appreciate you for sharing!

    Reply

  142. I will immediately clutch your rss as I can not in finding your e-mail subscription hyperlink
    or e-newsletter service. Do you have any? Kindly let me understand in order that
    I could subscribe. Thanks.

    Reply

  146. I will right away grasp your rss feed as I can’t find your email subscription link or newsletter service.
    Do you’ve any? Please let me understand in order that I
    may just subscribe. Thanks.

    Reply

  148. I have been surfing on-line more than 3 hours as of late,
    but I never found any interesting article like yours.
    It’s beautiful worth enough for me. In my view, if all website owners and bloggers made excellent content material as you did, the internet will
    probably be a lot more useful than ever before.

    Reply

  150. I’m really impressed with your writing skills
    and also with the layout on your blog. Is this a
    paid theme or did you modify it yourself? Either way keep up the nice quality writing, it’s rare to see a great blog like this one these
    days.

    Reply

  153. Hi, I do believe this is an excellent site. I stumbledupon it 😉 I may revisit once again since i have book marked it.
    Money and freedom is the greatest way to change, may you be rich and continue
    to help other people.

    Reply

  155. Hey there! Someone in my Myspace group shared this site with us
    so I came to look it over. I’m definitely loving the information. I’m book-marking and will be tweeting
    this to my followers! Fantastic blog and outstanding design and style.

    Reply

Leave a Reply

Your email address will not be published.

I accept that my given data and my IP address is sent to a server in the USA only for the purpose of spam prevention through the Akismet program.More information on Akismet and GDPR.

You missed

Talks

Artificial Intelligece: Friend or Foe?

May 3, 2021 maxversace
Articles Media Coverage Press Release

FLIR e Neurala annunciano collaborazione per soddisfare la crescente domanda di telecamere equipaggate con Deep Learning per la manifattura industriale

Mar 24, 2021 maxversace
Uncategorized

Why ‘Explainability’ Is The Next Step For AI In Manufacturing

Feb 23, 2021 maxversace
Uncategorized

Can AI Explain Itself?

Jan 27, 2021 maxversace