Max Versace

AI, academia => real-world

Talks

Forget Catastrophic Forgetting: the path to Deep Learning at the Edge

Bymaxversace

Apr 15, 2017 , , , ,

While the majority of AI uses slow server-based learning, there is another way.. the brain way.

Neurala’s CTO talk at the nVidia conference GTC 2017 in Santa Clara goes over drawbacks of current AI implementations, and introduces Lifelong Deep Neural Networks, or L-DNN.

Based on patent-pending technology developed at the Boston-based company Neurala, L-DNN enable machines to learn instantaneously at the device (or computing Edge) while performing a task. The technology unlocks a number of use cases that otherwise would be impossible with traditional server-based backpropagation approaches.

More info here, talk below.

 

 

Talk abstract: Neurala CTO Anatoly Gorshechnikov on Lifelong Deep Learning Neural Networks. One of the major hassles of Deep Learning is the need to fully retrain the network on server every time new data becomes available in order to preserve the previous knowledge. This is called ‘catastrophic forgetting’ and severely impairs the ability to develop a truly autonomous AI. We present the patent pending technology that allows us to solve this problem by simply training on the fly the new object without retraining of the old. Our results not only show state of the art accuracy, but real time performance suitable for deployment of AI directly on the edge, thus moving AI out of the server room and into the hands of consumers. Imagine a toy that can learn to recognize and react to its owner or a drone that can learn and detect objects of interest identified while in flight. (Recorded at the NVIDIA GTC Conference in 2017 at San Jose.)

By maxversace

Related Post

Media Coverage Talks

TEDx Cortina

Jul 17, 2023 maxversace
Talks

How can my turtle (AI discovery) make it to the ocean?

Jun 5, 2023 maxversace
Talks

SDIAFest 2022

Dec 2, 2022 maxversace
23,631 thoughts on “Forget Catastrophic Forgetting: the path to Deep Learning at the Edge”

  1. Thank you for your entire labor on this web site. My mom really loves managing investigations and it is obvious why. My partner and i learn all regarding the lively tactic you present sensible things through your web site and in addition invigorate response from some others on the situation then our favorite princess is really starting to learn a whole lot. Take advantage of the rest of the year. You have been doing a stunning job.

    Reply

  2. Thanks for your tips. One thing we have noticed is always that banks and also financial institutions have in mind the spending behavior of consumers and also understand that a lot of people max away their own credit cards around the holiday seasons. They prudently take advantage of this kind of fact and begin flooding the inbox and also snail-mail box together with hundreds of Zero APR card offers immediately after the holiday season finishes. Knowing that in case you are like 98% of all American open public, you’ll hop at the opportunity to consolidate personal credit card debt and move balances for 0 interest rates credit cards. fffeegk https://headachemedi.com – best Headache medication

    Reply

  133. I truly love your website.. Pleasant colors & theme.
    Did you build this amazing site yourself? Please reply back
    as I’m trying to create my own personal site and would like to know where you got this from or just what the theme is named.

    Cheers!

    Reply

  135. Hi, I do think this is a great website. I stumbledupon it ;
    ) I may come back once again since I saved as a favorite
    it. Money and freedom is the greatest way to change, may you
    be rich and continue to guide other people.

    Reply

  138. I’ve been browsing online more than 3 hours today, yet I never found any interesting
    article like yours. It’s pretty worth enough for me. Personally, if all website owners and bloggers made good content as
    you did, the internet will be a lot more useful than ever before.

    Reply

  140. I’ve been browsing online more than 2 hours today,
    yet I never found any interesting article like yours.
    It’s pretty worth enough for me. In my opinion, if all web owners and bloggers made good content as you did,
    the internet will be much more useful than ever before.

    Reply

  142. Hi, I do believe this is a great web site. I stumbledupon it 😉
    I will revisit yet again since I saved as a favorite it. Money
    and freedom is the best way to change, may you be rich and continue to guide
    other people.

    Reply

  143. I just couldn’t depart your web site before suggesting
    that I actually enjoyed the standard info an individual supply
    to your guests? Is going to be back incessantly to investigate cross-check new posts

    Reply

  147. We’re a gaggle of volunteers and starting a brand new scheme in our community.
    Your web site offered us with valuable info to work on. You’ve done an impressive activity and our entire group can be grateful to you.

    Reply

  149. Its such as you learn my mind! You appear to grasp a lot about this, such as you wrote
    the e book in it or something. I think that you could do with a few percent to
    drive the message home a bit, but instead of that, that is excellent blog.

    A fantastic read. I will certainly be back.

    Reply

  151. Hello there! This blog post couldn’t be written any better!
    Looking through this post reminds me of
    my previous roommate! He always kept preaching about
    this. I’ll forward this article to him. Fairly certain he’s going to have a very good read.
    I appreciate you for sharing!

    Reply

  155. I’ve been surfing online more than three hours today, but I never found any attention-grabbing article like yours.
    It’s pretty price sufficient for me. In my view, if all webmasters
    and bloggers made good content as you probably did, the net
    will probably be a lot more useful than ever before.

    Reply

  156. Its like you read my mind! You seem to know so much about this, such as you wrote
    the book in it or something. I believe that you could do with some % to power the message house a bit, but instead of that,
    this is magnificent blog. A great read. I’ll definitely be back.

    Reply

  161. It is appropriate time to make some plans for the future and it
    is time to be happy. I’ve learn this post and if I could I want to suggest you few attention-grabbing
    issues or advice. Perhaps you can write subsequent articles referring to this article.
    I wish to learn even more issues about it!

    Reply

  162. Howdy would you mind sharing which blog platform you’re working with?

    I’m planning to start my own blog soon but I’m having a
    hard time deciding between BlogEngine/Wordpress/B2evolution and Drupal.

    The reason I ask is because your design and style seems different then most blogs and I’m
    looking for something unique. P.S My apologies for being off-topic but I had to ask!

    Reply

  189. I have realized that car insurance corporations know the vehicles which are liable to accidents and various risks. Additionally they know what style of cars are given to higher risk as well as the higher risk they may have the higher a premium charge. Understanding the straightforward basics regarding car insurance can help you choose the right form of insurance policy that can take care of your requirements in case you get involved in an accident. Many thanks for sharing the ideas with your blog.

    Reply

  194. I simply could not depart your web site before suggesting that I extremely enjoyed the usual info a person provide in your visitors?
    Is gonna be again often in order to check out new posts

    Reply

  198. I have been surfing online more than 2 hours today, yet I never found any interesting article like yours.

    It is pretty worth enough for me. Personally, if all web owners and bloggers made good content as you did, the web will be
    a lot more useful than ever before.

    Reply

  200. One other thing I would like to say is that in place of trying to suit all your online degree tutorials on days that you end work (since the majority people are fatigued when they get home), try to have most of your sessions on the weekends and only a couple of courses for weekdays, even if it means a little time off your saturdays. This is beneficial because on the saturdays and sundays, you will be more rested along with concentrated with school work. Thanks for the different guidelines I have mastered from your blog.

    Reply

  205. Thanks for the several tips discussed on this blog. I have realized that many insurance companies offer buyers generous reductions if they favor to insure many cars together. A significant variety of households possess several automobiles these days, particularly those with mature teenage youngsters still residing at home, plus the savings upon policies could soon begin. So it pays to look for a bargain.

    Reply

  208. I’m not sure where you are getting your info, but great topic.

    I needs to spend some time learning more or understanding more.
    Thanks for fantastic information I was looking for this info for my mission.

    Reply

  211. I’ve been surfing online more than 4 hours today, yet I never found any interesting article like yours.
    It is pretty worth enough for me. Personally, if all
    web owners and bloggers made good content
    as you did, the internet will be a lot more useful than ever before.

    Reply

  230. I’m extremely impressed with your writing skills as well
    as with the layout on your blog. Is this a paid
    theme or did you customize it yourself? Either way keep up the nice quality writing, it’s rare to see a
    nice blog like this one these days.wholesale nhl jerseys

    Reply

  246. Hi! I’m at work surfing around your blog from my new iphone 4!
    Just wanted to say I love reading through yourr blog and look forward tto
    all your posts! Keep up the outstanding work!

    Reply

  248. Hey there would you mind sharing which blog platform you’re working with?
    I’m going to start my own blog soon but I’m having
    a hard time selecting between BlogEngine/Wordpress/B2evolution and Drupal.

    The reason I ask is because your design and style seems different then most blogs and I’m looking for something unique.
    P.S Sorry for getting off-topic but I had to ask!

    Reply

  253. I have been surfing online greater than 3 hours lately, but
    I never found any attention-grabbing article like yours.
    It is pretty value sufficient for me. Personally, if all webmasters and bloggers made good content as
    you probably did, the net will be much more useful than ever before.

    Reply

  256. If you need to receive more Gems and Coins for Pokemon Duel while utilizing
    Pokemon Duel generator Tool then be happy to simply use the Pokemon Duel Cheats once more.

    Reply

  264. It’s appropriate time to make some plans
    for the future and it is time to be happy. I
    have read this post and if I could I wish to suggest you some interesting
    things or suggestions. Maybe you could write next articles referring to this article.

    I desire to read more things about it!

    Reply

  276. Howdy! This article could not be written much better!
    Looking at this post reminds me of my previous roommate! He
    constantly kept talking about this. I am going to forward this
    information to him. Pretty sure he’s going to have a very good read.
    Thank you for sharing!

    Reply

  280. It is appropriate time to make a few plans for the longer term and it’s
    time to be happy. I’ve read this publish and if I may
    I wish to recommend you some attention-grabbing things or advice.
    Maybe you can write next articles regarding this article.
    I want to read more issues approximately it!

    Reply

  443. Magnificent beat ! I wish to apprentice while you amend your website, how can i
    subscribe for a weblog web site? The account aided me a acceptable deal.
    I had been a little bit acquainted of this your broadcast offered shiny clear idea

    Reply

  447. I was curious if you ever considered changing the page layout of your website?
    Its very well written; I love what youve got to say. But maybe you could a little more in the way of
    content so people could connect with it better.

    Youve got an awful lot of text for only having 1 or two images.
    Maybe you could space it out better?

    Reply

  512. Good day! I could have sworn I’ve been to this website before but after reading through some of the post I realized it’s new to me. Anyways, I’m definitely delighted I found it and I’ll be bookmarking and checking back often!

    Reply

  513. When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get three emails with the same comment. Is there any way you can remove me from that service? Cheers!

    Reply

  515. Hey just wanted to give you a quick heads up. The text in your content seem to be running off the screen in Firefox. I’m not sure if this is a format issue or something to do with web browser compatibility but I figured I’d post to let you know. The layout look great though! Hope you get the issue fixed soon. Thanks

    Reply

  569. What i don’t understood is in reality how you are no longer actually a lot more well-appreciated than you might be now. You’re so intelligent. You already know therefore considerably in relation to this subject, made me in my opinion consider it from a lot of various angles. Its like men and women don’t seem to be fascinated unless it is one thing to do with Girl gaga! Your individual stuffs great. At all times care for it up!

    Reply

  570. you’re truly a excellent webmaster. The web site loading speed is incredible. It kind of feels that you’re doing any distinctive trick. In addition, The contents are masterwork. you’ve performed a wonderful job in this subject!

    Reply

  571. Pretty portion of content. I just stumbled upon your blog and in accession capital to say that I get actually loved account your blog posts. Any way I’ll be subscribing in your feeds and even I achievement you get right of entry to persistently quickly.

    Reply

  573. Do you mind if I quote a few of your articles as long as I provide credit and sources back to your website? My blog is in the very same area of interest as yours and my visitors would really benefit from some of the information you present here. Please let me know if this ok with you. Thanks!

    Reply

  574. Attractive component of content. I simply stumbled upon your blog and in accession capital to assert that I acquire in fact enjoyed account your weblog posts. Anyway I’ll be subscribing for your augment and even I fulfillment you get right of entry to consistently rapidly.

    Reply

  575. Howdy! I’m at work browsing your blog from my new apple iphone! Just wanted to say I love reading through your blog and look forward to all your posts! Keep up the great work!

    Reply

  576. Hey there, You’ve done an incredible job. I’ll certainly digg it and personally recommend to my friends. I am confident they will be benefited from this web site.

    Reply

  581. Hi, i think that i noticed you visited my web site so i came to “go back the favor”.I’m trying to find issues to improve my site!I assume its ok to make use of some of your ideas!!

    Reply