Lifelong Deep Neural Networks

“Catastrophic forgetting,” is a major hurdle toward fully autonomous artificial intelligence. In a video interview, Anatoli Gorchechnikov, co-founder of Neurala, discusses current trends in AI and the need to overcome this problem.

If there’s one thing we’d like artificial intelligence to overcome it’s forgetfulness. The ultimate aim of deep learning and neural networks is to create algorithms that mimic the human brain. The idea is to reinforce learning by strengthening the “neural” pathways that lead to rewarding actions. Artificial intelligence is already getting better at humans at some very niche and specific tasks, like board games and menial manufacturing tasks. However, in addition to our learning patterns, AI has inherently inhereted another trait of the human mind – our forgetfulness.

Human memory is prone to many flaws, but learning new information and skills usually does not require us to completely re-learn everything that came before it. Not the case with AI. Once a system is trained and deployed, in order to add anything new to it, it has to be re-trained and re-deployed all over again. Imagine having to start from scratch any time a new task was added to your job. It’s a time suck at best and at worst could lead to huge losses of money and productivity.

It’s a phenomenon called “catastrophic forgetting,” and it’s one of the biggest hurdles to developing truly autonomous AI.

Ahead of his talk at ESC Boston, Anatoly Gorshechnikov, the co-founder and CTO of artificial intelligence company Neurala sat down with Design News to discuss the current state of AI, “catastrophic forgetting,” and the need for AI systems that can learn on the fly.

Watch the full interview below and for more updates be sure to follow Design News on Facebook.

Ahead of his talk at ESC Boston, Anatoli Gorchechnikov, the co-founder and CTO of artificial intelligence company Neurala discusses the current state of AI, "catastrophic forgetting," and the need for AI systems that can learn on the fly. You can find out more about Anatoli and his talk at: www.ESC-Boston.com

Posted by Design News on Wednesday, April 11, 2018

12 thoughts on “Overcoming the Catastrophe of Forgetful AI”
  1. I am commenting to let you know of the fine encounter my friend’s daughter found reading your site. She figured out many issues, not to mention what it’s like to have a wonderful giving mindset to have men and women quite simply have an understanding of selected hard to do subject areas. You really exceeded our expectations. Many thanks for giving the insightful, safe, explanatory and as well as easy thoughts on the topic to Jane.

  2. I wanted to post you that tiny remark to say thanks a lot over again just for the nice secrets you have featured in this case. It was really seriously open-handed with you to grant publicly just what many individuals might have offered for an ebook to generate some dough for themselves, mostly now that you might have tried it in case you desired. These principles as well served to be a good way to fully grasp that other people online have the identical fervor much like my personal own to know the truth many more regarding this matter. I am sure there are numerous more pleasant periods in the future for many who looked over your site.

  3. I am only writing to make you understand what a remarkable experience our princess undergone viewing your webblog. She picked up such a lot of things, with the inclusion of what it is like to possess an ideal teaching spirit to make the mediocre ones without difficulty master specified tortuous topics. You undoubtedly surpassed readers’ expected results. Thanks for rendering those useful, trustworthy, revealing as well as unique tips on your topic to Sandra.

  4. I am just writing to make you understand what a notable experience my wife’s girl had using your web site. She mastered so many pieces, which included what it is like to possess an excellent helping nature to let other people with ease learn some problematic things. You truly surpassed people’s expected results. Thank you for producing these precious, trusted, informative and in addition fun tips about this topic to Lizeth.

  5. Hello

    YOU NEED QUALITY VISITORS FOR YOUR: maxversace.com ?

    WE PROVIDE HIGH-QUALITY VISITORS WITH:
    – 100% safe for your site
    – real visitors with unique IPs. No bots, proxies, or datacenters
    – visitors from Search Engine (by keyword)
    – visitors from Social Media Sites (referrals)
    – visitors from any country you want (USA/UK/CA/EU…)
    – very low bounce rate
    – very long visit duration
    – multiple pages visited
    – tractable in google analytics
    – custom URL tracking provided
    – boost ranking in SERP, SEO, profit from CPM

    CLAIM YOUR 24 HOURS FREE TEST HERE=> ventfara@mail.com

    Thanks, Sophia Oxendine

  6. Hello

    YOU NEED HELP TO BUILD SEO LINKS FOR: maxversace.com ?

    I just checked out your website, and wanted to find out if you need help for SEO Link Building ?

    WE OFFER YOU THE BEST SEO STRATEGY FOR 2021.

    Build an unlimited number of Backlinks and increase Traffic to your websites which will lead to a higher number of customers and much more sales for you.

    If You Are Interested, I’m waiting for your response here => seosubmitter@mail.com

    Thanks, Ignacio Titheradge

  7. Bạn đã biết danh sách giống mèo hiện tại chưa. Mèo là vật nuôi được nhiều người quý mến nhất hiện nay. Thế nhưng bạncòn chưa có đủ học tập để phân biệt các giống mèo. Việc lựa chọn một chú mèo về làm thú cưng không đơn thuần chỉ là mua và bán nếu bạn không hiểu tính cách và lối sống của chúng thì chắc chắn rằng chúng sẽ bị bệnh ngay lập tức.

  8. Hello

    YOU NEED QUALITY VISITORS FOR YOUR: maxversace.com ?

    WE PROVIDE HIGH-QUALITY VISITORS WITH:
    – 100% safe for your site
    – real visitors with unique IPs. No bots, proxies, or datacenters
    – visitors from Search Engine (by keyword)
    – visitors from Social Media Sites (referrals)
    – visitors from any country you want (USA/UK/CA/EU…)
    – very low bounce rate
    – very long visit duration
    – multiple pages visited
    – tractable in google analytics
    – custom URL tracking provided
    – boost ranking in SERP, SEO, profit from CPM

    CLAIM YOUR 24 HOURS FREE TEST HERE=> ventfara@mail.com

    Thanks, Darby Soderlund

Leave a Reply

Your email address will not be published.

I accept that my given data and my IP address is sent to a server in the USA only for the purpose of spam prevention through the Akismet program.More information on Akismet and GDPR.