• HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
Thursday, August 7, 2025
BIOENGINEER.ORG
No Result
View All Result
  • Login
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
No Result
View All Result
Bioengineer.org
No Result
View All Result
Home NEWS Science News

Rice, Intel optimize AI training for commodity hardware

Bioengineer by Bioengineer
April 7, 2021
in Science News
Reading Time: 4 mins read
0
Share on FacebookShare on TwitterShare on LinkedinShare on RedditShare on Telegram

CPU algorithm trains deep neural nets up to 15 times faster than top GPU trainers

IMAGE

Credit: Photo by Jeff Fitlow/Rice University

HOUSTON — (April 7, 2021) — Rice University computer scientists have demonstrated artificial intelligence (AI) software that runs on commodity processors and trains deep neural networks 15 times faster than platforms based on graphics processors.

“The cost of training is the actual bottleneck in AI,” said Anshumali Shrivastava, an assistant professor of computer science at Rice’s Brown School of Engineering. “Companies are spending millions of dollars a week just to train and fine-tune their AI workloads.”

Shrivastava and collaborators from Rice and Intel will present research that addresses that bottleneck April 8 at the machine learning systems conference MLSys.

Deep neural networks (DNN) are a powerful form of artificial intelligence that can outperform humans at some tasks. DNN training is typically a series of matrix multiplication operations, an ideal workload for graphics processing units (GPUs), which cost about three times more than general purpose central processing units (CPUs).

“The whole industry is fixated on one kind of improvement — faster matrix multiplications,” Shrivastava said. “Everyone is looking at specialized hardware and architectures to push matrix multiplication. People are now even talking about having specialized hardware-software stacks for specific kinds of deep learning. Instead of taking an expensive algorithm and throwing the whole world of system optimization at it, I’m saying, ‘Let’s revisit the algorithm.'”

Shrivastava’s lab did that in 2019, recasting DNN training as a search problem that could be solved with hash tables. Their “sub-linear deep learning engine” (SLIDE) is specifically designed to run on commodity CPUs, and Shrivastava and collaborators from Intel showed it could outperform GPU-based training when they unveiled it at MLSys 2020.

The study they’ll present this week at MLSys 2021 explored whether SLIDE’s performance could be improved with vectorization and memory optimization accelerators in modern CPUs.

“Hash table-based acceleration already outperforms GPU, but CPUs are also evolving,” said study co-author Shabnam Daghaghi, a Rice graduate student. “We leveraged those innovations to take SLIDE even further, showing that if you aren’t fixated on matrix multiplications, you can leverage the power in modern CPUs and train AI models four to 15 times faster than the best specialized hardware alternative.”

Study co-author Nicholas Meisburger, a Rice undergraduate, said “CPUs are still the most prevalent hardware in computing. The benefits of making them more appealing for AI workloads cannot be understated.”

###

Additional co-authors include Mengnan Zhao of Rice, Sameh Gobriel and Charlie Tai of Intel, and Yong Wu, formerly of Intel and now with Ant Labs.

The research was supported by the National Science Foundation (1652131, 1838177), the Air Force Office of Scientific Research (FA9550-18-1-0152) and the Office of Naval Research.

The MLSys 2021 paper on SLIDE is available at: https://proceedings.mlsys.org/paper/2021/file/3636638817772e42b59d74cff571fbb3-Paper.pdf

High-resolution IMAGES are available for download at:

https://news-network.rice.edu/news/files/2020/03/1209_SLIDE-as028-16-lg.jpg

CAPTION: Anshumali Shrivastava (Photo by Jeff Fitlow/Rice University)

https://news-network.rice.edu/news/files/2021/04/0406_SLIDE2-sd-lg.jpg

CAPTION: Shabnam Daghaghi (Photo courtesy of S. Daghaghi)

https://news-network.rice.edu/news/files/2021/04/0406_SLIDE2-nm-lg.jpg

CAPTION: Nicholas Meisburger (Photo courtesy of N. Meisburger)

Related research from Rice:

Bad news for fake news: Rice research helps combat social media misinformation – Dec. 10, 2020

https://news.rice.edu/2020/12/10/bad-news-for-fake-news-rice-research-helps-combat-social-media-misinformation/

Deep learning rethink overcomes major obstacle in AI industry – March 2, 2020

https://news.rice.edu/2020/03/02/deep-learning-rethink-overcomes-major-obstacle-in-ai-industry/

Rice, Amazon report breakthrough in ‘distributed deep learning’ – Dec. 9, 2019

https://news.rice.edu/2020/03/02/deep-learning-rethink-overcomes-major-obstacle-in-ai-industry/

Rice U. scientists slash computations for ‘deep learning’ – June 1, 2017

http://news.rice.edu/2017/06/01/rice-u-scientists-slash-computations-for-deep-learning/

This release can be found online at news.rice.edu.

Follow Rice News and Media Relations via Twitter @RiceUNews.

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,978 undergraduates and 3,192 graduate students, Rice’s undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for lots of race/class interaction and No. 1 for quality of life by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance.

Media Contact
Jade Boyd
[email protected]

Tags: Computer ScienceHardwareRobotry/Artificial IntelligenceSoftware EngineeringTechnology/Engineering/Computer ScienceTheory/Design
Share12Tweet8Share2ShareShareShare2

Related Posts

blank

Suspected Group A Strep Transmission During Autopsy

August 7, 2025
blank

How Ingredients Affect Tomato Ketchup’s Water Mobility

August 7, 2025

Tackling Pediatric Anemia in Asia’s Low-SDI Regions

August 7, 2025

Duloxetine Blocks Breast Cancer via AKT and Apoptosis

August 7, 2025
Please login to join discussion

POPULAR NEWS

  • blank

    Neuropsychiatric Risks Linked to COVID-19 Revealed

    75 shares
    Share 30 Tweet 19
  • Overlooked Dangers: Debunking Common Myths About Skin Cancer Risk in the U.S.

    61 shares
    Share 24 Tweet 15
  • Predicting Colorectal Cancer Using Lifestyle Factors

    46 shares
    Share 18 Tweet 12
  • Modified DASH Diet Reduces Blood Sugar Levels in Adults with Type 2 Diabetes, Clinical Trial Finds

    41 shares
    Share 16 Tweet 10

About

We bring you the latest biotechnology news from best research centers and universities around the world. Check our website.

Follow us

Recent News

Suspected Group A Strep Transmission During Autopsy

How Ingredients Affect Tomato Ketchup’s Water Mobility

Tackling Pediatric Anemia in Asia’s Low-SDI Regions

  • Contact Us

Bioengineer.org © Copyright 2023 All Rights Reserved.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Homepages
    • Home Page 1
    • Home Page 2
  • News
  • National
  • Business
  • Health
  • Lifestyle
  • Science

Bioengineer.org © Copyright 2023 All Rights Reserved.