• HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
Wednesday, October 8, 2025
BIOENGINEER.ORG
No Result
View All Result
  • Login
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
  • HOME
  • NEWS
  • EXPLORE
    • CAREER
      • Companies
      • Jobs
        • Lecturer
        • PhD Studentship
        • Postdoc
        • Research Assistant
    • EVENTS
    • iGEM
      • News
      • Team
    • PHOTOS
    • VIDEO
    • WIKI
  • BLOG
  • COMMUNITY
    • FACEBOOK
    • INSTAGRAM
    • TWITTER
No Result
View All Result
Bioengineer.org
No Result
View All Result
Home NEWS Science News Chemistry

3D camera earns its stripes at Rice

Bioengineer by Bioengineer
September 24, 2020
in Chemistry
Reading Time: 6 mins read
0
IMAGE
Share on FacebookShare on TwitterShare on LinkedinShare on RedditShare on Telegram

Engineers develop Hyperspectral Stripe Projector to quickly merge depth, spectral data

IMAGE

Credit: Kelly Lab/Rice University

HOUSTON – (Sept. 24, 2020) – Stripes are in fashion this season at a Rice University lab, where researchers use them to make images that plain cameras could never capture.

Their compact Hyperspectral Stripe Projector (HSP) is a step toward a new method to collect the spatial and spectral information required for self-driving cars, machine vision, crop monitoring, surface wear and corrosion detection and other applications.

“I can envision this technology in the hands of a farmer, or on a drone, to look at a field and see not only the nutrients and water content of plants but also, because of the 3D aspect, the height of the crops,” said Kevin Kelly, an associate professor of electrical and computer engineering at Rice’s Brown School of Engineering. “Or perhaps it can look at a painting and see the surface colors and texture in detail, but with near-infrared also see underneath to the canvas.”

Kelly’s lab could enable 3D spectroscopy on the fly with a system that combines the HSP, a monochrome sensor array and sophisticated programming to give users a more complete picture of an object’s shape and composition.

“We’re getting four-dimensional information from an image, three spatial and one spectral, in real time,” Kelly said. “Other people use multiple modulators and thus require bright light sources to accomplish this, but we found we could do it with a light source of normal brightness and some clever optics.”

The work by Kelly, lead author and Rice alumna Yibo Xu and graduate student Anthony Giljum is detailed in an open-access paper in Optics Express.

HSP takes a cue from portable 3D imaging techniques that are already in consumers’ hands — think of face ID systems in smartphones and body trackers in gaming systems — and adds a way to pull broad spectral data from every pixel captured. This compressed data is reconstructed into a 3D map with spectral information that can incorporate hundreds of colors and be used to reveal not only the shape of an object but also its material composition.

“Regular RGB (red, green, blue) cameras basically give you only three spectral channels,” Xu said. “But a hyperspectral camera gives us spectra in many, many channels. We can capture red at around 700 nanometers and blue at around 400 nanometers, but we can also have bandwidths at every few nanometers or less between. That gives us fine spectral resolution and a fuller understanding of the scene.

“HSP simultaneously encodes the depth and hyperspectral measurements in a very simple and efficient way, allowing the use of a monochrome camera instead of an expensive hyperspectral camera as typically used in similar systems,” said Xu, who earned her doctorate at Rice in 2019 and is now a machine learning and computer vision research engineer at Samsung Research America Inc. She developed both the hardware and reconstruction software as part of her thesis in Kelly’s lab.

HSP uses an off-the-shelf digital micromirror device (DMD) to project patterned stripes that look something like colorful bar codes onto a surface. Sending the white-light projection through a diffraction grating separates the overlapping patterns into colors.

Each color is reflected back to the monochrome camera, which assigns a numerical grey level to that pixel.

Each pixel can have multiple levels, one for every color stripe it reflects. These are recombined into an overall spectral value for that part of the object.

“We use a single DMD and a single grating in HSP,” Xu said. “The novel optical design of folding the light path back to the same diffraction grating and lens is what makes it really compact. The single DMD allows us to keep the light we want and throw away the rest.”

These finely tuned spectra can reach beyond visible light. What they reflect back to the sensor as multiplexed fine-band spectra can be used to identify the material’s chemical composition.

At the same time, distortions in the pattern are reconstructed into 3D point clouds, essentially a picture of the target, but with a lot more data than a plain snapshot could provide.

Kelly envisions HSP built into car headlights that can see the difference between an object and a person. “It could never get confused between a green dress and a green plant, because everything has its own spectral signature,” he said.

Kelly believes the lab will eventually incorporate ideas from Rice’s groundbreaking single-pixel camera to further reduce the size of the device and adapt it for compressive video capture as well.

The National Science Foundation funded the research.

###

Read the paper at https://www.osapublishing.org/oe/fulltext.cfm?uri=oe-28-20-29740&id=439837

This news release can be found online at https://news.rice.edu/2020/09/24/3d-camera-earns-its-stripes-at-rice/

Follow Rice News and Media Relations via Twitter @RiceUNews

Related materials:

Single-pixel camera has multiple futures: http://news.rice.edu/2008/10/14/single-pixel-camera-has-multiple-futures/

Kevin Kelly: https://profiles.rice.edu/faculty/kevin-f-kelly

Department of Electrical and Computer Engineering: https://eceweb.rice.edu

George R. Brown School of Engineering: https://engineering.rice.edu

Video:

https://youtu.be/ddcIhxOX-Hs

CAPTION: Rice University engineers turned a set of monochrome camera captures from a 3D hyperspectral imaging system based on the Hyperspectral Stripe Projector into 4D data of spatial and spectral information. This video demonstrates the spatial reconstruction of the targets. (Credit: Kelly Lab/Rice University)
Images for download:

https://news-network.rice.edu/news/files/2020/09/0928_PROJECTOR-1-WEB.jpg

Patterns adorns a static model used to test Rice University’s Hyperspectral Stripe Projector, which combines spectroscopic and 3D imaging. Barcode-like black and white patterns are displayed on the DMD to generate the hyperspectral stripes. (Credit: Kelly Lab/Rice University)

https://news-network.rice.edu/news/files/2020/09/0928_PROJECTOR-2-WEB.jpg

A 3D point cloud of objects reconstructed by Rice University’s Hyperspectral Stripe Projector- based imaging system. The monochrome camera also captures spectral data for each point to provide not only the target’s form but also its material composition. (Credit: Kelly Lab/Rice University)

https://news-network.rice.edu/news/files/2020/09/0928_PROJECTOR-5-web.jpg

A target and its point cloud image show one capability of Rice University’s Hyperspectral Stripe Projector, which acquires 3D data and spectral data for each point to provide not only the target’s form but also its material composition. (Credit: Kelly Lab/Rice University)

https://news-network.rice.edu/news/files/2020/09/0928_PROJECTOR-3-WEB.jpg

Rice University engineers Kevin Kelly and Yibo Xu lead the development of the Hyperspectral Stripe Projector, which combines the capture of spectroscopic data of an object with 3D imaging into a single system that uses a monochrome camera as the sensor instead of a hyperspectral camera. (Credit: Kelly Lab/Rice University)

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 3,978 undergraduates and 3,192 graduate students, Rice’s undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for lots of race/class interaction and No. 1 for quality of life by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance.

Jeff Falk
713-348-6775
[email protected]

Mike Williams
713-348-6728
[email protected]

Media Contact
Jeff Falk
[email protected]

Original Source

https://news.rice.edu/2020/09/24/3d-camera-earns-its-stripes-at-rice/

Related Journal Article

http://dx.doi.org/10.1364/OE.402812

Tags: Computer ScienceHardwareMultimedia/Networking/Interface DesignOpticsSoftware EngineeringTechnology/Engineering/Computer ScienceVehicles
Share12Tweet8Share2ShareShareShare2

Related Posts

Rice University Unveils Second Cohort of Chevron Energy Graduate Fellows

Rice University Unveils Second Cohort of Chevron Energy Graduate Fellows

October 7, 2025
Covalent Organic Frameworks: Building Infinite Metal–Organic Structures

Covalent Organic Frameworks: Building Infinite Metal–Organic Structures

October 7, 2025

Next-Generation Perovskite Solar Cells Near Commercialization Milestone

October 7, 2025

Unlocking Clean Energy: Harvesting Hydrogen from Biomass Significantly Cuts Carbon Emissions

October 7, 2025
Please login to join discussion

POPULAR NEWS

  • Sperm MicroRNAs: Crucial Mediators of Paternal Exercise Capacity Transmission

    972 shares
    Share 388 Tweet 243
  • New Study Reveals the Science Behind Exercise and Weight Loss

    99 shares
    Share 40 Tweet 25
  • New Study Indicates Children’s Risk of Long COVID Could Double Following a Second Infection – The Lancet Infectious Diseases

    95 shares
    Share 38 Tweet 24
  • Ohio State Study Reveals Protein Quality Control Breakdown as Key Factor in Cancer Immunotherapy Failure

    77 shares
    Share 31 Tweet 19

About

We bring you the latest biotechnology news from best research centers and universities around the world. Check our website.

Follow us

Recent News

Whole Genome Sequencing Could Benefit 15,000 Women Diagnosed with Breast Cancer Annually, Researchers Reveal

Short bursts of exercise could enhance cardiorespiratory fitness in inactive adults, study finds

Integrating Consensus Standards in BME Education through Tensile Testing

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 63 other subscribers
  • Contact Us

Bioengineer.org © Copyright 2023 All Rights Reserved.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Homepages
    • Home Page 1
    • Home Page 2
  • News
  • National
  • Business
  • Health
  • Lifestyle
  • Science

Bioengineer.org © Copyright 2023 All Rights Reserved.