The following news release was issued by Purdue University. Yimei Zhu, a physicist at the U.S. Department of Energy’s Brookhaven National Laboratory, and a Shaobo Cheng, a former postdoctoral fellow working with Zhu, are co-authors on the paper. Zhu and Cheng used transmission electron microscopes in the Condensed Matter Physics and Materials Science Department at Brookhaven to study device interfaces and defects including their atomic arrangement, bonding states, and strain distributions. The structure integrity and electronic states determine the performance of the devices, which are being designed to mimic neurons and synapses of the nervous system for new “neuromorphic” approaches to computing and artificial intelligence. For more information about Brookhaven Lab’s role in this research, contact: Karen McNulty Walsh, email@example.com, (631) 344-8350.
The Brain's Secret to Lifelong Learning Can Now Come as Hardware for Artificial Intelligence
February 3, 2022
By Kayla Wiles, Purdue University
An electronic chip that can be reprogrammed on demand may enable artificial intelligence to learn more continuously like the human brain does, researchers have discovered. (Purdue University photo/Rebecca McElhoe)
WEST LAFAYETTE, Ind. — When the human brain learns something new, it adapts. But when artificial intelligence learns something new, it tends to forget information it already learned.
As companies use more and more data to improve how AI recognizes images, learns languages and carries out other complex tasks, a paper published in Science this week shows a way that computer chips could dynamically rewire themselves to take in new data like the brain does, helping AI to keep learning over time.
“The brains of living beings can continuously learn throughout their lifespan. We have now created an artificial platform for machines to learn throughout their lifespan,” said Shriram Ramanathan, a professor in Purdue University’s School of Materials Engineering who specializes in discovering how materials could mimic the brain to improve computing.
Shriram Ramanathan, a Purdue professor of materials engineering, is investigating ways to build artificial intelligence directly into hardware. (Purdue University photo/Rebecca McElhoe)
Unlike the brain, which constantly forms new connections between neurons to enable learning, the circuits on a computer chip don’t change. A circuit that a machine has been using for years isn’t any different than the circuit that was originally built for the machine in a factory.
This is a problem for making AI more portable, such as for autonomous vehicles or robots in space that would have to make decisions on their own in isolated environments. If AI could be embedded directly into hardware rather than just running on software as AI typically does, these machines would be able to operate more efficiently.
In this study, Ramanathan and his team built a new piece of hardware that can be reprogrammed on demand through electrical pulses. Ramanathan believes that this adaptability would allow the device to take on all of the functions that are necessary to build a brain-inspired computer.
“If we want to build a computer or a machine that is inspired by the brain, then correspondingly, we want to have the ability to continuously program, reprogram and change the chip,” Ramanathan said.
Toward building a brain in chip form
The hardware is a small, rectangular device made of a material called perovskite nickelate, which is very sensitive to hydrogen. Applying electrical pulses at different voltages allows the device to shuffle a concentration of hydrogen ions in a matter of nanoseconds, creating states that the researchers found could be mapped out to corresponding functions in the brain.
Michael Park (left) and Qi Wang, Purdue Ph.D. students, test and analyze a chip designed to mimic the learning strategies of the human brain. (Purdue University photo/Rebecca McElhoe)
When the device has more hydrogen near its center, for example, it can act as a neuron, a single nerve cell. With less hydrogen at that location, the device serves as a synapse, a connection between neurons, which is what the brain uses to store memory in complex neural circuits.
Through simulations of the experimental data, the Purdue team’s collaborators at Santa Clara University and Portland State University showed that the internal physics of this device creates a dynamic structure for an artificial neural network that is able to more efficiently recognize electrocardiogram patterns and digits compared with static networks. This neural network uses “reservoir computing,” which explains how different parts of a brain communicate and transfer information.
Researchers from The Pennsylvania State University also demonstrated in this study that as new problems are presented, a dynamic network can “pick and choose” which circuits are the best fit for addressing those problems.
Since the team was able to build the device using standard semiconductor-compatible fabrication techniques and operate the device at room temperature, Ramanathan believes that this technique can be readily adopted by the semiconductor industry.
“We demonstrated that this device is very robust,” said Michael Park, a Purdue Ph.D. student in materials engineering. “After programming the device over a million cycles, the reconfiguration of all functions is remarkably reproducible.”
The researchers are working to demonstrate these concepts on large-scale test chips that would be used to build a brain-inspired computer.
Experiments at Purdue were conducted at the FLEX Lab and Birck Nanotechnology Center of Purdue’s Discovery Park. The team’s collaborators at Argonne National Laboratory, the University of Illinois Chicago, Brookhaven National Laboratory and the University of Georgia conducted measurements of the device’s properties.
The research was supported by the U.S. Department of Energy Office of Science, the Air Force Office of Scientific Research and the National Science Foundation.
About Purdue University
Purdue University is a top public research institution developing practical solutions to today’s toughest challenges. Ranked in each of the last four years as one of the 10 Most Innovative universities in the United States by U.S. News & World Report, Purdue delivers world-changing research and out-of-this-world discovery. Committed to hands-on and online, real-world learning, Purdue offers a transformative education to all. Committed to affordability and accessibility, Purdue has frozen tuition and most fees at 2012-13 levels, enabling more students than ever to graduate debt-free. See how Purdue never stops in the persistent pursuit of the next giant leap at https://purdue.edu/.
Writer, Media contact: Kayla Wiles, 765-494-2432, firstname.lastname@example.org
Source: Shriram Ramanathan, email@example.com
Brookhaven National Laboratory is supported by the Office of Science of the U.S. Department of Energy. The Office of Science is the single largest supporter of basic research in the physical sciences in the United States and is working to address some of the most pressing challenges of our time. For more information, visit science.energy.gov.
2022-19408 | INT/EXT | Newsroom