General Lab Information

Computation and Data-Driven Discovery (C3D) Projects

Text Mining the Scientific Literature for X-ray Absorption Spectroscopy

Text mining is the process of automatically extracting meaningful information from large volumes of unstructured text data that can be directly presented to users or put into structured formats for populating databases. The National Synchrotron Light Source II (NSLS-II) is an emerging leader in x-ray spectroscopy with 25 beamlines in operation and additional ones under construction that enable scientific discoveries in clean and affordable energy, high-temperature superconductivity, and macromolecular crystallography. During the short period of time users spend at NSLS-II beamlines for their experiments (typically several four-hour sessions over 48 hours), they compare their sample spectra to those of well-characterized reference samples and adjust the measurement parameters. It is advantageous for users to find comparable spectra quickly from the scientific literature while at the beamline. This is a complex information need as X-ray spectroscopy is a widely used method in many different disciplines, and traditional search engines return numerous irrelevant papers.

figure 1

Figure 1: Classification of scientific articles in the TDM system.

This effort involved designing a pilot system for Text and Data Mining (TDM) to provide direction for answering users’ complex information needs. The TDM system builds a data collection, extracts pertinent information from the scientific literature related to X-ray spectroscopy, and presents it to users in a web-based portal. First, papers are classified according to 30 transition metals and their edges (K,L,M) (Figure 1). To perform the classification, figure captions have been analyzed using heuristic rules developed with the help of domain experts. The rules examine chemical elements, X-ray absorption spectroscopy (XAS) technique, and the type of edge in the figure captions.

For papers chosen by the user, figures are extracted and presented with their captions (Figure 2). Because captions often do not contain sufficient information and to minimize the amount of time beamline users spend on reviewing entire papers, explanatory text relevant to each figure is extracted from the article text via a contextualized word embedding model and presented to users. The model compares figure captions with the body text of an article and finds the most similar sentences to present to users. A feedback button allows users to indicate how relevant these text snippets are to the presented figure and provides developers with feedback to improve the system.

figure 2

Figure 2: Extracted figure with its caption and explanatory text from the article body. (Image courtesy of Yong, Z., Liu, T., Uruga, T., Tanida, H., Qi, D., Rusydi, A., and Wee, A. T. (2010). Ti-doped ZnO thin films prepared at different ambient conditions: electronic structures and magnetic properties. Materials, 3(6), 3642-3653.


Park, G., Pouchard, L. “Scientific Literature Mining for Experiment Information in Materials Design.” Proceedings of the IEEE New York Scientific Data Summit (NYSDS), New York, NY, 2019. November 2019. DOI: 10.1109/NYSDS.2019.8909726.

Park, G., J. Rayz , and L. Pouchard, Figure Descriptive Text Extraction using Ontological Representation, 33rd International FLAIRS Conference, May 2020.

Project Link (accessible with a BNL Guest appointment)