Life Sciences Success Story

Applying Visual Data Analysis Techniques to Ultrasound Images


"It's what you interpret from the results of your studies that's important, and that is what the PV-WAVE has given us -- a new way to interpret our data and better ways to manipulate it”


-Roger Pierson, Reproductive Biology Research Unit Director,
University of Saskatchewan

QUICK FACTS
Researchers at the University of Saskatchewan in the Department of Obstetrics and Gynecology are using Visual Numerics’ PV-WAVE to create visual data analysis (VDA) applications to conduct an in-depth study on aspects of infertility and contraception. The distinctions that they can now make are important in understanding the processes associated with infertility and conception and are helpful in making more accurate predictions based on their data.

THE PROBLEM
The Reproductive Biology Research Unit in the Department of Obstetrics and Gynecology at the University of Saskatchewan, Canada, is mainly concerned with the study of infertility, while providing clinical services to couples who are having difficulty conceiving children, a problem shared by about 20 percent of the North American population.

Like many clinics of this type, researchers rely heavily on ultrasound technology to generate pictures of internal body tissues. But Roger Pierson, an associate professor and the Unit's director, has developed a method to enhance those images, opening new areas of medical inquiry.

Pierson has put together a computer-based system in which preprocessed ultrasound images are acquired by a digital acquisition system as they stream off the digital scan connector within the ultrasound device. They are then ported to a powerful SunTM Microsystems workstation for interrogation with what has come to be called visual data analysis (VDA) software. "We grab the data just before it goes into the video processor and stream it into the computers," Pierson says.

THE SOLUTION
To analyze the data, Pierson and his team use PV-WAVE, a VDA package from Visual Numerics. PV-WAVE includes a fourth-generation language (4GL) for creating custom analysis and visualization routines, along with a library of functions for such tasks as convolution, filtering, and edge enhancement. Advanced math functions include Gaussian integrals, Fast Fourier Transforms (FFT), data point differentiation and interpolation.

"The software does some things exceptionally well, such as intensity mapping over images," Pierson says. "You can flip up an image and make a diagnosis very quickly. It helps keep track of all the images and provides the building blocks for our specialized research and analysis."

John Deptuch, a computer programmer who works with Pierson in the lab, says that the most useful routine is one that allows him to take a two-dimensional array and shade it as a three-dimensional surface, where the height is based on the value in the array. "Writing that routine myself would have been a lot of work," Deptuch says.

Researchers at the University's College of Medicine are using the system in several applications. By studying computerized images of ovarian follicles, for example, they are learning to tell good follicles from bad. Good follicles contain a visible egg and are likely to perform their proper physiologic function. This increases the success rates for conception.

In the long run, the information gathered could help scientists understand how to "turn on" the egg-producing mechanism in cases in which it is not functioning properly. Alternatively, researchers also want to understand how to turn the egg-producing mechanism off for contraceptive purposes. Another very promising area is cancer research. When Pierson and his team turned their equipment to study ovarian tumors, they realized that the visual data analysis could help them diagnose whether a cyst or tumor is malignant or benign based on a computer analysis of its structure.

This insight quickly spread to an interdisciplinary research project to verify the findings. Herb Yang in the University's Computer Science Department works closely with Pierson to guide the research. Today the team includes people throughout the university and medical community, from surgeons to computer graphics specialists, working together to establish a rigorous scientific and statistical basis for expanding these important findings beyond the clinic.

Standard output from an ultrasound machine produces black-and-white images that are studied against a light board or on a video monitor. Whereas most people can only discern about 80 shades of gray through a visual inspection of ultrasound images, Pierson's computer can distinguish 256 shades. The addition of bandwidth filters, superimposed colors, and 3-D visualization techniques from PV-WAVE enables even finer distinctions and variations to be observed.

"For example, during a metastatic process, the blood flow to the organ increases," Pierson explains. “This becomes apparent in an ultrasound image because the soundwaves decrease in their intensity and amplitude. Blood is a fluid, and fluids reflect a lower value echo. But in contrast to standard approaches, the computer can discern subtle differences that would be difficult to detect, such as the difference between amplitude of 130 and amplitude of 150 from a visual perusal of a black-and-white photographic image.”

"Instead of an arbitrary scale of reference, we have exact figures that we can apply against an absolute scale," Pierson observes.

RETURN ON INVESTMENT
The distinctions Pierson can now make are important in understanding the processes associated with infertility because the release of an egg from the follicle is related to blood flow and to the action of the hormones on the tissue of the follicle. For example, when the leutinizing hormone (LH) is present in sufficient quantities to trigger the release of an egg, it causes those cells to hypertrophy. This gives off a different echo-intensity pattern than the pattern received from cells that don't respond to that hormone.

"We can look at the tissue and determine LH response based on tissue response," Pierson says. "If the LH receptors aren't there, the follicle tends to be very thin and bright-walled. The computer allows us to put hard numbers on these subtle changes. From these we can make predictions, such as, within this range of numbers, the likelihood of releasing an egg is 80 percent."

The new techniques are equally useful in the study of contraception. "We're trying to understand what the hormones released by the pituitary gland do to the ovaries on a monthly basis," Pierson explains. "We can use our infertility patients as models of the hormonal state necessary to prevent conception."

Buoyed by their results in infertility and contraception studies, Pierson and his colleagues have now turned to the study and detection of breast tumors to establish whether they can detect lumps that are not apparent through a physical exam, whether they can tell a fast-growing lump from a slow-growing one by its visual patterns, and, ultimately, a fibrocystic lump from a malignancy.

"Based on what we have seen so far, there is a different visual pattern displayed in the benign lumps than there is in the malignant ones, but it is too early to say much more," Pierson says. "We need to be able to identify those different tissue types, and we need to get the segmentation of the image to the point where we can reliably detect the lumps. Then we can begin to apply that knowledge to a generalized screening scan."

It has taken Pierson and his team about five years to perfect the techniques of ultrasound visualization. "It has worked; that's been the thrilling part," Pierson says. "Once you understand the physical components of bouncing sound through someone's body and generating an image from that, everything you do after that is nothing more than standard image-processing," Pierson explains. "It's what you interpret from the results of your studies that's important, and that is what the PV-WAVE software has given us -- a new way to interpret our data and better ways to manipulate it."

WORLD CLASS PRODUCTS, SERVICES, AND SUPPORT
Visual Numerics has provided technical software solutions for numerical analysis and visualization for over 30 years. The company's software products help users understand complex data from a variety of sources and build business-critical applications. Visual Numerics offers two product lines: the IMSL® Numerical Libraries for powerful mathematical and statistical analysis and the PV-WAVE® visual data analysis development environment. Visual Numerics also offers customized consulting services for applications that involve mathematical, statistical, or visual data analysis to meet today’s business analytical needs.

The IMSL Numerical Libraries ­ which include the IMSL C Library, IMSL Fortran Library and JMSL™ Library for Java™ applications ­ are the industry standard for numerical analysis. They deliver developers with the breadth and depth of core algorithms allowing for the rapid development of any application. Whether developing applications in C, Fortran, or Java, or on UNIX, Windows or Linux, the robust IMSL Libraries provide the reliable foundation and the building blocks developers need.

The PV-WAVE family of products ­ which includes PV-WAVE, TS-WAVE, and JWAVE ­ delivers engineers with the development tools to efficiently and accurately meet their data analysis needs. PV-WAVE solutions allow users to rapidly import, manipulate, analyze and visualize data. The PV-WAVE family also includes robust time series analysis software as well as the ability to share analysis results across the enterprise with a Java-based solution. And, unlike other products, PV-WAVE Advantage includes a sophisticated set of analysis routines based on the industry-standard IMSL Libraries.

In addition, Visual Numerics Consulting Services combine technical expertise, decades of hands-on experience and a combination of powerful products to create the highest quality solutions possible for your visual data analysis needs.

Visual Numerics unique combination of products and services rapidly enhance ROI by delivering the highest efficiency, greatest accuracy and maximum performance.




Industry
Life Sciences

Application
Analysis of Ultra-sound Images

Product
PV-WAVE



The mission of the Department of Obstetrics, Gynecology and Reproductive Sciences at the University of Saskatchewan, is to provide quality educational programs that promote excellence in teaching, research, and professional service. The department has accomplished integrated bench and clinical research through cutting edge research by the reproductive biology research unit.


Key Benefits

> Identify detail in images unable to detect previously
> Intensity mapping over images
> Provides building blocks for specialized research and analysis
> Two dimensional array routines
> 3-D visualization techniques
> Able to interpret and manipulate data effectively
   
   
 
   
 
CompanyProducts & ServicesSolutionsSuccessesSupportDownloadsEmail this page
© Copyright 2008 Visual Numerics, Inc. All Rights Reserved Legal Privacy