Skip to : [Content] [Navigation]

 

LABORATORY AUTOMATION

A fully automated instrument for molecular diagnostics

Second-generation nucleic acid amplification testing systems present unique challenges to IVD manufacturers.

Brad Tieman, Jerzy Macioszek, Craig S. Hill, and Matthew C. Friedenberg

Editor’s note: The following is an update of an article that was originally published in the July/August 2005 issue of IVD Technology.

Figure 1. The Tigris system by Gen-Probe Inc. (San Diego).
In recent years, nucleic acid amplification tests (NAATs) for infectious diseases have come into widespread use in many clinical microbiology and blood-screening laboratories. A number of these tests have been approved by FDA and then commercialized for detecting infectious-disease organisms in clinical samples. Such tests have had a major impact on clinical laboratory diagnostics. This is due to the higher sensitivity of NAATs compared with conventional tests and their ability to detect organisms that are difficult or impossible to culture.

Blood-screening laboratories have already been using NAATs to detect pathogens in blood donations while a donor is in the preseroconversion window phase, is infected with immunovariant viruses, or is a nonseroconverting chronic carrier. Direct, sensitive detection of viral nucleic acids has decreased the incidence of transfusion-associated infections.

Although first-generation NAATs have demonstrated excellent performance, many laboratories have been slow to adopt the tests because of increased reagent costs and labor requirements, and concerns about carryover contamination. Larger laboratories have had difficulties with NAATs due to the low throughput of many of the test systems and the consequent need for multiple instruments to handle large daily test volumes. Some of the current first-generation NAATs have been partially automated in an attempt to reduce the tests’ complexities and labor requirements. While most of the semiautomated instruments have automated the amplification and detection steps of the assay, the sample-processing step has not been automated, and this is typically the most troublesome step.

In addition, first-generation NAAT sample-processing procedures are labor intensive, often requiring centrifugation and numerous manual pipetting steps. They are not effective in removing interfering substances from clinical specimens, which can inhibit the amplification reaction and produce false-negative results. The manual, complex nature of first-generation NAATs also has a direct impact on laboratory costs. Such costs include the need for more-experienced and higher-paid tech­nologists to run the tests.

The ongoing shortage of laboratory personnel has made it difficult for laboratories to dedicate additional resources to perform NAATs. Run failure, contamination, and inhibition problems can lead to higher costs due to repeat testing of samples with questionable results. This reduces efficiency and causes delays in reporting results. Repetitive-motion injuries, such as carpal tunnel syndrome, can occur from manual pipetting and result in higher costs to the laboratory due to absenteeism and workers’ compensation settlements.

The Tigris System

The Tigris system by Gen-Probe Inc. (San Diego) addresses the laboratory needs described above by providing full automation of NAATs and processing up to 1000 tests per day (see Figure 1). As the nucleic acid extraction process has been inte­grated into the design of the system and standardized for each assay, primary sample tubes can be placed directly on the system for analysis. For infectious-disease testing, multiple specimen types (e.g., endocervical, urethral and vaginal swabs, urine, and specimens collected into liquid-based cytology media) can be processed within the same worklist.

To minimize sample handling and contamination risk, the Tigris system provides cap-piercing functionality to process unopened samples directly from collection sites. This eliminates any need for sample preparation and cap removal for such specimens. The system also offers the ability to set up reagents for up to four different assay kits at one time and allows worklists of different assays to be run in a back-to-back mode.

Hardware and Software Design

Figure 2. (click to enlarge) CAD drawing of the upper deck of the Tigris System, which contains the sample processing and assay processing modules.

The Tigris system is divided into the lower and upper bay sections. The upper bay consists of a specimen queue, a multitube unit (MTU) input station, an MTU loading station, MTU mixers, incubators, magnetic separation stations, reagent pipettors, refrigerated reagent bay, oil addition station, luminometer, an MTU deactivation station, and other modules (see Figure 2). The lower bay contains common fluids that are shared between different assays, and storage areas for liquid and solid waste.

The Tigris system’s software architecture includes the following elements (see Figure 3). The master controller software is responsible for the overall control and operation of the instrument and consists of a user interface component that provides a graphical user interface for the operator (see Figure 4). The assay definition module contains all the information that is specific to a given assay and provides flexibility in adding menu options to the system. The embedded controller manages all the individual devices on the instrument.

Figure 3. (click to enlarge) Overview of Tigris software architecture.

Development Approaches

Requirements Management. In IVD product development, requirements management is critical to a successful program. A complex instrumentation program such as an automated NAAT instrument has thousands of requirements that must be traced from customer input to design requirements, assigned to appropriate functions for implementation and verification, and finally traced to appropriate verification evidence. A development team should implement a requirements management database that enables the team to sort requirements by varied categories and status, and provides the requirement trace matrices to link design output to design input.

Design Reviews and Decision Tools. As part of any design control and business practices, cross-functional design reviews are used to evaluate designs, balance trade-offs, and make recommendations. Concept screening methods are used to identify and weight design criteria and score options.1–3

Risk Management. Risk management is a fundamental component of automated NAAT instrument development efforts. A top-down, system-level approach ensures that human factors, hardware, software, samples, reagents, consumables, and ancillaries are all considered relative to poten­tial risks to patients, operators, bystanders, and the environment. A fault tree analysis provides a graphical representation of the hazards and their relationships to one another. A risk analysis identifies the risks associated with each hazard. It is supplemented by a human factors hazards analysis, software hazards analysis, and failure modes and effects analysis that provide detailed analyses of all potential sources of risk.

Figure 4. (click to enlarge) The Tigris system software provides a graphical user interface to facilitate interaction between the operator and the instrument. An example of the inventory status screen, used for managing reagents and consumables, is shown here.

Engineering Solutions. One major challenge in designing an automated NAAT instrument is achieving a high instrument throughput while controlling carryover contamination, a risk that is intrinsic to all amplification technologies. NAATs are more complex than conventional immuno­assays that are widely employed to test for a variety of infectious diseases. A typical NAAT requires isolating nucleic acids from human specimens by removing all inhibitory substances, amplifying target nucleic acids, detecting amplified products, and inactivating or containing the amplicon. Each of these steps could be as complex as a stand-alone immuno­assay. As a result, the time that is required to process a single NAAT is approximately 3.5 hours, whereas automated immunoassays can be completed in 45 minutes or less.

The throughput goal for the Tigris system was 1000 samples processed in 14 hours or less. This goal required designing a system that is capable of processing more than 100 samples per hour through numerous assay steps. This level of throughput would be difficult to achieve by processing a single sample at a time. This led to the MTU concept that combines five separate test tubes into a single disposable unit. Running an assay in minibatches of five tests minimizes the required number of movement steps and simplifies reagent addition by allowing delivery of reagents to five tests with a single aspiration step.

Fully automated NAAT instruments with a continuous mode of operation require the full harmonization of individual processing steps. As a result, the maximum number of tests that can be processed within an hour is a function of the duration of the longest step. During the development of the Tigris system, the rate-limiting steps were identified and addressed to optimize assay timing and maximize sample throughput. In some cases, multiple individual modules have to be provided to execute a given step in a parallel mode. This was the case for the magnetic separation station: five identical modules were installed on the instrument to accommodate the 12-minute interval that is required to process one MTU through this step.

Another major challenge facing automated NAAT instrument developers is target carryover and overall contamination control. A typical carryover requirement for immunoanalyzers is in the range of one part per million. Because of the ability of NAATs to detect target levels as low as a few copies, this level of carryover is unacceptable for a fully automated NAAT system. At the same time, the amplification process generates as many as 1012 copies of amplified target sequences, or amplicon. Any amplified product that is carried over to a preamplification step can generate a false-positive result. Because of that, the carryover requirement is increased to as high as one part per trillion.

One element of the Tigris design is that all amplicon is inactivated at the conclusion of assay processing by adding a sodium hypochlorite– based deactivation reagent into the MTU. A deactivator fluid dispense verification system was developed to monitor this critical instrument function.

Although inactivation of amplicon is an effective mitigator for carryover contamination, the following additional precautions were built into the system to further reduce the contamination risk:

  • Transcription-mediated amplification (TMA) technology is designed so that in all processing steps following the target capture step, when assay contamination risk is the highest, assay reagents are added directly into the MTU tubes. No transfer of amplicon is required. This minimizes the risk of carryover contamination during pipetting.
  • Oil is used as an overlay in each tube, reducing the contamination risk through aerosol creation.
  • Mixing steps have been optimized to eliminate splashing or aerosol creation.
  • Dedicated pipettor probes and wash cups are used for reagent dispensing during the pre- and postamplification processing steps.
  • During the dispensing of reagents, pipettor probes are positioned above the interior tube surface, isolating them from areas where potential contamination can occur during MTU mixing.
  • Sample tubes are isolated during sample processing to prevent crossover contamination from sample to sample.

Product Validation and Commercialization

Clinical Diagnostics. In December 2003, the Tigris system was cleared by FDA for use with the Aptima Combo 2 (AC2) assay for the detection of chlamydia and gonorrhea. Several studies have compared the AC2 assay on the Tigris system with semiautomated NAAT procedures. One group of researchers tested 1991 specimens from 1061 patients on the Tigris and semiautomated instruments.4 The study showed good positive and negative agreement between the two systems for urine and urogenital swab samples. Positive agreements ranged from 91.4 to 98.8% for chlamydia and gonorrhea. Negative agreements for both organisms ranged from 99.8 to 100%.

At the same time, 26 discordant results were observed from the 1991 specimens tested. Most of these discordant results were positive with the semiautomated procedure and negative on the Tigris system. Retesting these samples with the AC2 assay and with separate chlamydia and gonorrhea TMA assays that target alternate rRNA regions showed that 75% or more of the discordant results were resolved in favor of the Tigris system. The researchers suggested that this discordance was the result of operator-related errors on the semiautomated instruments, which were avoided by using a fully automated NAAT system.

A similar comparison study was conducted at a large clinical diagnostic reference laboratory.5,6 This laboratory’s testing volume was approximately 1100 chlamydia and gonorrhea samples per day, which included endocervical swab samples and urine samples. Positive and negative agreement between the instruments for chlamydia and gonorrhea ranged from 98.8 to 100%. Of the 8000 samples run, there were only 10 discordant chlamydia samples and one discordant gonorrhea sample. Retesting these samples with separate chlamydia and gonorrhea TMA assays that target alternate rRNA regions resolved all but one of the chlamydia samples in favor of the Tigris system. This study further supports the idea that a fully automated NAAT instrument reduces the chances of operator error, and suggests that adverse events such as carryover contamination are minimized when full automation is employed for NAAT assays.

Since the Tigris system was first approved with the AC2 assay in 2003, Gen-Probe has secured FDA clearances for additional infectious-disease assays and sample types. For example, Gen-Probe received FDA clearance for the Aptima CT and Aptima GC stand-alone assays on the Tigris system in 2006. Earlier that year, FDA cleared the AC2 assay to be used with two additional sample types: liquid Pap specimens collected in the PreservCyt solution and processed with Cytyc’s ThinPrep 2000 system, and clinician- and patient-collected vaginal swab specimens.

Blood Screening. Current semiautomated methods used for blood screening do not have sufficient throughput to support testing of individual donations. As a result, current procedures involve pooling plasma specimens prior to screening. If the sample pool is reactive, the individual samples that comprise the pool are tested to identify the reactive donations. As a result of the pooling, there is an intrinsic risk, although low, that viral nucleic acids are diluted below the detection limit. Employing fully automated, high-throughput systems for blood screening enables routine NAAT screening of individual donations.

In the blood-screening market, Gen-Probe’s Tigris system is called the Procleix Tigris system. The system and blood-screening assays are distributed by Chiron, a business unit of Novartis Vaccines and Diagnostics Inc. (Emeryville, CA). Gen-Probe was granted approval for this system to screen donated blood in the United States using the Procleix Ultrio and West Nile virus (WNV) assays in 2007. The Ultrio assay simultaneously detects HIV-1, hepatitis C virus (HCV), and hepatitis B virus (HBV). In addition, the Ultrio assay has been granted a CE mark in accordance with the European Union’s IVD Directive, and it is used overseas with the Tigris system.

During clinical trials, the performance of the Ultrio assay and HIV-1, HCV, and HBV discriminatory assays on the Procleix Tigris system were evaluated. For the study, a total of 6006 plasma specimens that had tested negative with licensed HIV, HCV, and HBV assays were tested on the Tigris system with the Ultrio assay and the three discriminatory assays. Ten of the specimens (0.17%) were initially reactive. None of the initially reactive specimens were reactive upon repeat testing, demonstrating the high clinical specificity of the system.

The sensitivity of the Ultrio assay was evaluated in separate HIV-1, HCV, and HBV seroconversion panels using both the semiautomated and Procleix Tigris system platforms. The testing on the semiautomated system showed that the assay can detect HIV-1 infection in individual seroconversion panels from 4 to 22 days earlier than the most sensitive HIV-1 p24 antigen test. The Ultrio assay was also able to detect HCV infection up to 52 days earlier than the HCV antibody test. For HBV, the Ultrio assay was able to detect the infection from 10 to 29 days earlier than the HBV surface anti­gen tests.7

Multiple studies on the performance of the Procleix Tigris system have been published. For example, a 2005 migration study compared the results of WNV testing on Gen-Probe’s semiautomated instrument system to results achieved on the Tigris platform.8 Variability between the systems was evaluated using 510 samples, and each sample was tested in triplicate. 1524 valid results were obtained on the semiautomated system, and 4554 results on the Tigris system. The overall accuracy for WNV testing on the semiauto-mated system was 99.6% (95% confidence interval: 99.1, 99.9), compared with overall accuracy on the Tigris system of 99.9% (CI: 99.8, 100).

The WNV assay on the Procleix Tigris system has been adopted in the United States, and the system was recently approved for use in Canada. Since investigational testing for WNV began in the United States in 2003, more than 1500 WNV-infected units of blood have been intercepted, including hundreds using the Procleix Tigris system. Most U.S. blood centers continue to screen for WNV in pools of 16, until certain levels of the virus are detected in a geographic region. Once this prevalence trigger is reached, the Tigris allows blood centers to improve the sensitivity of testing by quickly moving to individual donations. The move to individual donations would be extremely difficult with a semiautomated platform, which would require many more operators and systems to perform the additional tests required.

Conclusion

Fully automated nucleic acid amplification testing has the potential to revolutionize not only infectious disease testing and blood screening, but also many other areas of clinical testing in genetics, cancer, and other chronic human diseases. However, although new FDA-approved NAATs are becoming available, many laboratories have difficulties implementing the tests due to the high labor requirements, contamination concerns, and inhibition problems of the first-generation tests. Larger laboratories are particularly hindered by the high labor requirements and low throughput of many NAAT systems. New, fully automated instruments alleviate such constraints by increasing test throughput, reducing operator errors, and decreasing labor requirements, thereby reducing the overall costs of NAATs. Second-generation, fully automated technologies are making NAATs a reality for more laboratories, leading to improvements in healthcare through more-accurate, rapid, and cost-efficient diagnostic tests.

Brad Tieman is Tigris product manager at Gen-Probe Inc. (San Diego). He can be reached at bradt@gen-probe.com.
Jerzy Macioszek is an associate director of product development at Gen-Probe Inc. He can be reached at jerzym@gen-probe.com.
Craig S. Hill, PhD, is manager of scientific affairs at Gen-Probe Inc. He can be reached at craigh@gen-probe.com.
Matthew C. Friedenberg, PhD, is an associate director of product development at Gen-Probe Inc. He can be reached at mattf@gen-probe.com.

References

1. S Pugh, Total Design (Reading, MA: Addison-Wesley, 1990).

2. K Ulrich and S Eppinger, Product Design and Development (New York: McGraw-Hill, 1995).

3. CH Kepner and BB Tregoe, The Rational Manager (New York: McGraw Hill, 1965).

4. EW Hook et al., “The Tigris DTS System Reduces Operator-Related Error during Nucleic Acid Amplification Testing” (poster presented at the 104th general meeting of the American Society of Microbiology, New Orleans, May 2004).

5. CS Hill, “How Full Automation of Molecular Diagnostic Testing Can Increase Accuracy, Lab Efficiency, and Cost Savings,” Clinical Lab Products 33, no. 7 (2004): 32.

6. SM Novak-Weekley and AM Vannier, “High-Throughput Testing of the Aptima Combo 2 Assay for Chlamydia trachomatis and Neisseria gonorrhoeae on the Fully Automated Tigris DTS System” (poster presented at the 104th general meeting of the American Society of Microbiology, New Orleans, May 2004).

7. B Davis et al., “Fully Automated Nucleic Acid Amplification System Compatible with Chemiluminescence and Real-Time Fluo­rescence Assays” (poster presented at the Pan-American Society of Virology at the 21st Clinical Virology Symposium, Clearwater, FL, May 2005).

8. JD McAuley et al., “Multi-Site Study of the Procleix WNV Assay Using the Enhanced Semiautomated System Compared with the Tigris Automated System” (poster SP420 presented at the AABB annual meeting, Seattle, October 15–18, 2005).

 

Copyright ©2007 IVD Technology