Comparison of the SPF10-LiPA System to the Hybrid Capture 2 by Jose Carrasquero-Diaz

Vol. 45, No. 5

Comparison of the SPF10-LiPA System to the Hybrid Capture 2 Assay for Detection of Carcinogenic Human Papillomavirus Genotypes among 5,683 Young Women in Guanacaste, Costa Rica䌤 Mahboobeh Safaeian,1* Rolando Herrero,2 Allan Hildesheim,1 Wim Quint,4 Enrique Freer,3 Leen-Jan Van Doorn,4 Carolina Porras,2 Sandra Silva,3 Paula Gonza´lez,2 M. Concepcion Bratti,2 Ana Cecilia Rodriguez,1 and Philip Castle1 for the Costa Rican Vaccine Trial Group Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Bethesda, Maryland1; Proyecto Epidemiolo ´gico Guanacaste, Fundacio ´n INCIENSA, San Jose´, Costa Rica2; Universidad de Costa Rica, San Jose´, Costa Rica3; and Delft Diagnostic Laboratory, Delft, The Netherlands4 Received 22 December 2006/Returned for modification 9 February 2007/Accepted 26 February 2007

type 16 [HPV16] and HPV18, which together cause ⬃70% cases of cervical cancer worldwide) (11, 26). Thus, the study of cervical cancer prevention within the context of vaccines requires accurate detection of type-specific incidence and persistent HPV infections associated with cancer and precancerous lesions. Beyond the detection of HPV16 and HPV18, other types must be identified accurately as well. Important secondary aims of ongoing clinical trials of vaccines are whether they confer protection against HPV types besides those in the formulations and whether reducing the frequencies of the two most carcinogenic genotypes as a result of vaccination could lead to increased frequencies of other HPV types. At present there is no “gold standard” for HPV detection; however, there is one FDA-approved molecular assay, the Hybrid Capture 2 assay (HC2; Digene Corporation, Gaithersburg, MD), which collectively targets 13 carcinogenic HPV types, with the limitation that it does not provide information about type-specific HPV genotypes. On the other hand, PCRbased assays are able to amplify most genital HPV genotypes in a single PCR and have the added benefit of providing HPV type discrimination following amplification. Commonly used PCR primers are consensus primers GP5⫹/GP6⫹, MY9/ MY11, and PGMY9/PGMY11, which amplify 150-bp (primer GP5⫹/GP6⫹) and 450-bp (primers PGMY and MY9/MY11)

In the 1990s, data from multiple, international epidemiologic studies established infection with a group of ⬃15 human papillomavirus (HPV) types as a necessary cause of cervical cancer (2, 27). The steady increase in the fraction of cervical cancers attributable to HPV infection from the low estimates reported in epidemiologic studies from a decade earlier was achieved by a reduction in misclassification due to the measurement errors caused by suboptimal HPV DNA tests (3, 8, 9, 23). Now that the causal relationship between HPV infection and cervical cancer is certain, HPV-based prevention strategies are becoming increasingly important. In some countries HPV DNA assays are used as an adjunct to cytology to identify women at risk of cervical cancer who require preventive treatment. Recently, trials of prophylactic HPV vaccines have shown that these vaccines have high degrees of efficacy in preventing new and persistent infections with the HPV types in the vaccine formulation (most notably, HPV

* Corresponding author. Mailing address: Division of Cancer Epidemiology and Genetics, Hormonal and Reproductive Epidemiology Branch, National Cancer Institute, 6120 Executive Boulevard, Suite 550, Rockville, MD 20852. Phone: (301) 594-2934. Fax: (301) 4020916. E-mail: safaeianm@mail.nih.gov. 䌤 Published ahead of print on 7 March 2007. 1447

Downloaded from jcm.asm.org by on June 1, 2009

The objective of this analysis was to compare the performance characteristics of two human papillomavirus (HPV) DNA detections assays, the Hybrid Capture 2 assay (HC2) and the SPF10 assay, for the detection of carcinogenic HPV. Data are from the enrollment visits of women who participated in the randomized, double-blind, placebo-controlled phase III HPV16/18 Vaccine Trial in Guanacaste, Costa Rica. We compared the results of HC2 and SPF10 testing of cervical specimens. Since the line probe assay (LiPA) detection system does not distinguish between HPV type 68 (HPV68; which is targeted by HC2) and HPV73 (which is not targeted by HC2), for SPF10-LiPA, we defined the carcinogenic HPV types as the 12 HC2-targeted types (types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, and 59), HPV68/73, and the HC2-cross-reactive, carcinogenic type HPV66. The kappa values and the performance characteristics for the detection of cervical abnormalities were ascertained. Paired observations were available for 5,683 sexually active, young women (median age, 21 years). The prevalence of carcinogenic HPV types was 35% (n ⴝ 1,962) by HC2 and 35% (n ⴝ 2,003) by SPF10-LiPA. There were no differences in the prevalence of carcinogenic HPV types by HC2 and SPF10-LiPA among women with normal, atypical squamous cells of undetermined significance and high-grade squamous intraepithelial lesion cytology. Among women with low-grade squamous intraepithelial lesion cytology, HC2 was more likely to test positive than SPF10-LiPA for the carcinogenic HPV types (87% and 79%, respectively; P ⴝ 0.001) as a result of HC2 cross-reactivity with HPV types 40, 43, 44, 53, 54, 60, 70, and 74. The crude agreement between the two assays was 88%, with a kappa value of 0.75 (95% confidence limits, 0.73 to 0.76). We observed very good agreement between HC2 and SPF10-LiPA for carcinogenic HPV type detection.

1448

SAFAEIAN ET AL.

MATERIALS AND METHODS Study population. Data are from the enrollment visit of women who participated in CVT. As mentioned in the introduction, the primary aim of CVT is to independently assess the efficacy of an HPV16/18 vaccine manufactured by GlaxoSmithKline for the prevention of precancerous lesions (defined for the trial as CIN2, CIN3, or adenocarcinoma in situ [AIS]) and invasive cervical cancer. Enrollment began in June 2004 and ended in December 2005. Study participants were women between 18 and 25 years of age, in good general health, and without a history of chronic conditions that required treatment; were willing to use birth control during the vaccination period; and lived in the study area and had no plans of imminent departure from the study area. Approximately one-third of the females identified in a previous census fulfilled the inclusion criteria and participated in the study. At enrollment, the women provided written, informed consent and underwent a urine pregnancy test. Prior to randomization, the women were also administered a questionnaire that inquired about demographics, sexual activity, contraceptive use, reproductive history, cigarette use, and the family history of cancers. A detailed medical questionnaire was also administered, and medical and pelvic examinations were conducted for all consenting, sexually experienced women. During the pelvic examination, cervical cells were collected and placed in 20 ml of liquid cytology medium (PreservCyt; Cytyc Corporation, Marlborough, MA) for liquid-based cytology (ThinPrep; Cytyc Corporation) and for HPV detection by using SPF10 and HC2. To minimize the chance of carryover, cytologic slides were prepared after the withdrawal of two 0.5-ml aliquots, one for SPF10 PCR testing and one for confirmatory HPV testing in the future. Aliquots destined for PCR were stored in a liquid nitrogen tank, while the remaining PreservCyt samples were kept at room temperature (⬃20°C) until they were used to make liquid cytology slides to test for carcinogenic HPV, Chlamydia trachomatis, and Neisseria gonorrhoeae. All testing was done with the investigator masked to the results of other tests or cytology results. This analysis was based on the enrollment, prevaccination specimens from women entering the vaccine trial. All study protocols were reviewed and approved by the NCI and Costa Rican Institutional Review Boards. HPV detection and genotyping. (i) HC2. HC2 is an FDA-approved, commercially available HPV test which collectively targets 13 carcinogenic HPV types (types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68) without distinguishing the HPV type present. HC2 is a signal amplification assay that uses a technique which combines antibody capture of HPV DNA and RNA probe hybrids and

chemiluminescent signal detection. Additionally, because of their genetic relatedness (19, 21, 24), other cancer-associated types, such as HPV66, are also detected by HC2. HC2 was performed according to the manufacturer’s instructions in a laboratory at the University of Costa Rica in San Jose with residual PreservCyt samples. HC2 results were missing for 185 (3.2%) samples, mainly due to insufficient specimen volume. (ii) SPF10-LiPA system. Total DNA was isolated from 200 ␮l of a PreservCyt aliquot drawn prior to ThinPrep preparation by using a MagNA Pure LC instrument (Roche Diagnostics, Almere, The Netherlands) and a Total DNA isolation kit (Roche Diagnostics). DNA was eluted in 100 ␮l of water. Each DNA extraction run contained positive and negative controls to monitor the DNA isolation procedure. A 10-␮l aliquot of extracted DNA was used for each SPF10 PCR. The SPF10 PCR primer set was used to amplify a broad spectrum of HPV genotypes, as described earlier (15, 16). Briefly, this primer set amplifies a small fragment of 65 bp from the L1 region of HPV. Reverse primers contain a biotin label at the 5⬘ end, enabling capture of the reverse strand onto streptavidin-coated microtiter plates. The captured amplimers are denatured by alkaline treatment, and the captured strand is detected by a defined cocktail of digoxigenin-labeled probes that detect a broad spectrum of HPV genotypes. This method is designated the HPV DNA enzyme immunoassay (DEIA), which provides an optical density value. If the SPF10-DEIA yielded a borderline value (75 to 100% of the cutoff value), the SFP10 PCR was repeated and the sample was retested by DEIA. Each DEIA run contained separate positive, borderline, and negative controls. The broad-spectrum SFP10 primers can recognize at least 54 HPV types. The same SPF10 amplimers (from SPF10-DEIA-positive samples) were used to identify the HPV genotype by reverse hybridization on a LiPA containing probes for 25 different HPV genotypes (SPF10 HPV LiPA, version 1; manufactured by Labo Bio-Medical Products, Rijswijk, The Netherlands). The LiPA detects HPV types 6, 11, 16, 18, 31, 33, 34, 35, 39, 40, 42, 43, 44, 45, 51, 52, 53, 54, 56, 58, 59, 66, 68/73, 70, and 74. Each LiPA run contained negative and positive controls. Since the interprimer regions of HPV68 and HPV73 are identical, the LiPA system cannot distinguish between HPV68 and HPV73; hence, they are designated HPV68/73. SPF10-LiPA results were available for all samples. Because the CVT is focused on HPV16 and HPV18, type-specific (TS) PCR (TS-PCR) primer sets were also used to selectively amplify HPV16 (TS16) and HPV18 (TS18) from 2,513 specimens that tested positive by the SPF10 PCR but that did not contain HPV16 or HPV18, as determined by LiPA (25). The type-specific primers were based on those described by Baay et al. (1); they generate amplimers of 92 and 126 bp for HPV16 and HPV18, respectively. Amplimers from the TS-PCRs were detected by DEIA, similar to the method used for SPF10 amplimer detection. Statistical analysis. The primary outcome was the HPV prevalence determined by HC2 and SPF10-LiPA. It was necessary to adjust for the differences in HPV genotypes targeted by the two assays. HC2 collectively targets 13 carcinogenic HPVs (HPV types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68), although additional types, like HPV66, have also been shown to be detected sensitively in practice (4, 22). The SPF10 PCR can detect more than 50 HPV types, whereas the genotyping system (LiPA) can identify only 25 different HPV types: 11 noncarcinogenic types (types 6, 11, 34, 40, 42, 43, 44, 53, 54, 70, and 74) and 14 carcinogenic types (types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, and 68/73). Hence, to compare the SPF10 assays to HC2, we defined HPV detection by the SPF10 assays at three levels: (i) PCR positive, detection of all amplified HPV genotypes by DEIA without distinguishing which genotype(s) is present, (ii) LiPA positive, detection of at least 1 of the 25 low- and high-risk HPV types; and (iii) carcinogenic positive, detection of 1 of the 14 carcinogenic HPV types. The agreement between the two assays was determined using unweighted kappa statistics and 95% confidence intervals (CIs), which calculate the percent agreement beyond that expected by chance alone. The nonparametric test for matched data (McNemar’s ␹2 test) was used to determine whether the proportion of samples classified as positive by HC2 and negative by SPF10-LiPA was equal to the proportion of samples classified as negative by HC2 and positive by SPF10-LiPA. In an effort to investigate the reasons for discordant assay findings, we compared the 307 HC2-positive, SPF10-LiPA carcinogenic HPV-negative samples to the 348 HC2-negative, SPF10-LiPA carcinogenic HPV-positive samples. Using two-way tabulations and Pearson’s ␹2 test, we compared selected demographic and behavioral factors for women with discordant test results. Additionally, we compared selected medical findings from the pelvic examinations. Furthermore, because discordance between HC2 and the SPF10 assays could be due to the differential viral quantity required by the two assays, we used the ratio of relative light unit (RLU) values to positive control (pc) values (RLU/pc)

Downloaded from jcm.asm.org by on June 1, 2009

regions within the conserved L1 open reading frame, which encodes the major capsid protein. A newer primer set (SPF10) that amplifies a 65-bp region in the same L1 open reading frame region (16) as the other primers mentioned above has been developed. Because of its shorter amplification product, it is thought to be more analytically sensitive but possibly less specific for HPV detection than DNA-based assays, with a potential to amplify at least 54 HPV types. Genotype identification is achieved by using a reverse line probe assay (LiPA). We are using the SPF10-LiPA system as part of the HPV Vaccine Trial in Costa Rica (CVT). CVT is a phase III randomized efficacy trial of an HPV16 and HPV18 vaccine, with the primary end point being the reduction in HPV16- and HPV18-related cervical intraepithelial neoplasia (CIN) grade 2 (CIN2) and CIN3. The secondary aims of the trial (e.g., the effect of vaccination on the persistence of the targeted and nontargeted carcinogenic HPV types) are also dependent on the results of SPF10-LiPA. However, large formal evaluations of the SPF10-LiPA system are lacking, with only one report comparing the performance of SPF10-LiPA with that of HC2 using samples from 138 women attending a colposcopy clinic (18). Thus, we sought to compare the detection of HPV DNA by the SPF10-LiPA system to that by HC2 using paired samples collected during the enrollment phase of the community-based, randomized, double-blind, placebo-controlled phase III HPV16/18 Vaccine Trial in Guanacaste, Costa Rica.

J. CLIN. MICROBIOL.

VOL. 45, 2007

COMPARISON OF SPF10-LiPA SYSTEM TO HC2

1449

TABLE 1. Agreement between HC2 and SPF10-LiPA Sample or test and result (no. 关%兴 of women)

No. (%) of women with the following HC2 result:

McNemar’s test result

0.75 0.73–0.76

0.11

204 (3.6) 1,758 (30.9)

0.69 0.67–0.71

⬍0.0001

104 (1.8) 1,858 (32.7)

0.61 0.59–0.63

⬍0.0001

Positive (1,962 关34.52兴)

Carcinogenic HPVa Negative (3,680 关64.75兴) Positive (2,003 关35.23兴)

3,373 (59.4) 348 (6.1)

307 (5.4) 1,655 (29.1)

LiPAb Negative (3,285 关57.80兴) Positive (2,398 关42.20兴)

3,081 (54.2) 640 (11.3)

SPF10-DEIA PCR Negative (2,827 关49.74%兴) Positive (2,856 关50.66兴)

2,723 (47.9) 998 (17.6)

a b

Kappa (95% CI)

% Agreement

Negative (3,721 关65.48兴)

Comprised of 13 types targeted by HC2 (16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 68), and 66. Comprised of HPV types 6, 11, 16, 18, 31, 33, 34, 35, 39, 40, 42, 43, 44, 45, 51, 52, 53, 54, 56, 58, 59, 66, 68/73, 70, and 74.

RESULTS Of the 7,466 women enrolled in the trial, 1,598 were excluded from this analysis because a pelvic examination was not performed, mainly because they were virgins (n ⫽ 1,592). The median age was 21 years (interquartile range [IQR], 19 to 23 years), and the median age at the time of their first sexual intercourse was 17 years (IQR, 15 to 18 years). Forty-four percent (n ⫽ 2,574) were single; 52% (n ⫽ 3,050) were married; and 3.4% (n ⫽ 198) reported being separated, divorced, or widowed. Carcinogenic HPV detection. Among the 5,683 paired observations, 2,856 women (50%) were positive by PCR, 2,398 (42%) were positive by LiPA, and 2,003 (35%) were carcinogenic HPV positive. By comparison, 1,962 women (35%) were carcinogenic HPV positive by HC2. The crude agreement between the two assays for carcinogenic HPV type detection was 88%, and the kappa value was 0.75 (95% CI, 0.73 to 0.76), indicating very good agreement. Three hundred seven women (5%) were HC2 positive but carcinogenic HPV type negative by use of the SPF10-LiPA system. Similarly, 348 (6%) were carcinogenic HPV type positive by use of the SPF10-LiPA system but HC2 negative (McNemar’s P value ⫽ 0.1) (Table 1). Table 2 compares selected characteristics between the groups with discordant SPF10-LiPA and HC2 results. The purpose of this analysis was to investigate whether one group with discordant results was more likely to have characteristics which have been shown to be associated with HPV positivity. In a multivariate model, HC2-negative, SPF10-LiPA carcinogenic HPV type-positive women were older (P ⫽ 0.04) and were more likely to have Chlamydia infection (P ⫽ 0.03) than HC2positive, SPF10-LiPA carcinogenic HPV type-negative women. However, there were no differences based on the number of

lifetime sexual partners, marital status, and number of pregnancies, which are strong factors for HPV positivity. To investigate the negative results obtained by the SPF10 assay and/or LiPA among HC2-positive women, we examined the HC2 signal strength RLU/pc value (a semiquantitative measure of HPV viral burden [14]), among the HC2-positive subgroups (Table 3). Among the 104 women in the SPF10 PCR-negative group, 70 (67%) had HC2 RLU/pc values between 1 and 5, and similarly, 96 (47%) of carcinogenic HPV type-negative women had HC2 RLU/pc values of 1 to 5. By comparison, only 19% of the HC2-positive samples had RLU/pc values of 1 to 5 (P ⬍ 0.001 compared to the results for either of the other two groups). Table 4 presents the carcinogenic HPV types among SPF10 PCR-positive samples by HC2 status. HC2 identified as positive between 80% (HPV52) and 93% (HPV59) of specimens with types in its pooled probe. Eighty-eight percent of the samples identified as HPV16 and HPV18 positive by SPF10LiPA were called positive by HC2. Among the participants infected with a single HPV type, HC2 prevalence was highest for 12 of the 13 types targeted by the HC2 probe, ranging from 54% (HPV68/73) to 96% (HPV59). As noted previously (22), the prevalence detected by HC2 was also high for HPV66 (67%), a type not targeted by the HC2 probe. We observed evidence of HC2 cross-reactivity with several other noncarcinogenic HPV types. The extent of cross-reactivity (among those infected with only a single HPV type) for these types ranged from 8% (HPV43) to 49% (HPV70). Carcinogenic HPV type detection by HC2 and the SPF10 system, stratified by cytology, is presented in Fig. 1. For all cytologic interpretations, the assays performed similarly except for women with low-grade squamous intraepithelial lesions (LSILs). For the 568 women with LSILs, 79% were positive by SPF10-LiPA and 87% were positive by HC2 (P ⫽ 0.001). When we accounted for the previously reported HC2 cross-reactive types (4, 22), which we also observed in this analysis (HPV types 6, 11, 40, 53, and 70), 86% of the women with LSILs were positive by SPF10-LiPA. Furthermore, considering that kappa values are somewhat dependent on prevalence rates and since HPV prevalence dif-

Downloaded from jcm.asm.org by on June 1, 2009

from the HC2 assay as a proxy measure for HPV viral burden to investigate whether a lower viral RLU/pc quantity explained why some HC2-positive samples were classified as negative by the SPF10 PCR system. RLU/pc values were categorized on the basis of quartiles among HC2-positive samples: 1 to 4, 5 to 29, 30 to 267, and ⱖ268 RLU/pc. Among the HC2-negative samples, we investigated the frequency of HPV types missed.

1450

SAFAEIAN ET AL.

J. CLIN. MICROBIOL. TABLE 2. Characteristics of samples with discordant assay results P value

No. (%) of women SPF10-LiPA carcinogenic HPV negative and HC2 positive (n ⫽ 307)

SPF10-LiPA carcinogenic HPV positive and HC2 negative (n ⫽ 348)

Age 18–21 21–25

175 (57.0) 132 (43.0)

Education Less than elementary school Elementary school or more

Characteristic

Adjusted

162 (46.6) 186 (53.5)

0.008

0.04

88 (28.9) 217 (71.2)

107 (30.9) 239 (69.1)

0.6

0.9

Marital status Married Single Widowed/divorced

131 (43.0) 164 (53.8) 10 (3.3)

164 (47.4) 164 (47.4) 18 (5.2)

0.2

0.7

No. of lifetime partners 1 2 3 4 or more

105 (34.5) 90 (29.6) 61 (20.1) 48 (15.8)

117 (34.0) 87 (25.3) 54 (15.7) 86 (25.0)

0.02

0.4

No. of pregnancies 0 1 2 3 or more

143 (46.9) 101 (33.1) 41 (13.4) 20 (6.6)

135 (39.0) 121 (35.0) 70 (20.2) 20 (5.8)

0.07

0.5

Chlamydia infection No Yes

261 (85.0) 46 (15.0)

269 (77.5) 78 (22.5)

0.01

0.03

fers by age, marital status, and the number of lifetime sexual partners, we examined assay agreement by age group, marital status, and the number of lifetime partners. Kappa values were similar by age group, marital status, and the number of lifetime sexual partners (data not shown). Type-specific testing for HPV16 and HPV18. Among the 5,868 women for whom SPF10-LiPA results were available, 403 (6.9%) were positive for HPV16 and 145 (2.5%) were positive for HPV18, with 16 (0.3%) infected by both of those HPV types, based on SPF10-LiPA. Thus, 564 (9.6%) women were infected with HPV16 and/or HPV18. Of the 2,937 SPF10-DEIA-positive women, 471 (16%) were negative for the HPV types detected by LiPA. An additional 2,450 were SPF10-DEIA positive but either HPV16 or HPV18 TABLE 3. HC2 RLU values for samples positive by HC2 but negative by SPF10 assay and/or LiPA

negative by LiPA. This resulted in 2,921 women for whom results were available by additional type-specific tests with TS16 and/or TS18 primers, of whom 95 (3.2%) were found to be either HPV16 positive (n ⫽ 69) or HPV18 positive (n ⫽ 27) and of whom 1 was positive for both HPV16 and HPV18. By combining the results of both SPF10-LiPA and TS testing, 488 women (8.3%) were positive for HPV16 and 188 (3.2%) were positive for HPV18, with 30 (0.5%) infected with both of those types. Thus, 646 women (11%) were infected with HPV16 and/or HPV18. SPF10-LiPA detected 86% of HPV16 infections and 86% of HPV18 infections detected by both SPF10LiPA and TS testing. Eighty-one of the 95 (85%) samples positive by the TS-PCR were HC2 positive (compared with 88% of any specimens that tested positive for HPV16 and/or HPV18 and 80% of specimens that tested positive only for HPV16 or HPV18 by SPF10-LiPA); among the HC2-positive specimens, 33 (35%) of the TS PCR-positive specimens had high RLU/pc values, i.e., above 268.

No. (%) of women with the following SPF10 assay result: HC2-positive RLU/pc Negative value (n ⫽ 104)

1–4 5–29 30–267 ⱖ268

Positive

DISCUSSION

LiPA Carcinogenic HPV Carcinogenic HPV negative negative positivea (n ⫽ 1,560) (n ⫽ 100) (n ⫽ 203)

In this large, population-based cohort of young women, there was good agreement for the detection of carcinogenic HPV types by HC2 and the SPF10-LiPA system. Further stratification by cytology, age, and marital status revealed similar kappa values among the different strata. From a research perspective, both the SPF10 system and HC2 were comparable in detecting carcinogenic HPV, and from a clinical perspective, the HPV prevalences determined by both tests were com-

70 (67.3) 47 (47.0) 24 (23.1) 36 (36.0) 9 (8.7) 14 (14.0) 1 (1.0) 3 (3.0)

96 (47.3) 63 (31.0) 36 (17.7) 8 (3.9)

309 (18.7) 418 (25.3) 446 (27.0) 482 (29.1)

a Comprised of 13 types targeted by HC2 (16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 68), and 66.

Downloaded from jcm.asm.org by on June 1, 2009

Crude

VOL. 45, 2007

COMPARISON OF SPF10-LiPA SYSTEM TO HC2

1451

TABLE 4. HC2 results among SPF10 carcinogenic HPV-positive samples No. (%) of women with any infection HPV typea

No. of women (% HC2 positive) with a single infection

All subjects (n ⫽ 5,683)

HC2 positive

All subjects (n ⫽ 1,429)

HC2 positiveb (n ⫽ 906 关65.2%兴)

Normal cytologyb (n ⫽ 992)

ASCb,c (n ⫽ 88)

LSILb (n ⫽ 263)

HSILb (n ⫽ 80)

408 (7.2) 157 (2.8) 264 (4.7) 87 (1.5) 99 (1.7) 220 (3.9) 125 (2.2) 306 (5.4) 384 (6.8) 233 (4.1) 178 (3.1) 103 (1.8) 182 (3.2) 206 (3.6) 131 (2.3) 66 (1.2) 15 (0.3) 57 (1.0) 12 (0.2) 78 (1.4) 85 (1.5) 234 (4.1) 107 (1.9) 142 (2.5) 115 (2.0)

360 (88.2) 138 (87.9) 236 (89.4) 79 (90.8) 85 (85.9) 196 (89.1) 105 (84.0) 261 (85.3) 309 (80.5) 207 (88.8) 162 (91.2) 96 (93.2) 142 (78.0) 163 (79.1) 83 (63.4) 39 (59.1) 8 (53.3) 36 (63.2) 3 (25.0) 43 (55.1) 35 (41.2) 154 (65.8) 40 (37.4) 101 (71.1) 58 (50.4)

165 (11.6) 55 (3.9) 88 (6.2) 33 (2.3) 31 (2.2) 82 (5.7) 43 (3.0) 110 (7.7) 129 (9.0) 82 (5.7) 64 (4.5) 45 (3.2) 61 (4.3) 90 (6.3) 36 (2.5) 12 (0.8) 2 (0.1) 11 (0.8) 2 (0.1) 25 (1.8) 36 (2.5) 65 (4.6) 59 (4.1) 56 (3.9) 47 (3.3)

132 (83.0) 43 (78.2) 67 (80.7) 26 (81.3) 25 (80.7) 64 (80.0) 31 (73.8) 89 (82.4) 90 (72.6) 65 (81.3) 56 (90.3) 42 (95.5) 33 (54.1) 58 (66.7) 10 (27.8) 2 (16.7) 0 2 (18.2) 0 2 (8.3) 4 (11.4) 28 (43.8) 5 (8.8) 26 (49.1) 6 (13.3)

73 (75.3) 28 (70.0) 47 (75.8) 16 (76.0) 13 (72.0) 35 (70.0) 23 (67.7) 48 (75.0) 63 (65.6) 38 (74.5) 25 (83.3) 29 (93.6) 23 (48.9) 25 (48.1) 3 (13.0) 1 (14.3) 0 1 (14.3) 0 1 (7.7) 3 (9.4) 15 (31.9) 3 (6.1) 21 (43.8) 4 (10.0)

12 (80.0) 3 (100.0) 4 (100.0) 2 (67.7) 1 (100.0) 3 (100.0) 2 (100.0) 7 (87.5) 6 (85.7) 1 (33.3) 9 (90.0) 4 (100.0) 3 (75.00) 5 (100.0) 0 0 0 0 0 0 0 0 0 2 (100.0) 0

23 (100.0) 5 (100.0) 11 (91.7) 5 (100.0) 5 (83.3) 22 (95.7) 5 (100.0) 29 (93.6) 11 (100.0) 26 (100.0) 14 (100.0) 8 (100.0) 4 (57.1) 26 (92.9) 6 (66.7) 1 (25.0) 0 1 (33.3) 0 1 (14.3) 1 (50.0) 13 (86.7) 2 (40.0) 3 (100.0) 2 (50.0)

23 (100.0) 7 (100.0) 5 (100.0) 3 (100.0) 6 (100.0) 3 (100.0) 1 (100.0) 4 (100.0) 9 (100.0) 0 8 (100.0) 1 (100.0) 3 (100.0) 1 (100.0) 1 (100.0) 0 0 0 0 0 0 0 0 0 0

Boldface type represents HC2 carcinogenic types. HC2 results are missing for 40/1,429 subjects: 30 subjects with normal cytology characteristics, 2 subjects with ASCUS/ASC-H, 7 subjects with LSILs, and 1 subject with HSILs. c Includes both ASCUS subjects and subjects for whom ASCs of high-grade squamous intraepithelial lesions could not be excluded. b

parable among those with normal cytologies, atypical squamous cells (ASCs) of undetermined significance (ASCUS), and high-grade squamous intraepithelial lesions (HSILs). Unlike our results, a recent study from The Netherlands found poor agreement between the results of HC2 and the SPF10-LiPA system (crude agreement, 0.70; kappa value, 0.40) (18), with a carcinogenic HPV type prevalence of 36% by HC2 compared with a carcinogenic HPV type prevalence of 50% with the SPF10-LiPA system. The sample size for that study was relatively small (n ⫽ 138 at two 6-month intervals, resulting in 276 datum points), and the study consisted of women with low-grade cervical changes or women attending a clinic pre- and posttreatment for CIN, whereas our analysis consisted of younger, healthy women from the general population. It is unclear why there are such marked differences between the two studies and what methodological differences, if any, could explain such differences. Importantly, both studies showed similarly high sensitivities for the detection of HSIL by either HC2 or SPF10-LiPA. Our findings confirmed the previously reported cross-reactivity of HC2 with other HPV types not targeted in its probe set (4, 19, 20) by the use of HPV amplification and typing systems different from those used in the previous reports. We confirmed that HC2 detects HPV66 (a carcinogenic type not targeted by HC2) more frequently than HPV68/73, at least one of which (HPV68) is targeted by the HC2 probe. This is similar to the findings of other studies, which also observed that, among

the targeted types, HC2 detection is weakest for HPV68 (10, 22). This might account for the equivocal data regarding the carcinogenicity of HPV68 (5, 13). However, if 50% of the specimens positive for HPV68/73 are HPV68 positive and 50% are HPV73 positive and HC2 detected HPV in 50% of the specimens, this is consistent with 100% detection of HPV68 and 0% detection of HPV73. We were also able to show that there was a modest degree of HC2 cross-reactivity with HPV types 70 and 53 and, to a lesser extent, with types 6, 40, 11, 74, 44, 54, and 43. When we compared the misclassification of disease outcomes among those negative by both HC2 and SPF10-DEIA, we observed that both assays missed similar numbers of cytologic abnormalities; however, there was a tendency for more women with LSIL to be HC2 positive than positive for carcinogenic HPV types by SPF10-LiPA. Further evaluation revealed that this was mainly attributed to the cross-reactivity of HC2 to other, noncarcinogenic HPV types (types 40, 43, 44, 53, 54, 60, 70, and 74) detected in the LSIL-positive samples; these types can also cause LSILs (17). Discordance between the two assays based on the 14 carcinogenic HPV types could be explained by a couple of factors. In general, HC2-positive, SPF10-LiPA-negative specimens had lower viral quantities than those positive by both assays, suggesting that sampling error due to a low HPV viral load may be one reason for HC2-positive, SPF10-system-negative findings at the PCR level. Furthermore, comparing the samples with

Downloaded from jcm.asm.org by on June 1, 2009

16 18 31 33 35 39 45 51 52 56 58 59 68/73 66 6 11 34 40 42 43 44 53 54 70 74

No. (%) of women with a single infection

1452

SAFAEIAN ET AL.

J. CLIN. MICROBIOL.

discordant results by HC2 and with the SPF10-LiPA system, we found that there were no differences between the discordant groups by comparison of factors that are critical for HPV detection. Women whose samples were carcinogenic HPV type positive (by SPF10-LiPA) but HC2 negative were older and were more likely to have had a concurrent Chlamydia infection than carcinogenic HPV type-negative (by SPF10-LiPA) but HC2-positive women. However, this did not provide further clarification regarding the reasons for or the directionality of the discordance, suggesting that there is some degree of misclassification of HPV infection status by either assay. HC2 has been shown to be highly sensitive and specific for clinical outcomes (6), and its cross-reactivity with other HPV types, rather than compromising, probably contributes to its high sensitivity but probably results in false-positive findings. However, use of HC2 is limited in some applications because it does not provide information on the type-specific HPV infection. The type-specific information is valuable in studies of the natural history of HPV and specifically in the context of vaccine efficacy trials, in which the most relevant end points recommended by a FDA vaccine advisory panel for determining vaccine efficacy are a reduction in the incidence of vaccine type-specific persistent infections and associated moderate to severe CIN, approximated in this study by HSIL, or worse by cytology (7). Such desired type-specific associations are not facilitated by HC2; however, PCR-based assays and detections systems such as the SPF10-LiPA system allow type-specific HPV determination. Interestingly, the SPF10 consensus primers can potentially

coamplify 54 different HPV types in one PCR. However, its analytic sensitivity, especially in the presence of multiple HPV types with various viral loads, can possibly be reduced, as the different types can compete for limited PCR primers. This possibility might have been demonstrated by the additional HPV16- and HPV18-positive results when type-specific HPV16 and HPV18 primers were used to selectively amplify SPF10-DEIA-positive, LiPA-negative, and all HPV16- and HPV18-negative samples. An additional 69 samples were found to be HPV16 positive, and an additional 27 were found to be HPV18 positive. From a clinical perspective, missing these additional HPV16- and HPV18-positive samples was not plainly detrimental in our population sample because all six women with HSILs that were HPV16 positive only by the TS test and the two women with HSILs that were HPV18 positive only by the TS test were also positive for at least one other carcinogenic HPV type and, hence, were identified as HPV positive because of the pooling of the data. However, more investigation is warranted to evaluate the effect of competition between types within consensus PCR assays, especially if the competition is not random, and if, rather, competition is dependent on factors such as HPV type and viral quantity. One limitation of SPF10-LiPA system, especially in studies in which it is compared to HC2, was that the LiPA detection system does not differentiate between HPV68 (a type targeted by the HC2 probe) and HPV73 (a type not targeted by the HC2 probe). By including HPV68/73 in our comparison category, we may have artificially made a more robust category, especially if HPV73 is more prevalent than HPV68 in this

Downloaded from jcm.asm.org by on June 1, 2009

FIG. 1. Comparison of clinical performance for cytologic interpretation by HC2 and SPF10-PCR system. *, comprised of 25 types detected by LiPA (types 6, 11, 16, 18, 31, 33, 34, 35, 39, 40, 42, 43, 44, 45, 51, 52, 53, 54, 56, 58, 59, 66, 68/73, 70, and 74); **, comprised of 13 types targeted by HC2 (types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68) and HPV66.

VOL. 45, 2007

COMPARISON OF SPF10-LiPA SYSTEM TO HC2

cohort. However, data from a previous natural history study in the same region (Guanacaste, Costa Rica) (12) showed small but equal prevalences of both HPV68 and HPV73 in that population (0.3% and 0.5%, respectively). Hence, it is unlikely that inclusion of HPV73 as a carcinogenic type would have strongly influenced our results and led to conclusions of the equal performance of SPF10-LiPA and HC2. A strength of this study is that it is unlikely to have suffered from selection bias. Both assays were performed with samples derived from one specimen from the same participant at the same time and were collected in the same media, thus reducing the chance that differences could be attributed to procedural differences or other host factors. Another strength of this study was its large, population-based sample of women. In conclusion, we observed good agreement between HC2 and the SPF10-LiPA system for the detection of carcinogenic HPV types. We suggest that the SPF10-LiPA is a robust assay for the study of the natural history of type-specific HPV and vaccine-related outcomes.

5. 6.

9. 10.

ACKNOWLEDGMENTS 11.

12.

13.

14. 15.

16.

17.

18.

19.

20.

21.

REFERENCES 1. Baay, M. F., W. G. Quint, J. Koudstaal, H. Hollema, J. M. Duk, M. P. Burger, E. Stolz, and P. Herbrink. 1996. Comprehensive study of several general and type-specific primer pairs for detection of human papillomavirus DNA by PCR in paraffin-embedded cervical carcinomas. J. Clin. Microbiol. 34:745–747. 2. Bosch, F. X., M. M. Manos, N. Munoz, M. Sherman, A. M. Jansen, J. Peto, M. H. Schiffman, V. Moreno, R. Kurman, K. V. Shah, et al. 1995. Prevalence

22.

23.

of human papillomavirus in cervical cancer: a worldwide perspective. J. Natl. Cancer Inst. 87:796–802. Bosch, F. X., N. Munoz, S. S. de, E. L. Franco, D. R. Lowy, M. Schiffman, S. Franceschi, S. K. Kjaer, C. J. Meijer, I. H. Frazer, and J. Cuzick. 2001. Re: Cervical carcinoma and human papillomavirus: on the road to preventing a major human cancer. J. Natl. Cancer Inst. 93:1349–1350. Castle, P. E., M. Schiffman, R. D. Burk, S. Wacholder, A. Hildesheim, R. Herrero, M. C. Bratti, M. E. Sherman, and A. Lorincz. 2002. Restricted cross-reactivity of hybrid capture 2 with nononcogenic human papillomavirus types. Cancer Epidemiol. Biomarkers Prev. 11:1394–1399. Cogliano, V., R. Baan, K. Straif, Y. Grosse, B. Secretan, F. El Ghissassi, et al. 2005. Carcinogenicity of human papillomaviruses. Lancet Oncol. 6:204. Cuzick, J., C. Clavel, K. U. Petry, C. J. Meijer, H. Hoyer, S. Ratnam, A. Szarewski, P. Birembaut, S. Kulasingam, P. Sasieni, and T. Iftner. 2006. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int. J. Cancer 119:1095–1101. Food and Drug Administration. 2001. FDA vaccines and related biological products advisory committee. Center for Biologics Evaluation and Research, meeting 88. Center for Biologics Evaluation and Research, Food and Drug Administration, Washington, DC. Franco, E. L. 1991. The sexually transmitted disease model for cervical cancer: incoherent epidemiologic findings and the role of misclassification of human papillomavirus infection. Epidemiology 2:98–106. Franco, E. L. 1992. Measurement errors in epidemiological studies of human papillomavirus and cervical cancer. IARC Sci. Publ., issue 119, 181–197. Gravitt, P. E., C. L. Peyton, T. Q. Alessi, C. M. Wheeler, F. Coutlee, A. Hildesheim, M. H. Schiffman, D. R. Scott, and R. J. Apple. 2000. Improved amplification of genital human papillomaviruses. J. Clin. Microbiol. 38:357– 361. Harper, D. M., E. L. Franco, C. Wheeler, D. G. Ferris, D. Jenkins, A. Schuind, T. Zahaf, B. Innis, P. Naud, N. S. De Carvalho, C. M. RoteliMartins, J. Teixeira, M. M. Blatter, A. P. Korn, W. Quint, and G. Dubin. 2004. Efficacy of a bivalent L1 virus-like particle vaccine in prevention of infection with human papillomavirus types 16 and 18 in young women: a randomised controlled trial. Lancet 364:1757–1765. Herrero, R., P. E. Castle, M. Schiffman, M. C. Bratti, A. Hildesheim, J. Morales, M. Alfaro, M. E. Sherman, S. Wacholder, S. Chen, A. C. Rodriguez, and R. D. Burk. 2005. Epidemiologic profile of type-specific human papillomavirus infection and cervical neoplasia in Guanacaste, Costa Rica. J. Infect. Dis. 191:1796–1807. Hiller, T., S. Poppelreuther, F. Stubenrauch, and T. Iftner. 2006. Comparative analysis of 19 genital human papillomavirus types with regard to p53 degradation, immortalization, phylogeny, and epidemiologic risk classification. Cancer Epidemiol. Biomarkers Prev. 15:1262–1267. Iftner, T., and L. L. Villa. 2003. Human papillomavirus technologies. J. Natl. Cancer Inst. Monogr., issue 30, 80–88. Kleter, B., L. J. van Doorn, L. Schrauwen, A. Molijn, S. Sastrowijoto, J. ter Schegget, J. Lindeman, B. ter Harmsel, M. Burger, and W. Quint. 1999. Development and clinical evaluation of a highly sensitive PCR-reverse hybridization line probe assay for detection and identification of anogenital human papillomavirus. J. Clin. Microbiol. 37:2508–2517. Kleter, B., L. J. van Doorn, J. ter Schegget, L. Schrauwen, K. van Krimpen, M. Burger, B. ter Harmsel, and W. Quint. 1998. Novel short-fragment PCR assay for highly sensitive broad-spectrum detection of anogenital human papillomaviruses. Am. J. Pathol. 153:1731–1739. Kovacic, M. B., P. E. Castle, R. Herrero, M. Schiffman, M. E. Sherman, S. Wacholder, A. C. Rodriguez, M. L. Hutchinson, M. C. Bratti, A. Hildesheim, J. Morales, M. Alfaro, and R. D. Burk. 2006. Relationships of human papillomavirus type, qualitative viral load, and age with cytologic abnormality. Cancer Res. 66:10112–10119. Perrons, C., R. Jelley, B. Kleter, W. Quint, and N. Brink. 2005. Detection of persistent high risk human papillomavirus infections with hybrid capture II and SPF10/LiPA. J. Clin. Virol. 32:278–285. Peyton, C. L., M. Schiffman, A. T. Lorincz, W. C. Hunt, I. Mielzynska, C. Bratti, S. Eaton, A. Hildesheim, L. A. Morera, A. C. Rodriguez, R. Herrero, M. E. Sherman, and C. M. Wheeler. 1998. Comparison of PCR- and hybrid capture-based human papillomavirus detection systems using multiple cervical specimen collection strategies. J. Clin. Microbiol. 36:3248–3254. Poljak, M., I. J. Marin, K. Seme, and A. Vince. 2002. Hybrid Capture II HPV test detects at least 15 human papillomavirus genotypes not included in its current high-risk probe cocktail. J. Clin. Virol. 25(Suppl. 3):S89–S97. Schiffman, M., R. Herrero, A. Hildesheim, M. E. Sherman, M. Bratti, S. Wacholder, M. Alfaro, M. Hutchinson, J. Morales, M. D. Greenberg, and A. T. Lorincz. 2000. HPV DNA testing in cervical cancer screening: results from women in a high-risk province of Costa Rica. JAMA 283:87–93. Schiffman, M., C. M. Wheeler, A. Dasgupta, D. Solomon, and P. E. Castle. 2005. A comparison of a prototype PCR assay and Hybrid Capture 2 for detection of carcinogenic human papillomavirus DNA in women with equivocal or mildly abnormal Papanicolaou smears. Am. J. Clin. Pathol. 124:722– 732. Schiffman, M. H., and A. Schatzkin. 1994. Test reliability is critically important

Downloaded from jcm.asm.org by on June 1, 2009

CVT is a long-standing collaboration between investigators in Costa Rica and NCI. The trial is funded by intramural NCI and the NIH Office of Research on Women’s Health and is conducted in agreement with the Ministry of Health of Costa Rica. Vaccine was provided for our trial by GSK Biologicals, under a clinical trials agreement with NCI. GSK also provided support for aspects of the trial associated with the regulatory submission needs of the company. NCI and Costa Rican investigators make final editorial decisions on this presentation and subsequent publications; GSK has the right to review/comment. The affiliations of the members of the CVT group are as follows. At the Proyecto Epidemiolo ´gico Guanacaste, Fundacio ´n INCIENSA, San Jose´, Costa Rica, Mario Alfaro (cytologist), Manuel Barrantes (field supervisor), M. Concepcion Bratti (coinvestigator), Fernando Ca´rdenas (general field supervisor), Bernal Corte´s (specimen and repository manager), Albert Espinoza (head, coding and data entry), Yenory Estrada (pharmacist), Paula Gonzalez (coinvestigator), Diego Guille´n (pathologist), Rolando Herrero (co-principal investigator), Silvia E. Jimenez (trial coordinator), Jorge Morales (colposcopist), Lidia Ana Morera (head study nurse), Elmer Pe´rez (field supervisor), Carolina Porras (coinvestigator), Ana Cecilia Rodriguez (coinvestigator), and Maricela Villegas (clinic physician); at the University of Costa Rica, San Jose´, Costa Rica, Enrique Freer (director, HPV Diagnostics Laboratory), Jose Bonilla (head, HPV Immunology Laboratory), Sandra Silva (head technician, HPV Diagnostics Laboratory), Ivannia Atmella (immunology technician), and Margarita Ramı´rez (immunology technician); at the National Cancer Institute, Bethesda, MD, Pamala Gahr (trial coordinator), Allan Hildesheim (co-principal investigator and NCI co-project officer), Douglas R. Lowy (HPV virologist), Mark Schiffman (medical monitor and NCI co-project officer), John T. Schiller (HPV virologist), Mark Sherman (quality control pathologist), Diane Solomon (medical monitor and quality control pathologist), and Sholom Wacholder (statistician); at SAIC, NCI—Frederick, Frederick, MD, Ligia Pinto (head, HPV Immunology Laboratory) and Alfonso Garcia-Pineres (scientist, HPV Immunology Laboratory); at Womens and Infants’ Hospital, Providence, RI, Claire Eklund (quality control, cytology) and Martha Hutchinson (quality control, cytology); and Delft Diagnostics Laboratory, The Netherlands, Wim Quint (HPV DNA testing) and Leen-Jan van Doorn (HPV DNA testing).

1453

1454

SAFAEIAN ET AL.

to molecular epidemiology: an example from studies of human papillomavirus infection and cervical neoplasia. Cancer Res. 54:1944s–1947s. 24. Terry, G., L. Ho, P. Londesborough, J. Cuzick, I. Mielzynska-Lohnas, and A. Lorincz. 2001. Detection of high-risk HPV types by the Hybrid Capture 2 test. J. Med. Virol. 65:155–162. 25. van Doorn, L. J., A. Molijn, B. Kleter, W. Quint, and B. Colau. 2006. Highly effective detection of human papillomavirus 16 and 18 DNA by a testing algorithm combining broad-spectrum and type-specific PCR. J. Clin. Microbiol. 44:3292–3298. 26. Villa, L. L., R. L. Costa, C. A. Petta, R. P. Andrade, K. A. Ault, A. R. Giuliano, C. M. Wheeler, L. A. Koutsky, C. Malm, M. Lehtinen, F. E.

J. CLIN. MICROBIOL. Skjeldestad, S. E. Olsson, M. Steinwall, D. R. Brown, R. J. Kurman, B. M. Ronnett, M. H. Stoler, A. Ferenczy, D. M. Harper, G. M. Tamms, J. Yu, L. Lupinacci, R. Railkar, F. J. Taddeo, K. U. Jansen, M. T. Esser, H. L. Sings, A. J. Saah, and E. Barr. 2005. Prophylactic quadrivalent human papillomavirus (types 6, 11, 16, and 18) L1 virus-like particle vaccine in young women: a randomised double-blind placebo-controlled multicentre phase II efficacy trial. Lancet Oncol. 6:271–278. 27. Walboomers, J. M., M. V. Jacobs, M. M. Manos, F. X. Bosch, J. A. Kummer, K. V. Shah, P. J. Snijders, J. Peto, C. J. Meijer, and N. Munoz. 1999. Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J. Pathol. 189:12–19.

Downloaded from jcm.asm.org by on June 1, 2009