Escolar Documentos
Profissional Documentos
Cultura Documentos
Research Article
Kengo Hashimoto a Masafumi Sakagami a
West Corporation Osaka Hospital, Osaka, Japan; c Center for Clinical Research and
Keywords
Chronic rhinosinusitis · Nasal symptom questionnaire · Visual analogue scale · Endoscopic
sinus surgery
Abstract
Objectives: We aimed to verify the usefulness of our proposed nasal symptom question-
naire (NSQ) scoring system and to determine predictors linked to the improvement in nasal
symptoms in chronic rhinosinusitis (CRS) patients undergoing endoscopic sinus surgery
(ESS). Patients and Methods: Ninety-one CRS patients undergoing ESS and 144 volunteers
with results of NSQ available were enrolled. The NSQ consists of 10 items. Receiver-operat-
ing-characteristic (ROC) curve, area under the ROC curve (AUC), internal consistency, and
test-retest reproducibility of the NSQ were analyzed. The relationship of the NSQ score with
the visual analogue scale (VAS) was examined. After classifying into two groups, i.e., (i) “im-
provement group” and (ii) “no-improvement group,” factors linked to the improvement in
NSQ after ESS were investigated. Results: ROC-AUC (0.9318), the Cronbach α coefficient
(0.8696), and the test-retest coefficient (0.8131) showed high reliability. NSQ score signifi-
cantly correlated with VAS in both pre- (p < 0.0001, rs = 0.6007) and postoperative stages
(p < 0.0001, rs = 0.5975). The postoperative NSQ scores significantly decreased compared
with baseline levels (p < 0.0001). In multivariate analysis, the computed tomography (CT)
score by the Lund-Mackay scoring system revealed to be significant (p = 0.0481). Conclu-
sion: Our proposed NSQ scoring system was well verified. The CT score can be helpful for
predicting the improvement in nasal symptoms after ESS in CRS patients.
© 2018 S. Karger AG, Basel
Introduction
Sinonasal diseases can cause various symptoms such as sneezing, nasal obstruction,
nasal discharge, and olfactory loss, and thereby decrease the quality of life (QOL) [1–3]. It is,
therefore, essential to evaluate changes in subjective symptoms and QOL in patients with
sinonasal disease. To evaluate nasal symptoms and QOL, several questionnaires have been
preferably used: the 20-Item Sino-Nasal Outcome Test (SNOT-20) [4, 5], SNOT-22 [6–8] for
sinonasal diseases, the Japan Rhinitis Quality of Life Questionnaire (JRQLQ) [9] for allergic
rhinitis, and the self-administered odor questionnaire (SAOQ) [10] for olfactory dysfunction.
However, in daily clinical practice, there is concern about their complexity due to many
question items in these questionnaires, and a simple evaluation method of nasal symptoms
and QOL has been needed. Therefore, we created a novel simplified nasal symptom question-
naire (NSQ) consisting of 10 items, and we have used the NSQ for evaluating subjective
symptoms in patients with sinonasal diseases since June 2015.
Chronic rhinosinusitis (CRS) is one of the most common chronic diseases in adults and
severely affects QOL in patients [11–14]. CRS results in loss of daily work productivity, and
this is not a trivial amount. Productivity loss from CRS rivals that of other chronic disease
processes such as asthma, diabetes, and heart diseases [15, 16]. CRS is typically classified into
2 types: CRS with nasal polyps (NP) and CRS without NP [17–19]. Clinical features of CRS with
NP with eosinophil-dominant inflammation as “eosinophilic CRS (ECRS)” were first reported
in Japan in 2001 [20]. Clinically, ECRS is associated more closely with CRS with NP, clinical
complaints of nasal obstruction, and olfactory loss, and more frequently linked to comorbid-
ities such as asthma and aspirin hypersensitivity [21–24]. For the treatment of CRS, there is
currently an accepted treatment paradigm first with appropriate medical therapy such as
macrolide therapy and then with surgery if patients are refractory to medical therapy [2, 25,
26]. Endoscopic sinus surgery (ESS) can be indicated in such refractory cases. Postoperative
outpatient intranasal treatments under endoscopy and medication are also very important to
prevent recurring exacerbation [27, 28]. It is useful to estimate and evaluate a postoperative
sinonasal condition using an endoscopic scoring system [29, 30]. However, in daily clinical
practice, we certainly experience several cases whose subjective symptoms do not improve
even in CRS patients undergoing ESS. Thus, clarifying predictors associated with outcome in
CRS patients undergoing ESS is clinically of importance, although several prognostic factors
have already been reported [31–33].
The purpose of this study is to verify the usefulness of our proposed NSQ scoring system
and to determine predictors linked to clinical outcome, findings of nasal endoscopy, olfaction,
and sinonasal imaging in CRS patients treated with ESS.
Subjects
Between June 2015 and April 2018, 94 patients with CRS (60 men and 34 women; median age 51.0
years) who underwent ESS at the Department of Otolaryngology, Hyogo College of Medicine, and in whom
both pre- and postoperative NSQ results could be obtained, were enrolled in this study. ESS was performed
by 3 experienced rhinologists [34].
Patients were classified into ECRS (n = 45) and no-ECRS (n = 49) groups based on the Japanese Epide-
miological Survey of Refractory Eosinophilic Chronic Rhinosinusitis Study [20]. The criteria indicate ECRS
for a total score ≥11 from the following 4 items: (i) bilateral lesion (3 points); (ii) NP (2 points); (iii) ethmoid
sinus dominant or pansinusitis on computed tomography (CT) (2 points); and (iv) blood eosinophils > 2%
but ≤5%, 4 points; > 5% but ≤10%, 8 points; and > 10%, 10 points. Median duration of the postoperative
137.73.144.138 - 10/12/2018 10:41:51 AM
follow-up was 11.0 months (range, 2.0–24.0 months). The baseline data and the latest postoperative data
were collected for analysis.
King's College London
Downloaded by:
ORL 3
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
As a control group, a total of 144 volunteers (52 men and 92 women, median age 25 years), who were
staff members and students at the Hyogo College of Medicine, had been randomly selected. In the control
group, 121 healthy volunteers (48 men and 73 women, median age 24 years) without any sinonasal diseases
were analyzed to compare with the patients, and 61 volunteers (12 men and 49 women, median age 40 years)
could be retested on a > 5-day interval (median 7 days, ranging from 5 to 8 days) for test-retest reproduc-
ibility (including duplication).
of the NSQ were appropriate or not, and the results were investigated.
King's College London
Downloaded by:
ORL 4
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
Data are expressed as numbers or medians (ranges). ECRS, eosinophilic chronic rhinosinusitis; CT,
computed tomography.
Olfactory Tests
Olfactory tests were performed using the T&T olfactometer and intravenous olfaction test, both of
which are covered by health insurance and are commonly used for olfactory examination in our country [36].
The T&T olfactory test consists of 5 odorants: (i) β-phenylethyl alcohol, which smells like a rose; (ii) methyl
cyclopentenolone, which smells like burning; (iii) isovaleric acid, which smells like sweat; (iv) γ-undecalactone,
which smells like fruit; and (v) skatole, which smells like garbage (Takasago Industry Ltd., Tokyo, Japan).
Recognition thresholds were determined in each odorant. The average value in these 5 recognition thresholds
was defined as olfactometry function.
CT Score
CT findings were scored in accordance with the Lund-MacKay scoring system [37, 38]. The maxillary,
frontal, anterior, and posterior ethmoid, and sphenoid sinuses on both sides were scored from 0 to 2 points
(partial opacification: 1 point and complete opacification: 2 points). The ostiomeatal complex was scored
from 0 (no opacification) to 2 points (opacification). The total score was considered as the total CT score
(possible range: 0–24 points).
Statistical Analysis
Categorical parameters were compared by the Fisher exact test. Continuous parameters were compared
by paired or unpaired t test, Mann-Whitney U test, or Spearman rank correlation coefficient rs, as applicable.
The pretreatment NSQ scores were analyzed using a conventional receiver-operating-characteristic (ROC)
curve in order to determine the optimal cutoff points that yielded the highest combined sensitivity and spec-
ificity (Youden Index) with respect to distinguishing subjects without any sinonasal diseases from those with
them at the pretreatment stage. The positive and negative predictive values and the area under the curve
(AUC) were also calculated. The Cronbach α coefficient indicating internal consistency, test-retest reproduc-
ibility, known-group difference, and responsiveness to surgery (ESS) were also analyzed in order to validate
the NSQ.
For predicting treatment outcomes (i.e., improvement in NSQ score >3 points or more), candidate vari-
ables were selected by univariate analysis; parameters with p < 0.10 were subjected to a multivariate logistic
137.73.144.138 - 10/12/2018 10:41:51 AM
regression analysis. For the purpose of analyzing the significance of predictors in multivariate analysis, vari-
ables analyzed were divided by the median values for all cases (n = 91) and treated as dichotomous covariates.
King's College London
Downloaded by:
ORL 5
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
1.0
0.8
0.6
Sensitivity
0.4 ROC-AUC: 0.9318
Cutoff value: 4 points
Sensitivity: 0.9341
0.2 Specificity: 0.7769
Positive predictive value: 0.7589
Negative predictive value: 0.9400
Fig. 2. ROC analysis of NSQ. The
ROC-AUC was 0.9318, suggesting 0
0 0.2 0.4 0.6 0.8 1.0
a high diagnostic ability. The opti-
1 – specificity
mal cutoff value was considered
to be reasonable at 4 points.
The following parameters potentially related to the ESS outcome were examined in univariate analyses: age,
gender, presence of bronchial asthma, ECRS or no-ECRS, presence of nasal septum deviation, preoperative
mean recognition threshold, total IgE level, NP score, and CT score by the Lund-Mackay scoring system.
Clinical data were demonstrated as median values (ranges) unless stated otherwise. Statistical significance
was set at p < 0.05. Statistical analysis was performed with JMP software (version 13.0; SAS Institute Inc.,
Cary, NC, USA).
Results
80 80
60
60
VAS
VAS
40
40
20
20 rs = 0.6007 rs = 0.5975
p < 0.0001 0 p < 0.0001
0
5 10 15 20 25 0 5 10 15 20
a NSQ b NSQ
Fig. 3. The relationship between NSQ and VAS in the pre- (a) and postoperative (b) stages.
15
NSQ score
10
The median postoperative NSQ scores in the no-ECRS group (3 [0–18]) also significantly
decreased compared with baseline levels (p < 0.0001).
King's College London
Downloaded by:
ORL 7
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
Table 2. Univariate analysis for the improvement in nasal symptom questionnaire scores after endoscopic
sinus surgery
Data are expressed as numbers or medians (ranges). ECRS, eosinophilic chronic rhinosinusitis; CT,
computed tomography.
Table 3. Multivariate analysis of factors linked to the improvement in the nasal symptom questionnaire after
endoscopic sinus surgery
% p = 0.0474
100
85.1%
40/47
80
68.2%
30/44
60
40
20
Fig. 5. Proportion of patients with
improvement in NSQ after ESS
stratified by preoperative CT 0
CT score 10 or more CT score 9 or less
score by the Lund-Mackay scor-
ing system.
Discussion
In this study, we aimed to elucidate the usefulness of our proposed NSQ scoring system
and to determine predictors associated with the improvement in nasal symptoms in CRS
patients undergoing ESS. As mentioned earlier, several questionnaires have been proposed
and validated [4–10]. However, due to their complexity, they may not be easily manageable,
and it may be difficult to completely perform all questionnaires in daily clinical practice. Thus,
in our proposed NSQ scoring system, questions about symptoms were narrowed down to 8
items characteristic of allergy- and sinusitis-related symptoms, and together with the 2 items
on QOL, the total was set to 10 items. In our data, almost all volunteers answered that the
question items and numbers of the NSQ were appropriate. The NSQ and VAS scores showed
significant positive correlations in both pre- and postoperative stages. These results denoted
that our proposed NSQ scoring system is simple and useful to evaluate nasal symptoms in CRS
patients.
According to a judgment criterion of the ROC analysis, the ROC-AUC of 0.9318 could be
evaluated as excellent accuracy [39]. The cutoff value was clinically considered to be
reasonable at 4 points on the NSQ scale with a sensitivity of 0.9341 and a specificity of 0.7769.
The Cronbach coefficient (α = 0.8696), indicating internal consistency, could be appropriately
considered as high reliability [40, 41]. The test-retest showed a high reproducibility with a
coefficient of 0.8131 and a strong significant correlation between test and retest. Both total
and all 10 NSQ items showed significant differences between groups of healthy volunteers
and CRS patients. These results suggest that the NSQ scoring system could be reliable.
NSQ significantly decreased after ESS. In our experience, VAS also significantly decreased
after ESS both in the ECRS group and no-ECRS group [36]. Thus, our ESS showed favorable
results for CRS patients refractory to medical therapies.
In our multivariate analysis of parameters contributing to the improvement in NSQ after
ESS, only the CT score revealed to be significant, and the proportion of patients with
improvement in NSQ after ESS in patients with preoperative CT score >10 was significantly
higher than that in patients with preoperative CT score <9. In patients with preoperative CT
137.73.144.138 - 10/12/2018 10:41:51 AM
score <9, indication for ESS should be carefully reviewed because nasal symptoms may not
improve in such patients. Preoperative CT score significantly correlated with preoperative
King's College London
Downloaded by:
ORL 9
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
NSQ in this study (n = 91, p = 0.0358, rs = 0.4829). Patients with high CT scores have severe
symptoms, and the range of the sinonasal area to be treated by ESS can be widened in such
patients. Regarding olfactory function, the severity of the olfactory disorder and CT opacifi-
cation correlated significantly with the preoperative stage [38]. A high improvement rate of
75% in anosmic patients could be obtained in olfactory function after ESS [42]. It is considered
that as the extent of the sinonasal area normalized by ESS is wide, symptoms can improve to
a greater extent. Smith et al. [31] reported that preoperative CT scores approached signifi-
cance as being predictive of outcome after ESS for CRS patients. Stewart et al. [43] also demon-
strated that disease severity assessed by a pretreatment CT scan is a strong predictor of
clinical outcome, and CRS patients with higher symptom severity based on CT scans showed
significantly greater improvement. These reports are in line with our current results.
Further multicenter studies will thus be required to confirm the usefulness of the NSQ
score. However, clinical utility of the NSQ as an easy method of estimating the condition of
patients suffering from nasal symptoms was suggested in this study.
In conclusion, ESS can be useful for the treatment of CRS patients refractory to medical
therapies, and the CT score can be a useful predictor of clinical outcome. ESS should be care-
fully reviewed in patients with mild nasal symptoms to improve the patients’ QOL. Finally,
our proposed NSQ scoring system may be a promising scoring system.
Acknowledgment
We would like to thank all volunteers who answered the NSQ. We also gratefully acknowledge the help
of our technical assistants, Ms. Yumi Kida and Mrs. Midori Tanide. This work was partly supported by grants-
in-aid for scientific research (Japan Society for the Promotion of Science, KAKENHI: Nos. JP25462671 and
JP16K11220) from the Japan Society for the Promotion of Science, and the Practical Research Project for
Rare/Intractable Diseases from the Japan Agency for Medical Research and Development (AMED).
Statement of Ethics
The ethical committee meeting in our institution acknowledged our current study protocol (approval
Nos. 1512 and 2298). This study strictly followed all regulations of the Declaration of Helsinki.
Disclosure Statement
Author Contributions
Conception and design of the study were developed by K.T., T.S., and M.S. Data analysis and interpre-
tation were performed by T.S., K.O., K.H., and K.T. T.S., K.O., K.H., and K.T. were responsible for the acquisition
of data. T.S., K.T., and H.N. were involved in drafting of the article.
References
1 Wabnitz DA, Nair S, Wormald PJ. Correlation between preoperative symptom scores, quality-of-life question-
naires, and staging with computed tomography in patients with chronic rhinosinusitis. Am J Rhinol. 2005
Jan-Feb;19(1):91–6.
137.73.144.138 - 10/12/2018 10:41:51 AM
2 Djukic V, Dudvarski Z, Arsovic N, Dimitrijevic M, Janosevic L. Clinical outcomes and quality of life in patients
with nasal polyposis after functional endoscopic sinus surgery. Eur Arch Otorhinolaryngol. 2015 Jan;272(1):
83–9.
King's College London
Downloaded by:
ORL 10
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
3 Benninger MS, Senior BA. The development of the rhinosinusitis disability index. Arch Otolaryngol Head Neck
Surg. 1997 Nov;123(11):1175–9.
4 Piccirillo JF, Merritt MG Jr, Richards ML. Psychometric and clinimetric validity of the 20-Item Sino-Nasal
Outcome Test (SNOT-20). Otolaryngol Head Neck Surg. 2002 Jan;126(1):41–7.
5 Majima Y, Kurono Y, Hirakawa K, Suzaki H, Haruna S, Kawauchi H, et al. Reliability and validity assessments
of a Japanese version of QOL 20-Item Sino-Nasal Outcome Test for chronic rhinosinusitis. Auris Nasus Larynx.
2010 Aug;37(4):443–8.
6 Buckland JR, Thomas S, Harries PG. Can the Sino-nasal Outcome Test (SNOT-22) be used as a reliable outcome
measure for successful septal surgery? Clin Otolaryngol Allied Sci. 2003 Feb;28(1):43–7.
7 Poirrier AL, Ahluwalia S, Goodson A, Ellis M, Bentley M, Andrews P. Is the Sino-Nasal Outcome Test-22 a
suitable evaluation for septorhinoplasty? Laryngoscope. 2013 Jan;123(1):76–81.
8 Rudmik L, Soler ZM, Mace JC, DeConde AS, Schlosser RJ, Smith TL. Using preoperative SNOT-22 score to inform
patient decision for Endoscopic sinus surgery. Laryngoscope. 2015 Jul;125(7):1517–22.
9 Okubo K, Kurono Y, Ichimura K, Enomoto T, Okamoto Y, Kawauchi H, et al.; Japanese Society of Allergology.
Japanese guidelines for allergic rhinitis 2017. Allergol Int. 2017 Apr;66(2):205–19.
10 Takebayashi H, Tsuzuki K, Oka H, Fukazawa K, Daimon T, Sakagami M. Clinical availability of a self-adminis-
tered odor questionnaire for patients with olfactory disorders. Auris Nasus Larynx. 2011 Feb;38(1):65–72.
11 Soler ZM, Sauer DA, Mace J, Smith TL. Relationship between clinical measures and histopathologic findings in
chronic rhinosinusitis. Otolaryngol Head Neck Surg. 2009 Oct;141(4):454–61.
12 Hopkins C, Andrews P, Holy CE. Does time to endoscopic sinus surgery impact outcomes in chronic rhinosi-
nusitis? Retrospective analysis using the UK clinical practice research data. Rhinology. 2015 Mar; 53(1):
18–24.
13 Anand VK. Epidemiology and economic impact of rhinosinusitis. Ann Otol Rhinol Laryngol Suppl. 2004 May;
193:3–5.
14 Lanza DC, Kennedy DW. Adult rhinosinusitis defined. Otolaryngol Head Neck Surg. 1997 Sep;117(3 Pt 2):S1–7.
15 Rudmik L, Smith TL, Schlosser RJ, Hwang PH, Mace JC, Soler ZM. Productivity costs in patients with refractory
chronic rhinosinusitis. Laryngoscope. 2014 Sep;124(9):2007–12.
16 Chowdhury NI, Mace JC, Smith TL, Rudmik L. What drives productivity loss in chronic rhinosinusitis? A
SNOT-22 subdomain analysis. Laryngoscope. 2018 Jan;128(1):23–30.
17 Adnane C, Adouly T, Zouak A, Mahtar M. Quality of life outcomes after functional endoscopic sinus surgery for
nasal polyposis. Am J Otolaryngol. 2015 Jan-Feb;36(1):47–51.
18 Meltzer EO, Hamilos DL, Hadley JA, Lanza DC, Marple BF, Nicklas RA, et al.; American Rhinologic Society.
Rhinosinusitis: establishing definitions for clinical research and patient care. Otolaryngol Head Neck Surg.
2004 Dec;131(6 Suppl):S1–62.
19 Soler ZM, Pallanch JF, Sansoni ER, Jones CS, Lawrence LA, Schlosser RJ, et al. Volumetric computed tomography
analysis of the olfactory cleft in patients with chronic rhinosinusitis. Int Forum Allergy Rhinol. 2015 Sep;5(9):
846–54.
20 Tokunaga T, Sakashita M, Haruna T, Asaka D, Takeno S, Ikeda H, et al. Novel scoring system and algorithm for
classifying chronic rhinosinusitis: the JESREC Study. Allergy. 2015 Aug;70(8):995–1003.
21 Sahlstrand-Johnson P, Ohlsson B, Von Buchwald C, Jannert M, Ahlner-Elmqvist M. A multi-centre study on
quality of life and absenteeism in patients with CRS referred for endoscopic surgery. Rhinology. 2011 Oct;
49(4):420–8.
22 Bhattacharyya N. Influence of polyps on outcomes after endoscopic sinus surgery. Laryngoscope. 2007 Oct;
117(10):1834–8.
23 Smith TL. Outcomes research in rhinology: chronic rhinosinusitis. ORL J Otorhinolaryngol Relat Spec. 2004
Jul-Aug;66(4):202–6.
24 Kountakis SE, Arango P, Bradley D, Wade ZK, Borish L. Molecular and cellular staging for the severity of
chronic rhinosinusitis. Laryngoscope. 2004 Nov;114(11):1895–905.
25 Bliven BD, Kaufman SE, Spertus JA. Electronic collection of health-related quality of life data: validity, time
benefits, and patient preference. Qual Life Res. 2001;10(1):15–22.
26 Rudmik L, Mace J, Soler ZM, Smith TL. Long-term utility outcomes in patients undergoing endoscopic sinus
surgery. Laryngoscope. 2014 Jan;124(1):19–23.
27 Rudmik L, Smith TL. Evidence-based practice: postoperative care in endoscopic sinus surgery. Otolaryngol
Clin North Am. 2012 Oct;45(5):1019–32.
28 Nakamura Y, Suzuki M, Yokota M, Ozaki S, Ohno N, Hamajima Y, et al. Optimal duration of macrolide treatment
for chronic sinusitis after endoscopic sinus surgery. Auris Nasus Larynx. 2013 Aug;40(4):366–72.
29 Tsuzuki K, Hinohira Y, Takebayashi H, Kojima Y, Yukitatsu Y, Daimon T, et al. Novel endoscopic scoring system
after sinus surgery. Auris Nasus Larynx. 2014 Oct;41(5):450–4.
30 Tsuzuki K, Hashimoto K, Okazaki K, Sakagami M. Post-operative course prediction during endoscopic sinus
surgery in patients with chronic rhinosinusitis. J Laryngol Otol. 2018 May;132(5):408–17.
31 Smith TL, Mendolia-Loffredo S, Loehrl TA, Sparapani R, Laud PW, Nattinger AB. Predictive factors and
outcomes in endoscopic sinus surgery for chronic rhinosinusitis. Laryngoscope. 2005 Dec;115(12):2199–205.
137.73.144.138 - 10/12/2018 10:41:51 AM
32 Witsell DL, Stewart MG, Monsell EM, Hadley JA, Terrell JE, Hannley MT, et al. The Cooperative Outcomes Group
for ENT: a multicenter prospective cohort study on the effectiveness of medical and surgical treatment for
patients with chronic rhinosinusitis. Otolaryngol Head Neck Surg. 2005 Feb;132(2):171–9.
King's College London
Downloaded by:
ORL 11
DOI: 10.1159/000492965 © 2018 S. Karger AG, Basel
www.karger.com/orl
Saito et al.: Our Proposed Scoring System and Chronic Rhinosinusitis
33 Davis GE, Yueh B, Walker E, Katon W, Koepsell TD, Weymuller EA Jr. Psychiatric distress amplifies symptoms
after surgery for chronic rhinosinusitis. Otolaryngol Head Neck Surg. 2005 Feb;132(2):189–96.
34 Okazaki K, Tsuzuki K, Hashimoto K, Nishikawa H, Takebayashi H, Oka H, et al. Usefulness of our proposed
olfactory scoring system during endoscopic sinus surgery in patients with chronic rhinosinusitis. Eur Arch
Otorhinolaryngol. 2018 Feb;275(2):415–23.
35 Meltzer EO, Hamilos DL, Hadley JA, Lanza DC, Marple BF, Nicklas RA, et al.; Rhinosinusitis Initiative. Rhinosi-
nusitis: developing guidance for clinical trials. J Allergy Clin Immunol. 2006 Nov;118(5 Suppl):S17–61.
36 Oka H, Tsuzuki K, Takebayashi H, Kojima Y, Daimon T, Sakagami M. Olfactory changes after endoscopic sinus
surgery in patients with chronic rhinosinusitis. Auris Nasus Larynx. 2013 Oct;40(5):452–7.
37 Lund VJ, Mackay IS. Staging in rhinosinusitus. Rhinology. 1993 Dec;31(4):183–4.
38 Saito T, Tsuzuki K, Yukitatsu Y, Sakagami M. Correlation between olfactory acuity and sinonasal radiological
findings in adult patients with chronic rhinosinusitis. Auris Nasus Larynx. 2016 Aug;43(4):422–8.
39 Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988 Jun;240(4857):1285–93.
40 Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item Sinonasal Outcome Test.
Clin Otolaryngol. 2009 Oct;34(5):447–54.
41 de los Santos G, Reyes P, del Castillo R, Fragola C, Royuela A. Cross-cultural adaptation and validation of the
sino-nasal outcome test (SNOT-22) for Spanish-speaking patients. Eur Arch Otorhinolaryngol. 2015 Nov;
272(11):3335–40.
42 Soler ZM, Sauer DA, Mace JC, Smith TL. Ethmoid histopathology does not predict olfactory outcomes after
endoscopic sinus surgery. Am J Rhinol Allergy. 2010 Jul-Aug;24(4):281–5.
43 Stewart MG, Donovan DT, Parke RB Jr, Bautista MH Jr. Does the severity of sinus computed tomography
findings predict outcome in chronic sinusitis? Otolaryngol Head Neck Surg. 2000 Jul;123(1 Pt 1):81–4.