Ioftn Index
Ioftn Index
Objective: To design a new index categorizing the functional need for orthognathic treatment. Design: Laboratory-
based study. Setting: Records were obtained from two UK hospital-based orthodontic departments. Participants: A
panel of four consultant orthodontists, experienced in providing orthognathic care, devised a new index of
Orthognathic Functional Treatment Need (IOFTN) with the aid of the membership of the British Orthodontic
Society Consultant Orthodontists Group (COG). Twenty-three consultants and post-CCST level specialists took part
in the study as raters to test the validity and reliability of the new index. Methods: A total of 163 start study models
of patients who had previously undergone orthognathic treatment were assessed by the panel of four consultant
orthodontists using the new index (IOFTN) and the agreed category was set as the ‘gold standard’. Twenty-one
consultants and post-CCST level specialists then scored the models on one occasion and two scored 50 sets of models
twice to determine the test–re-test reliability. Results: Kappa scores for inter-rater agreement with the expert panel
for the major categories (1–5) demonstrated good to very good agreement (kappa: 0.64–0.89) for all raters. The
percentage agreement ranged from 68.1 to 92% in all cases. Intra-rater agreement for the major categories was
moderate to good (kappa: 0.53–0.80). Conclusions: A new index, the IOFTN, has been developed to help in the
prioritization of severe malocclusions not amenable to orthodontic treatment alone. It demonstrates good content
validity and good inter-rater and moderate to good intra-rater reliability. As a result of being an evolution of the
IOTN, the familiar format should make it easy to determine functional treatment need within daily orthognathic
practice.
Key words: Indices, orthognathic, IOTN, IOFTN
Assessment Record (Salzmann, 1968) and the Occlusal the IOTN in the absence of any other occlusal traits, and
Index (Summers, 1971) all having been developed earlier yet this can lead to potential gingival and periodontal
than the IOTN. The IOTN itself is a modification of an problems and might only be amenable to treatment with
index previously developed by the Swedish Dental combined orthodontic and orthognathic treatment.
Health Board (Linder-Aronson, 1974). With these limitations in mind, it was decided to create
In the process of developing an index of health, a a new Index of Orthognathic Functional Treatment
number of factors must be taken into consideration. The Need (IOFTN), using wherever possible the same traits
principal factor is its intended purpose, but ease of use as used in the IOTN DHC, but with modifications and
in daily practice is also important, since it may involve additions to reflect the functional indications of treat-
the collection and interpretation of a large amount of ment need for orthognathic patients. In this way, it was
data from which, a single useful indicator is then hoped to create an index that feels familiar to those
provided (Arvaniti and Panagiotakos, 2008). In addi- using the IOTN, is valid, reliable and quick and easy to
tion, an index should be both valid and reliable. A use. This paper describes the development of this new
number of studies have been carried out to assess the index.
validity and reliability of the IOTN, as well as the time
taken to use the index. Validity is often measured
against expert opinion. In comparison with other Materials and methods
orthodontic occlusal indices, the strengths of the Using the IOTN DHC as a starting point, four
IOTN DHC component are, not only its validity and consultant orthodontists with extensive experience in
reliability, but also that it is quick and easy to use treating orthognathic patients (AJI, SJC, MTC, NPH)
(Cardoso et al., 2011). Moreover, the grading also devised a draft IOFTN based on a five-point scale
appears to be unaffected by age, at least within the ranging from Very Great Need for Treatment (5)
relatively narrow age range of the adolescent patient through to No Need for treatment (1). The draft index
(Cooper et al., 2000). As a result, it is not only widely was then presented at the British Orthodontic Society
used in orthodontic research (Bellot-Arcı́s et al., 2012), Consultant Orthodontists Group (COG) Symposium in
but is also highly rated by those involved in planning Bristol during March 2013, following which it was
orthodontic service provision within the UK (de formally circulated to all 280 members of the COG
Oliveira, 2003). for written comment. Forty-six members replied with
The IOTN DHC is a straightforward five-point scale, written comments and these were then reconsidered at a
with the greatest need for treatment classified as being further meeting of the panel of experts. Modifications
group 5 and little or no need for treatment classified as were made to the wording of the index to reflect the
group 1. Within each group, there are well defined comments and at this point the index was considered to
descriptors of the features of the malocclusion deemed have face validity.
as indicators of orthodontic need (such as overjet, The panel of four experts then worked in pairs to score
impacted teeth and missing teeth). The reason the index 163 sets of start study models using the new index. The
is quick and easy to apply is that the malocclusion is sample of models represented various malocclusions
scored simply on the worst feature. In order to identify that had previously been treated using an orthognathic
this feature in a systematic manner it is suggested the approach. The scores were then compared and, wher-
assessor uses the acronym MOCDO (Missing teeth, ever there was disagreement, the panel discussed them
Overjet, Crossbites, Displacement of contact points, and came to a consensus score for each of the 163 sets of
Overbite) (Richmond et al., 1994). models. At this point, the index (Figure 1) was
Currently within the NHS, orthodontic treatment is considered to have content validity, as it was felt that
limited to IOTN DHC groups 4 and 5, and group 3 all of the possible facets of the construct of whether or
where the AC is grade 6 or above. Although widely not an orthognathic treatment approach was appro-
used, there are some limitations of the IOTN. In the case priate for functional reasons, had been considered.
of the AC of the index, it comprises only class I and class Twenty-one specialist orthodontists with experience of
II division 1 incisor relationships and there are no class orthognathic treatment, all consultant orthodontists and
II division 2 or class III incisor relationships. In the case senior FTTAs were then asked to score the 163 sets of
of the DHC, some of the functional indications for models using the new index, in order to test agreement
orthognathic treatment are not included, or might be with the expert panel scores. The scores were then
classified differently if the malocclusion were not analysed using Cohen’s kappa for inter-operator agree-
treatable with orthodontics alone. For example, exces- ment with the expert panel scores when assigning the
sive upper labial segment show at rest is not included in patient to one of the five major categories. It also looked
JO June 2014 Open Access Index of Orthognathic Functional Treatment Need 79
at assignment within the major categories to the considered good. When the agreement for the subcate-
individual sub-categories (for example, having decided gories within the major categories was compared with
a patient was in category 5, what was the agreement for the expert panel score, it was also good to very good for
allocation to the subcategories within the major all raters (Table 3), 2–5. There were too few models in
category). In addition, the percentage agreement with category 1 for statistical testing as few patients in this
all of the categories scored by the experts was also category will have undergone orthognathic treatment.
determined for each of the 21 assessors. The weighted kappa scores for intra-operator agree-
In order to determine the intra-operator agreement, ment were 0.53 for operator 1 and 0.80 for operator 2,
two consultants scored 50 sets of study models on two showing moderate to good agreement over time for each
separate occasions 1 week apart. Agreement was again rater. The percentage agreement for all categories and
tested using Cohen’s kappa for the main groups. subcategories was 68 and 76%, respectively.
Results Discussion
The results were analysed using SPSS (IBM SPSS In recent years, there has been a drive to reduce costs
Statistics 22.0; IBM Corp., Chicago, IL, USA) and within the UK NHS, not only to reduce overall
Stata Version 13 (STATA Corp., College Station, TX, spending, but also to divert money and resources from
USA). Table 1 is the summary table of the 163 study what are deemed ‘low priority’ treatments, to those
models, illustrating the number of models in each of the deemed to be of higher value and where the evidence to
IOFTN categories. The kappa scores for inter-operator support their use is said to be greater. As far back as
agreement with the expert panel scores for the major 2006, primary care trusts in England responsible for
categories are illustrated in Table 2, and this shows NHS funding within their areas began compiling lists of
good to very good agreement for all raters. The what they considered low priority treatments. One such
percentage agreement of the 21 assessors with the expert list, the Croydon List has received much attention and
panel scores for all categories is illustrated in Figure 2 comprised 34 treatments. Other PCTs compiled much
and ranged from 68.1 to 92%. The per cent agreement longer lists of over 100 procedures and this prompted
was over 80 for 16 of the 21 assessors, which can also be the Audit Commission in 2011 to suggest that their
implementation in commissioning health could lead to
Table 1 Numbers of models in each of the categories of annual savings to the NHS of £500 million (Audit
the IOFTN
Table 2 Kappa scores illustrating strength of agreement
Category 5 Number of models between the major category scores of each of the 21
assessors with the expert panel major category scores
5.1 9
5.2 9
(,0.25poor; 0.21–0.405fair; 0.41–0.605moderate; 0.61–
5.3 8 0.805good; 0.81–1.005very good agreement)
5.4 10
5.5 2 Assessor number Kappa score
5.6 0
5.7 5 1 0.85
Category 4 2 0.88
4.2 12 3 0.66
4.3 14 4 0.75
4.4 2 5 0.73
4.8 10 6 0.64
4.9 8 7 0.78
4.10 10 8 0.81
Category 3 9 0.83
3.3 13 10 0.81
3.4 7 11 0.80
3.9 0 12 0.83
3.10 9 13 0.87
Category 2 14 0.80
2.8 8 15 0.88
2.9 18 16 0.64
2.11 9 17 0.84
Category 1 18 0.89
1.12 0 19 0.76
1.13 0 20 0.81
1.14 1 21 0.74
JO June 2014 Open Access Index of Orthognathic Functional Treatment Need 81
Figure 2 Histogram illustrating the percentage agreement of each of the 21 assessors with the expert panel
scores for all of the 23 categories within the IOFTN
Authorities in England were abolished, in line with the with the IOTN, the single-most severe trait is used for
introduction of the UK government’s Health and Social scoring the patient. It is important, particularly when
Care reforms (Ham, 2012), and the South Central PCTs scoring from study models alone, that additional
commissioning intents appeared to have been lost information is provided; for example, information
during this NHS restructuring. In the new era, the would be required regarding the degree of upper labial
commissioning of all dental services and for the interim, segment exposure where present, or functional effects
all oral and maxillofacial services, were now to be such as trauma to the soft tissues where there is an
commissioned centrally by NHS England and imple- increased overbite. This will not be a problem where the
mented locally by the local area teams. In late 2013, IOFTN is used to score the patient at the chairside.
NHS England published its interim clinical commission- Similar limitations also apply to the use of IOTN when
ing policy for orthognathic treatment. Although this scoring more routine malocclusions from study models
interim policy was withdrawn in March 2013, it had alone. Once again, the IOFTN also demonstrates
stated the following (British Association of Oral and moderate to good intra-operator agreement over time
maxillofacial Surgeons (BAOMS), 2014): (0.53–0.80), not too dissimilar to that observed with the
IOTN, with its reported kappa scores of 0.75–0.84
N the IOTN must be 4 or 5;
(Brook and Shaw 1989).
N functional symptoms must have an important impact
After 24 years of service to orthodontics, it is perhaps
on quality of life, which would normally have become
timely that the application of IOTN in clinical practice is
apparent within 5 years of achieving skeletal matur-
being revisited. The concept that any one index should
ity;
not be expected to fit all eventualities when deciding on
N the multidisciplinary team confirms that orthodontic
treatment priorities has recently been made in reference
treatment is insufficient by itself to adequately correct
to secondary care orthodontics (Cousley, 2013). We
these functional symptoms;
therefore feel that the IOFTN is a natural evolution of the
N patients have reached skeletal maturity;
IOTN that should be used when setting treatment
N orthognathic treatment should be low priority on the
priorities for combined orthodontic and orthognathic
grounds of insufficient evidence of functional
care. It is both valid and reliable and, like the IOTN, is
improvement for:
quick and easy to use, thereby fulfilling the essential
requirements of an index. However, the IOFTN concerns
q speech problems;
the functional indicators for orthognathic treatment, and
q jaw pain, particularly that associated with the
other clinical and psychological indicators will also be
temporomandibular joint.
important in the assessment of orthognathic patients.
It would seem that the interim guidance was based on the
earlier South Centrals PCT work and included the IOTN
Conclusions
as a measure of severity and functional need. However,
A new index, the IOFTN, has been developed to help in
the use of IOTN has limitations as a measure of
the prioritization of severe malocclusions not amenable
functional and health need in orthognathic treatment
to orthodontic treatment alone. The index has face and
provision. In particular, some severe dentofacial defor-
content validity and has been shown to have good inter
mities and malocclusions would not be eligible for NHS
and moderate to good intra-operator reliability. As a
funding for orthognathic treatment using IOTN.
result of being an evolution of the IOTN, the format is
Examples include excessive upper labial segment gingival
similar to this index and so it should be easy to
exposure with evidence of gingival and/or periodontal
incorporate within daily orthognathic practice.
effects, complete scissor bites or facial asymmetries with
marked effects on the occlusal plane. In addition, there
was no mention of orthognathic treatment for sleep Disclaimer statements
apnoea. Contributors Each of the authors contributed in the
It is in order to overcome these limitations with the use following manner: substantial contributions to concep-
of IOTN in orthognathic treatment provision that the tion and design, or acquisition of data, or analysis and
IOFTN was developed. The new IOFTN has good face interpretation of data; drafting the article or revising it
and content validity and also demonstrates good to very critically for important intellectual content; and final
good inter-operator agreement (0.64–0.88), similar to approval of the version to be published. The guarantor
the IOTN (0.731–0.797) (Brook and Shaw, 1989). This is is Anthony J. Ireland.
perhaps not surprising, in that the two indices share a Funding None.
similar format, which clinicians are familiar with. As Conflicts of interest There are no conflicts of interest.
JO June 2014 Open Access Index of Orthognathic Functional Treatment Need 83
Ethics approval Ethical approval was not deemed Cooper S, Mandall NA, DiBiase D, Shaw WC. The reliability of the Index of
Orthodontic Treatment Need over time. J Orthod 2000; 27: 47–53.
necessary. Cousley R. IOTN as an assessment of patient eligibility for consultant
orthodontic care. J Orthod 2013; 40: 271–272.
de Oliveira CM. The planning, contracting and monitoring of orthodontic services,
Acknowledgements and the use of the IOTN index: a survey of consultants in dental public health
in the United Kingdom. Br Dent J 2003; 195: 704–706.
The authors would like to thank the members of the Draker HL. Handicapping labio-lingual deviations: a proposed index for public
health purposes. Am J Orthod I960; 46: 295–315.
COG who gave up their time to read and comment on Grainger RM. Orthodontic Treatment Priority Index. Public Health Service
the index and to score the models and to Professor Publication No. 1000, Series 2, No. 25. Washington, DC: US Government
Martyn Sherriff for his help and advice. Printing Office. 1967.
Ham C. The NHS in England in 2012? BMJ 2012; 343: d8259.
HIOW/SHIP Priorities Committee April 2008 to March 2012 Policy
Recommendations [Internet]. Available from: http://www.northhampshir
References eccg.com/website/X00237/files/ship-&-hiow-policy-recommendations.pdf
Arvaniti F, Panagiotakos DB. Healthy indexes in public health practice and (accessed 12 February 2014).
research: a review. Crit Rev Food Sci Nutr 2008; 48: 317–327. Holmes A, Wilmott D. The Consultant Orthodontists’ group 1994 survey of the use of
Audit Commission. Reducing Expenditure on Low Clinical Value Treatments. the Index of Orthodontic Treatment Need (IOTN). Br J Orthod 1996; 23: 57–59.
London: Audit Commission. 2011. Linder-Aronson S. Orthodontics in the Swedish Public Dental Health System.
BAOMS Interim Clinical Commissioning Policy: Orthognathic Surgery Trans Eur Orthod Soc 1974; 50: 233–240.
[Internet]. Available from: http://www.baoms.org.uk/file.aspx?id5752 Richmond S, O’Brien KD, Buchanan IB, Burden D. An Introduction to
(accessed 14 February 2014). Occlusal Indices. Manchester: Mandent Press. 1994.
Bellot-Arcı́s C, Montiel-Company JM, Almerich-Silla JM, Paredes-Gallardo V, Salzmann JA. Handicapping malocclusion assessment to establish treatment
Gandı́a-Franco JL. The use of occlusal indices in high-impact literature. priority. Am J Orthod 1968; 54: 749–765.
Community Dent Health 2012; 29: 45–48. Sharabiani M, Aylin, P, Bottle. A systematic review of comorbidity indices for
Brook PH, Shaw WC. The development of an index of orthodontic treatment administrative data. Med Care 2012; 50: 1109–1118.
priority. Eur J Orthod 1989; 11: 309–320. Solutions for Public Health 2012 [Internet]. Available from: http://
Cardoso CF, Drummond AF, Lages EM, Pretti H, Ferreira EF, Abreu MH. www.sph.nhs.uk/ebc/sph-files/mobb-policies/policy-recommendation-90-
The Dental Aesthetic Index and dental health component of the Index of orthognathic-surgery (accessed 12 February 2014).
Orthodontic Treatment Need as tools in epidemiological studies. Int J Summers CJ. The occlusal index: a system for identifying and scoring occlusal
Environ Res Public Health 2011; 8: 3277–3286. disorders. Am J Orthod 1971; 57: 552–567.