10 Brook Shaw 1989 IOTN Evaluation
10 Brook Shaw 1989 IOTN Evaluation
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
* University College Hospital, London
** University Dental Hospital of Manchester, England
SUMMARY The aim of this study was to develop a valid and reproducible index of orthodontic
treatment priority.
After reviewing the available literature, it was felt that this could be best achieved by using two
separate components to record firstly the dental health and functional indications for treatment,
and secondly the aesthetic impairment caused by the malocclusion.
A modification of the index used by the Swedish Dental Health Board was used to record the
need for orthodontic treatment on dental health and functional grounds. This index was modified
by defining five grades, with precise dividing lines between each grade.
An illustrated 10-point scale was used to assess independently the aesthetic treatment need of
the patients. This scale was constructed using dental photographs of 12-year-olds collected
during a large multi-disciplinary survey. Six non-dental judges rated these photographs on a
visual analogue scale, and at equal intervals along the judged range, representative photographs
were chosen.
To test the index in use, two sample populations were defined; a group of patients referred for
treatment, and a random sample of 11 -12-year-old schoolchildren. Both samples were examined
using the index and satisfactory levels of intra- and inter-examiner agreement were obtained.
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
This scale was constructed using dental photo-
important in the development of a new index of graphs of 1000 12-year-olds collected during a
orthodontic treatment need. large multi-disciplinary survey. Six non-dental
1. Separate components to record: judges rated these photographs on a visual
(a) Functional and dental health indications analogue scale, and at equal intervals along the
for treatment. judged range, representative photographs were
(b) Aesthetic impairment. chosen giving a 10-point scale from 0.5 (attrac-
2. For the functional and dental health compo- tive dental appearance) to 5.0 (unattractive den-
nent, each occlusal trait thought to contribute tal appearance) (Fig. 1).
to the longevity and satisfactory functioning
of the dentition, needs to be defined, and
easily measurable cut-off points between each Testing the index
grading need to be established. Two-hundred and twenty-two patients referred
In view of the uncertainty of the relative contri- to a regional orthodontic centre for advice or
bution that each occlusal trait makes to the treatment were examined under ideal lighting
longevity and satisfactory functioning of the conditions with radiographs available. Both
dentition and indeed the doubt surrounding the components of the index were applied and the
importance of aesthetics in the provision of patients were also asked to give their own rating
orthodontic care, the indices needed to be suffi- on the aesthetic scale.
ciently flexible to allow for adjustment of cut-off Intra-examiner error was estimated by the same
points and relativities between the categories, as examiner seeing 67 of these patients on two
the results from adequate longitudinal research occasions, at least one week apart, without
become available. reference to notes. A second examiner assessed
72 of the patients independently of the first
Development of the dental health component examiner to estimate inter-examiner error. To
With these criteria in mind, the index of treat- simulate the use of the indices in a screening
ment priority used by the Swedish Dental Board programme, 333, 11-12-year-old school children
(Linder-Aronson, 1974) was used as the basis for were examined. A cross section of schools
grading the functional and dental health indica- attended by children from a broad range of social
tions for treatment. There arefivegrades, grade 1 backgrounds were visited, and all available chil-
representing little or no need for treatment and dren in thefirstyear of secondary education were
grade 5 representing great need of treatment examined. Each child was examined in the school
(Table 1). An attempt was made to try to medical room using an angle-poise lamp for
establish from the literature meaningful values lighting, a simple millimeter rule and a dental
for cut-off points between grades for each occlu- mirror. Again, both components of the index
sal trait that represents a quantifiable threat to were applied, and the self rating recorded on the
the dentition. SCAN scale. In addition a dental surgery assist-
Most of the traits are recorded using a milli- ant recorded her rating on the SCAN scale.
metre rule, modified to incorporate a device for Forty-six children were chosen at random for re-
angular measurements. Crowding was recorded examination.
by measuring the largest displacement between Amongst the school sample 58 (17.4 per cent)
teeth in the arches, using a modified version of of the children were undergoing, or had com-
the index described by Lau et al. (1984). pleted orthodontic treatment. The orthodontist
In use, only the highest scoring trait need be involved in the treatment of each of these
recorded, as this determines the grading of the children was contacted so that details of the
patient. original malocclusion and information from the
ORTHODONTIC TREATMENT PRIORITY 311
Table 1 Index of orthodontic treatment need dental health component: for use on patients.
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
orthodontics.
Grade 4Great
Increased overjet greater than 6 mm but less than or equal to 9 mm.
Reverse overjet greater than 3.5 mm with no reported masticatory or speech difficulties.
Reverse overjet greater than 1 mm but less than or equal to 3.5 mm with reported masticatory or speech difficulties.
Anterior or posterior CTOssbites with greater than 2 mm displacement between retruded contact position and intercuspal
position.
Posterior lingual crossbites with no occlusal contact in one or both buccal segments.
Servere displacement of teeth greater than 4 mm.
Extreme lateral or anterior open bite greater than 4 mm.
Increased and complete overbite causing notable indentations on the palate or labial gingivae.
Patient referred by colleague for collaborative care e.g. periodontal, restorative or TMJ considerations.
Less extensive hypodontia requiring pre-restorative orthodontics or orthodontic space closure to obviate the need for a
prosthesis (not more than 1 tooth missing in any quadrant).
Grade 3Moderate
Increased overjet greater than 3.5 mm but less than or equal to 6 mm with incompetent lips at rest.
Reverse overjet greater than 1 mm but less than or equal to 3.5 mm.
Increased and complete overbite with gingival contact but without indentations or signs of trauma.
Anterior or posterior crossbite with less than or equal to 2 mm but greater than 1 mm displacement between retruded contact
position and intercuspal position.
Moderate lateral or anterior open bite greater than 2 mm but less than or equal to 4 mm.
Moderate displacement of teeth greater than 2 mm but less than or equal to 4 mm.
Grade 2Little
Increased overjet greater than 3.5 mm but less than or equal to 6 mm with lips competent at rest.
Reverse overjet greater than 0 mm but less than or equal to 1 mm.
Increased overbite greater than 3.5 mm with no gingival contact.
Anterior or posterior crossbite with less than or equal to 1 mm displacement between retruded contact position and intercuspal
position.
Small lateral or anterior open bites greater than 1 mm but less than or equal to 2 mm.
Pre-normal or post-normal occlusions with no other anomalies.
Mild displacement of teeth greater than 1 mm but less than or equal to 2 mm.
Grade 1None
Other variations in occlusion including displacement less than or equal to 1 mm.
study models could be used in place of the out of 118 re-tests and in all cases the disagree-
recordings taken at the school visits. In practice, ment was only by one grade. Guidelines for the
as many of the children were only just commenc- interpretation of the Kappa statistic (Landis and
ing treatment, the gradings were little changed. Koch, 1977) are shown in Table 2.
Inter-examiner agreement ranged from 0.731-
0.797. In total there were 21 out of 154 measure-
Results
ments that were not agreed. There were only 2
Reproducibility of the index cases where the error was by more than one
grade.
Dental health component
Intra-examiner agreement ranged from a Kappa SCAN component
value of 0.837 for the referred population seen For the referred sample there were three raters;
under ideal conditions, to 0.754 for the non- the patient and the two examiners. This gave two
referred population. In total there were 14 errors patient ratings (PI and P2), two ratings by
81:4 PETER H. BROOK AND WILLIAM C. SHAW
05
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
35
1-5
45
25
Figure 1 The SCAN Scale. Originally presented in colour in a horizontal arrangement. 0.5 extreme left. 5 extreme right.
Table 2 Guidelines for the interpretation of Kappa. Table 3 Examiner variability. Pearson's correlation
coefficients for SCAN.
Kappa statistic Strength of agreement
Referred Population
<0.00 Poor
0.00-0.20 Slight PB2 PI P2 WCS
0.21-0.40 Fair
0.41-0.60 Moderate PB1 0.87 0.50 0.36 0.71
0.61-0.80 Substantial (72) (82) (72) (82)
0.81-1.00 Almost perfect
PB2 0.45 0.40 0.73
(72) (72) (72)
PI 0.67 0.37
(72) (82)
examiner 1 (PB1 and PB2), and one rating by P2 0.29
examiner 2 (WCS). The examiner reproducibi- (72)
lity, and the comparability of patient and exa-
miner ratings, were investigated using Pearson's
correlation coefficient. The results are listed in tists were quite high, they were poorer than those
Table 3 with the number of repeat examinations obtained by Evans and Shaw (1987), where self-
in parenthesis. retaining lip retractors were used during the
Whilst the correlations between the orthodon- orthodontists' and the patients' assessments. For
ORTHODONTIC TREATMENT PRIORITY 313
this reason, self-retaining cheek retractors were in Table 5, and Figs. 2 and 3. The SCAN Index
used routinely for the examination of the non- scores are illustrated in Table 6, and Figs. 4 and
referred sample. 5.
In the school survey, 46 subjects were rated
twice by the orthodontist (PB) on the SCAN
Discussion
scale. Additionally, there was a rating by the
dental surgery assistant on two occasions (DSA1 Reproducibility
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
and DSA2), and two subject ratings (SI and S2).
Again, these relationships were examined using Dental health component
Pearson's correlation coefficient (Table 4). In general, the reproducibility of this index was
On this occasion intra-examiner agreement for very good. The same grade was re-chosen 86.4
the orthodontist (PB) was better. The DSA's per cent of the time with different examiners, and
reproducibility was less good. There was how- in 93 per cent of cases for the same examiner
ever, superior inter-examiner agreement on this under the more ideal clinic setting (the referred
occasion. There was also better correlation population).
between the subjects' and the professionals' The common traits causing disagreement, in
ratings. descending order of frequency were; crowding,
increased overjet, crossbites and overbites.
General features of the referred and non-referred Crowding represents a problem in recording
populations when the patient is in the mixed dentition.
The numbers of patients falling into each Dental Further refinement of the index in terms of the
Health Index grade for each group are illustrated mixed dentition analysis of crowding, may lead
to an improvement in reproducibility.
Evidently, the less than ideal conditions of the
Table 4 Examiner variability. Pearson's correlation school examination resulted in poorer reproduci-
coefficients for SCAN. bility. Should reproducibility levels similar to
that of the referred population be required, then
School Population better lighting, better patient seating facilities
DSA2 SI S2 PB1 PB2 and a more relaxed work rate would be required.
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
1 2 3 4 5
DENTAL HEALTH INDEX SCORE
Figure 2 Distribution of ratings for the Dental Health Index obtained from examination of 222 patients referred to a regional
orthodontic centre.
desirable. Self-retaining cheek retractors are a the SCAN Index, showded a distribution skewed
useful aid to recording dental aesthetics. towards the attractive end of the scale. The
patient ratings are skewed even further towards
The referred sample the attractive end of the scale, i.e. there was a
As expected, the referred sample showed a large tendency for subjects to overrate their dental
proportion of patients scoring in the higher attractiveness.
grades of the Dental Health Index, with all but 6
per cent in the highest three grades. The ortho- Comparison of the two samples
dontists' SCAN ratings showed a similar shift to From an overview of the data recorded from the
the unattractive side. The patient ratings showed samples, it appears quite obvious that there are
this effect to a much smaller extent. significant differences between them. Indeed the
median test and the /-test demonstrate this
The school population readily for the Dental Health component and the
There was a much more even spread of patients SCAN component respectively (p< 0.0001).
amongst the grades of the Dental Health Index However, the findings from the two surveys
for this population, with approximately one are not directly comparable. Firstly, the referred
third of the subjects in grade 3, and one third sample had a wide age spread, and secondly,
either side of this. The professional ratings using when applying the Dental Health component to
ORTHODONTIC TREATMENT PRIORITY 315
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
1 2 3 4 5
DENTAL HEALTH INDEX SCORE
Figure 3 Distribution of ratings for the Dental Health Index obtained from examination of 333 unselected schoolchildren.
the referred population, the examiners had Table 6 Distribution of SCAN ratings (Orthodontist
access to radiographs. For the school sample, it score).
was necessary to set criteria for such parameters
as unerupted or missing teeth, i.e. except for Referred Population School 1Population
incisors and first molars, all teeth were assumed SCAN
to be present, at age 11-12 years, premolars and rating Numbers Percentage Numbers Percentage
canines were assumed to be unerupted but not
0.5 0 0.0 16 4.8
impacted, missing upper lateral incisors and 1.0 2 1.0 54 16.2
lower incisors were assumed to be developmen- 1.5 19 9.4 65 19.5
tally absent whereas missing upper central inci- 2.0 17 8.4 59 17.7
sors and first molars were assumed to have been 2.5 28 13.8 62 18.6
extracted. 3.0 33 16.3 33 9.9
3.5 39 19.2 26 7.8
In an attempt to overcome this, a sub-group of 4.0 48 23.6 12 3.6
25 from the referred sample, with a similar age 4.5 8 3.9 5 1.5
range to the school sample was selected. Any 5.0 8 3.9 1 0.3
conditions that would have required radiographs Total 202 100.0 333 100.0
to confirm the diagnosis, were regraded using the
316 PETER H. BROOK AND WILLIAM C. SHAW
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
4 5 6 7 8
SCAN RATING
Figure 4 Distribution ot raungs for the SCAN index obtained from examination of 222 patients referred to a regional
orthodontic centre.
criteria set for the population seen without acceptable as it has been shown that most of the
radiographs. traits can be recorded with a high degree of
It was still evident that the samples were drawn
precision (Helm et al., 1975; Helm, 1977) with up
from different populations (Mest p< 0.001 for to 80 per cent agreement. However in their pure
the SCAN ratings; median test p< 0.001 for the form they do not record treatment priority.
Dental Health ratings). These tests seemingly The allocation of weighting factors to traits
validate the index, at least in terms of the can give an overall figure that is intended to
priorities of patients or dentists in bringing about
represent a score of severity, and thus treatment
referral to an orthodontist. priority. Several indices of this type have been
developed (Summers, 1971; Draker, 1960; Gra-
Comparison with previous methods of recording inger, 1967). Correlation coefficients for exa-
treatment priority miner agreement for such indices have ranged
Angle's classification (Angle, 1899) has been from a Spearman correlation coefficient of 0.903
shown to have poor reproducibility (Gravely and (Summers, 1971) to as low as 0.34 (Albino et al.,
Johnson, 1974) and has no usefulness in record- 1978) in a community screening setting. The
ing treatment priority. For epidemiological use, validity of such indices relies on acceptance of the
the registration techniques described by Bjork et authors' weightings.
al. (1964) and Baume et al. (1973) may be quite Indices based upon the classification of mor-
ORTHODONTIC TREATMENT PRIORITY 317
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
25-
P 19.5
E 20 - 18.6
R 17.7
C
E 15 -
N
T
A 9.9
G 10-
E 7.8
5 - 3.6
1.5
0.3
1 2 3 4 5 6 7 8 10
SCAN RATING
Figure 5 Distribution of ratings for the SCAN index obtained from examination of 333 unselected schoolchildren.
phological traits rely on the subjective opinion of development was based upon a full analysis of
an experienced judge to define the dividing lines the available literature (Brook, 1987) and the
between each trait (Linder-Aronson, 1974; experience gained from a longitudinal survey
Lundstrom, 1977; Malmgren, 1980). Used as (Shaw et ai, 1986), it is not felt that its validity
such, the percentage concordance ranges from can be inferior to that of other indices. The
55.9 to 74.6 per cent (Malmgren, 1980). inclusion of a separate index to record aesthetic
Subjective clinical opinion alone has agree- impairment removes the most subjective element
ment of about 80 per cent in most studies from indices of this kind. Good levels of agree-
(Bowden and Davies, 1975; Helm et ai, 1975) ment for this component have been demon-
but the validity of such judgements depends strated (Pearson's correlation coefficient values
upon the examiners' knowledge of the harmful from 0.71-0.95).
effects of malocclusion. In addition, inexper- Some support for the validity of the index
ienced examiners will find it difficult to apply comes from the observation that fewer subjects
such techniques. in the lower grades were referred for orthodontic
The orthodontic index of treatment need" advice. The extent to which it represents com-
described in this report has examiner agreement mon professional opinion is presently being
levels that compare well with any of those evaluated. However, true validity (i.e. that the
previously described (80.5-93 per cent). As its index measures what it purports to measure)
318 PETER H. BROOK AND WILLIAM C. SHAW
Table 7 Interrelationship between the SCAN and Dental Health Index scores.
(Cumulative Percentages)
1 2.1 5.4 6.3 6.6 7.2 7.2 7.2 7.2 7.2 7.2 7.2
2 4.2 15.6 25.8 31.8 34.8 35.1 35.1 35.1 35.1 35.1 35.1
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
3 4.5 19.5 37.2 51.3 60.9 64.5 65.7 67.2 67.2 67.2 67.2
4 4.8 20.4 39.6 57.3 75.3 84.9 91.5 93.9 94.8 94.8 94.8
5 4.8 21.0 40.5 58.5 76.8 86.7 94.5 98.2 99.7 100.0 100.0
Total 4.8 21.0 40.5 58.5 76.8 86.7 94.5 98.2 99.7 100.0 100.0
must await the compilation of a greater body of tions could produce a similar percentage. An
knowledge than that which is currently available. alternative method would be to combine the
It may accurately reflect contemporary profes- scores from the two components to give an
sional opinion, but this may be erroneous. overall score, then define limits based on this
figure.
Epidemiological uses for the index Eventual definitions of cut-offs must reflect the
During testing of the index on the school sample, setting in which treatment would be provided
it was felt that it represented a simple, quick and and include a consideration of the success rate of
reasonably reproducible method of recording the treatment which would be available, the
orthodontic treatment need. As all the traits are iatrogenic risks, and the cost (Shaw, 1987).
simple to record, it may be possible for less highly
trained personnel to apply the index, following
suitable training and calibration. Conclusions
An index with two components has been devel-
Further development of the index oped to record orthodontic treatment priority.
As developed so far, the index records the dental The first of these components records need for
health need for treatment, and the aesthetic treatment on dental health and functional
impairment, and by implication the social- grounds. The second component records the
pschological need for treatment. As yet, no aesthetic impairment, and by implication, the
attempt has been made to combine these into an justification for treatment on social-psychologi-
overall assessment of treatment need, or to define cal grounds.
scores below which treatment should be with- The indices were tested on a sample of patients
held. referred for orthodontic treatment and advice,
To assist discussion in this area, a table and on a random selection of 11-12-year-old
showing the cumulative percentages of patients school children. It was easy and quick to use and
having varying combinations of the Dental had acceptable reproducibility. True validation
Health grades, and the SCAN ratings has been of such an index must await the emergence of
constructed from the non-referred sample (Table further research data on the effects of malocclu-
7). sion, but the present index can be adaptable to
Many authors quote figures of around 50 per new information. Work is currently in progress
cent for the percentage of children who would to gauge the extent to which the index reflects
benefit from orthodontic treatment (Gardiner, common professional opinion.
1956; Haynes, 1982; Foster and Walpole Day, Defining specific ranges within which patients
1973). From Table 7, it can be seen that this should, or should not be offered treatment has
number would be obtained if patients scoring 'not been attempted but a mathematical model
grade 3 or less on the Dental Health Index and has been suggested that can define combinations
2.0 or less on the SCAN scale were excluded (51.3 of the gradings that will encompass varying
per cent), leaving 48.7 per cent. Other combina- proportions of a target population.
ORTHODONTIC TREATMENT PRIORITY 319
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012
Public Health Service Publication No 1000, Series 2, No.
a scribe. The study was supported in part by a 25. Washington DC, U.S. Government Printing Office.
grant from the DHSS and BLG.
Gravely J F, Johnson D B 1974 Angle's classification of
malocclusion: an assessment of reliability. British Journal
Address for correspondence of Orthodontics 3: 79-86
Professor W C Shaw Haynes S 1982 Discontinuation of orthodontic treatment in
the General Dental Service in England and Wales 1972-
Department of Orthodontics 1979. British Dental Journal 152: 127-129
University Dental Hospital of Manchester Helm S 1977 Intra-examiner reliability of epidemiological
and Turner Dental School registrations of malocclusion. Acta Odontologica Scandi-
Higher Cambridge Street navica 35: 161-165
Manchester M15 6FH Helm S, Kreiborg S, Barlebo J, Caspersen J, Eriksen J H,
England Hansen W, Hanusardottir B, Munck C, Perregaard J,
Prydson U, Reumert C, Spedtsberg H 1975 Estimates of
orthodontic treatment need in Danish schoolchildren.
References Community Dentistry and Oral Epidemiology 3: 136-142
Addy M, Griffiths G S, Duramer P M H, Kingdon A, Hicks Horup N, Melsen B, Terp S 1987 Relationship between
R, Hunter M L, Newcome R G, Shaw W C 1988 The malocclusion and maintenance of teeth. Community Den-
association between tooth irregularity and plaque accumu- tistry and Oral Epidemiology 15: 74-78
lation, gingivitis, and caries in 11-12-year-old children. Jarvinen S 1979 Traumatic injuries to upper permanent
European Journal of Orthodontics 10: 76-83 incisors related to age and incisal overjet. Acta Odonto-
Albino J E, Lewis E A, Slakter M J 1978 Examiner reliability logica Scandinavica 37: 335-338
for two methods of assessing malocclusion. Angle Ortho- Landif. J R, Kock G G 1977 The measurement of observer
dontist 48: 297-302 agreement for categorical data. Biometrics 33: 159-174
Angle E H 1899 Classification of malocclusion. Dental Lau D, Griffiths G, Shaw W C 1984 Reproducibility of an
Cosmos 41: 248-264 index for recording the alignment of individual teeth.
Baume L J, Horowitz H S, Summers C J, Backer Dirks O, British Journal of Orthodontics 11: 80-84
Brown W A B, Carlos J P, Freer T J, Harvold E P, Linder-Aronson S 1974 Orthodontics in the Swedish Public
Moorrees C F A, Saltzman J A, Schmuth G, Solow B, Dental Health System. Transactions of the European
Taatz H 1973 A method of examining occlusal traits Orthodontic Society 233-240
developed by the FDI commission on classification and
statistics for oral conditions (COCSTOQ International Lundstrom A 1977 Need for treatment in cases of malocclu-
Dental Journal 23: 530-537 sion. Transactions of the European Orthodontic Society
53: 111-123
Bjork A, Krebs Aa, Solow B 1964 A method for epidemi-
ological registration of malocclusion. Acta Odontologica Malmgren O 1980 Studies on the need and demand for
Scandinavica 22: 27-41 orthodontic treatment. Swedish Dental Supplement 6
Bowden D E J, Davies A P 1975 Inter- and intra-examiner Mohlin B, Thilander B 1984 The importance of the relation-
variability in assessment of orthodontic treatment need. ship between malocclusion and mandibular dysfunction
Community Dentistry and Oral Epidemiology 3: 198-200 and some clinical applications in adults. European Journal
of Orthodontics 16: 192-204
Brook P H 1987 The development of an orthodontic
treatment priority index. M.Sc. Thesis, University of Roth R H 1973 Temporomandibular pain-dysfunction and
Manchester occlusal relationships. Angle Orthodontist 43: 136-154
Davies T M, Shaw W C, Addy M, Dummer P H 1988 The Salzmann J A 1968 Handicapping malocclusion assessment
relationship of anterior overjet to plaque and gingivitis in to establish treatment priority. American Journal of
children. American Journal of Orthodontics 93: 303-309 Orthodontics 54: 749-765
Draker H L I960 Handicapping labio-lingual deviations: a Sandali T 1973 Irregularities of the teeth and their relation to
proposed index for public health purposes. American the periodontal condition with particular reference to the
Journal of Orthodontics 46: 295-315 lower labial segment. Transactions of the European Ortho-
Evans M R and Shaw W C 1987 Preliminary evaluation of an dontic Society 319-333
illustrated scale for rating dental attractiveness. European Shaw W C 1988 Risk benefit appraisal in orthodontics. In
Journal of Orthodontics 9: 314-318 orthodontics: evaluation and future. Proceedings of the
320 PETER H. BROOK AND WILLIAM C. SHAW
international conference on the occasion of the 25th Shaw W C, Addy M, Ray C 1980 Dental and social effects of
Anniversary of the Orthodontic Department of the malocclusion and effectiveness of orthodontic treatment: a
University of Nymegen, The Netherlands. October 22-24, review. Community Dentistry and Oral Epidemiology 8:
1987. Editors: C F A Moorrees and F P G M van der 36-45
Linden. Pp 63-81
Summers C J 1971 The occlusal index: a system for identify-
Shaw W C, Addy M, Dummer P M H, Ray C, Frude N 1986 ing and scoring occlusal disorders. American Journal of
Dental and social effects of malocclusion and effectiveness Orthodontics 57: 552-567
of orthodontic treatment: a strategy for investigation.
Community Dentistry and Oral Epidemiology 14: 60-64
Downloaded from http://ejo.oxfordjournals.org/ at Aarhus Universitets Biblioteker / Aarhus University Libraries on May 21, 2012