Defining Spoken Language Benchmarks and Selecting Measures of Expressive Language Development for Young Children with Autism Spectrum Disorder
Helen Tager-Flusberg, Boston University School of Medicine
Sally Rogers, University of California, Davis/MIND Institute
Judith Cooper, NIDCD
Rebecca Landa, Kennedy Krieger Institute, Johns Hopkins School of Medicine
Catherine Lord, University of Michigan;
Rhea Paul, Yale Child Study Center
Mabel Rice, University of Kansas
Carol Stoel-Gammon, University of Washington
Amy Wetherby, Florida State University
Paul Yoder, Vanderbilt University
KEYWORDS: Autism; Autism Spectrum Disorders; Language Acquisition
The aims of this paper are:
- To offer a set of recommended measures that can be used for evaluating the efficacy of interventions that target spoken language acquisition as part of treatment research studies or for use in applied settings.
- To propose and define a common terminology for describing levels of spoken language ability in the expressive modality and set benchmarks for determining a child’s language level in order to establish a framework for comparing outcomes across intervention studies.
The NIDCD assembled a group of researchers with interests and experience in the study of language development and disorders in young children with ASD. The group worked for 18 months through a series of conference calls and correspondence, culminating in a meeting held in December 2007 to achieve consensus on these aims.
- We recommend moving away from using the term “functional speech,” replacing it with a developmental framework;
- We recommend multiple sources of information to define language phases, including natural language samples, parent report, and standardized measures;
- We provide guidelines and objective criteria for defining children’s spoken language expression in three major phases that correspond to developmental levels between 8 and 48 months of age.
Autism is a neurodevelopmental disorder characterized by primary impairments in social interactions, communication, and repetitive and stereotyped behaviors (American Psychiatric Association, 2000). In addition, autism often results in significant disability, including intellectual deficits, language and adaptive behavior deficits, as well as problem behaviors. It is now recognized that classic autism is part of a spectrum of related disorders that includes pervasive developmental disorder-not otherwise specified (PDD-NOS) and Asperger syndrome; this set of diagnoses, collectively, is referred to here as autism spectrum disorders (ASD). Outcomes for children with ASD represent a broad continuum, with only a small percentage achieving independence and full employment as adults (Howlin, Goode, Hutton, & Rutter, 2004). ASDs are no longer thought to be rare disorders. Current reports indicate that 1 in every 150 children in the United States will receive an ASD diagnosis (Bertrand, Mars, Byle, Bove, 2001; Kuehn, 2007; Yeargin-Allsopp, Rice, Karapurka, Doernberg, Boyle, Murphy, 2003).
Children with ASD have long been known to respond to interventions that target specific skills and behaviors (NRC, 2001), and numerous studies have demonstrated the positive effects of early intervention on language development for the majority of children with ASD (Dawson & Osterling, 1997; Koegel & Koegel, 1988; Lovaas, 1987; Rogers, 2005; Rogers & Vismara, 2008), with some, though sparse, evidence of long lasting benefit. The fact that language development can be positively affected by early treatment has tremendous potential significance, because the emergence of spoken language is one of the most important variables predicting better outcomes in later childhood and adulthood (Gillberg & Steffenburg, 1987; Howlin et al., 2004; Venter, Lord, & Schopler, 1992). Thus, given the role of language acquisition in shaping long term outcomes, it has become important to identify the most successful strategies for facilitating language acquisition in young children with ASD, who uniformly demonstrate significant delays in at least some aspects of language and communicative development, especially in the domain of pragmatics (Tager-Flusberg, Paul & Lord, 2005).
While various intervention approaches teach and measure language acquisition in different ways, depending on the philosophy and underlying theory of the approach (see Rogers 2005 for a review), consumers of this literature must be able to compare language outcomes from different treatment approaches. Despite the numerous published language outcome studies of early intervention in ASD (Rogers, 2005), it is not possible to compare language outcomes across reports, because of the lack of uniform measurement approaches to assessing language skills, and the lack of uniform terminology for describing language outcomes in ASD. Many intervention programs for children with ASD, aim to facilitate the development of “functional speech.” However, because there has never been consensus on the definition of “functional speech” it is impossible to compare the longer term efficacy of different treatment programs. In this paper we offer an alternative framework for describing spoken language acquisition in children with ASD. The proposal described here replaces the arbitrary singular categorical distinction encompassed by the terminology of “functional speech” with a framework that captures the continuous developmental processes that underlie language acquisition.
In December 2006 the NIDCD assembled a group of experts in language disorders and language acquisition in young children with ASD to address these issues. Over the next year the group worked together through a series of conference calls and correspondence, culminating in a meeting held in December 2007. This paper summarizes the group’s recommendations relating to our primary goal of providing benchmarks for defining the acquisition of spoken language in the expressive modality in young children with ASD.
The working group set two major objectives:
- To develop a set of recommended measures that can be used for evaluating the efficacy of interventions that target spoken language acquisition as part of treatment research studies or for use in applied settings.
- To propose and define a common terminology for describing levels of spoken language ability and set benchmarks for determining a child’s spoken language level in order to establish a framework for comparing outcomes across intervention studies.
As such, this paper is addressed primarily to researchers; however, practitioners and other consumers are also relevant audiences. For researchers in early autism intervention, who may come from a wide range of theoretical backgrounds and practices, our goal is to provide common terminology and a suggested approach to defining language abilities before, during, and after treatment. The varying measurement approaches used in language intervention research require different levels of financial and human resources and expertise. In addition, researchers have differing aims and hypotheses that may require specialized descriptions of language acquisition of their participants. Thus, we propose a measurement approach that may be applied in a “bare bones” fashion (e.g., relying on direct assessments and parent reports), as well as a more elaborated measurement system (e.g., adding in measures derived from natural language samples), covering the full range of language domains that could be included in treatment programs. By proposing these guidelines we hope to move beyond the ambiguously defined treatment goal of “functional speech” to a more standardized approach, using common measures and common definitions that will allow comparison of outcomes across studies.
For practitioners, the proposed measures and benchmarks presented here provide a framework for describing the language progress of their clients during treatment. By providing a common framework we hope to facilitate the assessment process for clinicians, allowing them to measure their clients’ language gains in relation to the research literature. Thus, we aim to enhance the relationship between treatment research and clinical practice in the field of language intervention in ASD.
Our final target group of readers includes parents, early intervention professionals, and others who work to extract evidence of progress, whether research effectiveness or clinical efficacy, from clinical reports and research papers that use language measures to chart change in children with ASD. Clearly defined benchmarks of speech and language development will aid families, early childhood educators, and others who turn to the language research literature to understand language growth in young children with ASD.
Some additional comments are in order. First, we focus here exclusively on the development of spoken language through the preschool years, omitting consideration of measures and benchmarks for defining preverbal communicative skills. While the working group recognizes that sophisticated language skills take many forms, including both verbal and non-verbal means for effective communication, and that children with ASD continue to make important advances in language well into the school years, we selected these constraints because outcome studies are uniform in the predictive power of spoken language (i.e., speaking in sentences that serve a variety of functions; e.g., Paul & Cohen, 1984) by age five for individuals with ASD (e.g., Howlin et al., 2004; Venter et al., 1992). Second, we limited our focus to the development of expressive language skills in children with ASD because most intervention studies target expressive language as the primary outcome and also because expressive language is more reliably assessed, especially in children with ASD (cf. Tager-Flusberg, 2000). Third, we have limited our recommendations for measures and benchmarks to English, in part because almost all current studies have focused on English-speaking children with ASD. We hope, however, that the overall framework and guidelines presented here can be readily translated into other languages with some modifications.
Recommendations for Measuring Expressive Language
In order to capture the spoken language and communicative abilities of young children with ASD and to avoid sampling effects, assessments in this domain should include measures derived from multiple sources. These sources should ideally include (1) natural language samples, (2) parent report, and (3) direct standardized assessment.
a) Natural Language Sample (NLS)
Natural language samples that are collected in different communicative contexts provide excellent measures of a child’s expressive language abilities, including phonological repertoire, lexical and grammatical knowledge, and pragmatic/communicative skills; the latter are especially difficult to measure using other types of assessment. A NLS may be collected during either experimenter/clinician-child or mother-child interactions. Contexts during which a NLS may be collected include the administration of the Autism Diagnostic Observation Schedule (ADOS; Lord et al., 2000), the Communication and Symbolic Behavior Scales (CSBS; Wetherby & Prizant, 2002), the Early Social and Communication Scales (ESCS; Mundy et al. 1996; Siebert et al., 1982), or equivalent contexts that include social communicative presses. The specific context should be determined based on the goals of the assessment. For example, if a primary outcome measure of a treatment program includes the functional use of specifically targeted forms, then adequate sampling of a range of different communicative contexts (e.g., contexts for requesting, protesting, sharing) would be needed.
Typically, natural language samples will be at least 30 minutes in length to provide adequate time and opportunity to sample a sufficient number and range of utterances. For children with ASD, one may need to concatenate several short language samples to obtain 30 minutes of language behavior. Following the collection of a NLS (see Miller & Chapman, 2000 for discussion of methods), the data must be transcribed and coded to derive useful measures of the child’s language. The particular level of transcription (e.g., phonetic, lexical, inclusion of adult language) will again depend on the specific focus of the assessment. Transcription and analyses can be supported by computer-based software, including the widely used Systematic Analysis of Language Transcripts (SALT; Miller & Chapman, 2008), Child Language Data Exchange System (CHILDES; MacWhinney, 2000), Lingquest (Mordecai & Palin, 1982), or Computerized Profiling (Long & Fey, 2004).
b) Parent Report
Parent report measures, administered in questionnaire or interview format, can provide useful information about a child’s language skills that may not be observed in a laboratory or clinic setting. The most widely used measure is the MacArthur-Bates Communicative Development Inventory (MCDI; Fenson et al., 1993; 2007). The MCDI can be used to assess children’s expressive vocabulary and grammatical knowledge between the ages of 8 and 42 months. Although there are concerns that some parents may over- or under-report their child’s language repertoire, parent report instruments have generally been shown to provide valid assessments of young children’s language as measured by evidence that early predictors of language also predict MCDI productive raw scores in children with ASD (Charman, Baron-Cohen, Swettenham, Baird, Drew, & Cox, 2003; Luyster, Qui, Lopez & Lord, 2007). There is also evidence that MDCI scores are highly correlated with other measures of language in children with autism (Luyster, Kadlec, Connolly, Carter & Tager-Flusberg, 2008).
c) Direct Assessment/Standardized Tests
Direct assessment of a child’s language skills should be accomplished using standardized tests that have good psychometric properties, with particular attention paid to the reliability and validity of the measures that are derived from such tests for children with ASD. Standardized tests can be used to assess expressive language skills in phonological, lexical, grammatical and pragmatic domains of language. We note, however, that few standardized assessment instruments provide opportunities for assessing language skills aside from basic naming ability in children younger than 24 months of age. In addition, most elicited production tests have very few items during this early language period, which means that age equivalency or standard scores can change dramatically with a difference of only one or two raw score points.
Many children in the process of acquiring language use imitation and repetition of spoken language, especially during the early stages, to serve some functional communicative goals. Echolalia and stereotyped language, consisting of scripts heard in previous contexts repeated in a non-communicative way, are atypical imitation behaviors that are part of the symptom pattern of ASDs (Kanner, 1946; Prizant, 1983). During the early stages of language acquisition, it may be difficult to discriminate typical from atypical verbal repetition in young children, and there are no clear criteria for defining delayed echolalia (Prizant & Duchan, 1981). Nevertheless, when characterizing the complexity of children’s language, we recommend that echolalic (and imitative) language should be omitted from analyses, and from speech samples used to classify children according to the benchmarks described below.
Framework for Describing Spoken Language Acquisition in ASD
We take as our starting point a developmental approach in which we benchmark criteria for the acquisition of spoken language, and recommend measures for expressive language at different development levels. For each level we provide approximate age ranges, though these should be viewed as overlapping and not necessarily definitive. A developmental perspective provides a conceptual framework to guide intervention and evaluation of children with ASD, ensuring that researchers and clinicians strategically plan to target key language milestones within language intervention programs for children with ASD. Within a developmental framework, we identify 5 key phases of expressive language acquisition:
- Preverbal Communication. Children in this phase communicate using preverbal intentional communication through vocal (babble) and gestural means. This phase generally covers the age range of 6 to 12 months in typically developing children. As noted earlier, we have not included measures or benchmarks for this developmental phase as it is outside the scope of our goals.
- First Words. Children in this phase use non-imitated spontaneous single words referentially and symbolically to communicate about objects and events, including those outside the immediate context. At least some of their speech is intelligible and incorporates the most frequent consonant sounds heard in typical babble (Oller, 2000; Stoel-Gammon, 1998). Children in this phase use speech with a variety of people in different settings to serve several functions, including, but not limited to, labeling, requesting, and commenting on (directing joint attention) some objects or activities. This phase generally covers the age range of 12 to 18 months in typically developing children.
- Word Combinations. Children in this phase have a vocabulary that is rapidly increasing in size and includes a variety of parts of speech (nouns, verbs, descriptors). They are able to combine words creatively to refer to objects and events. Two- and three-word combinations are used for several different communicative functions. This phase generally covers the age range of 18 to 30 months in typically developing children.
- Sentences. Children in this phase combine words into clausal structures, or sentences, and use some morphological markers such as plurals, prepositions, and some verb endings. Their vocabulary is sufficiently large to serve their communicative needs in everyday situations. They communicate a wide range of functions in different settings with both familiar and unfamiliar people. The portion of this phase relevant for the proposed benchmarks defined here corresponds to typically developing children between the ages of 30 to 48 months.
- Complex Language. By the end of the preschool years, typically developing children have large and rich vocabularies that they use to communicate a wide range of topics (including abstract or hypothetical ideas) using complex grammatical constructions (e.g., relative clauses, sentential complements, anaphora) in different discourse contexts (e.g., conversation, narrative). We do not include either measures or benchmarks for this developmental phase (excluding measures not designed for children below the age of 48 months) as our focus is primarily on younger children with ASD. (For further reading, see Hoff & Shatz, 2007; Menn & Bernstein Ratner, 2000).
Table 1 provides a summary of our proposed benchmarks that define the key developmental phases for spoken language expression (First Words, Word Combinations; Sentences) across the different domains of language, with examples of how each type of measure can be used to assess children’s level of language use. As noted earlier, our objective in presenting this framework of benchmarks in each language domain at different developmental phases is explicitly designed to move away from the commonly used term “functional speech” as the outcome goal for intervention studies.
The benchmarks presented in Table 1 can be used for multiple purposes: (1) evaluating whether a child meets criteria for achieving the various language phases in the context of treatment research; (2) as measures to be incorporated into intervention studies; or (3) as a means for monitoring a child’s progress in ongoing community treatment. Although we present our benchmarks in each of the developing phases of language, it is important to keep in mind that these phases are dynamic and overlapping periods that, in reality, have no clear boundaries.
Criteria for Defining a Child’s Language Level
Some treatment studies include goals to advance a child’s language to a particular level. For example, in studies that begin with very young or preverbal children (i.e., children who do not meet the criteria for being in the First Words phase), the goal might be to provide interventions that lead the child into becoming “verbal” – which might then be defined as the First Words level. Other studies might have a more flexible goal of advancing children to the next level within a prescribed treatment period, or to chart language gains based on continuous measures (e.g., number of different consonants, words, or communication functions). Across all intervention studies, criteria for defining each language phase will facilitate the comparison of different treatment studies that may have different designs or measures.
For each language phase we defined the minimum criteria for evaluating a child’s language level: In order for a child to be considered to be at a particular level of expressive language functioning, the child’s measured language must meet at least one of the defined minimum benchmarks in every language domain that defines that phase. This stringent approach recognizes the comprehensive developmental approach to language acquisition in children with ASD that we have proposed, one which encompasses all aspects of language used to communicate effectively with others in everyday life.
Though each phase contains benchmarks for all language domains based on how language develops in typically developing children, we recognize that particularly in children with ASD there is likely to be asynchrony across different language domains (e.g., vocabulary development may be significantly more advanced than pragmatics). This will result in a mixed phase profile for many children. A child might meet minimum criteria for one phase in all domains and also meet criteria for the more advanced level in one or two domains assessed. Researchers or clinicians may choose to describe a child’s language separately for each language domain in place of the criteria defining the language phase.
This phase represents the emergence of spoken language covering the age range of 12 – 18 months in typically developing children. The benchmarks targeting this phase are placed at the 15 month age-equivalent level. To conclude that a child has reached the First Words phase, he or she must meet the following criteria within each of the following domains:
- Phonology: meets one of the two phonological criteria presented in Table 1 based on a NLS; and
- Vocabulary: meets criterion for number of different words used on the NLS, or the age-equivalent criterion on a parent report measure, or the age-equivalent criterion on a direct assessment measure; and
- Pragmatics: Meets criterion of a minimum of 2 communicative functions, including use of spoken language to comment.
The phase covers the age range of 18 – 30 months in typically developing children. The benchmarks targeting this phase are placed at the 24 month age-equivalent level. The following criteria define meeting the benchmarks for this phase:
- Phonology: meets one of the four phonological criteria presented in Table 1 based on a NLS;
- Vocabulary: meets criterion for number of different words used on the NLS or the age-equivalent criterion on a parent report measure, or the age-equivalent criterion on a direct assessment measure. The table lists one measure that focuses exclusively on vocabulary at this age range; in addition a number of direct assessment tests, for example the Mullen Scales for Early Learning (Mullen, 1995), Reynell Developmental Language Scales (Reynell & Gruber, 1990) or Preschool Language Scale-4 (Zimmerman, Steiner & Pond, 2002) all provide measures of expressive language that combine vocabulary and word combination/grammar items. These measures may be used as an alternative to cover the vocabulary and grammar domains for this phase.
- Grammar: meets the criteria on the NLS, parent report, or direct assessment measures (see above) listed;
- Pragmatics: meets criterion for one of the 3 measures based on the NLS or the age-equivalent score on a parent report measure.
This phase covers the broad age range from 30 to 48 months in typically developing children. The benchmarks are targeted to the 36 month age-equivalent level. The following criteria need to be met for this phase:
- Phonology: meets criterion of 75% intelligible in a NLS, or a 36 month level on a direct assessment measure.
- Vocabulary: meets criterion for number of different words used on the NLS or the age-equivalent criterion on a direct assessment measure.
- Grammar: meets criterion for a 36 month age-equivalent score on a direct assessment measure or the MLU criterion on a NLS. By this phase it is strongly preferred that the NLS include a minimum of 100 spontaneous (non imitative/echolalic) child utterances, for obtaining a more reliable MLU estimate.
- Pragmatics: meets criterion based on an elicited narrative, or the criterion for a conversational NLS, or a 36-month age-equivalent on parent report or direct assessment measures.
This report represents the consensus of our working group based on discussions carried out over the course of 18 months. We offer here the following summary and conclusions.
- We recommend a move away from using the term “functional speech” as a goal for intervention research and practice, replacing it with a developmental framework. We recognize that the impetus for the use of the term came from studies suggesting that achieving functional speech by age five is an important prognostic indicator in children with ASD. Nevertheless, it is not clear from the literature what definitions earlier studies relied on, though the descriptions in these studies suggest that children with optimal outcomes were able to speak in full sentences serving a range of communicative functions (Paul & Cohen, 1984). In our view, given the significant changes in the age of diagnosis and the increased access to early intensive intervention, it is time to re-open the question of the timing and role of language acquisition as key prognostic indicators in ASD.
- In evaluating treatment outcomes, we depend on objective measures, but we recognize that the measures available to us are imperfect. This is particularly evident when assessing the earliest phases of language in the emergence of words, grammatical combinations or the pragmatic uses of communication for which few if any standardized direct assessments are available for children under the age of two. To address these limitations we encourage the use of measures derived from natural language samples and parent report. We recognize that the collection, transcription and coding of natural language samples involves increased labor costs in research and clinical settings. However, we believe this cost cannot be avoided if we are to ensure that the data gathered have the highest degree of validity possible.
- We provide objective criteria for defining children’s expressive language development in order to provide guidance to researchers and clinicians who assess language in young children with ASD. These may be used to guide intervention research as well as treatment offered in clinical settings. The use of benchmarks based on typical development for charting children’s progress reflects findings that language development in early ASD generally follows a similar developmental pathway as in other children (Tager-Flusberg et al., 2005). Using benchmarks from typical development also draws attention to those typical language milestones that should be targeted by early intervention programs. These definitions and benchmarks will allow comparisons of outcomes across different studies.
- Finally, we set ourselves a practical goal: to provide a common vocabulary for discussing language acquisition to a wide interdisciplinary professional and lay audience. The terms selected for the benchmarks are intended to be transparent, reflecting important language features that define them. For each benchmark, we have provided definitions for behavior that can be objectively assessed by a broad range of early intervention professionals.
The framework we have developed here should be expanded in several ways: (1) incorporating benchmarks for identifying a range of preverbal communication skills; (2) development of valid and reliable measures of language comprehension for children with ASD; (3) adaptation of the framework for assessing children who communicate using AAC systems; and (4) evaluating the relative merits of different types of measures for children with ASD. Further research is needed to address these important issues, nevertheless, we hope that the concepts and recommendations presented in this paper will enhance early intervention research targeting spoken language development in ASD and will provide clinical professionals the ability to extract and clearly define important information about treatment effectiveness in their work.
*The group was co-chaired by Helen Tager-Flusberg, Sally Rogers and Judith Cooper (NIH). Members included Rebecca Landa, Catherine Lord, Rhea Paul, Mabel Rice, Carol Stoel-Gammon, Amy Wetherby and Paul Yoder.
*We have limited our recommendations on measures and benchmarks to spoken language, although we recognize that many children with ASD who do not speak can successfully acquire some expressive language skills using augmentative or alternative communication (AAC) systems such as vocal-output devices or manual signing. We have not included a detailed presentation of how our framework might apply to interventions that target AAC systems as there are no clear guidelines available for how to measure non-spoken language skills that are comparable to those available for spoken language.
*Children with ASD will often have a very small spoken vocabulary used primarily to regulate others’ behavior, however, unless the criteria for the definition of the First Words phase as specified in Table 1 are met, they should be considered to be in the Preverbal Communication phase.
- American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders. Fourth Edition, Text Revision. Washington, DC: Author
- Bertrand, J., Mars, A., Byle, C., Bove, F., Yeargin-Allsopp, M., & Decoufle, P. (2001). Prevalence of autism in a United States population: The Brick Township, New Jersey, investigation. Pediatrics, 108, 1155-1161.
- Carrow-Woolfolk, E. (1999). Comprehensive Assessment of Spoken Language. Bloomington, MN: Pearson Assessments.
- Charman, T., Baron-Cohen, S., Swettenham, J., Baird, G., Drew, A., & Cox, A. (2003). Predicting language outcome in infants with autism and pervasive developmental disorder. International Journal of Language & Communication Disorders, 38, 265-285.
- Dawson, G., & Osterling, J. (1997). Early intervention in autism: Effectiveness and common elements of current approaches. In M.J.Guralnick (Ed.), The effectiveness of early intervention: Second generation research. (pp. 307-326). Baltimore, MD: Brookes Publishing Co.
- Dawson, J. & Stout, C. (2003). The Structured Photographic Expressive Language Test – Third Edition. DeKalb, IL: Janelle Publications.
- Fenson, L., Dale, P. S., Reznick, S., Thal, D., Bates, E., Hartung, J. P., Pethick, S., & Reilly, J. S. (1993). MacArthur Communicative Development Inventories: User’s guide and technical manual. Baltimore, MD: Paul H. Brookes.
- Fenson, L., Marchman, V., Thal, D., Reznick, S., & Bates, E. (2007). MacArthur-Bates Communicative Development Inventories: User’s guide and technical manual – Second edition. Baltimore, MD: Paul H. Brookes.
- Gardner, M. F. (1990). Expressive One Word Vocabulary Test – Revised. Los Angeles, CA: Western Psychological Services
- Gillberg, C., & Steffenburg, S. (1987). Outcome and prognostic factors in infantile autism and similar conditions: A population-based study of 46 cases followed through puberty. Journal of Autism and Developmental Disorders, 17, 273-287.
- Goldman, R. & Fristoe, M. (2000). Goldman-Fristoe Test of Articulation – 2. Cicle Pines, MN: American Guidance Service.
- Hoff, E. & Schatz, M. (Eds.), (2007). Handbook of language development. Oxford: Blackwell.
- Howlin, P., Goode, S., Hutton, J. & Rutter, M. (2004). Adult outcome for children with autism. Journal of Child Psychology and Psychiatry, 45, 212-229.
- Kanner, L. (1946). Irrelevant and metaphorical language. American Journal of Psychiatry, 103, 242-246.
- Koegel, R., & Koegel, L. K. (1988). Generalized responsivity and pivotal behavior. In R. H. Horner, G. Dunlap, & R. L. Koegel (Eds.), Generalization and maintenance: Lifestyle changes in applied settings, (pp. 41-66). Baltimore: Paul H. Brookes Publishing Co.
- Kuehn, B. M. (2007). CDC: Autism Spectrum Disorders Common. Journal of the American Medical Association, 297, 940
- Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Consulting and Clinical Psychology, 55, 3-9.
- Long, S. & Fey, M. (2004). Computerized profiling (Computer program version 6.9). Milwaukee, WI: Marquette University.
- Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. S., Pickles, A., & Rutter, M. (2000). The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of Autism. Journal of Autism and Developmental Disorders, 30, 205-223.
- Luyster, R. Qui, S., Lopez, K., & Lord, C. (2007). Predicting outcomes of children referred for autism using the MacArthur-Bates Communicative Development Inventory. Journal of Speech, Language, and Hearing Research, 50, 667-681.
- Luyster, R., Kadlec, M. B., Connolly, C., Carter, A., & Tager-Flusberg, H. (2008). Language assessment and development in toddlers with autism spectrum disorders. Journal of Autism and Developmental Disorders, 38, 1426-1438.
- MacWhinney, B. (2000). The CHILDES Project: Tools for Analyzing Talk (Third Edition). Mahwah, NJ: Lawrence Erlbaum Associates.
- Menn, L. & Bernstein Ratner, N. (Eds). (2000). Methods for studying language production. Mahwah, NJ: Lawrence Erlbaum Associates.
- Miller, J. & Chapman, R. (1981). The relation between age and mean length of utterance in morphemes. Journal of Speech and Hearing Research, 24, 154-161.
- Miller, J. & Chapman, R. (2000). Systematic Analysis of Language Transcripts (SALT). Madison, WI: Language Analysis Lab.
- Miller, J. & Chapman, R. (2008). Systematic Analysis of Language Transcripts (SALT Software). Madison, WI: Language Analysis Lab.
- Mordecai, D. & Palin, M. (1982). Lingquest 1 and 2 (Computer Program). East Moline, IL: Lingquest Software.
- Mullen, E. (1995). Mullen Scales of Early Learning. Circle Pines, MN: American Guidance Service.
- Mundy, P., Hogan, A., & Doehring, P. (1996). A preliminary manual for the abridged Early Social Communication Scales (ESCS). Coral Gables, FL: University of Miami.
- National Research Council. (2001). Educating children with autism. Washington, DC: National Academy Press.
- O’Neill, D. (2007). The Language Use Inventory for young children: A parent-report measure of pragmatic language development for 18- to 47-month-old children. Journal of Speech, Language and Hearing Research, 50, 214-228.
- Oller, K. (2000). The emergence of the speech capacity. Mahwah, NJ: Lawrence Erlbaum Associates.
- Paul, R., & Cohen, D. J. (1984). Outcomes of severe disorders of language acquisition. Journal of Autism and Developmental Disorders, 14, 405-422.
- Prizant, B.M. (1983). Echolalia in autism: Assessment and intervention. Seminars in Speech and Language, 4, 63‑77.
- Prizant, B., & Duchan, J. (1981). The functions of immediate echolalia in autistic children. Journal of Speech and Hearing Disorders, 46, 241‑249.
- Rescorla, L. (1989). The Language Development Survey. A screening tool for delayed language in toddlers. Journal of Speech Language and Hearing Research, 54, 587-599.
- Reynell, J. K. & Gruber, C. P. (1990). Reynell Developmental Language Scales. Western Psychological Services.
- Rice, M. L. & Wexler, K. (2001). Rice/Wexler Test of Early Grammatical Impairment. San Antonio TX: Pearson Education Inc.
- Rogers, S. J. (2005). Evidence-based practices for language development in young children with autism. In T. Charman & W. Stone (Eds)., Social and Communication development in autism spectrum disorders (pp. 143-179) New York: Guilford.
- Rogers, S .J., & Vismara, L. A. (2008). Evidence-based comprehensive treatments for early autism. Journal of Clinical Child and Adolescent Psychology, 37, 8-38.
- Seibert, J., Hogan, A., & Mundy, P. (1982). Assessing social interactional competencies: The early social-communication scales. Infant Mental Health Journal, 3, 244-258.
- Stoel-Gammon, C. (1998). Sounds and words in early language acquisition: The relations between lexical and phonological development. In R. Paul (Ed.). Exploring the speech-language connection (pp. 25-52). Baltimore, MD: Paul H. Brookes.
- Tager-Flusberg, H. (2000). The challenge of studying language development in autism. In L. Menn and N. Bernstein Ratner (Eds.) Methods for studying language production (pp. 313-332). Mahwah, NJ: Lawrence Erlbaum Associates.
- Tager-Flusberg, H., Paul, R., & Lord, C.E. (2005). Language and communication in autism. In F. Volkmar, R. Paul, A. Klin & D. J. Cohen (Eds.) Handbook of autism and pervasive developmental disorder, Third Edition Volume 1 (pp. 335-364). New York: Wiley.
- Venter, A., Lord, C., & Schopler, E. (1992). A follow-up study of high-functioning autistic children. Journal of Child Psychology and Psychiatry, 33, 489-507.
- Wetherby, A. & Prizant, B. (2002). Communication and Symbolic Behavior Scales. Baltimore, MD: Paul H. Brookes.
- Yeargin-Allsopp, M., Rice, C., Karapurkar, T., Doernberg, N., Boyle, C., & Murphy, C. (2003). Prevalence of autism in a U.S. metropolitan area. Journal of the American Medical Association, 28, 249-255.
- Zimmerman, I. L., Steiner, V. G., & Pond, R. E. (2002). Preschool Language Scale, Fourth Edition (PLS-4). Harcourt Assessment.
Support for the preparation of this report was provided by the National Institute on Deafness and Other Communication Disorders - National Institutes of Health, and Autism Speaks. We are especially grateful to Andy Shih and Alycia Halladay of Autism Speaks for their support of this project.
Address for correspondence: Helen Tager-Flusberg, PhD., Department of Anatomy and Neurobiology, Boston University School of Medicine, 715 Albany Street L-814, Boston MA 02118. Email: email@example.com