Skip to content
The Chat Archive
gpt-4o-2024-08-06· OpenAI WildChat-4.8M (AI2)

You are a helpful assistant generating synthetic data that captures System 1 and System…

  1. User

    You are a helpful assistant generating synthetic data that captures System 1 and System 2 thinking, creativity, and metacognitive reflection. Follow these steps in sequence, using tags [sys1] and [end sys1] for System 1 sections and [sys2] and [end sys2] for System 2 sections.

    1. Identify System 1 and System 2 Thinking Requirements:

      • Carefully read the text.
      • Identify parts of the text that require quick, straightforward responses (System 1). Mark these sections with [sys1] and [end sys1].
      • Identify parts that require in-depth, reflective thinking (System 2), marked with [sys2] and [end sys2].
    2. Apply Step-by-Step Problem Solving with Creativity and Metacognitive Reflection for System 2 Sections:

      2.1 Understand the Problem:

      • Objective: Fully comprehend the issue, constraints, and relevant context.
      • Reflection: "What do I understand about this issue? What might I be overlooking?"
      • Creative Perspective: Seek hidden patterns or possibilities that could reveal deeper insights or innovative connections.

      2.2 Analyze the Information:

      • Objective: Break down the problem logically.
      • Reflection: "Am I considering all factors? Are there any assumptions that need challenging?"
      • Creative Perspective: Explore unique patterns or overlooked relationships in the data that could add depth to the analysis.

      2.3 Generate Hypotheses:

      • Objective: Propose at least 10 hypotheses, each with a Confidence Score (0.0 to 1.0) and Creative Score (0.0 to 1.0), reflecting originality, surprise, and utility.
      • Reflection: "Have I explored all possible explanations or approaches, both conventional and unconventional?"
      • Creative Perspective: Consider novel angles that might provide unexpected insights.

      2.4 Anticipate Future Steps and Obstacles:

      • Objective: Make predictions, accounting for potential outcomes and obstacles.
      • Reflection: "What challenges might I face? Is my plan flexible for different scenarios?"
      • Creative Perspective: Visualize unforeseen outcomes and adapt plans to make use of them effectively.

      2.5 Evaluate Hypotheses:

      • Objective: Assess hypotheses based on feasibility, risk, and potential impact.
      • Evaluation: Refine Confidence and Creative Scores as needed.
      • Reflection: "Am I unbiased in my assessment? Which options fit best with the overall objectives?"
      • Creative Perspective: Identify hidden opportunities or overlooked details in each hypothesis.

      2.6 Select the Best Hypothesis:

      • Objective: Choose the most promising, strategic hypothesis.
      • Reflection: "Why does this hypothesis stand out? How does it uniquely address the issue?"
      • Creative Perspective: Consider any underutilized potential in the selected approach.

      2.7 Implement the Hypothesis:

      • Objective: Outline actionable steps for testing the hypothesis.
      • Reflection: "Is this plan practical? What resources or preparation are required?"
      • Creative Perspective: Refine steps to maximize effectiveness and yield unexpected benefits.

      2.8 Monitor and Review Progress:

      • Objective: Review progress, noting areas for improvement.
      • Reflection: "What’s working well? What could be improved?"
      • Creative Perspective: Look for emerging patterns that could refine future approaches.

      2.9 Reflect and Capture Insights:

      • Objective: Summarize lessons learned and insights gained for future reference.
      • Reflection: "What new understanding has emerged from this process?"
      • Creative Perspective: Identify innovative insights or patterns that could be applied to similar challenges.
    3. Generate Text Output with Interleaved System 1 and System 2 Responses:

      • Use the tags [sys1] and [sys2] throughout.
      • Aim for a lengthier, detailed response. Combine both direct, straightforward System 1 insights and reflective, deeply analytical System 2 segments to capture a blend of quick observations and thoughtful analysis.

    Example Input Text:

    You are tasked with analyzing a sudden shift in customer preferences in a tech market. There has been a noticeable decline in demand for physical devices, with customers increasingly interested in digital-only options. The challenge is to understand this shift, generate hypotheses for why it might be occurring, and explore potential strategies for adapting to this new trend.


    Processed Output with System 1 and System 2 Thinking:

    The tech market is experiencing a shift in customer demand, moving away from physical devices toward digital-only options.

    [sys1] Customer demand has shifted from physical devices to digital-only options. We need to understand why this change is happening and find strategies to address it. Key factors may include cost, convenience, and technological trends. [end sys1]

    [sys2] 2.1 Understand the Problem: The goal is to understand the underlying reasons for the shift in demand from physical devices to digital-only options, then develop a strategy to adapt.

    Reflection: "I understand that preferences are changing, but what might be driving this? Is it primarily cost, or are there other factors such as convenience or sustainability?"

    Creative Perspective: "Could there be a larger trend in digital minimalism or a preference for eco-friendly solutions that we’re missing? What unseen motivations might explain this shift?"

    2.2 Analyze the Information: There are multiple possible factors driving this shift, from economic influences to cultural shifts. It’s essential to isolate each factor and understand its impact.

    Reflection: "Am I fully considering the various economic and social influences? Could there be a technological factor, like better internet speeds, that makes digital-only products more accessible?"

    Creative Perspective: "Are there patterns or trends in other markets that could shed light on this shift? Could this be part of a larger trend toward virtual experiences?"

    2.3 Generate Hypotheses:

    1. Customers prefer digital options due to lower costs. (Confidence: 0.8, Creative: 0.4)
    2. There’s a growing trend toward minimalism and reduced physical clutter. (Confidence: 0.7, Creative: 0.7)
    3. Digital products offer greater flexibility and ease of use. (Confidence: 0.6, Creative: 0.6)
    4. Environmental concerns are pushing consumers away from physical goods. (Confidence: 0.6, Creative: 0.8)
    5. Advances in tech make digital-only options more functional. (Confidence: 0.8, Creative: 0.5)
    6. Pandemic-era remote work increased demand for digital solutions. (Confidence: 0.7, Creative: 0.6)
    7. Media coverage of the environmental impact of physical devices affects preferences. (Confidence: 0.5, Creative: 0.7)
    8. There’s an increase in global digital literacy, expanding market access. (Confidence: 0.6, Creative: 0.6)
    9. Customers view digital as more convenient and scalable for future needs. (Confidence: 0.7, Creative: 0.5)
    10. Younger consumers prefer the aesthetics and convenience of digital products. (Confidence: 0.6, Creative: 0.6)

    Reflection: "Have I considered all possible influences? Are there any surprising factors that could explain this shift?"

    Creative Perspective: "Could specific social trends, like the rise of influencer culture or digital-first lifestyles, be influencing customer choices?"

    2.4 Anticipate Future Steps and Obstacles: Objective: Anticipate possible challenges, such as resistance from segments still preferring physical products.

    Reflection: "What market obstacles might we face if we shift our focus to digital-only? Are there sub-segments that still prioritize physical products?"

    Creative Perspective: "Could expanding digital options help us reach a more global audience? Are there emerging trends that we could leverage in our strategy?"

    [end sys2]

    [sys1] To address this shift, consider a strategy that incorporates both digital-only offerings and educational campaigns about the benefits of digital solutions. Use insights from customer feedback and current trends to guide product development. Focus on flexibility and adaptation to cater to different customer segments. [end sys1]

    The benefits of Early Intensive Behavioral Intervention (EIBI) for young children with autism are being increasingly documented. Recent reviews of the literature suggest that the effectiveness of EIBI may be considered "well established" according to commonly used criteria for evidence based practices (Eikeseth [@CR6]; Eldevik et al. [@CR11]; Rogers and Vismara [@CR29]), and meta-analytic methods reveal large and moderate effect sizes for outcome assessed via standardized tests of intelligence and adaptive functioning respectively (Eldevik et al. [@CR10]; Makrygianni and Reed [@CR22]; Reichow and Wolery [@CR26]; Virues-Ortega [@CR40]; Peters-Scheffer et al. [@CR25]). To date, the majority of published studies of EIBI included in systematic reviews have focused on its delivery by specialist teams and often with implementation staff engaged as part of a research evaluation project.

    The question of whether EIBI might be delivered successfully in more typical service settings, or on a reasonably large scale, has been relatively neglected. Community effectiveness studies of this kind would correspond to the final phase of validating a psychosocial intervention for autism spectrum disorders as proposed by Smith et al. ([@CR35]). According to Smith et al., implementing intervention in a real world setting to see whether similar outcomes can be achieved can be considered the ultimate test of effectiveness.

    There are various models described in the literature on how EIBI can be implemented (Handleman and Harris [@CR13]). These range from a full time placement in a center (or an institution), home-based programs directed either through a clinic or the parents themselves, to full time placement in mainstream pre-school with EIBI being implemented at home before or after pre-school and at the weekends. Most of the outcome data published so far have come from home-based programs in some form. Home-based EIBI has been organized through university clinics (Lovaas [@CR20]; Remington et al. [@CR27]), and community based agencies or clinics (Cohen et al. [@CR4]; Howard et al. [@CR14]; Sallows and Graupner [@CR31]). There are a few examples of evaluations of intervention models delivered outside of the home setting. In Norway, Eikeseth et al. ([@CR7], [@CR8]) evaluated EIBI for young children with autism in pre-school settings where supervision was provided through specialist health care services, and in Israel Ben-Itzchak and Zachor ([@CR3]) evaluated EIBI provided at an intervention clinic.

    In terms of outcomes of EIBI when delivered on a large scale, Perry et al. ([@CR24]) recently reported on EIBI delivered throughout a Canadian provincial area. EIBI was provided in a variety of settings (including center-based and integrated child care settings) and the evaluation was focused on the effectiveness of EIBI as it might be typically delivered clinically rather than in a controlled research study. Notably, staff training had to be conducted on a large scale in a limited time and no children were excluded based on co-morbid diagnosis, low cognitive ability, or age. Also, children were referred from a large and diverse socioeconomic group. Ostensibly, any one of these factors could lead to a less favorable outcome. The study reported outcomes for 332 children with autism between 2 and 7 years of age. Like in other outcome studies, there was considerable variation in outcome, but overall the children made statistically and clinically significant improvements in intellectual and adaptive functioning and autism severity.

    Initial data on delivery of EIBI in various settings, and even on a large scale and in typical clinical practice, are encouraging. However, there is still a need to investigate the effectiveness of models of service delivery in real world settings. Such settings will vary considerably from country to country (and within countries), and thus a variety of models will need to be evaluated. In the city of Oslo, Norway in the year 2000, an early intervention center (Senter for Tidlig Intervensjon; STI) was established that focused on the provision of an EIBI model for pre-school children with autism. As is the current policy in Norway, all children receiving services through the center were enrolled in their local mainstream pre-schools. Referrals to STI were taken from local pedagogical-psychological services (PPT), of which there were seven in the city, each covering a designated geographical area of the city. However, all referrals had to go through a central city education department office for final approval. The services from STI involved no extra financial costs for the family, the pre-school, or the community. The center's mission was to provide specialist early intervention services directly to the pre-schools, thus supporting the local PPT with some of their most difficult cases.

    No financial/staffing resources in addition to those typically given to a pre-school enrolling a child with autism were given. A pre-school enrolling a child with autism typically received one additional full-time staff member, and supervision and training from a special education teacher and/or speech and language therapist employed by the local community for 2--5 h a week. The aim of the current project was instead to provide a behavioral intervention program using these same professional resources, with some additional supervision input. Instead of the pre-school receiving supervision and training from local PPT professionals as would usually be the case, this was provided through the behavioral intervention center (STI). Although no formal modeling of costs was carried out, any additional costs for the city would have been associated with the funding of the supervisory staff employed at the intervention center instead of funding supervisory staff through the local PPT services. The pre-school staff (including the extra professional resources employed locally) were responsible for the day-to-day implementation of the behavioral intervention program while being supervised and trained by STI.

    The purpose of the present paper is to describe the key features of the Oslo mainstream pre-school EIBI model and to compare outcome data from children enrolled over a 10 year period with children receiving treatment as usual (TAU), which may be best described as eclectic special education intervention.

    Methods {#Sec1}

    Service Setting and Participants {#Sec2}

    All children who received intervention through the center from its inception in January 2000 to February 2011, and who met the following criteria, were included in the present analysis: (a) an independent diagnosis of autism or pervasive developmental disorders-not otherwise specified (PDD-NOS/atypical autism from ICD-10) based on the ADI-R (Lord et al. [@CR18]); (b) between 2 and 6 years of age at intake; (c) a full-scale intelligence test and a measure of adaptive behavior administered at intake and after about 2 years of intervention, and (d) at least 5 h per week of intervention. A comparison group of children meeting these same criteria, and also attending local mainstream pre-schools, but instead receiving TAU in the same time period was provided through the neighboring Akershus University Hospital.

    In total, 43 children met the inclusion criteria, 31 from the EIBI center and 12 who were diagnosed via the hospital clinic and were receiving TAU in their local mainstream pre-school. A more detailed description of the groups is provided in Tables 1{ref-type="table"} and 2{ref-type="table"}. There were no significant differences between the groups on age at intake, duration of intervention, the distribution of diagnoses, or gender. Furthermore, the proportions of children with severe, moderate, mild, and no intellectual disability where similar in the two groups at intake. Overall, the average IQ and adaptive behavior composite scores in both of the groups were slightly lower than the general population of children with autism spectrum disorders (Volkmar and Klin [@CR41]).Table 1Age at intake, intervention hours per week and duration, for each groupCharacteristicsEIBI group (n = 31)Comparison group (n = 12)MSD (range)MSD (range)Age at intake42.29.0 (26--70)46.212.4 (24--67)Hours spent on weekly goals13.65.3 (6.5--28)5+ (unspec.)--Duration of intervention in months25.16.3 (10--34)24.610.8 (13--49)Table 2Diagnosis, gender and level of intellectual functioning, number ofchilldren and percentage in each groupCharacteristicEIBI group (n = 31)Comparison group (n = 12)nPercentagenPercentageDiagnosisAutism2580.6975.0PDD-NOS516.1325.0Asperger13.200GenderMale2580.6866.7Female619.4433.3Level of intellectual disabilityNo ID412.9216.7Mild ID1032.3433.3Moderate ID1238.7541.7Severe ID516.118.3Profound0.00.0

    Pre-School Setting {#Sec3}

    Participants that received EIBI through the center were referred from pedagogical-psychological services (PPT) through the educational authorities in the city. The referral process would normally start with either the parents or staff at the pre-school raising concerns about the child, and referring it to the local PPT for an assessment by a consultant (a psychologist or special education teacher). The consultant would then write a proposed statement of the child's need, and how they could be met. The PPT staff were not trained in diagnosing children, so if there was suspicion of a diagnosis within the autism spectrum (or any other diagnosis) the child was referred on to specialist services within the health care system. By law, special education provision should not be based on a particular diagnosis but rather on the child's needs. Thus, the proposed statement did not have to wait for a formal diagnosis to be made but was sent to a central city education department office for final approval. Based on the child's needs and the wording in the statement the child was referred on from here to units that provide intervention and/or support for the child. Several options are available depending on the child's needs. Some children can get their intervention supervised by the local PPT, some are referred to the health care system, and some are referred to STI or to another service provider in the city. All of these services base their support on training and supervision of locally employed professionals and pre-school staff.

    All children in the EIBI and TAU groups attended their local mainstream pre-school. The pre-schools were in Oslo and Akershus County (total population ca 1.1 million). In most cases, a pre-school would have enrolled only one child with autism. As required by Norwegian regulations, mainstream pre-school units were staffed on 1:3 staff to child ratio for children under the age of 3 years, and a 1:6 staff to child ratio for children between 3 and 6 years of age (children started school proper at 6 years of age). In their final year of pre-school, special "clubs" are arranged to prepare the children for school. Typically, a pre-school unit would either consist of nine children below the age of three with three staff, or 18 children between the age of three and six with three staff. When the unit enrolled a child with autism, resources were normally received for one more full-time staff member making it possible to cover this child 1:1 without taking resources away from the other children in the unit. This extra resource was granted independent of any particular intervention (and of the current study). All units had a separate room available where 1:1 intervention could be done without disturbance from the rest of the unit. Pre-schools were typically open weekdays from 7:00 am to 5:00 pm, and children in the present study were typically at the pre-school for at least 20 h every week (typically, a minimum of 4 h per day).

    Some of the 1:1 h in the unit merely focused on practical help for getting dressed or undressed, eating, toileting, and going outside on the playground, without the use of systematic teaching methods. For the purposes of this study, only the hours spent implementing teaching methods towards specified weekly targets (whether inside or outside of the teaching room) were counted as intervention hours, while hours of general practical assistance only were not counted. Practical assistance hours were generally similar for all children in the pre-school settings.

    Interventions {#Sec4}

    EIBI Group {#Sec5}

    The county of Oslo, Norway in 2000 started a center that was to provide EIBI for children with autism. The center was to do this by offering supervision and training of existing personnel in the preschools. The center employed one psychologist and four supervisors. The psychologist (first author) was a Board Certified Behavior Analyst with approximately 15 years of experience implementing EIBI programs and served as a consultant for the supervisors. The supervisors had bachelors degrees (in habilitation of individuals with various handicaps) covering the basics of applied behavior analysis and between 2 and 10 years of training and experience with EIBI programs.

    For organizing the intervention, we recommended that 2--3 staff members from the unit formed an intervention team responsible for the day-to-day implementation of the intervention, rather than having just the extra staff member cover the child with autism. A rota was made so that all team members would work with the child during the week. This was also done so that the child would get used to interacting with a number of different adults and so as not to make the program dependent on just one person. One of the team members was given responsibilities for scheduling and monitoring intervention hours, preparing the weekly team meetings, updating the program records, and finding the instructional materials needed for the various programs.

    The center was responsible for training and supervision of all staff involved in the intervention. The model used for staff training and supervision was similar to that described as clinic-supervised intervention by Smith et al. ([@CR32]) and Eikeseth et al. ([@CR7]). Staff training started with a three-day workshop and continued throughout the duration of the intervention with weekly (or eventually in some cases bi-weekly) consultations lasting 1--4 h. In addition, weekly 2-h team meetings were held for each child. The child, primary caregiver(s), and staff attended both the workshops and the team meetings, and all were trained using an apprenticeship model. The supervisor first explained and demonstrated how to do a program, and then the staff took turns doing the program with the child, while being coached by the supervisor and the other team members. At team meetings, the child's program and/or intervention procedures were reviewed and modified based on the child's progress during the preceding week. The program was comprehensive and balanced covering all important areas of the child's life. Each week the child would normally be engaged in 10--20 teaching programs. Parental participation was encouraged to ensure generalization and maintenance of skills to the home and other community settings.

    Depending on the needs of the individual child, parts of the intervention were provided outside of the separate teaching room, targeting specific weekly goals (e.g., conducting incidental teaching for expressing wants and needs, providing instruction on self-help skills such as putting on shoes, teaching peer interaction skills, or implementing behavior management plans). The supervisors had a caseload of 4--8 children. They met weekly (or more often if required) with the psychologist to discuss programming or any particular problems arising with individual children. The psychologist would also oversee individual programs by attending team-meetings at least once a semester.

    The intervention was based on several widely used EIBI manuals (Leaf and McEachin [@CR17]; Lovaas [@CR19], [@CR21]; Maurice et al. [@CR23]; Sundberg and Partington [@CR38]). In short, the intervention began with establishing basic tasks, such as expressing wants and needs, responding to simple requests made by an adult, imitation of gross motor behaviors, matching of objects or pictures, and teaching of simple toy play such as completion of puzzles or putting shapes in a shape sorter. When these tasks were mastered, the intervention moved on to more complex skills such as imitation of fine motor and oral motor behaviors, imitation of sounds and words, and recognizing objects and actions upon request. After the child had acquired vocal imitation of words and basic receptive language, the child was taught to use the words functionally, for example by naming objects and actions. Next, more abstract concepts such as color, size, adjectives, and prepositions were targeted. Subsequent intervention goals included discriminating Wh-questions, conversing, and making friends with peers. From the start, the intervention also targeted other play and social skills, progressing from functional toy play and parallel play to symbolic play and cooperative play.

    All procedures were based on documented operant conditioning techniques such as differential reinforcement, shaping, chaining, task analysis, and prompt and prompt fading. In the early stages of intervention, most teaching took place in a 1:1 discrete trial format. Later, the focus gradually shifted to include small group settings with typically developing children to help generalize skills and adjust to the routines of the pre-school unit. The ultimate goal of the intervention was to improve the ability of the children to learn in natural settings as might be expected of their typically developing peers.

    Comparison (Treatment as Usual) Group {#Sec6}

    For children in this group, elements from various types of interventions were combined in an attempt to best meet the child's educational needs. The intervention typically included a mix of the following intervention types: alternative communication, applied behavior analysis (ABA), total communication, sensory motor therapies, programs based on the principles from TEACCH, as well as other methods that were incorporated based on the personal experience of the particular special education teacher and staff. The organization of supervision and staff training for the comparison group was in some ways similar to that of the EIBI group. A special education teacher from the local educational authorities would do one or two weekly consultations totaling about 2--5 h a week. The agency to be responsible for supervision and training was determined in the interdisciplinary educational planning process for each child. Within each agency a particular person was assigned on the basis of capacity and/or geographical location. As in the EIBI group, between one and three therapists were recruited from the pre-school staff to do the daily work with the child.

    The intervention components typically found in the comparison group can be summarized as follows. Any ABA intervention would typically include working on a small number of selected programs from ABA treatment manuals such as matching, imitation, or toilet training. Data on the number of hours of this intervention in the TAU group were not available, but the intervention was qualitatively different because of the focus on small numbers of selected programs rather than a comprehensive model. Alternative communication would typically include working towards a symbol or sign based communication system. Symbols were typically line drawings, Bliss symbols or photographs taken of objects, persons, or activities from the child daily life. Signs would typically be hand signs for expressing needs such as "Food," "Water," or "Toilet". Sensory integration would typically involve daily activity sessions of 15--20 min of going on a swing, rocking and stretching while listening to music, or getting a massage. Total Communication elements would include strategies for the complementary use of signs, symbols and speech to enhance verbal comprehension, improve expressive language and develop a form of literacy. Intervention would focus on broadening the medium of communication to include signs, symbols, pictures, photographs and objects, as well as speech. It might also involve the use of drama, mime, or other forms of visual communication. Elements taken from TEACCH would typically involve making length and content of sessions predictable by using picture schedules and baskets to separate the tasks and assigning areas for specific activities. The intervention elements that were reported to be based on the teacher's clinical experience would typically involve the use of worksheets, learning through educational software on a computer, and training social skills through listening to stories and looking at picture sequences.

    Unfortunately, because this was an evaluation of typical clinical practice we were not successful in measuring accurately the total time spent on intervention in the comparison group, or measuring the proportion of time spent on the various intervention approaches that were implemented and are described briefly above. Typically, sessions were conducted throughout the day taking advantage of opportunities that arose in daily life when the child was motivated. Also, intervention approaches were often combined in the same session, so that when applying principles derived from TEACCH, such as structuring daily activities with baskets, the staff simultaneously used techniques derived from ABA, such as reinforcement and prompting, and principles from total communication, such as combining visual and verbal modalities to promote spoken language.

    Outcome Measures {#Sec7}

    We employed measures of full scale intellectual functioning and adaptive behavior that are widely used and recommended for assessing children with autism (Klin et al. [@CR16]).

    Intellectual Functioning {#Sec8}

    The Bayley Scales of Infant Development (BSID), second or third edition (Bayley [@CR1], [@CR2]) was used for the youngest children or children that scored below the basal on intelligence tests standardized for their chronological age. The BSID is a measure of mental development for children up to 42 months. It will yield a mental developmental index (MDI), which was considered broadly equivalent to an IQ score. If the child scored below the norms on this test or was too old for the norms, we computed a ratio IQ score by dividing the obtained mental age with chronological age and multiplying by 100. For the older children we used the Stanford-Binet Intelligence Scale: Fourth or Fifth Edition (Thorndike et al. [@CR39]; Roid [@CR30]), or the Norwegian version of the Wechsler Preschool and Primary Scale Intelligence-Revised (Wechsler [@CR42]).

    Adaptive Behavior {#Sec9}

    The Vineland Adaptive Behavior Scales (VABS I or II; Sparrow et al. [@CR36], [@CR37]) were used for measuring adaptive behavior. The VABS yields standard scores on four domains; communication, daily living, socialization, and for children under 6 years old, motor skills. Based on these scores the VABS also yields a standardized adaptive behavior composite (ABC).

    Just under 60% of the assessments for the children in the EIBI group were carried out by professionals blind to the purposes of the present study (67% at intake, and 48% after 2 years). The remainder of the assessments were conducted by the first author. Six of these administrations were performed both by an independent professional and by the first author within 3 months of each other. In these instances, a conservative measure of improvement was obtained by using the higher score at intake and the lower score in the later assessments. Agreement on the total scores for assessments was within ±5 standard points in all of these "overlap" cases. As an added precaution we analyzed outcome data to see if there were any differences in the reported gains between the children that were tested by somebody independent of the study and the children who were tested by the first author (either at intake, after 2 years, or both). Ten children in the EIBI had all assessments completed by an independent professional and 21 children were tested by the first author at one or more points. Average gains were higher for the 10 children tested by an independent assessor both on IQ (22.1 and 11.7 point gains respectively) and ABC scores (6.6 and 5.7 point gains respectively) although these differences were not statistically significant. Thus, although this clearly cannot be ruled out, we could find no evidence of a positive bias introduced by the proportion of non-blind assessments. All children in the comparison (TAU) group were assessed by psychologists at the paediatric habilitation unit blind to purposes of this study.

    Data Analysis {#Sec10}

    The first level of analysis was to analyze group differences using ANCOVA models. Because the children were not randomly assigned to groups or actively matched, the intake score for the specific outcome measure along with age at intake were entered as covariates in each analysis. Age in months was used as a covariate because, although not statistically significant, there was a 4 month age difference in the groups and age is also commonly held to be related to outcome. ANCOVAs were conducted for IQ and adaptive behavior scores, including all sub domains (except for motor skills). Based on the mean differences in outcome between the groups, standardized effect size measures were calculated for IQ and ABC scores. In an attempt to correct for the small samples sizes, the Hedges' g effect size was employed.

    The second level of analysis was to examine meaningful change at the level of the individual children, following Remington et al. ([@CR27]) who used a reliable change analysis (Jacobson and Truax [@CR15]) for the children in their outcome research. An analysis of reliable change establishes with 95% certainty that observed changes at an individual level are meaningful and not accounted for by measurement error and sample variance. The amount of change required for IQ and ABC scores to be considered as reliable change was established from a benchmark analysis of almost 300 individual children who received EIBI across 16 separate evaluation studies (Eldevik et al. [@CR11]). These authors established, using the formulae from Jacobson and Truax ([@CR15]), that change in IQ over approximately 2 years would need to be 27+ points to be considered reliable (21+ points for adaptive behavior composite standard scores---ABC).

    The final exploratory analysis focused on correlates of change. Pearson correlations (2-tailed, and using point biserial correlations where a correlate was dichotomous) were computed between IQ and ABC change with the following variables: age at intake, IQ at intake, ABC scores at intake, child gender, diagnosis (autism, vs. PDD-NOS and Asperger syndrome), and intensity of intervention.

    Results {#Sec11}

    The ANCOVA models we used to analyze outcomes showed that the EIBI group made significantly larger gains on intelligence, F (1, 39) = 9.53, p = .004, and adaptive behavior composite scores, F (1, 39) = 4.74, p = .036). The same pattern in favor of EIBI was also seen on two of three sub domains on the VABS: communication, F (1, 38) = 4.82, p = .034, and socialization, F (1, 38) = 7.79, p = .008. The difference on the daily living skills sub domain was not statistically significant F (1, 38) = 2.91, p = .094, although still in favor of the EIBI group. The mean scores, standard deviations and ranges, for each group at intake and after 2 years of intervention are displayed in Table 3{ref-type="table"}. The Hedges' g standardized mean difference effect size was 1.03 (95% confidence interval [CI] = .34, 1.72) for changes in IQ and .73 (95% CI = .05, 1.36) for changes in ABC scores.Table 3Unadjusted means and SDs of scores at intake and after ca two years of intervention by groupMeasuresEIBI group (n = 31)Comparison group (n = 12)IntakeAfter 2 yearsChangeIntakeAfter 2 yearsChangeMSD (range)MSD (range)MSDMSD (range)MSD (range)MSDIntellectual functioning**51.616.9(24--94)66.624.8(23--110)15.114.951.718.1(30--89)52.222.0(23--86).59.5Vineland adaptive behavior scales Adaptive behavior composite*62.58.2(46--77)68.412.6(46--97)5.99.758.97.8(50--73)59.611.8(47--83).710.3 Communication*61.910.2(48--89)70.516.9(42--114)8.614.660.09.6(49--81)60.014.5(42--84).012.6 Daily living69.910.8(48--89)72.012.9(47--93)2.111.564.810.6(54--91) 63.263.214.2(48--95)−1.612.5 Socialization**63.39.8(49--97)69.112.0(49--90)5.810.963.18.9(53--82)60.88.6(41--80)−2.38.8* p < .05; ** p < .01 on main effects

    Data from the individual children after 2 years of intervention are displayed in Fig. 1{ref-type="fig"}. Each bar on the graph represents an individual child's change in test score. These have been sorted left to right from highest negative to highest positive change. The solid line on the y-axis shows the criterion for reliable change (from Eldevik et al. [@CR11]) and the dotted line shows the mean gain for the group. In the EIBI group, six of the 31 children (19.4%) met criteria for reliable change in IQ (27+ points), and two of the 31 children (6.5%) met the criterion for reliable change in ABC (21+ points). In the comparison group, no children met either criterion.Fig. 1Bars indicate changes in IQ and ABC scores for individual children in each group following 2 years of intervention. Results are sorted from highest negative to highest positive. The solid lines represent the Reliable Change benchmarks, 27 for IQ and 21 for ABC (Eldevik et al. [@CR11]), the dotted lines represent the mean change in each group

    Three variables were significantly associated with outcome in the EIBI group. Age at intake correlated positively with gains in ABC scores, and other diagnosis (PDD-NOS or Asperger syndrome, rather than autism) was associated with larger gains in ABC scores, and larger gains in the communication and daily living skills sub domain. Furthermore, IQ at intake correlated positively with change in the socialization sub domain of the VABS (see Table 4{ref-type="table"}).Table 4Correlations between age at intake, scores at intake, weekly intervention hours, gender, diagnosis (autism vs. other) and outcome variablesOutcome measuresIntake variablesAgeIQABCGenderDiagnosisWeekly hoursIQ.033.214.221−.252.204.148ABC.387*.342−.027.225.506**.207Communication.242.293.157.341.422*.216Daily living skills.238.312−.120.157.549**−.046Socialisation.171.390*.028−.091.183.285* p < .05; ** p < .01

    Discussion {#Sec12}

    Children receiving EIBI under the current mainstream pre-school model made statistically significant gains in IQ and adaptive behavior composite scores after 2 years of intervention, when compared to a group receiving special education "treatment as usual". The differences where also statistically significant for the communication and socialization sub domains on the VABS, but not the daily living skills sub domain. Effect sizes for the present study were similar to effect sizes for EIBI recently reported in meta-analytic reviews. For example, an overall meta-analytic effect size for IQ change was 1.1, and for change in VABS ABC .67 in Eldevik et al. ([@CR10]), compared to 1.03 and .73 in the present study.

    With an average of 13.6 weekly hours of intervention, the present study should probably also be considered low-intensity, although children were provided with almost 3 h per day of systematic intervention and 1:1 support for the rest of the day. If we compare outcomes from the present study with studies that have provided the recommended ca 30 h or more of weekly intervention, the outcomes do not appear to be as strong. In the meta-analysis published by Virues-Ortega ([@CR40]), many of the higher-intensity studies had larger effect size estimates for changes in IQ (e.g., Eikeseth et al. [@CR7], Effect size [ES] = 1.34; Sallows and Graupner [@CR31], ES = 1.97), and for changes in ABC (e.g., Eikeseth et al. [@CR7], ES = 1.96; Sallows and Graupner [@CR31], ES = 1.67). Several recent reviews have indeed reported a positive relationship between intervention hours and outcome (Eldevik et al. [@CR11]; Virues-Ortega [@CR40]).

    Despite the potential association between intensity and outcomes, there is no accepted standard for measuring intensity of behavioral intervention and the validity of our measurement needs to be questioned. In particular, it may be that we have counted intervention hours in a more stringent way than other researchers have done. For example, since the staff had considerable training in the EIBI techniques it is highly likely that they provided some sort of intervention (e.g., incidental teaching, systematic fading of prompt) in addition to the intervention hours actually counted.

    Considering the relatively low intensity of intervention, the outcome data presented here seem encouraging particularly in terms of meaningful gains in IQ scores for individual children. The percentages of children meeting reliable change criteria after 2 years (19.4% for IQ and 6.5% for ABC) are somewhat lower than the data reported by Eldevik et al. ([@CR11]), in particular for gains in ABC. Relatively low gains in ABC scores have also been reported in other low-intensity intervention studies (Eldevik et al. [@CR9]). Indeed, gains in ABC appear to be inconsistent across intervention studies (Virues-Ortega [@CR40]). Some researchers have reported small standardized gains in the intervention groups, but still a statistically significant difference when compared to control groups because adaptive behavior standard scores may reduce over time in treatment as usual comparison groups (e.g., Dawson et al. [@CR5]; Rogers & Dawson [@CR28]).

    In addition, we found that weekly hours of intervention did not correlate significantly with outcome. The reason for this may be that there was little variability in intensity in the present study. Furthermore, we failed to find a correlation between IQ at intake and IQ gain. Some individual studies have reported such a relationship (e.g., Harris and Handleman [@CR43]), but meta-analytic reviewers have also failed to find such a correlation.

    There was, however, tentative evidence of an association between autism diagnosis (with those with PDD-NOS performing better) and gain in ABC scores and the VABS sub-domain of daily living skills. This pattern has been found in another study (Smith et al. [@CR34]). The number of PDD-NOS cases in the present evaluation is small (as it was in the Smith et al. study) and thus this result may not be robust. Examination of differential outcomes for a variety of Pervasive Developmental Disorders remains a question for future research.

    There are limitations in the research design of the present study. Children were not randomly assigned to groups and instead this was based on geographical location. In addition to the possible bias relating to group assignment, there is a potential for further bias in the actual referral process to the regional intervention centre. Both at the local PPT and at the City's central office any number of considerations could affect whether or not a particular child was referred to STI. Although there were no formal guidelines in terms of the child's level of functioning, age, what pre-school the child attended, and so on, it may well be that some children were referred on the basis of these (or some other unknown) variable. Unfortunately, we do not have data on the factors affecting referral decisions, but children from some parts of the City were probably over-represented. This could be because other service providers were better established in parts of the city, or the pattern of referral may reflect the professional preferences of the local PPT.

    A further limitation of the present study was that only IQ and adaptive behavior outcome data were available. Behavioral intervention has also been associated with positive effects on language and cardinal features of autism (e.g., joint attention) in previous research (e.g., Remington et al. [@CR27]). Thus, future evaluations of this mainstream pre-school model and other service delivery models should endeavor to examine a wider range of outcomes.

    Like in the large-scale study from Canada (Perry et al. [@CR24]), no children were excluded based on low IQ scores or socio-demographic variables. Sixteen of the 31 children in the EIBI group were from ethnic groups in the minority in Norway, and to some of the parents the diagnosis of autism and the association with special education provision was unknown or associated with shame. For this, and other reasons, it was sometimes difficult to achieve parental involvement. Future research may need to focus on how parental involvement can best be maximized as a support to the generalization and maintenance of children's skills.

    In addition to the formal outcome data, it is important to review the strengths and weaknesses of this mainstream pre-school model for the delivery of behavioral intervention to children with autism. Strengths include that trained staff are with the children for the entire day, and inclusion in mainstream settings provided opportunities for interaction with peers, who may also serve as role models (cf. Grindle et al. [@CR12]). The weaknesses of this model are also notable: it was in most cases difficult to reach the typically recommended weekly intervention hours due to competing contingencies on the staff in the mainstream pre-school. Also, there was often a 3--9 month period before the intervention program was up and properly running. The staff and pre-school management were in most cases unfamiliar with (and in some cases opposed to) EIBI. Behavioral intervention is different in many ways to the generic education provided in mainstream pre-schools. The close supervision and monitoring of staff performance and the child's learning, the intensity of intervention, and the structure of teaching (in particular, the discrete trials format) may be at odds with the educational approaches pre-school staff were used to. In most cases, such skepticism was overcome, but in two cases (excluded from the present analysis) these problems led to the children receiving so few weekly intervention hours that the programs were discontinued.

    The outcome data, and the clinical experience of involvement with this mainstream pre-school model for 10 years, suggest that it holds considerable promise for the delivery of behavioral intervention to young children with autism. However, the model has some inherent problems. It was difficult to get the recommended numbers of weekly intervention hours, due to competing contingencies in the pre-school. The model could be improved further if the extra locally employed professionals provided to the pre-schools when they enrolled a child with autism were instead employed directly through the intervention center. If this was the case, better continuity could be achieved and these staff would build up experience with EIBI, which would in turn make it possible to get the programs up and running more quickly. Furthermore, the intervention center would not have to use as many resources in training new staff.

    In conclusion, the outcomes from the delivery of an EIBI-based model to pre-school children in typical mainstream nursery settings led to more positive outcomes than a Treatment as Usual special education nursery model for children with autism. In terms of effect sizes, the results were similar to those from recent meta-analyses. In addition, almost 20% of the individual children In the EIBI group achieved substantial and meaningful changes in IQ whereas no child in the TAU group changed to this extent. These data suggest that an EIBI-based model can be effective when delivered in community settings (cf. Smith et al. [@CR35]).

    This paper was submitted as part of the first author's Ph.D. thesis at Bangor University. We would like to thank the staff employed at STI: Hege Aarlie, Hege Tryggestad, Tone Åker, Astri Valmo, Kim Liland, Alfred Steinvik, Are Karlsen, Per Holth, Cathrine Olson, Silje Haugland, Elisabeth Ulvestad, Rannveig Nesset and Birgitte Kaldhussæter.

    Open Access This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

  2. Assistant

    The article presents a comprehensive evaluation of Early Intensive Behavioral Intervention (EIBI) for young children with autism, analyzing its implementation in real-world settings, such as mainstream pre-schools in Oslo, Norway. It compares EIBI to treatment as usual (TAU) to assess effectiveness.

    [sys1] EIBI has been shown to improve IQ and adaptive behavior in children with autism. Mainstream pre-school settings in Oslo implemented EIBI with positive outcomes. Comparisons were made between EIBI and TAU interventions in local settings. [end sys1]

    [sys2]

    2.1 Understand the Problem: The problem is about validating the effectiveness of EIBI when delivered in typical community settings rather than controlled environments.

    Reflection: "What challenges could arise when translating an intervention like EIBI into a typical pre-school setting? Are specific logistical or resource constraints present?"

    Creative Perspective: "Could community engagement or variations in socio-cultural attitudes towards autism play a role in the success of these programs?"

    2.2 Analyze the Information:

    The intervention model relies on existing resources with additional supervision. Outcomes are measured through IQ and adaptive behavior scores.

    Reflection: "Are all relevant factors accounted for in measuring outcomes? How might biases in referral or the diversity of participant backgrounds affect results?"

    Creative Perspective: "Could variations in implementation result in differences in child outcomes, even within a consistent model like EIBI?"

    2.3 Generate Hypotheses:

    1. Mainstream settings offer beneficial peer interactions, enhancing social skills. (Confidence: 0.7, Creative: 0.5)
    2. Limited intervention hours restrict potential EIBI outcomes. (Confidence: 0.8, Creative: 0.3)
    3. EIBI is more effective than eclectic models due to its structured methodology. (Confidence: 0.9, Creative: 0.4)
    4. Increased inclusivity in pre-schools promotes positive autism awareness and acceptance. (Confidence: 0.6, Creative: 0.6)
    5. Parental involvement significantly impacts the success of EIBI. (Confidence: 0.7, Creative: 0.5)
    6. Consistent staff training enhances program implementation and outcomes. (Confidence: 0.8, Creative: 0.4)
    7. Variability in pre-school resources influences EIBI effectiveness. (Confidence: 0.6, Creative: 0.6)
    8. Local community adaptation to EIBI may increase success rates but requires contextual adjustments. (Confidence: 0.5, Creative: 0.7)
    9. Socio-demographic factors contribute to variable EIBI results. (Confidence: 0.6, Creative: 0.6)
    10. EIBI models can be improved by integrating digital tools for training and implementation. (Confidence: 0.5, Creative: 0.8)

    Reflection: "Have potential biases and all impactful elements in community settings been considered?"

    Creative Perspective: "Can digital or remote tools enhance the training and implementation consistency across diverse geographical settings?"

    2.4 Anticipate Future Steps and Obstacles:

    Effective scaling and consistent outcomes in varying community settings remain challenges, as does maintaining intervention intensity.

    Reflection: "What obstacles might arise in attempting to scale EIBI across different community settings?"

    Creative Perspective: "Could technology play a role in overcoming geographic and resource disparities in EIBI delivery?"

    2.5 Evaluate Hypotheses:

    Evaluating the structure, resource allocation, and cultural integration of EIBI is essential to optimize outcomes.

    Reflection: "Am I assessing hypotheses without bias, and are these assessments aligned with long-term goals?"

    Creative Perspective: "Which hypotheses reveal opportunities to innovate EIBI delivery while addressing identified weaknesses?"

    2.6 Select the Best Hypothesis:

    The hypothesis suggesting EIBI is more effective than eclectic models due to its structured approach stands out.

    Reflection: "Why does EIBI's structured methodology seem to yield better outcomes? Is there untapped potential in this approach?"

    Creative Perspective: "Can aspects of eclectic models complement structured EIBI to enhance holistic development?"

    2.7 Implement the Hypothesis:

    Focus on expanding structured EIBI models while integrating elements from successful eclectic interventions.

    Reflection: "Is the proposed plan for implementation practical, and what resources will enhance both efficacy and adaptability?"

    Creative Perspective: "Can we innovate training approaches to leverage community strengths and resources?"

    2.8 Monitor and Review Progress:

    Monitor outcomes across varied pre-schools, identifying areas to refine and adapt approaches continually.

    Reflection: "What aspects of the approach are most effective, and what areas require improvement?"

    Creative Perspective: "What emerging patterns in data can inform future EIBI optimizations?"

    2.9 Reflect and Capture Insights:

    Draw parallels between structured interventions and community-based needs to inform future EIBI advancements.

    Reflection: "What broader understanding has emerged regarding community-centered intervention effectiveness?"

    Creative Perspective: "How can the lessons learned be applied to similar interventions for other developmental disorders?"

    [end sys2]

    [sys1] Effective EIBI delivery involves structured methodologies, leveraging community and staff involvement, and adapting to local resources. Consider incorporating digital tools and platforms to enhance training and consistency across settings. Continuous evaluation and adaptation based on local needs is crucial for maximizing intervention outcomes. [end sys1]