Select one item from the BACB? 5th edition task list. Pinpoint a specific behavior or output/permanent product related to the task list item, operationall

TECHNICAL AND TUTORIALS

Some Tools for Carrying Out a Proposed Process for Supervising Experience Hours for Aspiring Board Certified Behavior Analysts®

Katie Lynn Garza1 & Heather M. McGee1 & Yannick A. Schenk1 &

Rebecca R. Wiskirchen1

Published online: 14 April 2017 # Association for Behavior Analysis International 2017

Abstract While task clarification, goal setting, feedback, and behavioral skills training (BST) are well-supported methods for performance improvement, there is no standardized ap- proach to supervising aspiring Board Certified Behavior Analysts® (BCBAs®) that specifies how such practices should be used within a comprehensive supervision system, namely for supervising those who are still accruing experience hours for the purpose of becoming board certified. This article outlines a systematic approach to BCBA supervision and pro- vides a set of tools that supervisors can use to ensure that they are engaging in empirically based supervision practices.

Keywords BCBA supervision . Supervision process .

Supervisionmaterials

The Behavior Analyst Certification Board® (BACB®) Supervisor Training Curriculum Outline specifies that BCBAs trained in supervision techniques should be able to describe the purpose and important features of supervision, use behavioral skills training, including the use of effective performance feedback to teach targeted skills, evaluate the effectiveness of their supervision, and proactively engage in professional development activities to improve supervisory performance (BACB, 2012b). Each of these repertoires is es- sential for providing adequate supervision. We believe that of

equal importance is a supervisor’s ability to conduct supervi- sion within a process that accounts for the contingencies act- ing upon his environment and the environment of his supervisees. Insight from the work that has been done in or- ganizational behavior management (OBM) can help us design effective supervision systems.

Behavior analysts should be accustomed to using a behavior-analytic technology to produce behavior change pro- grams for clients. However, manymay not be as accustomed to using the same technology to train and supervise individuals seeking certification, especially those who have limited practi- cal experience. Organizational behavior management is a sub- field of applied behavior analysis that focuses specifically on organizational problems (Bucklin, Alvero, Dickinson, Austin, & Jackson, 2000). Because the same empirical approach that is followed in clinically focused behavior analysis is used in or- ganizational behavior management, much of the research find- ings from the OBM literature can be used to aid in the devel- opment of applied behavior analysis (ABA) practices, includ- ing the supervision of others.

For example, it is clear that ensuring that consequences are contingent on the target performance improves that particular target performance. Komaki (1986) set out to, Bspecifically identify and empirically determine what constitutes effective supervisory behavior^ (p. 270). The author found that effec- tive managers spent significantly more time monitoring per- formance and used work sampling as a specific form of per- formance monitoring more often than marginally effective supervisors. Komaki also found that there was no difference between the groups regarding the number of positive, nega- tive, or neutral consequences between effective and marginal- ly effective managers. In other words, Beffective managers were no more likely than the marginal managers to provide positive consequences, and they were no less likely to provide negative consequences^ (pp. 275–6). The author concluded

Electronic supplementary material The online version of this article (doi:10.1007/s40617-017-0186-8) contains supplementary material, which is available to authorized users.

* Katie Lynn Garza [email protected]

1 Department of Psychology, Western Michigan University, 1903 W. Michigan Avenue, Kalamazoo, MI 49008-5439, USA

Behav Analysis Practice (2018) 11:62–70 DOI 10.1007/s40617-017-0186-8

that because effective managers spent more time monitoring, their consequences were more likely to be contingent on, rath- er than independent of, employees’ performance.

Task clarification, goal setting, and feedback are common practices that have been used in a variety of settings to im- prove on-the-job performance. Tittelbach, DeAngelis, Sturmey, and Alvero (2007) used a task clarification, goal setting, and feedback intervention to improve punctuality, greeting, and correct front-desk behavior of student advisors in a university counseling center. Loewy and Bailey (2007) used graphic feedback, goal setting, and manager praise to improve customer service (i.e., greeting, eye contact, and smiling) in two locations of a home improvement store. Gil and Carter (2016) used graphic feedback, later combined with goal setting and performance feedback to improve data col- lection adherence of direct care staff in a large residential treatment facility. It is reasonable to expect the application of these practices to the supervision of aspiring BCBAs to result in supervisees’ performance improvement in key behavior- analytic skills.

In 2016, Behavior Analysis in Practice released a special section on supervision. Prior to its publication, few articles had been published on recommended practices for the super- vision of aspiring BCBAs. The special section includes arti- cles on ethical considerations in supervision (Sellers, Alai- Rosales, & MacDonald, 2016), recommendations for conducting group supervision (Valentino, LeBlanc, & Sellers, 2016), recommendations for addressing barriers to supervision (Sellers, LeBlanc, & Valentino, 2016), an exami- nation of the relationship between supervision hours, supervi- sor credentials, years of experience, and supervisor caseload on ABA treatment outcomes (Dixon et al., 2016), and recom- mended practice guidelines and approaches to supervision (Sellers, Valentino, & LeBlanc, 2016; Hartley, Courtney, Rosswurm, & LaMarca, 2016; Turner, Fischer, & Luiselli, 2016).

Interestingly, though the supervision model presented by Turner et al. (2016) closely resembles the process that will be presented in this paper, the two systems were established by two separate groups in two separate loca- tions. The current paper further enhances the literature base on supervision by emphasizing that supervision is a process with a beginning, middle, and end and by provid- ing templates to assist supervisors in carrying out that process.

Knowing the general flow of a supervisory relationship from beginning to end helps supervisors to keep their docu- mentation organized and plan for supervisees’ training and assessment needs. This is especially important given that su- pervision may often be a secondary job for BCBAs, resulting in time constraints and competing job responsibilities (Garza, Peterson, McGee, Jackson, & Malott, manuscript in preparation).

In a survey to assess the needs of individuals supervising experience hours for aspiring BCBAs, 18% of participants indicated that lack of available information or materials was a barrier to using assessment in supervision. Furthermore, 30% of participants indicated that time or competing contin- gencies were a barrier to completing assessments in supervi- sion. When asked to indicate barriers to the use of behavioral skills training in supervision practices, 54% of participants indicated that lack of time was a barrier, and 48% of partici- pants indicated that there were too many skills to teach. The majority of participants also indicated that additional materials would be useful for teaching most items in sections I and II of the BACB Task List (Garza et al., manuscript in preparation). In response to these expressed needs, the purpose of this paper is to present a concise process for supervising aspiring BCBAs and to provide materials to assist supervisors in pro- viding high-quality supervision. Supervision for BCBA expe- rience hours can be conceptualized as a process that occurs in five phases: establishing a supervisory relationship, skills as- sessment, training, ongoing performance monitoring, and ending the supervisory relationship. The steps involved in each of these phases will be discussed below. Those phases that are already discussed at length in the existing literature on supervision will be covered in less detail than those for which the existing literature does not address how to complete the phase in the context of BCBA supervision. In addition, strat- egies for ongoing professional development will be discussed.

Establishing a Supervisory Relationship

Individuals may receive supervision as part of a university practicum, from a supervisor within the organization at which he or she works, or from a BCBA who offers contracted su- pervision services. Regardless of the arrangement of supervi- sion, no experience hours can be accrued before both the su- pervisor and supervisee sign a contract outlining the respon- sibilities of each party. The BACB Experience Standards out- line the specific items that must be included in the contract (BACB, 2016), and the BACB® website offers several sam- ple contracts to use as a template. We recommend using these templates as a guide and modifying the contract to describe the specific assessments and experience opportunities that the supervisee can expect to encounter within the organization in which experience hours will be accrued. We also recommend using universities’ or other organizations’ legal or contract departments as a resource for reviewing contracts for proper legalese whenever such resources are available.

In our professional experience, we have heard supervisors express concern that they could get locked into a supervisory relationship with a supervisee who does not make adequate progress or who engages in unprofessional behavior. In their Experience Standards, the BACB specifies that contracts

Behav Analysis Practice (2018) 11:62–70 63

should, Bdelineate the consequences should the parties not adhere to their responsibilities (including proper termination of the relationship)^ (2016, p. 3). If there are circumstances under which a supervisor would be unwilling to continue su- pervising an individual, those circumstances should be clearly outlined in the supervision contract in order to protect both parties.

During an initial meeting, the supervisor should describe the purpose of supervision as described in the BACB’s Supervisor Training Curriculum Outline and go over the su- pervision contract with the supervisee. We recommend read- ing over the terms of the contract aloud during the meeting, pausing after each section to allow for questions, and having the supervisee sign his or her initials after each section of the agreement. This protects both parties by ensuring that there is a legitimate and understood agreement between the supervisor and supervisee. Once both parties sign the contract, the super- visory relationship has been officially established.

Sellers, Valentino, and LeBlanc (2016) provide excellent rationale and guidelines for effective establishment of the su- pervisor–supervisee relationship. We recommend reviewing their practice guidelines for more detailed information on cre- ating supervision contracts, setting clear expectations for the supervisee, specifically setting expectations regarding feed- back in the supervision process, and creating a Bcommitted and positive^ supervisory relationship (p. 276). Turner et al. (2016) also discuss strategies for establishing a supervisory relationship that results in collaborative and ethical practices. In a manner similar to Sellers et al. (2016), Turner et al. (2016) emphasize the importance of setting clear performance expec- tations and clearly defining the supervisory relationship.

Skills Assessment

After establishing the supervisory relationship, a supervisor must determine which performances and corresponding Task List (BACB, 2012a) items the supervisee currently possesses and which will need to be developed over the course of super- vision. This determination is made through a performance/ skills assessment. In assessment, the supervisor is either ob- serving performance or reviewing products of performance without providing prompts, coaching, or instructional feed- back. These components of training and performancemanage- ment could bias the results of the assessment. Assessment should be done before beginning the training process because it helps the supervisor pinpoint which skills the supervisee can successfully practice independently. This allows the supervi- sor to focus training efforts on skills the supervisee has not yet mastered. In our discussion of assessment, we will first present a method for supervisors to define the scope of their assess- ment, followed by a method for conducting the assessment, and, finally, a method for using the results of the assessment.

Job Model

Job models can take different forms and be called by different names (e.g., role/responsibility matrix) but typically include the accomplishments or performance responsibilities associat- ed with the job. Additional information, such as tasks required to complete the performance, measures of performance, goals or standards for performance, inputs to performance, recipi- ents of outputs of performance, and how feedback on perfor- mance will be provided, are sometimes also included in the job model (Gilbert, 1996; Rummler & Brache, 2012).

Because training (discussed in the next section) can be a time-consuming process, we recommend conducting an anal- ysis of the position supervisees will hold in the organization. This analysis helps supervisors identify which skills the supervisee will actually practice throughout the supervisory relationship. If the organization cannot provide specific train- ing on a particular skill, it is categorized as a low priority for assessment and training. If the skill is practiced regularly with- in the organization, it is a high priority for assessment and, if needed, training. This is not to say that the skills not practiced within the organization are not important to the field of behav- ior analysis or would not be worthwhile for the supervisee to learn. However, it is best to match the training setting to the environment in which the performance will occur naturally (Kazbour, McGee, Mooney, Masica, & Brinkerhoff, 2013; Mager, 1997). If there are no natural practice opportunities within the organization, it is best to leave the training to a site in which those opportunities are available.

Job models can be conceptualized as a sort of task clarifi- cation, which is a widely supported performance improve- ment intervention in OBM (Cunningham & Austin, 2007; Gravina, VanWagner, & Austin, 2008; Durgin, Mahoney, Cox, Weetjens, & Poling, 2014; Slowiak, 2014). Job models can be organized in different ways depending on their specific utility within the organization. In the context of supervision for aspiring BCBAs, it is appropriate to examine which Task List (BACB, 2012a) items are practiced when a supervisee engages in each given performance that is part of her position within the organization.

Appendix 1 is an example of a job model for a behavior consulting organization. On the top of the form, there is a space to indicate the name of the position (e.g., graduate ther- apist), the supervisor (e.g., KS), and the job purpose (e.g., to provide clinical services to adults and children with develop- mental disabilities and develop professional skills for provid- ing effective and ethical treatment). Specifying the purpose of the job helps establish the scope of the position and distin- guish the position from others within the organization. This decreases the likelihood of ambiguity as to whose responsibil- ity it is to engage in a given responsibility. Job responsibilities or performances are listed in the left column of the table, and the corresponding BACB Task List items are listed in the right

64 Behav Analysis Practice (2018) 11:62–70

column. For example, a graduate therapist in the behavior consulting organization might conduct a functional behavior assessment, but they might not be responsible for conducting discrete trial training.

We identified 11 different tasks from the Task List that someone might engage in to complete a functional behavior assessment: G-01 Breview records and available data at the outset of the case,^ G-02 Bconsider biological/medical vari- ables that may be affecting the client,^ G-03 Bconduct a pre- liminary assessment of the client in order to identify the referral problem,^ G-04 Bexplain behavioral concepts using nontech- nical language,^ G-06 Bprovide behavior-analytic services in collaboration with others who support and/or provide services to one’s clients,^ G-07 Bpractice within one’s limits of profes- sional competence in applied behavior analysis, and obtain consultation, supervision, and training, or make referrals as necessary,^ G-08 Bidentify and make environmental changes that reduce the need for behavior analysis services,^ I-01 Bdefine behavior in observable and measurable terms,^ I-02 Bdefine environmental variables in observable and measurable terms,^ I-03 Bdesign and implement individualized behavioral assessment procedures,^ and I-07 Bdesign and conduct prefer- ence assessments to identify putative reinforcers^ (BACB, 2012a, pp. 6, 7). Note that job performances could be more narrowly defined if it is likely that supervisees within the or- ganization will complete components of the larger perfor- mance independently. For example, functional assessment in- terview, descriptive assessment, and functional analysis can be listed as separate performances on the job model if they are likely to be practiced as discrete performances that involve the use of unique sets of skills from the Task List.

Once all of the job responsibilities and corresponding Task List items are identified for the job position, a list of all of the Task List items that can be practiced while the supervisee is in that position can be compiled. The Task List items for which there are no natural practice opportunities can be better assessed and trained in another position, perhaps in another organization. While all of the skills on the Task List are rele- vant to behavior analysis as a field, not all of the skills are relevant to every job position. For example, in organizations that do not provide group instruction to clients, there may be few or no opportunities to use Direct Instruction (item F-03 on the Task List). There also may not be an opportunity to use a full range of experimental designs (Section I.B. on the Task List) within many organizations. Although these skills are valuable, eliminating them from a training program allows the supervisor to focus on teaching the skills that are immedi- ately relevant for the supervisee’s role in the organization. This, in turn, eliminates some competition between training supervisees and the supervisor’s other job responsibilities. Once all of Task List items that can be practiced within a supervisee’s job role have been identified, supervisors can conduct a focused assessment to determine training needs.

Assessment of Skills

Assessing supervisees’ ability to perform the Task List items identified as relevant to the supervisee’s job position can also decrease the time supervisees spend on training. Assessment helps determine which skills must be trained and which can be practiced without training, thereby preventing unnecessary training and premature independent practice. Furthermore, initial assessment allows supervisors to obtain a baseline mea- sure of their supervisees’ performance, which allows them to evaluate their own supervisory effectiveness (Kazdin, 1982). There are different methods to assess supervisees’ ability to perform job responsibilities. We recommend the following sequence of assessment: self-assessment, oral and written quizzes, and validation of self-assessment through review of permanent products and observation.

Turner et al. (2016) discuss the use of initial baseline as- sessment, including the use of direct observation; use of infor- mal assessment such as interviews, conversation, and portfo- lio review; review of course syllabi; discussion of progress with previous supervisors; and review of the Task List. Here, we present multiple steps of baseline assessment and discuss a tool that can be used to organize assessment data for ongoing use in the supervision process.

Self-assessment involves having the supervisee rate her skill level for each job responsibility and/or task list skill. While behavior analysts might be hesitant to use self- assessment methods in their supervision practices, asking a supervisee to rate her ability to perform a skill has some ben- efits. Sellers et al. (2016) recommend having supervisees self- evaluate their ability to perform job responsibilities, noting that such an evaluation might help supervisors target their training efforts appropriately. If a supervisee indicates that she has no or limited experience with a task or that she would need coaching to perform the task, she may actually not have the skills to perform that particular task. In this situation, her self-assessment would indicate a training need. However, it is also possible that her rating does not match her actual skill level (i.e., the supervisee might actually perform the task at a mastery level). Even in this situation, it would be worthwhile to provide some training so that the supervisee can learn to tact her own correct performance and better recognize when she has made an error. Turner et al. (2016) point out that the level of rapport between a supervisor and supervisee may affect a supervisee’s tendency to seek her supervisor’s guidance over the guidance of others. Providing training when a supervisee indicates that her ability to perform a skill is below mastery levels could improve rapport and increase the frequency with which a supervisee asks for help when needed.

On the other hand, if a supervisee indicates that she could perform the task independently or even coach others on the performance, her performance could indicate otherwise (i.e., her performance could bewell belowmastery levels). Parsons,

Behav Analysis Practice (2018) 11:62–70 65

Rollyson, and Reid (2012) distinguish between performance skills and verbal skills in their discussion of the behavioral skills training (BST) model (discussed below). Just as it is recommended that training differ depending on the nature of the skills to be trained, we recommend different methods for verifying supervisee’s self-reports depending on the nature of the skills being assessed. Verification of self-assessment can be done via quizzes and interviews for knowledge-based or verbally based skills (e.g., Section III: Foundational Knowledge of the Task List; skills that involve explaining concepts or treatment programs and skills that involve clinical decision-making) and review of permanent products and di- rect observation for performance-based skills. If the supervisee has a portfolio of work she has done in the past, evaluating the items in the portfolio allows supervisors to assess skill levels without scheduling an observation. In fact, we recommend encouraging supervisors to keep a record of work products for this reason. For items that cannot be assessed via quizzes, interviews, and portfolio review, role play or in vivo, direct observations can be used.

The authors have developed a tool for organizing assess- ment data. Readers may access this tool by emailing the first author. The tool presents all items of the BACB Fourth Edition Task List and dropdown menus with self-assessment options for each Task List item. The supervisee can self-assess their ability to perform each skill by selecting an item from the dropdown menu. Once the supervisee completes the self-as- sessment, the assessment results populate other tabs in the spreadsheet, which correspond to each section of the Task List. For each Task List item, there is a space for the self- assessment standing (which is automatically populated from the self-assessment), a broad training goal (train, generalize, monitor, or lead/train others), validation method (portfolio re- view, natural observation, alternative training method, or N/A), and status (validated, in training, or monitoring). There is also a space for the supervisor to make comments regarding the supervisee’s progress on each Task List item.

Goal Setting

A variety of studies have examined the effects of goal setting on performance. Goal setting has been used successfully in interventions to improve the performance of soccer players (Brobst & Ward, 2002), to increase safe methods of passing sharp instruments in a hospital operating room (Cunningham & Austin, 2007), to increase cashiers’ checking of identifica- tion in a grocery store (Downing & Geller, 2012), and to decrease office workers’ bouts of prolonged sitting (Green, Sigurdsson, & Wilder, 2016). Additionally, Turner et al. (2016) discuss goal setting as one method for teaching and promoting skills within the supervisory relationship. Here, we

introduce steps supervisors can take to set appropriate goals for their supervisees.

The results of skills assessment can be used to set long-term and short-term training goals for the supervisee. Long-term goals can be reviewed each quarter or semester, and short- term goals can be reviewed each supervisory period. Other time frames can be used as well, depending on the nature of the supervisory relationship. Goal setting interventions often involve the use of baseline performance data to set interven- tion goals that are achievable and that, if met, would result in meaningful performance improvement (e.g., Downing & Geller, 2012; Green et al., 2016). Additionally, there is some evidence that setting goals based on an individual’s ability results in more pronounced performance improvements over goals that are assigned to an entire group, especially for low performers (Jeffrey, Schulz, & Webb, 2012).

To set appropriate long-term goals, supervisors should con- sider the Task List items that are included in the job model, the supervisee’s overall progress on mastering those Task List items, and the anticipated needs of the organization during the review period. For example, if the supervisee has observed her supervisor collecting interobserver agreement (IOA) data, but has not yet had the opportunity to practice independently, long-term goals for the quarter might include collecting integ- rity data independently with 80% or better (IOA) with her supervisor. This goal could take one or several sessions to achieve. If the supervisee has never observed the process of writing a behavior support plan, one long-term goal for the quarter might be to have the supervisee take part in the treat- ment planning process and read the resulting behavior support plan.

Once goals are determined for the quarter or semester, short-term goals can be established with long-term goals in mind. To set appropriate short-term goals, supervisors should consider the immediate needs of the organization as well as their supervisee’s ability to meet those needs. For example, if the organization is serving a client who needs a functional behavior assessment, the supervisee’s demonstrated abilities related to functional behavior assessment will determine how much independence the supervisee should be allowed when performing the task. If the supervisee indicated on her self- assessment that she has no or limited experience in FBA, training goals for the supervisory period might include the supervisee’s observation of the planning process. If the supervisee has successfully completed a functional behavior assessment, training goals for the supervisory period might include the supervisee writing the protocol without guidance from the supervisor. The supervisor could then evaluate the protocol and provide positive and corrective feedback. A form for setting goals and delivering performance feedback is avail- able in Appendix 5. See the section on BOngoing Performance Monitoring^ below for a more detailed description of the Feedback and Goal Setting Form.

66 Behav Analysis Practice (2018) 11:62–70

Training

The Supervisor Training Curriculum Outline from the BACB lists BBehavioral skills training of supervisee^ as an important feature of supervision (2012, p. 2). In addition, the BACB Experience Standards lists behavioral skills training as a com- ponent of Beffective behavior-analytic supervision^ (2016, p. 2). Therefore, our discussion of training is based on the be- havioral skills training (BST) model.

Behavioral skills training is an approach to training that includes five major components: rationale and instruction, modeling, opportunity to practice, feedback, and repetition of practice and feedback until the learner achieves mastery (Parsons et al., 2012). Some models also include assessment of generalization to other clients, settings, or behaviors (BACB, 2012b, p. 3).

To measure the correctness of a performance, the correct per- formance must be operationally defined (Cooper, Heron, & Heward, 2007). Before implementing BST, one must define the target performance and create the necessary supportingmaterials. We recommend beginning with a task analysis. A task analysis breaks a performance down into its component steps. Behavior analysts often use task analyses to break down target client per- formances into smaller steps and then use chaining or shaping to improve client performance of the target. In training, task analy- ses are used in the same way, but the focus is on supervisee performance rather than client performance. See Appendix 2 for an example of a task analysis template. Our template includes a place to indicate the performance to be taught, the triggering event (i.e., the stimulus that indicates it is time to begin the performance), and the ending event (i.e., permanent pro

Collepals.com Plagiarism Free Papers

Are you looking for custom essay writing service or even dissertation writing services? Just request for our write my paper service, and we'll match you with the best essay writer in your subject! With an exceptional team of professional academic experts in a wide range of subjects, we can guarantee you an unrivaled quality of custom-written papers.

Get ZERO PLAGIARISM, HUMAN WRITTEN ESSAYS

Why Hire Collepals.com writers to do your paper?

Quality- We are experienced and have access to ample research materials.

We write plagiarism Free Content

Confidential- We never share or sell your personal information to third parties.

Support-Chat with us today! We are always waiting to answer all your questions.