Middle/Junior High thru High School, Higher Education, Government/Business/Non-Degree Institute, Administrator
French, Other, Spanish
Effective July 21, 2019
A full-time exempt position
Assessment Development Specialist reports to the Principal Assessment Manager, CARD
This individual works both independently and collaboratively with members of CARD and ACTFL to support existing assessments and new initiatives.
Position Description: This position is a member of CARD’s assessment program and is an integral part of the ACTFL team. The Test Development Specialist is an entry level position and assists CARD’s Principal Assessment Manager with ACTFL’s test development processes for the ACTFL Assessment of Performance toward Proficiency in Language Learning (AAPPL), ACTFL Latin Interpretive Reading Assessment (ALIRA), Oral Proficiency Interview- Computer, the Writing Proficiency Test, the K12 Writing Proficiency Test, and ACTFL Listening and Reading assessments.
Responsibilities of the position include but are not limited to:
Test Development: Contribute to the development and maintenance of ACTFL’s assessment projects
Collaborate with ACTFL staff and consultants on test development timelines and consultant staffing requirements
Facilitate in training and norming session for the item development teams
Contribute to the development of ACTFL assessments through collaboration with test development teams and ACTFL staff
Support test development workflow processes and item development teams in online item development system
Facilitate and participate in test development processes and work sessions so that all consultants engaged in the item development process have feedback and information to ensure quality work aligned with best practices in test development
Support creation and revision of assessment related materials (test development documentation, training materials and guidelines, etc.)
Contribute to the production of test content including video, sound, pictures, texts to be delivered online
Assist in test assembly process and UAT processes prior to operationalization of test forms
Validity and Reliability: Employ a sound practice for validity and reliability assurance of ACTFL’s assessments
Participate in iterative quality assurance measures for assessment projects in collaboration with the Quality Assurance program
Contribute to content reviews and item performance reviews to ensure validity and reliability of ACTFL assessments
Collaborate with ACTFL staff and psychometricians on test designs, specifications, and item types
Review and verify test materials’ adherence to test specifications, copyright laws, appropriateness to test taker populations, sensitivity, bias and fairness
Contribute to planning and executing pilot testing, field-testing, and usability testing
Recruit participants for pilot testing, field-testing, and usability testing
Collect and support analysis of data from pilot testing, field-testing, and usability testing
Collaborate on project research on ACTFL assessments and their validity arguments
Administration: Assist with general administrative support for ACTFL assessment projects
Test Development: Assist with the project progress updates, verification and acceptance of project requirements and deliverables for administrative processes and closing procedures
Professionalism: Demonstrate good judgment, professionalism, sound application of subject matter expertise; responsiveness in support of the ACTFL mission.
Communication & Collaboration: Effectively communicates with participants of the test development process including test takers, item writers, reviewers and raters; disseminate information to all necessary parties to ensure effective stakeholder participation.
Collaborate across ACTFL departments and with LTI staff to enhance the quality of assessment offerings.
Participate in the annual ACTFL Convention either on-site or from ACTFL HQ
Support development of professional presentations related to ACTFL tests
Participate in additional assignments as needed
Qualifications, Skills, Abilities, & Experience
M.A. or equivalent degree in testing and assessment, language education, applied linguistics, world language or related field and three years of relevant experience required
Language learning experience required; proficiency in Spanish preferred; proficiency in a world language required
Knowledge of language proficiency scales (ACTFL, ILR, CEFR) required
Solid understanding of item development processes and best practices test development
Familiarity with testing accommodations and ADA requirements
Ability to identify problems, conceptualize solutions, prioritize tasks and meet deadlines
Strong organization, planning and time management skills required
Microsoft Office Suite- highly proficient in Word, Excel and Power Point; comfort administering an online Learning/Content Management System (e.g. Schoology); Ease learning new technology (e.g. Learnosity)
Must represent projects positively in person, by phone, online, and via written communication; effective communication skills a must
Ability to work collaboratively, cooperatively and collegially in a results-oriented environment
Ability to comfortably facilitate virtual meetings
Excellent writing, proofreading, editing, and public speaking skills
Applications must include a cover letter and three references. Applications without a cover letter will not be considered.
Applications will be reviewed until the position is filled.
The American Council on the Teaching of Foreign Languages (ACTFL) is dedicated to the improvement and expansion of the teaching and learning of all languages at all levels of instruction. ACTFL is an individual membership organization of more than 12,500 language educators and administrators from elementary through graduate education, as well as government and industry.
Since its founding (in 1967), ACTFL has become synonymous with innovation, quality, and reliability in meeting the changing needs of language educators and their students. From the development of Proficiency Guidelines, to its leadership role in the creation of national standards, ACTFL focuses on issues that are critical to the growth of both the profession and the individual teacher.