Who We Are
News & Stories
Sep 23, 2022
Sep 15, 2022
August 20, 2023
June 29, 2023
June 24, 2023
University Wide Events
No Communication Compromises
Areas of Study
Changing the world
Community & Innovation
Research Experiences & Services
Your Journey Starts Here
Tools & Resources
Explore Our Campus
Sep 26, 2022
American Sign Language Prof...
Research Recommendations and Implementation
Fowler Hall 410
Research Recommendations and ImplementationIn 2010-2012, the ASLPI evaluation system underwent validity and reliability studies by an external research and consulting firm. The lead researcher traveled to Gallaudet University to present about the findings to the Gallaudet faculty and administration (outcomes posted above).
Upon conclusion of this two year research study, the following recommendations were prioritized by ASL Diagnostic and Evaluation Services:
At the beginning of fall 2013, all ASLPI Evaluators were required to participate in a mandatory training. Adherence to stricter standards for rating agreement among evaluators was also instituted. The absolute agreement approach for rating decisions was implemented as is recommended for high stakes testing.
Following the training and implementation of the stricter rating expectation (absolute agreement for proficiency level decisions), The ASLPI established a monitoring system. Prior to distribution, every rating decision went through a review process to examine inter- and intra-rater reliability. This ensured application and effectiveness of the training. At the end of fall 2013, The ASLPI conducted a rating reliability study across all evaluators. The reliability study included the 275 evaluations conducted. Rating reliability for the entire pool of ASLPI Evaluators was determined to be 84%. For high stakes language proficiency testing, reliability must be 80% or above.
The ASLPI is continuing to closely monitor all evaluators to ensure that a shared mental model is consistent and evaluators are applying the same operational definitions of the proficiency constructs.
Gallaudet University, chartered in 1864, is a private university for deaf and hard of hearing students.
Copyright © 2022 Gallaudet University. All rights reserved.
800 Florida Avenue NE, Washington, D.C. 20002