ATP 2025: PSI Sessions

March 23 - 26, 2025 | Orlando, FL
View our resources

Platinum Sponsor

PSI will be presenting in seven sessions at this year's ATP Innovations in Testing Conference.

Add our sessions to your agenda!

   Monday, March 24th

The Risk of Ignoring DEI in Assessment Programs: Exploring What Change Looks Like for a Large Testing Organization | 10:15 am - 11:05 am ET | Celebration 7 - 8

About:

It is well-documented and widely recognized that including diversity, equity, and inclusion (DEI) considerations in managing a credentialing or testing organization can yield significant benefits but also presents some risks. Some of the key benefits include: broader representation, enhanced validity, increased accessibility, reputation and trust, and Innovation and creativity. Although there are also some risks to be aware of and be ready to mitigate as they relate to the implementation of DEI initiatives, these are outweighed by the actual risks of inaction or slow adoption. In this presentation, we will delve into the risks and benefits of integrating DEI in credentialing and testing organizations. We'll examine the initiatives implemented by a large testing organization to showcase the what, how, and key outcomes of their DEI-focused changes. This includes key data from the program and actionable tips for applying these principles to other organizations. Additionally, we will engage the audience in exploring outcomes from other organizations, fostering ongoing collaboration and learning across our industry.


Presenters:

 

•    Isabelle Gonthier, PhD, ICE-CCP / PSI Services

•    Mia (Diana) Bailey / NCARB

Insure Your Program – Web Crawling and Data Forensics, Real Time Monitoring, and Other Innovations in Test Security | 11:25 am - 12:15 pm ET | Celebration 12 - 13

About:

Ensuring test security is crucial for maintaining the integrity, value, and reputation of a certification program. As “Bad Actors” become more sophisticated in their strategies to circumvent traditional test security guard rails, we must continually adapt and evolve. This evolution can range from simple and novel procedural updates to elegant statistical and technological applications for real time monitoring and detection of cheating activity. In this session, a panel of experts in high stakes assessments will discuss innovations in test security throughout the testing cycle. Special attention will be given to how innovations are being leveraged to stop the wrong people from testing, catch bad behaviors during the act, build in opportunities for early corrective action, and incorporate robust and effective mechanisms to detect organized attempts to fraudulently obtain certification credentials. Panelists will discuss their experiences in implementing and using test security innovations like artificial intelligence, data forensics, and web crawling, including outcomes and lessons learned.

Presenters:
 
Frank Perna / NAHQ
Joscelyn Coles / PSI
Lingyun Gao, PhD, MEd / PSI
Wally Dalrymple / PSI & ETS

The Responsible Use of AI in the Assessment Industry | 1:35 pm - 2:25 pm ET | Bayhill 17-18

About:

The integration of Artificial Intelligence (AI) in the assessment industry offers immense potential to increase efficiency, accuracy, and security. However, the responsible use of AI is crucial to ensuring the continued validity, reliability and fairness of assessments. This Peas in a Pod discussion will first outline some of the potential applications and benefits of AI in assessment organizations, such as increased scalability, real-time data forensics, automated essay scoring, AI-driven proctoring, data analytics, and content generation—tools have the potential to reshape how assessments are designed, administered, and evaluated. We will present key considerations for responsibly implementing AI in assessment such as addressing bias and fairness, establishing organizational AI policies, data privacy and security, and copyright issues. We will then provide a forum for testing organizations who have yet to implement AI to discuss the factors that may be preventing them from doing so.



Presenters:

Sean Gasperson / PSI

ATP Security Committee Presents: Friend or Foe? - Generative AI in Assessment | 1:35 pm - 2:25 pm ET | Celebration 5-6

About:

Artificial Intelligence (AI) is currently of course a topic of intense debate within the testing and assessment sector, eliciting a broad spectrum of reactions. Enthusiasm for the potential enhancements in productivity and efficiency it could bring to test development and delivery sits at one end, while at the other, concerns loom regarding the risks posed by ever more powerful AI tools. These concerns primarily focus on security, data management, intellectual property rights, and the potential for malpractice. This complex landscape begs the question: Can we navigate the nuanced interplay between the opportunities and threats AI presents to our field? Our expert international panel aims to provide a comprehensive exploration of the challenges and prospects associated with AI tool deployment, especially in the realms of generative AI. We intend to critically assess both the test development and delivery processes and the security implications therein. Our discussion will encourage critical reflection, debate the merits and drawbacks, and stimulate a thought-provoking dialogue on security issues tied to ever increasing AI usage. Our commitment is to facilitate a panel that challenges conventional perspectives but also inspires attendees to reassess their viewpoints and foster an environment conducive to dialogue both in the session and beyond.



Presenters:

David Yunger / Vaital
Isabelle Gonthier, PhD, ICE-CCP / PSI
Marc Weinstein / Marc J. Weinstein PLLC
Paul Muir / risr/
Rose Hastings /Duolingo

PSI Services Sponsor Session: Revolutionizing Test Development and Prep with AI: Integrated Solutions for the Future | 3:00 pm - 3:50 pm ET | Celebration 5 - 6

About:

Test content development has traditionally been a labor-intensive process, relying heavily on subject matter experts (SMEs) to create high-quality, defensible exams. While this ensures rigor, the approach often lacks scalability and the ability to adapt quickly to new standards in fast-evolving fields. PSI and Memorang have collaborated to offer a transformative solution: empowering testing programs to train and evolve their own "AI box," a system that enhances the efficiency and scalability of content generation while preserving critical human oversight. This innovative approach evolves the role of SMEs from authors to architects, enabling them to guide and refine AI systems that improve over time through human oversight, feedback, and data. Testing programs can modernize their internal processes, generate high quality standards-aligned items more efficiently, and seamlessly integrate AI-powered test prep, assessment, and feedback. These solutions not only reduce content development time but also foster personalization and data-driven insights to better support test takers.



Presenters:

Isabelle Gonthier, PhD, ICE-CCP / PSI
Sean Gasperson / PSI
Yermie Cohen, MD / Memorang

Mastering Stakeholder Engagement: Strategies for Building Trust Through Communication | 4:10 pm - 5:00 pm ET | Celebration 12 - 13

About:

In the testing industry, effective stakeholder management and communication are critical for ensuring the continued positive perception and trust of the program. These stakeholder groups can vary widely with regard to their relationships with the program and levels of understanding and experience with the exam development process. The presenters will first describe strategies for managing diverse credentialing stakeholder groups, including candidates, educational institutions, and the public. Next, the presenters will provide a real-world application of these strategies in a high-stakes credentialing organization. This approach included a collaboration to evaluate the historical relationships and vested interests of various stakeholder groups, design a communication strategy to explain the value of certification and the best practice methods undertaken to create and maintain the test, and provide various opportunities for stakeholders to participate in the development and maintenance of the certification examination. Finally, the presenters will provide a form for all attendees to share experiences and strategies for communicating with stakeholders.



Presenters:

Amy Farmer / AAVSB
Channing Benson / AAVSB
Charles Bonfert / PSI

   Tuesday, March 25th

Inclusive AI - Driving Advancement With Intention | 8:30 am - 9:20 am ET | Celebration 7 - 8

About:


Advances in AI are significantly disrupting the assessment and learning industry, reshaping how education, workforce, and licensing organizations select individuals, evaluate KSAs, and personalize training and learning pathways. Although AI-based solutions come with a variety of advantages (e.g., time savings, reduced costs), these solutions have also raised equity and accessibility concerns (e.g., algorithmic discrimination, widening of digital divide). This session will help attendees to evaluate the implications of existing AI-based solutions and to think more broadly about how the testing industry can leverage technology to promote access and opportunity. The session includes panelists with expertise in education, workforce, licensing, and user experience fields, who will discuss key questions regarding what it means to design, develop, and deploy solutions with equity and intentionality in mind.

Presenters:

Alex Castillas / ACT
David Solot / American Board of Internal Medicine
Kelly Dages / Multi Health Systems, Inc.
Shebbra Toussaint, MBA, PMP / PSI