KEYW Corporation

Senior Instructional Testing Expert

1 month ago
# of Openings


KeyW is a total solutions provider for the Intelligence Community, solving their toughest challenges. We support the collection, processing, analysis and dissemination of information across the full life cycle of the Intelligence Community’s mission. We employ and challenge the most talented professionals in the industry with solving such complex problems as preventing cyber threats, transforming geospatial imaging into intelligence, and combating global terrorism.   


The Senior Instructional Testing Expert designs, develops, and revises tests and/or assessments for highly-technical evaluation programs. A qualified candidate must be fully cleared and possess an extensive range of experience including developing complex technical testing for eLearning, distance learning, instructor-led courses, and blended learning solutions.

The Testing Expert must have extensive knowledge of test design and exam item analysis methodologies to effectively support customers with rapidly evolving requirements. The Testing Expert will work closely with content developers and subject matter experts (SMEs) to design and develop rigorous formative and summative assessments to gauge the learner’s mastery of key concepts presented in learning materials. The Testing Expert conducts thorough data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies.

The Testing Expert ensures integrity of task analysis training requirements, training hierarchies, instructional materials and evaluation plans. The Testing Expert develops test blueprints for effectively designing and developing tests tied to learning objectives. The Testing Expert manages the test development activities of an item development team as lead test developer. The Testing Expert creates job-knowledge tests and performance-oriented assessments. The Testing Expert conducts Cut Score Workshops to determine appropriate cut scores for individual items and aggregate cut scores for exams. The Testing Expert writes Level 1 Survey forms to collect student feedback in courses. The Testing Expert works with Team Members to create Statistical Analysis Reports for exam analysis and customer reporting. The Testing Expert develops reports to satisfy contractual reporting requirements. The Testing Expert should be familiar with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions.

Among the tasks required of the successful Senior Instructional Testing Expert Candidate are:

  • Selects and develops the appropriate assessment and/or testing methods for learning solutions (virtual, face-to-face)
  • Applies validity and reliability standards to ensure test and/or assessments are psychometrically sound
  • Revises tests and/or assessments based on beta and pilot offerings of learning programs
  • Writes contract documentation to support all aspects of testing on the program to include Testing Packages, Proctoring Guides and documentation for High Stakes Exams, Training Evaluation documentation, Item Analysis Reports and documentation, etc.
  • Conducts research and provides recommendations to the Team and Customer on business processes and procedures for test creation and administration to ensure high exam validity and consistent student experience; these processes and procedures will also maximize test security, minimize test item exposure, reduce student potential for cheating, etc.
  • Collaborates with content developers, subject matter experts, and instructional designers/developers to integrate formative and summative tests and/or assessments into the course content of learning programs
  • Works with subject matter experts and instructional designers/developers to develop/ensure learning objectives are measurable and translate those objectives into the appropriate testing and/or assessment strategy
  • Knowledgeable and/or skilled at applying Kirkpatrick’s levels of evaluation in order to develop appropriate strategies for measuring learning outcomes
  • Develops behaviorally-related rating scales that emphasize job relevant competencies
  • Designs and develops job simulation exercises with behaviorally-based rating scales based on job competencies
  • Develops and utilizes paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations
  • Conducts Cut Score Workshops to determine the appropriate passing score for individual exam items and case studies and aggregates the cut score raters’ inputs to calculate the overall passing score for a specific exam.
  • Applies psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments of learning and behavioral objectives
  • Works with exam item statistics to conduct item analysis including, but not limited to, evaluation of distractor patterns, item difficulty, and item point bi-serial/corrected item total correlations, etc.
  • Maintains detailed records of the exams for the program regarding updates to exams and rationale for changes over time. Submits tickets in the Change Management System for tracking purposes and maintains detailed spreadsheets and reports for tracking purposes.
  • Effective communication, writing, documentation, and requirements gatherings skills are needed to be effective in this role for working with other members of the Team and with the Customer to meet the requirements of the contract.


Location:  Hanover, MD   


Degree:  Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with eight years of experience in workplace job performance assessments and/or evaluations. MS Degree in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) with ten years of experience in workplace job performance assessments and/or evaluations.


Clearance:  Positions require a Top Secret security clearance, based on current background investigation (SBI), as well as the favorable completion of polygraph.  Clearance and polygraph processing will be completed by the U.S. Government.


KeyW is an EEO employer. We are committed to providing fair and equal employment consideration, regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status or disability.


Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share to your network!

Need help finding the right job?

We can recommend jobs specifically for you! Click here to get started.