Software Test Oracles

One of the most difficult things about software testing is determining whether or not the software's behavior is correct. The mechanism used to make that determiniation is called a test oracle. This course shows the kinds of oracles available and methods to use them.

Students completing this course will understand the role of oracles in software testing and the practical application of that knowledge.

Class Outline:

  • Foundational concepts in software  
    • Vocabulary 
    • Why test 
    • The impossibility of complete testing 
  • Why oracles are important 
    • Identify anomalous behavior (find bugs) 
    • Determine if additional investigation is warranted 
  • Relating program influencers with outcomes 
  • Eight types of oracles 
    • Complete 
    • Consistency 
    • Self-referential 
    • Heuristic 
    • Model-based 
    • Statisical 
    • External 
    • None 
  • Results comparison mechanisms 
  • Where results can be monitored and oracles applied 
    • Using architecture diagrams 
    • UI and API 
    • Other touch points 
  • Timing of generating and comparing expected outcomes 
    • Oracle generation 
      • Before 
      • During 
      • After 
    • Results comparison 
      • During 
      • After 
      • Asychronously 
Students completing this course will have been given a brief tour of the basic information needed to design, plan, and conduct black box testing.

PREREQUISITE: Work experience in software testing or development or a strong interest in the field combined with significant experience or course work with computers.

RECOMMENDED TEXT: Testing Computer Software, 2nd edition, Cem Kaner, Jack Falk and Hung Nguyen, Thomson Press.


Updated November 25, 2008

Copyright (C) 1995-2008 Software Quality Methods, LLC. All Rights Reserved.

If buttons at top or on the side of the page are not showing, click here to download free java software.