2.0 The M&S Project Lifecycle: A Phased Implementation Framework
A structured, phased lifecycle is essential for managing the complexity of M&S projects and ensuring a successful outcome. This framework provides a disciplined pathway that guides teams from the initial concept to the final implementation and documentation. By breaking the project into distinct phases, it ensures that critical activities are performed in a logical sequence, objectives are clearly defined, and the final model is a credible, validated tool for decision-making.
2.1 Phase 1: Problem Formulation and Scoping
This initial phase is foundational to the entire project. Its purpose is to establish a clear and unambiguous understanding of the problem to be solved and the scope of the simulation effort. The team must rigorously define the system, its boundaries, and the specific objectives the model is intended to achieve.
A project manager should be able to answer the following critical questions before proceeding:
- What is the specific problem with the existing system or the core requirement of the proposed system?
- What are the key factors, limitations, and assumptions of the system to be modeled?
- What is the formal problem statement that will guide the project?
2.2 Phase 2: Data Collection and System Analysis
With a clear problem statement, the project moves to gathering the empirical data needed to build an accurate model. This phase is critical, as the quality of the model’s inputs directly determines the reliability of its outputs. The goal is to collect comprehensive data that represents the real-world behavior of the system.
Key activities in this phase include:
- Observing the real system to understand its performance and the interactions between its components.
- Collecting data from the real-life system to inform input variables and system parameters.
- Processing the collected data into a usable format that can be fed into the simulation model.
2.3 Phase 3: Model Design and Development
In this phase, the conceptual understanding and collected data are translated into a functional simulation model. This architectural process involves defining the model’s core components: the system entities, input variables, performance measures, and the functional relationships governing their interactions. The team must choose the input variables, create operational constraints on those variables, and determine the specific output variables that will measure the system’s performance.
Input variables are categorized into two distinct types that must be clearly defined:
| Variable Type | Description |
| Decision Variables | Variables that are controlled by the programmer or analyst. |
| Uncontrollable Variables | Random variables inherent to the system. |
During this phase, the team must develop a flowchart or network diagram that illustrates the logical progression of the simulation process, providing a clear map of the model’s architecture and operational flow.
2.4 Phase 4: Verification and Validation (V&V)
Verification and Validation (V&V) is a critical quality assurance process that ensures the model is both built correctly and is a sufficiently accurate representation of the real system for its intended purpose. It establishes the credibility of the model as a decision-making tool.
- Verification is the process of confirming that the simulation model has been built correctly according to its design specifications. It is often described as “building the model right.” It ensures the model’s implementation is free from errors and aligns with its conceptual description.
- Validation is the process of determining the degree to which the model accurately represents the real-world system within the context of the project’s objectives. It is often described as “building the right model.” It ensures the model’s results are fit for their intended purpose.
Verification Techniques
- Using programming skills to write and debug the program in sub-programs.
- Using a structured walk-through policy where more than one person reads the program.
- Tracing intermediate results and comparing them with observed outcomes.
- Checking the simulation model output using various input combinations.
- Comparing the final simulation result with analytic results.
Validation Techniques
- Designing the model for high validity through continuous discussion with system experts and interaction with the client throughout the process.
- Testing the model’s assumption data quantitatively and performing sensitivity analysis to observe the effect of changes in input data.
- Determining representative output by comparing simulation results with real system output. This often involves formal statistical methods, such as the chi-square test or Kolmogorov-Smirnov test, to quantitatively assess the model’s accuracy.
2.5 Phase 5: Experimentation and Analysis
Once the model is verified and validated, it becomes a powerful laboratory for experimentation. This phase is not an informal process of changing variables, but a structured and formal investigation. It begins with selecting an appropriate experimental design that defines the runs to be executed. The project team then induces specific experimental conditions on the model, systematically manipulating input variables to observe the impact on performance measures. By performing these controlled experiments, the team can rigorously analyze system behavior, test hypotheses, and identify the optimal solutions to the problem defined in Phase 1.
2.6 Phase 6: Documentation and Implementation
The final phase focuses on documenting the project and applying its findings. Comprehensive documentation is crucial for future use, maintenance, and comprehension of the model. The results from the experimentation phase are then translated into actionable recommendations and applied to the real-time system.
The final model documentation must include the following components:
- Objectives
- Assumptions
- Input variables
- Performance details
This structured process provides a clear path from an initial question to an implemented solution, but the decision to embark on this journey requires careful strategic consideration.