Deliverable 9.1: TITAN EVALUATION PLAN

Executive Summary

This document presents a framework for the validation and assessment of the TITAN project in order to assess whether the project objectives have been met. The TITAN Draft Validation Plan closely follows the format of the CONVERGE Project TR110, Deliverable DVQ5.1 Guidebook Version 2.0.

The document gives an overview of the user needs, presents a description of the applications to be evaluated, formulates the assessment objectives and proposes the assessment categories, indicators and methods that can be used in the preparation of the Final Evaluation Plan.

Two applications have been identified for evaluation purposes. Both are related to the application of the Transmodel (TRM) data modeling framework for Public Transport (PT) in Public Transport companies.

These particular applications should be viewed in a broader sense than "software products with limited functionality". Application 1 is concerned with validating the realisation of Integrated Information Systems (IS) in the sites, which are based on the Transmodel approach. The emphasis is going to be given on the construction of integrated systems coupling together existing and possibly new software applications in one overall information management system and its validation, rather than aiming at the validation of the current Information Systems and their components. Application 2, is concerned with validating the use of Transmodel principles and architecture as the kernel of Information Systems for a PT company, and in particular in the design of interfaces between the different functions (software products) and a central data repository based on the Reference Data Model for Public Transport, Transmodel.

The current IS (without Transmodel) is the reference case for several aspects of the evaluation of Application 1. The Application 1 pilot may be considered successful in many aspects if the performance of the IS after completion of the TITAN project remains at the same level as before. Indeed, the current system works satisfactorily at present in relation to the functionalities supported by the different software products. However, key benefits, resulting from the implementation of a Transmodel-based company data base, (i.e. after the design and implementation of a Transmodel-based integrated system) are expected to be realised. These benefits include better data management, more reliable data exchanges between the different products, extended data availability, easier DB management etc.

As regards Application 2, the main assessment objective is to verify the adequacy of the conceptual data model (Transmodel) to actual on-site conditions. Evaluation in this case involves assessing the complexity of the adaptations required in order to generate an operational data base that conforms to Transmodel. The reference case here is Transmodel Version 4.1.

It has to be pointed out that by validating and evaluating positively the results of Application 1 there is automatically a positive precedent for the evaluation of Application 2 whose results depend on Application 1. However, the opposite is not true, i.e. if the results of the evaluation of Application 1 are negative this does not necessarily mean that the results of Application 2 will be negative. Indeed, the success of Application 1 depends upon several factors such as equipment, competence of software suppliers to carry out necessary adaptations, etc

top