Caltrans D6/CHP Central Valley TMC - Archived Data Management Functionality

Subsystem Description

The Archived Data Management Subsystem (ADMS) collects, archives, manages, and distributes data generated from ITS sources for use in transportation administration, policy evaluation, safety, planning, performance monitoring, program assessment, operations, and research applications. The data received is formatted and tagged with attributes that define the data source, conditions under which it was collected, data transformations, and other information (i.e. meta data) necessary to interpret the data. The subsystem can fuse ITS generated data with data from non-ITS sources and other archives to generate information products utilizing data from multiple functional areas, modes, and jurisdictions. The subsystem prepares data products that can serve as inputs to federal, state, and local data reporting systems. This subsystem may be implemented in many different ways. It may reside within an operational center and provide focused access to a particular agency's data archives. Alternatively, it may operate as a distinct center that collects data from multiple agencies and sources and provides a general data warehouse service for a region.

Functional Area: Government Reporting Systems Support

Selects and formats data residing in an ITS archive to facilitate local, state, and federal government data reporting requirements.

IDRequirementStatus
1The center shall provide data from an ITS archive to federal, state, or local government reporting systems.Planned
2The center shall provide the capability to select data from an ITS archive for use in government reports.Planned
3The center shall provide the capability to format data from an ITS archive suitable for input into government reports.Planned
4The center shall support requests for ITS archived data from Government Reporting Systems.Planned
5The center shall provide the applicable meta-data for any ITS archived data to satisfy government reporting system requests. Meta-data may include attributes that describe the source and quality of the data and the conditions surrounding the collection of the data.Planned

Functional Area: ITS Data Repository

Collect and maintain data and data catalogs from one or more data sources. May include quality checks, error notification, and archive coordination.

IDRequirementStatus
1The center shall collect data to be archived from one or more data sources.Existing
2The center shall collect data catalogs from one or more data sources. A catalog describes the data contained in the collection of archived data and may include descriptions of the schema or structure of the data, a description of the contents of the data; e.g., time range of entries, number of entries; or a sample of the data (e. g. a thumbnail).Existing
3The center shall store the archived data in a focused repository that is suited to a particular set of ITS data users.Existing
4The center shall include capabilities for performing quality checks on the incoming archived data.Existing
5The center shall include capabilities for error notification on the incoming archived data.Existing
6The center shall include capabilities for archive to archive coordination.Existing
7The center shall support a broad range of archived data management implementations, ranging from simple data marts that collect a focused set of data and serve a particular user community to large-scale data warehouses that collect, integrate, and summarize transportation data from multiple sources and serve a broad array of users within a region.Existing
8The center shall perform quality checks on received data.Existing
9The center shall provide the capability to execute methods on the incoming data such as cleansing, summarizations, aggregations, or transformations applied to the data before it is stored in the archive.Existing
10The center shall respond to requests from the administrator interface function to maintain the archive data.Existing
11When data or a catalog of data is received from the archive, the center shall generate the requested data product for the users systems.Existing
12For archive data requiring financial payment, the center shall process the financial requests and manage an interface to a Financial Institution.Existing

Functional Area: On-Line Analysis and Mining

Advanced data analysis and mining features to support discovery of information, patterns, and correlations in large ITS archives.

IDRequirementStatus
1The center shall support the interface with Archive Data User Systems for requests for analysis of the archive data.Existing
2The center shall provide the capability to perform activities such as data mining, data fusion, summarizations, aggregations, and recreation from archive data. This may include multidimensional analysis, selective summarization and expansion of data details, and many other advanced analysis services.Planned
3The center shall receive the user’s systems requests and develop the request to retrieve the data from the archive.Planned
4The center shall respond to users systems requests for a catalog of the archived data analysis products available.Planned
5For archive analysis and data mining products requiring financial payment the center shall process the financial requests and manage an interface to a Financial Institution.Planned

Functional Area: Traffic and Roadside Data Archival

Collects and archives traffic and environmental information directly from the roadside for use in off-line planning, research, and analysis.

IDRequirementStatus
1The center shall manage the collection of archive data directly from collection equipment located at the roadside.Existing
2The center shall collect traffic sensor information from roadside devices.Existing
3The center shall collect environmental sensor information that from roadside devices.Existing
4The center shall respond to requests from the Archive Data Administer to input the parameters that control the collection process.Existing
5The center shall send the request for data and control parameters to the field equipment where the information is collected and returned.Existing
6The center shall record the status about the imported traffic and roadside data.Existing
7The center shall use the status information to adjust the collection of traffic and roadside data.Existing