Data Management

Being experts in the field of data managment, Viviente personnel are second to none when offering our services in data profiling, cleansing, migration, and bridging. Whatever data elements are encompassed in your modernization project, we know how to manage them.

Profiling and Cleansing

Data Profiling is used to identify key data elements, and to examine them for issues. It entails the automated and manual review of production data in order to establish metadata (information about data) about each critical data entity. This exhaustive analysis of each data element is subdivided into logical categories based on data usage.

Data Cleansing is conducted once data integrity issues have been identified. Issues can be remedied via manual or automated means, either in-situ (in the source database), as part of the data migration design, or, rarely, in the new system post-migration. Many public system data issues are very complex, and may require a mix of the above approaches.

Conversion and Migration

Data Migration encompasses all of the analysis, design, development and testing tasks necessary to stage, transform and migrate legacy data from its source systems to a modernized system. Data is typically migrated in phases corresponding to the phased implementation of a new system. Within each phase, the data migration work is subdivided into data categories much like during the data analysis and cleansing phases.

The Viviente ETL Engine
Our team uses a proprietary ETL engine based on Microsoft technologies that has been successfully deployed on previous projects for several years. The engine organizes, facilitates, audits and reports on migration and bridging migration processes.

Data Bridging

Data Bridging can be an extremely complex part of the overall data project. Once there are two production systems up and running, multiple bridge programs are needed to keep data in both systems in sync. Bridges can be forward (moving data from the legacy system to the new system) or backward (moving data from the new system back into legacy systems). They might need to be run on-demand, or might need to be scheduled to run nightly, weekly, or monthly. Bridge programs need just as much data transformation logic (or reverse transformation logic) as data migration programs do, but also require maintenance and support, reporting and reconciliation and, eventually, decommissioning planning.

Viviente’s team has expert-level experience in designing and implementing data bridging solutions to and from DB2 legacy databases and other systems.