Data Migration - Automation Tools DMF_v1.5
Data Migration - Automation Tools DMF_v1.5
Automation tools
Implementation
Extract Setup
Configuration Load Setup Data
Data
Configuration Auto
Analyzer Configurator
Extract Master
Master Data Load Master Data
EBS/PeopleSoft Data Oracle Cloud
(SaaS)
Data Migration
Transaction Data
Extract Tool Load Open
(Open Transaction,
Transaction Data Transaction Data
GL Balances)
Migration
Data Extraction Transformation Validations Import Reconcile
Strategy
FBDI
HDL
REST
Spreadsheet
EBS/PSFT
Data Extractor
ORACLE
Extract
Data Files Target Fusion
Cloud
Fusion Source
Data Extract Options Data Migration Framework
1. Batch - DMF Extractor – On Prem Extraction/SOAR (Transformation, Validation, Import and Reconcile)
2. Offline - Flat Files: For non Oracle Sources / Customer
provides data file/SOAR
3. Online – Direct connectivity to Source System (Fusion , EBS**)
Confidential – © 2020 – Oracle Internal
7
DMF Features
Migration
Data Extraction Transformation Validation Import Reconcile
Strategy
Deployment &
Docs and Artifacts Extraction Transformation Validations Import Reconciliation
Security
•Artifacts •Source •Mapping File •1900+ Prebuilt •Fusion Cloud •Field by Field •Deployment
•Mapping Details : •EBS •Multi Column Validations •SCM Comparison •Oracle Data
Source to Target •PeopleSoft •Many to Many •Mandatory •ERP •Reconcile against center
•Extraction Scripts •Fusion Transformation •Format •HCM Migration activity •Customer PaaS
•EBS •Third party (Flat •Schema Access •Fusion •Import Type •Source File vs •Security
•People Soft Files) for Advanced Configuration Fusion •OSSA Approved
•FBDI
•Reconciliation •Extraction Modes Transformation •Lookups •Reconciliation •SSO
•HDL
Scripts •Logical Report
•Offline •REST •PGP Encryption
•Fusion •Online Validation •AES Encryption –
•Rapid
•Fusion Validation •Extractor Tool for •Data Dependent Spreadsheet Batch mode
Scripts On Prem •Extensible •Load , Import and •Data Purged in
•Config •Validation Report Purge weekly basis
•Data Dependent •Error review &
Log for HDL
DMF
Extractor
Tool
Mapping
table
7. Oracle Consultant
1. Connects to 2. Executes a 3. Encrypt and 4. Consultant process 5. Consultant 6. Customer reviews migrates data to
Customer VPN / Extraction using Upload to the Data in DMF for places data files the data / cleans if
UCM(Automated by customer’s SaaS
Remote VDI and DMF Extractor or pre-validation and and pre- required and
Extractor tool) or Fusion. Data/ Error
fine tunes the SQL Developer. The transformation using validation report Approves the file for
CSV can be manually DMF Application. DMF /log Files will be
Query as per output of the and places the upload to Fusion
placed in agreed Automatically pulls placed in agreed
data rules and extraction scripts location ( SharePoint raw extracts in
data from UCM. CSV location for
transformation are a set of CSV , SFTP, Oradocs, the agreed
Files also can be Customer
files. Reviews the UCM) if extractor location
manually uploaded to Correction if any
count/data tool not used DMF if Extractor is not (SharePoint/Ora
data errors
used. docs /etc.)
Confidential – ©
9 9 2021 Oracle Internal/Restricted/Highly Restricted
Process Steps – non SOAR/Third Party Customer Oracle Consultant
Customer’s SaaS
Fusion
DMF Application
FBDI/ /
HDL/Other
Data
Templates
Mapping
table
7. Oracle Consultant
1. Oracle 2. Customer fills in 3.Filled templates 4. Consultant 5. Consultant 6. Customer review migrates data to
Consultant the data template as are placed in agreed generates CSV from places pre- the data / cleans if
location ( SharePoint customer’s SaaS
shares the per the required FBDI/HDL/Other Files validation report required and
/ SFTP/ Oradocs/ Fusion. Data/ Error
standard format or generates Template and uploads and places the approves the file for
UCM /) in DMF for pre- /log Files will be
templates to as CSV if volume is raw extracts in upload to Fusion
validation and placed in agreed
Customer to fill high the agreed
transformation using location for
in the data location
DMF Application. Customer
(SharePoint/Ora
Correction if any
docs /etc. )
data errors
Confidential – ©
10 102021 Oracle Internal/Restricted/Highly Restricted
Pre-requisites for Data Migration
• Agree on location for sharing data files – SharePoint/Oradocs/etc. Should be accessible by Consultant and
Customer.
• EBS DB Schema Credentials – Apps / Select access to standard tables
• EBS UI Access
• For Large/Complex Transformation and attachments extraction: Custom Schema in EBS to create Mapping
Tables, Packages , Function
• Connectivity to EBS
• (Recommended) -Customer VPN
• Remote Desktop / VDI
• Remote Desktop / VDI Prerequisites:
• Remote machine should be Windows OS – With min JRE 8 Installed , with min 8 GB RAM
• Mandatory Tools required in remote VDI: Microsoft Excel, SQL Developer , Notepad++. DMF Extractor Tool,
EBS Front End Access
• Optional Tools: SOAP UI, Postman , Winscp , ,Large Text Editor,
• Connectivity from VDI to Fusion Instances , EBS , Oradocs/SharePoint , Email
• Proxy Details if any – To connect fusion / EBS
• If VDI is shared between multiple consultants it should have required storage ,RAM, etc
DMF – Data Extract using DMF Extractor Client (Batch Mode)
2 3 Data Load
1 Data Extract Data Process
UCM
Data Fusion
Files Configs ESS
Oracle Logs
EBS DB
Web
Services
Fusion UCM
Data ESS
Files Transformation Services
User 1 Via Fusion UCM. No Logic & Mapping
Direct connection
DMF Client Tool Extracts Data
Files User 1 User 2
Fusion Database
• Oracle SSO Enabled. Oracle Hosted DMF can be accessed without any
• Not exposed in Public Internet and it can be prerequisite.
used only within Oracle network.
Prerequisites to deploy in Customer PaaS:
• Role Based Authentication , data access
controlled by Project level and user security Part Number: B90571 , DBCS Enterprise Edition
High Performance
• DMF Internally invokes standard Oracle Cloud
web services for import and Oracle cloud web Shape: OC5, 2 OCPU /16 GB Memory
services are secured with https TLS1.2 and Storage: 250 GB , OS: Linux
same https authentication is used. Recommended provisioning is to have DBCS and
• DMF does only outbound connection. Does SaaS in the
not exposes any data. No API are same data center region
enabled/exposed.
• No password is stored in DMF and it will be
entered in the tool at run time for processing.
• Auto provisioned in Oracle
DMF Extractor Client Tool - Overview
• Used to perform data extraction of EBS/Legacy data and push the extracted data to DMF Server for
further processing and migration.
• Standalone Light weight Java based tool can be installed on Windows Laptop/Desktop. (Similar to
SQL Developer)
• Can be used by consultant or customer to extract data
• Can connect to EBS over Customer VPN or can be installed on Customer remote desktop machine
which has access to EBS.
• Avoids manual task of running SQL in SQL Developer and eliminates transferring files over drives.
• Files are transferred via Customer Fusion UCM and encrypted.
Data Extraction – Extractor Tool - On Prem
20
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
ERP Coverage
• Work Structures • Assign Work • Salary Basis • Candidates • Goal • Course, Offering
• Worker Schedules • Basic Salary • Requisitions • Goal Plan Details
• Supervisors • Absence Entries • Element Entries • Candidate Job • Goal Plan Sets • Legacy Learning
• Contracts (Sick, Vacation • Element Entry Applications • Talent Profiles Items
etc.) Values • Learning Record
• Person Contacts • Content Items
• Pre-books • Payroll
• Department, • Education
Organization • Absence Relationships Establishments
Hierarchies Accruals • Bank, Branches • Rating Models
• DFFs, KFFs • Entitlements • External Bank
• External Accounts
Identifiers • Personal
• Users, Roles Payment
• Area Of Methods
Responsibility
(AOR)
General Ledger
25 Copyright © 2021, Oracle and/or its affiliates. All rights reserved.
Tool Usage
169 58
Projects in Last
Projects 6 months
19841 99
Migration Runs in Last
6 months Active Users
97 360
Migration Entities / Extraction
Objects/Entity Scripts
Groups
26 Copyright © 2021, Oracle and/or its affiliates. All rights reserved.
Projects where DMF used ( 169+)
28
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Access to Data Migration
Login to IP Portal (http://ip.oraclecorp.com/) & search for ‘Data Migration’. Click on link to the asset.
1. Navigate to Projects
3
Access
1 2
2. Click on New Project
1. Search for existing
Project OR
2. Create a New
Project
3. Click on Project
Settings
4
4. Once a New Project
is created, Project
Admin can manage
team members
5 5. Add Fusion Instance
and Source if
33 Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022 applicable
Migration Activities
34
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Migrate Data – Submit New Run
1. Navigate to Migrate
Data
1. Choose the
5
Migration Options
1 2. Select the Source
4 File
2 1. Upload File –
3 CSV,ZIP
2. Fetch Batch File –
On Prem Source
3. Online – Fusion
3. Enter Fusion
Credentials
4. Review the
Transformation,
Validation, Recon
Setting if applicable
5. Click on Submit Run
36 Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022
Migration Run - Validation
37
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Validations
1. Review the
Migration with
7 Summary of Run
2. Transformed Details
3. Validations
6 Summary
1 4. Fusion Import
2 3 4 5
Details
5. Reconciliation
Details
6. Ribbon Status of
every activity and
download the
respective files
7. Resubmit if
Required
39 Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022
Migrate Data – Validation Summary and Report
1
1. Entity level
Summary
2. Error Message wise
summary
2 3. Unique Data wise
error summary
1. Navigate Migrate
Data→ Entity →
Click on Entity to
1 open settings
2 2. Click on Entity
Validation
3 3. Add New Validation
or modify existing
4. Enter the validation
type and details
5. Save
4
42
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Entity Settings – Define Transformations
1. Navigate Migrate
Data→ Entity →
Click on Entity to
1 open settings
2. Click on Entity
Transformations
3 2
3. Add New
Transformation
3 4. New Transformation
Name
4
5. Upload mapping
File
5 6. Select columns to
be transformed and
save
1. Review the
transformation
details
2. Click to review the
transformed data
3. Advanced Script
based
Transformation can
1 be performed using
DMF DB Project
Schema via
2 SQL/PLSQL
45
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Migrate Data – Import Details
1. Navigate to Import
Run tab to review
Fusion Import
details
5 2. Review the Purge
Program Status
1 3. Review the Load
Program and log
3 4 files
4. Review the Fusion
2
Import Program and
log files
5. Download complete
Import Details
47
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Reconciliation
1. Suppliers
Already
imported
Data
Migration
•
•
Reconciliation Report with Status
Extract of Base Fusion Data(FBDI
Framework format)
Scenarios
2. Import &
Reconcile
Data
Migration
•
•
•
Reconciliation Report with Status
Extract of Interface Fusion Data
Extract of Base Fusion Data(FBDI
Suppliers Framework
format)
Migrate Data – Reconciliation
1. Navigate Migrate
Data→ Entity →
1 Resubmit Run
2. Click Recon Tab to
view standard
criteria
5
3. Change Recon
Criteria –
Add/Remove
2 Columns
4. Choose the recon
3 report
5. Submit Run
1. Click on
1 Reconciliation
3 Ribbon to view the
2 4 recon dashboard
5 2. Download the
Interface table
report
3. Download the
Fusion base table
report
4. Download Recon
report with Field
Level Comparison of
Source File and
Fusion
5. Reconciliation
Overview – Fully or
50 Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022
Partially Reconciled
Migrate Data – Reconciliation Details
1. Summary shows
1 which primary
columns got
reconciled and
unreconciled
columns
2. Could of records
Column level
3. Detailed Recon
2 3
details
52
Copyright © 2020, Oracle and/or its affiliates | Confidential: Internal/Restricted/Highly Restricted [Date]
Data Extraction – Offline ( for third party source or non SOAR)
1. Navigate Migrate
Data→ Entity →
Click on Entity to
1 open settings
2. Click on Entity
Extract Query
3. View and Modify as
2
per project
5 requirement
4. Apply Changes
5. View Scripts History
3
4
54 Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022
Data Extraction – Online
UCM
Fusion Source Data Fusion
ESS
Files Configs
Logs
Web
Services
Port: 443
:VPNaaS
Oracle
EBS ESS
Prod Programmatically Extracted Datafiles Services
Fusion Database
UCM
Data Fusion
Files Configs ESS
Oracle Logs
EBS DB
Web
Services
Fusion UCM
Data ESS
Files Transformation Services
User 1 Via Fusion UCM. No Logic & Mapping
Direct connection
DMF Client Tool Extracts Data
Files User 1 User 2
Fusion Database
• Used to perform data extraction of EBS/Legacy data and push the extracted data to DMF Server for
further processing and migration.
• Standalone Light weight Java based tool can be installed on Windows Laptop/Desktop. (Similar to
SQL Developer)
• Can be used by consultant or customer to extract data
• Can connect to EBS over Customer VPN or can be installed on Customer remote desktop machine
which has access to EBS.
• Avoids manual task of running SQL in SQL Developer and eliminates transferring files over drives.
• Files are transferred via Customer Fusion UCM and encrypted.
Data Extraction – Extractor Tool - On Prem
62
Copyright © 2021, Oracle and/or its affiliates | Confidential: Internal 8/23/2022
Please feel free to reach to know about DMF
Tool and DM Services
[email protected]
[email protected]
Thank You