Attunity Replicate Training

Attunity Overview Prepared for Stanley Black and Decker

Agenda
DAY 1 & 2 DAY 3

Introduction to Attunity Attunity for Db2 iSeries

Replicate Installation Hands-on – Task creation
Intro to the Replicate Console Attunity for MySQL (Aurora)
Attunity for Oracle Control Tables
Attunity for SQL Server Replicate Data Types
Attunity for SAP REPCTL and SQLite
Attunity for HANA Hands-on – REPCTL
Logstream Troubleshooting (Server Configuration)
Replication Tasks (Task Settings) Transformation (Table Settings and Global
DEMO: Basic Task Configuration Transformation)
Hands-on – Transformation

CONFIDENTIAL INFORMATION © 2017 Attunity

Introduction Attunity Replicate Training
In this Module we will discuss:
• Attunity Replicate Training Agenda
• Attunity Corporate Overview
• Product Overview
• Replicate
• Compose
• Visibility
• Challenges Addressed by Attunity
• Attunity Replicate Architecture

CONFIDENTIAL INFORMATION © 2017 Attunity

Attunity Corporate Overview

Global Organization Over 2000 Customers in 65 Countries

Financial Services Manufacturing / Industrials Health Care Government

EMEA
USA
APAC

Enterprise Data Management Technology / Telecommunications Other Industries

On Premise | Cloud | Across Platforms

• Accelerate data delivery across enterprise and cloud
• Empower rapid utilization of data by the business
• Continually optimize with intelligent insight

CONFIDENTIAL INFORMATION © 2017 Attunity

Attunity – Trusted Organization

• Trusted by Microsoft with 3 OEMs and for over 8 Years

• Trusted by Oracle with OEM for over 13 years
• Trusted by IBM with OEM for over 9 years
• Trusted by Amazon (AWS) as a technology partner
• Trusted by Teradata as a reseller for
Data Warehouse and Hadoop market

CONFIDENTIAL INFORMATION © 2017 Attunity

Enterprise Data Management – Needs

Right Data
Economically

Right Place Right User

Value

Right Time

Efficiently

CONFIDENTIAL INFORMATION © 2017 Attunity

Challenges addressed by Attunity

Integration across heterogeneous systems and new platforms are

complex and costly

Long time to deliver value due to manually intensive processes

Lack of adequate insight for better operational efficiency and cost

control

CONFIDENTIAL INFORMATION © 2017 Attunity

Introducing Replicate
Log based replication
• Only change data is read from transaction logs
• Reduces impact on the source database

Two modes of replication

• Full Load
• Automatically creates and loads the target

• Change processing (CDC)

• Captures changes in the source as they occur and applies to the target in near-
real-time.
CONFIDENTIAL INFORMATION © 2017 Attunity
Introducing Replicate
Attunity Replicate is high-performance data replication software.

• Web-based console and a replication server.

• Provided instantaneous visibility to current and historical status,
performance, resource usage, and exceptions data.

• Facilitates data replication from

• Enterprises databases, including Oracle, SQL Server, and DB2.
• Big Data platforms including Apache Hadoop, Teradata and Pivotal
Greenplum Database.

CONFIDENTIAL INFORMATION © 2017 Attunity

Attunity Replicate for Enterprise and Cloud
• Centralized control.
On Prem and Cloud.
• Amazon Web Services, Microsoft
Data Warehouse Azure, Google Cloud Platform
• On-Prem to On-Prem
RDBMS • On-Prem to Cloud
Hadoop • Cloud to On-Prem
Cloud Platform • Cloud to Cloud
• Wider breadth of sources and
On Premises targets
• Optimized, Hi-Speed data
RDBMS Hadoop transfer
• Data Compression
Data Warehouse
• Parallel/Concurrent data transfer
Sources Targets • Configurable batch sizes

CONFIDENTIAL INFORMATION © 2017 Attunity

Attunity Replicate Architecture

Web-based Designer and Management Console

Transfer
Cloud Cloud
In-Memory
Hadoop RDBMS Hadoop RDBMS
File Channel
CDC Incremental

Data Warehouse Data Warehouse

Filter Transform
Batch Batch
Files Mainframe Kafka Files

On-prem On-prem

Persistent Store

CONFIDENTIAL INFORMATION © 2017 Attunity

Data Ingest for Hadoop Data Lakes

Cloud Cloud
Attunity
Replicate
Hadoop RDBMS
CDC Incremental

Data Warehouse

Batch Batch

Files Mainframe

On- On-
prem prem
Persistent Store

CONFIDENTIAL INFORMATION © 2017 Attunity

CONFIDENTIAL INFORMATION © 2017 Attunity
CONFIDENTIAL INFORMATION © 2017 Attunity
The Sorter
The Sorter is a part of the CDC subtask
The purposes of the sorter is to:
• Retrieve events from the source, and sort CDC events by
transactions
• Handle different types of rollback operations
• Forward committed transactions to the target and handle apply
confirmations
• Store events, retrieved from the source in the swap files
• Handle task resume operation
• Count CDC statistics and the task latency
CONFIDENTIAL INFORMATION © 2017 Attunity
18
CDC – target side
Sorter always sending events to target when they are committed, and if they
should be sent to target
Sorter puts the events in a buffer (storage in memory) for the target to take
The target takes the events it needs , and applies them according to target
settings
Events are sent in order of commit
Control table events sent all the time

CONFIDENTIAL INFORMATION © 2017 Attunity

19
Automated data flow configuration
No manual coding or
scripting
• Automated end-to-end
replication
Hadoop Hadoop
• Target schema creation
• Heterogeneous data type
RDBMS
mapping
RDBMS
• Propagation of DDL across
EDW
• Batch to CDC transition
EDW
heterogeneous data systems
• DDL change propagation
Files
• Filtering Files
• Filtering and global
• Transformations transformations from source
Mainframe Kafka to target

CONFIDENTIAL INFORMATION © 2017 Attunity

Zero-footprint architecture
Lower impact on IT
• No software agents on
sources and targets for
mainstream databases
Hadoop Hadoop

RDBMS

• Log based
RDBMS
• Replicate data from 100’s of
EDW
• Source specific optimization EDW
source systems with easy
configuration
Files Files

• No software upgrades
Mainframe Kafka required at each database
source or target

CONFIDENTIAL INFORMATION © 2017 Attunity

Enterprise-class CDC
Flexible and optimized CDC
In Memory and File Optimized Data Transport options

SQL SQL SQL

• Transactions applied in real-
Transactional CDC n 2 1 time and in order
• Changes applied in
optimized batches
R1
R1
Batch CDC R2
R1
R1
R2
R2

• Integration with data

Data Warehouse
warehouse native loaders to
Ingest-Merge ingest and merge
• Message encoded streaming
Message Encoded
CDC
of changes (for Kafka
message broker)

CONFIDENTIAL INFORMATION © 2017 Attunity

Universal Integration with Attunity Replicate
One Pane of Glass – Any Major Platform

RDBMS DW Hadoop Cloud Mainframe SAP

Oracle Exadata Hortonworks AWS RDS Oracle DB2 for z/OS ECC on Oracle
SQL Server Teradata Cloudera AWS RDS SQL IMS/DB ECC on SQL
Sources DB2 iSeries Netezza MapR AWS RDS Postgres VSAM ECC on DB2
DB2 z/OS Vertica AWS RDS MySQL SAP HANA
DB2 LUW Greenplum Amazon Aurora
Other Legacy Files
MySQL & Percona Amazon Redshift
PostgreSQL SQL/MP Delimited (e.g.,
Sybase ASE Enscribe CSV, TSV)
Informix RMS
MariaDB

RDBMS DW Hadoop Cloud Streaming SAP

Oracle Teradata Hortonworks Amazon RDS Azure Event Hubs HANA

SQL Server Microsoft PDW Cloudera Amazon Redshift Kafka
Targets DB2 LUW Exadata MapR Amazon EMR MapR Streams
Kinesis
MySQL Netezza Amazon EMR Google Cloud SQL
Files
PostgreSQL Vertica Google Cloud MemSQL
Sybase ASE Sybase IQ Dataproc Delimited (e.g.,
SAP HANA Greenplum Azure SQL DW NoSQL CSV, TSV)
Azure SQL DB MongoDB
Azure HDInsight
Snowflake
S3

CONFIDENTIAL INFORMATION © 2017 Attunity

Optimized for Cloud data transfer
Attunity Replicate Server
High speed data transfer
Compress – Parallelize - Encrypt across data centers and
Cloud
• Support for Amazon Web
Services, Microsoft Azure
File Channel and Google Cloud
Attunity Replicate Server • Enabled by proprietary
Attunity ‘File Channel’
File Channel
Merge- Decompress • Uses compression to reduce
data and remove sparse
records
• Separates data in parallel
streams for optimal
transport over network
CONFIDENTIAL INFORMATION © 2017 Attunity
Supported OS Platforms

CONFIDENTIAL INFORMATION © 2017 Attunity

Summary
In this Module we discussed:
• Attunity Replicate Training Agenda
• Attunity Corporate Overview
• Product Overview
• Replicate
• Compose
• Visibility
• Challenges Addressed by Attunity
• Attunity Replicate Architecture

CONFIDENTIAL INFORMATION © 2017 Attunity

attunity.com