SAP Data Services 4.x Cookbook

封面

版权页

Credits

About the Author

About the Reviewers

www.PacktPub.com

Support files eBooks discount offers and more

Preface

What this book covers

What you need for this book

Who this book is for

Sections

Conventions

Reader feedback

Customer support

Chapter 1. Introduction to ETL Development

Introduction

Preparing a database environment

Creating a source system database

Defining and creating staging area structures

Creating a target data warehouse

Chapter 2. Configuring the Data Services Environment

Introduction

Creating IPS and Data Services repositories

Installing and configuring Information Platform Services

Installing and configuring Data Services

Configuring user access

Starting and stopping services

Administering tasks

Understanding the Designer tool

Chapter 3. Data Services Basics – Data Types Scripting Language and Functions

Introduction

Creating variables and parameters

Creating a script

Using string functions

Using date functions

Using conversion functions

Using database functions

Using aggregate functions

Using math functions

Using miscellaneous functions

Creating custom functions

Chapter 4. Dataflow – Extract Transform and Load

Introduction

Creating a source data object

Creating a target data object

Loading data into a flat file

Loading data from a flat file

Loading data from table to table – lookups and joins

Using the Map_Operation transform

Using the Table_Comparison transform

Exploring the Auto correct load option

Splitting the flow of data with the Case transform

Monitoring and analyzing dataflow execution

Chapter 5. Workflow – Controlling Execution Order

Introduction

Creating a workflow object

Nesting workflows to control the execution order

Using conditional and while loop objects to control the execution order

Using the bypassing feature

Controlling failures – try-catch objects

Use case example – populating dimension tables

Chapter 6. Job – Building the ETL Architecture

Introduction

Projects and jobs – organizing ETL

Using object replication

Migrating ETL code through the central repository

Migrating ETL code with export/import

Debugging job execution

Monitoring job execution

Building an external ETL audit and audit reporting

Using built-in Data Services ETL audit and reporting functionality

Auto Documentation in Data Services

Chapter 7. Validating and Cleansing Data

Introduction

Creating validation functions

Using validation functions with the Validation transform

Reporting data validation results

Using regular expression support to validate data

Enabling dataflow audit

Data Quality transforms – cleansing your data

Chapter 8. Optimizing ETL Performance

Introduction

Optimizing dataflow execution – push-down techniques

Optimizing dataflow execution – the SQL transform

Optimizing dataflow execution – the Data_Transfer transform

Optimizing dataflow readers – lookup methods

Optimizing dataflow loaders – bulk-loading methods

Optimizing dataflow execution – performance options

Chapter 9. Advanced Design Techniques

Introduction

Change Data Capture techniques

Automatic job recovery in Data Services

Simplifying ETL execution with system configurations

Transforming data with the Pivot transform

Chapter 10. Developing Real-time Jobs

Introduction

Working with nested structures

The XML_Map transform

The Hierarchy_Flattening transform