TDWI DI&BD115 What’s New in PowerCenter v10?
Data Powers Business
100K+ Developers
Thank You 5000+ Enterprise Customers
What’s New in PowerCenter v10.0 and v10.1?
2
1 Developer Productivity
Better Data Management Visibility & Understanding
3 Self-service for Business
More Business Value ©2016 Informatica. Proprietary and Confidential
4
What’s New in PowerCenter v10.0 and v10.1?
1
Dynamic Mappings 2 SQL to Mapping JSON – REST Provider
Developer Productivity
Metadata & Connectivity
3 Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
5
What’s New in PowerCenter v10.0 and v10.1?
1
Dynamic Mappings 2 SQL to Mapping JSON – REST Provider
Developer Productivity
Metadata & Connectivity
3 Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
6
Greater End-to-End Data Integration Agility Old Way
No Business-IT Collaboration
Business Dissatisfied
Months IT
Business
IT
IT
IT
Requirements Gathering
Business-IT Collaboration
Develop Self Service
New Way
IT
Requirements Gathering
Business
Deploy
Business Satisfied IT
Business
IT
Business
Prototyping & Validation (Data Virtualization & Data Profiling)
IT
IT
Business
Graphical Development
Optimized Deployment
Proactive Monitoring
Automated Testing
Days
IT
IT
Support for end-to-end data integration maturity lifecycle 1. Jumpstart new projects 2. Scale with growing needs 3. Deliver on-going success ©2016 Informatica. Proprietary and Confidential
7
Dynamic Mappings Capability •
Mass Ingestion – build a template once – automate mapping execution for 1,000’s of source objects with different schemas automatically
•
Mapping self adjusts dynamically to external schema changes and column characteristics
Customer Benefits •
Accelerates project delivery through automation and reuse of data integration design assets
•
Reduces project risks by following best practices templates
New Productivity Add-on Package ©2016 Informatica. Proprietary and Confidential
New in v10.0
8
Dynamic Mappings Design Once
Rule-based ports and links, e.g., include all String ports
Generic Source and Target with varying schemas
Varying logic, e.g., apply masking for varying number of date fields in the Source
Execute for Multiple Sources/targets
New Productivity Add-on Package ©2016 Informatica. Proprietary and Confidential
New in v10.0
9
Today’s Mapping Challenges Mappings are tightly bound to schemas
Efficiency, Flexibility, Quality Change in metadata (data type, column, etc.) may involve manual changes to 100s of transformations and mappings
Difficult to parameterize – multiple mappings/workflows are created, tested, maintained for each Source New in v10.0 ©2016 Informatica. Proprietary and Confidential
10
Dynamic Mapping – Few Key Benefits Parameterization Source, Target, Port, Rules, etc.
N Mappings for N Sources Input Rules Propagate columns based on Rules
Dynamic Schema Mapping selfadjusts at run-time
1 Template for N Sources
Dynamic Expression E.g., LTRIM & RTRIM all String ports
Massive Developer Productivity Gain Fewer Production Issues
©2016 Informatica. Proprietary and Confidential
New in v10.0 11
What’s New in PowerCenter v10.0 and v10.1?
1
Dynamic Mappings 2 SQL to Mapping JSON – REST Provider
Developer Productivity
Metadata & Connectivity
3 Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
12
SQL to PowerCenter Mapping Converter Capability
• New wizard to convert SQL Select queries to PowerCenter mappings
Customer Benefits
• • • •
Reduces hand coding Increases maintainability Reduces load on the OLTP Increased metadata lineage visibility
New Productivity Add-on Package ©2016 Informatica. Proprietary and Confidential
New in v10.1
13
SQL to Mapping Converter select sum(l_extendedprice * (1 – l discount) ) as revenue from lineitem, parttbl where ( p_partkey = l_partkey and p_brand = 'Brand#12' and p_container in ( 'SM CASE', 'SM BOX', 'SM PACK', 'SM PKG') or ( p_partkey = l_partkey and p_brand = 'Brand#23' … and p_size between 1 and 15 and l_shipmode in ('AIR', 'AIR REG') and l_shipinstruct = 'DELIVER IN PERSON')
GROUP BY clause
JOIN clause WHERE clause
New in v10.1 ©2016 Informatica. Proprietary and Confidential
14
What’s New in PowerCenter v10.0 and v10.1?
1
Dynamic Mappings 2 SQL to Mapping JSON – REST Provider
Developer Productivity
Metadata & Connectivity
3 Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
15
REST Provider with JSON Capability
• REST web services Provider • Support GET operation with JSON input/output
Benefits
• Ready access to DW data and other enterprise data to REST consumer applications
New in v10.1 ©2016 Informatica. Proprietary and Confidential
16
REST Provider Example (GET method) Rest Provider Application http:// request GET CustomerID=15954283
GET Mapping
Web App
JSON Response
Filter pushdown CustomerID=15954283
Customer Master
Output
What’s New in PowerCenter v10.0 and v10.1?
2 Better Data Management Visibility & Understanding
Improved Metadata Manager Business Glossary Connectivity 3 to More Sources AWS & Amazon Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
18
What’s New in PowerCenter v10.0 and v10.1?
2 Better Data Management Visibility & Understanding
Improved Metadata Manager Business Glossary Connectivity 3 to More Sources AWS & Amazon Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
19
Metadata Manager Lineage Rendering Up to 50X Data Lineage Rendering Performance (using Graph Database)
Object 3 Nodes: 172205 Links : 185081
0.4 44.6
• Faster rendering for current •
environment Capable of scaling to much larger environments
Customer Benefits
• Provides end-to-end diagram of •
data flows and transformations Essential for change management
Object 2 Nodes : 184364 Links : 197547
v10 Lineage Time
0.6 46.6
Object 1 Nodes : 399267 Links : 431431
9.6.1 Lineage Time
3.8 82.3
0
20
40
60
80
100 New in v10.0
©2016 Informatica. Proprietary and Confidential
20
Metadata Manager Summary Lineage • Easy to understand, end-point level summary lineage • Switch between Summary and Detailed lineage seamlessly
Detailed Lineage
Summary Lineage ©2016 Informatica. Proprietary and Confidential
New in v10.0
21
Metadata Manager Tableau Server X-Connect
New in v10.0 ©2016 Informatica. Proprietary and Confidential
22
Fast Metadata Connector Creation Capability
•
Create a Metadata connector (XConnect) with an easy to use tool
•
Equivalent to “ODBC for Metadata Connectivity”
•
Works with all current metadata connectors
Customer Benefits
•
Easily build metadata connectivity to new sources New in v10.1 ©2016 Informatica. Proprietary and Confidential
23
Incremental Metadata Load Support for RDBMS Capability
• • RDBMS BI Tools Models Apps
Metadata Manager Repository
•
Relational XConnects will support full and incremental modes Only changed metadata artifacts are refreshed in Metadata Manager Supports: Oracle, MS SQLServer and Teradata
Customer Benefits
•
Improved lineage performance by extracting only changed artifacts from relational sources
•
Lesser load on source databases compared to a full extraction New in v10.1 ©2016 Informatica. Proprietary and Confidential
24
What’s New in PowerCenter v10.0 and v10.1?
2 Better Data Management Visibility & Understanding
Improved Metadata Manager Business Glossary Connectivity 3 to More Sources AWS & Amazon Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
25
Business Glossary Capability
•
Build and maintain a common business vocabulary
• •
Link to technical metadata Asset approval workflow
Customer Benefits
• • •
Improve communication between colleagues, local or remote Understand where data resides, and what policies and processes apply Achieve buy-in from business and process stakeholders
New in v10.0 ©2016 Informatica. Proprietary and Confidential
26
What’s New in PowerCenter v10.0 and v10.1?
2 Better Data Management Visibility & Understanding
Improved Metadata Manager Business Glossary Connectivity 3 to More Sources AWS and Azure Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
27
Hundreds of Connectors, For Any Data Source Big Data
Sales & Service
Marketing
Social Human Resources Analytics IT & Admin ERP & Financials Web Protocols & API
B2B
©2016 Informatica. Proprietary and Confidential
28
New PowerExchange Connectors in PowerCenter
SQL Data Warehouse Blob Storage New in v10.0 ©2016 Informatica. Proprietary and Confidential
29
What’s New in PowerCenter v10.0 and v10.1?
2 Better Data Management Visibility & Understanding
Improved Metadata Manager Business Glossary Connectivity 3 to More Sources Azure and AWS Data Visibility
More Business Value ©2016 Informatica. Proprietary and Confidential
30
PowerCenter in AWS and Azure Certified for deployment in cloud ecosystems
• Amazon AWS • Connectivity to Amazon Redshift, Amazon RDS, S3
• Certification of PC SE, AE for latest releases • Microsoft Azure • PC Azure SQL Data Warehouse connector, PC Azure Blob connector
• Certification for PC SE, AE for 10.1 releases New in v10.0 ©2016 Informatica. Proprietary and Confidential
31
What’s New in PowerCenter v10.0 and v10.1?
1
Self-service 2 Data Preparation for Business Users
Developer Productivity
Metadata & Connectivity
3 Self-service Data Prep for Business
More Business Value ©2016 Informatica. Proprietary and Confidential
32
Data Preparation (Rev) Capability
• Data-driven UI’s for business users to discover & prepare data for their needs Customer Benefits
• Self-service for business users with ITenabled connectivity
• Increased productivity • Business-IT collaboration - converting business analyst’s work to PC mappings
Data Preparation
New in v10.1 ©2016 Informatica. Proprietary and Confidential
33
Free Cloud Data Prep for PowerCenter Customers
PowerCenter Customers Get 12 Months Free*
*Restrictions Apply
©2016 Informatica. Proprietary and Confidential
34
PowerCenter Packaging Add-on Options
Premium Edition
Productivity
MORE Operational Confidence
Data Integration Hub
Advanced Edition
Advanced Transformation
MORE Enterprise Scalability
Standard Edition MORE Development Agility
Real Time Package
Includes all features of Standard Edition
Includes all features of Standard and Advanced Editions ©2016 Informatica. Proprietary and Confidential
35
Added capability in PC V10.0 v PC V9.6.x
Improved capability in PC V10.1 v PC V10
New / added capability in PC V10.1
What’s New in PowerCenter v10.0 and v10.1? OPTIONS
EDITIONS Premium Edition
NEW CAPABILITIES •
Added additional capabilities vs. v9.6.x for FREE
•
50x performance improvement in MM (graph technology)
•
New Dynamic Mappings to adapt to changing schemas
•
New approval workflow and voting for business terms
•
New data profiling visualization for deep business insight
•
Improved monitoring (bird’s-eye view) of system usage
•
Expanded connectivity for cloud sources
Greater end-to-end data integration agility
Operational Confidence Data Validation Testing
Proactive Monitoring
Advanced Transformations
Advanced Edition Enterprise Scalability Advanced Scaling (Enterprise Grid, Push Down, HA)
Metadata Manager / Business Glossary
Real-time Option (Real-time Engine)
Productivity Add-on Package
Data Integration Hub Add-on Package
Advanced Transformation Add-on Package
Standard Edition Data Integration Agility Partitioning
Relational, Batch, ODBC Connectors
100 Analyst Seats
Batch ETL
Basic Profiling
Rapid Prototyping
Real Time Add-on Package
©2016 Informatica. Proprietary and Confidential
36
Rapid Prototyping - Jumpstart/Accelerate Projects Instant Business-IT to Discover Data 1 Collaboration 2 Profile with Analyst Tool Patterns and Issues Business
Business
IT Common Repository
3 4
Fine-tune and Deploy Desired Solution in Days
Business
Prototype and Validate Results
IT Business Logical Data Objects
IT
IT CUSTOMER
ORDER
PRODUCT
…
Data Source Data Source Data Source Data Source 37 ©2016 Informatica. Proprietary and Confidential
Data Profiling - Profile and Understand Your Data
©2016 Informatica. Proprietary and Confidential
38
Improved Administration & Monitoring Bird’s Eye View Of Service Health & System Usage
©2016 Informatica. Proprietary and Confidential
39
Several Ways to Scale Data Integration High Availability Overview / Need • Need for relative availability • Ensure zero downtime deployment Benefits • Mitigate impact of failures to the app layer • Maintain resiliency from source to target • Reduce time lost due to external failures • Improve effectiveness of your team
Enterprise Grid Overview / Need • Need for horizontal scaling • Leverage resources in a grid Benefits • Optimize computing assets • Provide load balancing • Boost system performance • Reduce overall deployment costs
Pushdown Optimization Overview / Need • Offload processing from PowerCenter • Leverage processing power of database Benefits • Improve overall performance • Reduce data movement • Maintain metadata and lineage in PowerCenter
In addition to Partitioning now offered in Standard Edition ©2016 Informatica. Proprietary and Confidential
40
Real Time Web Services & JMS Messaging Support
• Integrate incoming data via continuous sessions • Process real-time web service requests • Real Time Engine includes: • JMS PowerExchange • Real-time Request response capabilities for
Web Services Hub • Option to add connectivity to Web Services, CDC and messaging/EAI
©2016 Informatica. Proprietary and Confidential
41
Data Validation An independent (black box) testing solution that provides
• Automation • Scalability • Repeatability • Auditability Improve data quality, reduce time and effort in testing.
©2016 Informatica. Proprietary and Confidential
42
Proactive Monitoring • Monitoring and Alerting Tool for PowerCenter Issues • •
• • •
Governance: In Development Operations: In Production
Pre-built & Extensible Rules to Monitor PowerCenter Delivers Alerts to people, dashboards and systems Out of Box Reporting – analyze/drill down into current historical ALERTs Improve SLAs, Data Trust, Reduce IT Time & Cost ©2016 Informatica. Proprietary and Confidential
43
Data Integration Hub Add-on for PowerCenter Accelerate Data Modernization
• More efficient data integration flows with publish/subscribe data hub functionality
• Wizards for business self-service • Visibility across data integration workflows • Replace redundant synchronizations with SaaS apps and other systems with a single sync and orchestrated data distribution to reduce time, costs and complexity
• Integrate PowerCenter, Informatica Cloud & Big Data Management through one system ©2016 Informatica. Proprietary and Confidential
44
Advanced Transformation Data Transformation – Comprehensive
PNR
©2016 Informatica. Proprietary and Confidential
45
End-To-End Data Integration Agility
2
1 Developer Productivity
Better Data Management Visibility & Understanding
3 Self-service for Business
More Business Value ©2016 Informatica. Proprietary and Confidential
46
Q&A ©2016 Informatica. Proprietary and Confidential
47
User Groups Informatica User Groups are a great way for • you to invest in your professional development and learn about new Informatica offerings.
LEARN MORE AT IW16 : Go to the Solutions Expo Informatica Pavilion / Ecosystem & Innovation Area:
• Local Chapter Leaders manage each IUG
• • •
online and via in person meetings
• • •
Network and Socialize
•
Discover how colleagues and peers use Informatica
•
https://network.informatica.com/welcome/
Find and share content, best practices & tips Learn about the latest technologies and solutions from Informatica
Talk to regional user group leaders Learn about meeting plans Join your regional user group
• When: • • •
Monday 6:00pm – 8:30pm Tuesday 10:45am – 2:15pm Wednesday 10:30am – 1:45pm
• Where: •
Moscone West Hall Level One ©2016 Informatica. Proprietary and Confidential
48
Other Sessions of Interest • Visit us at the Solution Hall to learn more about the latest innovations • Check out the Hands-on Sessions and Deep Dive Sessions • Enabling Self-Service Analytics…..” DI&BD320 • Increase Productivity and Automation…..”
DI&BD328
©2016 Informatica. Proprietary and Confidential
49
Thank You!
