Script:
Owner:
Subdir:
Blog ID: 64040601
Group ID: User ID:
 
Insider Learning N.. IT Better data quality with SAP Data Services: Q&A...
Narrow by Topic:
Quick Reply
Cancel
Page 4 of 4  •  Prev 1 2 3 4
Locked: Better data quality with SAP Data Services: Q&A with Ginger Gatling & Data Services gurus - June 13
12 months ago  ::  Jun 13, 2012 - 12:05PM #31
Corrie Brague
Posts: 11

Jun 13, 2012 -- 11:58AM, Scott Priest wrote:

What’s the timeline to get the data quality piece working, and what skills does the team need?


The timeline to implement data quality is dependent on the type and complexity of your data.  We have blueprints and wizards available to get your started quickly on common cleansing, matching, consolidation and enrichment use cases.  We have seen data quality implementations (production ready for real-time, point-of-entry data cleansing via the web) occur in a just over a week.  To leverage the data quality transformations in Data Services, the team should be familiar with the core concepts of data quality.  Chapter 8 of the Enterprise Information Management with SAP book (www.sap-press.com/products/Enterprise-In...) will help to achieve this.


The good news is that Data Quality routines for cleansing and matching are provided out of the box via transformations within Data Services.  No more custom programs/scripts for data cleansing/matching Smile.  For each transform, there are also transform configurations, which are preconfigured best practices in terms input fields, output fields and option configuration for a particular use case or type of data. 


In addition, Data Services Blueprints are available (scn.sap.com/docs/DOC-8820).  A blueprint is a sample SAP Data Services job that is configured with best practices to solve a specific scenario. Each blueprint is an end-to-end job that includes sample data and may be run in the customer environment with only a few modifications. Some jobs include batch data flows and some include real-time data flows; some jobs include party data and some include product data. Data quality jobs include structured data and text data processing jobs include unstructured data.


Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:11PM #32
Werner Daehn
Posts: 5

Jun 13, 2012 -- 12:04PM, Siddhu wrote:


When i try to save Data Flow in my Designer..I am getting the following error "Cannot Save the current Model"..I am using SAP Data Services 3.2





The first answer to that is, it should never happen. Never ever. It means that the textual representation of what you have drawn cannot be parsed again, so it could not read what it wants to save.


I haven't seen this error recently, not even in 3.2 but before there had been some hotspots like lookup_ext() and other elements called as new-function-call were not escaped properly or put under quotes because they are reserved words.



As it seems you can reproduce it, please send this info to support so we can fix that class of problem entirely.


Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:13PM #33
Corrie Brague
Posts: 11

Jun 13, 2012 -- 12:04PM, PaulRouthier wrote:

Is there a 'Preferred' approach to the use of Data Services when integrating with NW MDM or Master Data Governance (MDG) for Vendors and/or Customers re: Cleansing and de-duping?


 


Why yes there is, Paul. 


There is an integration provided for data quality management in SAP applications, specifically in SAP ERP, SAP CRM, NW MDM and SAP Master Data Governance.  The embedded solution is called SAP Data Quality Management, version for SAP solutions, and it provides a transparent, out-of-the-box data quality solution within SAP applications.


The key capabilities include address cleansing, address enhancements, and duplicate checking for customer and vendor data domains.  For example, as you enter a new business partner, vendor or customer in the SAP application, an immediate check is done to parse names, cleanse the address, and check for duplicates.


For more information, check out these product tutorials:  www.sdn.sap.com/irj/scn/elearn?rid=/webc...

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:15PM #34
Scott Priest
Posts: 70

Thank you all again for a great discussion. We have time for 1-2 more questions before the forum ends.

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:15PM #35
Scott Priest
Posts: 70

Could you provide a little more information about data matching and enrichment? How does that work?

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:17PM #36
PaulRouthier
Posts: 2

Are there any plans to 'beautify' the Match Results achieved in a Data Services Batch job to allow a 'User' to see the match results coming from the Defined Match Rules?

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:18PM #37
Corrie Brague
Posts: 11

Jun 13, 2012 -- 12:15PM, Scott Priest wrote:

Could you provide a little more information about data matching and enrichment? How does that work?


In terms of data matching, duplicate records often exist in one or more source systems. The goal of matching is to determine whether records refer to the same entity. This involves evaluating how well the individual fields, or attributes, of the records match each other. Data Services Data Quality Management matching capabilities allow you to use various fields for comparisons, to compare records in multiple directions, and then join the intersections. Data quality management employs powerful matching algorithms to account for data entry errors, character transposition, and other data inaccuracies to match records.


In terms of data enrichment or enhancment, the out of the box enhancement options in Data Services include:

  • Providing full international postal information
  • Assigning longitude and latitude information to records
  • Assigning geospatial information such as tax jurisdiction identifiers
  • Assigning gender and prenames

Data Services also supports using 3rd party referential data (e.g. demographic data) to enhance records via our matching capabilities.  Blueprints are available for some common data content providers.

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:26PM #38
Corrie Brague
Posts: 11

Jun 13, 2012 -- 12:17PM, PaulRouthier wrote:

Are there any plans to 'beautify' the Match Results achieved in a Data Services Batch job to allow a 'User' to see the match results coming from the Defined Match Rules?


With the Information Steward 4.1 release, there is a new business user UI to review match conflicts, to provide resolution on those conflicts and make changes to the master record within a match group.  The new Match Review capabilities include task managment and status reporting capabilities.


Match Review is available in the Information Steward 4.1 release currently in Ramp Up (for more information visit the SAP Information Steward 4.1 Ramp-Up Info Page at websmp101.sap-ag.de/~form/sapnet?_SHORTK... ).  To find out more information on Match Review in SAP Information Steward 4.1, check out the 4.1 Documentation (see instructions on how to access here wiki.sdn.sap.com/wiki/display/EIM/Docume...).

Quick Reply
Cancel
12 months ago  ::  Jun 13, 2012 - 12:29PM #39
Scott Priest
Posts: 70

Thanks to all who joined is in the Forum today. A digest of all the questions will be availabl here in the IT Forum and in Insider Learning Network’s IT Group.


You can find Ginger's contributions to SAPexperts here


Although this Forum is now closed, you can post your own questions at any time in the IT Forum. Simply log in to Insider Learning Network, go to the IT Forum and select the "New Thread" button at the top of the page.


For more on data management and SAP’s EIM roadmap, you can also listen in on our conversations with Ginger Gatling and EIM for SAP authors, with podcasts from Ginger Gatling on an overview of EIM, Ina Felsheim on data management and EIM, and Andreas Engel on SAP’s approach to ECM – all topics covered in detail in the EIM for SAP book.


And once again, thanks to SAP’s Ginger Gatling, Corrie Brague and Werner Daehn for taking these questions today. Thank you all for joining us! 

Quick Reply
Cancel
Page 4 of 4  •  Prev 1 2 3 4
Quick Reply
Cancel
    Viewing this thread :: 0 registered and 1 guest
    No registered users viewing

    Become a member of Insider Learning Network:

    - Receive alerts for upcoming Q&As

    - Post your questions and get answers from a trusted network of peers and industry experts

    - Download free Member-only Resources including sample articles, presentations, and book chapters