Showing posts with label BA. Show all posts
Showing posts with label BA. Show all posts

Wednesday, March 18, 2015

Slowly changing dimension

What are Slowly Changing Dimensions?

Slowly Changing Dimensions (SCD) - dimensions that change slowly over time, rather than changing on regular schedule, time-base. In Data Warehouse there is a need to track changes in dimension attributes in order to report historical data. In other words, implementing one of the SCD types should enable users assigning proper dimension's attribute value for given date. Example of such dimensions could be: customer, geography, employee.

There are many approaches how to deal with SCD. The most popular are:



  • Type 0 - The passive method
  • Type 1 - Overwriting the old value
  • Type 2 - Creating a new additional record
  • Type 3 - Adding a new column

  • Credit: http://datawarehouse4u.info/SCD-Slowly-Changing-Dimensions.html


    In order to manage Slowly Changing Dimensions properly and easily it is highly recommended to use Surrogate Keys in the Data Warehouse tables.
    A Surrogate Key is a technical key added to a fact table or a dimension table which is used instead of a business key (like product ID or customer ID).
    Surrogate keys are always numeric and unique on a table level which makes it easy to distinguish and track values changed over time.

    In practice, in big production Data Warehouse environments, mostly the Slowly Changing Dimensions Type 1, Type 2 and Type 3 are considered and used. It is a common practice to apply different SCD models to different dimension tables (or even columns in the same table) depending on the business reporting needs of a given type of data.













    Friday, February 13, 2015

    Learn Talend Data Integration Basics by a presentation

    Hi All,
    I have made a presentation for Talend in one of my session in few year back and now I want to share that with you.

    I believe this will help you lot to understand Talend Data Integration.

    Download Presentation

    Wednesday, February 4, 2015

    Charts in Pentaho Reporting

    Hi All,
    Today I want to show you the different variety of Charts can be made using this powerful tool.

    Pentaho Reporting supports following charts:
    • Area Chart by Line
    • Area Chart  
    • Bar Chart  
    • Bar Line Chart 
    • Bubble Chart by Line
    • DifferenceChart   
    • Line Chart  
    • Multi Pie Chart 
    • Pie   
    • Radar Chart  
    • Scatter Chart Date Param
    • Scatter XY Collector 
    • Waterfall Legacy  
    • XY Area Chart 
    • XY-Area-Line   
    • XY Bar Chart 
    • XY Line Chart
    Below are Chart Reports screen-shots:














    Pentaho Report Designer

    Overview:

    The Report Designer is a desktop reporting tool that provides a visual design environment to easily create sophisticated and rich reports. It is geared towards experienced and power users, who are familiar with the concepts and data-sources used.

    Transform all your data into meaningful information tailored to your audience with Reporting, a suite of Open Source tools that allows you to create pixel-perfect reports of your data in PDF, Excel, HTML, Text, Rich-Text-File, XML and CSV. These computer generated reports easily refine data from various sources into a human readable form.

    Download & Run:


    Prerequisites: Java

    First download the setup zip file, I explain for Linux & Windows for url:
    http://community.pentaho.com/projects/reporting/

    e.g. you downloaded the file "prd-ce-5.2.0.0-209.zip"

    now unzip it, using the command-
    $ unzip -qq prd-ce-5.2.0.0-209.zip

    move to directory report-designer/ (prd-ce-5.2.0.0-209.zip will extract this directory)

    To execute in Linux:
    $ sh report-designer.sh

    To execute in Windows:
    Click on report-designer.bat file

    Examples:
    Pentaho Report Designer comes with some good example reports. You can get idea from those as well.




    Some Report's Preview









    References:
    http://wiki.pentaho.com/display/COM/Pentaho+Reporting+Articles
    https://training.pentaho.com/instructor-led-training/business-analytics-report-designer-ba2000---2-days

    Thursday, January 29, 2015

    Talend Data Quality

    Today I'm going to demonstrate the sample results produced by Talend Data Quality (DQ) Tool. This gives us an idea how is DQ useful for you data migration projects.
    To save our time I added many screen-shots of resultant analysis, you will find more functional ideas of Talend DQ.
    Overview:

    Talend Data Quality is a data profiler tool that can help us to know our data more deeply. It supports database, csv, excel (file based) and MDM data connections for
    profiling and cleansing.
    Simple Use Case:
    Let say you have an excel file and you have to do a data migration task with that file. One way to start the task is open that file and check row by row the data of that file, select column and apply filters to check the redundant data, that is very time consuming work.
    Another way to do that, use Talend Data Quality tool and do the same task in some clicks with many other useful details.

    In short DQ can do the following tasks:-


    By using this Talend Data Quality we can get following details of our data:-
    (a) Catalog Analysis shows total number of rows, columns, indexes, view, keys and table listing with rows, keys and index.
    (b) Table Analysis show various table data details.
    ​Column Analysis: 


    Database Compare: