BI ON THE CHEAP Mark Griffiths Griff & Jones Ltd.
AGENDA Let s demystify BI The business case for business intelligence To OLAP or not to OLAP BI Tools you may already have Data storage to drive decision support Information analysis Distributing Intelligent information How we can help
LET S DEMYSTIFYBI What is Business Intelligence(BI)? BI is an umbrella term to describe concepts and methods to improve business decision making by using fact-based support systems Technologies and practices which help business better understand commercial information Provides historical, current, and predictive views of business operations Aims to support better business decision-making by providing relevant, accurate and accessible information
LET S DEMYSTIFYBI OLAP stands for online analytical process: Uses a database which is structured in such a way to optimise analysis of business information Tool which utilises a multidimensional data model, allowing for complex analytical and ad-hoc queries with a rapid execution time OLTP stands for Online transactional process: Use a database which is structured for effective transactional processing. Systems that facilitate and manage transaction-oriented applications, typically for data entry and retrieval transaction processing, such as legacy ERP systems.
LET S DEMYSTIFYBI What is a Data Warehouse? Provides data storage which is structured and organised for the flow of data from operational systems to decision support environments. What is a Datamart? Typically a subsection of an data warehouse or organizational data store, usually oriented to a specific purpose or major data subject, that may be distributed to support business needs.
LET S DEMYSTIFYBI What is multidimensional analysis? Provides useful insight into your information by providing multiple perspectives within a hierarchical structure. Is a data analysis process that groups data into two basic categories: data dimensions and measurements. Dimensions are grouped information structured in levels. Measures are data values of statistical interest Collection of dimensions and measures is called cube US Canada Mexico 456 234 568 567 678 789 112 122 221 [1997] [1998] [1999]
DATA STORAGE TO DRIVE DECISION SUPPORT Using Multidimensional analysis 4.Filtering 1.Multidimensional analysis Demonstration 3.Dragging and Dropping 2.Slicing and Dicing
THE BUSINESS CASE FOR BUSINESS INTELLIGENCE Increase Decision Making Ability Structure information in a more intuitive and meaningful way Provides a consistent view of your information. Empowerment Of Users by BI analysis tools rather than static reports Increase data reach Store historical information
IMPLEMENTING BI Storage OLTP sources but you limited Using a Data warehouse database as a central source for all business information Then a big technological, skills and cost leap.. Store information in a OLAP multidimensional tool Data Analysis Microsoft Excel 2007 provides excellent BI analysis features Distribution Microsoft Sharepoint Server 2007 and Excel services
TO OLAP OR NOT TO OLAP!!! Using a OLAP multidimensional tool such as Microsoft Analysis Services ( included in Microsoft SQL 2000) means BI becomes expensive: Disadvantages: Requires unique skills which are not widely available Develop a dimensional data architecture Advantages: Advance BI technologies such as data mining and predictive analysis available Delivers rapid analysis of large volumes of information
TO OLAP OR NOT TO OLAP!!! Use a data warehouse with BI analysis tools. Disadvantages: Aggregation of measures will happen on client and will be slower and there is a limit to volume of information to analysis. It s as fast as a crystal report and handles a couple of 100,000 s reasonably comfortably Advanced BI techniques not available Advantages: Microsoft SQL skills widely available A data warehouse is scalable up to a multidimensional tool
BI TOOLS YOU MAY ALREADY HAVE Tool BI functionality type Factors Microsoft SQL Sever 2000 Storage Used with Fourth Shift V7.11-V7.4 Microsoft SQL skillsare widely available Microsoft SQL Sever 2005 Storage Used with Fourth Shift V7.4+ Microsoft Analysis services 2000(DTS) Storage Specific set of skills Microsoft Analysis services 2005(SSIS) Storage Microsoft Excel 2003 Analysis Limited BI analysis functionality Microsoft Excel 2007 Analysis Sharepoint Services Distribution Comes with Windows Server 2003 Sharepoint Server 2007 Distribution
DATA STORAGE TO DRIVE DECISION SUPPORT Using a Fourth Shift database(oltp) directly Technical Fourth Shift business foundation views phase 1+2 Business foundation views phase 2 is important for historical data analysis Use data view templates for help building your own business SQL data view Use import and export wizards to get you going with DTS Use SQL OLE DB service provider to provide information to client Can use SQL non-clustered indexes to optimise performance with care Best practise Build a business SQL data view library using the business foundation views Relatively simple to utilise information from other data sources and systems Using inbuilt SQL data connection service providers it is almost seamless to use Microsoft office products with Microsoft SQL Server Considerations Fourth Shift is a OLTP system and locking and performance issues will prohibit scalability Limited ability to improve performance using optimisation techniques Complex queries are slow to execute It is adventurous to fully document your business data view library removing confusion and stops re-creation of views
DATA STORAGE TO DRIVE DECISION SUPPORT Using the Fourth Shift SQL database directly 1.Fourth Shift business foundation views Demonstration 3.Using SQL connection providers with Microsoft office products 2.Importing data into SQL from other sources
DATA STORAGE TO DRIVE DECISION SUPPORT Creating your own Data Warehouse database Technical Use SQL Data transformation services for the ETL process (use import\export wizard initially) Information can transferred at regular intervals throughout the day SQL record changes can be picked by using the version field on every Fourth Shift table Fourth Shift Update, delete and insert transactions can be identified and replicated in business information database Same process can be utilised with Fourth Shift history Best Practise Use your business data view library Define the structure of your business information database using some OLAP principals Use information from other sources Information can be updated at regular intervals for example every 5 minutes emulating real-time Can be used for all you business analysis required including multidimensional analysis, reporting and ad-hoc information requests Considerations A solution for locking, performance and scalability issues of using Fourth Shift directly Use all SQL database design techniques to optimise data retrieval such as indexing and links Fully documenting your business information database will stop confusion and recreation of database objects
DATA STORAGE TO DRIVE DECISION SUPPORT Using Microsoft SQL Analysis service 2000 Establish a database using dimension architecture which utilises your data warehouse BI Accelerator dramatically speeds up the process of creating a multidimensional cube in Microsoft Analysis services Griff & Jones have developed a product which interfaces between Fourth Shift( or data warehouse) and the Microsoft BI Accelerator tool. Microsoft Analysis services and DTS has been radically changed and improved in Microsoft SQL 2005
DATA STORAGE TO DRIVE DECISION SUPPORT Using Microsoft SQL Analysis service 2000 Source Systems Analytics Builder Analytics Builder Workbook Fourth Shift BI Interface ETLM Process Staging Db Raw tables Structured Validated DTS Subject Matter Db Snowflake schema Update processing DTS KPI s Cubes Special calculated measures (KPIs) Built-in partitioning by time (optional) OLEDB for OLAP UI Standard Reports Various client tools supported
INFORMATION ANALYSIS Using Excel 2007 for BI Why use Excel 2007 for a BI analysis tool? New User interface utilises ribbons which make usage easier and more visual New office excel 2007 supports up to 1,048,576(65,536) rows and 16,384 columns(256) Regardless of where the data is coming from you can interrogate your information in a multidimensional way Pivot report and charts provide BI analysis capabilities Office 2003 is lacking BI functionality with limited: Filter, sort, grouping and presentation features No calculation field features
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: Access you information in Microsoft Excel Functional Steps Select Data Tab-Get External Data Group-From Other Sources command and select From SQL Server Select SQL server name Select SQL database Select SQL table or dataview Create a friendly name for connection Connection file (odc) is produced Import data table or Pivot table or chart
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: View data from different perspectives with a few clicks with Pivot tables or charts
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: Navigating around a Pivot Table Functional Steps Observe the layout layer and Pivot table field list Fields without numbers(labels) are placed to the left and numeric field to the right automatically when fields are selected If you click outside of the layout area (of a PivotTable report), the PivotTable Field List goes away
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: How can I start answering business questions Functional Steps What product provides my business with the most turnover? Which businesses order this product? What type of customers use this product The PivotTable field list enables you to drag and drop fields to define the layout Notice the effect dragging and dropping fields around the row label, column label,value and report filter list boxes
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: How about trends analysis over time Functional Steps Add date field to PivotTable In Options tab-group group-click Group Field. In the Grouping dialog box, select Years,Quarters,Months. Use the Field selection list to move time labels to column labels to track trends Drag and drop time labels into field selection list
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: I want to look at specific information Functional Steps Click the arrow next to column label and select field to apply filter. How to filter: Select from field list Select labels in the PivotTable and right click to apply filter to selected label Select a field from field selection list How to sort: Select labels in the PivotTable and right click to apply sort Select a field from field selection list
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: Creating your own calculations Functional Steps Can alter the way information is summarized Select labels in the PivotTable and right click to Summarise by other method Select other options to summarise data by a % or other value To create a calculated field go to Options tab-tools group-formulas command calculated field option Select field name and formula
INFORMATION ANALYSIS Using Excel 2007 for BI Business requirement: How can I tidy my report to present to others Functional Steps Alter all row label names Apply a table format Move to page layout and add a header to report and alter page layout Add a Pivot chart with options tab- Tools group
DISTRIBUTING INTELLIGENT INFORMATION Distributing with Sharepoint DELIVERY END USER TOOLS AND PERFORMANCE MANAGEMENT APPLICATIONS BI PLATFORM (RDBMS, ETL, OLAP, Reporting) Mainframe/ Department al Systems
DISTRIBUTING INTELLIGENT INFORMATION Excel services in Sharepoint Server 2007 New server technology included in Microsoft Office SharePoint Server 2007 This shared service enables you to load, calculate, and display Excel workbooks on Office SharePoint Server 2007 You can easily reuse and share Excel workbooks on Office SharePoint Server 2007 portals and dashboards The Report Center feature in Office SharePoint Server 2007 includes a business intelligence portal and dashboard functionalities You can also analyze, pivot, and interact with data using Excel Web Access
DISTRIBUTING INTELLIGENT INFORMATION Excel services in Sharepoint Server 2007
DISTRIBUTING INTELLIGENT INFORMATION Excel services in Sharepoint Server 2007
How can Griff & Jones Help? Fourth Shift data manipulation and building your business view library Establish your business Data Warehouse OLAP principals training Microsoft Excel 2007 BI training Microsoft Analysis 2000/2005 services Microsoft Sharepoint services
Enterprise Support Programme ANY QUESTIONS?