Author Archives: Ehsan Elahi

An Automated Approach to Modeling Your Slowly Changing Dimensions

Business data is inherently susceptible to change with the passage of time and impacts the business in different ways. In data warehouses, the effect of time on our dimensions and facts requires careful study for the repository to meet the business intelligence objective of delivering up-to-date information to decision makers.

Question is, how best to handle these changes?

Developing a dimensional model that captures the different states of your data with respect to time is a key objective of an Enterprise Data Warehouse. For measures in our fact tables, we can use date dimensions and link them using foreign keys. For dimensions, the complexity of handling changes increases greatly. Each step of the Slowly Changing Dimension (SCD) flow must be hand-coded using multiple, complex SQL statements. The implementation is lengthy and complex, and affects the business’ ability to maintain its data quickly and reliably – which is always a critical consideration.

Slowly Changing Dimensions in Centerprise

Compared to the traditional hand-coded approach to the slowly changing dimension flow, Astera offers an automated implementation using a completely drag-and-drop interface. Source data is mapped to an SCD object in Centerprise, which pushes system-generated SQL statements directly to the target data warehouse (Read: Pushdown Optimization Mode in Centerprise) based on the field layouts defined by the user. Each column in the user’s table can be designated as Surrogate Key, Business Key, SCD1, SCD2, etc. (see below) within the component’s properties in Centerprise. The platform handles the update strategy, performance considerations, routing, and complex joins automatically on the backend, as long as the SCD Field Types in below screen are defined correctly.

Field Layout - Slowly Changing Dimensions component

SCD Object Properties in Centerprise

Automating Type 1 & 2 Slowly Changing Dimension Implementation

Centerprise supports both Type 1 and Type 2 SCD to update records with and without maintaining history.

SCD Type 1

This type deals with updates in the dimensional table, for cases when preserving history is not a consideration and you need to replace the old values in your table with recent ones.

To use SCD Type 1 in Centerprise, you can mark your column as ‘SCD1 – Update’ in the Layout Fields menu of the SCD object in Centerprise, as seen in above screenshot for the ‘Contact Title’ column.

SCD Type 2

This type deals with changes in your dimension that need to be tracked. A new record is inserted with each change, and the existing record is marked as expired, by date, version, or status.

To use SCD Type 2 in Centerprise, mark your chosen column as ‘SCD2 – Update and Insert’, as seen in above screenshot for ‘ContactName’ column.

Push-Down Optimization

Once the layout is defined and flow executed, the Astera SCD transformation generates the SQL code necessary to compare, join, route, and insert data in your target dimension and pushes the transformation logic down to the database for processing.

Using this approach, the maintenance of large dimensions is significantly faster because all the processing is done by the database rather than the Centerprise server performing the operations and going back and forth between the database to read, compare, and write the data.

To learn more about the automated Slowly Changing Dimensions component in Centerprise and how to use it to manage your dimensions, download the white paper: How to Manage Slowly Changing Dimensions Using Centerprise.

Automate Partner Data Exchange and Integration through Astera’s Customer Portal

Effective business intelligence demands proper data collection and integration processes. Modern businesses receive data in different formats from a variety of communication protocols, when efficient collaboration and tracking of data exchanges are more important than ever before.

Partner Data Exchange and Integration Automation

Partner Data Exchange – Centerprise Data Integration Software

As data increases, the maintenance and management of multiple files from disparate sources takes its toll on IT teams. File based partner data exchanges need to be fast, reliable, and secure for transfers, especially on large-scale operations. Manual data entry and file exchange over channels like email aren’t sufficient anymore. Businesses need a centralized platform where customers, partners, suppliers, and employees can upload data files, ensure compliance, and track file status.

Enter the new Astera Cloud Customer Portal.

Key features include:

Centralized Uploading

Partners upload data files directly on the portal URL using their unique login credentials. Validation and cleansing take place automatically on the backend Centerprise server using custom integration flows. A response file is generated at the end for both the admin and users.

File Tracking

The Customer Portal comes with inherent file tracking: all involved remain up-to-date on file statuses in real-time via the Dashboard. For unsuccessful uploads, the response file contains error codes and explanations. Status emails can also be configured for all types of accounts. This ensures all necessary files are uploaded correctly after data validation, allowing the final workflow to run as scheduled.

Security

Secure Sockets Layer (SSL) and file encryption are supported on the Customer Portal. Uploaded encrypted files are automatically decrypted, processed, and then re-encrypted by Centerprise to be sent back.

Scalability

The Customer Portal is built to handle unlimited data volume and borrows on Centerprise’s powerful scalability. Cloud servers can also be added for reliable load balancing.

White Label Capability

Astera Cloud’s Customer Portal is customizable, with the ability to use your company logo and domain name. Get all the functionality of Centerprise while maintaining brand cohesion.

For a live demo and information on pricing for our partner data exchange and integration solution, call us at +1 888-772-7837 or email us at sales@astera.com