Data Engineering
What is Data Engineering?
The purpose of Data Engineering is to aggregate, merge, clean, transform and move data from different sources. This allows you to use the data as a single source of truth across the entire organization. Data Engineering enables you to respond quickly to ever-growing wishes regarding data and provide valuable insights. Having a single source of truth also makes it much easier to keep business logic consistent and track your data.
Why is it important?
Every day we produce 2.5 quintillion bytes of data. In other words, the volume of data is growing at an unbelievable rate. At the same time, you have many different source systems ranging from “on-premise” systems to solutions that run in the cloud. In addition, you often have all kinds of external data sources used in the decision-making process. To ensure that you can provide business processes with the correct and complete data, it is necessary that data from different systems are linked together. It is also important that the organization uses the same information everywhere. Data Engineering offers you the link between data sources and creates a single source of truth.
Rockfeather and Data Engineering
At Rockfeather, we ensure that all your data is up to date and available, creating a single source of truth for your organization. We differentiate between horizontal and vertical integration. Horizontal integration, for example, is moving data from your CRM application to your ERP application; this often is an event-driven process of moving data at the core of your company’s business. Vertical integration is moving data from your CRM application to a SQL Server to prepare the data for Data Visualization or Predictive analytics. These types of integrations refresh data more in bulk mode at set times during the day. We use a wide set of tools such as Azure Data Factory, Logic Apps, TimeXtender, and more. Do you want to know the difference between horizontal and vertical integration tools in the Microsoft portfolio? Have a look at this blog.
Our tools and standards
We use a best-in-class portfolio of toolsets. We continuously evaluate our portfolio and add new and promising solutions to our portfolio. Our current portfolio includes the following:
Horizontal
Vertical
In short
To be ready as a company to make truly data-driven decisions, having the right Data Engineering layer is essential. A good Data Engineering layer is flexible so that you can respond to changing sources and wishes and, at the same time, offers you the proper governance and structure.
Our Data Engineering Portfolio
Azure Data Factory
Azure Data Factory is a cloud based ETL and data integration service that enables data to be moved and transformed. Using Azure Data Factory, you can move data from many different sources and systems. If necessary, you can also transform the data and write it to a central point. This can then be monitored and properly maintained
Alteryx
Changing business through data science and analytics, Alteryx lets everyone in an organization feel the thrill of getting to the answer faster. The new, end-to-end analytics platform empowers analysts and data scientists alike to create, share, and prep data, perform analysis – statistical, predictive, prescriptive, and spatial – and deploy and run analytic models.
TimeXtender
TimeXtender is an integrated data management platform that enables you to build a modern data estate (data warehouse). With TimeXtender, you will not use a traditional working environment with many separate tools and manual scripts. It can be used in various data visualization tools like Power BI, Tableau, and Qlik.
Cases & Solutions
Data-driven insights with dashboards at ADO Den Haag
As a football club, ADO Den Haag is known for its green and yellow colours and the characteristic stork. However, what many people do not know is that behind the scenes ADO Den Haag is undergoing a true data transformation. The club wants to gain more insight into its performance through data, so that it can better anticipate and steer. The first step is the automation of manual overviews and the creation of dashboards in Power BI.
Data-Driven Account Management at ISS
ISS-Facility Services want to become the best service provider in the world. To become the best, they want to work with a number of its key-accounts based on a new business model, in which cooperation between partners is central.