Alberto Asuero, Chief Technology Officer, CARTO
On premise data warehouses come with lots of benefits such as speed, security and improved governance. However, they’re not elastic and require complex forecasting to determine how to scale the next-generation data warehouse for future needs.
Over the last few years there has been a huge increase in uptake in the elastic cloud for data management. This has propelled companies like Snowflake from a ‘no name’ to a $12 billion leader overnight.
Alberto Asuero, Chief Technology Officer at CARTO, a geospatial company gave us his insights into the impact next-generation data warehouses on businesses.
Some of the issues that a data warehouse face: data integration, data views, data quality, optimization, competing methodologies, etc. Fortunately, data warehouse automation can flip this scenario completely on its head. In data warehouse automation, a data warehouse uses a next-generation technology for automation that relies on advanced design patterns and processes to automate the planning, modelling and integration steps of the entire lifecycle. It provides an efficient alternative to traditional data warehousing design by reducing time-intensive tasks such as generating and deploying ETL codes to a database server.
The Shift in Data Management
Alberto drew upon his own experiences with data warehouses and providers throughout the years. Looking at the CARTO spatial extension and the problems they faced, Alberto explained the shift in thinking from ‘Bring your data’ and CARTO will connect to it to the best solution ‘Bring your data warehouse’. This is because they can revamp a customer’s product by directly connecting to their data, rather than trying to synchronise data with large data sets. Additionally, the shift in practise means customers don’t need to move their data and so there is better security and compliance.
During the presentation Alberto gave a demonstration of data sets being linked to this software to provide quick and accurate geospatial maps that update in real time.
Consumers trust cloud vendors and next generation data warehouse platforms more than they would a specific application or software with their data. The ability to synchronise these two modalities together has created new opportunities for companies to expand and grow without incurring costs, additional security vulnerabilities, easily scalable and use of real time data.
To understand how to navigate the next-generation data warehouses, be sure to discover the SCOPE: Supply Chain, Procurement and Logistics Community >>