In Short
What started as an initial adoption of Google Analytics by their marketing team soon blossomed into a complete structural shift towards the Google Cloud Platform.
GCP’s Cloud Composer played an integral role in orchestrating workflows.
The goal was to update Cloud Composer to work efficiently instead of switching solutions.
They had the right tool but were using it the wrong way. It just needed fixing. It was so much more than tech stuff; we changed the culture and the strategy.
About Nemlig
Nemlig.com is an online supermarket with the most extensive catalogue of organic products. With more than 11,500 discounted and branded products, customers count on nemlig.com for easy and convenient deliveries.
The Problem
GCP’s Cloud Composer played an integral role in orchestrating workflows between warehouse and smaller hubs. However, the system’s efficiency was lacking, and the time it took to run workloads were significantly slow.
Cloud Composer helped create data and reports for managed performance-based and workload status dashboards made in QlikSense for the employees. Some essential workloads for employee performance, would begin early in the morning, yet not finish in time for the employees’ arrival to work.
The Goal
Update Cloud Composer to work efficiently instead of switching solutions.
The Solution
There were performed further calculations to set the correct size of worker nodes to facilitate the airflow configuration and resource consumption of the tasks being run on the system. It resulted in an astounding 4x improvement in run time. Now the Cloud Composer workloads have a one hour run time, a ¼ of the initial time it took to complete.
Methodology
Four times a week for the following six months, Devoteam implemented CI/CD on their existing code and build and monitor the new data foundation without causing internal interruptions or downtime. Changes reformed and improved their data structure.
The Result
Devoteam is considered to be a trusted advisor to nemlig.com. During COVID pandemic nemlig.com, like many online retailers, saw major increase in traffic. They were well equipped to manage costumers efficiently.
Without the right data infrastructure, they may have struggled to keep up with the demands in the first half of 2020.