Mark Edmondson: Pioneering the Future of Data Engineering

In this series, we put the spotlight on Devoteam G Cloud’s experts, who are always at the forefront of driving progress in the exciting and rapidly evolving Google Cloud world. Meet Mark Edmondson, Principal Data Engineer at Devoteam G Cloud Denmark. With a strong background in data engineering and expertise in Google Analytics and Google Cloud Platform, Mark brings a wealth of knowledge and experience to the table. In just six months at Devoteam G Cloud, he has made a remarkable impact. Let’s dive into Mark’s journey and discover what makes his role as a data engineer truly captivating.

The First Steps at Devoteam G Cloud

Joining Devoteam G Cloud Denmark as a Principal Data Engineer has marked a milestone in my career. I have been involved in Google Cloud Platform since 2010 via my work with Google Analytics, BigQuery and then accelerated into the whole cloud suite when I was accepted into the Google Developer Expert (GDE) program. This helps aid in the development of Google Cloud offerings by providing feedback and writing user guides. 

Devoteam G Cloud brings me the opportunity of working on cutting-edge projects that expands both my skills and knowledge. I am motivated by staying at the forefront of emerging trends and technologies so that I can continuously learn and grow. These past months have demonstrated to me how Google and Devoteam set the pace, move together, and go big at Devoteam G Cloud.

Working with Google’s Customers Engineers

We work closely with Google and conversations with Google’s customer engineers are sparks of inspiration. Their insights, coupled with our understanding of our client’s needs, allow us to craft tailored solutions that exceed expectations.

Embracing the Journey of Data Engineering

My role revolves around optimising Google Cloud’s data capabilities to empower our clients, pushing boundaries and constantly striving for excellence.

My story as a Principal Data Engineer at Devoteam G Cloud continues to develop. Every day brings discoveries and challenges. The adventure never ceases, and I embrace every twist and turn that lies ahead.

The Power of Collaboration across countries

Collaboration is the fuel at Devoteam G Cloud. From day one, I recognised that knowledge sharing and the synergy between teams were the pillars of our success. Here, collaboration isn’t limited to formal meetings or structured conversations. It thrives in spontaneous moments, brainstorming sessions, and exchanges over a cup of coffee.

I’m part of the Data Tribe at Devoteam, a group of masters in building big data solutions, whether that’s a centralised data warehouse or a distributed data mesh. Interacting with these Data colleagues from different locations allows me to gain fresh perspectives and have interesting conversations about Google Cloud tech, projects & new features.

Diving Into the Tasks

The Cellpoint project marked my first month here. The mission was to transform the travel industry with an avant-garde payment transaction service. As the principal data engineer, I spearheaded the designing and implementation of a dynamic data stream, optimising processes and enhancing customer experiences. Armed with Google Cloud’s robust infrastructure, including Google Kubernetes Engine (GKE), BigQuery and Looker, my team and I built a solution from the ground up.

The Cellpoint Project

Devoteam partnered with Cellpoint Digital to create a new modern application stack on the Google Cloud Platform with the goal to set turbo on CellPoint Digital’s growth ambitions. The new platform is much more scalable and has the flexibility to adjust to customer’s future demands, moving billions of dollars annually. Read more about this story here. 

Being part of this project has been quite the journey. Together, we are revolutionising payment transaction services in the travel industry, with a specific focus on airports, hotels, and international travel. From the very beginning, we embarked on this endeavour, building on Google Code and harnessing the immense capabilities of Google Kubernetes Engine.

Cellpoint is on the verge of becoming Denmark’s foremost Kubernetes customer, and I’m proud of my contributions to its success and shaping the data component.

Staying Relevant In the Field

Setting the pace in my role involves several strategies. Internally, we utilise Confluence to document useful information for others and share best practices. I also stay updated with the latest news and updates through sources like Twitter and LinkedIn, following experts in relevant fields. If I find anything interesting, I ensure it’s shared with the team. Lately this also means using an internal chatbot, which uses large language models to help distil information out of complex documentation.

The Data Tribe’s Biggest Challenge

In terms of challenges, one aspect is juggling different responsibilities and managing time effectively. We have current work targets to meet, but also need to win work for ourselves after our current project finishes, which often involves pushing ourselves to identify what clients need help with. It can be difficult to determine the best use of time, for instance deciding which meetings you are invited to that may or may not be relevant. 

Additionally, balancing the sales process and nurturing leads while also working on projects requires careful navigation and decision-making.

Upcoming: Developing an MLOps Accelerator

Accelerators are valuable tools that we create based on experiences and lessons learned from past projects. They provide templated code, guidance and best practice documentation, saving time and effort for both our team and clients. These accelerators may consist of Terraform scripts or other relevant resources, as a starting point for new projects. Clients and even Google appreciate their efficiency and the direction they provide.

As for plans, I hope to create an accelerator for MLOps in due course, in particular for Large Language Models (LLMOps).. This would involve generalising the infrastructure and processes related to chatbot development, making it easier for everyone to benefit from. It’s an exciting prospect, and by sharing our knowledge and successes, we can enhance the efficiency and effectiveness of future projects.

Reflecting on Memorable Moments and Overcoming Challenges

One of the greatest moments I’ve had as a Devoteam G Clouder was taking part in the previously mentioned Cellpoint Data project. It involved distilling extensive workshop discussions and capturing the essence of what the client needed, and then translating their ideas and descriptions into a clear data architecture diagram that encapsulated just what they needed was particularly rewarding. 

Mark’s Advice To Lift Your Career

If you are looking to propel your data engineering career and are aspiring to reach new heights, I recommend chasing challenging experiences and tackling projects on the bleeding edge. Get out of your comfort zone, and avoid settling for safe options that can become commonplace. Instead, choose upcoming technologies and stay ahead of the curve. Consider partnering with innovative companies that set the pace, like Devoteam G Cloud. Build a diverse portfolio of projects and experiences, as this will help showcase your skill and boost your career.