logo
search
EN

Senior Data Engineer

Country

United Kingdom

Job Family

Technology

For over 80 years, GfK has been a reliable and trusted insight partner for the world’s biggest companies and leading brands who make a difference in every consumer’s life - and we will continue to build on this. We connect data, science and innovative digital research solutions to provide answers for key business questions around consumers, markets, brands and media. With our headquarters in Germany and a presence in around 60 countries worldwide, you benefit from our global company with a diverse community of ~9,000 employees.

Harnessing the power of our workforce, the greatest asset we have is our people. As part of GfK, you can take your future into your own hands. We value talent, skills and responsibility and support your development within our international teams. We are proud of our heritage and our future: Currently we are in the latter stages of a transformational journey from a traditional market research company to a trusted provider of prescriptive data analytics powered by innovative technology. This is only possible with extraordinary people and this is why we are looking for YOU to help create our future. For our employees as well as for our clients we pursue one goal: Growth from Knowledge!

Job Description

As a Senior Data Engineer, you will have following key accountabilities:

  • Ability to set up and configure distributed data technologies in GCP/AWS
  • Ability to set up resilient, performant and scalable data pipelines
  • Provide guidance on technology, library and tooling choices within the team
  • Good understanding of when to persist, replicate and cache data
  • Ability to wrangle and integrate data automatically/efficiently from various alternative data providers
  • Good working knowledge of various database types and when to use them, i.e. SQL, Columnar, Graph, Key-Value, and Document
  • Good understanding of database design patterns including OLTP and OLAP
  • Worked with SQL and Data Warehouses including PostgreSQL preferable but MS SQL Server, MySQL, AWS Redshift and/or Snowflake are good to have
  • Knowledge of serialisation technologies such as JSON.Net, Parquet and Avro
  • Experienced with REST and API design
  • Comprehensive automated testing experience with continuous integration and continuous delivery pipelines
  • Working with feature teams, our wider architecture function to ensure what we build is fit for purpose
  • Wary of things like scope creep, over-engineering and ‘skipping unit tests for now’

Now that we've introduced you to the Senior Data Engineering position, what skills, qualifications and experience should you have?

  • 5 years or more of software/data engineering experience
  • Working together, be that pairing, or wider team collaboration
  • A belief in the agile principles, not just a single "Agile Process"
  • Willingness to use the appropriate tool for the job, not just the latest "hot" technology
  • Sharing your knowledge and experience with others
  • Good (current) knowledge of SQL and at least two other programming languages
  • Experience in collaborative design of software systems including contracts, integration points and database schemas
  • The ability to Test-Drive software with automated tests

Our current "Tech Stack" includes, but is not limited to:

  • Google Cloud Platform
  • PostgreSQL
  • Bash
  • Python
  • Flyway
  • Oracle
  • Groovy
  • Spock Framework for testing

If you don't match exactly, don't worry, a good engineering mind will get you a long way!

      Besides the things we really expect you to have, there are some things which would be amazing if you have experience with them as well:

  • Build and design large scale real-time and batch data pipelines.
  • Distributed microservice based applications at scale
  • Docker and Kubernetes to run your amazing code
  • Experience with cloud technologies such as GCP, AWS

We offer an exciting work environment that brings people together. We encourage an entrepreneurial and innovative spirit. We make use of the latest digital technologies. We are looking for self-starters, who accept challenges and create solutions.

Can there be a better place to take centre stage in the digital revolution? We are excited to get to know you!

We offer an exciting work environment that brings people together. We encourage an entrepreneurial and innovative spirit. We make use of the latest digital technologies. We are looking for self-starters, who accept challenges and create solutions.

Can there be a better place to take center stage in the digital revolution? We are excited to getting to know you!

Posted: 32 days ago

City: London

Work Area: Technology

Job Time: Full Time

Requisition ID: R00008938