Senior Data Engineer/Back-end Engineer (Python/SQL/Serverless Cloud/Data Warehouses)

Country

India

Job Family

Technology

We show the world what people want.

Join GfK and help us shape tomorrow. As an NIQ company, we are the world's leading consumer intelligence firm, delivering the Full View™ on consumer behavior. We work to enable manufacturers and retailers better understand what consumers really want. Our name has inspired trust for over 89 years because we take pride in discovering new pathways to sustainable growth for our clients, our people, and our planet.

We are always looking for open-minded people who will grow with us, push boundaries, and pioneer disruptive methods in market research, data science, technology, and AI. If you share this passion to drive things forward and the integrity to insist on doing things the right way, we'll equip you to take your future into your own hands and play a leading role in our story.

Job Description

The team’s role will be to deliver the on-going development and evolution of the existing Business Reporting data pipeline, supporting a data warehouse whose data is consumed by several teams, and processes and downstream systems.  This will include integration of new sources, further transformation, optimisation, and troubleshooting of the data.

The pipeline can be thought of as follows:
Extract data from several sources both in house custom and third-party hosted.  
Transform, clean, and merge the data into a standard structure.  
Load the transformed data into a single data warehouse to be consumed by various downstream systems.

The responsibilities of the team can be broadly summarised as:  

  • Investigation and delivery of data to support new feature requirements.  

  • Ensuring data parity & quality between the source and destination data  

  • Continual improvements to the codebase - the team will be regularly reviewing the codebase, identifying areas for improvement, planning, and implementing appropriate changes.  

  • Support new teams and their processes and/or systems, when requiring access to our data.  

  • Ad-hoc support with regards to data queries from stakeholders 

Essential Skills

  • Strong SQL experience (7+ years)

  • Strong software development experience in Python (7+ years)

  • Experience working within linux/unix based systems & bash scripts

  • Gravitate towards quality, writing well tested code i.e. TDD / BDD

  • Knowledge of containers e.g. Docker, Kubernetes & Helm

  • Experience building and maintaining CI/CD pipelines, including monitoring and observability

  • Experience working in an AGILE environment i.e. Scrum, Kanban

  • Good communication and collaboration skills

  • Good problem-solving skills

Desired (Non-Essential) Skills

  • Experience working in any Cloud environment e.g. GCP, Azure, AWS

  • Experience with orchestrators e.g. Cloud Composer, Airflow, Argo

  • Experience of event driven architectures

  • Experience of batch/stream data processing

  • Experience of NoSQL databases

We are an ethical and honest company that is wholly committed to its clients and employees. We are proud to be an inclusive workplace for all and are committed to equal employment opportunity, focusing on all of our employees reaching their full potential. 

We respect and value every employee regardless of race, ethnicity, gender, sex, sexual orientation, age, personality, experience, culture, faith, socio-economic status, or physical or mental disabilities.

We endorse the core principles and rights set forth in the United Nations Declaration of Human Rights and the Social Charter of Fundamental Rights of the European Union, promoting the universal values of human dignity, freedom, equality, and solidarity.

Learn more about how we are driving diversity and inclusion in everything we do on: https://www.gfk.com/about-gfk/diversity-and-inclusion

At GfK we work collaboratively with our colleagues but offer a flexible working approach, including dividing our time between office & remote working as well as the opportunity to flex our working hours around team core hours.

We offer an exciting work environment that brings people together. We encourage an entrepreneurial and innovative spirit and make use of the latest digital technologies. We are looking for self-starters, who accept challenges and create solutions.

Can there be a better place to take center stage in the digital revolution? We are excited to get to know you!

Posted: 37 days ago

City: NIQ Pune

Work Area: Technology

Job Time: Full Time

Requisition ID: R00022066