Data Engineer

This individual may be required to provide input to or participate in various projects and will perform other duties as requested.This role involves collaborating with architects, product owners, data scientists, and engineers to bring big data and data science R&D projects into production.Responsibilities:

  • Transition R&D projects to production with hands-on design expertise.
  • Build, optimize, and maintain database models.
  • Develop scalable data pipelines and integrations.
  • Provide technical expertise in cloud data architecture, especially AWS.
  • Lead migration of legacy data solutions to cloud-based platforms.
  • Define best practices across the data and analytics landscape.
  • Work closely with business units on long-term data strategies.
  • Establish data management processes, including data lineage and governance.
  • Document architecture and decisions.

Qualifications:

  • 3-5 years in data warehouse platforms and 1-2 years in data modeling.
  • Strong Python and shell scripting skills.
  • Proficiency in Scala, Kafka, Spark, Zookeeper, Pyspark, Oracle, Redshift, Elasticsearch, and other open-source technologies.
  • Experience with cloud data pipelines, preferably AWS.
  • Knowledge of data ingestion frameworks and enterprise databases.

Place of work

Antal International
Chennai
India

Employer profile

In 1993, a visionary in London set out to create a better way to connect talented individuals with job opportunities. Fast forward 30 years, and that vision has grown into a worldwide network of over 800 consultants spanning 32 countries. As one of the top recruitment companies, we specialize in IT, Accountancy, Sales and Marketing, Engineering, and more, offering game-changing recruitment consultancy and talent acquisition services to companies of all sizes. Join us on this journey of growth! With our personalized approach to the hiring process, we aim to make finding the right job a positive and stress-free experience for you as a candidate. We understand that job searching can be overwhelming, so we offer our expertise every step of the way to help you navigate the process with ease. Our goal is to empower you to achieve your career aspirations and land the perfect job! At our core, we believe that our success is directly tied to the success of the candidates we work with!

Local radius

  • Ambattūr
  • Āvadi
  • Tiruvottiyūr
  • Pallāvaram
  • Alandur
  • Poonamalle
  • Saint Thomas Mount
  • Kattivākkam
  • Porur
  • Manali



Job ID: 8443580 / Ref: 7540da0067caf12f708d1f9606a4b684

Quick application

If the job appeals to you, don't hesitate and send in your application immediately - it might just be the dream job you're looking for.

Antal International

Employees
201-500
Industry
Other industries
Contact