Data Engineer

Job Description: Data Engineer- Contract

About ALLEN Digital

Allen Digital was created as a strategic partnership between Allen Careers Institute and Bodhi Tree

Systems to ensure tech enablement for millions of students. Allen Digital aims to build an EdTech

platform to provide students with everything a classroom cannot. We have the backing of some of

the best names in – media, business, education and technology. We are a start-up with a reputed

team, strong investors and a legacy.

About ALLEN Careers

Allen Career Institute has been in the coaching sector for the last 35 years and has earned an

undisputed market leader position in preparation for JEE (Main+Advanced), NEET, Class VI to X,

NTSE, and Olympiads.

Traditional coaching setups have a strong consumer proposition regarding outcomes, but their

geographic presence limits them, and the classroom journey is not personalised. Digital education

companies have predominantly solved access but have yet to have much success in delivering deep

engagement, comprehension, and outcomes. We at Allen Digital believe that we can take the best of

both traditional classrooms and digital technologies and create an education platform that takes the

application of technology more profoundly into the student journey and bring learning outcomes at

scale.

Responsibilities:

● You will be responsible for product features related to data transformations, enrichment, and

analytics

● You will discuss with product managers, UX designers, and other backend teams to understand

requirements and translate the same into functional specifications

● Design, develop, and maintain scalable and efficient data pipelines, data warehouses, and data

integration processes.

● Implement and optimize ETL (Extract, Transform, Load) processes to efficiently ingest, process,

and store large volumes of structured and unstructured data.

● Ensure data quality and integrity by implementing data validation and cleansing techniques,define

and enforce data governance, security, and compliance policies.

● Build and maintain data models, schemas, and database systems to support data analytics and

reporting needs.

Requirements:

● Education: BS Computer Science or Equivalent

● Minimum 2+ years of data engineering experience

● Experience using batch and stream processing frameworks like Spark/Kafka Streaming, Spring

batch or equivalent

● Proficiency in programming languages such as Python, Java, or Scala for data processing and

scripting.

● Good experience with SQL and writing complex queries/data structures

● Proficiency with AWS setup and configuration.

● Experience creating ETL pipelines from sources like Google Analytics, MixPanel, AWS Aurora

etc., using Glue or equivalent technologies

● In-depth knowledge of relational databases (e.g., MySQL, PostgreSQL) and experience with

database design and optimization.

● Hands-on experience with big data technologies such as Hadoop, Spark, or NoSQL databases.

● Excellent communication and interpersonal skills to effectively collaborate with cross-functional

teams and stakeholders.

Place of work