Senior Data Engineer
Posted 1 week agoBe an early applicant
Senior Data Engineer
Chennai, Tamil Nadu (+1 other)
JobSpri never asks you to pay for a job. If anyone does, it's a scam.
How well do you match this job?
Sign in to check your resume against this job and see the skills you're missing.
Experience
8+ yrs
Salary
₹17.8 – 33.1 LPA (est.)
Job type
Full-time
Openings
1
Education
Bachelor's degree or equivalent experience
Apply by
23 Nov 2026
We are seeking a Senior Data Engineer at Citi to modernize and evolve the data processing platform on Databricks on AWS. The role focuses on refactoring legacy Spark pipelines, optimizing performance, designing scalable solutions, and collaborating with architects and DevOps teams to deliver production‑ready data services.
- Refactor and modernize existing Spark pipelines to Databricks native architectures
- Eliminate legacy Hadoop dependencies and adopt cloud‑native AWS patterns
- Enhance and extend processing logic using optimized Spark on Databricks
- Build and optimize solutions using Delta Lake, Databricks Workflows, auto‑scaling and job clusters
- Contribute to low and mid level architecture and design, translating high‑level architecture into detailed technical designs
- Define data models, pipeline patterns, and reusable components to ensure scalable, maintainable, production‑ready solutions
- Analyze and improve Spark job performance, simplifying complex pipelines into efficient patterns
- Follow and contribute to Databricks and Spark engineering standards, writing clean, modular, testable code
- Collaborate with senior architects, platform teams, and DevOps engineers to provide technical inputs and support implementation
- Develop unit, integration, and data validation tests, supporting production releases and post‑deployment validation
- 8+ years of experience in data engineering or distributed systems
- Strong expertise in Apache Spark (Scala, Java, PySpark)
- Hands‑on experience with Databricks on AWS and Delta Lake
- Proficiency in SQL and AWS services for large‑scale data processing
- Experience modernizing or refactoring legacy data platforms to cloud‑based architectures
- Deep knowledge of Spark performance tuning and batch optimization
- Ability to translate architecture into detailed technical designs
- Understanding of data modeling and pipeline orchestration patterns
- Bachelor’s degree or equivalent experience
Skills
Stay Ahead in the
Jobspri Market
Join 50,000+ candidates receiving weekly job alerts, interview tips, and salary insights directly from top recruiters.
By subscribing, you agree to ourTerms of ServiceandPrivacy Policy.