Data Engineer ID94415

We are looking for a Data Engineer to execute large‑scale data platform migrations to Snowflake and support reliable Airflow workflows. The role involves migrating ~1,000 datasets, adapting pipelines, ensuring data quality, and supporting Airflow scheduling and monitoring. The position is full‑time, based in Thiruvananthapuram, Kerala, with remote work flexibility.

• Execute migration of approximately 1,000 datasets to Snowflake
• Adapt existing pipelines to Snowflake following core architecture and technical approach
• Ensure data quality and reliability throughout the migration process
• Support workflow scheduling and monitoring in Apache Airflow 3
• Execute time‑sensitive migrations, including Airflow 2 to 3, Confluent region migration, and move to Iceberg
• Accelerate migration initiatives targeted for completion by end of March 2027

• 3+ years of hands‑on Python development experience
• Advanced SQL, including complex joins, CTEs, window functions, and performance tuning
• Snowflake data modeling
• Apache Airflow development and testing in Python
• Apache Kafka
• Apache Spark with PySpark experience
• Iceberg and Parquet data formats
• AWS experience, particularly S3 (data lakes, partitioning, lifecycle policies)
• Testing strategy experience, with hands‑on debugging and testing code
• At least 2 years of industry experience working with large‑scale datasets, including Airflow and Spark
• Upper‑intermediate English level