Data Engineer - Python, AI

Citi is looking for an experienced Python Developer with combined expertise in Data Engineering and AI/NLP engineering. The role involves building NLP pipelines, large-scale data processing systems, and scalable APIs for advanced analytics and AI use cases.

• Develop and optimize ETL and data processing jobs using PySpark, Pandas, PyArrow, and related libraries
• Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
• Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
• Build and maintain Flask-based APIs for model inference and service integrations
• Manage and deploy ML models using MLflow for tracking and versioning
• Support CI/CD workflows using GitHub and LightSpeed Enterprise
• Create and maintain Autosys JILs for job scheduling and automation
• Monitor application and system health and write unit tests using PyTest

• 10–12 years of hands-on Python programming experience
• Strong fundamentals in Python, OOP, and design patterns
• Experience with NLP libraries such as Flair, BERT, and HuggingFace Transformers
• Solid experience with PySpark, Pandas, PyArrow, and distributed data pipelines
• Experience building APIs using Flask
• Experience with MLflow for model tracking and deployment
• Good understanding of CI/CD practices and Git workflows
• Experience working with Redis or similar in-memory stores
• Comfortable with Linux command line and shell scripting