Your career compass awaits
Create a free account to unlock
- ✓ See how you match this role
- ✓ AI resume tailored to this specific job
- ✓ Inside Track Companion — find your insider contact
- ✓ Skills gap analysis and upskill plan
- ✓ Interview prep kit for this role
- ✓ Relocation concierge — salary, tax, cost of living
Free — no credit card required
Confirm Application
Are you applying to ?
We'll track this in your dashboard as Applied.
Sr. Data Engineer - PySpark (Banking)
ICT
Company shared salary
NA
Market rate
AED 22,000–AED 35,000/mo (AED 264,000–AED 420,000/yr)
Based on similar roles (title + domain + location).
About the Company
We are looking for an experienced Senior Data Engineer with strong expertise in PySpark, Python, and Informatica BDM development to support large-scale Data & Analytics initiatives within an enterprise banking environment. The ideal candidate should possess hands-on experience in building and maintaining robust ETL pipelines, data marts, and scalable data processing solutions across structured, semi-structured, and unstructured data sources.
About the Role
d the ability to work closely with cross-functional teams throughout development, testing, deployment, and production support activities.
Responsibilities
- ● ta Mart solutions.
- ● Develop high-performance data processing solutions using PySpark and Python.
- ● Perform end-to-end SDLC activities including development, UAT support, bug fixing, production deployment, and post-production support.
- ● Build and optimize data transformation pipelines for large-scale enterprise data platforms.
- ● Perform data analysis, code debugging, and performance tuning across PySpark and SQL-based solutions.
- ● Collaborate with business, analytics, and engineering teams to understand and implement data requirements.
- ● Ensure data quality, integrity, scalability, and reliability across data pipelines.
- ● Work with structured, semi-structured, and unstructured datasets in enterprise environments.
- ● Participate in code reviews and implement software engineering best practices.
- ● Support CI/CD implementation and data pipeline deployment activities.
- ● Troubleshoot production issues and implement effective resolutions.
- ● Contribute to technical documentation and knowledge-sharing initiatives.
- ● Required Technical SkillsProgramming & Big Data Technologies Python PySpark Apache Spark Informatica BDM (Big Data Management) Hadoop MapReduce Hive Pandas Data Engineering & ETL ETL Pipeline Development Data Mart Development Data Warehousing Concepts Data Transformation & Processing Data Pipeline Optimization Databases & Query Languages Oracle SQL SQL NoSQL Databases Strong analytical and query-writing skills Tools & Platforms Jupyter Notebook Git / Version Control CI/CD Pipelines Testing & Validation Frameworks Required Experience Minimum 5+ years of commercial experience in Data Engineering or Data Analytics projects.
- ● Strong hands-on experience in PySpark and Python-based ETL development.
Requirements
- ● Strong experience in Informatica BDM development.
- ● Strong expertise in Oracle SQL and data analysis.
- ● Hands-on experience debugging PySpark code and optimizing data processing workflows.
- ● Strong understanding of software engineering principles and coding best practices.
- ● Preferred Domain Experience Banking Financial Services Digital Products Data & Analytics Platforms Nice to Have Experience working with enterprise data lake and big data ecosystems.
- ● Exposure to cloud-based data platforms.
- ● Knowledge of modern data engineering best practices and scalable architectures.
- ● Daily Tech Stack The selected candidate will work extensively with: Python PySpark Informatica BDM Apache Spark Jupyter Notebook Oracle SQL SQL & NoSQL Databases Hadoop Ecosystem (Hive, MapReduce) CI/CD Tools ETL & Data Warehousing Technologies Functional Competencies Strong problem-solving and analytical skills.
- ● Excellent debugging and troubleshooting capabilities.
- ● Ability to work independently in a fast-paced Agile environment.
- ● Strong ownership mindset and attention to detail.
- ● Effective stakeholder communication and collaboration skills.
- ● Ability to manage multiple priorities and production support activities.
⚡ Full Resume Sandbox Canvas