Senior Azure Data Engineer

YOUR KEY RESPONSIBILITIES: • Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale. • Own end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement. • Identify and resolve bottlenecks across ingestion, transformation, and serving layers; drive measurable performance gains. • Contribute to the design and evolution of our medallion architecture and golden layer strategy. • Implement data ingestion processes from multiple heterogeneous sources, ensuring accuracy, completeness, and consistency. • Support the migration from SAP BW, ensuring data continuity and quality throughout. • Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls. • Work autonomously to deliver complex data engineering tasks with minimal supervision, while proactively communicating progress and blockers. • Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions. • Participate in agile ceremonies, contribute to sprint planning, and own your backlog items end-to-end. ARE THESE YOUR SECRET INGREDIENTS? • Bachelor's degree in Information Technology, Computer Science, or related field. • 5+ years of experience in data engineering with a strong focus on Azure (Azure Data Factory, Azure Data Lake Storage, Fabric). • Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably. • Strong SQL skills and experience with data modelling, schema design, and query optimization. • Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation. • Proficiency in at least one programming language: Python (preferred), Scala, or C#/.NET. • Solid understanding of data warehouse and lakehouse concepts. • Strong ability to work independently, manage your own priorities, and deliver under ambiguity. • Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa. • Excellent problem-solving and debugging skills. • Excellent spoken and written English • Communication, organizational and analytical skills Preferred Qualifications: • Experience with real-time or near-real-time streaming pipelines (Azure Event Hubs, Apache Kafka, Spark Streaming). • Hands-on experience with CI/CD for data pipelines using Azure DevOps, Git, and infrastructure-as-code (Terraform). • Familiarity with DevSecOps principles and experience working within the SAFe Agile framework. • Knowledge of SAP BW (extractors, transformations, queries, data export) and experience supporting BW migrations. • Experience with big data technologies such as Hadoop, Spark, and Hive, and large data volume management. • Strong analytical and problem-solving mindset - you enjoy finding root causes, not just symptoms. • Experience with Power BI and DAX for building analytical models and connecting to enterprise data. Show more