Azure Data Engineer
Job Title: Azure Data Engineer
Experience: 5+ Years
Job Description:
We are looking for a skilled Azure Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have strong hands-on experience with Azure Data Factory, Databricks, PySpark, Python, and Power BI, and will work closely with business and analytics teams to deliver reliable, high-performance data solutions.
Key Responsibilities:
Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF).
Build and optimize ETL/ELT workflows using Azure Databricks and PySpark.
Develop data processing logic and transformations using Python.
Ensure data quality, performance, scalability, and reliability of data solutions.
Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
Support data modeling and prepare curated datasets for reporting and analytics.
Create and optimize Power BI datasets and reports for business insights.
Monitor, troubleshoot, and optimize data pipelines in production environments.
Required Skills & Qualifications:
5+ years of experience as a Data Engineer.
Strong hands-on experience with Azure Data Factory (ADF).
Expertise in Azure Databricks, PySpark, and Python.
Experience building scalable data pipelines and processing large datasets.
Strong SQL and data modeling skills.
Hands-on experience with Power BI (datasets, reports, performance optimization).
Good understanding of cloud data architecture and best practices.
Preferred Qualifications:
Experience with Azure data services such as Azure Data Lake, Synapse Analytics.
Understanding of data governance, security, and access controls.
Experience working in Agile/Scrum environments.
Strong communication and problem-solving skills.
Nice to Have:
Experience in regulated industries (Finance, Healthcare, etc.).
Exposure to CI/CD pipelines for data engineering workloads.