Microsoft Power Bi And Data scientist Engineer

Overview

We are seeking an experienced Data Engineer with expertise in Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric to join our growing data engineering team. The ideal candidate will design, build, and optimize data pipelines, data lakes, and data warehouses on Azure to empower data scientists, analysts, and business stakeholders. This role involves leveraging ADF for ETL processes, Synapse for analytics, and Microsoft Fabric for modern data workflows to deliver scalable, secure, and efficient data solutions.

Responsibilities

• Design, develop, and deploy ETL pipelines using Azure Data Factory (ADF).
• Integrate ADF with external sources (SQL, NoSQL, REST APIs, flat files, Azure Blob, Data Lake).
• Implement data validation, transformation rules, and error handling within pipelines.
• Automate data movement and orchestration across storage, databases, and analytics platforms.
• Use Mapping Data Flows for advanced transformations and aggregations.
• Build and manage data lakes and warehouses on Azure Synapse Analytics.
• Design serverless SQL pools, Spark pools, and data integration pipelines in Synapse Studio.
• Optimize Synapse performance for batch processing and real-time analytics.
• Develop OLAP and OLTP data models for reporting and exploration.
• Implement Microsoft Fabric for end-to-end data integration across Azure services.
• Leverage Fabric’s Lakehouses, Warehouses, and Data Pipelines for analytics and AI-driven insights.
• Enable collaborative workflows across data engineering, data science, and BI teams.
• Build self-service BI solutions within Fabric to empower business users.
• Design cloud-native architectures for scalable and cost-effective data systems.
• Ensure data governance, security, and compliance (GDPR, CCPA).
• Implement RBAC, encryption, and Azure Purview for data cataloging, lineage, and auditing.
• Optimize data storage, compute resources, and ensure high availability.
• Build and maintain CI / CD pipelines using Azure DevOps, GitHub Actions, or Azure Pipelines.
• Automate workflows with Azure Logic Apps and Power Automate.
• Monitor and troubleshoot pipeline performance to minimize downtime.
• Continuously improve data engineering processes for automation, scalability, and maintainability.
• Work closely with cross-functional teams including data scientists, analysts, and business stakeholders.
• Provide Power BI integration for advanced dashboards and reporting.
• Support AI / ML workflows using Azure Machine Learning when required.
• Report to the Project Manager and execute assigned data engineering tasks.

Required Skills & Experience

Azure Data Factory (ADF) – ETL and pipelines

Preferred Certifications (Not Mandatory)

Qualifications

Location : Onsite / Hybrid (as per project requirement)

Reporting To : Project Manager

Work Schedule : Standard office hours (flexibility as per project needs)

Skills : azure, power bi, transact-sql (t-sql), data lake, adf, ai / ml, cloud architecture, rbac, olap, etl pipelines

#J-18808-Ljbffr