Mandatory Skills :

Azure Data Engineer, Azure Datafactory, Azure Databricks ,Pyspark

- Strong working experience with Azure BI Services like Azure Data Factory, Azure Blob, ADLS, Azure Data Lake Storage Gen2,Logic Apps, Key Vault, Azure SQL DB and Synapse DWH

- Hands-on experience in Azure Data factory and its Core Concept's like Linked Services, Datasets, Data Flows, Pipelines, Activities and Triggers.

- Excellent knowledge of ADF building components -Integration Runtime, Self-Hosted Integration Runtime.

- Designed and developed data ingestion pipelines from on-premise to different layers into the ADLS using Azure Data Factory (ADF V2)

- Experience with integration of data from multiple data sources

- Knowledge on Data Extraction from On-Premise Sources and Delta Extraction methods from Source Systems to ADLS

- Extensively Worked on Copy Data activity

- Worked on Get Metadata Activity, look up, Store Procedure, For each, IF and execute Pipeline activities

- Implemented dynamic pipeline to extract the multiple files into multiple targets with the help of single pipeline

- Strong Knowledge on Parameterization of Linked Services, Datasets Pipelines, Activities.

- Manage data recovery for Azure Data Factory Pipelines

- Extensively worked on Azure Stream Analytics

- Strong Knowledge on Azure Data bricks, creation of Notebooks, Clusters.

- Pipeline execution methods (Debug vs Triggers)

- Monitor and manage Azure Data Factory