Azure Data Engineer

Key outcomes: Database engines/technologies (Synapse, SQL Server, Azure SQLetc.) Conducting unit and integration test automation Code management/reviews (Git) Build and release automation (CI/CD) using Azure Devops Build and management of Azure resources (including AD) Develop and maintain documentation of implemented solutions Build appropriate and useful reporting deliverables Provide timely scheduled management reporting Analyse existing SQL queries for performance improvements Manipulate and transform data Capabilities: Sound knowledge of Data pipelines and ETL processes using Azure Data Factory, Data Flow, Databricks/Spark (using Python & associated frameworks), Azure storage (data lake, blob) etc. Azure application and integration components using technologies defined in solution architectures (Azure stack - Functions, Service Bus, Event Grid etc., M365 stack - PowerApps etc., Languages - C#, Python etc.) Excellent written and oral communication skills Excellent Data Analysis skills Good programming skills Advanced knowledge of MSOffice Suite and excellent Excel working knowledge Required skills and experience: Programming T-SQL Python Pyspark C# (.Net/.Net Core) - desirable PowerShell - desirable YAML - desirable Azure Blob Storage & Azure Data Lake Gen2 Azure Data Factory including Data Flows Azure Databricks Azure SQL Database and Synapse Analytics (Data Warehouse) Azure DevOps Event Grid Azure Key Vault Function apps Logic apps Event Hubs - desirable Azure Service Bus - desirable