SC Cleared Data Engineer | Outside IR35 | 6 Months | Hybrid

SC Cleared Azure Data Engineer - 6 Months - Outside IR35 - London - Hybrid

We are committed to leveraging cutting-edge technology and innovation to drive meaningful impact in our industry. As part of our growth, we are seeking a highly skilled Senior Data Engineer with extensive experience in Azure Cloud technologies to join our dynamic team.

Role Overview: As a Senior Data Engineer specializing in Azure Cloud technologies, you will be responsible for designing, developing, and maintaining data engineering solutions to support our organization's data needs. You will work closely with the architecture team and business stakeholders to understand requirements and create detailed low-level designs. This role requires strong technical expertise in Azure Cloud services, particularly Azure Data Factory, Databricks, Azure Data Lake Services, and Azure Synapse Analytics.

Key Responsibilities:

• Utilize your 8+ years of experience in Data Engineering to design and implement robust data pipelines, ensuring data quality, reliability, and scalability.
• Collaborate with the architecture team and business stakeholders to define and execute detailed low-level designs.
• Develop and maintain ingestion pipelines, data models, and documentation.
• Hands-on experience with various Azure services, including but not limited to Azure Data Factory, Azure Data Lake Services, Azure Synapse Analytics, Azure API Management, Azure Functions, and Azure Web Applications.
• Create and manage resource groups, ensuring efficient resource allocation and utilization.
• Lead a development team of 7-10 members, providing technical guidance and mentorship.
• Implement Azure CI/CD pipelines to automate deployment and testing processes.
• Ensure adherence to SDLC processes and best practices throughout the development lifecycle.
• Demonstrate excellent verbal, written, and communication skills, with strong analytical and troubleshooting abilities.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum of 8 years of experience in Data Engineering, with a focus on Azure Cloud technologies and Databricks.
• Proficiency in Azure services such as Azure Data Factory, Azure Data Lake Services, Azure Synapse Analytics, Azure API Management, Azure Functions, and Azure Web Applications.
• Strong expertise in designing and implementing data ingestion pipelines, data models, and documentation.
• Experience working in an Agile environment and leading development teams.
• Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
• Proven track record of delivering high-quality solutions within established timelines.