SR2 are working with a leading consultancy on a critical government programme. An urgent requirement has materialised for a Data Engineer to join and lead the project.
Role Requirement:
Build streaming data ingestion pipelines using AWS MSK and batch data ingestion pipelines using APIs
Prepare data for prescriptive & predictive modelling.
Experience working with various data formats eg, parquet, avro, json
Experience in building ETL pipelines using Lambda, Step Functions and Glue
Experience working with various AWS database services (eg, RDS, DynamoDB and Redshift)
Technical expertise with various data modelling techniques
Hands-on experience with Python and SQL
Kafka Streaming data expert
This role is outside IR35 and requires active SC.