Senior Data Engineer (Cloud, Data Integration & Migration)

We are seeking an experienced Senior Data Engineer to join our growing Data Services team. This is a hands-on technical role focused on designing, building, and supporting cloud-based data solutions across AWS and Azure platforms. The successful candidate will have strong experience in data engineering, data integration, ETL/ELT development, data migration, data quality, and cloud-native analytics platforms. They will work closely with technical and business stakeholders to deliver scalable, secure, and high-quality data solutions. Key Responsibilities - Design, develop and maintain scalable ETL and ELT pipelines. - Build data integration solutions across cloud, on-premise, and third-party systems. - Design and implement robust data migration solutions, including extraction, transformation, validation, reconciliation, and cutover activities. - Perform data profiling, root cause analysis, and data quality assessments. - Develop and optimise data warehouse, data lake, and lakehouse solutions. - Produce source-to-target mappings, transformation rules, and technical documentation. - Support data governance, security, and compliance requirements. - Work collaboratively with stakeholders to understand requirements and deliver effective solutions. - Troubleshoot complex data issues and implement sustainable solutions. Essential Skills & Experience Experience - Minimum 5 years' hands-on experience in Data Engineering. - Proven experience delivering complex Data Migration and Data Integration projects. - Strong experience working with large and complex datasets. - Experience working across both AWS and Microsoft Azure environments. Databases & SQL Strong hands-on experience with: - PostgreSQL - MySQL - Microsoft SQL Server - Oracle - Amazon Redshift - Amazon Athena Excellent SQL development, optimisation, and troubleshooting skills. AWS Technologies Strong practical experience with: - AWS Glue - Amazon Athena - Amazon Redshift - Amazon S3 - AWS Lambda - AWS Step Functions - Amazon QuickSight Microsoft Azure Technologies Strong practical experience with: - Microsoft Fabric - Azure Data Factory - Azure Synapse Analytics - Azure Data Lake Storage - Azure SQL Data Engineering Strong knowledge of: - ETL and ELT design patterns - Data Integration architectures - Data Warehousing - Data Lake and Lakehouse architectures - Data Modelling - Data Profiling - Data Quality Management - Data Validation and Reconciliation Desirable Skills - Python development - PySpark - Databricks - Infrastructure as Code (Terraform, Bicep, CloudFormation) - CI/CD pipeline development - Microsoft Purview - AWS and/or Azure Certifications - Public Sector delivery experience Personal Attributes - Excellent communication and stakeholder management skills. - Strong analytical and problem-solving capability. - Ability to explain technical concepts to non-technical audiences. - Self-motivated with strong attention to detail. - Able to work independently and collaboratively within project teams. - Strong ownership and delivery focus. Qualifications - Degree in Computer Science, Data Engineering, Information Systems, or equivalent industry experience. - Relevant AWS and/or Microsoft Azure certifications desirable. Essential Skills & Experience Experience - Demonstrable experience in Data Engineering. - Proven experience delivering complex Data Migration and Data Integration projects. - Strong experience working with large and complex datasets. - Experience working across both AWS and Microsoft Azure environments. Databases & SQL Strong hands-on experience with: - PostgreSQL - MySQL - Microsoft SQL Server - Oracle - Amazon Redshift - Amazon Athena Excellent SQL development, optimisation, and troubleshooting skills. AWS Technologies Strong practical experience with: - AWS Glue - Amazon Athena - Amazon Redshift - Amazon S3 - AWS Lambda - AWS Step Functions - Amazon QuickSight Microsoft Azure Technologies Strong practical experience with: - Microsoft Fabric - Azure Data Factory - Azure Synapse Analytics - Azure Data Lake Storage - Azure SQL Data Engineering Strong knowledge of: - ETL and ELT design patterns - Data Integration architectures - Data Warehousing - Data Lake and Lakehouse architectures - Data Modelling - Data Profiling - Data Quality Management - Data Validation and Reconciliation