(Big) Data Engineer
(BIG) DATA ENGINEER:- Joining a dedicated team, partnered by Microsoft, building a data lake in Azure (the single most high profile IT initiative within this international company).
Data is the life blood of our Client and the Data Engineering team’s core responsibility is ensuring that their data platform, is robust, secure, timely and flexible. They achieve this by being integrated with engineering practice and follow principles such as, agile development, continuous delivery, and continuous improvement. Working with petabytes of data, leveraging advanced data engineering, analytics and reporting tools/techniques you’ll deliver accessible enterprise data that can be used for business critical insights and recommendations.
o Work as part of cross-functional agile team on the design and development of a large-scale, high-volume and high-performance data platform.
o Build large-scale ingestion and transformation pipelines and incorporate modern cloud-based technologies and frameworks.
o Creating and maintaining analytical extracts
(Ideal) Skills & Experience:
o You have previous experience in a data engineering role and have worked with large-scale data environments.
o You’ll need experience with various big data integration techniques, integration patterns, as well as the technologies and products used to implement them i.e. how to deal with volume/velocity/variety in a performant way.
o You have worked with unstructured big data, including data modelling and processing techniques (ETL, ELT, LETS) for big data systems especially in cloud environments.
o You have exposure to the Microsoft Azure platform especially: Azure Data Factory (ADF); Azure Functions; SQL Database; Azure Cosmos DB; Azure Storage; Service Bus; Azure Data Warehouse (SQLDW); Event Hubs.
o You have an understanding of agile development practices, ideally having worked successfully with agile delivery teams.
o You have excellent analytical, problem-solving and communications skills.
o You have database unit-test and integration test experience with automated testing frameworks and tools such as tSQLt, SpecFlow
o Generous salary, bonus and pension matching
o Great development programmes
o Amazing offices and great culture
o 25 days holiday plus one extra day for your birthday
o Subsidised gym and canteen
o Huge staff discount
o Life Insurance, medical care, cycle to work scheme
o Etc etc
By applying now, you accept you have read and accepted our GDPR Privacy Notice for Job Applicants.Back to Vacancy Listing