As a Data Engineer you will link and coordinate activities with the organisation's business divisions, including R&D, Core R&D, Engineering, Product Management and Service. In addition you will work directly with key Stakeholders including the Product Owner, Lead Cloud Architect, Senior Data Scientist, the Head of Digital Operations and the Machine Intelligence team.
The main duties and responsibilities are the creation of efficient data pipelines (such as ETL jobs) that consume raw data from multiple sources and ingest it into datasets, both in batch and streaming mode. The analysis of raw data and conduct data quality checks. Help implement an advanced digital operations center, monitoring and running all data engineering services. Improve multiple kinds of data sources within the company regarding their eligibility for data science. Perform data analyses and minor data science projects requested by colleagues and Consult colleagues in data engineering related questions, especially regarding Databricks.
This is a senior role which requires five year’s experience in data engineering, e.g. building production-ready data pipelines, designing data architectures, using different database technologies, conceptualizing data management frameworks. You have a hands-on and structured approach with a mentality to not give up easily, once data engineering challenges get more complex. You have a background that includes relevant data engineering environments, e.g. data analytics platforms such as Azure Data Explorer, databases management systems such as SQL, tools within the Apache ecosystem and their cloud counterparts such as Databricks (preferably in Azure). In addition you have experience in programming languages (Python, SQL, Kusto Query Language).
The role operates from the clients Dublin Headquarters on a Hybrid Basis. They will offer a top class package in an International working environment. They provide professional and personal development: learning on the job, specialised course, conferences etc and the space and support to experiment with new technologies.