Job am 03.04.2025 bei NewScientist Jobs gefunden
First Central Insurance Technology Group
Principal Data Engineer
• United Kingdom
[...] meet requirements for business and technical use cases You ll design and build of data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies You ll build solutions that
pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications You ll build physical data models that are appropriately designed to meet business needs and optimise storage requirements, ensuring maximum re-use You ll carry out unit testing of own code, peer testing of others code to ensure appropriate quality, and be responsible for completeness and integrity of solutions delivered on the data platform (s) You ll ensure that effective, and appropriate documentation that brings transparency and understandability are in place for all content on the data platform (s) You ll coach and mentor Senior Data Engineers, Data engineers Associate Data Engineers You ll create high complexity BI solutions including data mart, semantic
layer, and reporting visualisation solutions in recognised BI tools such as PowerBI Experience knowledge Requires extensive experience of designing and building end to end data solutions (10 years +) Exceptional at building strong, effective relationships with people from different disciplines. Experience of carrying out data engineering design and build activities using agile working practices (such as Scrum or Kanban) . Experience of Databricks solutions, Databricks administration and pyspark. Data Factory/ Synapse Workspace-for building data pipelines or synapse analytics pipelines Data Lake-Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management Synapse Warehouse/ Analytics-Experience in Synapse data mappings, external tables, schema creation from SSMS, knowledge on how Synapse pool works behind the scenes [...]
