Data Engineer – London  c£550 per day – 6 month rolling contract 

  • Freelance
  • London
  • Posted 1 month ago
  • Salary: £550 per day

SearchBI

Data Solutions Provider

Data Engineer – London  c£550 per day – 6 month rolling contract 

Big Data Engineer / Data Architect / Big Data Consultant

An analytics house based in London is actively seeking a Data Engineer to assist in the delivery of a number of key projects as the business has brought a high volume of work and requires assistance while they hire a permanent team.

Our client is a dynamic technology company that is focused on business analytics and planning. They take an innovative approach to making complex solutions simple so their clients can focus on running their businesses. Their services and applications enable clients to gain the benefits of world-class analytics and planning capability without the headaches.

What we can offer

  • The opportunity for a permanent leadership role further down the line if interested
  • Flexible working hours
  • The option of homeworking

Role Summary:

Responsibilities:

  • Clearly and effectively articulate how their work impacts the business and convey this to stakeholders
  • Building data and meta-data processes using established frameworks
  • Performing testing to validate that data is correctly processed and metadata is correctly maintained
  • Designing and modelling to ensure the semantic models align with conceptual
  • Configuring code orchestration, ensuring monitoring and error handling is occurring according to design
  • Management of developed artefacts into our repository
  • Be involved with a range of client projects and in handling vast amounts of data
  • Work on database design and development, data integration and ingestion
  • Play a key role on projects from a data engineering perspective to model the data landscape, obtain data extracts and define secure data exchange approaches
  • Plan and execute secure, good practice data integration strategies and approaches
  • Acquire, ingest, and process data from multiple sources and systems into Big Data platforms
  • Create and manage data environments in the Cloud (AWS/Azure)

 

Requirements:

Primary experience:

  • AWS / Azure
  • Cloudera Hadoop Distribution (CDH 5)
  • Implementing data ingestion / presentation / semantics data layers as guided by BA/Data governance/conceptual data models
  • Using existing and contributing to new frames works top manage data ingestion and transformation
  • Data modelling – Data Vault 2.0 (being a preference), but all modelling experience of valuable, especially across structured and unstructured data.
  • Metadata repositories and technologies (Hive, Cloudera, Navigator)
  • Working with SalesForce, XML, Rational Data
  • Manipulate data using Java, Scala, Python, Spark and orchestrated in Talend
  • Experience with Big Data self-descripting formats (JSON, Parquet/ORC etc.)
  • Experience with Spark Clusters, both permanent and transitory (Altus, EMR)
  • Data presentation; Sentry/Impala.. Tableau/Spotfire

 

Secondary experience:

  • Data management and analytics
  • Data discovery processes
  • Scrum / working in Agile teams
  • Creating data catalogues / models
  • Talend
  • Snowflake
  • Developing technical specifications and working with architecture, based on business and functional analysis
  • Using meta data to generate data catalogue
  • Working knowledge of setting up and running Big Data clusters. Hadoop, Spark, Impala, supported by various data bases and object stores (S3) on AWS.
  • Understanding of configuration management and devops techs. GitLab / Jenkins

 

AWS / Data Engineer / Data Consultant / Big Data Engineer / Data Architect / Big Data Consultant / SQL / Python / Spark / Data Scientist

 

 

Candidate Application


You can apply to this job and others using your online resume. Click the link below to submit your online resume and email your application to this employer.