Data Engineer – Central London – £85k

  • Full Time
  • London
  • Posted 1 week ago
  • Salary: c£85,000

SearchBI

Data Solutions Provider

Data Engineer – Central London – £85k

Big Data Engineer / Data Architect / Big Data Consultant

Are you an experienced Data Engineer looking for a new challenge? Do you want to work for a solutions provider with a range of exciting greenfield projects? Are you looking for a position that will give you the opportunity to be a future leader of the business within the next few years?

An analytics house based in London is actively seeking a Data Engineer to join a team responsible for a number of business-critical projects dealing with a range of technical solutions.

Our client is a dynamic technology company that is focused on business analytics and planning. They take an innovative approach to making complex solutions simple so their clients can focus on running their businesses. Their services and applications enable clients to gain the benefits of world-class analytics and planning capability without the headaches.

What we can offer

This is an opportunity to help grow the business and become a leader within a relatively short amount of time. If you are looking for career progression within your next role, you should apply for this job,

  • A competitive basic salary of circa £85k
  • An annual bonus of 5-15% of basic salary
  • Industry specific training and certifications
  • Flexible working hours
  • The option of homeworking
  • Pension

Role Summary:

Responsibilities:

  • Clearly and effectively articulate how their work impacts the business and convey this to stakeholders
  • Building data and meta-data processes using established frameworks
  • Performing testing to validate that data is correctly processed and metadata is correctly maintained
  • Designing and modelling to ensure the semantic models align with conceptual
  • Configuring code orchestration, ensuring monitoring and error handling is occurring according to design
  • Management of developed artefacts into our repository
  • Be involved with a range of client projects and in handling vast amounts of data
  • Work on database design and development, data integration and ingestion
  • Play a key role on projects from a data engineering perspective to model the data landscape, obtain data extracts and define secure data exchange approaches
  • Plan and execute secure, good practice data integration strategies and approaches
  • Acquire, ingest, and process data from multiple sources and systems into Big Data platforms
  • Create and manage data environments in the Cloud (AWS/Azure)

 

Requirements:

Primary experience:

  • AWS / Azure
  • Cloudera Hadoop Distribution (CDH 5)
  • Implementing data ingestion / presentation / semantics data layers as guided by BA/Data governance/conceptual data models
  • Using existing and contributing to new frames works top manage data ingestion and transformation
  • Data modelling – Data Vault 2.0 (being a preference), but all modelling experience of valuable, especially across structured and unstructured data.
  • Metadata repositories and technologies (Hive, Cloudera, Navigator)
  • Working with SalesForce, XML, Rational Data
  • Manipulate data using Java, Scala, Python, Spark and orchestrated in Talend
  • Experience with Big Data self-descripting formats (JSON, Parquet/ORC etc.)
  • Experience with Spark Clusters, both permanent and transitory (Altus, EMR)
  • Data presentation; Sentry/Impala.. Tableau/Spotfire

 

Secondary experience:

  • Data management and analytics
  • Data discovery processes
  • Scrum / working in Agile teams
  • Creating data catalogues / models
  • Talend
  • Snowflake
  • Developing technical specifications and working with architecture, based on business and functional analysis
  • Using meta data to generate data catalogue
  • Working knowledge of setting up and running Big Data clusters. Hadoop, Spark, Impala, supported by various data bases and object stores (S3) on AWS.
  • Understanding of configuration management and devops techs. GitLab / Jenkins

 

AWS / Data Engineer / Data Consultant / Big Data Engineer / Data Architect / Big Data Consultant / SQL / Python / Spark / Data Scientist

Candidate Application


You can apply to this job and others using your online resume. Click the link below to submit your online resume and email your application to this employer.