Senior Data Engineer
We are seeking to engage a Senior Data Engineer to help us deliver on a key goal of setting up an ML-based, real time application for data-driven decision making for our clients in the public sector. The person will help design and build the datasets to underpin the ML models as well as help design and create the output pipeline.
The primary responsibilities of this role include:
- Design, develop and maintain scalable, automated data pipelines on AWS, pertaining to our AWS products
- Maintaining and monitoring our AWS data infrastructure
- Researching, learning and implementing relevant tools and technologies in the data engineering space to our AWS products
- Engineer manual data flows/pipelines to enable scaling and repeatable use
- Write necessary ETL/ELT code to make sure the required processes perform optimally
- Building CI/CD pipelines for MLOps – implementing and automating continuous integration (CI), continuous delivery (CD), and continuous training (CT) for in-house machine learning (ML) algorithms
- Building, designing, refactoring or optimising data lakes and data warehouses from a variety of data sources.
- Identify opportunities to re-use existing data flows
- Optimise code to ensure processes perform optimally
- Apply knowledge of systems integration to their work
- Support work on database management
- Liaise with data scientists, junior data engineers, data analysts and decision-makers such as product owners and business analysts to gather and analyse the data requirements
Basic qualifications required for this role:
- Bachelor’s degree in Computer Science, Engineering, Statistics, Mathematics or related field
- 3-5 years’ experience in data engineering
- Experience with different AWS services like Lambda, Glue, S3, Athena, DMS, Redshift, and ML tools
-
Demonstrable experience in European research projects (i.e. FP7, H2020)
- Good working knowledge of any of the following: SQL, Python, Scala
- Background in supporting data scientists in conducting large scale data analyses / modelling to support business decision making
- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
- Be self-driven and show ability to deliver on ambiguous projects with incomplete or messy data.
- An ability and interest in working in a fast-paced environment ·
- Strong verbal/written communication and data presentation skills, including an ability to effectively communicate with both business and technical teams
- Provide guidance and mentorship to other members of the team
Location: This position is open to candidates based in the UK
Salary: £40-50K
Hours: Full Time
Contract Type: Fixed Term or Permanent
In return you get:
- Flexible working hours / remote working options
- Competitive pension scheme
- A positive and supportive environment
This role is subject to security vetting, therefore all candidates must be eligible to work in the UK and have been resident in the UK for a minimum of 3 years.
To Apply please submit both your CV and a cover letter linking your experience to our requirements in order to have your application considered. References will be required prior to appointment. We will process applications on a rolling basis until the position is filled, hence we suggest to apply early.
At Trilateral Research, we value privacy and data protection rights. We have a longstanding data protection culture and promote robust ethical standards in data management and research ethics. Please read our Privacy Notice in relation to our recruitment activities before submitting your application to work with us.
For any questions about your personal data, feel free to contact us at dpo@trilateralresearch.com.
Trilateral Research is a UK and IE-based enterprise founded in 2004. Our teams include social scientists, data scientists, ethical, legal and human rights experts who work across the technology-social disciplinary divide. We apply rigorous, cutting-edge research when developing and assessing new technologies to ensure they achieve sustainable innovation and measurable impact.
Our culture is based on delivering high-quality outputs through our commitment and passion for what we do. We work in an open and collaborative environment where the team culture provides support amongst peers and colleagues. Find out about our people and our culture, and see how our mission drives the projects we take on, the key data protection services we provide, and the technology products and supplementary services we develop.
We are an Equal Opportunities employer and positively encourage applications from suitably qualified and eligible candidates, regardless of their age, sex, race, disability, sexual orientation, gender reassignment, religion or belief, marital/civil partnership status, or pregnancy and maternity. We are a Disability Confident committed and Living Wage employer.
Sign up for our newsletter
Join our mailing lists to receive updates about our latest research and to hear about our free public events and exhibitions. If you would like to find out more about how we manage your personal information please see our privacy policy.
Tech for Social Good
Our Research
Data Governance
UK
+44 (0)2070528285
info@trilateralresearch.com
One Knightsbridge Green, London SW1X 7QA, UK
IRELAND
+353 (0)51 833 958
info@trilateralresearch.com
2nd Floor Marine Point, Belview Port, Waterford, X91 W0XW, Ireland
Menu
