Senior Data Engineer
- Engineering
- Full-time
- London, GB
- Hybrid
- 85K - 100K GBP a year
Posted on May 28, 2024
Carbon Re is on a mission to abate gigatonnes of carbon emissions by applying intelligence to heavy industries.
We're seeking a senior data engineer to help us improve the design and performance of our ingestion pipelines.
You will have the opportunity to work on customer-facing systems, all the way through to front-end work if that excites you. You will be a part of our platform team, which is responsible for our customer-facing application, our cloud environment, and data ingestion and preparation.
We're fully hosted in AWS, and our ingest pipelines are serverless, comprising Lambda, S3, Athena, Glue, and Timestream. We deploy to production many times per day, practice TDD, and obsess over observability.
We offer a nurturing and safe environment, an excellent engineering culture, and the opportunity to fight climate change.
Your main responsibilities
Reporting to the Head of Engineering, you will:
Work on the platform team as an individual contributor, working on cloud and data engineering.
Help to design and improve our data ingestion and ML-Ops pipelines.
Work with the machine learning team to understand and advise on data quality and data access.
Requirements
You have 5 or more years of engineering experience, with at least 3 years of data engineering work.
You are comfortable with AWS, Terraform, and serverless systems.
You are fluent in Python, and have some exposure to dev-ops practice and TDD.
You have built large scale ETL pipelines, for both batch and real-time ingest.
You are hungry for responsibility, and have strong opinions, weakly held.
You'll excel if
You have prior experience of industrial IoT, particularly with respect to AWS and Greengrass
You have a degree in machine learning, physics, or chemistry
You have experience with Spark, Ray, Dask or other big-data processing systems
You have an analytical mind, and a working knowledge of statistics
You are used to working in a fast-paced startup environment, with an agile process
You are open to working in new technologies, and developing your software engineering skills.
You are not expected to check every box, and we’d love to hear from you even if your experience isn’t an exact match.
Location
London office or hybrid remote with 2 - 3 days in our London office each week
The interview process
We run a three part interview process. You can choose to interview remotely or on-site, but it’s easier to build rapport in person.
Intro Call - Meeting with Bob, head of engineering; or Bronte, people manager. We’ll have an introductory call with you to make sure that we’re aligned on salary and right to work, and to check any questions on your CV.
Technical Interview - We have a two-part technical interview, where you’ll meet some of our other engineers.
A pair-programming exercise. We’ll work with you to solve a TDD Kata in Python. We want to see how you solve a problem, and what you’re like to work with. You’re not expected to finish the exercise, you can use Google, and your pair can write code. This isn’t an exam, it’s a playful coding problem.
A system walk-through. We’ll ask you to draw a system that you helped to design and build and talk us through the major technical decisions. We want to know how well you communicate about technical issues, and how you think about system trade-offs.
Operating principles — Lastly, you’ll meet with other team members you will be working with and Josh, our CEO, or Buffy, our COO, to discuss how you like to work and how you align with Carbon Re’s Operating Principles.
In the same way we reference-check our candidates before making final offers, we offer you the opportunity to reference-check us by chatting informally with any team members you didn’t meet as part of the hiring process.
Once the interviews are over, we’ll try to make a decision as quickly as possible, and you can ask us for feedback on any stage.
About Carbon Re
Carbon Re is an AI product, research, and development company on a mission to remove Gigatonnes of CO2 emissions each year by focusing on some of the biggest emitting sectors, such as cement and steel. We leverage world-class expertise from UCL and Cambridge University in AI, energy efficiency, and industrial process improvement.
Our first product, Delta Zero Cement, enables cement producers to optimise their production processes, reducing fuel costs and emissions. In the longer term, we aim to achieve our ambitious mission by leveraging AI and machine learning to design novel industrial processes and speed up the development of new climate-friendly materials.
We recognise the value of bringing different views and perspectives to the table and feel strongly that this is key to developing a successful business. As such, we aim to build a truly diverse company that attracts people from a variety of backgrounds and with different skill sets.
How we operate
Our dream is to create a workplace where every single person is someone you’re genuinely inspired by; someone you respect and learn from. A place filled with lofty ambitions, lots of laughs and intense learning. To achieve this, we embed our operating principles in all that we do, and we expect that new joiners will do the same.
🏭 Concrete Honesty - Be honest — as concrete forms the foundation of our world, genuine honesty and transparency are our cultural bedrock.
📈Forever Optimising - Always look for ways to improve — we are in the process improvement game, we have high standards and we’re striving to improve.
⏩ Increase Torque - Move with urgency — Our world depends on us, we have a responsibility to find a way to move faster, always.
🔧 Maintain Reliability - Earn trust — Machines break, humans falter. We recognise that to inspire confidence in ourselves, we must earn our teammate’s trust.
Benefits
Equity in the form of share options
Flexible working arrangements
30 PTO days
Generous pension scheme
This is an ideal opportunity to be early into a growing software company that is applying cutting-edge AI technologies to make a meaningful impact on carbon emissions and climate change.
Equal opportunities
Carbon Re is an equal opportunity employer. We are still a small team and are committed to growing in an inclusive manner. We want to augment our team with talented, compassionate people irrespective of race, colour, religion, national origin, sexual orientation, gender identity, physical or mental disability, or age. We see our diversity as an asset as we tackle challenging problems through technology.
Remote restrictions
- Must be a resident of United Kingdom