Big Data Engineer (EU) - Remote at Leap
Utrecht, The Netherlands
Applications are now closed
Get more jobs like this straight to your inbox
Leap’s mission is to combat climate change by enabling a reliable electric grid that runs on clean energy. The electric grid is transforming from dirty (but predictable) fossil fuels to clean (but less predictable) renewable energy. To do so, the grid needs more flexible demand and supply to help maintain stability and reliability.
Leap plays a crucial role in opening up wholesale energy markets to all distributed energy resources, enabling our partners to get paid for providing flexibility to the grid.
Leap is a privately-held tech company with funding from top VCs and well-known energy entrepreneurs. Our core operations are in the San Francisco Bay Area and Utrecht (NL), but we are a distributed workplace with teammates based in Atlanta, Boston, Boulder, Chicago, Maui, and Washington, DC.
Your Role: Big Data Engineer (EU+)
You build the infrastructure that provides and manages the data that is the lifeblood of our company. You manage and extend an ever-growing ecosystem of pipelines and enable engineers and users to access, track and use data with tools like Dremio, Looker and DataHub. In general, you write code for PySpark and Airflow and manage our AWS data infrastructure -- you are used to thinking about the challenges of complex calculations on very large datasets. Of course, you work in a team so you review your colleagues code and spend time talking to them about problems, the data platform architecture and your favorite hobbies!
For example, you might have to work on the PySpark code that calculates the (meter load) baseline for a certain market. Or, you might extend how we do data quality checks with new techniques like SPC. You might be writing terraform code to upgrade our Airflow server or setup a Marquez server.
The job is not only writing code and updating issues: our organization is fairly flat and data engineers are expected to be proactive and communicative. If there’s a piece of our system that you don’t think is good, you speak up, talk with the rest of the team and make the fix! When an analyst or other user comes to you, you’re able to ask them questions to make them think a little more and point them in the right direction -- or work on the issue yourself and make a ticket for it to be tracked.
You enjoy working together with others on problems but can also easily pick up tasks independently. You’re more concerned with learning than making mistakes -- after all, you can’t do one without the other. You're able to think about complicated pipelines, systems and algorithms. Depending on your level, you should also be comfortable talking directly with the product manager and managing large epics of issues. You're considerate of others but also express your opinions clearly.
- You live in the EU in a timezone that is fully UTC, UTC+1 or UTC+2
- A minimum of 2 years of work experience with Spark or Pyspark
- A diploma from a Bachelor or Master in a technical field, such as Computer Science or AI.
- A minimum of 1 year of experience as a data engineer and at least 3 years as a data engineer or software engineer
- Experience with a big data architectures in AWS
- Experience with governance and related aspects of managing a large collection of datasets
- Multiple years of experience with spark and/or data engineering
- Experience with Terraform or Airflow
What is offered?
- A salary based on knowledge, experience and location
- Stock options
- 32, 36 or 40 hours/week
- When working remotely, work when you want to as long as there is some overlap with colleagues
- Both remote work and working at the office are possible
- No official limit on vacation days (previously, the minimum was 25)
- Social team building events
- Pension arrangement
- Choice of laptop
What’s it like to work at Leap?
Product: At our core we are a tech company. We love technical challenges and build things that we are proud of and would like to use ourselves. Everyone is highly involved in building and designing our products, making them extremely valuable and a pleasure to use.
Purpose: Some of us worked in energy before, some of us haven’t. All of us would like to make a difference and do our part in helping the world move towards a more resilient grid run on renewable energy.
Fun: We work hard, but enjoy our time at work as well as outside of work. With the team spread out over multiple time zones we also embraced flexibility early on, and are focused on results instead of time spent in the office.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Applications are now closed