Workaline

source{d}

Lead Infrastructure Engineer

source{d} published 7 days ago

€56k - 58k | Equity

Senior, Lead, Manager, Full-time

Madrid, Spain

Lead Infrastructure Engineer

source{d} | Madrid, Spain
€56k - 58k | Equity Remote Visa sponsor Paid relocation

About this job

Job type: Full-time
Experience level: Senior, Lead, Manager
Role: DevOps, System Administrator
Industry: Enterprise Software, Machine Learning, Software Development / Engineering
Company size: 11–50 people
Company type: VC Funded

Remote details

Office Location: Madrid, Spain. Employees can also work full time from this office.
Visa Sponsorship: Yes
Relocation Assistance: Yes

Technologies

Job description

At source{d} we are building the technology stack for the next generation of Machine Learning powered developer tools. We are an open-core company built around our Open Source projects. We have raised over ten million USD so far, and we are currently growing our team.

This position is open to those wishing to work remotely between the San Francisco and Moscow Timezones as well as those who want to work from our Madrid Office.

Role

This position is for a Lead Engineer in the Infrastructure team. The team has currently 3 members.

The Infrastructure team manages multiple clusters:

  • Pipeline clusters, built on bare metal servers at a hosting provider. It has more than 1000 threads, more than 6TB of RAM and 500TB of storage, and it is backed by CoreOS and Kubernetes. It has two main goals: on the one hand, it stores all the available public code in a distributed filesystem and on the other hand, it runs intensive computation jobs over the stored data on top of Apache Spark.
  • Machine Learning research cluster, built on bare metal servers at our Madrid office. It is backed by CoreOS and Kubernetes too and it has GPUs available on every server to run deep learning algorithms.
  • Multiple Google Kubernetes Engine clusters for public-facing services. All clusters are managed with Terraform, Kubernetes and Helm.

The team also maintains several services such as databases, queues, continuous integration, monitoring, logging, etc.

At source{d}, we care about Open Source, which is why we as the infrastructure team we contribute to projects such as Terraform & CoreOS and create our own. We maintain the official Terraform provider for Helm (terraform-provider-helm).

We are looking for someone with a background in Linux, networking and containers, passion for automation and experience working at scale. Finally, knowledge of at least one backend/scripting language who cares about best development practices.

Life at source{d}

About source{d}

Engineering consists of five different teams that represent the architecture of our product:

  • Applications (Scala, Go, Python, and Frontend tools): Builds CLI/Web applications combining ML research with our stack.
  • Machine Learning (C++ and Python): Performs R&D for Machine Learning on Source Code.
  • Data Retrieval (Scala and Go): Builds the technology that finds, fetches, stores and analyzes over +60M Git repositories.
  • Language Analysis (Go and another +15): Focused on Babelfish, the universal code parsing server.
  • Infrastructure (Go and Python): Manages a cluster of on-prem bare metal servers with Kubernetes and CoreOS, and GCP for user facing applications.

We care about Open Source. Everything we develop is available for anyone to read, modify, and contribute (under Apache 2.0 or GPL3 license). Some examples of our projects are:

  • bblfsh/bblfshd: Babelfish server, turning code into Universal Abstract Syntax Trees (UASTs).
  • src-d/engine: a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.
  • src-d/go-git: a highly extensible Git implementation in pure Go.
  • src-d/ml: a library to build and apply Machine Learning models on top of Universal Abstract Syntax Trees.

Benefits

  • Fully flexible working hours as well as remote working
  • 37 days paid vacation
  • Full relocation package if you decide to relocate to Madrid
  • 10% of your working time to contribute to Open Source Days
  • We buy you any books that can help you be even better at your job
  • Our kitchen is always full, from beer and sodas to fruit and ice cream
  • Monthly get-togethers, Summer and Winter parties & annual retreat
  • We host quarterly Tech Talks, as well as 3rd-party talks at the office
Learn more about source{d}
Lead Infrastructure Engineer at source{d}