RemoteFull time

Senior Data Engineer

Several people around the world are doing investments right now. but have you ever thought that maybe those people, (even yourself), are losing money and opportunities because they don't ask the right questions? That's where my client comes in! They are a VC-backed data innovation startup. They transform raw data into a source for business and investment professionals to ask better questions so they can make better decisions. They believe, in the right hands, data has the power to change the way we work.

They work in a DevOps environment where teams own their code and infrastructure in Production.

The technologies they use but are not limited to Google Cloud Platform, Scala, Python, Docker, and Kubernetes.

They favor type-safe and functional programming languages, we tend towards Scala for building distributed data pipelines.

Your Daily Basis:

  • Collaborate with teams in the development and delivery of new product features across a multitude of datasets;
  • Build and maintain integrated data pipelines, systems, and internal tooling in functional Scala, Python, and SQL to power the company’s products;
  • Define ETL/ELT logic for processing terabytes of raw data, including writing scripts, calling APIs, writing BigQuery SQL, Dataflow (Apache Beam) and Spark;
  • Ensure high data duality and pipeline stability and of course: Troubleshooting.

Requirements:

  • Programming experience in Scala/Java, Python, SQL, and Bash.
  • ETL full process, Git, SQL, and some knowledge in GCP or AWS, code reviews and CI/CD, Dataflow, Apache Airflow

They offer several benefits and career path opportunities and they are pretty flexible about the salary range.

P.S This Job role is remotely inside Europe but it is NOT open to sponsorship.

Don't be caught up about having all the requirements, we can always sort things out.

If it sounds like you, apply here or send me an email at mande@ninedots.io

Get notified about your perfect job

Send us your CV and we'll message you when we find a good match.

upload CV