Senior Data Engineer (PySpark)

As a Senior Data Engineer, be responsible for building high-quality, scalable data pipelines, defining robust data architectures, and driving quality and performance across the entire stack. More specifically, you will:

• Design, implement, and optimise robust data pipelines using PySpark and Apache Spark.
• Set up and guide architectural decisions using modern data platforms like Databricks.
• Apply best practices across batch and streaming data processing to support data-driven initiatives
• Drive collaboration with cross-functional stakeholders in a large enterprise setting—ideally you have experience within banking, insurance, or financial services
• Collaborate within a cross-functional, international team in a fast-paced enterprise environment
• Possibly mentor and guide junior engineers

Position Requirements

We highly value individual experience and are not only interested in ticking boxes, nevertheless, there are some essential skills required to get the job done:

• Bachelor's degree in Computer Science or a relevant field.
• 5+ years of experience in Data Engineering, with strong expertise in PySpark, Spark, and distributed computing
• Strong command of SQL, including optimisation, window functions, and complex transformations
• Experience with Databricks and or other low-code enterprise data platforms.
• Deep familiarity with data architectures (data lakehouse, warehouse, streaming systems)
• Strong scripting skills in Python for data transformation and automation
• Solid understanding of data quality, schema evolution, and monitoring best practices.
• Experience with version control systems (Git).
• English Proficiency, both spoken and written
• Resident and eligible to work in Portugal

Nice skills to have will be

• Familiarity with Azure Cloud (certification preferred)
• Experience as a backend or full-stack developer (e.g. Python / Node.js / Java / C# / C++)
• Understanding of Lambda/Kappa architectures and their application to real-time analytics
• Solid grasp of CI/CD
• Experience with containerization (Docker, Kubernetes)
• Proven experience leading or mentoring teams in corporate environments
• Agile delivery experience

What’s in it for you?

• Competitive salary (negotiable based on experience) as we value top talent.
• Cutting-edge hardware: A high-performance laptop with ample memory and processing power, along with any peripherals you need.
• A dynamic and collaborative work environment where your leadership will shape the team’s future.
• Opportunities for professional development and ongoing training to keep you at the forefront of technology.
• A comprehensive health insurance package and attractive benefits.
• Quarterly team get-togethers for collaboration, innovation, and fun!
• A welcoming and inclusive workplace where we embrace diversity and creativity.

Work Setup

• You will have the option of working in either of our offices (Évora or Lisbon), or from the comfort of your home. Many of us work remotely.
• The main point is that you’ll be in touch with a great team who really enjoy working together.

Apply using the form below