Senior Data Engineer, Azure Databricks
About the Role
Our client is a well-established data and integration consultancy with offices across New Zealand and Australia. They're building a Wellington hub and need a Databricks specialist to help lead the way.
You'll deliver data solutions for a range of clients, report to the Data Practice Lead, and work closely with project teams and client stakeholders. This is a hands-on role with a design element. You'll build the solution, and you'll also explain to the client why it was built that way.
What You'll Be Doing
You're a Databricks specialist who likes being close to the build. You've probably worked in an internal data team or a client-facing role, where you owned the outcome and not just a piece of the platform. You're comfortable in front of a client and curious about what's next.
What's on Offer
Does this sound like you? We'd love to hear from you. If you're strong in Databricks but don't tick every box, apply anyway. We're happy to talk through where you fit, and we recruit across other levels too.
#SCR-joel-norris
About the Role
Our client is a well-established data and integration consultancy with offices across New Zealand and Australia. They're building a Wellington hub and need a Databricks specialist to help lead the way.
You'll deliver data solutions for a range of clients, report to the Data Practice Lead, and work closely with project teams and client stakeholders. This is a hands-on role with a design element. You'll build the solution, and you'll also explain to the client why it was built that way.
What You'll Be Doing
- Building and delivering Lakehouse solutions on Azure Databricks for client projects
- Developing PySpark and SQL pipelines using Medallion architecture principles
- Designing solution architecture and talking clients through your decisions
- Setting up CI/CD pipelines and sound engineering practices across projects
- Writing data quality checks and automated tests so issues are caught before production
- Reviewing existing systems and proposing improvements
- Sharing best practice with team members and client stakeholders
- Around 5 to 7 years in data engineering, with deep hands-on Azure Databricks experience
- Strong PySpark and SQL skills
- Solid architecture fundamentals, including Lakehouse and Medallion design
- Experience working with Azure data services such as Azure Data Lake and Azure Data Factory
- Clear, confident communication, including explaining technical choices to non-technical stakeholders
- A track record of end-to-end delivery, from design through to production
- Python experience
- Microsoft Fabric exposure
- CI/CD experience with Git and Azure DevOps
- Infrastructure as Code experience with Terraform or Bicep
You're a Databricks specialist who likes being close to the build. You've probably worked in an internal data team or a client-facing role, where you owned the outcome and not just a piece of the platform. You're comfortable in front of a client and curious about what's next.
What's on Offer
- Hybrid working, with arrangements shaped around client needs
- Hot-desk space in Wellington as the new hub gets established
- Paid certifications and support for training on Azure and Databricks
- Varied client projects, so you keep building new skills
- Offices across Christchurch, Auckland, Melbourne and Brisbane, and a team that supports your growth
Does this sound like you? We'd love to hear from you. If you're strong in Databricks but don't tick every box, apply anyway. We're happy to talk through where you fit, and we recruit across other levels too.
#SCR-joel-norris
Employer questions
Your application will include the following questions:
- Which of the following statements best describes your right to work in New Zealand?
- How many years' experience do you have as a Data Engineer?
Report this job advert
Be carefulDon’t provide your bank or credit card details when applying for jobs.Learn how to protect yourself
Report this job ad
What can I earn as a Data Engineer
See more detailed salary information