Lead Data Engineer - Databricks (Brisbane)

Lead Data Engineer
- Databricks As a key member of our Data Engineering team, you will lead the design and deployment of data projects, develop data pipelines, and build data models and advanced queries to help our clients harness the power of data. Responsibilities
- Design and implement greenfield solutions, as well as recommending and implementing changes to existing solutions.
- Build and deploy modern data architectures (Medallion/Lakehouse) primarily on Databricks, utilizing cloud platforms like AWS, Azure, or GCP.
- Define and establish technical architectures and delivery frameworks, ensuring a clear, shared vision across the team and stakeholders.
- Have responsibility for the deliverables and efforts of project teams, collaborating with other Leads or Principals when necessary.
- Define the data strategy for AI within the data domain, setting the standards for feature governance, data quality, and data lineage required for robust ML systems.
- Balance thorough, best‑practice implementations with pragmatic solutions, depending on project timelines.
- Be deeply familiar with the Scope of Work, understanding how to achieve commercial success of your project.
- Ensure quality of work is maintained through mentoring and up‑skilling of others.
- Show outstanding consulting, technical and project management skills; stay at the forefront of relevant technologies through continuous development, including certifications; share learnings with the team.
- Educate clients and potential clients about Mantel's Databricks offerings relative to the overall strategy, participate in pre‑sales activities such as creating proposals/SoWs and facilitating walk‑throughs with clients.
- Build meaningful and trusted relationships with clients, key decision makers and partners; establish your reputation and influence as a data expert.
- Lead teams by demonstrating Mantel's principles and attributes. Qualifications
- Strong consulting experience, either with external clients or internally within an organisation.
- Commercial data experience across different industries and domains.
- Ability to engage with senior level stakeholders and have a broad influence in the internal and client teams.
- Experience in establishing technical architecture and leading the delivery of technical projects and project teams.
- Prior experience leading greenfield projects and maintaining high-quality work throughout all project phases.
- Technical brilliance across a broad range of cloud‑native services.
- Expertise in a broad range of data engineering approaches, Lakehouse architecture and Spark‑based processing.
- Proficiency in data languages: SQL, Python (PySpark) or Scala; deep understanding of the Spark engine is a significant plus.
- Demonstrable leads end‑to‑end data engineering projects, including automation best practices for CI/CD and IaC.
- Hands‑on experience with Databricks (Workflows, Unity Catalog, Delta Live Tables) and modern cloud ecosystems (AWS/GCP/Azure).
- Knowledge of data security best practices and data quality frameworks to ensure data integrity and consistency.
- Ability to explain technical concepts regardless of the audience.
- We value diverse skill‑sets; if you cover the majority of the experiences/skills listed we still encourage you to apply. What you can expect from us
- You’ll have a flexible work program allowing you to tailor your yearly plan to what’s most important to you, including professional development, annual leave, side‑hustle time, or other priorities.
- You’ll receive a new phone, laptop & other equipment.
- Access to Mantel’s AI first tools, including a monthly budget for experimenting and a secure platform with multiple AI models.
- Supportive work workplace with flexible personal leave options and adaptable hybrid work arrangements guided by principles.
- Opportunities for career growth across Cloud, Data, Digital, Delivery & Security internally.
- Collaboration with world‑class partners on high‑profile projects.
- Mantel is a certified Family Inclusive Workplace, supporting flexible work, parental leave, family care and wellbeing. #J-*****-Ljbffr #J-18808-Ljbffr Apply on Kit Job: kitjobau.com/job/3rvdbb