Employment OS for your Business

Senior Data Engineer (Databricks/Azure) – Hybrid, QLD

DE Team • Queensland, Australia • Full-time
AI Job Summary
  • At least 3 years in Databricks, including Lakehouse architecture, Delta Lake, and Spark-based pipeline design/optim.
  • Hands-on experience with Microsoft Fabric (Lakehouse, OneLake, Data Factory, Power BI).
  • Experience with Azure services including Azure SQL, Azure Data Factory, and Synapse Analytics.

Role Type

Permanent • Full-time • Mid-level Senior

Description

About Us

At Agile Insights, we are passionate about empowering organisations to transform through the power of Data & AI. We work with global brands and leading organisations to deliver innovative solutions that solve real business challenges. We have a fantastic, long-standing relationship with Microsoft. We are extremely proud to be a Microsoft Solutions Specialist for four competencies including: Data Analytics and AI, Azure and Digital & App Innovation.

The Role

We’re seeking an experienced Senior Data Engineer (Databricks & Azure) with expertise across:

  • Databricks (Lakehouse architecture, Delta Lake, Spark-based pipeline design and optimisation) — Databricks is the primary focus of this role.
  • Microsoft Fabric (Lakehouse, OneLake, Data Factory, Power BI) — hands-on Fabric experience is highly regarded.
  • Azure data platform (Azure SQL, Azure Data Factory, Synapse Analytics).
  • Strong Python and SQL, with experience in CI/CD and DevOps practices (Git, Azure DevOps).
  • Supporting enterprise data migration and transformation programs.
  • Strong problem-solving skills and ability to work in collaborative project teams.
  • This is a hybrid role based in Queensland — you’ll spend a few days each week in the Agile Insights office and/or client offices, with the balance working from home.

What’s In It for You?

At Agile Insights, we believe in nurturing talent and creating a supportive, flexible, and rewarding workplace. Here’s what you can look forward to:

  • Wellbeing: Access to hybrid work arrangements, an Employee Assistance Program, and an individualised gym and wellbeing program.
  • Flexibility: Work from anywhere for up to 6 weeks per year.
  • Professional Development: Additional paid leave for certifications and exams, with Agile-sponsored training programs for Microsoft and Databricks certifications.
  • Team Engagement: Enjoy regular team meetups, including state-based gatherings and an annual all-company event.
  • Equipment & Hardware: Receivean allowance for your home office setup and a 2-year equipment incentive.
  • Salary Packaging: Access novated leasing services for tax-effective car purchases.
  • Learning Resources: Expand your skills with access to our digital library and learning platforms. Opportunity to work with some of the best developers in the business including one on one mentoring with senior consultants.

Why Agile Insights?

Work with some of the largest clients and global brands across diverse industries. Be part of a fast-growing, award-winning team passionate about transforming organisations with Data & AI. Thrive in a friendly start-up culture that values innovation, collaboration, and work-life balance.

Ready to Lead with Us?

If you’re passionate about data engineering, modern data platforms, and consulting, we’d love to hear from you.

Apply now to join Agile Insights and take your career to the next level!

No agencies – No overseas applications – Must be based in Queensland and have full Australian work rights