Senior Data Engineer (Microsoft Fabric / Azure) – Hybrid, Sydney preferred

About Us

At Agile Insights, we are passionate about empowering organisations to transform through the power of Data & AI. We are an independent, Australian-owned consulting firm and one of Australia’s leading Microsoft Data & AI partners — placed in the top 1% globally for Microsoft Data and AI expertise. We are a Microsoft Solutions Partner and Trusted Advanced Specialisation Partner, as well as a Databricks and ESRI partner.

We work with government agencies and mid-to-large enterprises across energy and utilities, financial services, healthcare, education, local government, retail, and transport — delivering modern data platforms, analytics, governance, and AI solutions end to end.

The Role

We’re seeking an experienced Senior Data Engineer to design and build modern data platforms on Microsoft Fabric, working across multiple clients and projects as part of our Data & Analytics Practice.

Sydney is our preferred location, but we will consider strong candidates based in other Australian states.

What you’ll bring (essential)

• Microsoft Fabric — hands-on delivery experience across Lakehouse, OneLake, Data Factory / pipelines, Notebooks, Warehouse, and semantic models. Fabric is the primary technology for this role.
• Azure data platform — Azure Data Factory, Azure SQL, Synapse Analytics, Azure Storage.
• Strong Python and SQL, including Spark-based transformation and performance tuning.
• Modern data architecture — lakehouse and medallion patterns, dimensional modelling, batch and incremental ingestion, data quality.
• CI/CD and DevOps practices — source control and deployment pipelines using Azure DevOps and/or GitHub (Git branching strategies, automated deployment of data assets, environment promotion).
• Power BI — building and optimising datasets and reports on top of the platforms you deliver.
• Consulting delivery experience — comfortable working directly with clients, running workshops, and balancing multiple concurrent projects and priorities.
• Strong teamwork and communication — you work collaboratively in project teams, share knowledge, mentor others, and communicate confidently with both technical and business stakeholders.
• Experience supporting enterprise data migration and transformation programs.
• Full, unrestricted Australian work rights and based in Australia.

Nice to have

• Databricks — Lakehouse architecture, Delta Lake, Spark pipeline design and optimisation, Unity Catalog.
• Microsoft Purview — data governance, Data Hub / Unified Catalog, data quality, lineage, classification, sensitivity labelling, and compliance.
• Real-time / streaming data processing.
• Experience delivering into Australian government or other regulated environments.
• Microsoft and/or Databricks certifications (e.g. DP-600, DP-700).

Ways of working

This is a hybrid role, based in Sydney by preference (other Australian states considered). In line with company direction, you’ll spend a few days each week at the Agile Insights office and/or client offices, with the balance working from home.

What’s In It for You?

At Agile Insights, we believe in nurturing talent and creating a supportive, flexible, and rewarding workplace. Here’s what you can look forward to:

• Wellbeing: Access to hybrid work arrangements, an Employee Assistance Program, and an individualised gym and wellbeing program.
• Flexibility: Work from anywhere for up to 6 weeks per year.
• Professional Development: Additional paid leave for certifications and exams, with Agile-sponsored training programs for Microsoft and Databricks certifications.
• Team Engagement: Enjoy regular team meetups, including state-based gatherings and an annual all-company event.
• Equipment & Hardware: Receive an allowance for your home office setup and a 2-year equipment incentive.
• Salary Packaging: Access novated leasing services for tax-effective car purchases.
• Learning Resources: Expand your skills with access to our digital library and learning platforms. Opportunity to work with some of the best developers in the business including one on one mentoring with senior consultants.

Why Agile Insights?

Work with some of the largest clients and global brands across diverse industries. Be part of a fast-growing, award-winning team passionate about transforming organisations with Data & AI. Thrive in a friendly start-up culture that values innovation, collaboration, and work-life balance.

Ready to Join Us?

If you’re passionate about data engineering, modern data platforms, and consulting, we’d love to hear from you.

Apply now to join Agile Insights and take your career to the next level!

No agencies – No overseas applications – Must be based in Australia (Sydney preferred) and have full Australian work rights