Description
ROLE: Data Engineer- Data AnalyticsLOCATION: Melbourne, VICREPORTS TO: Head of Data and processThis role is responsible for the day-to-day operational management of ZEN Energy’s core enterprise data platform, ensuring data integrity, reliability, and quality standards that enable ZEN’s data analytical, modelling and reporting needs with confidence.You will be working closely with internal and external stakeholders, and delivery partners as the role contributes to the ongoing evolution of ZEN’s data architecture and engineering practices, helping to maintain excellence in data design, integration, and operational processes as the platform continues to grow and mature.Key Responsibilities:•Develop and maintain our data platform including:o Our data-lake (based on Azure Databricks)o Our transactional databaseso The flow of data into and between these systems•Support business users with access to the data that they need and understanding their data.•Ensure the ongoing correctness, integrity and security of our data.•Work closely with stakeholders to understand their data needs and design data solutions to meet those needs.oTroubleshoot and resolve data related issues including:o Investigation and resolution of data and pipeline issueso Root cause analysis of ongoing data issues and development of remediations•Develop and maintain documentation defining how data is stored and how data flows between data subsystems. This should include high level / logical description of data entities as well as detailed entity/relation diagrams.•Collaborate with developers and peers in the maintenance and development of data driven applications.•Participate in peer design and coding reviews.•Collaborate and work with data analysts in the business.•Manage relevant aspects of our data platform including:o Data quality and delivery timelinesso Performanceo Backup and availability managemento Cost analysis and managemento Security management•Work with vendors and other support providers to meet data management needs.•Undertake work in accordance with ZEN’s design and coding standards, security standards and agreed SDLC processes.As part of the ZEN team, you will be curious, have a bold imagination, strive to be your best in everything you can do and be ready to laugh and have fun at work.Education and Qualifications•A degree in computer science, engineering, mathematics or an appropriate field.Experience•3 or more years of experience in data engineering and/or software developmentTechnical Skills – Required•Strong proficiency in data modelling, particularly for analytical and time-series datasets•Strong proficiency in SQL and Python•Hands-on experience with data lake / Lakehouse platforms (e.g. Databricks)•Strong experience with Spark (PySpark preferred)•Experience with relational databases such as PostgreSQL and SQL Server•Experience with data orchestration tools (preferably Azure Data Factory)•Strong analytical and problem-solving skills, with the ability to work with complex datasets•Effective communicator able to work across technical and non-technical stakeholdersTechnical Skills – Desirable•Experience working in energy markets, utilities, or trading environments (electricity, gas, renewables, or related)•Familiarity with energy market data such as pricing, forecasts, settlements, or meter data•Knowledge of Azure cloud services•Background in mathematics, engineering, or a related discipline•Experience in energy markets or financial trading environments•Familiarity with Terraform, Azure DevOps, and CI/CD pipelines•Additional programming experience such as C#(.NET)Personal and Professional Capabilities•Comfortable working in time-critical, data-intensive environments with evolving requirements•High levels of initiative, ownership, and accountability•Strong professionalism, integrity, and ethical judgement•Excellent interpersonal and communication skills, including constructive conflict management•Proven ability to work independently and deliver outcomes end-to-end•Strong attention to detail and consistency in meeting deadlines•Alignment with ZEN’s values, reflected in day-to-day behaviours and ways of working
