In-Demand Engineering lead (ai, analytics & platform) Jobs in Parramatta, Nsw

Senior Databricks Developer
AI Talent —Sydney NSW
- $70,000 - $120,000 a year
- Full-time
- Hybrid work
- Azure
- SQL
- Communication skills
- Work from home
Quick Apply
Principal Product Manager - Discovery & Onboarding(Exchange)
Crypto.com —Sydney NSW
- Full-time
- Remote
- Mechanic experience
- SQL
- Product management
- Health insurance
- Annual leave
Quick Apply
Technical Success Manager II
New Relic —Sydney NSW
- Hybrid work
- Sales
- SQL
- AWS
New Business Manager
Intelligen Group —Sydney NSW
- $160,000 - $185,000 a year
- Full-time
- Hybrid work
- Business development
- AI
- Leadership
- Work from home
- Free food
Quick Apply
Data Architect
InterWorks —Sydney NSW
- Remote
- Azure
- Computer Science
- SQL
- Health insurance
- Gym membership
Quick Apply
Senior Software Engineer
CoStar Group —Sydney NSW
- Full-time
- DevOps
- AWS
- APIs
Client Account Executive
Elite Technology —Sydney NSW
- Hybrid work
- CRM software
- Salesforce
- Bachelor's degree
- Health insurance
- Dental insurance
Quick Apply
Data Governance - Senior Consultant
Intelligen Group —Sydney NSW
- $120,000 - $170,000 a year
- Full-time
- Hybrid work
- AI
- Communication skills
- Analytics
Quick Apply
Senior Data Analyst
Livewire Markets —Barangaroo NSW
- Full-time
- Hybrid work
- SQL
- AI
- Communication skills
Quick Apply
Salesforce CRM Leader
Infosys Singapore & Australia —Sydney NSW
- Full-time
- Hybrid work
- CRM software
- Management
- Sales
Quick Apply
Cloud Architect
Capgemini —Sydney NSW
- Hybrid work
- Azure
- DevOps
- Agile
Director of Product Design - Business Accounts
Airwallex —Sydney NSW
- Full-time
- Hybrid work
- Computer Science
- Salesforce
- Research
Data Architect
Probe CX —Sydney NSW
- Full-time
- Azure
- SQL
- AWS
(Associate) Director, Account Management
Airwallex —Sydney NSW
- Full-time
- CRM software
- Sales
- Salesforce
Product Director, Payment Fraud
Airwallex —Sydney NSW
- Full-time
- Salesforce
- Bachelor's degree
- Product management
Product Lead, Payment Fraud
Airwallex —Sydney NSW
- Full-time
- Salesforce
- Bachelor's degree
- Product management

I want to receive the latest job alert for engineering lead (ai, analytics & platform) in parramatta, nsw

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

engineering lead (ai, analytics & platform) jobs near parramatta, nsw

Senior Databricks Developer

AI Talent
Sydney NSW

Quick Apply

Job Details

Permanent | Full-time
$70,000 - $120,000 a year

Benefits

Visa sponsorship
Work from home

Qualifications

CI/CD
Cloud infrastructure
Azure
SQL
Terrafrom
Unity
Jenkins
Communication skills

Full Job Description

We're partnering with a vital leader in the Government Health sector, dedicated to optimising public health outcomes, resource allocation, and policy analysis through a modern, cloud-native data platform. For the right candidate with the necessary skills and experience, we are pleased to offer 482 visa sponsorship.

This client requires a Senior Databricks Developer to serve as a technical leader for their advanced Analytics and Research workloads. You will be instrumental in architecting and building highly scalable data pipelines using PySpark/Scala within the Databricks Lakehouse Platform. This role demands expertise in Delta Lake, performance optimisation, and ensuring strict data governance and security for sensitive patient data, adhering to all compliance and privacy regulations.

What You'll Do

Lead the design and development of large-scale, resilient, and performant ETL/ELT data pipelines using PySpark/Scala within Databricks notebooks and jobs.
Architect and manage the Delta Lake environment, focusing on data ingestion, quality enforcement (using Delta Live Tables or similar), and schema evolution for complex public health datasets.
Optimise Databricks clusters, notebooks, and Spark jobs for cost-efficiency and performance, specifically targeting bottlenecks in high-volume batch and streaming workloads.
Define and enforce data governance practises within the Lakehouse, utilizing Unity Catalogue for centralized metadata and access control, adhering to government standards.
Collaborate closely with government analysts and data scientists to transition analytical models and research findings into scalable, production-ready pipelines.
Champion CI/CD and MLOps practises for Databricks notebooks and workflows, utilizing tools like Azure DevOps or Jenkins.
Mentor and guide junior engineers on Databricks development standards, Spark optimisation, and modern data engineering practises.

What You'll Bring

6+ years of progressive professional experience in Data Engineering, with at least 3 years dedicated to developing solutions on the Databricks Platform.
Expert-level proficiency in PySpark and/or Scala for distributed data processing.
Mandatory hands-on experience with Delta Lake architecture, including DLT, time travel, and VACUUM operations.
Deep understanding of cloud infrastructure (Azure preferred) and how Databricks integrates with cloud storage (ADLS Gen2) and services.
Expert proficiency in SQL and dimensional modelling principles.
Proven experience with CI/CD, Infrastructure as Code (e.g., Terraform), and Databricks command-line tools for automation.
Exceptional communication and problem-solving skills, with the ability to analyse complex requirements and design resilient solutions in a highly regulated environment.

Pay: $70,000.00 – $120,000.00 per year

Benefits:

Work from home

Application Question(s):

Are you currently in Australia?
Are you looking for visa sponsorship?
How many years of experience do you have?

Work Location: Hybrid remote in Sydney NSW 2000

Quick Apply

Refine Your Search

engineering lead (ai, analytics & platform) jobs in parramatta, nsw

Senior Databricks Developer

Principal Product Manager - Discovery & Onboarding(Exchange)

Technical Success Manager II

New Business Manager

Data Architect

Senior Software Engineer

Client Account Executive

Data Governance - Senior Consultant

Senior Data Analyst

Salesforce CRM Leader

Cloud Architect

Director of Product Design - Business Accounts

Data Architect

(Associate) Director, Account Management

Product Director, Payment Fraud

Product Lead, Payment Fraud

I want to receive the latest job alert for engineering lead (ai, analytics & platform) in parramatta, nsw

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected