In-Demand Data engineering lead (ai, analytics & platform) Jobs in Parramatta, Nsw

Senior Databricks Developer
AI Talent —Sydney NSW
- $70,000 - $120,000 a year
- Full-time
- Hybrid work
- Azure
- SQL
- Communication skills
- Work from home
Quick Apply
Technical Success Manager II
New Relic —Sydney NSW
- Hybrid work
- Sales
- SQL
- AWS
Senior Software Engineer
CoStar Group —Sydney NSW
- Full-time
- DevOps
- AWS
- APIs
Salesforce CRM Leader
Infosys Singapore & Australia —Sydney NSW
- Full-time
- Hybrid work
- CRM software
- Management
- Sales
Quick Apply
Intelligent Automation Architect
Datacom —Sydney NSW
- Full-time
- Hybrid work
- Management
- Scripting
- AI
Quick Apply
10d
New Business Manager
Intelligen Group —Sydney NSW
- $160,000 - $185,000 a year
- Full-time
- Hybrid work
- Business development
- AI
- Leadership
- Work from home
- Free food
Quick Apply
Director of Product Design - Business Accounts
Airwallex —Sydney NSW
- Full-time
- Hybrid work
- Computer Science
- Salesforce
- Research
Customer Success Manager - Sydney, Australia m/f/d
AB Tasty —Sydney NSW
- Full-time
- Hybrid work
- Management
Quick Apply
Client Account Executive
Elite Technology —Sydney NSW
- Hybrid work
- CRM software
- Salesforce
- Bachelor's degree
- Health insurance
- Dental insurance
Quick Apply
(Associate) Director, Account Management
Airwallex —Sydney NSW
- Full-time
- CRM software
- Sales
- Salesforce
Product Director, Payment Fraud
Airwallex —Sydney NSW
- Full-time
- Salesforce
- Bachelor's degree
- Product management

More jobs to discover

Find similar jobs that you might be interested in.

Technical Success Manager II
New Relic —Sydney NSW
Strong Communication Skills: Highly skilled in communicating complex technical concepts to diverse audiences, including non-technical stakeholders, through…
Account Manager II
PAC Panasonic Avionics Corporation —Alexandria NSW
Lead all sales efforts for assigned customers, including development of sales strategy, Profit & Loss statements, and customer proposals.
8d

I want to receive the latest job alert for data engineering lead (ai, analytics & platform) in parramatta, nsw

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

data engineering lead (ai, analytics & platform) jobs near parramatta, nsw

Senior Databricks Developer

AI Talent
Sydney NSW

Quick Apply

Job Details

Permanent | Full-time
$70,000 - $120,000 a year

Benefits

Visa sponsorship
Work from home

Qualifications

CI/CD
Cloud infrastructure
Azure
SQL
Terrafrom
Unity
Jenkins
Communication skills

Full Job Description

We're partnering with a vital leader in the Government Health sector, dedicated to optimising public health outcomes, resource allocation, and policy analysis through a modern, cloud-native data platform. For the right candidate with the necessary skills and experience, we are pleased to offer 482 visa sponsorship.

This client requires a Senior Databricks Developer to serve as a technical leader for their advanced Analytics and Research workloads. You will be instrumental in architecting and building highly scalable data pipelines using PySpark/Scala within the Databricks Lakehouse Platform. This role demands expertise in Delta Lake, performance optimisation, and ensuring strict data governance and security for sensitive patient data, adhering to all compliance and privacy regulations.

What You'll Do

Lead the design and development of large-scale, resilient, and performant ETL/ELT data pipelines using PySpark/Scala within Databricks notebooks and jobs.
Architect and manage the Delta Lake environment, focusing on data ingestion, quality enforcement (using Delta Live Tables or similar), and schema evolution for complex public health datasets.
Optimise Databricks clusters, notebooks, and Spark jobs for cost-efficiency and performance, specifically targeting bottlenecks in high-volume batch and streaming workloads.
Define and enforce data governance practises within the Lakehouse, utilizing Unity Catalogue for centralized metadata and access control, adhering to government standards.
Collaborate closely with government analysts and data scientists to transition analytical models and research findings into scalable, production-ready pipelines.
Champion CI/CD and MLOps practises for Databricks notebooks and workflows, utilizing tools like Azure DevOps or Jenkins.
Mentor and guide junior engineers on Databricks development standards, Spark optimisation, and modern data engineering practises.

What You'll Bring

6+ years of progressive professional experience in Data Engineering, with at least 3 years dedicated to developing solutions on the Databricks Platform.
Expert-level proficiency in PySpark and/or Scala for distributed data processing.
Mandatory hands-on experience with Delta Lake architecture, including DLT, time travel, and VACUUM operations.
Deep understanding of cloud infrastructure (Azure preferred) and how Databricks integrates with cloud storage (ADLS Gen2) and services.
Expert proficiency in SQL and dimensional modelling principles.
Proven experience with CI/CD, Infrastructure as Code (e.g., Terraform), and Databricks command-line tools for automation.
Exceptional communication and problem-solving skills, with the ability to analyse complex requirements and design resilient solutions in a highly regulated environment.

Pay: $70,000.00 – $120,000.00 per year

Benefits:

Work from home

Application Question(s):

Are you currently in Australia?
Are you looking for visa sponsorship?
How many years of experience do you have?

Work Location: Hybrid remote in Sydney NSW 2000

Quick Apply

Refine Your Search

data engineering lead (ai, analytics & platform) jobs in parramatta, nsw

Senior Databricks Developer

Technical Success Manager II

Senior Software Engineer

Salesforce CRM Leader

Intelligent Automation Architect

New Business Manager

Director of Product Design - Business Accounts

Customer Success Manager - Sydney, Australia m/f/d

Client Account Executive

(Associate) Director, Account Management

Product Director, Payment Fraud

More jobs to discover

I want to receive the latest job alert for data engineering lead (ai, analytics & platform) in parramatta, nsw

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected