In-Demand Databricks engineer Jobs in Parramatta, Nsw

Data and AI Architect
EPAM Systems, Inc. —Sydney NSW
- AI
2h
DevOps Engineer
Alinta Energy —Sydney NSW
- Full-time
- Hybrid work
- Azure
- DevOps
- Scripting
- Employee assistance program
10d
Staff AI Application Security Engineer
Relevance AI —Sydney NSW
- Full-time
- Hybrid work
- AWS
- APIs
- AI
- Parental leave
- Employee assistance program

More jobs to discover

Find similar jobs that you might be interested in.

DevOps Engineer - Rancher / SUSE Products
Darumatic —Sydney NSW
Troubleshoot and resolve issues related to Rancher, Kubernetes nodes, workloads, and networking. Version control all infrastructure-related code and promote…
Quality Engineer - AI (12 Months Contract)
Tyro Payments —Sydney NSW
Execute functional and non-functional testing activities as required to support delivery quality, regardless of whether they are performed manually or through…
4d

I want to receive the latest job alert for databricks engineer in parramatta, nsw

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

databricks engineer jobs near parramatta, nsw

Devops Engineer jobs in Sydney NSW

Application Security Engineer jobs in Sydney NSW

Devops Engineer jobs in Liverpool Nsw

Devops Engineer jobs in Perth Wa

Devops Engineer jobs in Bathurst Nsw

Structural Engineer jobs in Brisbane Qld

Network Engineer jobs in Melbourne Vic

Ai Architect jobs in Melbourne Vic

Ai Architect jobs in Macquarie University Nsw

Ai Architect jobs in Docklands Vic

Ai Engineer jobs in Melbourne Vic

Ai Company jobs in Sydney Nsw

Electrical Engineer jobs in Burpengary East Qld

Security jobs in Greater Adelaide Sa

Student Civil Engineer, Cadet jobs in Sydney Nsw

Western Sydney Airport Security jobs in Mount Druitt Nsw

Data and AI Architect

EPAM Systems, Inc. -
Sydney NSW

Apply Now

Job Details

2 hours ago

Qualifications

Performance tuning
Data modelling
Unity
AI

Full Job Description

We are seeking a Data and AI Architect to design shared data architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data and enable RAG retrieval patterns using Delta Lake, Unity Catalog, Spark and Vector Search. You simplify complexity and guide teams toward scalable, reusable designs.

You will define the shared data architecture for Agentic AI solutions built on Databricks. Your focus is creating a secure, scalable and reusable foundation for ingestion, modeling, governance and retrieval patterns that enable AI-ready data products.

You bring a pragmatic systems mindset, and you can translate complex data and AI requirements into clear architecture decisions. You collaborate across engineering, product and security teams, challenge assumptions constructively and manage risks early.

Responsibilities

Design shared data and AI architecture on Databricks across Agentic AI solutions
Define data modeling standards for IoT and time-series domains aligned to analytics and RAG needs
Architect ingestion and processing pipelines using Spark and Delta Lake
Establish governance, lineage and access controls with Unity Catalog
Define secure data access patterns for internal teams and downstream consumption
Design RAG retrieval patterns including indexing strategy and datasets for Vector Search
Produce architecture decision records, reference designs and reusable templates
Partner with stakeholders to align scope, manage risks and drive implementation quality

Requirements

Databricks architecture experience in production environments
Data modeling expertise including event, time-series, dimensional and canonical modeling patterns
Ingestion pipeline experience across batch and streaming patterns
IoT and time-series data experience including scale, retention and query optimization
Delta Lake expertise including table design, performance tuning and lifecycle management
Databricks Unity Catalog experience covering governance, lineage and fine-grained access control
Apache Spark expertise for large-scale processing and optimization
Data governance and security experience including policy design and secure-by-default architecture

Nice to have

Experience implementing Vector Search and managing embedding lifecycle
Familiarity with retrieval quality, evaluation signals and RAG tuning considerations
Experience enabling shared data products across multiple teams

We offer

By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Life at EPAM

We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.
We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.
You will work in an open and friendly work environment where your professional skills and experience can stand out.

How We Hire

Here, we summarize the typical journey to finding a job within EPAM.
Apply and tell us about yourself!
Go through some standard interviews:

- General interview with a recruiter
- Technical interview with our technology experts
- Manager interview or Offer interview with a hiring manager

Get ready to join the team!
Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!
It takes 1 min of application to start the journey with us. Apply now!

Apply Now

Refine Your Search

databricks engineer jobs in parramatta, nsw

Data and AI Architect

DevOps Engineer

Staff AI Application Security Engineer

More jobs to discover

I want to receive the latest job alert for databricks engineer in parramatta, nsw

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected