In-Demand Data engineer (aws / spark) Jobs

Critical Search Engineer
Particular Audience —Darlinghurst NSW
- From $130,000 a year
- Full-time
- Azure
- Master's degree
- Databases
Quick Apply
Principal Engineer | Enterprise Data Platform
Macquarie Group Limited —Sydney NSW
- Full-time
- Hybrid work
- AWS
- Scripting
- Agile
- Annual leave
- Work from home
Staff Machine Learning Engineer
Xero —Sydney NSW
- Full-time
- Hybrid work
- Systems design
- SQL
- AWS
14d
Data Engineering Technical Coach
FDM Group —Sydney NSW
- Microsoft Excel
- Azure
- Administrative experience
8d
Senior Data Engineer
V2 Digital —Melbourne VIC
- Hybrid work
- Azure
- Master's degree
- AWS
- Parental leave
Quick Apply
1d
AI Engineer (Senior)
AMP Limited —Melbourne VIC
- Full-time
- Azure
- AWS
- Machine learning
Senior Databricks Specialist Lead | AI & Data | Sydney
Deloitte —Sydney NSW
- Azure
- Salesforce
- SQL
- Parental leave
Senior Software Engineer (Python) - Regulatory Reporting
The Argyle Network —Sydney NSW
- $160,000 a year
- Full-time
- SQL
- AWS
- Analysis skills
Technology Director - Platform Engineering
Simple Machines —Sydney NSW
- Hybrid work
- Azure
- AWS
- AI
Quick Apply
Snr Engineering Manager / Chapter Lead (Data Engineering) - 12 Months Fixed Term Contract
Commonwealth Bank —Sydney NSW
- Full-time
- SQL
- AWS
- Analysis skills
8d
Senior Machine Learning / ML Engineer
Xero —Sydney NSW
- Full-time
- Hybrid work
- Systems design
- SQL
- AWS
Senior Machine Learning Operations Engineer (MLOps)
Easygo —Melbourne VIC
- Full-time
- Azure
- Computer Science
- DevOps
- Work from home
- Employee assistance program
Quick Apply
Lead AI Scientist
Rhino Partners Pty Ltd —Barangaroo NSW
- $180,000 - $200,000 a year
- Full-time
- Hybrid work
- Azure
- Management
- Patient monitoring
Quick Apply
7d
Senior Manager, Data Analytics Consulting
EPAM Systems, Inc. —Sydney NSW
- Azure
- SQL
- AWS
5d
Lakebase Specialist Sales
Databricks —Melbourne VIC
- Azure
- Sales
- Databases
Engineering Lead/Manager, Risk (Relocate to Singapore)
Airwallex —Sydney NSW
- Full-time
- Management
- Computer Science
- Salesforce
Migrations Solutions Architect, Sales
Snowflake —Sydney NSW
- Hybrid work
- Azure
- Computer Science
- Engineering
Senior Sales Engineer, ANZ
Alteryx —Sydney NSW
- Full-time
- Azure
- Sales
- SQL
4h
Senior Manager, Global Premier Support
Databricks —Sydney NSW
- Azure
- Computer Science
- Sales
13d
Senior Data Engineer
AMP Limited —Australia
- Full-time
- SQL
- AWS
- AI

I want to receive the latest job alert for data engineer (aws / spark)

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

data engineer (aws / spark) jobs near

Engineering Lead jobs in Sydney NSW

Machine Learning Engineer jobs in Sydney NSW

Senior Analytics Consultant jobs in Sydney NSW

Principal Software Engineer jobs in Sydney NSW

Data Engineer jobs in Melbourne VIC

Platform Engineer jobs in Sydney NSW

Senior Software Engineer jobs in Sydney NSW

Machine Learning Engineer jobs in Melbourne VIC

Ai Developer jobs in Melbourne VIC

Software Architect jobs in Sydney NSW

Software Engineering, Internship jobs in Perth Wa

Mechanical Engineering, Intern jobs in Brisbane Qld

Engineering Lead jobs in Amberley Qld

Engineering Lead jobs in Docklands Vic

Data Engineer jobs in St Leonards Nsw

Data Engineer jobs in Perth Wa

Data Engineer jobs in Gold Coast Qld

Electronics Engineer jobs in Sydney Nsw

Technical Coach jobs in Sydney Inner Suburbs Nsw

Football, Soccer, Coach jobs in Perth Wa

Critical Search Engineer

Particular Audience
Darlinghurst NSW

Quick Apply

Job Details

Full-time
From $130,000 a year

Qualifications

Lucene
Search engines
Cloud infrastructure
Azure
Go
Law
Data structures
System architecture
NoSQL
Google Cloud Platform
Master's degree
Databases
SQL
AWS
Machine learning
Terrafrom
Solr

Full Job Description

The Role

As a Critical Search Engineer, you will sit at the intersection of infrastructure engineering, data retrieval, and relevance tuning. You will be responsible for the systems that power our most critical, high-throughput search paths. When a user hits "search," your architecture ensures they get the right result in milliseconds, even under peak loads.

Key Responsibilities

Infrastructure & Scaling: Design, scale, and maintain our distributed search cluster architecture ([Elasticsearch / OpenSearch / Solr]).
Performance Tuning: Optimize index strategies, query performance, and caching layers to maintain sub-second latencies across massive datasets.
Relevance & Ranking: Collaborating with product and data teams to implement, test, and refine ranking algorithms, tokenization, and NLP-driven search features.
Reliability & Monitoring: Establish robust monitoring, alerting, and disaster recovery patterns for search clusters to guarantee high uptime.
Data Pipeline Integration: Build and maintain reliable data ingestion pipelines ([Kafka / Spark / Logstash]) to ensure real-time or near-real-time data indexing.
Mentorship: Lead architectural reviews and mentor junior/mid-level engineers on search best practices.

Skills & Qualifications

Search Expertise: 4+ years of deep, hands-on experience managing and tuning distributed search engines at scale (Elasticsearch, OpenSearch, Solr, or Lucene).
Backend Proficiency: Strong coding skills in languages like [Java / Go / Python / Scala].
System Architecture: Proven experience with distributed systems, sharding strategies, cluster routing, and replication.
Cloud Infrastructure: Experience deploying and managing search infrastructure in cloud environments ([AWS / GCP / Azure]), ideally using Infrastructure as Code (Terraform).
Data Savvy: Solid understanding of data structures, indexing strategies, and database internals (SQL and NoSQL).

Nice-to-Haves

Experience with vector search, vector databases ([Milvus / Pinecone / Qdrant]), or hybrid search implementations.
Background in Machine Learning for search (Learning to Rank, semantic search, or LLM integration).
Active contribution to open-source search communities.

Pay: From $130,000.00 per year

Work Location: In person

Quick Apply

Refine Your Search

data engineer (aws / spark) jobs

Critical Search Engineer

Principal Engineer | Enterprise Data Platform

Staff Machine Learning Engineer

Data Engineering Technical Coach

Senior Data Engineer

AI Engineer (Senior)

Senior Databricks Specialist Lead | AI & Data | Sydney

Senior Software Engineer (Python) - Regulatory Reporting

Technology Director - Platform Engineering

Snr Engineering Manager / Chapter Lead (Data Engineering) - 12 Months Fixed Term Contract

Senior Machine Learning / ML Engineer

Senior Machine Learning Operations Engineer (MLOps)

Lead AI Scientist

Senior Manager, Data Analytics Consulting

Lakebase Specialist Sales

Engineering Lead/Manager, Risk (Relocate to Singapore)

Migrations Solutions Architect, Sales

Senior Sales Engineer, ANZ

Senior Manager, Global Premier Support

Senior Data Engineer

I want to receive the latest job alert for data engineer (aws / spark)

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected