In-Demand Gen ai Jobs

Senior Data Engineer
Tata Consultancy Services —Sydney NSW
- Databases
- AWS
- Scripting
Principal Consulting Engineer
NOKIA —Australia
- Full-time
- Microsoft Powerpoint
- Bachelor's degree
- AI
Senior Financial Analysis Manager
Sophos —Australia
- Sales
- Salesforce
- Analysis skills
Senior Sales Manager, MSP Channel Sales - Sydney / Melbourne based
Sophos —Australia
- Management
- Recruiting
- AI

More jobs to discover

Find similar jobs that you might be interested in.

Senior / Principal Water Resources Engineer
Stantec —Melbourne VIC
Working knowledge of current guidelines, including experience working with Australian Rainfall and Runoff. Tertiary qualifications in Civil or Environmental…
Principal Hydraulic Engineer
Stantec —Brisbane QLD
Have minimum 8 years hydraulic building services experience within the consulting or engineering industry. Stantec are involved in a vast variety of project…

I want to receive the latest job alert for gen ai

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

gen ai jobs near

Data Engineer jobs in Sydney NSW

Data Engineer jobs in Macleod Vic

Data Engineer jobs in Melbourne Vic

Data Engineer jobs in Perth Wa

Junior Mechanical Engineer jobs in Moreton Bay Qld

Fresh Entery , Mechanical Engineer jobs in Granville Nsw

Data Engineer jobs in Northern Territory

Student Civil Engineer, Cadet jobs in Sydney Nsw

Principal Software Engineer jobs in Mandurah Wa

Principal Software Engineer jobs in Florey Act

Electrical Engineer jobs in Oakhurst Nsw

Principal Software Engineer jobs in Smithfield Qld

Principal Software Engineer jobs in Brisbane Qld

Financial Analyst jobs in Melbourne Vic

Manager In Public Health jobs in South Australia

Office Manager jobs in Sydney Nsw

Sales jobs in Sydney Nsw

Senior Citizens jobs in Gold Coast Qld

Regional Manager Aged Care jobs in New South Wales

Senior Sales Manager jobs in Sydney Nsw

Senior Data Engineer

Tata Consultancy Services -
Sydney NSW

Apply Now

Job Details

Qualifications

Data modelling
NoSQL
MongoDB
Databases
AWS
SDKs
Scripting
Data pipeline
APIs
Security
Scalability
S3
Teradata
DynamoDB
AI
Data warehouse

Full Job Description

Job Description

AWS SageMaker Unified Studio Expertise:

- Proficiency with AWS SageMaker Unified Studio, including its various components Discover, Build and Govern.

- Experience with development in Sagemaker IDE and Application (Jupyterlab, Spaces and Partner AI Apps).

- Data Analysis and Integrations ( Query Editor, Visual ETL Jobs and Data Processing jobs)

- Orchestration of workflows and ML Pipelines

- Understanding and expertise to work with ML and Gen AI tools available in unified studio are ad-on values.

- Setting up projects and data governance in SageMaker Unified studio

Advanced Data Ingestion & Processing (Real-time & Batch):

- Framework Development: Proven ability to design, develop, and implement highly reusable and adaptable data ingestion frameworks capable of handling diverse source types (e.g., databases, APIs, message queues, file systems).

- Low-Latency Real-time: Deep expertise in building real-time data pipelines with stringent sub-second latency requirements, utilising services like AWS Kinesis (Data Streams/Firehose), Apache Kafka, or similar streaming technologies.

- Batch Processing: Experience with robust batch ingestion patterns and tools (e.g., AWS Glue, Apache Spark) for efficient processing of larger datasets.

- Data Transformation: Stron g skills in designing and implementing efficient data transformation logic for both streaming and batch data.

Programming and Scripting:

- Advanced proficiency in Python, particularly for developing scalable data ingestion and export frameworks, API integration, and extensive use of the AWS SDK (Boto3).

- Experience with performance optimisation techniques for Python applications in data-intensive environments.

- Familiarity with other relevant languages (e.g., Scala, Spark) for high-performance streaming applications is beneficial.

AWS Services for Data and Infrastructure:

- In-depth knowledge of core AWS services: Lambda, S3, DynamoDB, CloudWatch, SQS, SNS, and API Gateway.

- Strong understanding of AWS networking (VPC, security groups, private endpoints) and IAM for secure, fine-grained access control.

Key Skillset:

Previous experience in developing framework for batch and real time data ingestions in relation and no-sql databases or filesystems.

Previous experience in Real time data ingestion with low latency with experience on AWS Kinesis Stream, Apache Kafka or similar streaming technologies

Proven experience in various database technologies (e.g. Oracle, Teradata, MongoDB, Snowflake etc)

Sound knowledge and experience in building Data Warehouses and Data Lakehouses.

Data Modeling experience is a plus point

Location

Sydney

Job Function

TECHNOLOGY

Role

Engineer

Job Id

413196

Desired Skills

AWS | Python | Apache

Apply Now

Refine Your Search

gen ai jobs

Senior Data Engineer

Principal Consulting Engineer

Senior Financial Analysis Manager

Senior Sales Manager, MSP Channel Sales - Sydney / Melbourne based

More jobs to discover

I want to receive the latest job alert for gen ai

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected