Test Engineer ( Data Testing)
Key Responsibilities
Automated Data Testing: Design testing frameworks for pipelines (Data Factory, Dataflows Gen2) and PySpark/Spark notebooks to validate data ingestion and transformation logic.
- BI & Semantic Model Validation: Test and verify Power BI semantic models, execute validation on DAX calculations, and verify Row-Level Security (RLS) implementation.
- Data Quality & Lineage: Enforce data quality rules (completeness, accuracy, uniqueness) and use built-in tools to trace data lineage across the OneLake and Lakehouse/Warehouse environments.
- CI/CD & DevOps: Integrate data testing suites into automated Azure DevOps pipelines for smooth deployments of Fabric artifacts across workspaces.
- Performance Testing: Monitor Lakehouse/Warehouse workloads, diagnosing bottlenecks and optimizing capacity scaling.
- Technical Qualifications
Platforms: Deep familiarity with the Microsoft Fabric ecosystem and Power BI service.
Query & Code Languages: Strong expertise in SQL, PySpark, DAX, and KQL (Kusto Query Language).
QA Frameworks: Experience with data-centric testing libraries
Pay: $100,000.00 – $110,000.00 per year
Work Location: Hybrid remote in Sydney NSW 2000
