Trouvez votre emploi idéal
Espace Recruteurs

Lead Data Engineering Architect

Westbury Partners Sydney, Australie
Mise en ligne il y a 1 jour CDI A$400k - A$700k

Lead Data Engineering Architect

Westbury Partners Sydney, Australie

Lead the design and delivery of scalable data platforms and pipelines, combining technical expertise, architecture, mentorship, and strategic leadership to enable trusted, high-performing, data-driven decisions.

What You'll Do:

Shape the future of data engineering by leading the architecture, development, and delivery of scalable data platforms, pipelines, and analytical solutions. You’ll turn complex data challenges into reliable, high-performance solutions that create meaningful business impact.

Your responsibilities will include:

  1. Lead the design and development of scalable ETL/ELT pipelines and modern data platforms.
  2. Define engineering standards, architecture patterns, development methodologies, and best practices.
  3. Build and optimise data warehouses, data lakes, and lakehouse solutions.
  4. Champion data quality, security, governance, availability, and performance.
  5. Lead architecture reviews, technical discussions, code reviews, and solution design sessions.
  6. Mentor data engineers and promote strong engineering practices across the team.
  7. Establish effective monitoring, testing, documentation, CI/CD, and deployment processes.
  8. Troubleshoot complex pipeline, performance, infrastructure, and data issues.
  9. Evaluate emerging technologies and recommend solutions that balance innovation, scalability, and cost.
  10. Partner with Data Scientists, BI Developers, Analysts, Software Engineers, Product Managers, and business stakeholders.
  11. Drive continuous improvement across data architecture, engineering processes, productivity, and technical debt.
  12. Support cloud-based initiatives while ensuring robust, scalable, and cost-effective solutions.

Why Join Us:

This is an opportunity to combine hands-on engineering with genuine technical leadership. You’ll have the influence to shape data architecture, establish engineering standards, mentor talented professionals, and deliver platforms that directly support business growth and smarter decision-making.

About You:

  1. You’re an experienced data engineering professional with7+ years of relevant experience and at least2 years leading or mentoring engineering teams . You bring strong SQL and programming skills, extensive ETL/ELT experience, and a solid understanding of data modelling, warehousing, distributed systems, and scalable data processing.
  2. You’re comfortable working with cloud platforms and modern technologies such as Spark, Kafka, Airflow, Databricks, Snowflake, BigQuery, or equivalent solutions. You understand software engineering practices including version control, CI/CD, automated testing, and deployment.
  3. You’re also a confident technical leader who can communicate complex ideas clearly, collaborate across disciplines, solve challenging problems, and make pragmatic architectural decisions.

#DataEngineering #DataEngineer #DataEngineeringLead #DataArchitecture #DataPipelines #ETL #ELT #CloudComputing #DataWarehouse #DataLake #DataLakehouse #ApacheSpark #Databricks #DataGovernance #TechnicalLeadership

Référence  8925
Plus d'offres de Westbury Partners
Westbury Partners
Trading Tools & Data Engineering Specialist
Westbury Partners
Hong Kong
il y a 1 jour Plein-temps HK$2m - HK$3m
Westbury Partners
Junior Engineering Operations & Projects Engineer
Westbury Partners
Sydney, Australia
il y a 1 jour Plein-temps A$300k - A$600k
Westbury Partners
Blockchain Infrastructure & Production Engineer
Westbury Partners
Sydney, Australia
il y a 1 jour Plein-temps A$400k - A$700k
Westbury Partners
Trading Systems Software Engineer
Westbury Partners
Sydney, Australia
il y a 4 jours Plein-temps A$400k - A$700k
Westbury Partners
Secure Platform Reliability Engineer
Westbury Partners
Sydney, Australia
il y a 4 jours Plein-temps A$400k - A$700k
Westbury Partners
Research Engineer
Westbury Partners
Sydney, Australia
il y a 4 jours Plein-temps A$400k - A$700k
Westbury Partners
Linux HPC Operations Engineer
Westbury Partners
Sydney, Australia
il y a 4 jours Plein-temps A$400k - A$700k
Westbury Partners
Low-Latency Performance Optimization Engineer
Westbury Partners
Sydney, Australia
il y a 4 jours Plein-temps A$350k - A$500k
Westbury Partners
Cyber Security Operations Engineer - HFT - SYD
Westbury Partners
Sydney, Australia
il y a 1 jour Plein-temps A$250k - A$600k
Westbury Partners
Senior Python Engineer – Trading & Research Systems
Westbury Partners
Sydney, Australia
il y a 1 jour Plein-temps AUD250k - AUD550k

Donnez un nouvel élan à votre carrière

Trouvez des milliers d'opportunités emploi en vous inscrivant sur eFinancialCareers dès aujourd'hui.
Plus d'offres d'emploi
Optiver
Engineering Lead - Data
Optiver
Sydney, Australia
London Stock Exchange Group
Lead Data Architect - News Engineering
London Stock Exchange Group
London, United Kingdom
State Street Corporation
Alpha Data Solution Architect, Vice President
State Street Corporation
Sydney, Australia