Senior Data Engineer - DataBricks - Contract
We are seeking an experienced Data Engineer to join a leading global investment bank on a long-term contract. This is an excellent opportunity to work on large-scale enterprise data platforms supporting critical business initiatives within a fast-paced financial services environment.
The successful candidate will be responsible for designing, developing, and optimising scalable data pipelines, working closely with engineering and business teams to deliver high-quality data solutions.
Key Responsibilities
- Design, build and maintain robust ETL data pipelines.
- Develop scalable data engineering solutions using Databricks, PySpark and Python.
- Optimise data processing workflows for performance, reliability and scalability.
- Work with large, complex datasets across cloud-based data platforms.
- Collaborate with business stakeholders, architects and development teams to deliver high-quality solutions.
- Ensure data quality, governance and best engineering practices are maintained.
- Support the delivery of strategic data initiatives within the bank.
Essential Skills
- Strong commercial experience with Databricks
- Excellent Python development skills
- Strong PySpark experience
- Proven experience designing and developing ETL pipelines
- Experience building scalable data engineering solutions
- Strong SQL skills
- Experience working within Agile delivery environments
Desirable Skills
- Previous experience working on Risk technology or Risk data projects within investment banking
- Experience with cloud platforms (Azure or AWS)
- Knowledge of CI/CD and DevOps practices
- Understanding of financial markets and investment banking data
Please click here to find out more about our Key Information Documents. Please note that the documents provided contain generic information. If we are successful in finding you an assignment, you will receive a Key Information Document which will be specific to the vendor set-up you have chosen and your placement.
To find out more about Huxley, please visit www.huxley.com
Huxley, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 8 Bishopsgate, London, EC2N 4BQ, United Kingdom | Partnership Number | OC387148 England and Wales
