My client works with some of the largest Investment Banks and Financial Exchanges in the world. This is a unique opportunity to for a Data Engineer who strives to build highly scalable, performant and robust system that helps clients benefit from comprehensive market data sets and analytics.
My client own some of the largest financial data sets in the world and are looking for programmers that enjoy tackling the challenges that come with real time streaming data and large historical databases.
This hire will be responsible for expanding and optimizing data and data pipeline architecture, optimizing data flow and collection for cross functional teams, and supporting data quality investigations and troubleshooting for real-time streaming and historical data sets.
The candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and automating workflows. The right candidate will be excited by the prospect of optimizing our company's data architecture to support the next generation of products and data initiatives.
What you will do:
Create and maintain optimal data pipeline architectures
Identify, design, and implement internal batch process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS 'big data' technologies
Assemble large, complex data sets that meet functional / non-functional business requirements
Keep our data separated and secure across national boundaries through multiple data centres and AWS regions.
Optimize application performance through analysis and tuning
Analyse and recommend technologies and tools to improve efficiency and quality of the development process
You will have countless opportunities to develop your skills, make an impact through meaningful contributions, and gain rich experiences at an accelerated pace
You will be involved in all phases of the development lifecycle; this will include engaging with business owners to understand and document requirements, design of solutions and the implementation
You will manage assigned projects to ensure successful completion in designated time frames
Previous experience in a professional environment using Python and SQL
Production experience with large data sets and data pipelines
Strong programming skills, broad knowledge of algorithms and data structures
Practical experience with relational databases such as MySQL, PostgreSQL, SQL Server, including schema design, writing DML, optimizing query performance
Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify opportunities for improvement, and support production data products
Comfortable with both Linux and Windows based systems
Passionate about data and automation
Desire and ability to lead and take ownership of projects and systems
Strong critical thinking, communication, and organizational skills
Ability to work effectively in a fast-paced environment with minimal direction
Apply now or call to find out more about this Senior BI Analyst opportunity.
For further information on this vacancy, or any other job in Belfast or wider Northern Ireland, please apply via the link below or contact Ryan Quinn in the strictest confidence
Follow VANRATH on LinkedIn for: Expert Career Advice. The Latest Top Jobs. Industry News. And much more…