Data Engineer ( Global FinTech )

My client works with some of the largest Investment Banks and Financial Exchanges in the world. This is a unique opportunity to for a Data Engineer who strives to build highly scalable, performant and robust system that helps clients benefit from comprehensive market data sets and analytics.

My client own some of the largest financial data sets in the world and are looking for programmers that enjoy tackling the challenges that come with real time streaming data and large historical databases.
This hire will be responsible for expanding and optimizing data and data pipeline architecture, optimizing data flow and collection for cross functional teams, and supporting data quality investigations and troubleshooting for real-time streaming and historical data sets.

The candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and automating workflows. The right candidate will be excited by the prospect of optimizing our company's data architecture to support the next generation of products and data initiatives.
What you will do:

• 
  Create and maintain optimal data pipeline architectures
• 
  Identify, design, and implement internal batch process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• 
  Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS 'big data' technologies
• 
  Assemble large, complex data sets that meet functional / non-functional business requirements
• 
  Keep our data separated and secure across national boundaries through multiple data centres and AWS regions.
• 
  Optimize application performance through analysis and tuning
• 
  Analyse and recommend technologies and tools to improve efficiency and quality of the development process
• 
  You will have countless opportunities to develop your skills, make an impact through meaningful contributions, and gain rich experiences at an accelerated pace
• 
  You will be involved in all phases of the development lifecycle; this will include engaging with business owners to understand and document requirements, design of solutions and the implementation
• 
  You will manage assigned projects to ensure successful completion in designated time frames

Requirements:

• 
  Previous experience in a professional environment using Python and SQL
• 
  Production experience with large data sets and data pipelines
• 
  Strong programming skills, broad knowledge of algorithms and data structures
• 
  Practical experience with relational databases such as MySQL, PostgreSQL, SQL Server, including schema design, writing DML, optimizing query performance
• 
  Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify opportunities for improvement, and support production data products
• 
  Comfortable with both Linux and Windows based systems
• 
  Passionate about data and automation
• 
  Desire and ability to lead and take ownership of projects and systems
• 
  Strong critical thinking, communication, and organizational skills
• 
  Ability to work effectively in a fast-paced environment with minimal direction

Apply now or call to find out more about this Senior BI Analyst opportunity.
For further information on this vacancy, or any other job in Belfast or wider Northern Ireland, please apply via the link below or contact Ryan Quinn in the strictest confidence
Follow VANRATH on LinkedIn for: Expert Career Advice. The Latest Top Jobs. Industry News. And much more…