Senior Assoc, Data Engineer, Middle Office Technology, Technology & Operations

Business Function

Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we managethe majority ofthe Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Responsibilities

• Deliver solutions for online data extraction, data integration and data management.
• Develop and maintain high-performance, scalable utilities to support technology research and data transformation.
• Optimize data processing protocols and systems for better efficiency and maintainability.
• Contribute to the establishment and maintenance of distributed computing platform and big data services
• Writing of documents that clearly explain how algorithms should be implemented, verified and validated.

Requirements

• Experience in a field encompassing Distributed computing, Big Data Analytics, Data Transformation (6-8 years)
• Relevant industry experience in large scale crawling on cloud platforms would be favourably considered
• Knowledge on Core Java / Scala preferably
• Hands on experience in Spark is must.
• Hands on experience on HDFS (Hadoop), spark, impala, hive.
• Hands on experience on database technology.
• Computer Science fundamentals in algorithm design, problem solving, and complexity analysis
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Able to perform Unix / Linux scripting.
• Able to write the programs in Spark.
• Monitor and address issues relating to capacity constraints and performance related items.
• Analyse and perform performance tuning for jobs and Queries.