Associate Lead Engineer (Job Ref#:220803)

Lkcareers
Full-timeColombo, Sri Lanka

Key Responsibilities

  • Installation, configuration, and upgrading of Big Data solutions while leading the team for smooth operationalization
  • Benchmark systems, analyze system bottlenecks, and propose solutions to eliminate them
  • Provide deep subject matter expertise, advice for the program delivery while establishing architectural principles and patterns
  • Conduct technical and design reviews while understanding system integration concepts and patterns
  • Review the business requirements captured and assess gaps
  • Innovation role on Digital Data with latest technologies and identify customer expectations and competitor movements fast and accurate and same time coordination among organizational units to enhance operational backbone
  • Carrying out R&Ds to select best suited Big Data technologies
  • Design ETL flow using technologies such as Sqoop / Flume / Kafka / Hive / Oozie / PIG / AWS Glue / Airflow
  • Responsible for performing monthly / quarterly performance analysis to identify the application bottlenecks, issues and new resources requirements while defining the process and continuous improvement
  • Troubleshooting on system issues, attending to faults, analysis of issues, applying corrective action / workarounds, proving RCAs
  • Periodically update relevant patches on Big Data platforms while assessment of the Big Data platform to identify gaps for patch and make long-term and short-term plans to bridge the gaps
  • Perform Unix / Linux administrative tasks while planning and execution of performance improvement activities essential to Maintain smooth operational environment
  • Implementing and managing OS level security and patch upgrades while maintaining minimum baseline security of servers (Periodic VA Scans / Recommending patches)
  • Maintaining up to date documentation, connectivity diagrams, and related information for all the application liaised within the responsibility of this position
  • Career path development and create Learning opportunities for subordinates

Key Requirements

  • More than 5 years’ experience in a relevant position at similar field
  • Bachelors’ degree in IT/Computer science from a recognized university
  • Having Scalable Machine Learning certification, certified on Data warehousing with MSSQL Server, certified on Cloudera Developer for Apache Hadoop & Spark, certified on Cloudera Designing and Building Applications and AWS solution architect is advantageous
  • Strong Knowledge Big Data related technologies (Hadoop, MapReduce, Pig, Hive, HBase, Oozie, Flume, ZooKeeper, Kafka, Spark, Solr, Impala, Hue)
  • Knowledge on RDBMS (MySQL, Oracle), PLSQL, Shell Scripting, MySQL Clustering, Impala Load Balancing, NoSQL / column-oriented Databases (Preferred Snowflake / ClickHouse)
  • Strong Programming skills with Scala / Python/ Java

Apply for this job

Resume/CV*

Click or drag file to this area to upload your Resume

Please make sure to upload a PDF

First Name*
Last Name*
Email*
Phone Number*