Senior Tech Lead / Associate Architect (Data Engineering)

Nextjob
Full-timeColombo, Sri Lanka

The Company

We are a Norwegian owned company, delivering offshore software services from our development centre in Sri Lanka. Over the last 15 years, we have completed 250+ successful projects worldwide, for clients ranging from startups to Fortune 500 companies. For a decade and a half, we have been creating breakthrough software for leading organisations in Europe, USA, Australia, Singapore and more. We are a team of global experts who architect solutions that change the way business is done and add colour to everyday living.

We offer custom software application development to diverse sectors such as proptech, fintech, environment, logistics, maritime, health, and more. We assign a dedicated, long-term technology team to each client, allowing for seamless integration with their internal teams. Guided by the Nordic values of trust, transparency and commitment, our diverse team drives innovation and disruption in the modern digital era.

The Role

We have been creating breakthrough software for leading organizations in Europe, USA, Australia, Singapore and more. Parented by a Norwegian company and with significant operations in Sri Lanka, we are a team of global experts who architect solutions that change the way business is done and add color to everyday living. As a member of our team you will have the opportunity to be a part of a diverse, global team with shared values of Transparency, Agility, Trust and Commitment.

Our behavior fosters disruptive innovation as we challenge the status quo and continually reach greater heights. As a Senior Tech Lead, you will be part of a dynamic team dedicated to developing cutting-edge software for an organization committed to identifying, empowering, and supporting equity-driven leaders with a mission to transform education and create opportunities for all children, with a core focus on reducing educational inequity.

Key Responsibilities

  • Data Pipeline Development: Design, develop, and optimize ETL/ELT pipelines to extract, transform, and load data from multiple sources. Ensure data pipelines are scalable, reliable, and maintainable.
  • Process Automation: Identify and automate manual processes to improve efficiency and reduce operational overhead. Implement solutions to eliminate repetitive tasks using modern tools and scripting languages like Python.
  • Data Architecture: Design and implement scalable data architectures to meet business and analytical requirements. Collaborate with stakeholders to build data models for data warehousing and analytics.
  • Cloud Integration: Manage data storage solutions using Azure services such as Azure Blob Storage, Azure Data Lake, and Azure SQL. Utilize Azure Data Factory for orchestrating and automating data workflows.
  • API Integrations: Develop and manage APIs for integrating various data sources, enabling seamless data sharing and retrieval.
  • Data Governance: Implement and maintain data governance frameworks to ensure data quality, security, and compliance. Establish processes for data stewardship and enforce best practices across the organization.
  • Business Intelligence Enablement: Work with tools like Power BI and integrate data for reporting and visualization. Collaborate with analysts to provide insights that drive decision-making.
  • Collaboration and CI/CD: Deploy data solutions using CI/CD pipelines with tools like Azure DevOps or GitHub Actions. Establish best practices for development, testing, and deployment workflows.
  • Data Pipeline Architecture: Design and implement enterprise-level data pipeline architectures to meet business and analytical needs. Optimize workflows for performance, scalability, and reliability.
  • Monitoring and Optimization: Monitor the performance of data pipelines and optimize them for cost-efficiency and performance.
  • Troubleshoot and resolve data-related issues promptly.

Required Skills

  • 10+ years of python/pyspark programming experience
  • Azure cloud(Azure ADLS, Azure SQL, Azure DevOps, Azure Data Factory, Azure Function apps, Fabric and Synapse Analytics would be a plus),
  • Power BI experience
  • Excellent SQL skills
  • GitHub, GitHub Actions experience
  • Strong Database, Warehouse and Mart conceptual knowledge
  • Can work with minimal knowledge transition
  • Can lead the data engineering space offshore and be the point of contact for data engineering
  • Can wear developer, analyst and lead hat as needed

Good-to-Have Skills

  • Familiarity with Microsoft Fabric for data workflows.
  • Experience with Google Analytics for extracting and analyzing web and app data.

Working hours

  • 6pm - 3am, Sri Lankan time

Benefits

  • Great Remuneration πŸ’°
  • Flexible Work Arrangement 🏠
  • Performance Bonus 🏦
  • Private Health Insurance πŸ₯
  • Accelerated Career Growth πŸ“š
  • Latest Tech Equipment πŸ’»
  • International Exposure πŸš€
  • Exciting Company Events πŸ₯³

Apply for this job

Resume/CV*

Click or drag file to this area to upload your Resume

Please make sure to upload a PDF

First Name*
Last Name*
Email*
Phone Number*
The hiring team may use this number to contact you about this job.

By clicking 'Submit Application', you agree to receive job application updates from Nextjob via text and/or WhatsApp. Message frequency may vary. Reply STOP to unsubscribe at any time. Message & data rates may apply.