Company Description

We are a dynamic and innovative software solutions provider dedicated to delivering cutting-edge technology services to our valued clients. Our expertise spans project execution and dedicated team provisioning, allowing us to cater to diverse needs effectively. We have an impressive portfolio, including reputable accounts from NASDAQ, SGX, and ASX listed companies. Our highly skilled and innovative team serves clients worldwide, including in the USA, Singapore, Australia, UK, Sweden, and Norway, providing exceptional and tailored solutions. Our core values of innovation, efficiency, and customer satisfaction position us as a preferred technology partner for businesses globally.

About the Role

We are looking for a skilled and motivated Azure Databricks Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Databricks, Azure Data Lake, and other components within the Azure ecosystem.

Key Responsibilities

• Design and implement scalable and robust ETL/ELT pipelines using Azure Databricks (PySpark, Scala, or SQL).
• Work with stakeholders to understand data requirements and deliver high-quality data solutions.
• Integrate Databricks with other Azure services such as Azure Data Factory, Data Lake Storage, Synapse Analytics, and Azure SQL DB.
• Optimize data workflows for performance and cost efficiency.
• Implement best practices in data engineering, including CI/CD, monitoring, version control, and security.
• Collaborate with Data Scientists, Analysts, and other Engineers to support data exploration and model deployment.

Required Skills & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering with strong expertise in Azure Databricks.
• Hands-on experience with PySpark, SparkSQL, or Scala in Databricks.
• Solid understanding of Azure ecosystem including Data Lake, Data Factory, Key Vault, and Synapse.
• Proficient in building and managing large-scale data pipelines and workflows.
• Experience in data modeling, data warehousing, and performance tuning.
• Familiarity with Delta Lake and data versioning concepts.
• Experience with Git, CI/CD tools, and infrastructure as code (ARM/Bicep/Terraform) is a plus.

Preferred Qualifications

• Databricks Certified Associate or Professional is a plus.
• Experience with MLflow and machine learning model deployment is a bonus.
• Knowledge of DevOps practices and Agile methodologies.

Benefits

• Competitive salary and benefits package.
• Flexible work hours and remote work options.
• Opportunity to work on cutting-edge data engineering projects.
• Collaborative and innovative team environment.
• Career development and learning opportunities.