Senior Data Engineer

SmashTaps Pvt Ltd
Full-timeNugegoda, Sri Lanka

Founded in 2014, SmashTaps is a Great Place to Workยฎ certified, Digital Product Studio with offices in Sri Lanka, Malaysia, and the USA. We offer Web and Mobile Application Development Services for startups and scale-ups, and we are proud to work closely with our clients, taking total project ownership while following the Agile Development Methodology.

At SmashTaps, we understand the unique needs of our clients, and we are dedicated to delivering high-quality solutions tailored to their requirements. With our expertise and commitment to excellence, we have built strong partnerships with clients from various industries. In fact, 90% of our clients are from the United States, representing some of the world's leading brands in industry verticals such as FinTech, MarTech, AdTech, Middleware, and Enterprise AI.

In addition to our client services, we are actively involved in launching our own startup ventures, leveraging our experience and knowledge to create innovative products and solutions. We believe in the power of entrepreneurship and continuously seek opportunities to push boundaries and drive positive change in the digital landscape.

SmashTaps takes pride in our dedicated team of professionals who are passionate about technology and driven to deliver exceptional results. Our diverse workforce is united by a shared commitment to excellence, collaboration, and continuous learning, enabling us to stay at the forefront of the ever-evolving digital market.

Our client is a prominent provider of AI-driven customer analytics, personalization, and brand collaboration solutions. With a presence spanning numerous retailers and brands worldwide, they harness cutting-edge big data, real-time analytics, and data science automation. Their innovative solution is reshaping the current data and media monetization landscape by empowering retailers to maintain control over their revenue streams. Their parent company has been listed on NYSE and S&P 500.

Regarding the role:

The Data Engineer plays a pivotal role in crafting novel data solutions for rapidly expanding clientele, operating within a collaborative, forward-thinking, and innovative work environment.

Your responsibilities will encompass:

  • Spearheading the entire data flow process, from conceptualization to architectural design, encompassing data acquisition, data set acceptance criteria, and seamless integration with data science.

  • Crafting and tailoring technological solutions for large-scale data processing.

  • Developing and implementing real-time and batch data processing infrastructures and pipelines.

  • Taking charge of exploring technologies to enhance the data ecosystem's capacity to handle rapid data growth.

  • Collaborating closely with the Data Science team to seamlessly embed ML/AI algorithms into our products.

  • Coordinating efforts with cloud, DevOps, application, and client teams to ensure that your solution effectively addresses significant business challenges in a robust and scalable manner.

  • Leveraging cutting-edge technologies such as Python, Airflow, Java, Kubernetes, Spark, Scala, and Kafka.

Key requirements for this role:

  • A Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field.

  • Over 4 years of hands-on experience in backend engineering within production environments, specifically in data and big data processing and database techniques.

  • Demonstrated proficiency in Java and Scala (Python and Go skills are advantageous).

  • Proven expertise in designing and developing scalable big data solutions.

  • Proficiency in big data technologies, including Spark, Kafka, and Flink.

  • Experience with Kubernetes, containers, and Helm.

  • Familiarity with SQL and NoSQL databases, including PostgreSQL, DataLake, and Columnar DB.

  • Adaptability to learn new technologies and thrive in a dynamic, fast-paced work environment.

  • Results-oriented, pragmatic, and innovative mindset.

  • Previous experience with cloud technologies is a plus.

  • Strong English communication skills, both written and spoken.

9 reasons why you should join us:

๐Ÿ”ฅ Startup culture

๐Ÿ  Hybrid work setup with the ability to work from home

๐Ÿ– Flexible work hours

๐Ÿค Small teams of awesome people per project, who are smart, friendly, talented, hardworking, enthusiastic and fun to work with!

๐Ÿคฉ Hired based on skill, over paper qualifications

๐ŸŒŽ Global exposure - collaborate with our client teams overseas

โœจ Opportunity to use the latest tech

๐Ÿ’ฐ Highly competitive salary (USD or LKR)

Job Type: Permanent or Contract

Apply for this job

Resume/CV*

Click or drag file to this area to upload your Resume

Please make sure to upload a PDF

First Name*
Last Name*
Email*
Phone Number*