Senior Data Engineer

** Review requirements carefully; non-compliance leads to rejection **

Founded in 2014, SmashTaps is a Great Place to Work® certified, Digital Product Studio with offices in Sri Lanka, Malaysia, and the USA. We offer Web and Mobile Application Development Services for startups and scale-ups, and we are proud to work closely with our clients, taking total project ownership while following the Agile Development Methodology.

At SmashTaps, we understand the unique needs of our clients, and we are dedicated to delivering high-quality solutions tailored to their requirements. With our expertise and commitment to excellence, we have built strong partnerships with clients from various industries. In fact, 90% of our clients are from the United States, representing some of the world's leading brands in industry verticals such as FinTech, MarTech, AdTech, Middleware, and Enterprise AI.

In addition to our client services, we are actively involved in launching our own startup ventures, leveraging our experience and knowledge to create innovative products and solutions. We believe in the power of entrepreneurship and continuously seek opportunities to push boundaries and drive positive change in the digital landscape.

SmashTaps takes pride in our dedicated team of professionals who are passionate about technology and driven to deliver exceptional results. Our diverse workforce is united by a shared commitment to excellence, collaboration, and continuous learning, enabling us to stay at the forefront of the ever-evolving digital market.

Our client is a prominent provider of AI-driven customer analytics, personalization, and brand collaboration solutions. With a presence spanning numerous retailers and brands worldwide, they harness cutting-edge big data, real-time analytics, and data science automation. Their innovative solution is reshaping the current data and media monetization landscape by empowering retailers to maintain control over their revenue streams. Their parent company has been listed on NYSE and S&P 500.

Regarding the role:

You will be a member of the data onboarding team and will be responsible for overseeing the onboarding processes of customers' data. In this position, you will collaborate closely with customers' data teams, utilizing integration and ETL processes to facilitate the onboarding of their data. Your role will be pivotal in ensuring the success of customer onboarding projects.

Your responsibilities will encompass:

• Collaborate directly with customers' data teams on projects involving data interfaces and integration.
• Lead complex data extraction tasks to address business inquiries, generate ad-hoc reports, and respond to customer queries.
• Execute data validation tasks, standardize and explore datasets, and troubleshoot and resolve data-related issues.
• Take a significant role in data onboarding workstreams for new customers, pilots, and proof-of-concept projects.
• Assume responsibility for all stages of data flow, from definition to data acquisition, and establish data set acceptance criteria.
• Develop data queries and extractions to support customer success managers.
• Design, create, and sustain ETL processes for various data streams, employing multiple consumption methods such as Blob, Snowflake, Kafka, SFTP, SQL connectors, and REST API.
• Utilize cutting-edge technologies, including Java, Python, Spark, Scala, Airflow, Kubernetes and Kafka.

Key requirements for this role:

• Possess a minimum of 3 years of hands-on experience in data operations/engineering.
• Hold a Bachelor's degree in Information Systems, Statistics, Mathematics, Engineering, Economics, or a related discipline.
• Demonstrated proficiency in developing and maintaining ETL/ELT, preferably using Python (DASK or equivalent); familiarity with pandas and numpy is advantageous.
• Strong SQL skills for querying large and complex datasets.
• Extensive experience working with SQL and NoSQL Databases such as PostgreSQL, DataLake, and Columnar DB to translate data into meaningful insights.
• Proven experience in client-facing roles, with project management capabilities, adept at managing customer expectations and deadlines, and excellent communication skills.
• Excellent spoken and written English communication skills.
• Results-driven, pragmatic, and innovative approach.
• Team player with strong interpersonal skills.
• Independent and proactive in taking initiative.