Data Engineer

Singapore

Key Responsibilities

• Design, develop and implement Big Data platforms in cloud
• Build a centralized datalake and data warehouse for data feeds from all M-DAQ entities
• Set up tools for data ingesting (batch and real-time), data cleaning, building data cubes in the data warehouse
• Build tools to monitor data quality and manage data changes
• Build end-user facing data catalogue and data lineage to facilitate data discovery

Desired Skill Set and Attributes

• 5+ years of experience with excellent coding skills (Python, Java or Scala)
• Bachelor or Master’s degree in Computer Science, Engineering, or relevant industry experience is required
• Experience with Big Data technology architecture (Hadoop, Spark, Kafka, Flink, Hive etc), tuning, troubleshooting and scaling the systems. Deep understanding with the internal principles of these systems.
• Hands on experience designing and implementing Data Warehouse (Snowflake, Athena or Redshift)
• Solid understanding of ETL and ELT approaches and large scale data ingestion/integration framework.
• Experience in designing data quality morning and fault-tolerant pipelines
• Hands on experience in developing/designing/integrating using Kubernetes
• Exposure in building real-time processing pipelines using Flink or Spark-streaming
• Exposure to data and machine learning services from Amazon Web Services (AWS) and/or Google Cloud (GCP) is a plus

What We Offer:

M-DAQ offers competitive remuneration including employee stock options and employee benefits. In 2019, M-DAQ was recognised as the Best Tech Company To Work For.

Please send your latest resume to recruit@m-daq.com with your availability, current and expected remuneration.