MDAQ_Logo

 

Data Engineer

Singapore

 

Key Responsibilities

  • Design, develop and implement Big Data platforms in cloud
  • Build a centralized datalake and data warehouse for data feeds from all M-DAQ entities
  • Set up tools for data ingesting (batch and real-time), data cleaning, building data cubes in the data warehouse
  • Build tools to monitor data quality and manage data changes
  • Build end-user facing data catalogue and data lineage to facilitate data discovery

Desired Skill Set and Attributes

  • 5+ years of experience with excellent coding skills (Python, Java or Scala)
  • Bachelor or Master’s degree in Computer Science, Engineering, or relevant industry experience is required
  • Experience with Big Data technology architecture (Hadoop, Spark, Kafka, Flink, Hive etc), tuning, troubleshooting and scaling the systems. Deep understanding with the internal principles of these systems.
  • Hands on experience designing and implementing Data Warehouse (Snowflake, Athena or Redshift)
  • Solid understanding of ETL and ELT approaches and large scale data ingestion/integration framework.
  • Experience in designing data quality morning and fault-tolerant pipelines
  • Hands on experience in developing/designing/integrating using Kubernetes
  • Exposure in building real-time processing pipelines using Flink or Spark-streaming
  • Exposure to data and machine learning services from Amazon Web Services (AWS) and/or Google Cloud (GCP) is a plus

What We Offer:

M-DAQ offers competitive remuneration including employee stock options and employee benefits. In 2019, M-DAQ was recognised as the Best Tech Company To Work For.

Please send your latest resume to recruit@m-daq.com with your availability, current and expected remuneration.

 

 

 

OpeningsDepartmentLocation
Senior Software EngineerEngineeringSingapore
Product ManagerStrategic Product ManagementSingapore
Site Reliability Engineer (CORE/SRE)Site Reliability EngineeringSingapore
Associate Site Reliability Engineer Site Reliability EngineeringSingapore
Site Reliability Engineer InternSite Reliability EngineeringSingapore
Treasury AnalystTreasury Singapore
Sales ManagerSalesSingapore
Client Solutions ManagerSalesSingapore
Client Solutions Associate (Entry-Level)SalesSingapore
IT Support AssistantInfra Cloud SecuritySingapore
Sr Fraud Specialist / Fraud Risk ManagerInformation Security Risk, Operational Risk and Fraud Risk
Singapore

Human Resources InternHuman Resources
Singapore
DevOps Intern Infra Cloud SecuritySingapore
Marketing InternSunraySingapore
Finance & Admin InternFinanceSingapore
QA EngineerEngineeringSeoul, South Korea
Analyst CORE/SRESite Reliability Engineering
Seoul, South Korea