MDAQ_Logo

 

Data Engineer

Singapore

 

Key Responsibilities

  • Design, develop and implement Big Data platforms in cloud
  • Build a centralized datalake and data warehouse for data feeds from all M-DAQ entities
  • Set up tools for data ingesting (batch and real-time), data cleaning, building data cubes in the data warehouse
  • Build tools to monitor data quality and manage data changes
  • Build end-user facing data catalogue and data lineage to facilitate data discovery

Desired Skill Set and Attributes

  • 5+ years of experience with excellent coding skills (Python, Java or Scala)
  • Bachelor or Master’s degree in Computer Science, Engineering, or relevant industry experience is required
  • Experience with Big Data technology architecture (Hadoop, Spark, Kafka, Flink, Hive etc), tuning, troubleshooting and scaling the systems. Deep understanding with the internal principles of these systems.
  • Hands on experience designing and implementing Data Warehouse (Snowflake, Athena or Redshift)
  • Solid understanding of ETL and ELT approaches and large scale data ingestion/integration framework.
  • Experience in designing data quality morning and fault-tolerant pipelines
  • Hands on experience in developing/designing/integrating using Kubernetes
  • Exposure in building real-time processing pipelines using Flink or Spark-streaming
  • Exposure to data and machine learning services from Amazon Web Services (AWS) and/or Google Cloud (GCP) is a plus

What We Offer:

M-DAQ offers competitive remuneration including employee stock options and employee benefits. In 2019, M-DAQ was recognised as the Best Tech Company To Work For.

Please send your latest resume to recruit@m-daq.com with your availability, current and expected remuneration.

 

 

 

OpeningsDepartmentLocation
Engineering ManagerEngineeringSingapore
Scrum MasterEngineeringSingapore
QA EngineerEngineeringSingapore
Software EngineerEngineeringSingapore
Senior Software EngineerEngineeringSingapore
Data EngineerEngineeringSingapore
UAT TesterEngineeringSingapore
Senior Mobile EngineerEngineeringSingapore
Site Reliability Engineer (CORE/SRE)Site Reliability EngineeringSingapore
Associate Site Reliability Engineer Site Reliability EngineeringSingapore
Treasury (FX, Settlements & Payments) Operations AnalystTreasury Singapore
Treasury AnalystTreasury Singapore
DevOps EngineerInfrastructureSingapore
Product ManagerStrategic Product ManagementSingapore
Business Development Executive (Entry-Level)Business DevelopmentSingapore
Content Communications ManagerMarketing Singapore
Human Resource ManagerHuman ResourcesSingapore
Talent Acquisition SpecialistHuman Resources
Singapore

Data Science & Analytics Intern Data Science & Analytics Singapore
Software Engineer InternEngineeringSingapore
Site Reliability Engineer InternSite Reliability EngineeringSingapore
Marketing InternMarketingSingapore
Graphic Design InternGraphic DesignSingapore
Human Resources InternHuman Resources
Singapore
Business Development InternBusiness Development
Singapore
Business Development ManagerBusiness DevelopmentShanghai, China
Business Development AssociateBusiness DevelopmentJapan
Business Development InternBusiness DevelopmentJapan
Software EngineerEngineeringSeoul, South Korea
Business Development ManagerBusiness DevelopmentSeoul, South Korea
Analyst CORE/SRESite Reliability Engineering
Seoul, South Korea