Data Engineer
Singapore
Key Responsibilities
- Design, develop and implement Big Data platforms in cloud
- Build a centralized datalake and data warehouse for data feeds from all M-DAQ entities
- Set up tools for data ingesting (batch and real-time), data cleaning, building data cubes in the data warehouse
- Build tools to monitor data quality and manage data changes
- Build end-user facing data catalogue and data lineage to facilitate data discovery
Desired Skill Set and Attributes
- 5+ years of experience with excellent coding skills (Python, Java or Scala)
- Bachelor or Master’s degree in Computer Science, Engineering, or relevant industry experience is required
- Experience with Big Data technology architecture (Hadoop, Spark, Kafka, Flink, Hive etc), tuning, troubleshooting and scaling the systems. Deep understanding with the internal principles of these systems.
- Hands on experience designing and implementing Data Warehouse (Snowflake, Athena or Redshift)
- Solid understanding of ETL and ELT approaches and large scale data ingestion/integration framework.
- Experience in designing data quality morning and fault-tolerant pipelines
- Hands on experience in developing/designing/integrating using Kubernetes
- Exposure in building real-time processing pipelines using Flink or Spark-streaming
- Exposure to data and machine learning services from Amazon Web Services (AWS) and/or Google Cloud (GCP) is a plus
What We Offer:
M-DAQ offers competitive remuneration including employee stock options and employee benefits. In 2019, M-DAQ was recognised as the Best Tech Company To Work For.
Please send your latest resume to recruit@m-daq.com with your availability, current and expected remuneration.
Openings | Department | Location |
---|---|---|
Senior Software Engineer | Engineering | Singapore |
Product Manager | Strategic Product Management | Singapore |
Site Reliability Engineer (CORE/SRE) | Site Reliability Engineering | Singapore |
Associate Site Reliability Engineer | Site Reliability Engineering | Singapore |
Site Reliability Engineer Intern | Site Reliability Engineering | Singapore |
Treasury Analyst | Treasury | Singapore |
Sales Manager | Sales | Singapore |
Client Solutions Manager | Sales | Singapore |
Client Solutions Associate (Entry-Level) | Sales | Singapore |
IT Support Assistant | Infra Cloud Security | Singapore |
Sr Fraud Specialist / Fraud Risk Manager | Information Security Risk, Operational Risk and Fraud Risk | Singapore |
Human Resources Intern | Human Resources | Singapore |
DevOps Intern | Infra Cloud Security | Singapore |
Marketing Intern | Sunray | Singapore |
Finance & Admin Intern | Finance | Singapore |
QA Engineer | Engineering | Seoul, South Korea |
Analyst CORE/SRE | Site Reliability Engineering | Seoul, South Korea |