- Design, develop and implement Big Data platforms in cloud
- Build a centralized datalake and data warehouse for data feeds from all M-DAQ entities
- Set up tools for data ingesting (batch and real-time), data cleaning, building data cubes in the data warehouse
- Build tools to monitor data quality and manage data changes
- Build end-user facing data catalogue and data lineage to facilitate data discovery
Desired Skill Set and Attributes
- 5+ years of experience with excellent coding skills (Python, Java or Scala)
- Bachelor or Master’s degree in Computer Science, Engineering, or relevant industry experience is required
- Experience with Big Data technology architecture (Hadoop, Spark, Kafka, Flink, Hive etc), tuning, troubleshooting and scaling the systems. Deep understanding with the internal principles of these systems.
- Hands on experience designing and implementing Data Warehouse (Snowflake, Athena or Redshift)
- Solid understanding of ETL and ELT approaches and large scale data ingestion/integration framework.
- Experience in designing data quality morning and fault-tolerant pipelines
- Hands on experience in developing/designing/integrating using Kubernetes
- Exposure in building real-time processing pipelines using Flink or Spark-streaming
- Exposure to data and machine learning services from Amazon Web Services (AWS) and/or Google Cloud (GCP) is a plus
What We Offer:
M-DAQ offers competitive remuneration including employee stock options and employee benefits. In 2019, M-DAQ was recognised as the Best Tech Company To Work For.
Please send your latest resume to email@example.com with your availability, current and expected remuneration.
|Senior Software Engineer||Engineering||Singapore|
|Product Manager||Strategic Product Management||Singapore|
|Site Reliability Engineer (CORE/SRE)||Site Reliability Engineering||Singapore|
|Associate Site Reliability Engineer||Site Reliability Engineering||Singapore|
|Site Reliability Engineer Intern||Site Reliability Engineering||Singapore|
|Client Solutions Manager||Sales||Singapore|
|Client Solutions Associate (Entry-Level)||Sales||Singapore|
|IT Support Assistant||Infra Cloud Security||Singapore|
|Sr Fraud Specialist / Fraud Risk Manager||Information Security Risk, Operational Risk and Fraud Risk||Singapore
|Human Resources Intern||Human Resources||Singapore|
|DevOps Intern||Infra Cloud Security||Singapore|
|Finance & Admin Intern||Finance||Singapore|
|QA Engineer||Engineering||Seoul, South Korea|
|Analyst CORE/SRE||Site Reliability Engineering||Seoul, South Korea