Data Engineer  

Summary:

The Data Engineers, as part of Product team, will be responsible to ensure the smooth data operations and seamless flow of data into Qlue Database. The Data Engineer will involve with the team to develop agile reliable, secure, high performing, efficient, and effective state-of-the-art data and analytics driven solutions.

Tasks:

• Develop Data Integration from data sources to Data Lake and/or Data Warehouse, based on Data Pipeline Framework established by Data Engineering Team and technical requirement specifications developed by Data Analyst and/or Business team.
• Develop all necessary ad-hoc Data Ingestion/Integration processes into Operational in Production Environment by adhering to agile, reliable, secure, high performing, efficient and effective methodology.
• Support and Monitor Day-to-day Operations of Data Ingestion and Data Integration processes, serve as a focal point for resolution/escalation of data issues based on an agreed SLA and/or SOP.
• Administration and Monitoring of all Data platforms (Data Lake platform, Data Warehouse and Data Mart databases), ensuring availability, scalability, reliability, and security of the platforms
• Support Data Analyst and Business Stakeholder in analyzing and resolving any data issues as required.

Requirements:

• At least Bachelor's degree in Computer Science, Engineering or other technical field from top local or overseas universities
• Have passion in big data, data mining, and machine learning
• Proficient in programming language (Python, R, Scala, etc)
• Proficient in several modeling techniques including but not limited to: Clustering, SVM, Linear/Non Linear Modeling, Random forest, ANN, etc.
• Familiar with relational/NoSQL database, SQL, and ETL process
• ate in making our city better through technology
• Plus: concern about city improvement