Data Engineer  

• evelop, construct, test, and maintain architectures (such as databases and large-scale processing systems);
• Ensure architecture will support the business requirements;
• Discover opportunities for data acquisition;
• Designing and developing data streaming pipelines for data science at scale;
• Develop data set processes for data modeling, staging, ETL and production;
• Employ a variate of languages and tools (e.g. SQL, and scripting languages) to establish the data pipeline;
• Experimenting with new technologies and communicating the results;

Recommend ways to improve data reliability, efficiency and quality

• Bachelor/Master's degree in computer science, computer engineering or any related engineering discipline; or three years’ solid experience as a data engineer;
• Experience with programming languages and other tools such as PostgreSQL, MySQL, MongoDB, neo4j, Spark, Hadoop, container management, cloud platform such as AlibabaCloud, Google Cloud Platform, AWS;
• Experience with two or more of the following programming languages: Python, R, Scala, C, C++, Java, Golang.
• Experience in data processing and working with database technologies, such as Talend, Pentaho/Vantara, GCP dataflow, AlibabaCloud MaxCompute,
• Ability to think creatively and analytically, to work collaboratively and to perform tasks under minimal supervision.
• Ability to work in a proactive, highly engaging, client oriented environment;
• Ability and experience in the way of industry’s functions and how data can be collected, analyzed and utilized; maintaining flexibility in the face of big data developments.