Data Engineer

Shopee

South Jakarta, Indonesia
26, Pacific Century Place SCBD Lot 10, Jl. Jendral Sudirman Kav 52-53, Jakarta 12190, Indonesia, South Jakarta, DKI Jakarta, Indonesia
South Jakarta
DKI Jakarta
Indonesia
Indonesia
Penuh waktuFULL_TIME

Berakhir 5 years ago

2019-10-31T17:00:00+00:00

Ditutup.

Deskripsi Pekerjaan

As a Data Engineer, you will be partly a software engineer, a platform engineer, and a system engineer. You will design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations. Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platform.

Job descriptions:

Design, build, maintain, and scale our data infrastructure. In doing so, you will also have to monitor and debug the infrastructure that stream millions of data
Explore and learn new technologies that can complement or improve our current stack
Develop data ingestion and integration from data sources to data lake and/or data warehouse, based on data pipeline and framework, into query-able format
Performance tuning and optimization of all data ingestion and data integration processes, including data platform and databases
Work with regional team to allow centralised data warehousing
Work with data analytics team to strive greater functionality in our data system

Kualifikasi Minimum

Requirements:

Bachelor / Master / PhD in Computer Science or a related technical field
At least 2 years working experience in software development, in at least one of these languages: Java, Scala, Go, Python, C/C++, under Linux / Unix
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
Uphold best practices and principle around clean code, testing, continuous integration
Familiar with SQL and/or noSQL databases, eg MySQL, PostgreSQL, MongoDB etc
Love to use and develop with open-source technologies

Skills below are optional but preferable:

Experience with cloud platforms, eg Google Cloud Platform, Amazon Web Services
Familiarity with writing ETL queries
Strong scripting ability in Bash
Familiarity with designing and operating of a robust distributed system.
Experience in manipulating, processing and extracting value from large disconnected datasets
Experience with big data tools: Hadoop, Spark, Kafka, etc

Ringkasan Perkerjaan

Tingkat Posisi: Supervisor / Asisten Manager

Spesialisasi: IT and Software

Persyaratan tingkat pendidikan: Lulus program Sarjana (S1)

Respon rekruter ke lamaran: Once in a while

Alamat Kantor: 26, Pacific Century Place SCBD Lot 10, Jl. Jendral Sudirman Kav 52-53, Jakarta 12190, Indonesia, South Jakarta, DKI Jakarta, Indonesia

Industri: E-Commerce

Lowongan: 1 lowongan dibuka

Situs: https://shopee.co.id/

Agar merasa aman saat melamar: carilah ikon verifikasi dan selalu lakukan riset terhadap Perusahaan yang Anda lamar. Hindari dan laporkan situasi dimana Perusahaan membutuhkan bayaran dalam proses rekrutmen mereka.

Tentang Shopee

Shopee is the leading e-commerce platform in Southeast Asia & Taiwan. Shopee promotes an inclusive and sustainable digital ecosystem by enabling businesses to digitalise and grow their online presence, helping more people access and benefit from digital services, and uplifting local communities. Shopee offers an easy, secure, and engaging experience that is enjoyed by millions of people daily. Shopee is also a key contributor to the region’s digital economy with a firm commitment to helping homegrown brands and entrepreneurs succeed in e-commerce. Shopee is part of Sea Limited (NYSE: SE), a leading global consumer internet company. Sea’s mission is to better the lives of consumers and small businesses with technology through its three core businesses: Shopee, Garena and SeaMoney.

Kandidat juga melamar untuk

Home