Senior Data Engineer (Data)  

• Develop robust end-to-end data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling.
• Collaborate with a cross functional team to resolve data quality and operational issues.
• Interact directly with end users to gather requirements and consult on data integration solutions. Regularly have their best interests in mind and proactively recommend value added items – even if not requested.
• Maintain, support, and enhance most elements of Tokopedia’s Information Management Systems with minimal assistance from peers.
• Provide mentoring / coaching to junior developers
• Receive and adhere to project delivery deadlines.
• Migrate code across environments and leverage a source code management system.
• Create jobs to perform auditing and error handling.
• Develop and maintain proper documentation for data pipeline and service
• Doing code review during development

Skill Sets:

• Proficiency in traditional RDBMS with an emphasis on Postgres, and MySQL.
• General understanding of ETL/ELT frameworks, error handling techniques, data quality techniques and their overall operation
• Generally proficient in performing data transformations via scripting, stored procedures, or an ETL framework.
• Proficient in developing and supporting all aspects of a big data cluster: Ingestion, Processing, integration (Python, Spark, Scala), data cleansing, workflow management (OOZIE and ActiveBatch, Airflow), and querying (SQL).
• Proficiency in at least one of the following programming languages: Java, Python, Go and Scala.
• Experience in writing Apache Spark or Apache Beam including an understanding of optimization techniques.
• Proficient in Unix and Linux operating systems
• Capable of navigating and working effectively in a DevOps model including leveraging related technologies: Jenkins, GitLab, Git etc...

Education:

• A Bachelor’s Degree in Computer Science or related field required.
• 3+ years of Data Integration experience
• 3+ years of hands on experience with one of the following technologies: Hadoop, Apache Spark, Redis, SQL or Redshift or PostgreSQL
• 1+ years experience with Cloud Environment like AWS, GCP or Azure
• Having experience in GCP Product like Bigquery, Dataflow, PubSub, Bigtable, Composer, GCS is a big plus
• 1+ years of experience in developing REST APIs
• 3+ years of experience in using complex SQL