Data Engineer
Shopee Indonesia · Jakarta, Indonesia
Sekilas tentang pekerjaan ini
Shopee Indonesia mencari Data Engineer untuk mendukung inisiatif business intelligence dan analitik data melalui pengembangan data mart, data warehouse, dan pipeline. Posisi ini berbasis di Jakarta, Indonesia, dan ditujukan bagi kandidat dengan pengalaman 2–4 tahun.
Tugas utama
- Merancang dan mengembangkan data mart serta data warehouse
- Mengelola pipeline data dari berbagai sumber
- Berkolaborasi mengubah data menjadi insight bisnis
- Menjaga kualitas, keamanan, dan privasi data
- Menerapkan praktik pengembangan perangkat lunak dan dokumentasi kode
Kualifikasi utama
- S1 atau S2 di bidang komputer, sistem informasi, sains, atau teknik
- Pengalaman 2–4 tahun di bidang data engineering, pipeline, atau arsitektur data
- Kemampuan tingkat ahli dalam SQL, Spark, HDFS, atau framework big data
- Menguasai pemrograman berorientasi objek dan fungsional; Python atau Scala diutamakan
- Pengalaman dengan UNIX, pemrosesan batch, lambda architecture, dan pemodelan data Kimball
Ringkasan ini dibuat dengan AI dari deskripsi di bawah. Yang berlaku adalah deskripsi lengkapnya di situs Shopee Indonesia.
Deskripsi pekerjaan
- Design and develop data marts and data warehouses to support business intelligence and data analytics initiatives within the project lifecycle.
- Handle end-to-end data pipelines from multiple internal and external sources, ensuring high performance, scalability, and establishing a Single Source of Truth for project deliverables.
- Collaborate closely with Data PMs, Business Intelligence Analysts, and engineering team members to transform complex data into actionable business insights within designated project timelines.
- Implement and maintain data management best practices across all project pipelines, focusing on data quality, security, and privacy.
- Execute software development best practices, including test-driven development and code documentation, to ensure robust and maintainable data infrastructure.
Requirements
- Hold a Master's or Bachelor's degree in Computer Science, Information Systems, or other quantitative-based majors (Science or Engineering)
- Possess 2 to 4 years of hands-on working experience in data engineering, data pipeline development, or data architecture.
- Demonstrated expert-level proficiency in SQL, Spark, HDFS, or big data processing frameworks.
- Expert knowledge of Object-Oriented and Functional Programming, with a strong preference for Python or Scala.
- Solid experience working in UNIX environments, with deep understanding of batch processing, lambda architecture, and Kimball data modeling concepts.
- Proficient in Software Development Life Cycle (SDLC) practices, including version control, test-driven development, and technical documentation.