FULL_TIME
Design and build ETL/ELT pipelines using Spark SQL and Python within the Databricks Medallion architecture. Develop dimensional data models using star schema methodology, including fact and dimension table design, SCD implementation, and optimization for analytical workloads. Improve Spark SQL and DataFrame performance through partitioning strategies, clustering, and join optimizations while reducing costs. Create data quality frameworks with automated validation checks, statistical profiling, exception handling, and data reconciliation. Set up CI/CD pipelines with version control and automated testing such as unit tests, integration tests, smoke tests, and more. Enforce data governance standards with row-level and column-level security policies for access controls and compliance. Produce and maintain technical documentation covering ERDs, schema specifications, data lineage diagrams, and metadata repositories. Requirements include a minimum of 4 years of fulltime experience with SparkSQL, Python, and PySpark in data engineering workflows; strong skills in dimensional modeling and star schema design for analytical workloads; experience with automated testing and CI/CD pipelines for data workflows; familiarity with GitHub operations and collaborative development practices; proven ability to optimize engineering workflow jobs for performance and cost efficiency; experience with cloud data services and infrastructure (AWS, Azure, or GCP); proficiency with IDE tools such as Visual Studio Code; experience with the Databricks platform considered a plus.
Data Engineer
PT ZURICH ASURANSI INDONESIA, Tbk • Jakarta Selatan
Gaji tidak dicantumkan
Deskripsi Pekerjaan
Ringkasan
- Perusahaan
- PT ZURICH ASURANSI INDONESIA, Tbk
- Lokasi
- Jakarta Selatan
- Tipe kerja
- FULL_TIME
- Gaji
- Gaji tidak dicantumkan
- Tanggal tayang
- 29 Sep 2026
- Terlihat sejak
- 30 Sep 2026
Sumber & keterlacakan data
JobStreet / Jobsdb (SEEK)Buka sumber asli ↗https://id.jobstreet.com/job/94951845
Siap melamar? Langsung di sumber asli.Buka Halaman Lamaran
Lowongan Terkait Lainnya
FULL_TIME1bln
Software Engineer, Backend
PLT Engineering • Jakarta
Gaji tidak dicantumkanLihat Detail →
FULL_TIME1blnSystem Engineer
PT Prima System Integrated • Jakarta Selatan
Gaji tidak dicantumkanLihat Detail →
FULL_TIME1blnSoftware Engineer, Backend
PT Solusi Transportasi Indonesia • Jakarta
Gaji tidak dicantumkanLihat Detail →
FULL_TIME1blnSenior Software Engineer, Mobile (Android) - Consumer Experience
PLT Engineering • Jakarta
Gaji tidak dicantumkanLihat Detail →