Deskripsi Pekerjaan

Responsibilities: - Extract text data from multiple sources such as PDF, Excel, and Word. - Convert text data into specified formats based on requirements. - Save processed data into designated databases. - Develop and automate data pipelines for continuous automatic updates. - Debug and maintain existing data pipelines. Required Qualifications: - Minimum Associate Degree (D3) in Computer Science, Information Systems, Data Science, or another related technical field. - At least 1 year of experience as a Data Engineer. - Solid understanding of file formats (PDF, Excel, Word, etc.) and data extraction techniques. - Experience in text data processing and transformation. - Proficiency in Python and SQL. - Knowledge of DBMS including MySQL, PostgreSQL, and NoSQL. - Strong analytical skills and attention to detail. Preferred Qualifications: - Familiarity with vector databases (Qdrant, Weaviate, MongoDB, etc.) and hands-on experience using them. - Experience in building and managing data pipelines using tools like Apache Airflow and Luigi. - Experience with big data and related tools such as Hadoop and Spark. - Experience working with cloud services (AWS, GCP, Azure).

Senior Data Engineer

Deskripsi Pekerjaan

Ringkasan

Sumber & keterlacakan data

Lowongan Terkait Lainnya

IT Staff

Staff - IT Infrastructure

Software Engineer

DevOps Engineer