Data Engineer
PT Bumi Amartha Teknologi Mandiri
- South Tangerang, IndonesiaSouth Tangerang, Banten, IndonesiaSouth TangerangBantenIndonesiaIndonesia
- KontrakCONTRACTOR
Lowongan dipasang 20 days ago dan batas waktu lamaran adalah 30 Jan
Rekruter terakhir aktif 2 days ago
2024-12-02T10:02:21.340984+00:002025-01-30T17:00:00+00:00Deskripsi Pekerjaan
- Utilize Google Cloud Data Fusion, Composer/Airflow, and DataProc to develop and manage scalable data pipelines that integrate data from various sources.
- Write and optimize Python and PySpark scripts to process, clean, and analyze large datasets.
- Develop and manage BigQuery solutions, including creating and executing queries, writing procedures, and using the BigQuery API to interface with data. Optimize query performance and ensure efficient data storage.
- Leverage Google Cloud Pub/Sub to implement real-time data streaming solutions. Design and maintain pub/sub topics and subscriptions to handle data ingestion and processing.
- Identify and resolve issues related to data processing and pipeline performance. Continuously seek opportunities to optimize and enhance data engineering practices.
Kualifikasi Minimum
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent work experience.
- Minimum of 4 years of experience as a Data Engineer or in a similar role, with hands-on experience in Google Cloud Platform and associated tools.
- Proficient in Google Cloud Data Fusion, Composer/Airflow, DataProc, and Pub/Sub.
- Strong experience with Python and PySpark for data processing and analysis.
- Expertise in BigQuery, including API usage, writing procedures, and optimizing queries.
- Experience with Google Kubernetes Engine (GKE) for deploying and managing containerized applications.
- Knowledge of data warehousing and ETL best practices.
Ringkasan Perkerjaan
- Tingkat Posisi
- Mid-Senior Level Manager
- Spesialisasi
- IT and Software
- Persyaratan tingkat pendidikan
- Lulus program Sarjana (S1)
- Respon rekruter ke lamaran
- Once in a while
- Alamat Kantor
- South Tangerang, Banten, Indonesia
Agar merasa aman saat melamar: carilah ikon verifikasi dan selalu lakukan riset terhadap Perusahaan yang Anda lamar. Hindari dan laporkan situasi dimana Perusahaan membutuhkan bayaran dalam proses rekrutmen mereka.
Tentang PT Bumi Amartha Teknologi Mandiri
Bumi Amartha Teknologi Mandiri or “AMARTEK” was established to provide information technology solutions. Our mission from the very first day has been to cultivate professional relationships with our clients to provide effective and reliable information technology solutions for their needs. The team at "AMARTEK" is equipped with a highly developed skillset developed over decades of experience not only in information technology but also in business processes across a range of industry sectors. This business experience makes us uniquely positioned to offer solutions promising greater operational efficiency, productivity gains and cost savings for each of our clients, regardless of their industry.
As an established technology-intensive company, we pride ourselves on providing a comprehensive suite of solutions comprising of Infrastructure Consultancy, on/offsite services, Custom software and web development, Talent Augmentation, and enterprise architecture consulting. Our team consistently delivers state-of-the-art solutions in various areas including, but not limited to: integrated business solutions, system applications, product development and professional services.
At "AMARTEK", we guarantee rapid, reliable and robust information technology solutions that work.