Data Engineer
PT Bumi Amartha Teknologi Mandiri
- South Tangerang, IndonesiaSouth Tangerang, Banten, IndonesiaSouth TangerangBantenIndonesiaIndonesia
- ContractualCONTRACTOR
Posted 21 days ago and deadline of application is on 30 Jan
Recruiter was hiring an hour ago
2024-12-02T10:02:21.340984+00:002025-01-30T17:00:00+00:00Job Description
- Utilize Google Cloud Data Fusion, Composer/Airflow, and DataProc to develop and manage scalable data pipelines that integrate data from various sources.
- Write and optimize Python and PySpark scripts to process, clean, and analyze large datasets.
- Develop and manage BigQuery solutions, including creating and executing queries, writing procedures, and using the BigQuery API to interface with data. Optimize query performance and ensure efficient data storage.
- Leverage Google Cloud Pub/Sub to implement real-time data streaming solutions. Design and maintain pub/sub topics and subscriptions to handle data ingestion and processing.
- Identify and resolve issues related to data processing and pipeline performance. Continuously seek opportunities to optimize and enhance data engineering practices.
Minimum Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent work experience.
- Minimum of 4 years of experience as a Data Engineer or in a similar role, with hands-on experience in Google Cloud Platform and associated tools.
- Proficient in Google Cloud Data Fusion, Composer/Airflow, DataProc, and Pub/Sub.
- Strong experience with Python and PySpark for data processing and analysis.
- Expertise in BigQuery, including API usage, writing procedures, and optimizing queries.
- Experience with Google Kubernetes Engine (GKE) for deploying and managing containerized applications.
- Knowledge of data warehousing and ETL best practices.
Jobs Summary
- Job Level
- Mid-Senior Level / Manager
- Job Category
- IT and Software
- Educational Requirement
- Bachelor's degree graduate
- Recruiter response to application
- Once in a while
- Office Address
- South Tangerang, Banten, Indonesia
Feel secure when applying: look for the verified icon and always do your research on a company. Avoid and report situations when employers require payment or work without compensation as part of their application process.
About PT Bumi Amartha Teknologi Mandiri
Bumi Amartha Teknologi Mandiri or “AMARTEK” was established to provide information technology solutions. Our mission from the very first day has been to cultivate professional relationships with our clients to provide effective and reliable information technology solutions for their needs. The team at "AMARTEK" is equipped with a highly developed skillset developed over decades of experience not only in information technology but also in business processes across a range of industry sectors. This business experience makes us uniquely positioned to offer solutions promising greater operational efficiency, productivity gains and cost savings for each of our clients, regardless of their industry.
As an established technology-intensive company, we pride ourselves on providing a comprehensive suite of solutions comprising of Infrastructure Consultancy, on/offsite services, Custom software and web development, Talent Augmentation, and enterprise architecture consulting. Our team consistently delivers state-of-the-art solutions in various areas including, but not limited to: integrated business solutions, system applications, product development and professional services.
At "AMARTEK", we guarantee rapid, reliable and robust information technology solutions that work.