Data Engineer

Talent Insider is an upcoming HR Consultancy Service, founded in 2021. Our clients have been some of the leading brands in Indonesia, and this service continues to expand.

Registered in Singapore & Indonesia, we can assist with your growth plans and strategies, and continue to expand our regional presence with strong regional partners to assist our client in recruitment and branding strategy.

• Understand The Business Requirements And Translate These To Data Services To Solve The Business And Data Problems
• Develop And Manage The Transports/data Pipelines (ETL/ELT Jobs) And Retrieve Applicable Datasets For Specific Use Cases Using Cloud Data Platforms And Tools
• Explore New Technologies And Tools To Design Complex Data Modeling Scenarios, Transformations And Provide Optimal Data Engineering Solutions
• Build Data Integration Layers To Connect With Different Heterogeneous Sources Using Various Approaches
• Understand Data And Metadata To Support Consistency Of Information Retrieval, Combination, Analysis And Reporting
• Troubleshoot And Monitor Data Pipelines To Have High Availability Of Reporting Layer.
• Collaborate With Many Teams - Engineering And Business, To Build Scalable And Optimized Data Solutions

• Over 1-4 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake
• Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must
• Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc.
• Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto)
• Data pipelines & orchestration tool (Ozzie, Airflow, Nifi)
• Any streaming engines (Kafka, Storm, Spark Streaming)
• Any relational database or data warehousing experience
• Any ETL tool experience (Informatica, Talend, Pentaho, Business Objects Data Services, Hevo)