About the Company:
Talent Insider is an upcoming HR Consultancy Service, founded in 2021. Our clients have been some of the leading brands in Indonesia, and this service continues to expand.
Registered in Singapore & Indonesia, we can assist with your growth plans and strategies, and continue to expand our regional presence with strong regional partners to assist our client in recruitment and branding strategy.
Job Description:
- Design And Implement Data Engineering Products While Liaising With Technical And Business SMEs To Understand Requirements And Architect Appropriate Solutions.
- Provide High-level Expertise In The Use Of SQL, Both In Developing Data Engineering Solutions, And Supporting Less-technical Teams To Effectively Interact With The Company's Data Platforms.
- Optimise Data Solutions Deployed To The Company's Cloud Data Platforms To Improve Performance And Reduce Cost.
- Actively Contribute To The Digital And Technology Team Culture, Actively Engaging In Team Projects, Supporting The Development Of Junior Staff, And Sharing Knowledge With Peers.
- Comply With The Company's Delegations Of Authority (DOA), Procurement Policy, Gifts And Hospitality Policy, And Company's Governance System.
Job Requirements:
- 5+ years in Data Engineering roles, preferably with large, heavy-industry-based company
- Track record in architecting big-data processing systems using contemporary cloud-based technology.
- Experience working as ML Ops (or liaising with data Scientists) preferred.
- Expertise in the Azure data stack (Azure Data Factory), and data lake environments (Data Lake Store, DataBricks_.
- Expertise in SQL Server data sources, and dealing with a variety of data ingestion requirements across relational, streaming, and semi-structured (JSON, XML) formats.
- Experience in utilizing DataBricks/Apache Spark for data engineering (pySpark, DeltaLake).
- Capability to implement appropriate CI/CD processes in a data engineering environment, and to assist data science teams with improving maturing in DevOps/DataOps practices.
- Up to date with modern cloud architectures and supporting services encompassing security, log management, container-based workloads.
