Senior Data Engineer Lead Balen
Bedrijfsvoorstelling
Nyrstar is an international producer of critical minerals and metals essential for a low carbon future. With a market leading position in zinc and lead, Nyrstar has mining, smelting and other operations located in Europe, the United States and Australia and employs approximately 4,000 people. Its Corporate Office is based in Budel-Dorplein, the Netherlands.
The company’s operations are located close to key customers and major transport hubs to facilitate reliable and efficient delivery of raw materials and distribution of finished products. Nyrstar’s operating business is wholly owned by Trafigura, one of the world’s leading independent commodity trading and supply chain logistics companies.
Functie
This critical role falls under our Digital Innovation & AI division, charged with the mission of leading the development and optimization of our data infrastructure to support advanced data engineering initiatives. The ideal candidate will bring a wealth of technical expertise in data engineering, outstanding leadership capabilities, and a strategic outlook to empower data-driven decision-making processes. The primary objective is to orchestrate the construction and continuous improvement of scalable, reliable data pipelines and architectures. You will mentor local Data Engineers, establish best practices in data handling and processing, and oversee innovative engineering projects that enable sophisticated data analysis and actionable insights. This role is dedicated to enhancing data accessibility and quality, as well as creating a culture of technical excellence & collaborative learning within the community.
- Optimal Data Pipeline Architecture: Create and maintain state-of-the-art data pipeline architectures, ensuring that they meet both functional and non-functional business requirements. Develop a cost-effective, scalable and future-proof data architecture.
- Building the Foundation: Creating best practices, guides, and training for everyone using Data Engineering at Nyrstar Group. Assess and determine governance together with our data governance manager about stewardship, and frameworks for managing data across the organization.
- Improve data accessibility & quality: Offering support & coordination to local data engineering projects by closely working with them to identify, design, and build appropriate data pipelines following the best practice.
- Championing Excellence: Setting up a dedicated Data Engineering Center of Excellence to drive continuous learning and innovation in data management.
- Process Improvement: Identify and implement internal process improvements by automating manual processes, optimizing data delivery, and redesigning infrastructure for enhanced scalability.
- Leading our data engineering community: Providing training and guidance/coaching to our local data engineers, fostering knowledge sharing and collaboration.
- Infrastructure Development: Build and maintain the necessary infrastructure for efficient extraction, transformation, and loading (ETL) of data from diverse sources utilizing SQL and cloud technologies such as Azure.
- The Data Engineering Answer Person: Acting as the trusted resource for colleagues and business stakeholders on all things Data Engineering tools, projects and approaches.
- Working with Teams: Work with Product Managers, Engineers, and Analytics teams to address data-related technical issues and fulfill their data infrastructure requirements.
- Managing Roadmaps: Conduct research and make recommendations on big data infrastructure, database technologies and manage our general roadmap on the long-term.
Profiel
- 8+ years experience in Data Engineering, with 5+ years in the production industry to understand the specific needs of large manufacturing companies (both time series, relational and transactional datasets).
- Proven track record of leading Data Engineering teams and projects; strong (project) management skills and organizational capabilities.
- Expertise in building and optimizing big data pipelines, setting up architectures, and datasets to make them scalable, future-proof and cost-effective.
- Strong experience in the Azure environment is a must.
- Technical Skills:
- Proficiency with big data tools, particularly Databricks.
- Experience managing data pipelines and workflows in Azure DevOps.
- Experience in object-oriented or functional scripting languages - Python (& PySpark), T-SQL, PowerShell and Java.
- Familiarity with stream-processing systems - Storm, Spark-Streaming, etc.
- Tech knowledge of Azure Cloud Data Technologies (ADF, Databricks, ADLS, Monitoring & Logging on Azure Cloud)
- Working with SAP is a big plus.
- Proficiency with a variety of database systems, both relational and non-relational.
- Good understanding of machine learning algorithms and their implementation in big data pipelines since you will work closely with the senior data scientist lead.
- Proficient in English and have great skills in conveying complex concepts to a non-technical audience. Dutch and/or French languages are a big plus.
- Strong analytical and problem-solving abilities; attention to detail; project management experience; understanding of data privacy laws (GDPR).
- Detail-oriented, proactive problem solver, flexible, independent, collegial attitude, and a team player.
Aanbod
Nyrstar offers a wide range of benefits, including:
- Monthly salary based on your expertise
- Annual bonus
- Monthly representation allowance
- Company car
- Meal vouchers
- Possibility to work from home
- Hospitalisation insurance
- Pension plan
- ...
Nyrstar is an equal opportunity employer and takes pride in a diverse workforce. We do not discriminate in recruitment, hiring, training, promotion or other employment practices for reasons of race, colour, religion, gender, sexual orientation, national origin, age, marital or veteran status, medical condition or handicap, disability, or any other legally protected status.
Bijkomende informatie
#LI-LD1
