Back to roles
Data Engineer / Developer | Databricks & SQL | Data Quality Rules & Measuring Engineer
Posted 1 week ago
Main tasks & responsibilities
- Develop and extend the GDQM Measuring Engine, implementing new functionalities and technical enhancements.
- Implement, adjust and optimize data quality rules, including the maintenance and further development of the central Rule Repository.
- Translate functional requirements into technical solutions and assess new data quality rule requirements.
- Integrate new data sources and optimize measurement processes and data processing procedures.
- Perform code reviews, testing and quality assurance to ensure the reliability and maintainability of solutions.
- Support the operations and support teams in troubleshooting and resolving complex technical issues.
- Collaborate closely with DevOps engineers, business departments and the GDQM SPOCs of the participating distribution system operators (DSOs).
- Maintain technical documentation covering development activities, solutions and implemented functionalities.
Requirements
- Very good SQL skills and hands-on experience with Databricks.
- Experience with GitLab, version control and CI/CD processes.
- Proven experience in software development within data engineering environments.
- Knowledge and experience in implementing and managing data quality rules.
- Familiarity with data governance concepts and processes.
- Experience working with the Azure Data Platform.
Nice to have
- Knowledge or experience in the energy industry.
- German language skills.