Senior Data Engineer (Azure & Python) (m/f/d)
- Remote, Berlin
- Start: 10.08.2026
- 3 days ago
- Job type:
- Project
- Duration:
- 12 months
- Scope of work:
- part-time - (180 PT)
- Languages:
- German, English
ID: 179396
Westhouse is one of the leading international recruitment agencies for the procurement of highly qualified experts in fields such as IT lifecycle management, SAP, engineering, commerce and specialist consultancy.
For our client we are currently looking for a Senior Data Engineer (Azure & Python) (m/f/d) - Remote, Berlin.
Your tasks
- Stabilize the existing implementations
- Suggest and implement quality improvements in existing data pipelines and
- Finalize implementation of missing features and pipelines
- Design, develop, implement and document agreed components for production-grade data processing and integration systems
- Design, develop, implement and document reliable and scalable data pipelines with a focus on stability, performance, maintainability and operational efficiency
- Produce high-quality, testable, and version-controlled source code in accordance with established engineering standards, development guidelines, and best practices
- Conduct code, design and architecture reviews and document findings and recommendations for the continued development of the solution landscape
- Execute technical assessment, root-cause analysis and documented recommendations for agreed operational issues in relation to the delivered components
- Provide technical input through defined project interfaces and agreed review formats with designated contact persons
- Provide technical expertise and recommendations to support the successful delivery of project and operational objectives
Interested?
Mark Plewe
Tel.: +49-69-24007541
Fax.: +49-69-240075-49
Email: m.plewe@westhouse-group.com
Share posting
Your qualifications
- MUST HAVE:
- Proven professional experience in software engineering or backend engineering, ideally in data‑intensive or distributed systems
- Azure Cloud Platform Expertise: extensive experience designing, implementing, and operating solutions in Azure, including services such as Azure Data Factory, Azure Data Lake Storage (ADLS), Azure Functions, and Event Grid.
- Python Application Development (4+ years): Demonstrated experience in developing modular, maintainable and testable Python applications for production use.
- Demonstrated experience in troubleshooting complex cross-system issues in production environments.
- Strong understanding of data modeling techniques (e.g. dimensional modeling, domain-driven design, event-driven architectures)
- Experience designing and maintaining automated build, test, and deployment processes for data pipelines and analytics workloads, including version control, environment promotion, and release management (e.g. Git‑based workflows, Azure DevOps)
- NICE TO HAVE:
- Demonstrated professional experience in building and operating Spark-based data processing solutions, preferably with Databricks in production environments.
- Practical experience operating software systems in cloud environments, including identity and access management (IAM), security best practices, and environment configuration
- Proven experience in Data Product Activities: Design and maintenance of data products with clear ownership, interface contracts, and service-level expectations (SLAs/SLOs)
- Advanced proficiency in SQL, strong understanding of relational data concepts and data modeling principles.
- Experience in the design and evolution of shared data engineering standards, patterns, or best practices based on defined requirements
- Experience with data quality, observability and governance, including lineage, monitoring, metrics, alerting and quality controls
- Experience designing and operating enterprise‑scale data platforms or data infrastructure
- Experience managing schema evolution and data contracts in production environments
- Experience with event-driven architectures and/or streaming data processing (e.g. Spark Structured Streaming, Kafka, Azure Event Hub)