Senior Data Engineer
PROBIS is a fast-growing PropTech startup from Munich that is currently redefining financial controlling for real estate projects worldwide with its cloud-based platform - from high-rises in New York to megaprojects in Saudi Arabia. Our software is technically sophisticated, complex in terms of content - and yet should be easy and intuitive for our users to operate.
Now, in the most exciting phase of our growth, we are looking for you as our Senior Data Engineer.
The Senior Data Engineer is responsible for designing, implementing, and maintaining enterprise-scale data architecture solutions. This role designs and develops a greenfield data lakehouse system, including data ingestion pipelines, storage optimization, and high-performance query APIs. The position requires hands-on technical implementation combined with strategic architectural design skills and English speaking individual.
Essential Job Functions
1. Data Architecture Design
o Understand PROBIS data model, identify bottlenecks and translate into
actionable designs
o Design a modern data lakehouse architecture for greenfield implementation
o Architect scalable data storage and processing solutions using Azure
ecosystem and applicable open source components
o Design the best stack for the job, considering data sovereignty and storage
requirements in target markets
2. Technical Implementation
o Implement data ingestion pipelines from existing postgres database systems
and integrations
o Improve the .net based data access of existing postgres system
o Build and verify high-performance query APIs on top of the greenfield design, enabling orders of magnitude growth in data volume, with improved performance
o Develop and optimize data transformation processes
o Set up monitoring and observability for reliable live operation
3. System Integration
o Integrate the data lakehouse with existing enterprise systems
o Design and implement performant query engines for user interfaces
o Ensure data consistency and quality across integrated systems
4. Documentation and Compliance
o Execute performance and consistency testing under increased loads
o Collect evidence and document the architecture
o Ensure compliance and support necessary certification processes
Required Qualifications
Experience
● Minimum 6 years of experience in data engineering
● Minimum 4 years of hands-on experience with Microsoft Azure data services
● Proven track record of shipping performant data projects on Azure / Postgres / Data Factory / Databricks
Technical Skills
● Expert proficiency in Microsoft Azure data platform (Synapse, Data Factory, SQL Databases, Data Lake)
● Good .NET Core development skills
● Strong SQL and database (psql) optimization capabilities
● Experience with data modeling techniques and methodologies
● Ideally, experience with sovereign data solutions including Spark based data warehousing
● Knowledge of ETL/ELT processes and data pipeline design
Success Metrics
● Successful optimization of existing database access for problematic queries
● Successful delivery of greenfield data warehouse implementation
● Achievement of query performance targets (sub-second response times)
● Data pipeline reliability and uptime metrics
● Customer satisfaction with data architecture solutions.