Rólunk

What is like to work in UC colors? One thing is for sure, all 350+ of our colleagues would say the same: unique and unrepeatable. Professional and soft skill training, team-building, IT Fest, Balaton Circle on two wheels or two feet, kUCkó aka UC wellness centre, themed craft afternoons, charity painting. Be a part of this experience of a lifetime!

Az ügyfél / a projekt

We're looking for a skilled and experienced Senior Data Engineer with deep specialization in Databricks and Microsoft Azure. You'll be one expert of the team, instrumental in designing, building, and maintaining robust and scalable data pipelines, ensuring the highest standards of data quality, security, and compliance within a critical financial environment. You'll work closely with data scientists, analysts, and business stakeholders, turning raw financial data into valuable insights that drive our business forward.

Feladatok

• Data Pipeline Development: design, develop, implement, and optimize complex ETL/ELT data pipelines using Databricks, and other Azure data services like Azure Data Factory, Azure SQL, Azure Data Lake Storage (ADLS).
• Databricks Expertise: leverage your in-depth knowledge of Databricks for large-scale data processing, transformation, and analysis.
• Coding & Scripting: write clean, efficient, and well-documented code primarily using Spark (PySpark or Scala), Python, and SQL for data manipulation and transformation.
• Azure Cloud Architecture: contribute to the architectural design of scalable and secure data solutions on the Azure platform, ensuring best practices for performance, cost-efficiency, and resilience.
• Data Modeling & Governance: Collaborate with data architects to implement robust data models (e.g., Delta Lake, data warehousing concepts) and enforce data governance policies, including data quality, lineage, and metadata management.
• Performance Optimization: identify and implement performance tuning strategies for data ingestion, processing, and query performance within Azure and Databricks.
• Financial Data Handling: work with sensitive financial data, ensuring strict adherence to data security protocols, regulatory requirements (e.g., GDPR, PSD2), and industry best practices.
• Automation & DevOps: implement CI/CD pipelines using Azure DevOps or similar tools to automate data pipeline deployments, testing, and monitoring.
• Troubleshooting & Support: provide expert-level troubleshooting and support for data pipeline issues, ensuring minimal disruption to data availability and integrity.
• Collaboration: work effectively in an agile team environment, collaborating with cross-functional teams including software engineers, data scientists, business analysts, and compliance officers.
• Documentation: create and maintain comprehensive technical documentation for data pipelines, processes, and data models.

Szükséges ismeretek/ Használt technológiák

• A minimum of five years of professional experience as a Data Engineer is required.
• Proven hands-on experience (2-3+ years) of dataflow developments with Microsoft Azure and Databricks data services, specifically: Azure Datalake Storage (ADLS), Azure SQL, Azure Data Factory.
• Strong programming proficiency in Python (PySpark), ETL with Spark SQL and SQL.
• Familiarity with Medallion Architecture, so called Bronze, Silver and Gold layers.
• Solid understanding of data warehousing concepts, ETL/ELT methodologies, and data modeling techniques.
• Experience with version control systems (e.g., Git) and CI/CD practices.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and as part of a collaborative team in a fast-paced environment.

Előny

• Databricks Certified Data Engineer Associate or Professional certification.
• Microsoft Certified: Azure Data Engineer Associate (DP-203) certification (or equivalent: DP-201, 202 or DP-700).
• Prior experience working in the financial services industry (e.g., banking, fintech, insurance), with an understanding of financial data concepts, and reporting requirements (e.g.: BASEL2).
• Familiarity with data governance tools and frameworks (e.g.: Collibra, Unity Catalog or Microsoft Pureview).

Miért érdemes csatlakozni hozzánk

• We don't have the wrong answer! Remember, you can never be too loud when we're celebrating!
• Building community is our core value: we organise on average 1 event per week: team building, meetup, workshop, kick-off, business breakfast, sporting event... what else could you add?
• Flexibility is the key? Working from home?, in our new office? - which would you prefer?
• Two steps ahead: varied projects, mentoring, technical and soft skill training, supportive leadership and career development - all waiting for you!
• A break after work? Our super company holiday resort kUCkó in Siofok is waiting for you, whether it's a workshop, a team-building session or a family holiday.