Job Description

Responsibilities:


Active member of the data engineering team
Conduct full lifecycle analysis to include requirements, activities, and design
Build data flows for data acquisition, aggregation, and modeling, using both batch and streaming paradigms
Development of high-quality code for the core data stack including data integration hub, data warehouse and data pipelines under Azure services.
Define new data collection and analysis processes.
Support and optimize data tools and associated cloud environments for consumption by downstream systems, data analysts and data scientists
Ensure code, configuration and other technology artifacts are delivered within agreed time schedules and any potential delays are escalated in advance
Collaborate across developers as part of a SCRUM team ensuring collective team productivity
Participate in peer reviews and QA processes to drive higher quality

Experience and Skills:


3-6 years professional experience as a data engineer, software engineer, data analyst, data scientist, or related role.
High level of T-SQL and data modelling skills in MS SQL Server or Azure SQL environment
2+ years of relevant experience building complex data pipelines using Azure Data Factory
Experience with Microsoft Azure Data Integration Stack (Azure Data Lake Gen2, Azure Data Factory, Delta Lake, Azure SQL, Azure Synapse)
Expertise building ETL and data pipelines on Databricks using data engineering languages Python and SQL on Azure
Proven experience with all aspects of the Data Pipeline (Data Sourcing, Transformations, Data Quality, Etc…).
Experience with Azure DevOps including test and build automation tools and processes
Experience with relational and dimensional database modelling (Relational, Kimball, Data Vault)
Excellent technical documentation and writing skills, and have published API documentation or similar
Exposure to commercial real estate investment domain will have an edge

Personal Attributes:


Positive, Proactive and Committed
Strong communications skills (verbal and written) and outstanding interpersonal skills
Demonstrate a strong work ethic with willingness to do what it takes to get the job done
Exceptional active listening skills
Team player with focus on team success