Key responsibilities

• Design, build, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
• Develop and optimize data models and ETL or ELT processes for cloud-based data warehouses.
• Implement data integration solutions across multiple sources using Azure Data Lake Storage and Azure SQL Database.
• Monitor, troubleshoot, and optimize data pipeline performance and data quality.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.
• Implement data security, governance, and compliance best practices on the Azure platform.
• Develop and maintain Azure Databricks notebooks for data transformation and processing.
• Support real-time data streaming solutions using Azure Event Hubs and Stream Analytics.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3+ years of hands-on experience with Microsoft Azure data services.
• Strong proficiency in SQL, Python, and or Scala for data engineering tasks.
• Experience with Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Data Lake.
• Knowledge of data warehousing concepts, dimensional modeling, and star or snowflake schemas.
• Familiarity with CI/CD pipelines, version control (Git), and DevOps practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities.

Preferred

• Azure Data Engineer Associate certification (DP-203) preferred.

Key responsibilities

• Engage with business stakeholders to understand, gather, and assess information needs.
• Translate business requirements into detailed system specifications supporting data warehouse architecture.
• Perform analysis, development, and evaluation of data mining activities in a data warehouse environment.
• Contribute to data design, database architecture, metadata creation, and repository structures.
• Review, analyze, and validate data loaded into the data warehouse for accuracy and completeness.
• Conduct data quality checks and resolve data discrepancies through cleansing and refinement.
• Collaborate with business users on reporting requirements and provide technical consulting.
• Develop prototypes to validate design approaches, prepare test scripts, and perform functional testing.
• Support data replication, extraction, transformation, and loading processes.
• Maintain strong working knowledge of software tools, scripts, and languages in the data warehouse environment.
• Continuously evaluate data warehouse processes and recommend improvements.

Qualifications

• Minimum 3 years of relevant technical or business work experience.
• Strong skills in analyzing and documenting technical processes and identifying inefficiencies.
• Experience with data mapping, data modeling, and data integration between systems.
• Proficiency with Microsoft Visio.
• Strong verbal and written communication skills.
• Bachelor's degree in Computer Science, Information Systems, or a related field, or 4 years of equivalent experience.

Preferred

• Familiarity with business process mapping and defining current-state applications.
• Experience facilitating sessions with business leadership, subject matter experts, and users.
• Skilled in understanding web applications and common application approaches.