Description:
Responsibilities:
Data Architecture and Modeling
- Design, implement, and manage scalable and efficient data models optimized for Azure environments.
- Collaborate closely with data engineers, business analysis, and business stakeholders to understand data requirements and translate them into effective Azure/on-prim -based solutions.
Data Integration
- Develop and implement robust ETL processes using Azure Data Factory / Azure Synapse pipeline - dataflows to extract, transform, and load data from diverse sources into our Azure-based data warehouse.
- Develop and maintain ETL processes using Microsoft technology SSRS, SSAS,SSIS Data warehouse and Data mart
- Ensure data integrity and quality throughout the Azure/on-prim -based ETL pipeline.
Azure Database Management
- Manage and optimize databases on Azure, ensuring high performance and availability.
- Implement best practices for Azure/on-prim database security, backup, and recovery procedures.
Data Visualization
- Create visually compelling and user-friendly reports using Power BI Desktop.
- Implement best practices for Power BI data visualization to enhance data-driven decision-making.
- Utilize Power BI services to enable collaboration, sharing, and distribution of reports within the organization.
Data Pipeline Automation
- Develop and maintain automated data pipelines on Azure for seamless data flow across systems.
- Implement monitoring and alerting systems using Azure Monitor to ensure the reliability of data pipelines.
Collaboration
- Collaborate closely with cross-functional teams, including data engineers, analysts, and software engineers, to understand Azure/on-prim-based data needs and deliver effective solutions.
- Provide mentorship and guidance to junior team members on Azure/on-prim data engineering best practices.
Documentation
- Create and maintain comprehensive documentation for Azure/on-prim -based data processes, workflows, and data models, technical part of proposals
Requirements
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer with a focus on designing and implementing data solutions on-prim and Azure platform.
- Strong proficiency in SQL and experience with Azure/on-prim -based relational databases.
- Experience with Azure data technologies, including Azure Data Factory, and Azure Synapse Analytics.
- Expertise in Power BI services, including dashboard and report development
- Proficiency in Power BI Desktop and Report Server for creating compelling data visualizations.
- Proficiency in one or more programming languages (e.g., Python, Scala) with Azure SDK integration.
- Strong understanding and hands on experience of Azure AI offering and services (e.g., Azure Open AI, Azure AI Bot Services).
- Strong understanding and hands on experience with Azure ML and Auto ML.
- Solid understanding of data modeling principles and best practices within the Azure ecosystem.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.