We are seeking a highly skilled and experienced professional specializing in the Microsoft Power Platform and Azure services to implement a comprehensive data warehousing, live data streaming, and analytics solution for our organization. Our project aims to enhance our capability to measure and analyze the performance of service providers during the Hajj season, providing live updates and insights to various stakeholders, including government agencies.
# Project Objectives:
1. Data Warehousing Implementation: Utilize Azure SQL Database or Azure Synapse Analytics to establish a robust data warehouse that can handle large volumes of data efficiently, integrating with our existing Microsoft Power Platform setup.
2. API Endpoints: Develop secure API endpoints for real-time data access, ensuring they can be consumed both internally and by external stakeholders. The ability to stream data live, potentially through RSS feeds or a similar approach, is highly desirable.
3. Power BI Dashboard Development: We have an existing Power BI dashboard that needs to be copied and modified to read from the new data warehouse, with enhancements to support live data streaming and real-time updates.
4. Automated Data Cleansing: Implement automated business rules for data cleansing to ensure the integrity and accuracy of data before it is displayed on the dashboard or made available through API endpoints. This process should handle common data quality issues such as duplicates, missing values, and incorrect data formats.
# Key Responsibilities:
- Design and implement a scalable data warehouse using Azure SQL Database or Azure Synapse Analytics, considering our current data collection methodologies and future growth.
- Enable API endpoints for secure, real-time data access by internal and external systems, with a strong emphasis on reliability and scalability.
- Modify existing Power BI dashboards to connect to the new data warehouse, ensuring the capability for live data updates and streaming.
- Work closely with our team to understand specific requirements and provide technical guidance on best practices for data management, security, and compliance.
- Document the architecture and setup thoroughly, ensuring our team can manage and scale the solution in the future.
- Develop and integrate automated data cleansing processes within the data warehousing solution, using Azure services or Power Automate to apply business rules that clean data as it is received.
- Work closely with our team to define and implement business rules for data quality, including validation, normalization, de-duplication, and error correction.
- Ensure that the data cleansing process does not significantly impact the real-time data streaming capabilities, optimizing for both data quality and accessibility.
- Provide guidance on monitoring and maintaining data quality over time, including recommendations for adjusting business rules as the project evolves.
Requirements:
- Proven experience with Microsoft Power Platform (Power Apps, Power Automate, Azure Functions and Power BI) and Azure services (Azure SQL Database, Azure Synapse Analytics, Azure API Management).
- Strong background in data warehousing, database design, and data integration projects.
- Expertise in developing and securing API endpoints for real-time data sharing.
- Experience with modifying and enhancing Power BI dashboards for live data streaming and real-time updates.
- Excellent communication skills, with the ability to collaborate remotely and provide clear documentation.
- Familiarity with implementing live data streaming solutions, such as RSS feeds or similar technologies, is a plus.
### Important Note on Project Implementation:
All implementation work for this project must exclusively utilize Microsoft tools and services. The chosen candidate will be expected to deliver solutions within the framework of Microsoft's ecosystem, without the need for deploying custom servers or tools outside of this environment. Our goal is to leverage our existing Microsoft infrastructure to its fullest extent, ensuring a seamless integration and utilization of Microsoft's Power Platform and Azure services.
# Engagement Details:
- This project is expected to start immediately, with an estimated duration of 3-4 days.
- We prefer a fixed-price contract but are open to hourly arrangements for the right candidate.
- Please provide examples of similar projects you've completed, especially those involving the Microsoft Power Platform, Azure, and Power BI.
# How to Apply:
- Submit a proposal outlining your experience with the technologies mentioned, including specific examples of data warehousing, API integration, and Power BI projects.
- Include your availability and preferred engagement terms (fixed-price or hourly).
- Attach or link to your portfolio or case studies demonstrating relevant work.
Budget: $750
Posted On: March 30, 2024 21:39 UTC Category: Data Analytics Skills:Microsoft Power BI, Data Analysis, Data Visualization, Business Intelligence, Microsoft Azure, API, Microsoft PowerApps, Microsoft Power Automate
Skills: Microsoft Power BI, Data Analysis, Data Visualization, Business Intelligence, Microsoft Azure, API, Microsoft PowerApps, Microsoft Power Automate Country: Saudi Arabia
click to apply
Project ID:
3378435
Project category:
Microsoft Power BI, Data Analysis, Data Visualization, Business Intelligence, Microsoft Azure, API, Microsoft PowerApps, Microsoft Power Automate