Project objectives
The main objectives of this project were :
- Propose a Target Architecture: Design a suitable architecture for migrating on-premises SQL databases to Azure.
- Estimate Finops and Costs: Evaluate the Build and Run costs associated with the migration.
- Transparent migration: Ensure a smooth transition of SQL databases and SSAS cubes to Azure.
Used Platforms & Technologies
The migration was carried out using Azure cloud services. The following technologies were crucial to the success of this project:
- Azure SQL Managed Instances : To host migrated SQL databases.
- Azure Analysis Services : For data modelling and analysis.
- Microsoft Power BI : For data visualisation.
- VPN Gateway : To secure communications between on-premises and Azure environments.
We Used also :
- Azure Data Factory (ADF) : To automate and optimise data migration processes.
- Self-hosted Integration Runtime (SHIR) : To enable data integration between on-premises and Azure environments.
- SQL Server Integration Services (SSIS) : To orchestrate migration workflows.
- Azure Data Lake Storage Gen2 : For scalable data storage.
Conclusion
This initiative, by implementing a CI/CD process with Gitlab and ArgoCD on Kubernetes, and deploying Ambari clusters to support Hadoop components, provides a complete and automated solution for the development and deployment of Big Data applications. This approach will enable our organisation to benefit from a flexible and scalable infrastructure to meet our data analysis needs effectively and efficiently.