Coder Social home page Coder Social logo

golclinics / serengetidatalab Goto Github PK

View Code? Open in Web Editor NEW

This project forked from jcardif/serengetidatalab

0.0 0.0 0.0 13.23 MB

An E2E solution of the Data Resources on Azure using the Snapshot Serengeti dataset. This E2E solution focuses Azure Synapse Analytics, Power Bi & the Azure Data Factory.

License: MIT License

Bicep 100.00%

serengetidatalab's Introduction

SerengetiDataLab

An E2E solution of the Data Resources on Azure using the Snapshot Serengeti dataset. This E2E solution focuses Azure Synapse Analytics, Power Bi & the Azure Data Factory.

๐Ÿค” Prerequisites

  1. An active Azure Subscription. if you do not have one you can create a free Azure Subscription.

  2. Appropriate permissions within the Azure subscription that will allow for creating resources, assigning roles, registering providers and deleting resources.

    To proceed you need to deploy the following azure resources:

    • Microsoft.KeyVault
    • Microsoft.Synapse
    • Microsoft.ContainerRegistry
    • Microsoft.Storage
    • Microsoft.MachineLearningServices
    • Microsoft.Insights
    • Microsoft.OperationalInsights
    • Microsoft.Sql

    โš ๏ธ In case any of these resources providers are not registered, follow the steps from the documentation to register them.

  3. Fork this repository to your GitHub account so that you can link it to the synapse workspace.

๐Ÿš€ Lab Deployment

  1. Right-click or Ctrl + click the button below to open the Azure Portal in a new tab and begin deployment.

    Deploy to Azure

  2. On the opened azure portal custom deployment page select the subscription from the drop-down, next click on the create new and provide a unique name to your resource group then select a valid location for the resources.

  3. Provide the SQL login password which should contain at least 8 characters, 1 uppercase, 1 lowercase, 1 number and 1 special character then click on the Review + create button.

  4. Once the validation is done, click on the Create button to start the deployment.

  5. The deployment should take approximately 10 minutes to complete. Once the deployment is completed, you can navigate to the resource group to check the deployed resources.

  6. If Successful you should see 10 resoiurces in your resource group.

๐Ÿงช Lab Configuration

  1. Click on the Synapse Workspace resource and then launch Synapse Studio.

  2. We'll need to link the synapse workspace to the repo you forked in the pre-requisites so that we can import the necessary notebooks and scripts. Click on Manage > Git Configuration > Configure

  3. On the wizard that opens, select the Repository type to be GitHub the GitHub repository owner as your GitHub username, then proceed to authenticate to your GitHub.

  4. After successful authentication, select the repository name from the dropdown. For the Collaboration branch create a new branch or just select the default main branch and similarly for the Publish branch

  5. The Root folder input synapse-worspace and ensure the Import existing resources checkbox is checked, then finally click Apply

  6. When this completes select your working branch then save.

โ„น๏ธ To learn more about Git & source control in a Synapse Workspace read more here

๐Ÿงน Clean Up Resources

To save up on your cloud costs,delete the resource group that was created for this lab, after completing the workshop. To do so, navigate to the resource group and click on the delete button.

serengetidatalab's People

Contributors

bethanyjep avatar jcardif avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.