Sunday, October 13, 2019

Demo on creating Azure Storage Account and configuring network connections.

Hello Readers!

The below is the second blog I am writing on Azure Storage Accounts. In this blog, I will be documenting the steps that you need to follow to create a storage account .Because of blog size , I will document the steps  to access the storage account from your on-premise machines later. 

Pre-requisites: You have read and understood the basics covered in my previous post on Storage account basics. Access it here

Lets get to it.

Creating an Azure Storage Account

Login to Azure portal with your azure account and search for Storage Accounts.

Click on add


It will open the form for creating your storage account like the one below.
You can select your subscription and resource group . There is also an option to create resource group to add your storage account under it.

Choose a name(All characters in smallcaps), and azure Region according  to your will. I am keeping standard with the assumption that you will be using this only for beginner/POC experience and not for Production.

Premium account sits on SSD (Solid State Drive) and Standard one is created on a Hard Disk Drive (HDD).And as you might know SSD gives us better performance than what HDD offers.

In account Kind , you would get to choose three options. Choose according to the description below.

General Purpose V2: This supports every Replication settings 
General Purpose V1: Supports only LRS, GRS and RA-GRS
Blob Storage: When your purpose is only using Blob storage service and not other storage services.

Hot is to be chosen as the access tier if the files are going to be accessed frequently.  



Once you decide on your choices and fill in the details, please click on next and proceed.

The below is what you get get.You need to decide whether we can go public access(Access over internet/all network ) or public access with your storage account added to your VNet/Subnet to limit  access from all other networks.(Unless added explicitly under Firewalls and Virtual Network settings in your storage account).



Even if you are a beginner , I would recommend you to associate your storage account with a Vnet/Subnet and later you can whitelist a public IP of your/Team/Company network to enable access from your office desktops. (Wait for my Next blog for information on it).

Though it is fine to use the pure public( all networks option like below), if you are exploring with your free azure subscription with no company data at all. In this way, you would only need an access key/Shared access keys for authentication.



For this POC ,  we are going with the connection method as Public endpoint (Selected networks), which would let us choose a VNet and Subnet  to associate our Storage account and limit the accessibility unless we enable it for a particular IP range, other VNets etc.

Storage accounts doesn't support Private endpoints in the create windows.We can workaround it using azure firewall service later. I will write on that later. 




The first option above (Secure Transfer required) would demand secure connections (HTTPs/Encryption for Fileshare ) for connections.
The second one is for enabling Blob Soft delete which would enable us to recover the data that is overwritten in the blobs.You will have to mention a retention period for the data. It can be any number of days between 1 and 365 .

We cant turn on the third option unless the 2nd is turned off. Data lake is an azure solution for big data analytics. 
Clicking on Next with your preferences will launch the page for giving tags. 
You could give a variety of Tags to your azure resources like Name, billing Approver, Created by etc for it to be identified among a large pool of resources created across Resource groups and VNets.




Clicking on Next is for validating and displaying the options we have chosen in the windows so far.



Mine would look like something like  the above. 

Once you verify the settings , please click on create. It would take around 10 mins for the storage account to be created.

Whitelisting your Public IP

    You can get the public IP from google for any sort of network connections. Try searching for "My public IP " when connected from your home internet, Office VPN, office LAN connections etc.You are supposed to get different IPs for each of your Network connections.

Imagine you want to enable access to your storage account for your colleagues/Team mates when they are connected via Office VPN, all you got to do is whitelist your VPN network's public IP. (Find from google whats your public IP when you are connected to office VPN)


Go to your storage account and click on Firewalls and Virtual Networks on the left Pane.
Enter the public IP in the textbox and save it. You can also add more Virtual networks to enable access in the same window.




And that brings us to the end of this blog. I hope you learned good today about Storage account creation and configuration. I will write soon on , connecting to it and uploading files in my next blog.

Keep learning and write your comments below.







Saturday, October 12, 2019

Azure Storage Account basics

Hi Readers !

The below is the first part of my blogs on covering the basic concepts about Azure Storage account . The second part would have steps to add storage accounts with explanations for the options to choose, and to access it with a client software named Azure Storage explorer.

What are Azure Storage accounts?

It is just the name Microsoft has given for its solution for data storage in Azure. We can create one or many storage accounts in our Azure subscriptions as per our needs. The "needs" could be the sensitivity of the data or a requirement from your client that their data in the cloud shouldn't be of multi Tenant model. Each subscription can have upto 200 Storage accounts with each having storage size upto 550 TB .
Microsoft supports authentication to azure storage accounts through Access keys, Shared Access Signature keys(SAS) and with Azure AD. (I will cover in the demos later ).
We can also set different replication settings to a storage accounts that will define how the replicas of your actual data are going to be kept. 

Durability Options of Storage replication:

Locally Redundant Storage (LRS): Data being synchronously replicated three times within the same azure data center. It covers only storage node failures and this is the cheapest replication because of low level redundancy.

Zone Redundant Storage (ZRS) : Here the data kept in the azure storage  is being synchronously replicated among the availability  zones within an azure region .Azure availability Zones are basically different physical locations within an azure Region like "East US". MS maintains 3 zones in a region to the minimum.

Geo Redundant Storage (GRS): The data in your storage account is replicated synchronously with LRS first and then asynchronously replicated to another region and be made locally redundant within that Region too. The benefit is obvious. If the whole region goes down, you could access your data kept in your secondary region.

Read Access GRS or RA-GRS: GRS with the option of having to use the secondary copy in read only mode. The regular GRS give access to your data in the secondary region, only when your primary region goes down. The azure storage used for automated DB backup runs with RA-GRS replication. 

Geo Zone Redundant Storage: This is a new durability/Replication option that replaces LRS with ZRS  in the Geo Redundant Storage. Explaining further, it replicates data synchronously first to the availability Zones and then asynchronously replicate it to a different region . It is only in public preview and is currently not being made available to all Azure regions. 

Services offered under Azure Storage accounts

1.Azure Blobs

This is the service which can be used to store unstructured data (data that is not confined to a particular data type/defenition). We can create blob containers and sub folders under a storage account to keep various types of data like SQL backups, images, Videos, excel sheets or basically any format of data. Under Azure Blobs , we can create three types of blobs to keep our data .
a.Page blobs: It consists of pages of 512 bytes and are suitable for faster read/write access. 
b.Append Blobs: Data can be appended or added to the end of previously added data without replacing it.
c.Block Blobs :It consists of blocks and are suitable for data streaming.

2.Azure Files 

Think of it as network file share locations that can be accessed via URLs from anywhere . This come of use in place of wherever we use SMB (Server Message blocks) share in On-premise (Like Replication snapshot folder).

3.Azure Queues Storage: 

Azure queue storage are used for the purpose of asynchronous message queueing for communication between application components. 

4. Azure Table Storage: 

This is the storage service for NoSQL fans. You could store your structured NoSQL data in the cloud with Azure Table storage.

You could see all these options when you open the overview page in your storage account.There are a few more  definitions related to azure storage and unrelated to Azure storage account and hence I would cover it when I talk about other subjects like VMs and Azure SQL storage (Behind the scene).

Thanks for Visiting. Please follow me in blogger for more content related to SQL servers and Azure. Hope the explanations are simple enough to be followed just like how I intended.