Introduction
Azure data lake is also a cloud based storage service that supports big data analytics. You can store any kind of structured, non structured or semi structured data into it. It provides unlimited storage for any size of data.
Microsoft Azure Data Lake Storage (ADLS) is a completely overseen, versatile, adaptable and secure file system that upholds HDFS semantics and works with the Apache Hadoop environment. It gives industry-standard dependability, venture grade security and limitless storage to store a huge amount of data.
Source system like Device, Web, LOB App, Social, Relations etc.
We have separate article on over view of azure data lake
Features of Azure Data Lake Storage
The main characteristic of big data is its variety. Azure data lake provide the storage for limitless data. Data can be of any size and comes from many different sources like database, application or web etc. It additionally permits clients to store relational and non-relational data. Furthermore, it doesn't need a pattern to be characterized before data is store into the store.
- Unstructured data: data that doesn't have a pre-characterized data model or isn't coordinated into a specific arrangement or standard, i.e., tweets, instant messages, and so forth
- Semi-organized data: data that doesn't adjust with the conventional construction of data models related with a social data set or different types of data tables (i.e., JSON, XML).
- Organized data: data that lives in a field inside a record document; the most widely recognized models are accounting pages and data contained in a social data set.
ADLS is used for big data analytics to improve performance and reduce idleness. ADLS is able to process data up to petabytes in size by partition data into multiple nodes, where mappers and reducers, in the size of thousands, measure the data in corresponding to give quick outcomes.
High Availability and Reliability
To prevent data from any hardware failure, Azure always keep three copies of each data object stored across many regions to ensure availability. “Read” transactions can be directed toward any of the three copies of the data object. Microsoft recommends as a best practice to consistently guarantee appropriate access approaches for your data just as make duplicates of basic data as a component of disaster mitigation routines.
Security
ADLS gives rich security capacities so clients can experience harmony of psyche while putting away their resources in the ADLS framework. Clients can screen execution, review use and access control through the incorporated Azure Active Directory (AAD).
Auditing
ADLS makes review logs for all activities acted in it. These logs can be broke down with U-SQL contents.
Access Control
ADLS gives access control through the help of POSIX-agreeable access control records (ACL) on documents and envelopes put away in its foundation. It additionally oversees verification through the combination of AAD dependent on OAuth tokens from upheld character suppliers. Tokens will convey the client's security group data, and this data will be gone through all the ADLS microservices.
Information Encryption
ADLS encodes information on the way and very still, furnishing worker side encryption of information with the assistance of keys incorporating client oversaw keys in the Azure Key Vault.
Information Encryption Key Types
ADLS utilizes a Master Encryption Key (MEK) put away in Azure's critical vault to encode and decode information. Clients have the alternative to deal with this key themselves yet there is consistently the danger of not having the option to decode the information if the key is lost. ADLS additionally incorporates the accompanying keys:
- Block Encryption Key (BEK) - these are keys produced for each square of data.
- Data Encryption Key (DEK) - these keys are encoded by the MEK and are liable for producing BEKs to scramble data blocks.
Azure Data Lake Storage Gen 2 Pricing
Microsoft has announced ADLS gen 2. Azure Data Lake Storage Gen2 is the world’s most productive Data Lake. The below information is based on ADLS gen 2 pricing of hierarchical structure (file structure) in central India region and Indian currency.
Data Storage Prices for LRS Redundancy
| PREMIUM |
PREMIUM
|
HOT
|
COOL
|
ARCHIVE
|
|
First 50 terabyte (TB) / month
|
₹15.12951 per GB
|
₹1.44091 per GB
|
₹1.09509 per GB
|
₹0.14410 per GB
|
|
Next 450 TB / month
|
₹15.12951 per GB
|
₹1.38327 per GB
|
₹1.09509 per GB
|
₹0.14410 per GB
|
|
Over 500 TB / month
|
₹15.12951 per GB
|
₹1.32564 per GB
|
₹1.09509 per GB
|
₹0.14410 per GB
|
Join the conversation! Your thoughts help the community grow.