What is the architecture of Azure Data Lake?

What is the architecture of Azure Data Lake?

Azure Data Lake is designed with 2 major components, data lake store and analytics. And majorly there are below structure:

1.) Internal system - YARN & WebHDFS. Yarn - Analytics & WebHDFS - Hadoop hdfs storage.

2.) Analytics - USQL

3.) Compute Engine - HdInsight (Big Data batch processing).

3 Azure Data Lake Store (ADLS) serving as the hyper-scale storage layer.

What can I do with Azure Data Lake Analytics?

· Right now, ADLA is focused on batch processing, which is great for many Big Data workloads.

· Prepping large amounts of data for insertion into a Data Warehouse

· Processing scraped web data for science and analysis

· Churning through text, and quickly tokenizing to enable context and sentiment analysis

· Using image processing intelligence to quickly process unstructured image data

· Replacing long-running monthly batch processing with shorter running distributed processes

ADLA is well equipped to handle many of the types of processing we do in the T portion of ETL; that is, transforming data. If you've found that your data volumes have increased, changed shape, or you are generally not happy with your ETL performance, ADLA might serve as a good replacement for your traditional approach to prepping data for analysis.

Thanks for reading

Plz dont forget to like Facebook Page..
https://www.facebook.com/pages/Sql-DBAcoin/523110684456757

Comments

How to encrypt and decrypt Table data in postgres

For encrypting and decrypting , we must use the bytea data type on the column which we implement. Bcoz bytea will use the pgcrypto method by default. However, you will need to create the pgcrypto extension to enable these functions as they are not pre-defined in PostgreSQL/PPAS. Example CREATE EXTENSION pgcrypto; CREATE TABLE userinfo (username varchar(20), password bytea); >> Inserting the data in an encrypted format INSERT INTO userinfo VALUES(' suman ',encrypt('111222','password','aes')); select * from userinfo ; >> Retrieving the data as decrypted format SELECT decrypt(password,decode('password','escape'::text),'aes'::text) FROM userinfo; Thanks for reading Plz dont forget to like Facebook Page.. https://www.facebook.com/pages/Sql-DBAcoin/523110684456757

How to recover msdb database from suspect mode

It was Monday 9 th Jun 47 degr. temperature of Delhi-NCR. Temperature was like boiling me and database. When I reached my office( @ 8.45 am) got an alert from one of Server. “MSDB is in suspected mode” At the same time comes in my mind, this issue will boil me today.. I just tried to cool my self through cold drink then connected server from my local system using windows authentication mode..

History of MySQL from AB Corp to Cloud Database

MySQL was created by a Swedish company, MySQL AB, founded by David Axmark, Allan Larsson and Michael "Monty" Widenius. Original development of MySQL by Widenius and Axmark began in 1994. The first version of MySQL appeared on 23 May 1995. Its name is a combination of "My", the name of co-founder Michael Widenius's daughter,and "SQL", the abbreviation for Structured Query Language. · 23 May 1995 - First internal release · Year 1996 - Version 3 o Simple CRUD operations o January 1997 Windows version was released on 8 January 1998 for Windows 95 and NT o production release 1998, from www.mysql.com · Year 2002 - Version 4 o MyISAM o unions o Tracking o B-trees o s...

The Young DBA

Search This Blog