Microsoft Azure: Choosing Blob Storage vs Data Lake Store

-

In today’s post, I will like to talk about considerations for choosing to use Azure Blob Storage or Azure Data Lake Store when processing data to be loaded into a data warehouse. Here is a Data Warehouse Architecture published by Microsoft, where it suggests loading data from your source into Azure Blob Storage.
Pause for a second!!!

Ok, Let's continue!!!

So, here are my thoughts on why you may choose one over the other based on my experience in some projects. It really "depends".In most cases you can’t go wrong either way because they are both powerful storage systems.Let's go:

Firstly, Text files. ADLS is better with text files compared to ABS.When you talk about non-text data like media files,database backup files etc, are better off with ABS.There are trade-offs with both.

Secondly, Geographic redundancy. ABS gives you that out of the box. For ADLS,it requires setting a job to get it done periodically to replicate data geographically.

Thirdly, Security/Data access. ABS uses access key only for security. But ADLS supports Azure active directory and access key for security. Bottom line is, they are both secure, it’s just a matter of a different method of accessing it.

Fourthly, Analytics. ABS does not support Analytics. But ADLS does provide support for Analytics. Specifically Azure Data Lake Analytics.

Fifthly, Price. It varies really.ABS provides more options/flexibility for pricing related to data access. For ADLS, it might be more expensive sometimes depending on excess and volume options.

Either way, you can’t go wrong.It depends on what works best for you and your project. But i just wanted to give my thoughts on it. Again, just my thoughts. If you have any additional information based on your experience on using Azure Data Lake Store vs Azure Blob Storage, feel free to share.

If you still have questions or just want to chat about Tech stuff, contact me and i will be glad to help!.

Comments

  1. tradeimexinfoJuly 30, 2021 at 10:04 PM

    You've provided quite good information here about china export data. This is fantastic since it expands our knowledge and is also beneficial to us. Thank you for sharing this piece of writing.

    ReplyDelete
  2. Alia parkerSeptember 13, 2021 at 2:00 AM

    Fantastic write-up by the great author, it is really massive and insightful but still preaches the method to sounds like that it has some beautiful ideas explained so I really value this write-up. Bare metal data center

    ReplyDelete
  3. tradeimexinfoSeptember 21, 2021 at 6:31 PM

    Very well written article. It was an awesome article to read. Complete rich content and fully informative. I totally Loved it. Read more info about Import Data Philippines

    ReplyDelete
  4. Laura BushSeptember 27, 2021 at 6:01 AM

    Great Article about Buy Unboxed Mobiles Online. Thank you for providing such unique and valuable information to your readers. I really appreciate your work.

    ReplyDelete
  5. tradebordersNovember 22, 2021 at 12:22 PM

    You are providing good knowledge. It is really helpful and factual information for us and everyone to increase knowledge.about b2b Trade Marketplace. Continue sharing your data. Thank you.

    ReplyDelete
  6. Aaron jhonsonDecember 5, 2021 at 9:28 PM

    Excellent article... Thank you for providing such valuable information; the contents are quite intriguing.
    Data Engineering Services 
    Data Analytics Solutions
    Data Modernization Solutions
    AI & ML Service Provider

    ReplyDelete

Post a Comment

Popular posts from this blog

AWS: Benefits of using Amazon S3

-
Image
Let us start with a quick introduction. Amazon simple storage service or Amazon S3 provides developers / IT teams / Organizations / Individuals with secure, available, price friendly object storage in the cloud. Ok. Slow down. What is object storage? It is a computer data storage architecture that manages data as objects, as opposed to other storage architectures like file systems, which manage data as a file hierarchy, and block storage, which manages data as blocks within sectors and tracks. Amazon S3 is easy to use and can be used to store and retrieve any amount of data at any time. All data transfers are over automatic encryption and SSL. Data is secure, available when needed and will scale as your needs grow. Last thing you want to worry about is losing valuable data. Amazon S3 automatically replicates your objects on multiple devices across multiple facilities. In Amazon S3, you create bucke
Read more

Google To Acquire Looker For $2.6 Billion

-
Image
The deal is expected to close later this year, at which point Looker will become part of Google Cloud , helping serve Google customers a more comprehensive analytics solution. Data remains an untapped resource for many organizations and businesses. I believe the addition of Looker to Google Cloud will provide customers with a more comprehensive analytics solution,from ingesting and integrating data to gain insights, to embedded analytics and visualizations enabling enterprises to leverage the power of analytics, machine learning and AI. Whether that’s supply chain analytics in retailing; media analytics in entertainment; or healthcare analytics at global scale. The market for business intelligence software is large. Indeed in August 2018, IDC said that "Worldwide revenue for big data and business analytics (BDA) solutions was $166 billion, up 11.7% over 2017 and would reach $260 billion
Read more

Python - GUI - Tkinter(Bar & Pie Chart)

-
Image
Quickly, i just want to show you a simple example of creating bar and pie chart with Tkinter . Try this simple example: import tkinter as tk root = tk.Tk() root.title("Tkinter Bar and Pie Graph") #here is for bar chart............ tk.Label(root, text='Bar Chart').pack() data = [21, 20, 19, 16, 14, 13, 11, 9, 4, 3] c_width = 400 c_height = 350 c = tk.Canvas(root, width=c_width, height=c_height, bg= 'white') c.pack() #experiment with the variables below size to fit your needs y_stretch = 15 y_gap = 20 x_stretch = 10 x_width = 20
Read more