How To Create A Data Lake Architecture

wujun1225 2019-01-31

展开全文

What is a Data Lake?

A data lake is a method of storing data within a system or repository, in its natural format, that facilitates the collocation of data in various schemata and structural forms, usually object blobs or files.

A Tutorial on Data Lake Architecture

Here on Dragon1 you can, with one click of a button, create a data lake architecture visualization. Next, adjust the template to your situation. Or you can start from scratch and make use of the data lake building blocks / symbols to create your unique data lake architecture within a few moments.

Evaluate Dragon1 PRO now

We have provided the Zaloni Data Lake Reference Architecture as a template for you on Dragon1.

This picture shows a Data Lake Architecture.

An overview like this is necessary in any organization.

You will create this architecture by using one web application on Dragon1: The Visual Designer.

You will take the following steps

Create a dossier structure
Enter Data
Create process and application models, using the data
Create links between the process and application models
Create process and application views, using the models
Create links between views
Create a visualization, using the views
Publish the visualization to the Content Viewer to have it commented by stakeholders

Introducing Dragon1

Dragon1 is a SaaS platform for co-creating and managing enterprise architecture.

It is a suite of web applications that can be used for creating interactive content and products like: Enterprise Architecture, Business Models, Processes, Landscapes, Blueprints and Roadmaps. In this tutorial you will be using four web applications: Architecture Repository, Visual Designer, Content Viewer and Resource Center.

You can access each of these web applications by clicking on the corresponding label on the buttonbar above.

Architecture Repository

Create folder structures and enter data manually, enrich data or import data from files. Choose from 400+ entity classes.

Visual Designer

Create meta models, models, views and visualizations. Use templates and shape libraries. Create and reuse patterns.

Content Viewer

Watch the content created by you or others. Place comments onto the visualizations. Search, compare, trace and filter visualizations.

Resource Center

Create your own resource center or intranet. Publish your input documents, strategy, architecture and transformation.

Step 1. - Create a Dossier Structure

First we are going to create a dossier structure in a cabinet to store our data in.

To create a dossier structure

Go to the Visual Designer
Create or open a Cabinet
Select the cabinet in the Explorer treeview
Create a dossier
Create four folders in the dossier: Data, Model, View and Visualization

Step 2. - Enter Data

On Dragon1 you can enter data by dragging shapes to a folder.

To enter data

Go to the Visual Designer
Create or open a Cabinet
Select a folder
Insert shapes from the Draw Archifact or Draw Entity dropdown menu
- For the process-application landscape choose the shapes for three layers:
- Business Layer: Group, Function, Process, Activity
- Information Layer: Information Object
- Application Layer: Application, Database, Interface, Service
Select a shape in the treeview
Select the shapes' icon on the canvas
Change the name of the shape at the right top in the text attributes of the Inspector

Step 3. - Create a Model, using the data

To create a model

Go to the Visual Designer
Create or open a Cabinet
Select a folder
Insert models from the menu bar
- Create models for the process-application landscape for every entity class you have used
- Process model, Service model, Application model, etc...
Enter a name for the model
Optionally choose a type for the model
Insert shapes like processes and applications for the model by clicking on Draw Archifact or Draw entity and drag shape onto the canvas
You can change the color and size of the shapes
Draw connections between the shapes using the smart tools of a selected shape.

Step 4. - Create links between models

To create a link between models:

Select a model in the Explorer treeview
Select a shape in the model
Enter a link to another model in the LinkURL field of the text attributes

Step 5. - Create a View, using the model

To create a view

Go to the Visual Designer
Create or open a Cabinet
Select a folder
Insert views from the menubar
- Create views for the process-application landscape for each model you created:
- Functions view, Process view and Activities view, etc..
Enter a name
Select the model to use
Enter a viewing rule for the model data:
- Rule Event: onload
- Rule Condition: Class=Process;Name=Sales;Relation=FirstLevel
- Rule Action: Show(name)

Step 6. - Create links between views

To create a link between views:

Select a view in the Explorer treeview
Select a shape in the view
Enter a link to another view in the LinkURL field of the text attributes

Step 7. - Create a Visualization, using the views

To create a visualization

Go to the Visual Designer
Create or open a Cabinet
Select a folder
Insert a visualization from the menubar
Drag a shape on the canvas. You will use this shape to generate the view data with on the canvas.
- For the process-application landscape use three shapes:
- One for Functions, Processes and Activities.
Save the visualization
Select one of the three view shapes
Enter the following view rules in the data attributes panel of the inspector.
- Rule Event: onload
- Rule Condition: Class=Process
- Rule Action: Show(name)

Do this for all three view shapes

With this rule you will only see the processes from the view data. You can also show the whole view with Rule Condition = *.