当前位置:网站首页>Dataarts studio data architecture -- a case of intelligent automation pipeline construction based on model driven
Dataarts studio data architecture -- a case of intelligent automation pipeline construction based on model driven
2022-07-18 03:34:00 【Hua Weiyun】
1 clock
1.1 Create a new code table
New built “ payment method ” Code table as an example . On the code table management page , Select a directory in the code table directory tree , Then click... On the right “ newly build ” Button .


stay “ Table Management ” page , Find the code table “ payment method ”, Then click... In the row of the code table “ more > Fill in the value ”. On the fill in values page , In turn, click “ newly build ” Add values . Save and publish the created code table .
2 Relationship modeling
In relational modeling , Separately build SDI Layer and the DWI Layer two relationship models , And import the original data table into SDI Layer relationship model , stay DWI Create a new one in the layer model “ Standard travel data ” Standardized business table .
2.1 Creating models
In the specification design console , Click... In the left navigation tree “ Relationship modeling ”, If you have not created a relationship model at present , The system will pop up a prompt box , single click “ confirm ” Create a relational model . newly build SDI and DWI Two models .

2.2 Import the original table
In the relationship model tree on the left , Expand the new relationship model , Select the business object “ Urban transportation > Travel records > The original record ”, single click “ Reverse database ”, Through reverse database , Import the original table . Please refer to the user guide for specific operation instructions https://support.huaweicloud.com/usermanual-dayu/dayu_01_0635.html. After the reverse database succeeds , You can view the imported table in the list .

2.3 Create a new standardized business table
single click “ newly build ” Button , Enter the new table page . In the new table “ Basic configuration ”Tab Page , The configuration is as follows :

Get into “ Table field ”Tab page , single click “ newly build ”, In the standard travel data sheet , Add fields in turn , At the same time, click... In the field “ Data standards ” Buttons in the column , It can be associated with published data standards .

Get into “ mapping ”Tab page , Create a new mapping to design the data source of the table .

After completing the configuration of the mapping , Save and publish the table model .
3 Dimensional modeling
3.1 dimension
Dimension is the perspective used to observe and analyze business data , Support data aggregation 、 Drilling 、 Slice analysis , be used for SQL Medium GROUP BY Conditions . Most dimensions have a hierarchical structure , Such as : Geographical dimension ( This includes the country 、 region 、 Provincial and city level content )、 Time dimension ( This includes annual 、 quarter 、 Contents of monthly level ). Create dimensions , That is to standardize business entities from the top level ( Or master data ) The existence and uniqueness of .
In the specification design console , Click... In the left navigation tree “ Dimensional modeling ”, Enter the dimension modeling page , Create a new code table dimension . On the new dimension page , Configure parameters as shown in the figure below , And then click “ preservation ” Finish creating dimension .

Create a new hierarchical dimension “ Date dimension ”. The basic configuration and physicochemical configuration are as follows :



Publish the above new dimension , The system will automatically create a dimension table corresponding to the dimension , The name and code of the dimension table are the same as the dimension .
3.2 Fact table
A logical table of facts belonging to a business process , It can enrich the details of transactions corresponding to specific business processes . Creating a fact logic table completes the precipitation of public transaction details , Thus, it is convenient to extract the detailed data related to transactions in the business .
In the specification design console , Click... In the left navigation tree “ Dimensional modeling ”, choice “ Fact table ” Tab . Select an object in the theme tree on the left , And then click “ newly build ” Button . stay “ New fact table ” page , Complete the following configuration :

stay “ Field configuration ” Area , single click “ newly build ” You can select one or more created dimensions , single click “ determine ” after , The primary key field of the dimension will be added to the list .

stay “ Field configuration ” Area , single click “ newly build ” Add measure .

Like relationship modeling , Data standards can also be associated , Configure data quality , Establish a mapping relationship . The method is the same as that in relation modeling .
3.3 Technical indicators
3.3.1 Atomic index
newly build 1 Atomic indicators “ Total fare ”, Used to calculate the total fare . The configuration on the new atomic indicator page is as follows , Click... When configuration is complete “ Release ”.

3.3.2 Derivatives
Calculate the total fare based on the payment method dimension . On the technical indicators page , Get into “ Derivatives ”Tab page , And then click “ newly build ” Button , On the new derivative indicator page , The configuration is as follows . When the configuration is complete , single click “ A test run ”, And click... In the pop-up window “ A test run ”, If run by clicking “ preservation ”.

3.4 The summary table
In the specification design console , Click... In the left navigation tree “ Dimensional modeling ”, Enter the dimension modeling page . single click “ The summary table ” Tab , Enter the summary page . Create a new payment method statistics summary .



Save and publish .
4 Data development
Complete the above arrangement , After the summary table is released in the specification design , It will automatically generate the whole process of data development jobs , 串起 SDI、DWI、DWR、DM The whole process . It can be viewed in the data development service 、 Implement or monitor the implementation of corresponding operations .

Refer to the user manual for relevant operations of data development https://support.huaweicloud.com/usermanual-dayu/dayu_01_0432.html.
边栏推荐
- Issue 105: a failed browser plug-in development
- Issue 106: hree Application scenarios and basic concepts of JS
- 5 款内部系统搭建低代码平台评测
- 線程-interrupt方法詳解
- [Xingguang 04] 2022 deep learning GPU form
- Go zero micro service practical series (v. how to write cache code)
- leetcode:558. 四叉树交集【四叉树dfs】
- 浅谈 Slack Channel 支持的一些提高工作效率的特性
- Detailed explanation of thread interrupt method
- 网站漏洞修复服务商讲解越权漏洞的原因
猜你喜欢
![[MySQL] multi table query](/img/9a/21b8996470203d7dfbb162ae0d9276.png)
[MySQL] multi table query

Go zero micro service practical series (v. how to write cache code)

活动预告|Apache Doris x Apache SeaTunnel 联合 Meetup 开启报名!

曾经,我对着AI客服喷了两分钟,它只回复了我的第一句话

Digital ecological map of human resources in China - flexible employment market

Use the kicad plug-in to visualize PCB welding

Teach people to fish - see a field on the sap mm material display interface, how to find which field of which database table to store

Indexedstack in shutter

Talk about seven ways to realize asynchronous programming

mysql(三)路由器、MHA高可用
随机推荐
00后博士毕业拟任南大特任副研究员,网友扒出论文后吵翻了
Euler talk | developer community experience bureau starts at about 19:30 on July 14
Efficient development of harmonyos course applications based on ETS
Chromium Threading and Task
File parsing_ Excel file parsing
【OpenCV 例程200篇】230. 特征描述之 LBP 统计直方图
Equal subtrees on binary trees
DEVKIT-mpc5744p配置rtos
聊聊异步编程的 7 种实现方式
上云精品 | 云商店助力慧科 推动校企联合,共育人才发展
WebView loading URL prompt net:: error_ UNKNOWN_ URL_ SCHEME
H5 implementation generates urlscheme and jumps from H5 to applet
Website vulnerability repair service providers explain the reasons for ultra vires vulnerabilities
Redis 过期的数据会被立马删除么?大有玄机
Use USBASP to write programs to Arduino uno through ICSP mode
Tencent celebrities share | Tencent alluxio (DOP) landing and Optimization Practice in the financial scene
Robotframework advanced (I) integrated pychart and UI automation use case writing
Clustered index and non clustered index
Issue 106: hree Application scenarios and basic concepts of JS
朱松纯团队最新研究:机器人可与人类“推心置腹”!还说下一步要造“AI大白”...