Patent
Method and apparatus for realizing data extraction transformation and loading (ETL)
Tang Weiqun
- 05 Jun 2018
TL;DR: In this article, a method for re-executing data extraction transformation and loading (ETL) operation is presented, which comprises the steps of obtaining a specified identifier of a user configuration file, and according to the specified identifier, determining a specified user config file; reexecuting the ETL operation by utilizing the specified-user configuration file to generate a second data file; combining the second file with a first data file, where the first file is generated after the operation is executed by utilizing all user configuration files; and deleting the original first file in a storage path of the
read more
Abstract: The invention discloses a method for realizing data extraction transformation and loading (ETL). The method is used for re-executing data ETL operation. The method comprises the steps of obtaining a specified identifier of a user configuration file, and according to the specified identifier, determining a specified user configuration file; re-executing the ETL operation by utilizing the specifieduser configuration file to generate a second data file; combining the second data file with a first data file to generate a third data file, wherein the first data file is generated after the ETL operation is executed by utilizing all user configuration files; and deleting the original first data file in a storage path of the first data file, and storing the third data file as an updated first data file. The invention furthermore discloses an ETL realization apparatus.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
References
Patent
Methods, systems, and computer program products for managing batch operations in an enterprise data integration platform environment
Kyle Linder
- 12 Dec 2008
TL;DR: In this article, a method for defining a window of time in which a batch will run by entering a batch identifier into a batch table, the batch identifier specifying a primary key of the batch table and is configured as a foreign key to a batch schedule table.
13
Patent
Data paralleling abstracting method and apparatus and database system
Chunyi Lu,Lifu Tan +1 more
- 24 Dec 2008
TL;DR: In this article, a data parallel extraction method, a device and a database system which are applied to improving the extraction performance of the existing parallel extraction technique is described, where data in a database table to be extracted are extracted from one of the storage subareas.
10
Patent
Merger and acquisition data validation
Alastair Parkes,Mari Hasegawa,Ravi Manjunatha +2 more
- 08 Oct 2008
TL;DR: In this paper, a real-time data validation system is presented that performs data validation in real time by uploading the source data from spreadsheets or entering the data directly into an application.
9
Patent
Database management method, device and electronic equipment
Kuang Zehui
- 02 Dec 2015
TL;DR: In this article, a database management method, device and electronic equipment is described, which is suitable for carrying out database management on the basis of the object type file storage system, and it includes the steps that user data processing operation which is input by a user and carried out on a first database file is received, and the first database files are located in an OTFS system; a first Hash value corresponding to the first DB file is obtained; first identification of the firstDB file is determined, and is the newest identification corresponding to DB file; Hash calculation is carried on the
3
Related Papers (5)
Luo Haiwei,Chen Shouyuan +1 more
- 01 Mar 2017
Luo Haiwei,Chen Shouyuan +1 more
- 23 Feb 2017
Luo Haoran,Cao Zhihao +1 more
- 21 May 2019
Li Ning
- 16 Sep 2015
Wu Lidan,Miao Chunbao +1 more
- 16 Jun 2020