App Tree

Note: If current module is using FlexETL, 1.Module shall be named as 1.ETL.

Data Table & Data Flow

FlexETL Supports Six Different Types of Data Table Working as Either Source/Target Data Table

 

Excel(File,Sheet): Excel (97-2003) with file extension “xls”, Excel (2007~Current) with file extension “xlsx”

 

CSV(File): a comma-separated values file that uses a comma (or other special characters) to separate values
 
LamiBook(Book,Sheet): Is a In-memory data table object which is Excel workbook compatiable, supports a lot of Excel formulas

 

DT(TableName): for you to achieve highest performance using FlexETL native CalcFunctions rather than Excel Formulas

 

ISAM64(TableName): one of most common for data management solutions, segmentation of data by individual row

 

DB.Name: Default is FlexColumn e.g. Master(TableName), Mapping(TableName), Fact(TableName), Statistics.StatName(TableName)

FlexETL Supports Different Combinations of Data Flow – Source Data to Target Data

 

Excel(File,Sheet) to DT(TableName)
Excel(File,Sheet) to Excel(File,Sheet)
CSV(File) to ISAM64(TableName)
DT(TableName) to DB.Name.Fact(TableName)
DB.Name.Fact(TableName) to Excel(File,Sheet)
DB.Name.Statistics.AnalysisAccount(TableName) to Excel(File,Sheet)

Please also Configure Each Common Column & Data Type for Each ETL Worksheet

 

Data Type: String, Period, Date, Decimal
Common Column Name: Shall be related to the column of Data Flow – Source Data to Target Data
ETL Worksheet: Common column settings for each ETL worksheet are independent for each other. 

Explanation of Data Table & Data Flow of the above ETL Worksheet

 

Data Table: Excel(*.xlsx,Inv) & DT(Data)
Data Flow: Excel(*.xlsx,Inv) to DT(Data) – Copy data from Excel to Dependent Table (DT) with adding new column “Amount”
Common Column Name<Data Type>:Invoice<String>, Item<String>, Qty<Decimal>, Unit Price<Decimal>, Amount<Decimal>

Note1: If there are more than one Excel Workbooks, all extracted data will be merged into single table as represented by DT(Data).
Note2: An ETL command “Preload Table” dose not follow the rules of common column, it allows user to load many master files into Dependent Table directly to support other commands. 

Set Column Command

Map Column

When column names of source data are not identical with common columns of target data, Map Column allows you to configure each pair of column name mapping.

Rename Column

This command apply to FlexColumn only when you need to effect changes of column names of data table previously created in data store.

Delete Column

This command apply to FlexColumn only when you need to remove particular columns of data table previously created in data store.

Filter Command

Select (Unmatch) Data

Select Data & (Select Unmatch Data) are used to filter records from source data table by one or more filter settings, match or (unmatch) records will be copied to target data table.

Post Batch

If you have implemented posting data table to batch, this command allows you to confirm the batch becoming a posted data of target data table of FlexColumn.

Delete (Unmatch) Data

Delete Data & (Delete Unmatch Data) are used to delete records of target data table by one or more filter setting, match or (unmatch) records will be deleted to effect target data table.

Append Data

This command is used to append records from source data table to target data table which allows you to configure filters to effect selection of records at the same time.

Matching Command

Reconcile Data

This command allows you to reconcile data between two different source data tables by one or more matching columns. Reconciled results will be saved as target data table.

Split Data

This command allows you to split data between two different source data tables by one or more matching columns. Splited results will be saved as target data table.

Amend Data

This command allows you using source data table to amend target data table by one or more matching columns.

Calculation Command

Compute Column

This command supports you to effect different kinds of calculation rules with referring to column names of source data table or given values, in order to support generation of new or replace column values of target data table.

Compute Row

This command supports you to effect different kinds of calculation rules with referring to row numbers of source data table or given values, in order to support generation of new row values of target data table.

Build Statistics

This command is related to fact(TableName) of FlexColumn only. Build Statistics supports you to calculate a set of data tables by different intervals & by different statistical functions. Calculated data tables will be loaded to disk directly.

Compute Table

This command supports a collection of functions derived from Compute Column, Compute Row & Build Statistics. When using functions of build statistics, it allow to save target data table in in-memory rather than disk.

Other Command

Preload Table

This command allows you to preload one or more data tables into in-memory. It is most common use to preload some of master or mapping data table. Source data table must be DB & target data table must be DT.

e.g. DB.Ledger.Master(Company) to DT(Company)

Copy Data

This command allows you to copy source data table to target data table with referring to its common columns.

Web Framework

You Can Implement & Host any Front/Back-end Web Framework with Adopting FlexCalc as a Calc Engine

Data Scientist

Revolutionary Software with the 2020 Roadmap to Empower Business Users Performing as Data Scientist

Business Scenario

Providing Very Rich Information for Matching Your Business Requirements in Different Scenarios

Online Tutorial

Inspiring Your App Building Practices by Offering Comprehensive Guide with Many Use Cases