In the Informatica PowerCenter, there are two ways to load a flat file into a Target definition: Direct and Indirect. You can set the Source File type to ‘Direct’ when loading a single flat file. ‘Indirect’ Source File type is when you need to load multiple flat files.
When implementing the ‘Indirect’ file type, users will use a file list. The file list is a text file that contains all the names of the flat files.
PowerCenter will read each file listed in the file list using only one Source definition.
To implement: In the PowerCenter Workflow Manager, create a workflow and select a mapping to add to the session. Right-click on the session task to Edit. Under the Mapping tab, click the Source Qualifier and set the Source File type to “Indirect” under Properties.
Below are the details after loading the target table:
Indirect file (customers_allbanks.txt)
To verify, you can load the files individually and verify the sum of the source/target rows in the single flat files matches the source/target number in the indirect file.
Single flat file (customers_southbank.dat)
Single flat file (customers_northbank.dat)
Single flat file (customers_westbank.dat)
It is important to note that all files must have the same naming convention and layout. If the file list contains the name of flat files that does not have the same naming convention, the workflow will run successfully; however, the records from the flat file(s) with the different naming convention will not load into the Target definition.
In this example, only the records from the first 2 files are loaded into the target. The rows from the last 2 files are not applied. PowerCenter looks at the first file to determine the appropriate naming convention.
Also note that you can follow the same concept in the Informatica Data Quality client. However, the layout and screenshots shown in this particular post are specifically for Information PowerCenter client.