Adapter type: toolkit_file_csv_input. The File/Hadoop CSV Input adapter reads delimiter-separated data from a file or a Hadoop Distributed File System (HDFS). Set these properties for the File/Hadoop CSV Input adapter in the ESP Studio adapter properties dialog.
If you use the CCL ATTACH ADAPTER statement to attach an adapter, you must supply the adapter type.
| Property Label | Description |
|---|---|
| Column Delimiter |
Property ID: csvDelimiter Type: string (Advanced) Specify the symbol used to separate the columns. The default value is a comma, ",". |
| Date Format |
Property ID: csvDateFormat Type: string (Advanced) Specify the format for parsing date values. The default value is yyyy-MM-dd'T'HH:mm:ss. |
| Timestamp Format |
Property ID: csvTimestampFormat Type: string (Advanced) Specify the format for parsing timestamp values. The default value is yyyy-MM-dd'T'HH:mm:ss.SSS. |
| Has Header |
Property ID: csvHasHeader Type: boolean (Advanced) Indicate whether the first line of the file contains the description of the CSV fields. The default value is false. |
| Stream name, opcode expected |
Property ID: csvExpectStreamNameOpcode Type: boolean (Optional) If set to true, the adapter interprets the first two fields of the incoming CSV line as stream name and opcode. The adapter discards messages with unmatched values. The default value is true. |
| Directory |
Property ID: dir Type: directory (Required) Specify the location of the data files. |
| File (in Directory) |
Property ID: file Type: string (Required) Specify the file to read. Wildcards are allowed. |
| Dynamic Loading Mode |
Property ID: dynamicMode Type: string (Optional) Set dynamic mode for reading files. Valid values: static, dynamicFile, dynamicPath. The default value is static. |
| Poll Period (seconds) |
Property ID: pollingPeriod Type: int (Advanced) Specify the poll period when dynamicMode is dynamicFile or dynamicPath. The default value is 0. |
| Remove Files After Processing |
Property ID: removeAfterProcess Type: boolean (Optional) Removes files after they have been processed. The default value is false. |
| Scan Depth |
Property ID: scanDepth Type: int (Advanced) Specify the depth of the schema discovery. The adapter reads the number of rows specified by this parameter value when discovering the input data schema. The default value is 5. |
|
PropertySet |
Property ID: propertyset Type: string (Advanced) Specifies the name of the property set. Property sets are reusable sets of properties that are stored in the project configuration file. Using these sets allows you to move adapter configuration properties out of the CCL file and into the CCR file. If you specify the same properties in the project configuration file and the ATTACH ADAPTER statement, the values in the property set override the values defined in the ATTACH ADAPTER statement. No default value. |