File/Hadoop JSON Output Adapter Configuration

Type: string

(Optional) Specify a full path to the log4j.properties logging file you wish to use. The default value is $ESP_HOME/adapters/framework/config/log4j.properties.

(Required) Element containing all information for this module. It contains a type attribute for specifying the module type.

For example, espconnector.

Type: string

(Required) Instance name of the specific module you want to use. For example, MyInputTransporter.

Type: string

(Required) Name of the module as defined in the modulesdefine.xml file. For example, <TransporterType>InputTransporter.

Type: string

(Required) Instance name of the module that follows this one.

Type: integer

(Advanced) Capacity of the buffer queue between this module and the next. The default value is 10240.

(Required) Element containing elements for the ESP subscriber.

Type: string

(Required if running adapter in standalone mode; optional if running in managed mode) Specifies the unique project tag of the ESP project to which the adapter is connected. For example, EspProject2.

This is the same project tag that you specify later in the adapter configuration file in the Name element within the Event Stream Processor (EspProjects) element.

If you are starting the adapter with the ESP project to which it is attached (running the adapter in managed mode), you do not need to set this element as the adapter automatically detects the project name.

Type: string

(Required if running adapter in standalone mode; optional if running in managed mode) Name of the ESP stream from which the adapter subscribes to data.

If you are starting the adapter with the ESP project to which it is attached (running the adapter in managed mode), you do not need to set this element as the adapter automatically detects the stream name.

(Required) Element containing all information for this module. It contains a type attribute for specifying the module type.

For example, formatter.

Type: string

(Required) Instance name of the specific module you want to use. For example, MyInputTransporter.

Type: string

(Required) Name of the module as defined in the modulesdefine.xml file. For example, <TransporterType>InputTransporter.

Type: string

(Required) Instance name of the module that follows this one.

Type: integer

(Advanced) Capacity of the buffer queue between this module and the next. The default value is 10240.

(Required) Element containing the EsptoJsonStreamFormatterParameters element.

(Required) Element containing the ESP to JSON Stream formatter elements.

(Required) Element containing the Column element.

Type: complextype

(Required) Specify JSONPath expressions for the JSON data that you want to map to columns of an ESP stream. You can have multiple Column elements.

{
"firstName": "John",       
"lastName": "Smith", 
"phoneNumbers": [
        {
            "type": "home",
            "number": "212 555-1234"
        },
        {
            "type": "fax",
            "number": "646 555-4567"
        }
],
"friends": [
["female1","female2","female3"],
["male1","male2","male3"]
]
}

The first <Column/> element and its value are mapped to the first column of an ESP stream, the second <Column/> element and its value are mapped to the second column of an ESP stream, and so on.

Type: string

(Advanced) The format string for date values. For example, yyyy-MM-dd'T'HH:mm:ss.

Type: string

(Advanced) Format string for timestamp values. For example, yyyy-MM-dd'T'HH:mm:ss.SSS.

(Required) Element containing all information for this module. It contains a type attribute for specifying the module type.

For example, transporter.

Type: string

(Required) Instance name of the specific module you want to use. For example, MyInputTransporter.

Type: string

(Required) Name of the module as defined in the modulesdefine.xml file. For example, <TransporterType>InputTransporter.

Type: integer

(Advanced) Capacity of the buffer queue between this module and the next. The default value is 10240.

(Required) Element containing the FileOutputTransporterParameters element.

(Required) Element containing the elements for the File Output transporter.

Type: string

(Required) Specify the absolute path to the data files that you want the adapter to write to. For example, <username>/<foldername>. The default value is ".", meaning the current directory in which the adapter is running.

To use Hadoop system files, use an HDFS folder instead of a local file system folder. For example, hdfs://<hdfsserver>:9000/<foldername>/<subfoldername>/<leaffoldername>.

To use Hadoop, download the binaries for Hadoop version 1.2.1 from http://hadoop.apache.org. Copy the hadoop-core .jar file (for example, for version 1.2.1 hadoop-core-1.2.1.jar) to %ESP_HOME%\ adapters\framework\libj. Ensure you use a stable version rather than a beta.

Use a forward slash for both UNIX and Windows paths.

Type: string

(Required) Specify the file to which the adapter writes.

Type: string

Type: boolean

(Optional) If set to true, the adapter appends the data into the existing file. If set to false, the adapter overwrites existing content in the file. Default value is false.