esp_convert

Converts XML and delimited records into 32-bit binary records compatible with Event Stream Processor. The metadata describing the streams is obtained either from a connection to a running instance of the Event Stream Processor (via the Command and Control interface) or via an Event Stream Processor compatible configuration file.

Syntax

esp_convert -f configFile -p [host:]port -c user[:password] [OPTION...]

Required Arguments

-c user[:password] – (required) authenticates with a user ID and, optionally, a password. If you do not provide either the password or the -k or -G option, you are prompted for the password. If the Event Stream Processor successfully authenticates with these credentials, the connection is maintained, otherwise the Event Stream Processor immediately closes the connection.
-f configFile – (dependent required) specifies the XML style configuration file that describes the data to be converted to Event Stream Processor format.
-p [<host>:]<port>/workspace-name/project-name – (required) together, the host:<port>/<workspace name>/ <project name> arguments specify the URI to connect to the ESP Server (cluster manager). For example, if you have started your ESP cluster server in the port 19011, the host name is set as localhost, and you are running a project called prj1 in the default workspace, specify -p as: -p localhost:19011/default/prj1

Options

-b – (optional) indicates that the machine architecture on which the server (that is consuming data) is running has the reverse byte order of the machine architecture on which esp_convert is running.
-d separator – (optional) reads and converts delimited records from standard input instead of the default XML format.
-e – (optional) encrypts traffic with the Event Stream Processor via openSSL sockets.
Note: Ensure that the Event Stream Processor is started in encrypted mode to use this option.
-f configfile – (dependent required) specifies the CCX configuration file that describes the location of data that is read via standard input.
-F path – (optional) specifies the full pathname of the XML Schema file (default is $ESP_HOME/etc/Platform.xsd).
-G – (optional) authenticates access to the Event Stream Processor with credentials held within a Kerberos authentication ticket. Environment variables determine where the system will look to find authentication tickets (See Administrators Guide > Security in the Event Stream Processor > Authentication > Setting Environment Variables for Kerberos for more information). If the user name differs from the default principal name in the ticket cache, specify an alternate user name with the –c option to use the corresponding authentication ticket.
-h – (optional) prints a list of possible options on the screen along with a brief explanation for each option.
-k privateRsaKeyFile – (optional) performs authentication using the RSA private key file mechanism instead of password authentication. The privateRsaKeyFile must specify the pathname of the private RSA key file.
Note: Ensure that the ESP Server has been started with the -k option specifying the directory in which to store the RSA keys.
-m datetimemask – (optional) specifies the format string for date values (in strptime format). Default value is "%Y-%m-%dT%H:%M:%S".
-v – (optional) prints the esp_convert utility version.

Examples

Converting Records to Binary Format – Convert records from XML or a comma separated value (CSV) file.
To convert all XML records in file foo.xml to native binary format, and post them to a running instance of the Event Stream Processor, use:
```
cat foo.xml | esp_convert -p localhost:19011/default/prj1 | esp_upload -p localhost:19011/default/prj1
    
```
To convert all comma-separated records in file foo.csv to native binary format, and post them to a running instance of the Event Stream Processor, use:
```
cat foo.csv | esp_convert -d "," -p localhost:19011/default/prj1 | esp_upload -p localhost:19011/default/prj1
    
```
To convert all XML records in file foo.xml to native binary format, and post them to a running instance of the Event Stream Processor on a target machine HOST that has a differing byte order than the machine on which esp_upload is running, use:
```
cat foo.xml | esp_convert -b -p localhost:19011/default/prj1 | esp_upload -b -p localhost:19011/default/prj1
    
```
To convert all XML records in file foo.xml to native binary format and post them to standard output without a running instance of ESP, use the -f option and provide the CCX configuration file used to start the server.
```
cat foo.xml | $ESP_HOME/bin/esp_convert -f test.ccx
    
```