Lists and briefly describes some of the crucial properties in the .properties file. See the example.properties file for a complete, up-to-date list of configurable properties for the adapter.
The example .properties file contains commented-out examples of the column lists for the common log format and the combined log format. (See the "Parse.Class" section of the file.) To use the Extended Common log format, add column names and datatypes to the Parse.Format.Common.Columns property. Since the log file reader is extensible and modifiable, you can define your own formats, and modify the existing formats to match your configurations. For example, if your Apache server has changed the format it writes for common log format or combined log format, you can modify the properties file to match. You can either modify existing entries or create new entries. For example, you can create a new format named "MyUncommonFormat" and define the columns for that format.
Property Name | Type | Description |
---|---|---|
Input.Filename | string | Lists the name of the log file to read from. |
Input.WaitForGrowth | string | If set to false, the adapter reads until it reaches the end
of the file and then exits. If set to true, the adapter continues
reading from the log file indefinitely at intervals of 100
milliseconds (the default interval). A value in the format milliseconds or milliseconds, nanoseconds tells the server to continue reading from the log file indefinitely at the specified interval, for example, 10 tells the adapter to read every 10 milliseconds and 0,500000 tells the adapter to check every 500000 nanoseconds, or 2000 times per second. The actual interval between reads is approximately the interval you specify; the exact interval depends upon your system's hardware and operating system and load. |
Parse.Class | string | Specifies the JavaBean used to parse columns in the log file. |
Parse.FormatName | string | Specifies the name of the format of the data in the log file. This may be the name of one of the predefined formats, such as common or combined, or it may be the name of a custom format. |
Parse.{FormatName}.Columns (where {FormatName} is replaced with the name provided by Parse.FormatName) | string | Contains the names and datatypes of the column names in the log file. You may need to customize this property. |
Parse.{FormatName}.DateColumn (where {FormatName} is replaced with the name provided by Parse.FormatName) | string | Contains the name of the date column in the log file. This value must match the actual name of your date column. |
Parse.{FormatName}.TimeColumn (where {FormatName} is replaced with the name provided by Parse.FormatName) | string | (Optional) Contains the name of the time column in the log file. This column is needed only if the date column does not include the time. |
Output.Uri | string | URI of the stream to send the rows to. |
Output.Columns | string | The string should contain a list of column names separated by spaces. This allows you to match the output to the schema of the stream that you are writing to. |
Admin.Input | string | If Admin.Input is set to stdin, then the log file adapter reads stdin looking for administrative commands. The only administrative command it currently supports is exit, which can be requested by any of the input lines: exit, quit, x, or q. The primary intent of this is as a debugging aid. The default is for no administrative request bean. |
Output.AuthType | string | (Optional) Specifies authentication type. Valid values are: UserPassword, Kerberos, or ServerRSA. Default value is UserPassword. |
Output.username | string | (Required) For UserPassword, this specifies the username for the server. For ServerRSA authentication method, this specifies the keystore alias. |
Output.password | string | (Dependent required) Required by UserPassword authentication method. Specifies password for the Server. |
Output.passwordEncrypted | string | (Dependent required) Specifies whether password in Output.password property is encrypted. Valid values are true or false. Default value is false. |
Output.RSAKeyStore | string | (Dependent required) Specifies location of keystore file. Required by ServerRSA authentication method or UserPassword (if password is encrypted). |
Output.RSAKeyStoreAlias | string | (Dependent required) Specifies the keystore alias. Required by UserPassword authentication method if password is encrypted. |
Output.RSAKeyStorePassword | string | (Dependent required) Specifies password for the RSA keystore. Required by ServerRSA authentication method or UserPassword (if password is encrypted). |
Output.KerberosKDC | string | (Dependent required) Specifies host name for the Kerberos key distribution center. Required by Kerberos authentication method. |
Output.KerberosRealm | string | (Dependent required) Specifies the Kerberos realm setting. Required by Kerberos authentication method. |
Output.KerberosService | string | (Dependent required) Specifies the Kerberos principal name that identifies an Event Stream Processor cluster. Required by Kerberos authentication method. |
Output.KerberosTicketCache | string | (Dependent required) Specifies the location of the Kerberos ticket cache file. Required by Kerberos authentication method. |
Parse.BigDatetime.Format | string | Specifies format of bigdatetime column. Uses java.text.SimpleDateFormat, which does not support microseconds. To display microseconds, ensure the string UUUUUU is present. If month comes after microseconds, and the number of characters in the month are variable, the data is parsed incorrectly. For example, if the full month name is used, September has more characters than July, and July has more than May. |