Provides logging to logstash using the Graylog Extended Logging Format (GELF). This implementation comes with support for three areas:
See also http://logging.paluch.biz/ for further documentation.
This project is built against following dependencies/versions:
- log4j 1.2.14
- log4j2 2.0-rc1
- Java Util Logging JDK Version 1.6
- logback 1.0.13
- slf4j-api 1.7.5
Following settings can be used:
host
(since version 1.2.0, Mandatory): Hostname/IP-Address of the Logstash Host- tcp:(the host) for TCP, e.g. tcp:127.0.0.1 or tcp:some.host.com
- udp:(the host) for UDP, e.g. udp:127.0.0.1 or udp:some.host.com
- (the host) for UDP, e.g. 127.0.0.1 or some.host.com
port
(since version 1.2.0, Optional): Port, default 12201graylogHost
(until version 1.1.0, Mandatory): Hostname/IP-Address of the Logstash HostgraylogPort
(until version 1.1.0, Optional): Port, default 12201originHost
(Optional): Originating Hostname, default FQDN HostnameextractStackTrace
(Optional): Post Stack-Trace to StackTrace field, default falsefilterStackTrace
(Optional): Perform Stack-Trace filtering (true/false), default falsefacility
(Optional): Name of the Facility, default logstash-gelfthreshold
/level
(Optional): Log-Level, default INFO
filter
(Optional): Class-Name of a Log-Filter, default nonemdcProfiling
(Optional): Perform Profiling (Call-Duration) based on MDC Data. See MDC Profiling, default falseadditionalFields
(Optional): Post additional fields. Example: .GelfLogHandler.additionalFields=fieldName=ValuemdcFields
(Optional): Post additional fields, pull Values from MDC. Name of the Fields are comma-separated mdcFields=Application,Version,SomeOtherFieldNamedynamicMdcFields
(Optional): Dynamic MDC Fields allows you to extract MDC values based on one or more regular expressions. Multiple regex are comma-separated. The name of the MDC entry is used as GELF field name.
MDC Profiling allows to calculate the runtime from request start up to the time until the log message was generated. Only available in log4j environments. You must set one value in the MDC:
profiling.requestStart.millis: Time Millis of the Request-Start (Long or String) Two values are set by the Log Appender:
profiling.requestEnd: End-Time of the Request-End in Date.toString-representation profiling.requestDuration: Duration of the request (e.g. 205ms, 16sec)
Maven:
<dependency>
<groupId>biz.paluch.logging</groupId>
<artifactId>logstash-gelf</artifactId>
<version>1.3.1</version>
</dependency>
JBoss Module Download:
<dependency>
<groupId>biz.paluch.logging</groupId>
<artifactId>logstash-gelf</artifactId>
<version>1.3.1</version>
<classifier>logging-module</classifier>
</dependency>
Properties:
handlers = biz.paluch.logging.gelf.jul.GelfLogHandler, java.util.logging.ConsoleHandler
.handlers = biz.paluch.logging.gelf.jul.GelfLogHandler, java.util.logging.ConsoleHandler
.level = INFO
biz.paluch.logging.gelf.jul.GelfLogHandler.host=udp:localhost
biz.paluch.logging.gelf.jul.GelfLogHandler.port=12201
biz.paluch.logging.gelf.jul.GelfLogHandler.facility=java-test
biz.paluch.logging.gelf.jul.GelfLogHandler.extractStackTrace=true
biz.paluch.logging.gelf.jul.GelfLogHandler.filterStackTrace=true
biz.paluch.logging.gelf.jul.GelfLogHandler.timestampPattern=yyyy-MM-dd HH:mm:ss,SSSS
biz.paluch.logging.gelf.jul.GelfLogHandler.maximumMessageSize=8192
biz.paluch.logging.gelf.jul.GelfLogHandler.additionalFields=fieldName1=fieldValue1,fieldName2=fieldValue2
biz.paluch.logging.gelf.jul.GelfLogHandler.level=INFO
log4j.appender.gelf=biz.paluch.logging.gelf.log4j.GelfLogAppender
log4j.appender.gelf.Threshold=INFO
log4j.appender.gelf.Host=udp:localhost
log4j.appender.gelf.Port=12201
log4j.appender.gelf.Facility=java-test
log4j.appender.gelf.ExtractStackTrace=true
log4j.appender.gelf.FilterStackTrace=true
log4j.appender.gelf.MdcProfiling=true
log4j.appender.gelf.TimestampPattern=yyyy-MM-dd HH:mm:ss,SSSS
log4j.appender.gelf.MaximumMessageSize=8192
log4j.appender.gelf.AdditionalFields=fieldName1=fieldValue1,fieldName2=fieldValue2
log4j.appender.gelf.MdcFields=mdcField1,mdcField2
log4j.appender.gelf.DynamicMdcFields=mdc.*,(mdc|MDC)fields
XML:
<appender name="gelf" class="biz.paluch.logging.gelf.log4j.GelfLogAppender">
<param name="Threshold" value="INFO" />
<param name="Host" value="udp:localhost" />
<param name="Port" value="12201" />
<param name="Facility" value="java-test" />
<param name="ExtractStackTrace" value="true" />
<param name="FilterStackTrace" value="true" />
<param name="MdcProfiling" value="true" />
<param name="TimestampPattern" value="yyyy-MM-dd HH:mm:ss,SSSS" />
<param name="MaximumMessageSize" value="8192" />
<param name="AdditionalFields" value="fieldName1=fieldValue1,fieldName2=fieldValue2" />
<param name="MdcFields" value="mdcField1,mdcField2" />
<param name="DynamicMdcFields" value="mdc.*,(mdc|MDC)fields" />
</appender>
Log4j v2 supports an extensive and flexible configuration in contrast to other log frameworks (JUL, log4j v1). This allows you to specify your needed fields you want to use in the GELF message. An empty field configuration results in a message containing only
- timestamp
- level (syslog level)
- host
- facility
- message
- short_message
You can add different fields:
- Static Literals
- MDC Fields
- Log-Event fields (using Pattern Layout)
In order to do so, use nested Field elements below the Appender element.
<Field name="fieldName1" literal="your literal value" />
<Field name="fieldName1" mdc="name of the MDC entry" />
<DynamicMdcFields regex="mdc.*" />
In contrast to the configuration of other log frameworks log4j2 config uses one DynamicMdcFields
element per regex (not separated by comma).
See also: Pattern Layout
Set the desired pattern and the field will be sent using the specified pattern value.
Additionally, you can add the host-Field, which can supply you either the FQDN hostname, the simple hostname or the local address.
Option | Description |
---|---|
host{["fqdn" "simple" "address"]} |
Outputs either the FQDN hostname, the simple hostname or the local address. You can follow the throwable conversion word with an option in the form %host{option}. %host{fqdn} default setting, outputs the FQDN hostname, e.g. www.you.host.name.com. %host{simple} outputs simple hostname, e.g. www. %host{address} outputs the local IP address of the found hostname, e.g. 1.2.3.4 or affe:affe:affe::1. |
XML:
<Configuration>
<Appenders>
<Gelf name="gelf" graylogHost="udp:localhost" graylogPort="12201" extractStackTrace="true"
filterStackTrace="true" mdcProfiling="true" maximumMessageSize="8192">
<Field name="timestamp" pattern="%d{dd MMM yyyy HH:mm:ss,SSS}" />
<Field name="level" pattern="%level" />
<Field name="simpleClassName" pattern="%C{1}" />
<Field name="className" pattern="%C" />
<Field name="server" pattern="%host" />
<Field name="server.fqdn" pattern="%host{fqdn}" />
<Field name="fieldName2" literal="fieldValue2" /> <!-- This is a static field -->
<Field name="mdcField2" mdc="mdcField2" /> <!-- This is a field using MDC -->
<DynamicMdcFields regex="mdc.*" />
<DynamicMdcFields regex="(mdc|MDC)fields" />
</Gelf>
</Appenders>
<Loggers>
<Root level="INFO">
<AppenderRef ref="gelf" />
</Root>
</Loggers>
</Configuration>
standalone.xml
<custom-handler name="GelfLogger" class="biz.paluch.logging.gelf.jboss7.JBoss7GelfLogHandler" module="biz.paluch.logging">
<level name="INFO" />
<properties>
<property name="threshold" value="INFO" />
<property name="host" value="udp:localhost" />
<property name="port" value="12201" />
<property name="facility" value="java-test" />
<property name="extractStackTrace" value="true" />
<property name="filterStackTrace" value="true" />
<property name="mdcProfiling" value="true" />
<property name="timestampPattern" value="yyyy-MM-dd HH:mm:ss,SSSS" />
<property name="maximumMessageSize" value="8192" />
<property name="additionalFields" value="fieldName1=fieldValue1,fieldName2=fieldValue2" />
<property name="mdcFields" value="mdcField1,mdcField2" />
<property name="dynamicMdcFields" value="mdc.*,(mdc|MDC)fields" />
</properties>
</custom-handler>
<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE configuration>
<configuration>
<contextName>test</contextName>
<jmxConfigurator/>
<appender name="gelf" class="biz.paluch.logging.gelf.logback.GelfLogbackAppender">
<host>udp:localhost</host>
<port>12201</port>
<facility>java-test</facility>
<extractStackTrace>true</extractStackTrace>
<filterStackTrace>true</filterStackTrace>
<mdcProfiling>true</mdcProfiling>
<timestampPattern>yyyy-MM-dd HH:mm:ss,SSSS</timestampPattern>
<maximumMessageSize>8192</maximumMessageSize>
<additionalFields>fieldName1=fieldValue1,fieldName2=fieldValue2</additionalFields>
<mdcFields>mdcField1,mdcField2</mdcFields>
<dynamicMdcFields>mdc.*,(mdc|MDC)fields</dynamicMdcFields>
<filter class="ch.qos.logback.classic.filter.ThresholdFilter">
<level>INFO</level>
</filter>
</appender>
<root level="DEBUG">
<appender-ref ref="gelf" />
</root>
</configuration>
MDC Profiling allows to calculate the runtime from request start up to the time until the log message was generated. You must set one value in the MDC:
profiling.requestStart.millis: Time Millis of the Request-Start (Long or String)
Two values are set by the Log Appender:
- profiling.requestEnd: End-Time of the Request-End in Date.toString-representation
- profiling.requestDuration: Duration of the request (e.g. 205ms, 16sec)
- [The MIT License (MIT)] (http://opensource.org/licenses/MIT)
- Contains also code from https://github.com/t0xa/gelfj