Configuring the Elasticsearch Log Plug-In to Write Container Logs to Elasticsearch

Learn how to install and use the Akana Elasticsearch Log Plug-In to write log files to the Elasticsearch server.

Table of Contents

• Overview
• Installation
• Configuring the Elasticsearch Log Plug-In to write container logs to Elasticsearch (com.soa.log)
• Logged Data: container logs

Overview

The Akana Elasticsearch Log Plug-In can be installed on each of the Akana containers. This plug-in allows the capture of Akana container exception data and access log information into Elasticsearch optionally.

You can use Kibana to view the data pushed into Elasticsearch, or query it directly. The data is returned as a JSON document.

There is a com.soa.log configuration property that you can use to configure the Elasticsearch Log Plug-In to write data to Elasticsearch rather than the default location. The com.soa.log allows you to configure the platform to write the container logs to the Elasticsearch server.

Installation

The Akana Elasticsearch Log Plug-In is a part of the Akana Option packs and is downloaded from the Support Download site. It can be installed in any of the Akana containers.

To download: Go to the Rogue Wave Support Center (https://library.roguewave.com). Click Product Downloads > Akana - Product Downloads > choose version. Option packs are in the bottom section of the page. Download the version number that matches your installation.

Unzip the file, and then copy everything contained inside the /lib/ folder in the ZIP file (folders and files), to the /lib/ folder of your installation. For example: \lib\optionpacks\2019.1.3.

You can then install the feature using the Akana Administration Console.

Any container where the Akana Elasticsearch Log Plug-In is installed must be able to access the Elasticsearch server.

Configuring the Elasticsearch Log Plug-In to write container logs to Elasticsearch (com.soa.log)

After installing the plug-in, you can configure the container so that instead of writing the server logs to the disk, it writes them to the Elasticsearch server.

In the Akana Administration Console, on the Configuration tab, under Configuration Categories, select com.soa.log. The configuration PID is: com.soa.log

Note: By default, rootLogger.appenderRef.root.ref property is set to rolling. However, if you specify rootLogger.appenderRef.root.ref property to rolling and rootLogger.appenderRef.elastic.ref property to elastic, the logs are written to both log file and Elasticsearch server.

Properties that are required are shown in the table below.

Logged Data: container logs

This plug-in pushes the exceptions from the access log file into Elasticsearch. An example message is shown below. This 404 exception is logged in Elasticsearch. For additional information regarding this error (for example, what may have caused the error, exception) the container log files residing on the file system are still required because this information is not pushed into Elasticsearch.

{
  "_index": "request-log",
  "_type": "_doc",
  "_id": "ecd1436d-6552-431b-a79e-07082646bac7",
  "_version": 1,
  "_score": null,
  "_source": {
    "@timestamp": "2020-02-24T23:55:35.524Z",
    "hostName": "ap-ex-swest",
    "applicationName": "AP",
    "containerKey": "1000105",
    "instanceName": "ap-ex-swest",
    "logger": "com.soa.transport.jetty.JettyTransportBinding",
    "level": "ERROR",
    "className": "com.soa.transport.http.HttpException",
    "message": "HTTP Error [404:Not Found] when accessing the URI [Not specified]",
    "stackTrace": "com.soa.transport.http.HttpException: HTTP Error [404:Not Found] when. . . . [abbreviated for display purposes] \n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\n\n\t",
    "request": null,
    "tenant": "none",
    "eventId": "264c24d7-5761-11ea-9044-b5a9b2cef593",
    "alertCode": 9022
  },
  "fields": {
    "@timestamp": [
      "2020-02-24T23:55:35.524Z"
    ]
  },
  "sort": [
    1582588535524
  ]
			}

Related Topics