Index not showing in ES

[grillsoftware]

I'm not sure what am I doing wrong but I don't see the index in my Elasticsearch instance. The console and file appenders work fine. I don't see errors related to the ElasticsearchAppender.

logback.xml

<appender name="ELASTIC" class="com.internetitem.logback.elasticsearch.ElasticsearchAppender">
        <url>http://localhost:9200/_bulk</url>
        <index>dev_myApp-%date{yyyy-MM-dd}</index>
        <type>logback</type>
        <connectTimeout>30000</connectTimeout> <!-- optional (in ms, default 30000) -->
        <errorsToStderr>false</errorsToStderr> <!-- optional (default false) -->
        <includeCallerData>false</includeCallerData> <!-- optional (default false) -->
        <logsToStderr>false</logsToStderr> <!-- optional (default false) -->
        <maxQueueSize>104857600</maxQueueSize> <!-- optional (default 104857600) -->
        <maxRetries>3</maxRetries> <!-- optional (default 3) -->
        <readTimeout>30000</readTimeout> <!-- optional (in ms, default 30000) -->
        <sleepTime>250</sleepTime> <!-- optional (in ms, default 250) -->
        <rawJsonMessage>false</rawJsonMessage> <!-- optional (default false) -->
        <includeMdc>false</includeMdc> <!-- optional (default false) -->
        <maxMessageSize>-1</maxMessageSize> <!-- optional (default -1 -->
        <properties>
            <property>
                <name>severity</name>
                <value>%level</value>
            </property>
            <property>
                <name>thread</name>
                <value>%thread</value>
            </property>
            <property>
                <name>stacktrace</name>
                <value>%ex</value>
            </property>
            <property>
                <name>logger</name>
                <value>%logger{16}.%method</value>
            </property>
            <property>
                <name>server-time</name>
                <value>%date{ISO8601, {{ansible_timezone}}}</value>
            </property>
        </properties>
        <headers>
            <header>
                <name>Content-Type</name>
                <value>text/plain</value>
            </header>
        </headers>
    </appender>
    
    <root level="INFO">
        <appender-ref ref="CONSOLE" />
        <appender-ref ref="FILE" />
        <appender-ref ref="ELASTIC" />
    </root>

    <logger name="com.myCompany.myApp" level="DEBUG" />

curl localhost:9200/_cat/indices

green open .geoip_databases                y1revQR7SyWHJIxnAq0z7w 1 0  42    0 40.3mb 40.3mb
green open .kibana_7.16.3_001              zjnnLKjXT362iQdFnXPsHQ 1 0 279   27  2.4mb  2.4mb
green open .apm-custom-link                t8-PvRWaTpSd1n2xuT8tYA 1 0   0    0   226b   226b
green open .apm-agent-configuration        hx8SsYzkTDqkEPpA7aZcvg 1 0   0    0   226b   226b
green open .kibana_task_manager_7.16.3_001 H-Kjao4hRLW45PmEMTvnGw 1 0  17 5352    1mb    1mb
green open .tasks                          Xp2ezFegRo-jzjK4UfUTpQ 1 0   6    0 28.9kb 28.9kb

[jonahbenton]

That means your logs are not properly getting to, or being captured by, the elastic instance. Try setting errorsToStderr to true, which should report some errors the appender can see to the console, and separately logsToStderr to true can show you the json getting sent to elastic.

At first glance your config looks ok, though we send a header of Content-Type application/json, and you may need to include the authentication tag, depending on your elastic setup.

[agido-jrieks]

I had the same problem, it is caused by incorrect error handling here:

logback-elasticsearch-appender/src/main/java/com/internetitem/logback/elasticsearch/writer/ElasticsearchWriter.java

Line 81 in c708131

if (rc != 200) {

The HTTP status code is 200, so the code assumes everything is fine - but the body tells that there was a problem: