You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to do a simple test where fluentd and opensearch are in the same docker network.
The Docker compose file is:
services:
fluentd:
build: ./fluentd
container_name: fluentd
ports:
- 24224:24224
- 24224:24224/udp
restart: unless-stopped
links:
- "opensearch"
volumes:
- ./fluentd/data:/fluentd/log
- ./fluentd/conf:/fluentd/etc
networks:
- opensearch-net # All of the containers will join the same Docker bridge network
opensearch: # This is also the hostname of the container within the Docker network (i.e. https://opensearch-node1/)
image: opensearchproject/opensearch:latest # Specifying the latest available image - modify if you want a specific version
container_name: opensearch-node1
environment:
- cluster.name=opensearch-cluster # Name the cluster
- node.name=opensearch-node1 # Name the node that will run in this container
- cluster.initial_cluster_manager_nodes=opensearch-node1 # Nodes eligible to serve as cluster manager
- bootstrap.memory_lock=true # Disable JVM heap memory swapping
- "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # Set min and max JVM heap sizes to at least 50% of system RAM
- 'network.host: "0.0.0.0"'
- "discovery.type=single-node"
ulimits:
memlock:
soft: -1 # Set memlock to unlimited (no soft or hard limit)
hard: -1
nofile:
soft: 65536 # Maximum number of open files for the opensearch user - set to at least 65536
hard: 65536
volumes:
- opensearch-data1:/usr/share/opensearch/data # Creates volume called opensearch-data1 and mounts it to the container
ports:
- 9200:9200 # REST API
- 9600:9600 # Performance Analyzer
networks:
- opensearch-net # All of the containers will join the same Docker bridge network
opensearch-dashboards:
image: opensearchproject/opensearch-dashboards:latest # Make sure the version of opensearch-dashboards matches the version of opensearch installed on other nodes
container_name: opensearch-dashboards
ports:
- 5601:5601 # Map host port 5601 to container port 5601
expose:
- "5601" # Expose port 5601 for web access to OpenSearch Dashboards
environment:
- 'OPENSEARCH_HOSTS=["https://opensearch:9200"]'
networks:
- opensearch-net
volumes:
opensearch-data1:
networks:
opensearch-net:
When I lauch the docker-compose up command, I obtain the following error:
fluentd | 2023-10-30 09:31:40 +0000 [warn]: #0 Could not communicate to OpenSearch, resetting connection and trying again. Connection refused - connect(2) for 172.27.0.2:9200 (Errno::ECONNREFUSED)
Of course, none of my logs are reported into Opensearch.
The complete log is :
opensearch-node1 | Enabling execution of install_demo_configuration.sh for OpenSearch Security Plugin
opensearch-node1 | **************************************************************************
opensearch-node1 | ** This tool will be deprecated in the next major release of OpenSearch **
opensearch-node1 | ** opensearch-project/security#1755 **
opensearch-node1 | **************************************************************************
opensearch-node1 | OpenSearch Security Demo Installer
opensearch-node1 | ** Warning: Do not use on production or public reachable systems **
opensearch-node1 | Basedir: /usr/share/opensearch
opensearch-node1 | OpenSearch install type: rpm/deb on Amazon Linux release 2023 (Amazon Linux)
opensearch-node1 | OpenSearch config dir: /usr/share/opensearch/config
opensearch-node1 | OpenSearch config file: /usr/share/opensearch/config/opensearch.yml
opensearch-node1 | OpenSearch bin dir: /usr/share/opensearch/bin
opensearch-node1 | OpenSearch plugins dir: /usr/share/opensearch/plugins
opensearch-node1 | OpenSearch lib dir: /usr/share/opensearch/lib
opensearch-node1 | Detected OpenSearch Version: x-content-2.11.0
opensearch-node1 | Detected OpenSearch Security Version: 2.11.0.0
opensearch-node1 | /usr/share/opensearch/config/opensearch.yml seems to be already configured for Security. Quit.
opensearch-node1 | Enabling OpenSearch Security Plugin
opensearch-node1 | Enabling execution of OPENSEARCH_HOME/bin/opensearch-performance-analyzer/performance-analyzer-agent-cli for OpenSearch Performance Analyzer Plugin
fluentd | 2023-10-30 09:31:37 +0000 [info]: init supervisor logger path=nil rotate_age=nil rotate_size=nil
fluentd | 2023-10-30 09:31:37 +0000 [info]: parsing config file is succeeded path="/fluentd/etc/fluent.conf"
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluentd' version '1.15.3'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-calyptia-monitoring' version '0.1.3'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-cmetrics' version '0.1.0'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-metrics-cmetrics' version '0.1.2'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-multi-format-parser' version '1.0.0'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-opensearch' version '1.1.4'
fluentd | 2023-10-30 09:31:37 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0'
opensearch-node1 | WARNING: A terminally deprecated method in java.lang.System has been called
opensearch-node1 | WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/opensearch/lib/opensearch-2.11.0.jar)
opensearch-node1 | WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
opensearch-node1 | WARNING: System::setSecurityManager will be removed in a future release
fluentd | 2023-10-30 09:31:37 +0000 [warn]: define <match fluent.**> to capture fluentd logs in top level is deprecated. Use <label @FLUENT_LOG> instead
fluentd | 2023-10-30 09:31:37 +0000 [info]: using configuration file:
fluentd |
Using Fluentd and OpenSearch plugin versions
OS version: Windows 11 Family 22H2
Docker Desktop v4.19.0
Fluentd v1.15.3
OpenSearch plugin version: 1.1.4
The text was updated successfully, but these errors were encountered:
(check apply)
Steps to replicate
I'm trying to do a simple test where fluentd and opensearch are in the same docker network.
The Docker compose file is:
The fluentd config file is:
Expected Behavior or What you need to ask
When I lauch the docker-compose up command, I obtain the following error:
Of course, none of my logs are reported into Opensearch.
The complete log is :
Using Fluentd and OpenSearch plugin versions
The text was updated successfully, but these errors were encountered: