Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Metricbeat option to ignore NFS auto-mount #4685

Closed
brandonmensing opened this issue Jul 17, 2017 · 2 comments
Closed

Metricbeat option to ignore NFS auto-mount #4685

brandonmensing opened this issue Jul 17, 2017 · 2 comments
Labels
enhancement v5.6.0 v6.0.0-beta2 v6.1.0

Comments

@brandonmensing
Copy link

With drop_event.when.regexp.mount_point set, metricbeat does not send stats for those filtered out file systems, but it still touches them keeping mount points active. Eventually systems started to have thousands of mount points causing input/output errors for new workers. Need a setting like ignore_nfs_automount. Metricbeat will NOT touch nfs automounts at all, so the mount point timeout can kick in.
@andrewkroh
Copy link
Member

andrewkroh commented Aug 2, 2017 •
edited
Loading

It looks like we already have the filesystem types internally from when we query /etc/mtab to get a list of filesystems. So if we introduce a new filter option like filesystem.ignore_types: [nfs], we can apply that filter before continuing to stat the filesystems. This should keep Metricbeat from ever touching any of the NFS mounts.

The same filter would also need to be applied to the fsstat metricset.

andrewkroh added a commit to andrewkroh/beats that referenced this issue Aug 2, 2017
@andrewkroh
Add filesystem.ignore_types to ignore filesystem types
9b1d140 
Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes elastic#4685
@andrewkroh andrewkroh mentioned this issue Aug 3, 2017
Merged
kvch pushed a commit that referenced this issue Aug 15, 2017
@andrewkroh @kvch
Add filesystem.ignore_types to ignore filesystem types (#4823)
70caf0e 
* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes #4685

* Address doc review comments
@andrewkroh andrewkroh mentioned this issue Aug 15, 2017
Merged
andrewkroh added a commit to andrewkroh/beats that referenced this issue Aug 15, 2017
@andrewkroh
Add filesystem.ignore_types to ignore filesystem types (elastic#4823)
a2da1b0 
* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes elastic#4685

(cherry picked from commit 70caf0e)
@andrewkroh
Copy link
Member

andrewkroh commented Aug 15, 2017 •
edited
Loading

Branches with the feature:

exekias pushed a commit that referenced this issue Aug 16, 2017
@andrewkroh @exekias
Add filesystem.ignore_types to ignore filesystem types (#4823) (#4906)
aa54a22 
* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes #4685

(cherry picked from commit 70caf0e)
@andrewkroh andrewkroh mentioned this issue Aug 16, 2017
Merged
andrewkroh added a commit to andrewkroh/beats that referenced this issue Aug 16, 2017
@andrewkroh
Add filesystem.ignore_types to ignore filesystem types (elastic#4823) (…
dfc2247 
…elastic#4906)

* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes elastic#4685

(cherry picked from commit aa54a22)
exekias pushed a commit that referenced this issue Aug 16, 2017
@andrewkroh @exekias
Add filesystem.ignore_types to ignore filesystem types (#4823) (#4906) (
2fa4bb0 
#4918)

* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes #4685

(cherry picked from commit aa54a22)
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@andrewkroh @exekias
Add filesystem.ignore_types to ignore filesystem types (elastic#4823) (…
a7b61b1 
…elastic#4906) (elastic#4918)

* Add filesystem.ignore_types to ignore filesystem types

Add `filesystem.ignore_types` to the system module for ignoring filesystems
in the `filesystem` and `fsstat` metricsets. The new configuration option
accepts a list of filesystem types.

    metricbeat.modules:
    - module: system
      metricsets: [filesystem, fsstat]
      filesystem.ignore_types: [nfs, smbfs, proc, cgroups]

Closes elastic#4685

(cherry picked from commit 575483a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement v5.6.0 v6.0.0-beta2 v6.1.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@andrewkroh @brandonmensing