URL structure different from webinterface and prometheus link

[LudwigDevOps]

Hello Guys,

i have a simmular problem with this.
i have prometheus and snmp_exporter on the same machine (no docker, just debian OS)
prometheus runs on 9090 and snmp_exporter on 9116

in the prometheus config file i have declated my targets:

  - job_name: snmp
    metrics_path: /snmp
    params:
      module: [if_mib]
    static_configs:
      - targets:
        - 192.168.130.246 #HP ProCurve 4204
        - 192.168.130.252 #HP 2530
        - 192.168.130.249 #Aruba 6100
        - 192.168.130.250 #Dell PowerEdge 2824
        - 192.166.130.1   #Firewall 
    relabel_configs:
      - source_labels: [__address__]
        target_label: __param_target
      - source_labels: [__param_target]
        target_label: instance
      - target_label: __address__
        replacement: myserver.domain.com:9116 # URL as shown on the UI

the other switches are running and everything is fine.
i collect the data and display my traffic with grafana.

but the firewall one is a little bit bitchy.
the snmp config on the firewall should be fine snmp v2c and public as the com.string.

on the webinterface from the snmp_exporter the firewall(called devices) gives back his information instant.
webinterface runs with this URL:

http://myserver.domain.com:9116/snmp?target=192.168.130.1&module=if_mib

fine.. i got my ifOutOctets

on the prometheus webinterface on targets.. i got the error 500 and if i click on the link i get
error getting target 192.166.130.1: request timeout (after 3 retries)

i look in the URL and its this one:

http://myserver.domain.com:9116/snmp?module=if_mib&target=192.166.130.1

so just the structure of the URL is changed.. and then error 500 on prometheus and timeout????

can you guys say me something about this. why the URL stucture changes and why it workes with just this constellation..
it makes no sense to me.

br

Ludwig

btw: i use this version

 snmp_exporter --version
snmp_exporter, version 0.22.0 (branch: HEAD, revision: 7b0657fd99862a47f2f9f780f08a794ca7040ae7)
  build user:       root@cfac3556bd96
  build date:       20230615-13:29:47
  go version:       go1.20.5
  platform:         linux/amd64
  tags:             netgo

[SuperQ]

Just like the other post, order of URL parameters doesn't matter.

I recommend you use --log.level=debug to find out where your issue is.

[SuperQ]

Also, it appears you likely have a typo in your config. 166 vs 168.

[LudwigDevOps]

thanks for the quick reply..

i'm sorry, i dont' see the typo 166 vs 168.

with the debug Level here my log.. unfortunatly it doesn't provide much more informations..

ts=2023-07-12T14:05:24.187Z caller=main.go:157 level=info msg="Starting snmp_exporter" version="(version=0.22.0, branch=HEAD, revision=7b0657fd99862a47f2f9f780f08a794ca7040ae7)"
ts=2023-07-12T14:05:24.187Z caller=main.go:158 level=info build_context="(go=go1.20.5, platform=linux/amd64, user=root@cfac3556bd96, date=20230615-13:29:47, tags=netgo)"
ts=2023-07-12T14:05:24.348Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9116
ts=2023-07-12T14:05:24.348Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9116
ts=2023-07-12T14:05:49.141Z caller=main.go:106 level=debug module=if_mib target=192.166.130.1 msg="Starting scrape"
ts=2023-07-12T14:05:49.141Z caller=collector.go:220 level=debug module=if_mib target=192.166.130.1 msg="Getting OIDs" oids=1
ts=2023-07-12T14:06:09.150Z caller=collector.go:390 level=info module=if_mib target=192.166.130.1 msg="Error scraping target" err="error getting target 192.166.130.1: request timeout (after 3 retries)"
ts=2023-07-12T14:06:09.151Z caller=main.go:117 level=debug module=if_mib target=192.166.130.1 msg="Finished scrape" duration_seconds=20.00940663
```4

[SuperQ]

Look more carefully. This is still hitting the wrong IP.

[LudwigDevOps]

damm thanks for checking and your time :) you are great.

it works now muchu thanks

[LudwigDevOps]

I don't know why.. but the URL now is working.. when i type

http://myserver.domain.com:9116/snmp?module=if_mib&target=192.168.130.1

and i see the log:

s=2023-07-12T14:20:53.834Z caller=collector.go:220 level=debug module=if_mib target=192.168.130.1 msg="Getting OIDs" oids=1
ts=2023-07-12T14:20:53.835Z caller=collector.go:230 level=debug module=if_mib target=192.168.130.1 msg="Get of OIDs completed" oids=1 duration_seconds=778.761µs
ts=2023-07-12T14:20:53.835Z caller=collector.go:254 level=debug module=if_mib target=192.168.130.1 msg="Walking subtree" oid=1.3.6.1.2.1.2
ts=2023-07-12T14:20:53.846Z caller=collector.go:268 level=debug module=if_mib target=192.168.130.1 msg="Walk of subtree completed" oid=1.3.6.1.2.1.2 duration_seconds=11.177283ms
ts=2023-07-12T14:20:53.846Z caller=collector.go:254 level=debug module=if_mib target=192.168.130.1 msg="Walking subtree" oid=1.3.6.1.2.1.31.1.1
ts=2023-07-12T14:20:53.853Z caller=collector.go:268 level=debug module=if_mib target=192.168.130.1 msg="Walk of subtree completed" oid=1.3.6.1.2.1.31.1.1 duration_seconds=6.543501ms
ts=2023-07-12T14:20:53.861Z caller=main.go:117 level=debug module=if_mib target=192.168.130.1 msg="Finished scrape" duration_seconds=0.026542303

but in prometheus... still error 500