Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

level=error msg="error gathering metrics on Cisco Nexus 6000 #13

Closed
nuclearcat opened this issue Oct 25, 2021 · 6 comments
Closed

level=error msg="error gathering metrics on Cisco Nexus 6000 #13

nuclearcat opened this issue Oct 25, 2021 · 6 comments

Comments

@nuclearcat
Copy link

nuclearcat commented Oct 25, 2021

Just noticed error in log (upd, added with debug: true) :

Oct 25 10:13:16 grafana cisco-exporter[58467]: 2021/10/25 10:13:16 Running command on 10.0.25.35:22: show version
Oct 25 10:13:18 grafana cisco-exporter[58467]: 2021/10/25 10:13:18 Host 10.0.25.35:22 identified as: NXOS
Oct 25 10:13:18 grafana cisco-exporter[58467]: 2021/10/25 10:13:18 Running command on 10.0.25.35:22: show environment
Oct 25 10:13:18 grafana cisco-exporter[58467]: 2021/10/25 10:13:18 Running command on 10.0.25.35:22: show interface
Oct 25 10:13:18 grafana cisco-exporter[58467]: 2021/10/25 10:13:18 Running command on 10.0.25.35:22: show interfaces stats | exclude disabled

Oct 25 09:09:03 grafana cisco-exporter[57520]: time="2021-10-25T09:09:03+03:00" level=error msg="error gathering metrics: 22 error(s) occurred:\n* collected metric "cisco_interface_receive_bytes" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_errors" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_drops" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_bytes" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_errors" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_drops" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_broadcast" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_multicast" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_admin_up" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:1 > } was collected before with the same name and label values\n* collected metric "cisco_interface_up" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_error_status" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:1 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_bytes" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_errors" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_drops" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_bytes" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_errors" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_transmit_drops" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_broadcast" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_receive_multicast" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_admin_up" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:1 > } was collected before with the same name and label values\n* collected metric "cisco_interface_up" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:0 > } was collected before with the same name and label values\n* collected metric "cisco_interface_error_status" { label:<name:"description" value:"" > label:<name:"mac" value:"002a.6a80.36e1" > label:<name:"name" value:"mgmt0" > label:<name:"speed" value:"" > label:<name:"target" value:"10.0.25.35" > gauge:<value:1 > } was collected before with the same name and label values\n" source="log.go:181"

Please let me know what kind of other info needed to troubleshoot.
And thanks for great exporter!

@nuclearcat
Copy link
Author

HO-CORE# show interfaces stats | exclude disabled
^
% Invalid command at '^' marker.

Probably more correct like this:
show interface status | exclude disabled | exclude notconn | exclude sfpAbsent
Will try to patch and test

@l3akage
Copy link
Contributor

l3akage commented Oct 25, 2021

Hey,

"show interfaces stats | exclude disabled" is for metrics with "cisco_optics_" prefix, your error is for metrics with "cisco_interface_" so the command should be "show interface". Could you check if you see the interface mgmt0 twice?

@nuclearcat
Copy link
Author

nuclearcat commented Oct 25, 2021

I found what is reason, command "show interfaces stats | exclude disabled" doesnt exist on my Nexus.
--- removed patch, its getting malformed---
I did this hack, i know it is not appropriate as patch, but just to test if its a reason. It worked.
Now it returns optics stats

@nuclearcat
Copy link
Author

nuclearcat commented Oct 25, 2021

Sorry, patch is at https://pastebin.com/zE1EXFV7 , seems github getting worse every day, can't attach a file or paste code(code tag doesnt work properly) here.

@nuclearcat
Copy link
Author

nuclearcat commented Oct 25, 2021

"error gathering metrics: 22 error(s) occurred" seems irrelevant to optics issues, you are right. Its two separate bugs.
I did show interface, mgmt0 is appearing only once.

@nuclearcat
Copy link
Author

I think "error gathering metrics: 22 error(s) occurred" is not critical, so closing bug, unless i will find something is missing :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants