Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[0.9.5-nightly-6ecb62e] Partial crash using certain queries #4751

Closed
enigmapsi opened this issue Nov 11, 2015 · 2 comments
Closed

[0.9.5-nightly-6ecb62e] Partial crash using certain queries #4751

enigmapsi opened this issue Nov 11, 2015 · 2 comments

Comments

@enigmapsi
Copy link

Hi,

Not sure if this was reported before, I thought it's worth mentioning. Running as single node, not cluster.

InfluxDB stops listening to 2 ports if I execute certain queries, please see below. One of the ports is for the HTTP api - no API connection is possible until the daemon is restarted.

> select * from ping where time  > now() - 5d and time < now() - 4d LIMIT 10
name: ping
----------
time            avg host    max min received    sent    stddev
2015-11-06T15:52:26Z    102.8   host0   118 73  5       5   15.77
2015-11-06T15:53:26Z    99.6    host0   116 76  5       5   14.61
2015-11-06T15:54:26Z    95.4    host0   125 70  5       5   23
2015-11-06T15:55:26Z    100.4   host0   119 83  5       5   12.92
2015-11-06T15:56:26Z    97.6    host0   120 79  5       5   15.84
2015-11-06T15:57:26Z    103.4   host0   126 76  5       5   16.63
2015-11-06T15:58:26Z    96  host0   116 75  5       5   16.65
2015-11-06T15:59:26Z    100.8   host0   116 81  5       5   14.63
2015-11-06T16:00:26Z    86.6    host0   102 74  5       5   8.98
2015-11-06T16:01:26Z    82.8    host0   105 76  5       5   11.14

> select mean(avg) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
name: ping
----------
time            mean
2015-11-06T15:53:00Z    
2015-11-06T15:54:00Z    95.4
2015-11-06T15:55:00Z    100.4
2015-11-06T15:56:00Z    97.6
2015-11-06T15:57:00Z    103.4
2015-11-06T15:58:00Z    96
2015-11-06T15:59:00Z    100.8
2015-11-06T16:00:00Z    86.6
2015-11-06T16:01:00Z    82.8
2015-11-06T16:02:00Z    107.8

> select mean(avg), min(min) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
name: ping
----------
time            mean    min
2015-11-06T15:53:00Z        
2015-11-06T15:54:00Z    95.4    70
2015-11-06T15:55:00Z    100.4   83
2015-11-06T15:56:00Z    97.6    79
2015-11-06T15:57:00Z    103.4   76
2015-11-06T15:58:00Z    96  75
2015-11-06T15:59:00Z    100.8   81
2015-11-06T16:00:00Z    86.6    74
2015-11-06T16:01:00Z    82.8    76
2015-11-06T16:02:00Z    107.8   85

> select mean(avg), avg(stddev), min(min) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
ERR: function not found: "avg"
> select mean(avg), mean(stddev), min(min) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
name: ping
----------
time            mean    mean    min
2015-11-06T15:54:00Z    95.4    23  70
2015-11-06T15:55:00Z    100.4   12.92   83
2015-11-06T15:56:00Z    97.6    15.84   79
2015-11-06T15:57:00Z    103.4   16.63   76
2015-11-06T15:58:00Z    96  16.65   75
2015-11-06T15:59:00Z    100.8   14.63   81
2015-11-06T16:00:00Z    86.6    8.98    74
2015-11-06T16:01:00Z    82.8    11.14   76
2015-11-06T16:02:00Z    107.8   15.61   85
2015-11-06T16:03:00Z    94.8    14.66   77

> select mean(avg) - mean(stddev)  from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
name: ping
----------
time            
2015-11-06T15:54:00Z    
2015-11-06T15:55:00Z    87.48
2015-11-06T15:56:00Z    81.75999999999999
2015-11-06T15:57:00Z    86.77000000000001
2015-11-06T15:58:00Z    79.35
2015-11-06T15:59:00Z    86.17
2015-11-06T16:00:00Z    77.61999999999999
2015-11-06T16:01:00Z    71.66
2015-11-06T16:02:00Z    92.19
2015-11-06T16:03:00Z    80.14

> select mean(avg), mean(stddev), mean(avg) - mean(stddev) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
name: ping
----------
time            mean    mean    
2015-11-06T15:55:00Z            
2015-11-06T15:56:00Z    97.6    15.84   81.75999999999999
2015-11-06T15:57:00Z    103.4   16.63   86.77000000000001
2015-11-06T15:58:00Z    96  16.65   79.35
2015-11-06T15:59:00Z    100.8   14.63   86.17
2015-11-06T16:00:00Z    86.6    8.98    77.61999999999999
2015-11-06T16:01:00Z    82.8    11.14   71.66
2015-11-06T16:02:00Z    107.8   15.61   92.19
2015-11-06T16:03:00Z    94.8    14.66   80.14
2015-11-06T16:04:00Z    100 12.84   87.16

> select mean(avg), mean(stddev), mean(avg) - mean(stddev), min(min) from ping where time  > now() - 5d and time < now() - 4d GROUP BY time(1m) LIMIT 10
ERR: Get http://10.0.25.98:8086/query?db=test&q=select+mean%28avg%29%2C+mean%28stddev%29%2C+mean%28avg%29+-+mean%28stddev%29%2C+min%28min%29+from+ping+where+time++%3E+now%28%29+-+5d+and+time+%3C+now%28%29+-+4d+GROUP+BY+time%281m%29+LIMIT+10: EOF

The last query always crashes InfluxDB, as follows (ports open before and after that query).

Proto Recv-Q Send-Q Local Address           Foreign Address         State   PID/Program name
tcp6       0      0 :::8083                 :::*                    LISTEN  19340/influxd
tcp6       0      0 :::8086                 :::*                    LISTEN  19340/influxd
tcp6       0      0 :::8088                 :::*                    LISTEN  19340/influxd

Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State   PID/Program name
tcp6       0      0 :::8088                 :::*                    LISTEN  19426/influxd

Log entries (influxdb is restarted by systemd):

Nov 11 16:01:45 inf-stor-02 influxd: [query] 2015/11/11 16:01:45 SELECT mean(avg), mean(stddev), mean(avg) - mean(stddev), min(min) FROM "test"."default".ping WHERE time > now() - 5d AND time < now() - 4d GROUP BY time(1m) LIMIT 10
Nov 11 16:01:45 inf-stor-02 influxd: panic: runtime error: makeslice: len out of range
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 264 [running]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*AggregateExecutor).processSelectors(0xc8201683c0, 0xc8201f60f0, 0xa, 0xa, 0x3, 0x7f75a6b57e00, 0xc8214c0580, 0x5, 0x8, 0x0, ...)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/aggregate.go:404 +0x168
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*AggregateExecutor).processFunctions(0xc8201683c0, 0xc8201f60f0, 0xa, 0xa, 0xc8214c0580, 0x5, 0x8, 0x0, 0x0, 0x0, ...)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/aggregate.go:389 +0x2ce
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*AggregateExecutor).execute(0xc8201683c0, 0xc82304fce0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/aggregate.go:150 +0x12ee
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb.(*AggregateExecutor).Execute
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/aggregate.go:48 +0x5d
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 1 [chan receive, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: main.(*Main).Run(0xc820049f10, 0xc82000a190, 0x2, 0x2, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/main.go:96 +0xa39
Nov 11 16:01:45 inf-stor-02 influxd: main.main()
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/main.go:46 +0x29b
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 17 [syscall, 4 minutes, locked to thread]:
Nov 11 16:01:45 inf-stor-02 influxd: runtime.goexit()
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/asm_amd64.s:1696 +0x1
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 5 [syscall, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: os/signal.loop()
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/os/signal/signal_unix.go:22 +0x18
Nov 11 16:01:45 inf-stor-02 influxd: created by os/signal.init.1
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/os/signal/signal_unix.go:28 +0x37
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 19 [select, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/cmd/influxd/run.(*Server).monitorErrorChan(0xc8201430e0, 0xc820016780)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:551 +0x145
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/cmd/influxd/run.(*Server).Open.func1
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:382 +0xc88
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 7 [IO wait, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: net.runtime_pollWait(0x7f75a69ad9f0, 0x72, 0xc820010140)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/netpoll.go:157 +0x60
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).Wait(0xc820055330, 0x72, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:73 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).WaitRead(0xc820055330, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:78 +0x36
Nov 11 16:01:45 inf-stor-02 influxd: net.(*netFD).accept(0xc8200552d0, 0x0, 0x7f75a4320000, 0xc82016e000)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_unix.go:408 +0x27c
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).AcceptTCP(0xc820028100, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:254 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).Accept(0xc820028100, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:264 +0x3d
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*Mux).Serve(0xc82015eac0, 0x7f75a69adb78, 0xc820028100, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:48 +0x4b
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/cmd/influxd/run.(*Server).Open.func1
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:376 +0xb04
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 8 [chan receive, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028108, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/meta.(*raftLayer).Accept(0xc820165950, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:2204 +0x51
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*NetworkTransport).listen(0xc820055340)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/net_transport.go:362 +0x79
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/hashicorp/raft.NewNetworkTransportWithLogger
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/net_transport.go:154 +0x279
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 9 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).leaderLoop(0xc8200941c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:849 +0xcce
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).runLeader(0xc8200941c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:821 +0x936
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).run(0xc8200941c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:602 +0xbb
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.run)-fm()
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:252 +0x20
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*raftState).goFunc.func1(0xc8200941c0, 0xc8201678b0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:152 +0x44
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/hashicorp/raft.(*raftState).goFunc
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:153 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 10 [select, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).runFSM(0xc8200941c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:509 +0x10eb
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.runFSM)-fm()
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:253 +0x20
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*raftState).goFunc.func1(0xc8200941c0, 0xc8201678c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:152 +0x44
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/hashicorp/raft.(*raftState).goFunc
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:153 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 11 [select, 1 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).runSnapshots(0xc8200941c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:1636 +0x493
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.runSnapshots)-fm()
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/raft.go:254 +0x20
Nov 11 16:01:45 inf-stor-02 influxd: github.com/hashicorp/raft.(*raftState).goFunc.func1(0xc8200941c0, 0xc8201678d0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:152 +0x44
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/hashicorp/raft.(*raftState).goFunc
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/hashicorp/raft/state.go:153 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 12 [select, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/meta.(*localRaft).logLeaderChanges(0xc82000d770)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/state.go:190 +0x4f5
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/meta.(*localRaft).open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/state.go:180 +0x1344
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 13 [chan receive, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028110, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/meta.(*Store).serveExecListener(0xc8200868c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:643 +0xae
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/meta.(*Store).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:237 +0x351
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 14 [chan receive, 4 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028118, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/meta.(*Store).serveRPCListener(0xc8200868c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:753 +0xa2
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/meta.(*Store).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:240 +0x3a3
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 55 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8205029a0, 0xc8225b8b40)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 75 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012c540, 0xc824865500)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 53 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8205020e0, 0xc823c708a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 54 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820502540, 0xc823c71bc0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 38 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b40e0, 0xc82337d7a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 74 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012c1c0, 0xc824864d20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 52 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8207e68c0, 0xc823aebe60)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 76 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012c9a0, 0xc824865b60)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 77 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012ce00, 0xc822ece480)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 78 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012d260, 0xc822eced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 79 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012d6c0, 0xc822ecf500)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 80 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82012dc00, 0xc822ecfc20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 81 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820082380, 0xc822f146c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 82 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820082a80, 0xc822f15020)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 83 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820082ee0, 0xc823c62060)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 84 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820083340, 0xc823c631a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 85 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200837a0, 0xc823c63980)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 86 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820083c00, 0xc8237b4de0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 87 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aee460, 0xc8237b58c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 88 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aee620, 0xc8240c2300)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 89 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aeea80, 0xc8240c2ae0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 90 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aeeee0, 0xc8240c3740)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 91 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aef340, 0xc8249a2cc0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 92 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aef7a0, 0xc8249a39e0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 93 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820aefc00, 0xc821a202a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 94 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b320e0, 0xc821a21680)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 95 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b32540, 0xc82277e780)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 96 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b329a0, 0xc82277f560)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 97 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b32e00, 0xc82277fec0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 98 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b33260, 0xc822d1d320)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 99 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b336c0, 0xc82458a4e0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 100 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc820b33b20, 0xc82458ac00)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 101 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8207e6000, 0xc82458bf20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 102 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8207e6460, 0xc822642a20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 39 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b4540, 0xc8226c8fc0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 40 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b49a0, 0xc8226c9da0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 41 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b4e00, 0xc823300ae0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 42 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b5260, 0xc823301a40)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 43 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b56c0, 0xc822607080)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 44 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8200b5b20, 0xc822607f20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 45 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207c000, 0xc8247b07e0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 46 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207c460, 0xc8247b1800)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 47 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207c8c0, 0xc821ea8360)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 48 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207cd20, 0xc821ea8c00)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 49 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207d180, 0xc821ea9c20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 114 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207d5e0, 0xc8229f9260)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 115 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207da40, 0xc8223902a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 116 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc82207dea0, 0xc822391800)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 117 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8222ce380, 0xc8249f0b40)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 118 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8222ce7e0, 0xc8249f1620)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 119 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8222cec40, 0xc82329e3c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 120 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8222cf0a0, 0xc82329e8a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 121 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8222cf500, 0xc82329f200)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:241 +0x627
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 125 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*Store).periodicMaintenance(0xc820086780)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/store.go:322 +0x11c
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb.(*Store).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/store.go:377 +0x3b7
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 126 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/hh.(*Service).purgeInactiveProcessors(0xc82013c0c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/hh/service.go:222 +0x17c
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/hh.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/hh/service.go:117 +0x609
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 127 [chan receive]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/subscriber.(*Service).writePoints(0xc8200169c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/subscriber/service.go:209 +0xac
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/subscriber.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/subscriber/service.go:77 +0x13f
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 128 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/meta.(*Store).WaitForDataChanged(0xc8200868c0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/meta/store.go:443 +0x203
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/subscriber.(*Service).waitForMetaUpdates(0xc8200169c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/subscriber/service.go:102 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/subscriber.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/subscriber/service.go:79 +0x161
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 129 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/monitor.(*Monitor).storeStatistics(0xc820082620)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/monitor/service.go:359 +0x120d
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/monitor.(*Monitor).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/monitor/service.go:138 +0x349
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 130 [chan receive, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028120, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/cluster.(*Service).serve(0xc8200550a0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cluster/service.go:98 +0xdb
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/cluster.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cluster/service.go:75 +0x135
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 131 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/precreator.(*Service).runPrecreation(0xc82015e640)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/precreator/service.go:75 +0x44f
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/precreator.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/precreator/service.go:53 +0x21f
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 138 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*PointBatcher).Start.func2(0xc824efca80, 0xc823c4f8e0, 0xc823c4f900, 0xc820102930, 0xc820102928)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/batcher.go:74 +0x522
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb.(*PointBatcher).Start
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/batcher.go:109 +0x17e
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 133 [chan receive, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028128, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/snapshotter.(*Service).serve(0xc82000cf00)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/snapshotter/service.go:75 +0xa9
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/snapshotter.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/snapshotter/service.go:48 +0x130
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 134 [chan receive, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/tcp.(*listener).Accept(0xc820028130, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/copier.(*Service).serve(0xc82015e6c0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/copier/service.go:78 +0xa9
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/copier.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/copier/service.go:51 +0x130
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 135 [IO wait, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: net.runtime_pollWait(0x7f75a69ad930, 0x72, 0xc820010140)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/netpoll.go:157 +0x60
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).Wait(0xc820f7e6f0, 0x72, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:73 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).WaitRead(0xc820f7e6f0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:78 +0x36
Nov 11 16:01:45 inf-stor-02 influxd: net.(*netFD).accept(0xc820f7e690, 0x0, 0x7f75a4320000, 0xc8209b9620)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_unix.go:408 +0x27c
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).AcceptTCP(0xc820102138, 0x455640, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:254 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).Accept(0xc820102138, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:264 +0x3d
Nov 11 16:01:45 inf-stor-02 influxd: net/http.(*Server).Serve(0xc824efdb00, 0x7f75a69adb78, 0xc820102138, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1887 +0xb3
Nov 11 16:01:45 inf-stor-02 influxd: net/http.Serve(0x7f75a69adb78, 0xc820102138, 0x7f75a429ea60, 0xc8209cb740, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1765 +0x85
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/admin.(*Service).serve(0xc82000cff0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/admin/service.go:107 +0x12f
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/admin.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/admin/service.go:70 +0x491
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 136 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/continuous_querier.(*Service).backgroundLoop(0xc82008b080)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:184 +0x55f
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/continuous_querier.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/continuous_querier/service.go:118 +0x255
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 137 [IO wait]:
Nov 11 16:01:45 inf-stor-02 influxd: net.runtime_pollWait(0x7f75a69ad870, 0x72, 0xc820010140)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/netpoll.go:157 +0x60
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).Wait(0xc820f7e760, 0x72, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:73 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: net.(*pollDesc).WaitRead(0xc820f7e760, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_poll_runtime.go:78 +0x36
Nov 11 16:01:45 inf-stor-02 influxd: net.(*netFD).accept(0xc820f7e700, 0x0, 0x7f75a4320000, 0xc821cbfd60)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_unix.go:408 +0x27c
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).AcceptTCP(0xc820102bc8, 0xc821e2cdc0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:254 +0x4d
Nov 11 16:01:45 inf-stor-02 influxd: net.(*TCPListener).Accept(0xc820102bc8, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/tcpsock_posix.go:264 +0x3d
Nov 11 16:01:45 inf-stor-02 influxd: net/http.(*Server).Serve(0xc824efd2c0, 0x7f75a69adb78, 0xc820102bc8, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1887 +0xb3
Nov 11 16:01:45 inf-stor-02 influxd: net/http.Serve(0x7f75a69adb78, 0xc820102bc8, 0x7f75a429e9c0, 0xc82008b100, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1765 +0x85
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.(*Service).serve(0xc820016d20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/service.go:133 +0x6e
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/httpd.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/service.go:101 +0x6ca
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 139 [runnable]:
Nov 11 16:01:45 inf-stor-02 influxd: syscall.Syscall6(0x2d, 0x77, 0xc8246c2000, 0x5ac, 0x0, 0xc8223e9c90, 0xc8223e9c8c, 0x52e, 0x5ac, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/syscall/asm_linux_amd64.s:44 +0x5
Nov 11 16:01:45 inf-stor-02 influxd: syscall.recvfrom(0x77, 0xc8246c2000, 0x5ac, 0x5ac, 0x0, 0xc8223e9c90, 0xc8223e9c8c, 0x7, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/syscall/zsyscall_linux_amd64.go:1712 +0x91
Nov 11 16:01:45 inf-stor-02 influxd: syscall.Recvfrom(0x77, 0xc8246c2000, 0x5ac, 0x5ac, 0x0, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/syscall/syscall_unix.go:244 +0xb8
Nov 11 16:01:45 inf-stor-02 influxd: net.(*netFD).readFrom(0xc820f7e770, 0xc8246c2000, 0x5ac, 0x5ac, 0x0, 0x0, 0x0, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/fd_unix.go:255 +0x1dc
Nov 11 16:01:45 inf-stor-02 influxd: net.(*UDPConn).ReadFromUDP(0xc820102920, 0xc8246c2000, 0x5ac, 0x5ac, 0x534, 0xc821c64b40, 0x0, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/udpsock_posix.go:61 +0x117
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/collectd.(*Service).serve(0xc82008b180)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/collectd/service.go:215 +0x12c
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/collectd.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/collectd/service.go:146 +0x12ac
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 140 [select]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/collectd.(*Service).writePoints(0xc82008b180)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/collectd/service.go:248 +0x54c
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/collectd.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/collectd/service.go:147 +0x12d1
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 141 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/retention.(*Service).deleteShardGroups(0xc82000d1d0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/retention/service.go:69 +0x351
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/retention.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/retention/service.go:45 +0x1b4
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 142 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/retention.(*Service).deleteShards(0xc82000d1d0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/retention/service.go:102 +0x9fd
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/services/retention.(*Service).Open
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/retention/service.go:46 +0x1d9
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 143 [chan receive, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/cmd/influxd/run.(*Server).startServerReporting(0xc8201430e0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:492 +0x1ee
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/cmd/influxd/run.(*Server).Open.func1
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:420 +0x1506
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 144 [select, 3 minutes]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/cmd/influxd/run.(*Command).monitorServerErrors(0xc82007a510)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:145 +0x2c8
Nov 11 16:01:45 inf-stor-02 influxd: created by github.com/influxdb/influxdb/cmd/influxd/run.(*Command).Run
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/cmd/influxd/run/command.go:127 +0xf97
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 145 [select, 3 minutes, locked to thread]:
Nov 11 16:01:45 inf-stor-02 influxd: runtime.gopark(0xdb1208, 0xc820539f28, 0xc597a8, 0x6, 0xc820034f18, 0x2)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/proc.go:185 +0x163
Nov 11 16:01:45 inf-stor-02 influxd: runtime.selectgoImpl(0xc820539f28, 0x0, 0x18)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/select.go:392 +0xa64
Nov 11 16:01:45 inf-stor-02 influxd: runtime.selectgo(0xc820539f28)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/select.go:212 +0x12
Nov 11 16:01:45 inf-stor-02 influxd: runtime.ensureSigM.func1()
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/signal1_unix.go:227 +0x353
Nov 11 16:01:45 inf-stor-02 influxd: runtime.goexit()
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/runtime/asm_amd64.s:1696 +0x1
Nov 11 16:01:45 inf-stor-02 influxd: goroutine 262 [chan receive]:
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.(*Handler).serveQuery(0xc82008b100, 0x7f7597bc6a88, 0xc821cbfe40, 0xc8222ced20, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:287 +0xc2c
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.(*Handler).(github.com/influxdb/influxdb/services/httpd.serveQuery)-fm(0x7f7597bc6a88, 0xc821cbfe40, 0xc8222ced20, 0x0)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:99 +0x48
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.authenticate.func1(0x7f7597bc6a88, 0xc821cbfe40, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:697 +0x70
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168be0, 0x7f7597bc6a88, 0xc821cbfe40, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.gzipFilter.func1(0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:758 +0x2af
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168c00, 0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.versionHeader.func1(0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:767 +0xc0
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168c20, 0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.cors.func1(0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:800 +0x328
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168c40, 0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.requestID.func1(0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:810 +0x15d
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168c60, 0x7f7597bc69b0, 0xc821cbfe00, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.logging.func1(0x7f7597bc69b0, 0xc821cbfde0, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:818 +0x10b
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168c80, 0x7f7597bc69b0, 0xc821cbfde0, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:45 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.recovery.func1(0x7f7597bc6978, 0xc8200ca210, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:837 +0x168
Nov 11 16:01:45 inf-stor-02 influxd: net/http.HandlerFunc.ServeHTTP(0xc820168ca0, 0x7f7597bc6978, 0xc8200ca210, 0xc8222ced20)
Nov 11 16:01:45 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1422 +0x3a
Nov 11 16:01:46 inf-stor-02 influxd: github.com/bmizerany/pat.(*PatternServeMux).ServeHTTP(0xc8200280b0, 0x7f7597bc6978, 0xc8200ca210, 0xc8222ced20)
Nov 11 16:01:46 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/bmizerany/pat/mux.go:109 +0x244
Nov 11 16:01:46 inf-stor-02 influxd: github.com/influxdb/influxdb/services/httpd.(*Handler).ServeHTTP(0xc82008b100, 0x7f7597bc6978, 0xc8200ca210, 0xc8222ced20)
Nov 11 16:01:46 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/services/httpd/handler.go:173 +0x357
Nov 11 16:01:46 inf-stor-02 influxd: net/http.serverHandler.ServeHTTP(0xc824efd2c0, 0x7f7597bc6978, 0xc8200ca210, 0xc8222ced20)
Nov 11 16:01:46 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1862 +0x19e
Nov 11 16:01:46 inf-stor-02 influxd: net/http.(*conn).serve(0xc8200ca000)
Nov 11 16:01:46 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1361 +0xbee
Nov 11 16:01:46 inf-stor-02 influxd: created by net/http.(*Server).Serve
Nov 11 16:01:46 inf-stor-02 influxd: /root/.gvm/gos/go1.5.1/src/net/http/server.go:1910 +0x3f6
Nov 11 16:01:46 inf-stor-02 influxd: goroutine 263 [chan receive]:
Nov 11 16:01:46 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*QueryExecutor).executeStatement(0xc820055030, 0x0, 0x7f7597bc6dc8, 0xc823676000, 0xc8222cf18e, 0x4, 0xc82304fc80, 0x2710, 0x0, 0x0)
Nov 11 16:01:46 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/query_executor.go:713 +0x14a
Nov 11 16:01:46 inf-stor-02 influxd: github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery.func1(0xc821cbffe0, 0xc8222cf18e, 0x4, 0xc820055030, 0xc82304fc80, 0x2710)
Nov 11 16:01:46 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/query_executor.go:173 +0x933
Nov 11 16:01:46 inf-stor-02 influxd: created by github.com/influxdb/influxdb/tsdb.(*QueryExecutor).ExecuteQuery
Nov 11 16:01:46 inf-stor-02 influxd: /tmp/tmp.hviQS4L7E4/src/github.com/influxdb/influxdb/tsdb/query_executor.go:230 +0x9b
Nov 11 16:01:46 inf-stor-02 systemd: influxdb.service: main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 11 16:01:46 inf-stor-02 systemd: Unit influxdb.service entered failed state.
Nov 11 16:01:46 inf-stor-02 systemd: influxdb.service holdoff time over, scheduling restart.
Nov 11 16:01:46 inf-stor-02 systemd: Stopping InfluxDB is an open-source, distributed, time series database...
Nov 11 16:01:46 inf-stor-02 systemd: Starting InfluxDB is an open-source, distributed, time series database...
@enigmapsi
Copy link
Author

Update: I've tried both engines, bz1 and tsm1, the same effect.

@beckettsean
Copy link
Contributor

The ports close because the process crashes. The specific query is causing a panic and bringing down the process.

It's a known (ugly) bug with math on multiple fields: #4046

Closing as duplicate.

@bthesorceror bthesorceror mentioned this issue Sep 19, 2019
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@enigmapsi @beckettsean