fatal error: concurrent map writes

[fpytloun]

Detailed Description

Creating or updating a lot of publishes over aptly-api can sometimes result in fatal error: concurrent map writes exception.

Full traceback:

aptly_api.1.p1pwmtu984v3@cz7110    | fatal error: concurrent map writes
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1522 [running]:
aptly_api.1.p1pwmtu984v3@cz7110    | runtime.throw(0xcbad03, 0x15)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/panic.go:605 +0x95 fp=0xc4238613d0 sp=0xc4238613b0 pc=0x42a4b5
aptly_api.1.p1pwmtu984v3@cz7110    | runtime.mapassign_faststr(0xbc9380, 0xc424ef07e0, 0xc42415aff0, 0x8, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/hashmap_fast.go:607 +0x4f5 fp=0xc423861450 sp=0xc4238613d0 pc=0x40cd15
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/deb.(*PublishedRepoCollection).LoadComplete(0xc422f34d20, 0xc428501dc0, 0xc4202b4370, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/deb/publish.go:902 +0x7fa fp=0xc423861670 sp=0xc423861450 pc=0x92c0da
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.apiPublishList.func1(0xc428501dc0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/publish.go:69 +0x65 fp=0xc4238616e0 sp=0xc423861670 pc=0xacf615
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/deb.(*PublishedRepoCollection).ForEach(0xc422f34d20, 0xc423861780, 0xc4, 0xc4200a1c00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/deb/publish.go:1012 +0x7c fp=0xc423861720 sp=0xc4238616e0 pc=0x92cfec
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.apiPublishList(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/publish.go:68 +0x1ca fp=0xc4238617c0 sp=0xc423861720 pc=0xac5f7a
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43 fp=0xc4238617e0 sp=0xc4238617c0 pc=0x7d41d3
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.Router.func1(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/router.go:47 +0x125 fp=0xc423861860 sp=0xc4238617e0 pc=0xacfb45
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43 fp=0xc423861880 sp=0xc423861860 pc=0x7d41d3
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.ErrorLoggerT.func1(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/logger.go:38 +0x38 fp=0xc4238618e8 sp=0xc423861880 pc=0x7e5108
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43 fp=0xc423861908 sp=0xc4238618e8 pc=0x7d41d3
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.RecoveryWithWriter.func1(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/recovery.go:45 +0x5a fp=0xc423861938 sp=0xc423861908 pc=0x7e5e4a
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43 fp=0xc423861958 sp=0xc423861938 pc=0x7d41d3
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.LoggerWithWriter.func1(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/logger.go:79 +0xb1 fp=0xc423861bb8 sp=0xc423861958 pc=0x7e5261
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43 fp=0xc423861bd8 sp=0xc423861bb8 pc=0x7d41d3
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc420299e60, 0xc428648000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/gin.go:332 +0x5b4 fp=0xc423861ce0 sp=0xc423861bd8 pc=0x7dcc24
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc420299e60, 0x10fcdc0, 0xc426fcee00, 0xc420129e00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/gin.go:296 +0x16b fp=0xc423861d18 sp=0xc423861ce0 pc=0x7dc3bb
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.serverHandler.ServeHTTP(0xc4202c2b60, 0x10fcdc0, 0xc426fcee00, 0xc420129e00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2619 +0xb4 fp=0xc423861d48 sp=0xc423861d18 pc=0x6cb264
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*conn).serve(0xc420604a00, 0x10fd880, 0xc420632100)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:1801 +0x71d fp=0xc423861fc8 sp=0xc423861d48 pc=0x6c73ad
aptly_api.1.p1pwmtu984v3@cz7110    | runtime.goexit()
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc423861fd0 sp=0xc423861fc8 pc=0x458c51
aptly_api.1.p1pwmtu984v3@cz7110    | created by net/http.(*Server).Serve
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2720 +0x288
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1 [IO wait]:
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.runtime_pollWait(0x7fb5bb888f70, 0x72, 0xffffffffffffffff)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/netpoll.go:173 +0x57
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).wait(0xc420125318, 0x72, 0xc42078b800, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:85 +0xae
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).waitRead(0xc420125318, 0xffffffffffffff00, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:90 +0x3d
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*FD).Accept(0xc420125300, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_unix.go:334 +0x1e2
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*netFD).accept(0xc420125300, 0xce1d30, 0xc42078ba40, 0x40239b)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/fd_unix.go:238 +0x42
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*TCPListener).accept(0xc42000c920, 0xbb78e0, 0xc42078ba70, 0x401137)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/tcpsock_posix.go:136 +0x2e
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*TCPListener).AcceptTCP(0xc42000c920, 0xc42078bab8, 0xc42078bac0, 0xc42078bab0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/tcpsock.go:234 +0x49
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.tcpKeepAliveListener.Accept(0xc42000c920, 0xce1628, 0xc420604a00, 0x10fd940, 0xc4202dc060)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:3120 +0x2f
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*Server).Serve(0xc4202c2b60, 0x10fd280, 0xc42000c920, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2695 +0x1b2
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*Server).ListenAndServe(0xc4202c2b60, 0xc4202c2b60, 0xc4201a1c80)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2636 +0xa9
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.ListenAndServe(0xc4202ca4b0, 0x5, 0x10f49c0, 0xc420299e60, 0xc42028b8c0, 0x39)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2882 +0x7f
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/cmd.aptlyAPIServe(0xc420299b00, 0xc4201fd370, 0x0, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/cmd/api_serve.go:77 +0x256
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/smira/commander.(*Command).Dispatch(0xc420299b00, 0xc4201fd370, 0x0, 0x0, 0xc4202bfe01, 0xc4202bfe18)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/smira/commander/commands.go:305 +0x2a7
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/smira/commander.(*Command).Dispatch(0xc420299c20, 0xc4201fd370, 0x1, 0x1, 0xc420000101, 0xce1d30)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/smira/commander/commands.go:283 +0x151
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/smira/commander.(*Command).Dispatch(0xc420299d40, 0xc4201fd360, 0x2, 0x2, 0xc42029d500, 0xc4201fd360)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/smira/commander/commands.go:283 +0x151
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/cmd.Run(0xc420299d40, 0xc42000e090, 0x3, 0x3, 0xc420292101, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/cmd/run.go:41 +0x12a
aptly_api.1.p1pwmtu984v3@cz7110    | main.main()
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/main.go:24 +0x151
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 6 [syscall, 8 minutes]:
aptly_api.1.p1pwmtu984v3@cz7110    | os/signal.signal_recv(0x53dbb0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/sigqueue.go:131 +0xa6
aptly_api.1.p1pwmtu984v3@cz7110    | os/signal.loop()
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/os/signal/signal_unix.go:22 +0x22
aptly_api.1.p1pwmtu984v3@cz7110    | created by os/signal.init.0
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/os/signal/signal_unix.go:28 +0x41
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 7 [chan receive]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.acquireDatabase(0xc420092660)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/api.go:80 +0x52
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/api.Router
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/router.go:25 +0x166
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1523 [IO wait]:
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.runtime_pollWait(0x7fb5bb544e28, 0x72, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/netpoll.go:173 +0x57
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).wait(0xc426077618, 0x72, 0xffffffffffffff00, 0x10f8a40, 0x10f24f0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:85 +0xae
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).waitRead(0xc426077618, 0xc423badd00, 0x1, 0x1)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:90 +0x3d
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*FD).Read(0xc426077600, 0xc423badd81, 0x1, 0x1, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_unix.go:125 +0x18a
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*netFD).Read(0xc426077600, 0xc423badd81, 0x1, 0x1, 0xc426fd4000, 0x0, 0x10f5801)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/fd_unix.go:202 +0x52
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*conn).Read(0xc420395178, 0xc423badd81, 0x1, 0x1, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/net.go:176 +0x6d
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*connReader).backgroundRead(0xc423badd70)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:660 +0x62
aptly_api.1.p1pwmtu984v3@cz7110    | created by net/http.(*connReader).startBackgroundRead
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:656 +0xd8
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1618 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc4211ef980)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:110 +0x225
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1478 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc4231fad80)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:110 +0x225
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1604 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc4231fb680)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0x119
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:139 +0x4bd
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1607 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc4231fb680)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:751 +0x192
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:147 +0x680
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1584 [IO wait]:
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.runtime_pollWait(0x7fb5bb888d30, 0x72, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/runtime/netpoll.go:173 +0x57
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).wait(0xc4211f5718, 0x72, 0xffffffffffffff00, 0x10f8a40, 0x10f24f0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:85 +0xae
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*pollDesc).waitRead(0xc4211f5718, 0xc422f34c00, 0x1, 0x1)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_poll_runtime.go:90 +0x3d
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*FD).Read(0xc4211f5700, 0xc422f34c71, 0x1, 0x1, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_unix.go:125 +0x18a
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*netFD).Read(0xc4211f5700, 0xc422f34c71, 0x1, 0x1, 0xc423724e40, 0x1b, 0x8)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/fd_unix.go:202 +0x52
aptly_api.1.p1pwmtu984v3@cz7110    | net.(*conn).Read(0xc425735838, 0xc422f34c71, 0x1, 0x1, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/net.go:176 +0x6d
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*connReader).backgroundRead(0xc422f34c60)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:660 +0x62
aptly_api.1.p1pwmtu984v3@cz7110    | created by net/http.(*connReader).startBackgroundRead
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:656 +0xd8
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1503 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc420db7b00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:110 +0x225
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1586 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc4211ef200)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:110 +0x225
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1583 [runnable]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*blockIter).Next(0xc423abf860, 0x10fddc0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:250 +0xfb1
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*blockIter).Seek(0xc423abf860, 0xc420d7ff80, 0x2d, 0x2d, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:242 +0x2be
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).find(0xc42029f6c0, 0xc420d7ff80, 0x2d, 0x2d, 0xc42383ad01, 0x0, 0xc42383ad00, 0x0, 0x0, 0x0, ...)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:834 +0x20b
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).Find(0xc42029f6c0, 0xc420d7ff80, 0x2d, 0x2d, 0x1, 0x0, 0xc420d7ff80, 0x25, 0x2d, 0xc421d73490, ...)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:918 +0x7a
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*tOps).find(0xc4259587b0, 0xc4203c6640, 0xc420d7ff80, 0x2d, 0x2d, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.go:382 +0x15f
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*version).get.func1(0x0, 0xc4203c6640, 0xc420d7ff80)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/version.go:176 +0x477
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*version).walkOverlapping(0xc4203c7d60, 0x0, 0x0, 0x0, 0xc420d7ff80, 0x2d, 0x2d, 0xc42383b0f8, 0xc42383b0c8)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/version.go:116 +0x29b
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*version).get(0xc4203c7d60, 0x0, 0x0, 0x0, 0xc420d7ff80, 0x2d, 0x2d, 0x0, 0x0, 0x0, ...)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/version.go:160 +0x2e2
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).get(0xc4231fb680, 0x0, 0x0, 0x0, 0x0, 0xc420d7ff50, 0x25, 0x30, 0xd2b99, 0x0, ...)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:776 +0x3eb
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).Get(0xc4231fb680, 0xc420d7ff50, 0x25, 0x30, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:842 +0x163
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/database.(*levelDB).Get(0xc4201fd760, 0xc420d7ff50, 0x25, 0x30, 0x25, 0x30, 0x25, 0xce1d30, 0xc42179e1c0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/database/leveldb.go:118 +0x60
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/deb.(*SnapshotCollection).LoadComplete(0xc423e23a70, 0xc422564c60, 0x24, 0xc422564c60)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/deb/snapshot.go:233 +0xc4
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/deb.(*PublishedRepoCollection).LoadComplete(0xc422f34d20, 0xc428501ea0, 0xc4202b4370, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/deb/publish.go:897 +0x79c
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.apiPublishList.func1(0xc428501ea0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/publish.go:69 +0x65
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/deb.(*PublishedRepoCollection).ForEach(0xc422f34d20, 0xc42383b780, 0xc4, 0xc422f76700)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/deb/publish.go:1012 +0x7c
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.apiPublishList(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/publish.go:68 +0x1ca
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/api.Router.func1(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/api/router.go:47 +0x125
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.ErrorLoggerT.func1(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/logger.go:38 +0x38
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.RecoveryWithWriter.func1(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/recovery.go:45 +0x5a
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.LoggerWithWriter.func1(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/logger.go:79 +0xb1
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Context).Next(0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/context.go:104 +0x43
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc420299e60, 0xc423ba49a0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/gin.go:332 +0x5b4
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc420299e60, 0x10fcdc0, 0xc420392a80, 0xc421bb6100)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/gin-gonic/gin/gin.go:296 +0x16b
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.serverHandler.ServeHTTP(0xc4202c2b60, 0x10fcdc0, 0xc420392a80, 0xc421bb6100)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2619 +0xb4
aptly_api.1.p1pwmtu984v3@cz7110    | net/http.(*conn).serve(0xc424ee70e0, 0x10fd880, 0xc4286d6a00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:1801 +0x71d
aptly_api.1.p1pwmtu984v3@cz7110    | created by net/http.(*Server).Serve
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/net/http/server.go:2720 +0x288
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1603 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc4282c2000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x172
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x195
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1606 [runnable]:
aptly_api.1.p1pwmtu984v3@cz7110    | syscall.Syscall6(0x11, 0x12, 0xc421efac00, 0xec0, 0x1bdcfb, 0x0, 0x0, 0xec0, 0xec0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/syscall/asm_linux_amd64.s:44 +0x5
aptly_api.1.p1pwmtu984v3@cz7110    | syscall.Pread(0x12, 0xc421efac00, 0xec0, 0x1005, 0x1bdcfb, 0xc420c86f28, 0xc420db6a80, 0xce1d40)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/syscall/zsyscall_linux_amd64.go:1335 +0x77
aptly_api.1.p1pwmtu984v3@cz7110    | internal/poll.(*FD).Pread(0xc4214480f0, 0xc421efac00, 0xec0, 0x1005, 0x1bdcfb, 0xc42030b7d0, 0xc420c86fb8, 0x429726)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/internal/poll/fd_unix.go:146 +0x9c
aptly_api.1.p1pwmtu984v3@cz7110    | os.(*File).pread(0xc425a50320, 0xc421efac00, 0xec0, 0x1005, 0x1bdcfb, 0xc42003e000, 0xc420c87048, 0x429448)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/os/file_unix.go:225 +0x58
aptly_api.1.p1pwmtu984v3@cz7110    | os.(*File).ReadAt(0xc425a50320, 0xc421efac00, 0xec0, 0x1005, 0x1bdcfb, 0x0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /usr/local/Cellar/go/1.9/libexec/src/os/file.go:121 +0xfd
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).readRawBlock(0xc42029f790, 0x1bdcfb, 0xebb, 0x1, 0x612237e500000369, 0x48, 0x70, 0xc420c871f8, 0xc420c87210)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:564 +0xb5
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).readBlock(0xc42029f790, 0x1bdcfb, 0xebb, 0x1, 0xc420c87278, 0x4118cc, 0xc4252e0480)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:603 +0x5b
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).readBlockCached(0xc42029f790, 0x1bdcfb, 0xebb, 0xc420c80001, 0x428d89, 0xc400000008, 0xc4286d6100, 0xc4285ccd5f, 0x8497bb)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:648 +0x26e
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).getDataIter(0xc42029f790, 0x1bdcfb, 0xebb, 0x0, 0x1, 0x188f, 0xebb)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:765 +0x5e
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*Reader).getDataIterErr(0xc42029f790, 0x1bdcfb, 0xebb, 0x0, 0x1, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:780 +0x14d
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table.(*indexIter).Get(0xc421192f60, 0xc425974000, 0xc4217b63c0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/table/reader.go:507 +0x2ed
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator.(*indexedIterator).setData(0xc4252e0a80)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator/indexed_iter.go:39 +0x4e
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator.(*indexedIterator).Next(0xc4252e0a80, 0x8341d0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator/indexed_iter.go:160 +0xbd
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator.(*indexedIterator).Next(0xc4252e0a20, 0x136)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator/indexed_iter.go:149 +0x114
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator.(*mergedIterator).Next(0xc4228c0380, 0xc420e04000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/iterator/merged_iter.go:169 +0xf1
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*tableCompactionBuilder).run(0xc4200a8780, 0xc4212366a0, 0x0, 0x0)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:439 +0x31d
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).compactionTransact(0xc4231fb680, 0xcb2e11, 0xb, 0x10f9c00, 0xc4200a8780)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:185 +0x162
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tableCompaction(0xc4231fb680, 0xc420129400, 0x6431316536342000)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:577 +0x697
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tableAutoCompaction(0xc4231fb680)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:633 +0x56
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc4231fb680)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_compaction.go:824 +0x3ba
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:146 +0x65e
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1605 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc4231fb680)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:101 +0x13b
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df
aptly_api.1.p1pwmtu984v3@cz7110    |
aptly_api.1.p1pwmtu984v3@cz7110    | goroutine 1627 [select]:
aptly_api.1.p1pwmtu984v3@cz7110    | github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc4231faf00)
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db_state.go:110 +0x225
aptly_api.1.p1pwmtu984v3@cz7110    | created by github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb.openDB
aptly_api.1.p1pwmtu984v3@cz7110    |    /Users/smira/Documents/go/src/github.com/smira/aptly/vendor/github.com/syndtr/goleveldb/leveldb/db.go:140 +0x4df

Context

Possible Implementation

Your Environment

Docker image tcpcloud/aptly-api/1.1.1-75-g9cb2a30

[fpytloun]

Found out that this is not a regression as this also happens in 1.1.1 stable.. :-(

[fpytloun]

See golang/go#20270

[smira]

@fpytloun thanks for reporting it.

It certainly highlights that there's data race in aptly

[smira]

I've found a problem, and fix is ready. I'm looking for more places with same problem. Also I wonder if we can have easy way to produce load-test for aptly (nothing really complicated, simply exercising different APIs with concurrency of 4-5 would be more than enough)

[fpytloun]

Great, is it already in latest nightly build, so I can test if it solved the issue?
I am trying to avoid concurrent access to aptly api (except for files upload which is probably the root cause here - files upload while publishing is in progress).

[smira]

@fpytloun fix should be in #688 - I'll merge that as produce nightly build if build passes

[smira]

aptly_1.2.0+2+g1aa8870 nightly build contains the fix

[fpytloun]

Good, seems this solved the issue :-)
Thank you!

[smira]

Thanks for reporting it!