The lazily constructed segment map made reads race once far pointers are
involved.  This shouldn't slow down most applications, since the segment
map is only used when calling Segment() or allocating new objects.