Return error rather than panic when too many row groups are written

Return error rather than panic when too many row groups are written #4756