Only keep collecting line comments if they are not separate by a new line

[nojaf]

Fixes #920

I'm open to suggestions when it comes to using that mutable.
Had no immediate idea of how to do it without it.

[knocte]

I'm open to suggestions when it comes to using that mutable.

Use List.fold instead of List.takeWhile?

[nojaf]

@knocte

rest
|> List.takeWhile

rest in this case are the remaining tokens of the entire file.
Doing a List.fold followed by a filter would go over way to many tokens.

[jindraivanek]

I'm open to suggestions when it comes to using that mutable.

Something like

Seq.zip rest (headToken::rest |> List.map (fun x -> x.LineNumber)) 
|> Seq.takeWhile (fun (t, currentLineNumber) -> ...)

[nojaf]

@jindraivanek thanks, I'll try it.

[nojaf]

@jindraivanek ready for review.