Detecting page breaks in markdown output

[AdityaMannu1709]

Is there any way to detect page breaks in markdown output of a PDF?
For example, in PyMuPDF4LLM library 'n\n-----\n\n' were used in markdown output to detect page breaks.....Can see one of that output below -

[dolfim-ibm]

This is an interesting feature request. Let us put it in the pipeline after the upcoming release.
We are already using comments <!-- --> for tagging images. I think we could easily do the same to signal page breaks. And potentially, having the user specifying the preferred placeholder for it.

[AdityaMannu1709]

yes it would be great then

[AdityaMannu1709]

Just a more adding to this feature request , just like doctags if its possible to identify code tags, table and images captions in markdown also bcz currently they are part of normal markdown text flow.

[laxas]

It would be usefull to have the page number in that "page break comment".

[rmenziejr]

I manually did this by looking at the page elements count and exporting to markdown from the beginning to end of each page element. you could probably implement this more elegantly on the backend but here is example:

from itertools import accumulate
...
result = converter.convert()
page_element_count = [1+len(i.assembled.elements) for i in result.pages]
element_page_cutoff = list(accumulate([1] + page_element_count))
pages = [
        (
            result
            .document
            .export_to_markdown(
                from_element=s,
                to_element=e
            )
        )  
        for s,e in zip(element_page_cutoff[:-1], element_page_cutoff[1:])
]
full_text = print("\n\n<!-- new page -->\n\n".join(pages))

[rmenziejr]

from itertools import accumulate
...
result = converter.convert()
page_element_count = [1+len(i.assembled.elements) for i in result.pages]
element_page_cutoff = list(accumulate([1] + page_element_count))
pages = [
(
result
.document
.export_to_markdown(
from_element=s,
to_element=e
)
)
for s,e in zip(element_page_cutoff[:-1], element_page_cutoff[1:])
]
full_text = print("\n\n\n\n".join(pages))