How to simulate clicks on a JS pager?

[cl3rO3Y]

Hello !

I want to crawl list pages handled by a JS pager.

Is there a way with Roach PHP to simulate the click to a given page and crawl the received html code?


I’ve read the doc https://roach-php.dev/docs/downloader-middleware/#executing-javascript and installed the required libraries but I don’t understand how to make things work.

I’ve tried something like this in initialRequests():

        $url = Browsershot::url('https://example.com')->click('#selector1’);
        $to_return[] = new Request(
            'GET',
            $url,
            [$this, 'parse']
        );

But obviously, I get an error
RoachPHP\Http\Request::__construct(): Argument #2 ($uri) must be of type string, Spatie\Browsershot\Browsershot given
As Roach needs a string and Browsershot is giving me a Browsershot object.

Would someone be kind to provide a working example?

Thanks