Installation and which ReactPHP package

[Drignoid]

Hi Guys, from my research ReactPHP seems what I'm looking for: a few questions. Background - I'm running a web application on Apache, MySQL 8 and PHP 7.4 with the requirement to upload csv files (1.2 million lines) and extract the data to insert into the database and facing a Gateway Timeout (I believe it's set to 2 minutes), the gateway has not received a timely response from your server error/message (or similar). This process works fine without the gateway overlay (internal url address).
Questions - How do I install without Composer (not on my server and not sure I have permission to install it), which ReactPHP package should I use (http or csv) and will the package send gateway acceptable responses? Thanks in advance.

[SimonFrings]

Hey @Drignoid thanks for bringing this up 👍

Sound like you're looking for reactphp/http, clue/reactphp-csv and friends-of-reactphp/mysql. My question here is: why don't you want to use Composer for the project installations? Composer makes it rather easy to install all project dependencies via one command instead of installing each dependency from scratch.

I don't have much information about your code base but it sounds like you're sending an http request with your csv file and then wait for the database to process the whole file before receiving a response. This means you have to wait for your response as long as it takes for the database to insert your data. This results in the Gateway Timeout you're seeing.

One way to prevent this is to send out the request containing your csv file and then receive an immediate response from the server saying something like "received data". This way you don't have to wait for the database to finish its operation.

You could also improve the behavior of inserting the data. As I already said, I don't know what your code looks like, so I can only assume how your server behaves. If you insert every single row at once from the csv file, you can improve that by gathering multiple lines on the server side and then insert the whole collection of rows instead of doing one by one. This can speed up this database process significantly 🚀

I hope this helps you progressing. If you need more input, it's definitely useful to share some more information about your use case, the error message your seeing and the behavior of your code. What do you think about this?

[Drignoid]

Hi Simon
Thanks very much for your insight. I don't know if I have access to install composer - I hear what you're saying, I will make enquiries on my ability and access and install to the server.

My code is uploading the file (a parts price list and uploads fine), grabs each line checks whether the same price last update exists (to create history of changes) and skips it if it's the same inserts if different price. So, I think I need to go line by line, unfortunately.

Thanks again.

[WyriHaximus]

@Drignoid You can also do the composer install locally (make sure you configure your platform to match your server PHP version) and upload those files.

[Drignoid]

Thanks WyriHaximus, I am reaching out to my server admins to find out the situation and await their response.

[Drignoid]

@WyriHaximus, I have found that I can install Composer. I have 5 web sites running on the server and each need to consume reactPHP - I assume I need to install Composer Globally. Which version of react should I install - the requirement is much the same i.e. upload a csv and then insert the content into the db? Thanks for your guidance :)

[WyriHaximus]

@Drignoid The latest version of reactphp, https://packagist.org/packages/clue/reactphp-csv, and https://github.com/friends-of-reactphp/mysql