Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload of small historical csv times out #696

Open
SRGDamia1 opened this issue Jan 24, 2024 · 1 comment
Open

Upload of small historical csv times out #696

SRGDamia1 opened this issue Jan 24, 2024 · 1 comment

Comments

@SRGDamia1
Copy link
Member

Attempting to upload a CSV with approximately 4300 lines of data leads to a time-out after 5 minutes. The data in the file is from 8/18/23 to 9/2/23 at SHVC2S. Everything in the CSV appears to be correctly formatted and I'm getting no errors other than the timeout. Is this a problem with the CSV upload itself or is it related to compressing and decompressing chunks to insert historical data?

@tpwrules
Copy link

tpwrules commented Jan 24, 2024

This is likely due to database access inefficiencies. I was able to make this over 90 times faster on my setup using the code here. I don't recall if that's a complete fix that 100% preserves site functionality however, but I believe that commit is for this specific problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants