Uploading this (large?) GTFS ZIP file appears to take down the entire Heroku server

[pinecone460]

Hi. My apologies. I appear to have accidentally crashed [a portion of] your Heroku server by uploading the Seattle area combined GTFS file.

Operating system

Mac OS Big Sur 11.5, Firefox 102.0, both 64-bit

Python version

Running via the public Heroku

Problem description

I uploaded a (publicly available) GTFS file, about 22 megabytes, that combines agency data from several agencies in the Seattle area to import it into the GTFS editor. The upload failed, as did subsequent access to the site for several minutes.

Console / terminal output if any

There was some sort of (styled HTML) Heroku error, but I forget exactly what it said. It was similar or the same error in response to the ZIP and for the whole site afterward.

Expected Action

I realize that, for various reasons, some ZIP files may not be workable in this app. If, for one reason or another, the app can't take a file, it should say so and then stop trying before it crashes. If an error does occur, it shouldn't obstruct access to the site as a whole.

Details of data you are working with, if relevant

Q: Is there anything peculiar about the data you are working with, which may be causing the issue? Any extra files in the feed? Extra columns? Any mandatory columns/fields omitted?
A: The data is downloadable (in archived form, as it will change from time to time here. I downloaded it from here.

Q: What is the size of the dataset : how many lines in stops.txt, routes.txt and stop_times.txt?
A: The ZIP is about 22 megabytes. stops.txt has 12066 lines, routes.txt has 341 lines, and stop_times.txt has 1,555,981 lines.

Q: Are you starting a new feed from scratch and haven't filled in any of the other files like calendar.txt?
A: (no)

Anything else

The web app appears to be back now. There was one seemingly-successful refresh in between the initial error and when it seemed the whole site had gone down -- could have been loaded locally from my browser's cache, I'm not sure.

[answerquest]

Hi @pinecone460 , ya.. I don't think that was the right place to be trying something like that ;)
The heroku was for demo purposes - the infra behind it is : light, small, won't take in huge payloads or work with huge data, and most importantly : will purge all data and reset after a few mins. Yeah, that last one a lot of folks have missed.

Try out the docker way on your own system - it won't take long!

I think Heroku has wound down this free tier or service (or changed the terms or something) and closed my account or so by now, to add. If someone can deploy this on https://deta.space/ , that would be good