Error when flushing an existing function and then executing twice

[csegarragonz]

There is a strange bug with the flushing/caching that materialises as follows:

1. Upload func A/B with contents C
2. Execute func A/B (contents C get executed)
3. Flush
4. Upload func A/B with contents D
5. Execute func A/B (contents D get executed)
6. Execute func A/B again (contents C get executed ?!)

There is an E2E test that is currently skipped that replicates this issue.