Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crashes with lots of small file -- too many open files #66

Open
drmikecrowe opened this issue Apr 14, 2019 · 0 comments
Open

Crashes with lots of small file -- too many open files #66

drmikecrowe opened this issue Apr 14, 2019 · 0 comments

Comments

@drmikecrowe
Copy link

Trying to run a bunch of small tasks in parallel (trying 12x once)

Error:

Line: 193 ash /hFile: /home/wagoodman/go/src/github.com/wagoodman/bashful/screen.go s/leftcenter/the-forward/the-forward-all.html                                                                                  
 fork/exec /bin/stty: too many open files                                                                                                                                          Runtime[00:01:22] ETA[00:-1:-22]
&{0xc4200a0060} Unable to determine screen width.

yml file is built from a list:

config:
    max-parallel-commands: 12
tasks:

  - name: Download 1 of 227
    parallel-tasks:
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]

  - name: Download 2 of 227
    parallel-tasks:
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
      - cmd: bash inner-find-domain.sh [a local path]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant