initial script for automating the creation of a controlled testing en…

[Aya-AlJafari]

No description provided.

[reuben]

unused?

[reuben]

I guess this shouldn't be hardcoded? Or is it meant as a development tool, so you iterate on the parts as you get them working?

[reuben]

Suggested change

	# Extract corpus unique vocabularies
	# Extract corpus vocabulary (unique words)

[reuben]

Suggested change

	# Pick the least frequent 10% vocabularies to represent OOVs
	# Pick the least frequent 10% words to build OOV set

[reuben]

use wc -l to communicate intent earlier.

Suggested change

	oov_count=$(wc tmp/vocab.txt | awk '{print int($0*0.1)}')
	oov_count=$(wc -l tmp/vocab.txt | awk '{print int($0*0.1)}')

[reuben]

Size of OOV set should be a parameter (with default).

[reuben]

This sed command doesn't work on macOS:

sed: 1: "1 i\wav_filename,wav_fi ...": extra characters after \ at the end of i command

Can we make it portable to BSD sed? This fix worked for me:

Suggested change

	grep -wFf tmp/oov_sents $data | sed '1 i\wav_filename,wav_filesize,transcript' > tmp/oov_corpus.csv
	echo "wav_filename,wav_filesize,transcript" > tmp/oov_corpus.csv
	grep -wFf tmp/oov_sents $data >> tmp/oov_corpus.csv

[reuben]

Suggested change

	echo "Step 2: Generaing Language Model"
	echo "Step 2: Generating Language Model"

[reuben]

Suggested change

	# Prepare OOV csv for testing purposes (to assess imporvements on it)
	# Prepare OOV CSV for testing purposes (to assess improvements on it)

[reuben]

Checkpoint path should be made into a parameter.

[reuben]

The native_client/kenlm.scorer should be kenlm.scorer, according to the command in the step above, right? And that should probably be changed to tmp/kenlm.scorer to keep all the outputs of the script contained to that folder.