upload_file: user-supplied delimiter to pass to messytables?

[dhalperi]

Right now, it looks like the messytables.any_tableset function does not do what we want, i.e., it won't parse testdata/TwitterK-noheader.hive. The user should be able to pass a delimiter on the command-line, however there is not currently a way to pass that delimiter to any_tableset.

For testdata/TwitterK-noheader.hive:

% python bin/upload_file testdata/TwitterK-noheader.hive --relation test
Traceback (most recent call last):
  File "bin/upload_file", line 5, in <module>
    upload_file.main(sys.argv[1:])
  File "build/bdist.macosx-10.9-x86_64/egg/myria/cmd/upload_file.py", line 147, in main
  File "/Users/dhalperi/Envs/myria-python/lib/python2.7/site-packages/messytables/any.py", line 148, in any_tableset
    raise messytables.ReadError('any: \n'.join(error))
messytables.error.ReadError: Did not recognise detected MIME type: "application/octet-stream".

[domoritz]

What specifically does not behave as we want? Do we want to override the delimiter guessing because it is wrong?

[dhalperi]

It does not take a delimiter option that can be passed on to, e.g., CSVTableSet.

[dhalperi]

The particular use case is that it won't parse testdata/TwitterK-noheader.hive