How to evaluate a Seq2Seq model ?

[mellahysf]

Hi,

I have built a se2seq model that takes the question and generates the SQL query directly.

My question is how to evaluate my model since the predictions are in sequence format ("select .... from ... where...")?

It's very urgent, please.

Thanks

[jaytimbadia]

Hi @mellahysf
How can one train on a custom SQLite file or database?
Can you please provide the steps or can share your training script if possible?

Thank you!

[Timothyxxx]

Hi~A simple solution is to use the evaluation from Spider dataset https://github.com/taoyds/spider which has great written parser to formulate the sql. Otherwise, since the formulation of WikiSQL is quiet simple, you can just write a parser for you generated SQL.