Improving Test score using DIN SQL

[goyalpramod]

Spider Is topped by DIN-SQL two aspects have not been explored in the mentioned model namely. DB content used and DSP. Implementation of the mentioned features in DIN-SQL may present substantial improvement in the test score.

Colab Notebook. This is the current Notebook in which the work is being pursued.

[goyalpramod]

Current progress:

• A breakdown of the DIN SQL model has been prepared and added to the notebook
• Literature review of the DIN SQL paper has been made & a PR will be made soon to add the information

Problems encountered:

• The model can not be shifted to gpt 3.5 to reduce the cost and time as tokens become the bottleneck
• Cannot figure out how "db content used", can be used in this model.

Scope of Improvement:

• The DIN SQL model does not have prompts for extra hard questions, they need to be framed and added specifically to the model
• Ways to add DSP need to be explored

Papers:
Link The following paper talks about QA on knowledge database, This can be useful to understand how to implement DSP on DIN SQL (Nothing of substance was found)