Skip to content

Commit

Permalink
Update data extract prompts (#156)
Browse files Browse the repository at this point in the history
Signed-off-by: Sean Sundberg <[email protected]>
  • Loading branch information
seansund authored Nov 9, 2023
1 parent 93c0f2a commit dd98eca
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 20 deletions.
20 changes: 10 additions & 10 deletions config/KYCDataValidationQuestions.csv
Original file line number Diff line number Diff line change
@@ -1,21 +1,21 @@
ID,Question,Source,Model,Token,PoCScope,Company,Prompt,Expected Answer,Cosine Prompt
1,What is name and trading name of the organization?,Discovery,meta-llama/llama-2-70b-chat,20,,,"From the below text, what is name and trading name of the organization #?",,"What is name and trading name of #?"
2,What is the registered address of the company?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"From the below text, find the Registered address of the Company # ?","1 St James's Square, London, SW1Y 4PD","What is the Registered office address of company # ?"
3,What is the business/trading address of the company?,Discovery,google/flan-t5-xxl,20,,,"From the below text, what is the business / trading address of the company #?",,"What is the business / trading address of #?"
4,What is identification number of the organization?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,From the below text find identification number of the organization #?,102498,
1,What is name and trading name of the organization?,Discovery,meta-llama/llama-2-70b-chat,20,X,,"From below text, what is name and trading name of the organization #?",,"What is name and trading name of #?"
2,What is the registered address of the company?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"From below text, find the Registered address of the Company # ?","1 St James's Square, London, SW1Y 4PD","What is the Registered office address of company # ?"
3,What is the business/trading address of the company?,Discovery,google/flan-t5-xxl,20,,,"From below text, what is the business / trading address of the company #?",,"What is the business / trading address of #?"
4,What is identification number of the organization?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,from below text find identification number of the organization #?,102498,
5,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
6,Names all the active directors of the company.,KYCSummary,meta-llama/llama-2-70b-chat,30,X,BP P.L.C,"from below text, find the names of all active directors of the company # in sequence ?","LUND, Helge BLANC, Amanda Jayne DALEY, Pamela",
7,"What is the status of the organization ex; active, dissolved?",Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, what is the status of the organization # ex: Active or Dissolved ?",Active,
8,What is the year of incorporation?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, What is the year of incorporation of the company #?",1909,
8,What is the year of incorporation?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, What is the year of incorporation of the company #? if there is no answer then reepond as No content avilable",1909,"What is the year of incorporation of company #?"
9,Who are the shareholders of the company along with the percentage of ownership?,Discovery,google/flan-t5-xxl,20,,,"from below text, Who are the shareholders of the company # along with the percentage of ownership?",,
10,Who is the ultimate owner of the company?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who is the ultimate owner of the company #?",,
11,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
12,What is the industry type/SIC/NICS code of the company?,KYCSummary,google/flan-t5-xxl,20,,,"from below text, What is the industry type/SIC/NICS code of the company #?",,
11,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
12,What is the industry type/SIC/NICS code of the company?,KYCSummary,google/flan-t5-xxl,20,X,,"from below text, What is the industry type/SIC/NICS code of the company #?",,"What is the industry type/SIC/NICS code of the company #?"
13,What are the products utilized by the company?,KYCSummary,google/flan-ul2,20,X,,"from below text, What are the products manufactured by the company #?",,
14,What is/are operation location/s or jurisdiction/s?,Discovery,google/flan-t5-xxl,20,,,"from below text, What is/are operation location/s or jurisdiction/s of the company #?",,
15,Number of employees of the firm,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, find the Number of employees of the company #?",,
14,What is/are operation location/s or jurisdiction/s?,Discovery,google/flan-t5-xxl,20,,,"from below text, What is/are operation location/s or jurisdiction/s of the comoany #?",,
15,Number of employees of the firm,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, find the Number of employees of the company #?",,
16,Name of the subsidiary of the company,Discovery,google/flan-t5-xxl,20,,,"from below text, find the Name of the subsidiary of the company #?",,
17,What is the Legal entity Type of the organization ex; publicly traded/limited liability etc.,Discovery,google/flan-t5-xxl,30,X,,"from below text, What is the Legal entity Type of the organization # ex; Public limited or publicly traded or limited liability or Private limited? etc.",,
18,What is the turnover or revenue of the organization?,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, find the turnover or revenue of the organization #?",,
19,Certificate/licence issued by the government.,Discovery,google/flan-t5-xxl,20,,,"from below text, What is the Certificate/licence issued by the government for company #?",,
20,Whats is the next date of confirmation statement?,Discovery,google/flan-t5-xxl,30,X,BP P.L.C,"from below text, find the next date of confirmation statement for company #?",30/06/24,
20,Whats is the next date of confirmation statement?,Discovery,google/flan-t5-xxl,30,X,BP P.L.C,"from below text, find the next date of confirmation statement for company #?",30/06/24,"Whats is the next date of confirmation statement of $?"
20 changes: 10 additions & 10 deletions src/services/data-extraction/data-extraction.csv.ts
Original file line number Diff line number Diff line change
Expand Up @@ -7,26 +7,26 @@ import {DataExtractionQuestionModel, DataExtractionResultModel} from "../../mode
import {first, parseCsv} from "../../utils";

const csvFile: string = `ID,Question,Source,Model,Token,PoCScope,Company,Prompt,Expected Answer,Cosine Prompt
1,What is name and trading name of the organization?,Discovery,meta-llama/llama-2-70b-chat,20,,,"From the below text, what is name and trading name of the organization #?",,"What is name and trading name of #?"
2,What is the registered address of the company?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"From the below text, find the Registered address of the Company # ?","1 St James's Square, London, SW1Y 4PD","What is the Registered office address of company # ?"
3,What is the business/trading address of the company?,Discovery,google/flan-t5-xxl,20,,,"From the below text, what is the business / trading address of the company #?",,"What is the business / trading address of #?"
4,What is identification number of the organization?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,From the below text find identification number of the organization #?,102498,
1,What is name and trading name of the organization?,Discovery,meta-llama/llama-2-70b-chat,20,X,,"From below text, what is name and trading name of the organization #?",,"What is name and trading name of #?"
2,What is the registered address of the company?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"From below text, find the Registered address of the Company # ?","1 St James's Square, London, SW1Y 4PD","What is the Registered office address of company # ?"
3,What is the business/trading address of the company?,Discovery,google/flan-t5-xxl,20,,,"From below text, what is the business / trading address of the company #?",,"What is the business / trading address of #?"
4,What is identification number of the organization?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,from below text find identification number of the organization #?,102498,
5,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
6,Names all the active directors of the company.,KYCSummary,meta-llama/llama-2-70b-chat,30,X,BP P.L.C,"from below text, find the names of all active directors of the company # in sequence ?","LUND, Helge BLANC, Amanda Jayne DALEY, Pamela",
7,"What is the status of the organization ex; active, dissolved?",Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, what is the status of the organization # ex: Active or Dissolved ?",Active,
8,What is the year of incorporation?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, What is the year of incorporation of the company #?",1909,
8,What is the year of incorporation?,Discovery,google/flan-t5-xxl,20,X,BP P.L.C,"from below text, What is the year of incorporation of the company #? if there is no answer then reepond as No content avilable",1909,"What is the year of incorporation of company #?"
9,Who are the shareholders of the company along with the percentage of ownership?,Discovery,google/flan-t5-xxl,20,,,"from below text, Who are the shareholders of the company # along with the percentage of ownership?",,
10,Who is the ultimate owner of the company?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who is the ultimate owner of the company #?",,
11,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
12,What is the industry type/SIC/NICS code of the company?,KYCSummary,google/flan-t5-xxl,20,,,"from below text, What is the industry type/SIC/NICS code of the company #?",,
11,Who are the key controllers and authorized signatories?,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, Who are the key controllers and authorized signatories of the company #?",,
12,What is the industry type/SIC/NICS code of the company?,KYCSummary,google/flan-t5-xxl,20,X,,"from below text, What is the industry type/SIC/NICS code of the company #?",,"What is the industry type/SIC/NICS code of the company #?"
13,What are the products utilized by the company?,KYCSummary,google/flan-ul2,20,X,,"from below text, What are the products manufactured by the company #?",,
14,What is/are operation location/s or jurisdiction/s?,Discovery,google/flan-t5-xxl,20,,,"from below text, What is/are operation location/s or jurisdiction/s of the company #?",,
15,Number of employees of the firm,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, find the Number of employees of the company #?",,
14,What is/are operation location/s or jurisdiction/s?,Discovery,google/flan-t5-xxl,20,,,"from below text, What is/are operation location/s or jurisdiction/s of the comoany #?",,
15,Number of employees of the firm,KYCSummary,meta-llama/llama-2-70b-chat,30,,,"from below text, find the Number of employees of the company #?",,
16,Name of the subsidiary of the company,Discovery,google/flan-t5-xxl,20,,,"from below text, find the Name of the subsidiary of the company #?",,
17,What is the Legal entity Type of the organization ex; publicly traded/limited liability etc.,Discovery,google/flan-t5-xxl,30,X,,"from below text, What is the Legal entity Type of the organization # ex; Public limited or publicly traded or limited liability or Private limited? etc.",,
18,What is the turnover or revenue of the organization?,KYCSummary,meta-llama/llama-2-70b-chat,30,X,,"from below text, find the turnover or revenue of the organization #?",,
19,Certificate/licence issued by the government.,Discovery,google/flan-t5-xxl,20,,,"from below text, What is the Certificate/licence issued by the government for company #?",,
20,Whats is the next date of confirmation statement?,Discovery,google/flan-t5-xxl,30,X,BP P.L.C,"from below text, find the next date of confirmation statement for company #?",30/06/24,`
20,Whats is the next date of confirmation statement?,Discovery,google/flan-t5-xxl,30,X,BP P.L.C,"from below text, find the next date of confirmation statement for company #?",30/06/24,"Whats is the next date of confirmation statement of $?"`

export interface DataExtractionConfig extends DataExtractionQuestionModel {
source: string;
Expand Down

0 comments on commit dd98eca

Please sign in to comment.