Prompt template for finetuning Mistral or Llama 2 model for RAFT

[dhirajkiran007]

Question: The Oberoi family is part of a hotel company that has a head office in what
city?
context: [The Oberoi family is an Indian family that is famous for its involvement in
hotels, namely through The Oberoi Group]...[It is located in city center of Jakarta,
near Mega Kuningan, adjacent to the sister JW Marriott Hotel. It is operated by The
Ritz-Carlton Hotel Company. The complex has two towers that comprises a hotel and the
Airlangga Apartment respectively]...[The Oberoi Group is a hotel company with its head
office in Delhi.]
Instruction: Given the question, context and answer above, provide a logical reasoning
for that answer. Please use the format of: ##Reason: {reason} ##Answer: {answer}.

CoT Answer: ##Reason: The document ##begin_quote## The Oberoi family is an Indian
family that is famous for its involvement in hotels, namely through The Oberoi Group.
##end_quote## establishes that the Oberoi family is involved in the Oberoi group, and
the document ##begin_quote## The Oberoi Group is a hotel company with its head office
in Delhi. ##end_quote## establishes the head office of The Oberoi Group. Therefore,
the Oberoi family is part of a hotel company whose head office is in Delhi. ##Answer:
Delhi

For above sample how will the input sample look like, does it look like below

[INST] Question: The Oberoi family is part of a hotel company that has a head office in what
city?
context: [The Oberoi family is an Indian family that is famous for its involvement in
hotels, namely through The Oberoi Group]...[It is located in city center of Jakarta,
near Mega Kuningan, adjacent to the sister JW Marriott Hotel. It is operated by The
Ritz-Carlton Hotel Company. The complex has two towers that comprises a hotel and the
Airlangga Apartment respectively]...[The Oberoi Group is a hotel company with its head
office in Delhi.]
Instruction: Given the question, context and answer above, provide a logical reasoning
for that answer. Please use the format of: ##Reason: {reason} ##Answer: {answer}. [/INST]CoT Answer: ##Reason: The document ##begin_quote## The Oberoi family is an Indian
family that is famous for its involvement in hotels, namely through The Oberoi Group.
##end_quote## establishes that the Oberoi family is involved in the Oberoi group, and
the document ##begin_quote## The Oberoi Group is a hotel company with its head office
in Delhi. ##end_quote## establishes the head office of The Oberoi Group. Therefore,
the Oberoi family is part of a hotel company whose head office is in Delhi. ##Answer:
Delhi