task_categories:text-generation language:en license:apache-2.0 region:us
---
license: apache-2.0
task_categories:
- text-generation
language:
- en
---

# Topic -> Question

This dataset consists of just under 10.5k question-topic pairs, for use as prompts in synthetic Q&A datasets. It was generated using [StableBeluga2](https://huggingface.co/stabilityai/StableBeluga2) and the prompt listed below.

## Generation

As stated above, this dataset was created using StableBeluga2. This was done by prompting the model to generate a question to fit a specific topic which were taken from Wikipedia's [Level-4 Vital Articles](https://en.wikipedia.org/wiki/Wikipedia:Vital_articles/Level/4) as well as a small amount of random articles from the [Electronics](https://en.wikipedia.org/wiki/Category:Electronics) and [Engineering](https://en.wikipedia.org/wiki/Category:Engineering) categories (not vital articles). The article names list was created using [PetScan](https://petscan.wmflabs.org/) and links to the queries are below.

The following prompt was used to generate each question: **"Drawing on your expertise regarding the topic '{topic}', create a thought-provoking question about it that goes beyond basic facts. Your question should encourage deep analysis, critical thinking, and profound understanding. Avoid a question that can be readily answered through a quick search, aiming instead for one that necessitates your expert insights."**

Here is the list of PetScan queries used to obtain the topic list (each topic was only used once):

| Category                       | All topics? |  Query Link                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
|--------------------------------|-------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| People                         | Yes         | [Link](https://petscan.wmflabs.org/?page_image=any&edits%5Bflagged%5D=both&interface_language=en&min_redlink_count=1&sparql=&show_redirects=both&sortby=none&wpiu=any&search_filter=&referrer_url=&common_wiki_other=&pagepile=&outlinks_no=&search_max_results=500&min_sitelink_count=&langs_labels_any=&cb_labels_no_l=1&output_compatability=catscan&ores_prob_from=&depth=0&sitelinks_yes=&common_wiki=auto&ns%5B0%5D=1&max_sitelink_count=&cb_labels_yes_l=1&before=&language=en&ores_prob_to=&templates_no=&labels_yes=&wikidata_prop_item_use=&cb_labels_any_l=1&labels_no=&active_tab=tab_templates_n_links&search_wiki=&ores_type=any&after=&edits%5Bbots%5D=both&sitelinks_any=&project=wikipedia&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FPeople&doit=)                                                                                              |
| History                        | Yes         | [Link](https://petscan.wmflabs.org/?referrer_name=&langs_labels_yes=&wikidata_item=no&wpiu=any&search_max_results=500&larger=&labels_yes=&namespace_conversion=keep&langs_labels_any=&show_redirects=both&cb_labels_any_l=1&cb_labels_no_l=1&ores_prob_from=&max_sitelink_count=&smaller=&show_soft_redirects=both&links_to_no=&sitelinks_any=&cb_labels_yes_l=1&after=&depth=0&templates_yes=&wikidata_prop_item_use=&edits%5Bbots%5D=both&links_to_any=&manual_list_wiki=&interface_language=en&since_rev0=&subpage_filter=either&templates_any=&ns%5B0%5D=1&active_tab=tab_templates_n_links&templates_no=&project=wikipedia&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FHistory&language=en&sortby=none&min_sitelink_count=&max_age=&min_redlink_count=1&edits%5Banons%5D=both&doit=)                                                                          |
| Geography                      | Yes         | [Link](https://petscan.wmflabs.org/?common_wiki=auto&manual_list=&edits%5Banons%5D=both&outlinks_yes=&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FGeography&sortorder=ascending&minlinks=&langs_labels_yes=&combination=subset&ores_prob_from=&negcats=&wikidata_label_language=&cb_labels_any_l=1&ns%5B0%5D=1&search_filter=&categories=&search_wiki=&format=html&sitelinks_any=&max_age=&labels_yes=&output_limit=&wikidata_item=no&cb_labels_yes_l=1&search_max_results=500&maxlinks=&cb_labels_no_l=1&active_tab=tab_templates_n_links&links_to_any=&manual_list_wiki=&after=&language=en&page_image=any&pagepile=&depth=0&max_sitelink_count=&regexp_filter=&referrer_name=&interface_language=en&project=wikipedia&output_compatability=catscan&wikidata_source_sites=&doit=)                                                                                |
| Arts                           | Yes         | [Link](https://petscan.wmflabs.org/?cb_labels_any_l=1&outlinks_yes=&depth=0&language=en&edits%5Bflagged%5D=both&referrer_name=&source_combination=&cb_labels_yes_l=1&search_max_results=500&manual_list=&ores_prob_from=&min_redlink_count=1&sitelinks_no=&sitelinks_yes=&cb_labels_no_l=1&sparql=&wikidata_label_language=&wikidata_item=no&links_to_all=&maxlinks=&outlinks_no=&wikidata_prop_item_use=&templates_yes=&project=wikipedia&active_tab=tab_templates_n_links&combination=subset&after=&wpiu=any&langs_labels_no=&interface_language=en&ores_type=any&links_to_any=&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FArts&larger=&wikidata_source_sites=&manual_list_wiki=&edits%5Bbots%5D=both&ns%5B0%5D=1&page_image=any&min_sitelink_count=&ores_prediction=any&pagepile=&doit=)                                                                       |
| Philosophy and religion        | Yes         | [Link](https://petscan.wmflabs.org/?wpiu=any&edits%5Bbots%5D=both&langs_labels_yes=&sitelinks_no=&max_sitelink_count=&sortorder=ascending&before=&outlinks_no=&language=en&labels_yes=&show_disambiguation_pages=both&regexp_filter=&show_redirects=both&project=wikipedia&depth=0&ores_prob_from=&page_image=any&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FPhilosophy_and_religion&min_sitelink_count=&labels_any=&edits%5Banons%5D=both&search_max_results=500&cb_labels_yes_l=1&cb_labels_no_l=1&ns%5B0%5D=1&sparql=&manual_list=&cb_labels_any_l=1&interface_language=en&sitelinks_any=&active_tab=tab_templates_n_links&wikidata_source_sites=&links_to_any=&templates_no=&links_to_all=&links_to_no=&ores_prediction=any&categories=&manual_list_wiki=&common_wiki=auto&doit=)                                                                             |
| Everyday life                  | Yes         | [Link](https://petscan.wmflabs.org/?templates_any=&edits%5Bbots%5D=both&templates_no=&maxlinks=&wikidata_label_language=&cb_labels_any_l=1&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FEveryday_life&edits%5Banons%5D=both&links_to_all=&ns%5B0%5D=1&larger=&search_filter=&language=en&show_disambiguation_pages=both&sitelinks_any=&langs_labels_any=&cb_labels_yes_l=1&cb_labels_no_l=1&wpiu=any&after=&project=wikipedia&sparql=&output_limit=&manual_list=&since_rev0=&langs_labels_no=&edits%5Bflagged%5D=both&wikidata_source_sites=&sitelinks_yes=&before=&combination=subset&sortorder=ascending&ores_type=any&min_redlink_count=1&referrer_url=&search_max_results=500&active_tab=tab_templates_n_links&wikidata_item=no&categories=&sortby=none&interface_language=en&doit=)                                                                            |
| Society and social sciences    | Yes         | [Link](https://petscan.wmflabs.org/?before=&labels_yes=&output_limit=&labels_no=&active_tab=tab_templates_n_links&outlinks_yes=&templates_yes=&larger=&ores_prob_to=&search_max_results=500&cb_labels_no_l=1&max_age=&templates_any=&common_wiki=auto&max_sitelink_count=&minlinks=&cb_labels_any_l=1&show_soft_redirects=both&langs_labels_any=&interface_language=en&search_wiki=&links_to_any=&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FSociety_and_social_sciences&min_sitelink_count=&ores_prob_from=&search_filter=&ns%5B0%5D=1&common_wiki_other=&sitelinks_no=&sitelinks_any=&labels_any=&wikidata_item=no&wikidata_prop_item_use=&wikidata_label_language=&links_to_all=&language=en&output_compatability=catscan&categories=&cb_labels_yes_l=1&project=wikipedia&smaller=&doit=)                                                                      |
| Biological and health sciences | Yes         | [Link](https://petscan.wmflabs.org/?common_wiki=auto&links_to_all=&common_wiki_other=&search_filter=&format=html&project=wikipedia&negcats=&interface_language=en&labels_yes=&templates_no=&show_disambiguation_pages=both&pagepile=&cb_labels_no_l=1&search_max_results=500&sitelinks_any=&wikidata_label_language=&templates_yes=&max_age=&page_image=any&cb_labels_yes_l=1&manual_list=&language=en&larger=&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FBiology_and_health_sciences&source_combination=&cb_labels_any_l=1&min_redlink_count=1&active_tab=tab_templates_n_links&show_redirects=both&show_soft_redirects=both&ores_type=any&search_wiki=&max_sitelink_count=&labels_any=&regexp_filter=&manual_list_wiki=&ores_prob_to=&ns%5B0%5D=1&edits%5Banons%5D=both&links_to_no=&links_to_any=&wikidata_prop_item_use=&doit=)                               |
| Physical sciences              | Yes         | [Link](https://petscan.wmflabs.org/?page_image=any&cb_labels_yes_l=1&sortby=none&interface_language=en&language=en&outlinks_yes=&cb_labels_any_l=1&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FPhysical_sciences&active_tab=tab_templates_n_links&sitelinks_no=&project=wikipedia&categories=&edits%5Bbots%5D=both&labels_any=&search_wiki=&cb_labels_no_l=1&show_soft_redirects=both&wikidata_item=no&depth=0&ores_prediction=any&search_query=&wikidata_label_language=&smaller=&langs_labels_yes=&edits%5Banons%5D=both&namespace_conversion=keep&show_disambiguation_pages=both&search_max_results=500&wikidata_prop_item_use=&wpiu=any&sitelinks_yes=&common_wiki=auto&show_redirects=both&langs_labels_any=&ns%5B0%5D=1&templates_any=&format=html&ores_prob_from=&min_redlink_count=1&output_compatability=catscan&ores_type=any&max_sitelink_count=&doit=) |
| Technology                     | Yes         | [Link](https://petscan.wmflabs.org/?output_limit=&since_rev0=&categories=&labels_no=&manual_list=&labels_yes=&max_age=&langs_labels_any=&referrer_name=&search_max_results=500&outlinks_no=&cb_labels_yes_l=1&edits%5Bbots%5D=both&language=en&combination=subset&wikidata_source_sites=&langs_labels_no=&referrer_url=&cb_labels_any_l=1&interface_language=en&templates_any=&ores_prob_to=&search_wiki=&show_redirects=both&ns%5B0%5D=1&sitelinks_yes=&sitelinks_no=&regexp_filter=&edits%5Banons%5D=both&active_tab=tab_templates_n_links&project=wikipedia&depth=0&negcats=&after=&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FTechnology&smaller=&show_disambiguation_pages=both&subpage_filter=either&cb_labels_no_l=1&outlinks_yes=&doit=)                                                                                                                  |
| Mathematics                    | Yes         | [Link](https://petscan.wmflabs.org/?project=wikipedia&links_to_no=&max_age=&minlinks=&combination=subset&search_max_results=500&labels_no=&sortby=none&interface_language=en&active_tab=tab_templates_n_links&wpiu=any&larger=&wikidata_prop_item_use=&since_rev0=&cb_labels_no_l=1&ns%5B0%5D=1&common_wiki=auto&labels_any=&cb_labels_any_l=1&sortorder=ascending&show_disambiguation_pages=both&show_soft_redirects=both&outlinks_any=Wikipedia%3AVital_articles%2FLevel%2F4%2FMathematics&manual_list_wiki=&wikidata_label_language=&negcats=&links_to_all=&maxlinks=&after=&cb_labels_yes_l=1&edits%5Bbots%5D=both&output_limit=&langs_labels_any=&edits%5Banons%5D=both&referrer_url=&sitelinks_any=&ores_prob_to=&subpage_filter=either&output_compatability=catscan&ores_prob_from=&language=en&edits%5Bflagged%5D=both&doit=)                                        |
| Engineering                    | **No**      | [Link](https://petscan.wmflabs.org/?format=html&regexp_filter=&since_rev0=&templates_no=&search_filter=&langs_labels_any=&min_sitelink_count=&outlinks_any=&wikidata_label_language=&show_redirects=both&links_to_no=&referrer_name=&min_redlink_count=1&langs_labels_no=&source_combination=&cb_labels_any_l=1&referrer_url=&sitelinks_yes=&ores_type=any&cb_labels_yes_l=1&cb_labels_no_l=1&ores_prob_from=&project=wikipedia&search_max_results=500&common_wiki_other=&wikidata_item=no&categories=Engineering&output_limit=&depth=2&manual_list=&interface_language=en&minlinks=&namespace_conversion=keep&subpage_filter=either&manual_list_wiki=&links_to_all=&edits%5Banons%5D=both&ns%5B0%5D=1&language=en&edits%5Bflagged%5D=both&doit=)                                                                                                                            |
| Electronics                    | **No**      | [Link](https://petscan.wmflabs.org/?links_to_any=&language=en&labels_no=&outlinks_yes=&categories=Electronics&sortorder=ascending&combination=subset&links_to_no=&labels_any=&ns%5B0%5D=1&edits%5Bbots%5D=both&outlinks_no=&format=html&templates_yes=&wikidata_prop_item_use=&cb_labels_no_l=1&langs_labels_no=&active_tab=tab_categories&ores_type=any&templates_no=&common_wiki=auto&source_combination=&search_max_results=500&ores_prediction=any&show_disambiguation_pages=both&cb_labels_any_l=1&min_redlink_count=1&project=wikipedia&referrer_name=&after=&show_redirects=both&langs_labels_any=&depth=1&cb_labels_yes_l=1&interface_language=en&ores_prob_to=&negcats=&wikidata_item=no&max_age=&langs_labels_yes=&edits%5Bflagged%5D=both&doit=)                                                                                                                  |

### Post-Processing

A small amount of post-processing was done to the models outputs. Here is a list of all modifications made:

- Strip leading and trailing whitespace (automatic)
- Filter generated questions for the following words: ["question", "expert", "sorry", "opinion"]. This was done to filter out rare instances where the model responded in way which contained stuff other than just the question, or didn't generate a question.
- Manually fixing some stray tokens (`'s` was sometimes `'S` or `'t`, years sometimes had a random character inserted in them, and other rare cases of tokens which didn't make since, even if the rest of the question was good)
