<commit_before>youtube-transcription
=====================

Scripts to retrieve videos, upload them to YouTube, and retrieve the automatically-generated transcriptions. Requires you to first [register](https://developers.google.com/youtube/registering_an_application) a YouTube Data API-consuming application with Google.

## config.yaml

The scripts require a files called config.yaml (formatted like the included file config.yaml.example) containing your YouTube auth information.

## upload-videos.py

Accepts a json manifest with video URLs and metadata values. Retrieves the videos, uploads them to YouTube, and outputs a modified manifest including YouTube IDs.<commit_msg>Explain two-factor authentication password<commit_after>youtube-transcription
=====================

Scripts to retrieve videos, upload them to YouTube, and retrieve the automatically-generated transcriptions. Requires you to first [register](https://developers.google.com/youtube/registering_an_application) a YouTube Data API-consuming application with Google.

## config.yaml

The scripts require a files called config.yaml (formatted like the included file config.yaml.example) containing your YouTube auth information. Note that if your YouTube account has two-factor authentication enabled, you'll have to [generate an application-specific password](http://support.google.com/accounts/bin/answer.py?hl=en&answer=185833), rather than providing your Google account's password.

## upload-videos.py

Accepts a json manifest with video URLs and metadata values. Retrieves the videos, uploads them to YouTube, and outputs a modified manifest including YouTube IDs.
{'fraction_non_alphanumeric': 0.08698296836982969, 'fraction_numerical': 0.0036496350364963502, 'mean_word_length': 5.970338983050848, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '431856', 'n_tokens_mistral': 388, 'n_tokens_neox': 370, 'n_words': 168}