<commit_before><%inherit file="base.mako"/>
<%def name="title()">FAQ</%def>

<%def name="stylesheets()">
    <link rel="stylesheet" href="/static/css/pages/getting-started-page.css">
</%def>

<%def name="content()">
<div class="nav-rows container">
    <div class="row">
        <div class="col-sm-4 col-md-3 nav-list-spy">
            <div data-spy="affix" class="gs-sidebar hidden-print hidden-xs panel panel-default" role="complementary">
                <ul class="nav nav-stacked nav-pills gs-sidenav" style="min-width: 210px">
                    <li><a class="active" href="#about">About</a></li>
                    <li><a href="#using">Using the OSF</a></li>
                    <li><a href="#security">Privacy and Security</a></li>
                    <li><a href="#common">Common Issues</a></li>
                </ul>
            </div>
        </div>


        <div class="col-sm-8 col-md-9 p-l-md">
            <div>
                <h1 class="text-center">Frequently Asked Questions</h1>
            </div>

            <div id="about" class="anchor row">
                <h2 class="text-center">About</h2>
                    <h4 class="m-t-lg f-w-lg">How much does the OSF service cost?</h4>
                        <p>It's free!</p>

                    <h4 class="m-t-lg f-w-lg">How can it be free? How are you funded?</h4>
                        <p>The OSF is maintained and developed by the <a href="http://cos.io">Center for Open Science</a> (COS), a non-profit organization. COS is supported through grants from a variety of supporters, including <a href="http://centerforopenscience.org/about_sponsors/"> federal agencies, private foundations, and commercial entities</a>.</p>
                    
                    <h4 class="m-t-lg f-w-lg">What if you run out of funding? What happens to my data?</h4>
                        <p>Data stored on the OSF is backed by a $250,000 preservation fund that will provide for persistence of your data, even if the Center for Open Science runs out of funding. The code base for the OSF is entirely <a href="https://github.com/CenterForOpenScience/osf.io">open source</a>, which enables other groups to continue maintaining and expanding it if we aren’t able to.</p>

                    <h4 class="m-t-lg f-w-lg">How will the OSF be useful to my research?</h4>
                        <p>The OSF integrates with the scientist's daily workflow. The OSF helps document and archive study designs, materials, and data. The OSF facilitates sharing of materials and data within a laboratory or across laboratories. The OSF also facilitates transparency of laboratory research and provides a network design that details and credits individual contributions for all aspects of the research process. To see how it works, watch our short <a href="/getting-started">Getting Started</a> videos, see the <a href="/4znZP/wiki/home">OSF Features</a> page, or see how other scientists <a href="/svje2/">use the OSF.</a></p>

                    <h4 class="m-t-lg f-w-lg">How can I help develop the OSF?</h4>
                        <p>If you are a developer, check out the source code for the OSF <a href="https://github.com/CenterForOpenScience/osf.io">on GitHub</a>.
                        The <a href="https://github.com/CenterForOpenScience/osf.io/issues">issue tracker</a> is a good place to find ways to help. For more information, send an email to <a
                        href="mailto:<EMAIL>"><EMAIL></a>.</p>


                    <h4 class="m-t-lg f-w-lg">What is coming to the OSF?</h4>
                        <p>For updates on new features, you can join our <a href="https://groups.google.com/forum/#!forum/openscienceframework">Google
                        Group</a>, find us on <a href="https://twitter.com/osframework">Twitter</a> and on <a href="https://www.facebook.com/OpenScienceFramework">Facebook</a>, or follow the COS <a href="https://github.com/centerforopenscience">GitHub</a> page.</p>

                    <h4 class="m-t-lg f-w-lg">How can I contact the OSF team if I have a question that the FAQ or Getting Started pages don’t answer?</h4>
                        <p>Send us an <a href="mailto:<EMAIL>">email</a> and we'll be happy to help you.</p>
            </div>
            <div id="using" class="anchor row">
                <h2 class="text-center">Using the OSF</h2>

                    <h4 class="m-t-lg f-w-lg">How can I get started on using the OSF?</h4>
                        <p>OSF membership is open and free, so you can
                            just register and check out our <a href="/getting-started">Getting Started</a>
                            page for a thorough run-down of how it works. This FAQ page will only cover a few of the most basic questions about the OSF, so it’s highly recommended that you read through Getting Started if you have any issues.</p>

                    <h4 class="m-t-lg f-w-lg">How do I create a lab group/organizational group?</h4>
                        <p>The best way to create a lab or organizational group on the OSF is to create a project for that group. Then, individual projects within the lab can either be organized into components of the lab project or into their own projects which are linked to the lab group project. For an example, check out the <a href="https://osf.io/ezcuj/">Reproducibility Project: Psychology.</a></p>

                    <h4 class="m-t-lg f-w-lg">What services can I use with the OSF?</h4>
                        <p>The OSF supports many third-party add-ons. For storage, you can connect to Amazon S3, Box, Dataverse, Dropbox, Figshare, Github, and Google Drive, and the OSF has its own default storage add-on, OSF Storage, if you choose not to connect to any third-party add-ons. The OSF also supports Mendeley and Zotero as citation managers. Please refer to the helpful <a href="/getting-started/#addons">Add-ons section</a> of our Getting Started page for more information on how to use add-ons.</p>

                    <h4 class="m-t-lg f-w-lg">What can I do with a file after uploading it into a storage add-on?</h4>
                        <p>You can view, download, delete, and rename any files uploaded into OSF Storage. Files in third party storage add-ons might have restrictions on renaming and downloading.</p>

                    <h4 class="m-t-lg f-w-lg">What is a registration?</h4>
                        <p>A registration is a frozen version of your project that can never be edited or deleted, but you can issue a retraction of it later, leaving behind basic metadata. When you create the registration, you have the option of either making it public immediately or making it private for up to four years through an embargo. A registration is useful for certifying what you did in a project in advance of data analysis, or for confirming the exact state of the project at important points of the lifecycle, such as manuscript submission or the onset of data collection.</p>

                    <h4 class="m-t-lg f-w-lg">What if I don't want to register anything in the OSF?</h4>
                        <p>Registering is an optional feature of the OSF.</p>

                    <h4 class="m-t-lg f-w-lg">What is the cap on data per user?</h4>
                        <p>There is a limit on the size of individual files uploaded to the OSF. This limit is 128 MB. If you have larger files to upload, you might consider utilizing add-ons. When archiving files during the registration process, there is a 1 GB total limit across all storage add-ons being archived.</p>

                    <h4 class="m-t-lg f-w-lg">How do I get a DOI or ARK for my project?</h4>
                        <p>DOIs and ARKs are available for <b>public registrations</b> of projects. To get a DOI or ARK for your project, first create a registration of your project, and make sure the registration is public. Then click the "Create DOI / ARK" link, located in the block of text below the project title. A DOI and ARK will be automatically created. </p>

            </div>

            <div id="security" class="anchor row">
                <h2 class="text-center">Privacy and Security</h2>
                    <h4 class="m-t-lg f-w-lg">What if I don't want to make anything available publicly in the OSF?</h4>
                        <p>
                            The OSF is designed to support both private and public workflows. You can
                            keep projects, or individual components of projects, private so that only
                            your project collaborators have access to them.</p>

                    <h4 class="m-t-lg f-w-lg">How secure is my information?</h4>
                        <p>Security is extremely important for
                            the OSF. When you sign up and create a password, your password is not
                            recorded. Instead, we store a <a href="http://bcrypt.sourceforge.net/">bcrypt
                                hash</a> of your password. This is a computation on your password that
                            cannot be reversed, but is the same every time it is computed from your
                            password. This provides extra security. No one but you can know your
                            password. When you click "Forgot your password," the OSF sends you a new random
                            password because it neither stores nor has the ability to compute your password.
                            <br/><br/>
                            Data and materials posted on the OSF are not yet encrypted, unless you encrypt
                            them before uploading to the site. This means that if our servers were
                            compromised, the intruder would have access to raw data. While we have taken
                            technological measures to minimize this risk, the level of security can be
                            improved further. We will offer encryption soon, and we will partner with
                            data storage services that offer strong security features.</p>

                    <h4 class="m-t-lg f-w-lg">Is the OSF HIPAA compliant?</h4>
                        <p>You should refer to your institutional policies regarding specific security requirements for your research.</p>

                    <h4 class="m-t-lg f-w-lg">How can I license my data/code/etc.?</h4>
                        <p>If you’d like to attach a license to your materials hosted on the OSF, you can put this information in your project’s wiki or upload a README file. Typically, users wish to license their materials using Creative Commons licenses. Information about Creative Commons licenses can be found <a href="https://creativecommons.org/licenses/">here.</a> </p>


                    <h4 class="m-t-lg f-w-lg">How does the OSF store and backup files that I upload to the site?</h4>
                        <p>The OSF stores files with <a href="http://www.rackspace.com/">Rackspace</a>
                            via an open source sponsorship, and has backups on
                            <a href="http://aws.amazon.com/glacier/">Amazon's Glacier platform</a>.
                            The OSF maintains several backup schemes, including off-site backups and
                            automated backups performed by our host every day, week, and fortnight.</p>
                        <p>Rackspace and Amazon Glacier have their own methods to support data integrity (e.g., redundancy across 5+ locations), but the Open Science Framework takes the extra step of calculating multiple <a href="https://en.wikipedia.org/wiki/Checksum">checksums</a> and <a href="https://en.wikipedia.org/wiki/Parchive">parity archives</a> to account for even the most improbable errors.</p>

            </div>

            <div id="common" class="anchor row">
                <h2 class="text-center">Common Issues</h2>
                    <h4 class="m-t-lg f-w-lg">What do I do if I lost my email confirmation for OSF registration, or I never received it?</h4>
                        <p>Log into the OSF with the email address and password of the account you created, and there will be a link to resend the confirmation email.</p>

                    <h4 class="m-t-lg f-w-lg">My email address has changed. How do I change my login email?</h4>
                        <p>From your <a href="/settings/account">account settings</a> page, you can add additional email addresses to your account, and select which of these is your primary email address. Any of these emails can be used to log in to the OSF. </p>

                    <h4 class="m-t-lg f-w-lg">I have multiple OSF accounts. How do I merge them into one account?</h4>
                        <p>Log into the account you wish to keep and navigate to your <a href="/settings/account/">account settings</a> page. There, enter the email address associated with your other OSF account. You will receive a confirmation link via email. Clicking the link will merge the projects and components into one account.</p>

                    <h4 class="m-t-lg f-w-lg">How do I deactivate my OSF account?</h4>
                        <p>From your <a href="/settings/account/">account settings</a> page, you can request a deactivation of your OSF account. A member of the OSF team will review your request and respond to confirm deactivation.</p>

                    <h4 class="m-t-lg f-w-lg">What is the difference between a component and a folder?</h4>
                        <p>A folder can be used to organize files within a project or component - just like a folder on your own computer groups files together. A component is like a sub-project to help you organize different parts of your research. Components have their own privacy and sharing settings as well as their own unique, persistent identifiers for citation, and their own wiki and add-ons. You can also register a component on its own, without registering the parent project.</p>

                    <h4 class="m-t-lg f-w-lg">How do I delete a project or component?</h4>
                        <p>To delete a project or component, navigate to the project or component and click on "Settings" in the gray navigation bar. There you will see a red "delete" button. You can only delete a project or component that does not contain other components - so you must delete any nested components first.</p>

                    <h4 class="m-t-lg f-w-lg">How do I move a file from one storage add-on to another? Or one component to another?</h4>
                        <p>You can move files between components and add-ons, provided the components and add-ons are a part of the same project, by simply dragging and dropping from within the files widget of the project overview page or the Files tab. The Dataverse add-on does not currently support this feature.</p>

                    <h4 class="m-t-lg f-w-lg">How do I rename a project?</h4>
                        <p>You can rename a project or a component by clicking on the project title in the project or component overview page.</p>

                    <h4 class="m-t-lg f-w-lg">I’m using the search function in the top navigation bar to find one of my projects, but it’s not showing up in the results. What’s wrong?</h4>
                        <p>The search function only returns public projects, so if you’re searching for one of your own private projects, it won’t be returned in the results. To search for your own projects, go to your dashboard, and use the “Go to my project” widget on the top right.</p>

                    <h4 class="m-t-lg f-w-lg">I have a DOI for my project on the OSF, but I've decided I'd rather host the material elsewhere. How can I do this without losing/needing a new DOI?</h4>
                        <p>Send us an email with your DOI and the new location of your materials and we'll update the URL associated with your DOI. </p>

            </div>
        </div>
    </div>
</div>

</%def><commit_msg>Update faq.mako<commit_after><%inherit file="base.mako"/>
<%def name="title()">FAQ</%def>

<%def name="stylesheets()">
    <link rel="stylesheet" href="/static/css/pages/getting-started-page.css">
</%def>

<%def name="content()">
<div class="nav-rows container">
    <div class="row">
        <div class="col-sm-4 col-md-3 nav-list-spy">
            <div data-spy="affix" class="gs-sidebar hidden-print hidden-xs panel panel-default" role="complementary">
                <ul class="nav nav-stacked nav-pills gs-sidenav" style="min-width: 210px">
                    <li><a class="active" href="#about">About</a></li>
                    <li><a href="#using">Using the OSF</a></li>
                    <li><a href="#security">Privacy and Security</a></li>
                    <li><a href="#common">Common Issues</a></li>
                </ul>
            </div>
        </div>


        <div class="col-sm-8 col-md-9 p-l-md">
            <div>
                <h1 class="text-center">Frequently Asked Questions</h1>
            </div>

            <div id="about" class="anchor row">
                <h2 class="text-center">About</h2>
                    <h4 class="m-t-lg f-w-lg">How much does the OSF service cost?</h4>
                        <p>It's free!</p>

                    <h4 class="m-t-lg f-w-lg">How can it be free? How are you funded?</h4>
                        <p>The OSF is maintained and developed by the <a href="http://cos.io">Center for Open Science</a> (COS), a non-profit organization. COS is supported through grants from a variety of supporters, including <a href="http://centerforopenscience.org/about_sponsors/"> federal agencies, private foundations, and commercial entities</a>.</p>
                    
                    <h4 class="m-t-lg f-w-lg">What if you run out of funding? What happens to my data?</h4>
                        <p>Data stored on the OSF is backed by a $250,000 preservation fund that will provide for persistence of your data, even if the Center for Open Science runs out of funding. The code base for the OSF is entirely <a href="https://github.com/CenterForOpenScience/osf.io">open source</a>, which enables other groups to continue maintaining and expanding it if we aren’t able to.</p>

                    <h4 class="m-t-lg f-w-lg">How will the OSF be useful to my research?</h4>
                        <p>The OSF integrates with the scientist's daily workflow. The OSF helps document and archive study designs, materials, and data. The OSF facilitates sharing of materials and data within a laboratory or across laboratories. The OSF also facilitates transparency of laboratory research and provides a network design that details and credits individual contributions for all aspects of the research process. To see how it works, watch our short <a href="/getting-started">Getting Started</a> videos, see the <a href="/4znZP/wiki/home">OSF Features</a> page, or see how other scientists <a href="/svje2/">use the OSF.</a></p>

                    <h4 class="m-t-lg f-w-lg">How can I help develop the OSF?</h4>
                        <p>If you are a developer, check out the source code for the OSF <a href="https://github.com/CenterForOpenScience/osf.io">on GitHub</a>.
                        The <a href="https://github.com/CenterForOpenScience/osf.io/issues">issue tracker</a> is a good place to find ways to help. For more information, send an email to <a
                        href="mailto:<EMAIL>"><EMAIL></a>.</p>


                    <h4 class="m-t-lg f-w-lg">What is coming to the OSF?</h4>
                        <p>For updates on new features, you can join our <a href="https://groups.google.com/forum/#!forum/openscienceframework">Google
                        Group</a>, find us on <a href="https://twitter.com/osframework">Twitter</a> and on <a href="https://www.facebook.com/OpenScienceFramework">Facebook</a>, or follow the COS <a href="https://github.com/centerforopenscience">GitHub</a> page.</p>

                    <h4 class="m-t-lg f-w-lg">How can I contact the OSF team if I have a question that the FAQ or Getting Started pages don’t answer?</h4>
                        <p>Send us an <a href="mailto:<EMAIL>">email</a> and we'll be happy to help you.</p>
            </div>
            <div id="using" class="anchor row">
                <h2 class="text-center">Using the OSF</h2>

                    <h4 class="m-t-lg f-w-lg">How can I get started on using the OSF?</h4>
                        <p>OSF membership is open and free, so you can
                            just register and check out our <a href="/getting-started">Getting Started</a>
                            page for a thorough run-down of how it works. This FAQ page will only cover a few of the most basic questions about the OSF, so it’s highly recommended that you read through Getting Started if you have any issues.</p>

                    <h4 class="m-t-lg f-w-lg">How do I create a lab group/organizational group?</h4>
                        <p>The best way to create a lab or organizational group on the OSF is to create a project for that group. Then, individual projects within the lab can either be organized into components of the lab project or into their own projects which are linked to the lab group project. For an example, check out the <a href="https://osf.io/ezcuj/">Reproducibility Project: Psychology.</a></p>

                    <h4 class="m-t-lg f-w-lg">What services can I use with the OSF?</h4>
                        <p>The OSF supports many third-party add-ons. For storage, you can connect to Amazon S3, Box, Dataverse, Dropbox, Figshare, Github, and Google Drive, and the OSF has its own default storage add-on, OSF Storage, if you choose not to connect to any third-party add-ons. The OSF also supports Mendeley and Zotero as citation managers. Please refer to the helpful <a href="/getting-started/#addons">Add-ons section</a> of our Getting Started page for more information on how to use add-ons.</p>

                    <h4 class="m-t-lg f-w-lg">What can I do with a file after uploading it into a storage add-on?</h4>
                        <p>You can view, download, delete, and rename any files uploaded into OSF Storage. Files in third party storage add-ons might have restrictions on renaming and downloading.</p>

                    <h4 class="m-t-lg f-w-lg">What is a registration?</h4>
                        <p>A registration is a frozen version of your project that can never be edited or deleted, but you can issue a retraction of it later, leaving behind basic metadata. When you create the registration, you have the option of either making it public immediately or making it private for up to four years through an embargo. A registration is useful for certifying what you did in a project in advance of data analysis, or for confirming the exact state of the project at important points of the lifecycle, such as manuscript submission or the onset of data collection.</p>

                    <h4 class="m-t-lg f-w-lg">What if I don't want to register anything in the OSF?</h4>
                        <p>Registering is an optional feature of the OSF.</p>

                    <h4 class="m-t-lg f-w-lg">What is the cap on data per user?</h4>
                        <p>There is a limit on the size of individual files uploaded to the OSF. This limit is 128 MB. If you have larger files to upload, you might consider utilizing add-ons. When archiving files during the registration process, there is a 1 GB total limit across all storage add-ons being archived.</p>

                    <h4 class="m-t-lg f-w-lg">How do I get a DOI or ARK for my project?</h4>
                        <p>DOIs and ARKs are available for <b>public registrations</b> of projects. To get a DOI or ARK for your project, first create a registration of your project, and make sure the registration is public. Then click the "Create DOI / ARK" link, located in the block of text below the project title. A DOI and ARK will be automatically created. </p>

            </div>

            <div id="security" class="anchor row">
                <h2 class="text-center">Privacy and Security</h2>
                    <h4 class="m-t-lg f-w-lg">What if I don't want to make anything available publicly in the OSF?</h4>
                        <p>
                            The OSF is designed to support both private and public workflows. You can
                            keep projects, or individual components of projects, private so that only
                            your project collaborators have access to them.</p>

                    <h4 class="m-t-lg f-w-lg">How secure is my information?</h4>
                        <p>Security is extremely important for
                            the OSF. When you sign up and create a password, your password is not
                            recorded. Instead, we store a <a href="http://bcrypt.sourceforge.net/">bcrypt
                                hash</a> of your password. This is a computation on your password that
                            cannot be reversed, but is the same every time it is computed from your
                            password. This provides extra security. No one but you can know your
                            password. When you click "Forgot your password," the OSF sends you a new random
                            password because it neither stores nor has the ability to compute your password.
                            <br/><br/>
                            Data and materials posted on the OSF are not yet encrypted, unless you encrypt
                            them before uploading to the site. This means that if our servers were
                            compromised, the intruder would have access to raw data. While we have taken
                            technological measures to minimize this risk, the level of security can be
                            improved further. We will offer encryption soon, and we will partner with
                            data storage services that offer strong security features.</p>

                    <h4 class="m-t-lg f-w-lg">Is the OSF HIPAA compliant?</h4>
                        <p>You should refer to your institutional policies regarding specific security requirements for your research.</p>

                    <h4 class="m-t-lg f-w-lg">How can I license my data/code/etc.?</h4>
                        <p>If you’d like to attach a license to your materials hosted on the OSF, you can put this information in your project’s wiki or upload a README file. Typically, users wish to license their materials using Creative Commons licenses. Information about Creative Commons licenses can be found <a href="https://creativecommons.org/licenses/">here.</a> </p>


                    <h4 class="m-t-lg f-w-lg">How does the OSF store and backup files that I upload to the site?</h4>
                        <p>The OSF stores files with <a href="http://www.rackspace.com/">Rackspace</a>
                            via an open source sponsorship, and has backups on
                            <a href="http://aws.amazon.com/glacier/">Amazon's Glacier platform</a>.
                            The OSF maintains several backup schemes, including off-site backups and
                            automated backups performed by our host every day, week, and fortnight.</p>
                        <p>Rackspace and Amazon Glacier have their own methods to support data integrity (e.g., redundancy across 5+ locations), but the Open Science Framework takes the extra step of calculating multiple <a href="https://en.wikipedia.org/wiki/Checksum">checksums</a> and <a href="https://en.wikipedia.org/wiki/Parchive">parity archives</a> to account for even the most improbable errors.</p>

            </div>

            <div id="common" class="anchor row">
                <h2 class="text-center">Common Issues</h2>
                    <h4 class="m-t-lg f-w-lg">What do I do if I lost my email confirmation for OSF registration, or I never received it?</h4>
                        <p>Log into the OSF with the email address and password of the account you created, and there will be a link to resend the confirmation email.</p>

                    <h4 class="m-t-lg f-w-lg">My email address has changed. How do I change my login email?</h4>
                        <p>From your <a href="/settings/account">account settings</a> page, you can add additional email addresses to your account, and select which of these is your primary email address. Any of these emails can be used to log in to the OSF. </p>

                    <h4 class="m-t-lg f-w-lg">I have multiple OSF accounts. How do I merge them into one account?</h4>
                        <p>Log into the account you wish to keep and navigate to your <a href="/settings/account/">account settings</a> page. There, enter the email address associated with your other OSF account. You will receive a confirmation link via email. Clicking the link will merge the projects and components into one account.</p>

                    <h4 class="m-t-lg f-w-lg">How do I deactivate my OSF account?</h4>
                        <p>From your <a href="/settings/account/">account settings</a> page, you can request a deactivation of your OSF account. A member of the OSF team will review your request and respond to confirm deactivation.</p>

                    <h4 class="m-t-lg f-w-lg">What is the difference between a component and a folder?</h4>
                        <p>A folder can be used to organize files within a project or component - just like a folder on your own computer groups files together. A component is like a sub-project to help you organize different parts of your research. Components have their own privacy and sharing settings as well as their own unique, persistent identifiers for citation, and their own wiki and add-ons. You can also register a component on its own, without registering the parent project.</p>

                    <h4 class="m-t-lg f-w-lg">How do I delete a project or component?</h4>
                        <p>To delete a project or component, navigate to the project or component and click on "Settings" in the gray navigation bar. There you will see a red "delete" button. You can only delete a project or component that does not contain other components, so you must delete any nested components first.</p>

                    <h4 class="m-t-lg f-w-lg">How do I move a file from one storage add-on to another? Or one component to another?</h4>
                        <p>You can move files between components and add-ons, provided the components and add-ons are a part of the same project, by simply dragging and dropping from within the files widget of the project overview page or the Files tab. The Dataverse add-on does not currently support this feature.</p>

                    <h4 class="m-t-lg f-w-lg">How do I rename a project?</h4>
                        <p>You can rename a project or a component by clicking on the project title in the project or component overview page.</p>

                    <h4 class="m-t-lg f-w-lg">I’m using the search function in the top navigation bar to find one of my projects, but it’s not showing up in the results. What’s wrong?</h4>
                        <p>The search function only returns public projects, so if you’re searching for one of your own private projects, it won’t be returned in the results. To search for your own projects, go to your dashboard, and use the “Go to my project” widget on the top right.</p>

                    <h4 class="m-t-lg f-w-lg">I have a DOI for my project on the OSF, but I've decided I'd rather host the material elsewhere. How can I do this without losing/needing a new DOI?</h4>
                        <p>Send us an email with your DOI and the new location of your materials and we'll update the URL associated with your DOI. </p>

            </div>
        </div>
    </div>
</div>

</%def>
{'fraction_non_alphanumeric': 0.08882307092751364, 'fraction_numerical': 0.005674201091192517, 'mean_word_length': 2.2475448010529515, 'pattern_counts': {'":': 0, '<': 477, '<?xml version=': 0, '>': 477, 'https://': 22, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 12, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6632856', 'n_tokens_mistral': 8589, 'n_tokens_neox': 8104, 'n_words': 3884}