jet-taekyo commited on
Commit
ef3de2b
1 Parent(s): c740b26

Add new SentenceTransformer model.

Browse files
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 768,
3
+ "pooling_mode_cls_token": true,
4
+ "pooling_mode_mean_tokens": false,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,719 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Snowflake/snowflake-arctic-embed-m
3
+ library_name: sentence-transformers
4
+ metrics:
5
+ - cosine_accuracy@1
6
+ - cosine_accuracy@3
7
+ - cosine_accuracy@5
8
+ - cosine_accuracy@10
9
+ - cosine_precision@1
10
+ - cosine_precision@3
11
+ - cosine_precision@5
12
+ - cosine_precision@10
13
+ - cosine_recall@1
14
+ - cosine_recall@3
15
+ - cosine_recall@5
16
+ - cosine_recall@10
17
+ - cosine_ndcg@10
18
+ - cosine_mrr@10
19
+ - cosine_map@100
20
+ - dot_accuracy@1
21
+ - dot_accuracy@3
22
+ - dot_accuracy@5
23
+ - dot_accuracy@10
24
+ - dot_precision@1
25
+ - dot_precision@3
26
+ - dot_precision@5
27
+ - dot_precision@10
28
+ - dot_recall@1
29
+ - dot_recall@3
30
+ - dot_recall@5
31
+ - dot_recall@10
32
+ - dot_ndcg@10
33
+ - dot_mrr@10
34
+ - dot_map@100
35
+ pipeline_tag: sentence-similarity
36
+ tags:
37
+ - sentence-transformers
38
+ - sentence-similarity
39
+ - feature-extraction
40
+ - generated_from_trainer
41
+ - dataset_size:714
42
+ - loss:MatryoshkaLoss
43
+ - loss:MultipleNegativesRankingLoss
44
+ widget:
45
+ - source_sentence: What are some examples of data privacy issues mentioned in the
46
+ context?
47
+ sentences:
48
+ - "on a principle of local control, such that those individuals closest to the data\
49
+ \ subject have more access while \nthose who are less proximate do not (e.g.,\
50
+ \ a teacher has access to their students’ daily progress data while a \nsuperintendent\
51
+ \ does not). \nReporting. In addition to the reporting on data privacy (as listed\
52
+ \ above for non-sensitive data), entities devel-\noping technologies related to\
53
+ \ a sensitive domain and those collecting, using, storing, or sharing sensitive\
54
+ \ data \nshould, whenever appropriate, regularly provide public reports describing:\
55
+ \ any data security lapses or breaches \nthat resulted in sensitive data leaks;\
56
+ \ the number, type, and outcomes of ethical pre-reviews undertaken; a \ndescription\
57
+ \ of any data sold, shared, or made public, and how that data was assessed to\
58
+ \ determine it did not pres-\nent a sensitive data risk; and ongoing risk identification\
59
+ \ and management procedures, and any mitigation added"
60
+ - "DATA PRIVACY \nHOW THESE PRINCIPLES CAN MOVE INTO PRACTICE\nReal-life examples\
61
+ \ of how these principles can become reality, through laws, policies, and practical\
62
+ \ \ntechnical and sociotechnical approaches to protecting rights, opportunities,\
63
+ \ and access. \nThe Privacy Act of 1974 requires privacy protections for personal\
64
+ \ information in federal \nrecords systems, including limits on data retention,\
65
+ \ and also provides individuals a general \nright to access and correct their\
66
+ \ data. Among other things, the Privacy Act limits the storage of individual \n\
67
+ information in federal systems of records, illustrating the principle of limiting\
68
+ \ the scope of data retention. Under \nthe Privacy Act, federal agencies may only\
69
+ \ retain data about an individual that is “relevant and necessary” to \naccomplish\
70
+ \ an agency’s statutory purpose or to comply with an Executive Order of the President.\
71
+ \ The law allows"
72
+ - "DATA PRIVACY \nWHY THIS PRINCIPLE IS IMPORTANT\nThis section provides a brief\
73
+ \ summary of the problems which the principle seeks to address and protect \n\
74
+ against, including illustrative examples. \n•\nAn insurer might collect data from\
75
+ \ a person's social media presence as part of deciding what life\ninsurance rates\
76
+ \ they should be offered.64\n•\nA data broker harvested large amounts of personal\
77
+ \ data and then suffered a breach, exposing hundreds of\nthousands of people to\
78
+ \ potential identity theft. 65\n•\nA local public housing authority installed\
79
+ \ a facial recognition system at the entrance to housing complexes to\nassist\
80
+ \ law enforcement with identifying individuals viewed via camera when police reports\
81
+ \ are filed, leading\nthe community, both those living in the housing complex\
82
+ \ and not, to have videos of them sent to the local\npolice department and made\
83
+ \ available for scanning by its facial recognition software.66\n•"
84
+ - source_sentence: What are the main topics covered in the National Institute of Standards
85
+ and Technology's AI Risk Management Framework?
86
+ sentences:
87
+ - "https://www.rand.org/pubs/research_reports/RRA2977-2.html. \nNicoletti, L. et\
88
+ \ al. (2023) Humans Are Biased. Generative Ai Is Even Worse. Bloomberg. \nhttps://www.bloomberg.com/graphics/2023-generative-ai-bias/.\
89
+ \ \nNational Institute of Standards and Technology (2024) Adversarial Machine\
90
+ \ Learning: A Taxonomy and \nTerminology of Attacks and Mitigations https://csrc.nist.gov/pubs/ai/100/2/e2023/final\
91
+ \ \nNational Institute of Standards and Technology (2023) AI Risk Management Framework.\
92
+ \ \nhttps://www.nist.gov/itl/ai-risk-management-framework \nNational Institute\
93
+ \ of Standards and Technology (2023) AI Risk Management Framework, Chapter 3:\
94
+ \ AI \nRisks and Trustworthiness. \nhttps://airc.nist.gov/AI_RMF_Knowledge_Base/AI_RMF/Foundational_Information/3-sec-characteristics\
95
+ \ \nNational Institute of Standards and Technology (2023) AI Risk Management Framework,\
96
+ \ Chapter 6: AI \nRMF Profiles. https://airc.nist.gov/AI_RMF_Knowledge_Base/AI_RMF/Core_And_Profiles/6-sec-profile"
97
+ - "(e.g., via red-teaming, field testing, participatory engagements, performance\
98
+ \ \nassessments, user feedback mechanisms). \nHuman-AI Configuration \nAI Actor\
99
+ \ Tasks: AI Development, AI Deployment, AI Impact Assessment, Operation and Monitoring\
100
+ \ \n \nMANAGE 2.2: Mechanisms are in place and applied to sustain the value of\
101
+ \ deployed AI systems. \nAction ID \nSuggested Action \nGAI Risks \nMG-2.2-001\
102
+ \ \nCompare GAI system outputs against pre-defined organization risk tolerance,\
103
+ \ \nguidelines, and principles, and review and test AI-generated content against\
104
+ \ \nthese guidelines. \nCBRN Information or Capabilities; \nObscene, Degrading,\
105
+ \ and/or \nAbusive Content; Harmful Bias and \nHomogenization; Dangerous, \nViolent,\
106
+ \ or Hateful Content \nMG-2.2-002 \nDocument training data sources to trace the\
107
+ \ origin and provenance of AI-\ngenerated content. \nInformation Integrity \n\
108
+ MG-2.2-003 \nEvaluate feedback loops between GAI system content provenance and\
109
+ \ human"
110
+ - "domain or for functions that are required for administrative reasons (e.g., school\
111
+ \ attendance records), unless \nconsent is acquired, if appropriate, and the additional\
112
+ \ expectations in this section are met. Consent for non-\nnecessary functions\
113
+ \ should be optional, i.e., should not be required, incentivized, or coerced in\
114
+ \ order to \nreceive opportunities or access to services. In cases where data\
115
+ \ is provided to an entity (e.g., health insurance \ncompany) in order to facilitate\
116
+ \ payment for such a need, that data should only be used for that purpose. \n\
117
+ Ethical review and use prohibitions. Any use of sensitive data or decision process\
118
+ \ based in part on sensi-\ntive data that might limit rights, opportunities, or\
119
+ \ access, whether the decision is automated or not, should go \nthrough a thorough\
120
+ \ ethical review and monitoring, both in advance and by periodic review (e.g.,\
121
+ \ via an indepen-\ndent ethics committee or similarly robust process). In some\
122
+ \ cases, this ethical review may determine that data"
123
+ - source_sentence: How can organizations leverage user feedback to enhance content
124
+ provenance and risk management efforts?
125
+ sentences:
126
+ - "tested, there will always be situations for which the system fails. The American\
127
+ \ public deserves protection via human \nreview against these outlying or unexpected\
128
+ \ scenarios. In the case of time-critical systems, the public should not have\
129
+ \ \nto wait—immediate human consideration and fallback should be available. In\
130
+ \ many time-critical systems, such a \nremedy is already immediately available,\
131
+ \ such as a building manager who can open a door in the case an automated \ncard\
132
+ \ access system fails. \nIn the criminal justice system, employment, education,\
133
+ \ healthcare, and other sensitive domains, automated systems \nare used for many\
134
+ \ purposes, from pre-trial risk assessments and parole decisions to technologies\
135
+ \ that help doctors \ndiagnose disease. Absent appropriate safeguards, these technologies\
136
+ \ can lead to unfair, inaccurate, or dangerous \noutcomes. These sensitive domains\
137
+ \ require extra protections. It is critically important that there is extensive\
138
+ \ human \noversight in such settings."
139
+ - "enable organizations to maximize the utility of provenance data and risk management\
140
+ \ efforts. \nA.1.7. Enhancing Content Provenance through Structured Public Feedback\
141
+ \ \nWhile indirect feedback methods such as automated error collection systems\
142
+ \ are useful, they often lack \nthe context and depth that direct input from end\
143
+ \ users can provide. Organizations can leverage feedback \napproaches described\
144
+ \ in the Pre-Deployment Testing section to capture input from external sources\
145
+ \ such \nas through AI red-teaming. \nIntegrating pre- and post-deployment external\
146
+ \ feedback into the monitoring process for GAI models and \ncorresponding applications\
147
+ \ can help enhance awareness of performance changes and mitigate potential \n\
148
+ risks and harms from outputs. There are many ways to capture and make use of user\
149
+ \ feedback – before \nand after GAI systems and digital content transparency approaches\
150
+ \ are deployed – to gain insights about"
151
+ - "A.1. Governance \nA.1.1. Overview \nLike any other technology system, governance\
152
+ \ principles and techniques can be used to manage risks \nrelated to generative\
153
+ \ AI models, capabilities, and applications. Organizations may choose to apply\
154
+ \ their \nexisting risk tiering to GAI systems, or they may opt to revise or update\
155
+ \ AI system risk levels to address \nthese unique GAI risks. This section describes\
156
+ \ how organizational governance regimes may be re-\nevaluated and adjusted for\
157
+ \ GAI contexts. It also addresses third-party considerations for governing across\
158
+ \ \nthe AI value chain. \nA.1.2. Organizational Governance \nGAI opportunities,\
159
+ \ risks and long-term performance characteristics are typically less well-understood\
160
+ \ \nthan non-generative AI tools and may be perceived and acted upon by humans\
161
+ \ in ways that vary greatly. \nAccordingly, GAI may call for different levels of\
162
+ \ oversight from AI Actors or different human-AI"
163
+ - source_sentence: What should be ensured for users who have trouble with the automated
164
+ system?
165
+ sentences:
166
+ - "32 \nMEASURE 2.6: The AI system is evaluated regularly for safety risks – as\
167
+ \ identified in the MAP function. The AI system to be \ndeployed is demonstrated\
168
+ \ to be safe, its residual negative risk does not exceed the risk tolerance, and\
169
+ \ it can fail safely, particularly if \nmade to operate beyond its knowledge limits.\
170
+ \ Safety metrics reflect system reliability and robustness, real-time monitoring,\
171
+ \ and \nresponse times for AI system failures. \nAction ID \nSuggested Action\
172
+ \ \nGAI Risks \nMS-2.6-001 \nAssess adverse impacts, including health and wellbeing\
173
+ \ impacts for value chain \nor other AI Actors that are exposed to sexually explicit,\
174
+ \ offensive, or violent \ninformation during GAI training and maintenance. \nHuman-AI\
175
+ \ Configuration; Obscene, \nDegrading, and/or Abusive \nContent; Value Chain and\
176
+ \ \nComponent Integration; \nDangerous, Violent, or Hateful \nContent \nMS-2.6-002\
177
+ \ \nAssess existence or levels of harmful bias, intellectual property infringement,"
178
+ - "APPENDIX\nSystems that impact the safety of communities such as automated traffic\
179
+ \ control systems, elec \n-ctrical grid controls, smart city technologies, and\
180
+ \ industrial emissions and environmental\nimpact control algorithms; and\nSystems\
181
+ \ related to access to benefits or services or assignment of penalties such as\
182
+ \ systems that\nsupport decision-makers who adjudicate benefits such as collating\
183
+ \ or analyzing information or\nmatching records, systems which similarly assist\
184
+ \ in the adjudication of administrative or criminal\npenalties, fraud detection\
185
+ \ algorithms, services or benefits access control algorithms, biometric\nsystems\
186
+ \ used as access control, and systems which make benefits or services related\
187
+ \ decisions on a\nfully or partially autonomous basis (such as a determination\
188
+ \ to revoke benefits).\n54"
189
+ - "meaningfully impact rights, opportunities, or access should have greater availability\
190
+ \ (e.g., staffing) and over­\nsight of human consideration and fallback mechanisms.\
191
+ \ \nAccessible. Mechanisms for human consideration and fallback, whether in-person,\
192
+ \ on paper, by phone, or \notherwise provided, should be easy to find and use.\
193
+ \ These mechanisms should be tested to ensure that users \nwho have trouble with\
194
+ \ the automated system are able to use human consideration and fallback, with\
195
+ \ the under­\nstanding that it may be these users who are most likely to need\
196
+ \ the human assistance. Similarly, it should be \ntested to ensure that users\
197
+ \ with disabilities are able to find and use human consideration and fallback\
198
+ \ and also \nrequest reasonable accommodations or modifications. \nConvenient.\
199
+ \ Mechanisms for human consideration and fallback should not be unreasonably burdensome\
200
+ \ as \ncompared to the automated system’s equivalent. \n49"
201
+ - source_sentence: What must lenders provide to consumers who are denied credit under
202
+ the Fair Credit Reporting Act?
203
+ sentences:
204
+ - "8 \nTrustworthy AI Characteristics: Accountable and Transparent, Privacy Enhanced,\
205
+ \ Safe, Secure and \nResilient \n2.5. Environmental Impacts \nTraining, maintaining,\
206
+ \ and operating (running inference on) GAI systems are resource-intensive activities,\
207
+ \ \nwith potentially large energy and environmental footprints. Energy and carbon\
208
+ \ emissions vary based on \nwhat is being done with the GAI model (i.e., pre-training,\
209
+ \ fine-tuning, inference), the modality of the \ncontent, hardware used, and type\
210
+ \ of task or application. \nCurrent estimates suggest that training a single transformer\
211
+ \ LLM can emit as much carbon as 300 round-\ntrip flights between San Francisco\
212
+ \ and New York. In a study comparing energy consumption and carbon \nemissions\
213
+ \ for LLM inference, generative tasks (e.g., text summarization) were found to\
214
+ \ be more energy- \nand carbon-intensive than discriminative or non-generative\
215
+ \ tasks (e.g., text classification)."
216
+ - "that consumers who are denied credit receive \"adverse action\" notices. Anyone\
217
+ \ who relies on the information in a \ncredit report to deny a consumer credit\
218
+ \ must, under the Fair Credit Reporting Act, provide an \"adverse action\" \n\
219
+ notice to the consumer, which includes \"notice of the reasons a creditor took\
220
+ \ adverse action on the application \nor on an existing credit account.\"90 In\
221
+ \ addition, under the risk-based pricing rule,91 lenders must either inform \n\
222
+ borrowers of their credit score, or else tell consumers when \"they are getting\
223
+ \ worse terms because of \ninformation in their credit report.\" The CFPB has\
224
+ \ also asserted that \"[t]he law gives every applicant the right to \na specific\
225
+ \ explanation if their application for credit was denied, and that right is not\
226
+ \ diminished simply because \na company uses a complex algorithm that it doesn't\
227
+ \ understand.\"92 Such explanations illustrate a shared value \nthat certain decisions\
228
+ \ need to be explained."
229
+ - "measures to prevent, flag, or take other action in response to outputs that \n\
230
+ reproduce particular training data (e.g., plagiarized, trademarked, patented,\
231
+ \ \nlicensed content or trade secret material). \nIntellectual Property; CBRN\
232
+ \ \nInformation or Capabilities"
233
+ model-index:
234
+ - name: SentenceTransformer based on Snowflake/snowflake-arctic-embed-m
235
+ results:
236
+ - task:
237
+ type: information-retrieval
238
+ name: Information Retrieval
239
+ dataset:
240
+ name: Unknown
241
+ type: unknown
242
+ metrics:
243
+ - type: cosine_accuracy@1
244
+ value: 0.881578947368421
245
+ name: Cosine Accuracy@1
246
+ - type: cosine_accuracy@3
247
+ value: 0.9671052631578947
248
+ name: Cosine Accuracy@3
249
+ - type: cosine_accuracy@5
250
+ value: 0.9868421052631579
251
+ name: Cosine Accuracy@5
252
+ - type: cosine_accuracy@10
253
+ value: 1.0
254
+ name: Cosine Accuracy@10
255
+ - type: cosine_precision@1
256
+ value: 0.881578947368421
257
+ name: Cosine Precision@1
258
+ - type: cosine_precision@3
259
+ value: 0.3223684210526316
260
+ name: Cosine Precision@3
261
+ - type: cosine_precision@5
262
+ value: 0.19736842105263155
263
+ name: Cosine Precision@5
264
+ - type: cosine_precision@10
265
+ value: 0.09999999999999999
266
+ name: Cosine Precision@10
267
+ - type: cosine_recall@1
268
+ value: 0.881578947368421
269
+ name: Cosine Recall@1
270
+ - type: cosine_recall@3
271
+ value: 0.9671052631578947
272
+ name: Cosine Recall@3
273
+ - type: cosine_recall@5
274
+ value: 0.9868421052631579
275
+ name: Cosine Recall@5
276
+ - type: cosine_recall@10
277
+ value: 1.0
278
+ name: Cosine Recall@10
279
+ - type: cosine_ndcg@10
280
+ value: 0.9460063349721777
281
+ name: Cosine Ndcg@10
282
+ - type: cosine_mrr@10
283
+ value: 0.9282346491228071
284
+ name: Cosine Mrr@10
285
+ - type: cosine_map@100
286
+ value: 0.9282346491228068
287
+ name: Cosine Map@100
288
+ - type: dot_accuracy@1
289
+ value: 0.881578947368421
290
+ name: Dot Accuracy@1
291
+ - type: dot_accuracy@3
292
+ value: 0.9671052631578947
293
+ name: Dot Accuracy@3
294
+ - type: dot_accuracy@5
295
+ value: 0.9868421052631579
296
+ name: Dot Accuracy@5
297
+ - type: dot_accuracy@10
298
+ value: 1.0
299
+ name: Dot Accuracy@10
300
+ - type: dot_precision@1
301
+ value: 0.881578947368421
302
+ name: Dot Precision@1
303
+ - type: dot_precision@3
304
+ value: 0.3223684210526316
305
+ name: Dot Precision@3
306
+ - type: dot_precision@5
307
+ value: 0.19736842105263155
308
+ name: Dot Precision@5
309
+ - type: dot_precision@10
310
+ value: 0.09999999999999999
311
+ name: Dot Precision@10
312
+ - type: dot_recall@1
313
+ value: 0.881578947368421
314
+ name: Dot Recall@1
315
+ - type: dot_recall@3
316
+ value: 0.9671052631578947
317
+ name: Dot Recall@3
318
+ - type: dot_recall@5
319
+ value: 0.9868421052631579
320
+ name: Dot Recall@5
321
+ - type: dot_recall@10
322
+ value: 1.0
323
+ name: Dot Recall@10
324
+ - type: dot_ndcg@10
325
+ value: 0.9460063349721777
326
+ name: Dot Ndcg@10
327
+ - type: dot_mrr@10
328
+ value: 0.9282346491228071
329
+ name: Dot Mrr@10
330
+ - type: dot_map@100
331
+ value: 0.9282346491228068
332
+ name: Dot Map@100
333
+ ---
334
+
335
+ # SentenceTransformer based on Snowflake/snowflake-arctic-embed-m
336
+
337
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Snowflake/snowflake-arctic-embed-m](https://huggingface.co/Snowflake/snowflake-arctic-embed-m). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
338
+
339
+ ## Model Details
340
+
341
+ ### Model Description
342
+ - **Model Type:** Sentence Transformer
343
+ - **Base model:** [Snowflake/snowflake-arctic-embed-m](https://huggingface.co/Snowflake/snowflake-arctic-embed-m) <!-- at revision e2b128b9fa60c82b4585512b33e1544224ffff42 -->
344
+ - **Maximum Sequence Length:** 512 tokens
345
+ - **Output Dimensionality:** 768 tokens
346
+ - **Similarity Function:** Cosine Similarity
347
+ <!-- - **Training Dataset:** Unknown -->
348
+ <!-- - **Language:** Unknown -->
349
+ <!-- - **License:** Unknown -->
350
+
351
+ ### Model Sources
352
+
353
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
354
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
355
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
356
+
357
+ ### Full Model Architecture
358
+
359
+ ```
360
+ SentenceTransformer(
361
+ (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
362
+ (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
363
+ (2): Normalize()
364
+ )
365
+ ```
366
+
367
+ ## Usage
368
+
369
+ ### Direct Usage (Sentence Transformers)
370
+
371
+ First install the Sentence Transformers library:
372
+
373
+ ```bash
374
+ pip install -U sentence-transformers
375
+ ```
376
+
377
+ Then you can load this model and run inference.
378
+ ```python
379
+ from sentence_transformers import SentenceTransformer
380
+
381
+ # Download from the 🤗 Hub
382
+ model = SentenceTransformer("jet-taekyo/snowflake_finetuned_recursive")
383
+ # Run inference
384
+ sentences = [
385
+ 'What must lenders provide to consumers who are denied credit under the Fair Credit Reporting Act?',
386
+ 'that consumers who are denied credit receive "adverse action" notices. Anyone who relies on the information in a \ncredit report to deny a consumer credit must, under the Fair Credit Reporting Act, provide an "adverse action" \nnotice to the consumer, which includes "notice of the reasons a creditor took adverse action on the application \nor on an existing credit account."90 In addition, under the risk-based pricing rule,91 lenders must either inform \nborrowers of their credit score, or else tell consumers when "they are getting worse terms because of \ninformation in their credit report." The CFPB has also asserted that "[t]he law gives every applicant the right to \na specific explanation if their application for credit was denied, and that right is not diminished simply because \na company uses a complex algorithm that it doesn\'t understand."92 Such explanations illustrate a shared value \nthat certain decisions need to be explained.',
387
+ 'measures to prevent, flag, or take other action in response to outputs that \nreproduce particular training data (e.g., plagiarized, trademarked, patented, \nlicensed content or trade secret material). \nIntellectual Property; CBRN \nInformation or Capabilities',
388
+ ]
389
+ embeddings = model.encode(sentences)
390
+ print(embeddings.shape)
391
+ # [3, 768]
392
+
393
+ # Get the similarity scores for the embeddings
394
+ similarities = model.similarity(embeddings, embeddings)
395
+ print(similarities.shape)
396
+ # [3, 3]
397
+ ```
398
+
399
+ <!--
400
+ ### Direct Usage (Transformers)
401
+
402
+ <details><summary>Click to see the direct usage in Transformers</summary>
403
+
404
+ </details>
405
+ -->
406
+
407
+ <!--
408
+ ### Downstream Usage (Sentence Transformers)
409
+
410
+ You can finetune this model on your own dataset.
411
+
412
+ <details><summary>Click to expand</summary>
413
+
414
+ </details>
415
+ -->
416
+
417
+ <!--
418
+ ### Out-of-Scope Use
419
+
420
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
421
+ -->
422
+
423
+ ## Evaluation
424
+
425
+ ### Metrics
426
+
427
+ #### Information Retrieval
428
+
429
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
430
+
431
+ | Metric | Value |
432
+ |:--------------------|:-----------|
433
+ | cosine_accuracy@1 | 0.8816 |
434
+ | cosine_accuracy@3 | 0.9671 |
435
+ | cosine_accuracy@5 | 0.9868 |
436
+ | cosine_accuracy@10 | 1.0 |
437
+ | cosine_precision@1 | 0.8816 |
438
+ | cosine_precision@3 | 0.3224 |
439
+ | cosine_precision@5 | 0.1974 |
440
+ | cosine_precision@10 | 0.1 |
441
+ | cosine_recall@1 | 0.8816 |
442
+ | cosine_recall@3 | 0.9671 |
443
+ | cosine_recall@5 | 0.9868 |
444
+ | cosine_recall@10 | 1.0 |
445
+ | cosine_ndcg@10 | 0.946 |
446
+ | cosine_mrr@10 | 0.9282 |
447
+ | **cosine_map@100** | **0.9282** |
448
+ | dot_accuracy@1 | 0.8816 |
449
+ | dot_accuracy@3 | 0.9671 |
450
+ | dot_accuracy@5 | 0.9868 |
451
+ | dot_accuracy@10 | 1.0 |
452
+ | dot_precision@1 | 0.8816 |
453
+ | dot_precision@3 | 0.3224 |
454
+ | dot_precision@5 | 0.1974 |
455
+ | dot_precision@10 | 0.1 |
456
+ | dot_recall@1 | 0.8816 |
457
+ | dot_recall@3 | 0.9671 |
458
+ | dot_recall@5 | 0.9868 |
459
+ | dot_recall@10 | 1.0 |
460
+ | dot_ndcg@10 | 0.946 |
461
+ | dot_mrr@10 | 0.9282 |
462
+ | dot_map@100 | 0.9282 |
463
+
464
+ <!--
465
+ ## Bias, Risks and Limitations
466
+
467
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
468
+ -->
469
+
470
+ <!--
471
+ ### Recommendations
472
+
473
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
474
+ -->
475
+
476
+ ## Training Details
477
+
478
+ ### Training Dataset
479
+
480
+ #### Unnamed Dataset
481
+
482
+
483
+ * Size: 714 training samples
484
+ * Columns: <code>sentence_0</code> and <code>sentence_1</code>
485
+ * Approximate statistics based on the first 714 samples:
486
+ | | sentence_0 | sentence_1 |
487
+ |:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
488
+ | type | string | string |
489
+ | details | <ul><li>min: 11 tokens</li><li>mean: 18.46 tokens</li><li>max: 32 tokens</li></ul> | <ul><li>min: 21 tokens</li><li>mean: 175.32 tokens</li><li>max: 512 tokens</li></ul> |
490
+ * Samples:
491
+ | sentence_0 | sentence_1 |
492
+ |:---------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
493
+ | <code>What is the purpose of conducting adversarial testing in the context of GAI risks?</code> | <code>Human-AI Configuration; <br>Information Integrity; Harmful Bias <br>and Homogenization <br>AI Actor Tasks: AI Deployment, Affected Individuals and Communities, End-Users, Operation and Monitoring, TEVV <br> <br>MEASURE 4.2: Measurement results regarding AI system trustworthiness in deployment context(s) and across the AI lifecycle are <br>informed by input from domain experts and relevant AI Actors to validate whether the system is performing consistently as <br>intended. Results are documented. <br>Action ID <br>Suggested Action <br>GAI Risks <br>MS-4.2-001 <br>Conduct adversarial testing at a regular cadence to map and measure GAI risks, <br>including tests to address attempts to deceive or manipulate the application of <br>provenance techniques or other misuses. Identify vulnerabilities and <br>understand potential misuse scenarios and unintended outputs. <br>Information Integrity; Information <br>Security <br>MS-4.2-002 <br>Evaluate GAI system performance in real-world scenarios to observe its</code> |
494
+ | <code>How are measurement results regarding AI system trustworthiness documented and validated?</code> | <code>Human-AI Configuration; <br>Information Integrity; Harmful Bias <br>and Homogenization <br>AI Actor Tasks: AI Deployment, Affected Individuals and Communities, End-Users, Operation and Monitoring, TEVV <br> <br>MEASURE 4.2: Measurement results regarding AI system trustworthiness in deployment context(s) and across the AI lifecycle are <br>informed by input from domain experts and relevant AI Actors to validate whether the system is performing consistently as <br>intended. Results are documented. <br>Action ID <br>Suggested Action <br>GAI Risks <br>MS-4.2-001 <br>Conduct adversarial testing at a regular cadence to map and measure GAI risks, <br>including tests to address attempts to deceive or manipulate the application of <br>provenance techniques or other misuses. Identify vulnerabilities and <br>understand potential misuse scenarios and unintended outputs. <br>Information Integrity; Information <br>Security <br>MS-4.2-002 <br>Evaluate GAI system performance in real-world scenarios to observe its</code> |
495
+ | <code>What types of data provenance information are included in the GAI system inventory entries?</code> | <code>following items in GAI system inventory entries: Data provenance information <br>(e.g., source, signatures, versioning, watermarks); Known issues reported from <br>internal bug tracking or external information sharing resources (e.g., AI incident <br>database, AVID, CVE, NVD, or OECD AI incident monitor); Human oversight roles <br>and responsibilities; Special rights and considerations for intellectual property, <br>licensed works, or personal, privileged, proprietary or sensitive data; Underlying <br>foundation models, versions of underlying models, and access modes. <br>Data Privacy; Human-AI <br>Configuration; Information <br>Integrity; Intellectual Property; <br>Value Chain and Component <br>Integration <br>AI Actor Tasks: Governance and Oversight</code> |
496
+ * Loss: [<code>MatryoshkaLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#matryoshkaloss) with these parameters:
497
+ ```json
498
+ {
499
+ "loss": "MultipleNegativesRankingLoss",
500
+ "matryoshka_dims": [
501
+ 768,
502
+ 512,
503
+ 256,
504
+ 128,
505
+ 64
506
+ ],
507
+ "matryoshka_weights": [
508
+ 1,
509
+ 1,
510
+ 1,
511
+ 1,
512
+ 1
513
+ ],
514
+ "n_dims_per_step": -1
515
+ }
516
+ ```
517
+
518
+ ### Training Hyperparameters
519
+ #### Non-Default Hyperparameters
520
+
521
+ - `eval_strategy`: steps
522
+ - `per_device_train_batch_size`: 20
523
+ - `per_device_eval_batch_size`: 20
524
+ - `num_train_epochs`: 5
525
+ - `multi_dataset_batch_sampler`: round_robin
526
+
527
+ #### All Hyperparameters
528
+ <details><summary>Click to expand</summary>
529
+
530
+ - `overwrite_output_dir`: False
531
+ - `do_predict`: False
532
+ - `eval_strategy`: steps
533
+ - `prediction_loss_only`: True
534
+ - `per_device_train_batch_size`: 20
535
+ - `per_device_eval_batch_size`: 20
536
+ - `per_gpu_train_batch_size`: None
537
+ - `per_gpu_eval_batch_size`: None
538
+ - `gradient_accumulation_steps`: 1
539
+ - `eval_accumulation_steps`: None
540
+ - `torch_empty_cache_steps`: None
541
+ - `learning_rate`: 5e-05
542
+ - `weight_decay`: 0.0
543
+ - `adam_beta1`: 0.9
544
+ - `adam_beta2`: 0.999
545
+ - `adam_epsilon`: 1e-08
546
+ - `max_grad_norm`: 1
547
+ - `num_train_epochs`: 5
548
+ - `max_steps`: -1
549
+ - `lr_scheduler_type`: linear
550
+ - `lr_scheduler_kwargs`: {}
551
+ - `warmup_ratio`: 0.0
552
+ - `warmup_steps`: 0
553
+ - `log_level`: passive
554
+ - `log_level_replica`: warning
555
+ - `log_on_each_node`: True
556
+ - `logging_nan_inf_filter`: True
557
+ - `save_safetensors`: True
558
+ - `save_on_each_node`: False
559
+ - `save_only_model`: False
560
+ - `restore_callback_states_from_checkpoint`: False
561
+ - `no_cuda`: False
562
+ - `use_cpu`: False
563
+ - `use_mps_device`: False
564
+ - `seed`: 42
565
+ - `data_seed`: None
566
+ - `jit_mode_eval`: False
567
+ - `use_ipex`: False
568
+ - `bf16`: False
569
+ - `fp16`: False
570
+ - `fp16_opt_level`: O1
571
+ - `half_precision_backend`: auto
572
+ - `bf16_full_eval`: False
573
+ - `fp16_full_eval`: False
574
+ - `tf32`: None
575
+ - `local_rank`: 0
576
+ - `ddp_backend`: None
577
+ - `tpu_num_cores`: None
578
+ - `tpu_metrics_debug`: False
579
+ - `debug`: []
580
+ - `dataloader_drop_last`: False
581
+ - `dataloader_num_workers`: 0
582
+ - `dataloader_prefetch_factor`: None
583
+ - `past_index`: -1
584
+ - `disable_tqdm`: False
585
+ - `remove_unused_columns`: True
586
+ - `label_names`: None
587
+ - `load_best_model_at_end`: False
588
+ - `ignore_data_skip`: False
589
+ - `fsdp`: []
590
+ - `fsdp_min_num_params`: 0
591
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
592
+ - `fsdp_transformer_layer_cls_to_wrap`: None
593
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
594
+ - `deepspeed`: None
595
+ - `label_smoothing_factor`: 0.0
596
+ - `optim`: adamw_torch
597
+ - `optim_args`: None
598
+ - `adafactor`: False
599
+ - `group_by_length`: False
600
+ - `length_column_name`: length
601
+ - `ddp_find_unused_parameters`: None
602
+ - `ddp_bucket_cap_mb`: None
603
+ - `ddp_broadcast_buffers`: False
604
+ - `dataloader_pin_memory`: True
605
+ - `dataloader_persistent_workers`: False
606
+ - `skip_memory_metrics`: True
607
+ - `use_legacy_prediction_loop`: False
608
+ - `push_to_hub`: False
609
+ - `resume_from_checkpoint`: None
610
+ - `hub_model_id`: None
611
+ - `hub_strategy`: every_save
612
+ - `hub_private_repo`: False
613
+ - `hub_always_push`: False
614
+ - `gradient_checkpointing`: False
615
+ - `gradient_checkpointing_kwargs`: None
616
+ - `include_inputs_for_metrics`: False
617
+ - `eval_do_concat_batches`: True
618
+ - `fp16_backend`: auto
619
+ - `push_to_hub_model_id`: None
620
+ - `push_to_hub_organization`: None
621
+ - `mp_parameters`:
622
+ - `auto_find_batch_size`: False
623
+ - `full_determinism`: False
624
+ - `torchdynamo`: None
625
+ - `ray_scope`: last
626
+ - `ddp_timeout`: 1800
627
+ - `torch_compile`: False
628
+ - `torch_compile_backend`: None
629
+ - `torch_compile_mode`: None
630
+ - `dispatch_batches`: None
631
+ - `split_batches`: None
632
+ - `include_tokens_per_second`: False
633
+ - `include_num_input_tokens_seen`: False
634
+ - `neftune_noise_alpha`: None
635
+ - `optim_target_modules`: None
636
+ - `batch_eval_metrics`: False
637
+ - `eval_on_start`: False
638
+ - `eval_use_gather_object`: False
639
+ - `batch_sampler`: batch_sampler
640
+ - `multi_dataset_batch_sampler`: round_robin
641
+
642
+ </details>
643
+
644
+ ### Training Logs
645
+ | Epoch | Step | cosine_map@100 |
646
+ |:------:|:----:|:--------------:|
647
+ | 1.0 | 36 | 0.9145 |
648
+ | 1.3889 | 50 | 0.9256 |
649
+ | 2.0 | 72 | 0.9246 |
650
+ | 2.7778 | 100 | 0.9282 |
651
+
652
+
653
+ ### Framework Versions
654
+ - Python: 3.11.9
655
+ - Sentence Transformers: 3.1.0
656
+ - Transformers: 4.44.2
657
+ - PyTorch: 2.4.1+cu121
658
+ - Accelerate: 0.34.2
659
+ - Datasets: 3.0.0
660
+ - Tokenizers: 0.19.1
661
+
662
+ ## Citation
663
+
664
+ ### BibTeX
665
+
666
+ #### Sentence Transformers
667
+ ```bibtex
668
+ @inproceedings{reimers-2019-sentence-bert,
669
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
670
+ author = "Reimers, Nils and Gurevych, Iryna",
671
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
672
+ month = "11",
673
+ year = "2019",
674
+ publisher = "Association for Computational Linguistics",
675
+ url = "https://arxiv.org/abs/1908.10084",
676
+ }
677
+ ```
678
+
679
+ #### MatryoshkaLoss
680
+ ```bibtex
681
+ @misc{kusupati2024matryoshka,
682
+ title={Matryoshka Representation Learning},
683
+ author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
684
+ year={2024},
685
+ eprint={2205.13147},
686
+ archivePrefix={arXiv},
687
+ primaryClass={cs.LG}
688
+ }
689
+ ```
690
+
691
+ #### MultipleNegativesRankingLoss
692
+ ```bibtex
693
+ @misc{henderson2017efficient,
694
+ title={Efficient Natural Language Response Suggestion for Smart Reply},
695
+ author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
696
+ year={2017},
697
+ eprint={1705.00652},
698
+ archivePrefix={arXiv},
699
+ primaryClass={cs.CL}
700
+ }
701
+ ```
702
+
703
+ <!--
704
+ ## Glossary
705
+
706
+ *Clearly define terms in order to be accessible across audiences.*
707
+ -->
708
+
709
+ <!--
710
+ ## Model Card Authors
711
+
712
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
713
+ -->
714
+
715
+ <!--
716
+ ## Model Card Contact
717
+
718
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
719
+ -->
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "finetuned_embeddings/snowflake_recursive",
3
+ "architectures": [
4
+ "BertModel"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "classifier_dropout": null,
8
+ "gradient_checkpointing": false,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "layer_norm_eps": 1e-12,
15
+ "max_position_embeddings": 512,
16
+ "model_type": "bert",
17
+ "num_attention_heads": 12,
18
+ "num_hidden_layers": 12,
19
+ "pad_token_id": 0,
20
+ "position_embedding_type": "absolute",
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.44.2",
23
+ "type_vocab_size": 2,
24
+ "use_cache": true,
25
+ "vocab_size": 30522
26
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "3.1.0",
4
+ "transformers": "4.44.2",
5
+ "pytorch": "2.4.1+cu121"
6
+ },
7
+ "prompts": {
8
+ "query": "Represent this sentence for searching relevant passages: "
9
+ },
10
+ "default_prompt_name": null,
11
+ "similarity_fn_name": null
12
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d12a67c9c42496ace1b297f7b2bf1326130184d3ab6558cedbc20e5dd8cba4c8
3
+ size 437951328
modules.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Normalize",
18
+ "type": "sentence_transformers.models.Normalize"
19
+ }
20
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 512,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_lower_case": true,
47
+ "mask_token": "[MASK]",
48
+ "max_length": 512,
49
+ "model_max_length": 512,
50
+ "pad_to_multiple_of": null,
51
+ "pad_token": "[PAD]",
52
+ "pad_token_type_id": 0,
53
+ "padding_side": "right",
54
+ "sep_token": "[SEP]",
55
+ "stride": 0,
56
+ "strip_accents": null,
57
+ "tokenize_chinese_chars": true,
58
+ "tokenizer_class": "BertTokenizer",
59
+ "truncation_side": "right",
60
+ "truncation_strategy": "longest_first",
61
+ "unk_token": "[UNK]"
62
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff