anycores commited on
Commit
beba6af
1 Parent(s): 9a7f7aa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md CHANGED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ## Overview
2
+
3
+ This is an implementation of whisper from scratch in C++.
4
+ The related binaries are available on HuggingFace.
5
+
6
+ This is a proof-of-concept. Further modifications, imporvements are coming.
7
+ Feedbacks are wellcomed in the corresponding github repository, [precompAId](https://github.com/anycores/precompAId).
8
+
9
+ Binary contains:
10
+ * exe for testing the app quickly
11
+ * header and dll for building custom solutions
12
+ * main.cpp as an example, how to use the header (the exe compiled from this)
13
+ * weights.xdf (required to load into the graph, no other input required)
14
+ * audios folder, containing examples to try the application
15
+ * convert.py for creating the right input for the application from and arbitrary audio file
16
+
17
+ ## Quick start
18
+
19
+ Example for the usage of whisper.exe:
20
+ ```
21
+ whisper.exe weights.xgdf audios\voice_example1.pb
22
+ ```
23
+
24
+ Example compilation (with clang from the root):
25
+ ```
26
+ clang++ main.cpp win64\whisper.lib -o whisper.exe
27
+ ```
28
+
29
+ Example for converting:
30
+ ```
31
+ python convert.py --ipath audios\voice_example_orig1.wav --opath voice_example.pb
32
+ ```
33
+
34
+ ## Implementation info
35
+
36
+ Tested on:
37
+ * windows 10
38
+ * intel i7 11th gen
39
+ * clang 16.06 as compiler
40
+
41
+ Current properties:
42
+ * fp32
43
+ * avx512 is required
44
+
45
+ ## Further Notes
46
+
47
+ Improved versions will arrive regularly.
48
+ Feedbacks are wellcomed. Especially the following:
49
+ * features to be add (input format, expected output format etc.)
50
+ * devices (plan to extend for mobiles, IPUs etc.)
51
+ * models (what other models would be great to accelerate)