Vipitis commited on
Commit
2728bd0
1 Parent(s): fa25c04

added information to markdown

Browse files
Files changed (1) hide show
  1. app.py +6 -2
app.py CHANGED
@@ -40,13 +40,17 @@ text = """# Welcome to the ShaderEval Suite.
40
 
41
  ## Results
42
  ![](file/bar.png)
 
43
 
44
- ## Todo (feel free to contribute in a Pull Request)
45
- - [~] leaderboard
46
  - [?] supporting batches to speed up inference
47
  - [ ] CER metric (via a custom metric perhaps?)
48
  - [x] removing the pad_token warning
49
  - [ ] adding OpenVINO pipelines for inference, pending on OpenVINO release
 
 
 
50
  """
51
 
52
 
 
40
 
41
  ## Results
42
  ![](file/bar.png)
43
+ Additionally, you can report results to your models and it should show up on this [leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=Vipitis%2FShadertoys-fine)
44
 
45
+ ## Todo (feel free to contribute in a [Pull Request](https://huggingface.co/spaces/Vipitis/ShaderEval/discussions?status=open&type=pull_request))
46
+ - [~] leaderboard (via autoevaluate and self reporting)
47
  - [?] supporting batches to speed up inference
48
  - [ ] CER metric (via a custom metric perhaps?)
49
  - [x] removing the pad_token warning
50
  - [ ] adding OpenVINO pipelines for inference, pending on OpenVINO release
51
+ - [ ] task1b for "better" featuring a improved testset as well as better metrics. Will allow more generation parameters
52
+ - [ ] semantic match by comparing the rendered frames (depending on WGPU implementation?)
53
+ - [ ] CLIP match to evaluate rendered images fitting to title/description
54
  """
55
 
56