Commit History

first version streaming via webrtc but quality sucks
d91a673

sohojoe commited on

refactor so we have in and then i can add out
ac35a95

sohojoe commited on

refactor ffmeg_concerter_actor.py to its own class
c4fe843

sohojoe commited on

updated version that uses ray queues so it doesn't block.
681abd4

sohojoe commited on

basic version that is working
6dfcd3a

sohojoe commited on

debug_app.py which choppy audio
d0639dc

sohojoe commited on

pickle the frames so easier to debug downstream
32ed25f

sohojoe commited on

4096 chunk sizes seams to be more robust
24d9393

sohojoe commited on

add mp3 format hint
7efb19e

sohojoe commited on

some debug code
f615884

sohojoe commited on

fix: should be raise, now throw
dc249ac

sohojoe commited on

should not leave on debug text
187e31c

sohojoe commited on

add cancel and fix a bunch of async problems
afc1e50

sohojoe commited on

create respond to prompt actor
bcea2ea

sohojoe commited on

migrated speech to text to an actor
98ec0ec

sohojoe commited on

fix use of ray.get inside aync
768e92a

sohojoe commited on

Charles running between two applications
ad67495

sohojoe commited on

start of moving to ray
62a21bd

sohojoe commited on

prep for charicter
ff684ee

sohojoe commited on

prep for video frames
ad9371a

sohojoe commited on

basic POC
162d5c8

sohojoe commited on

refactor app.py to run as async
9740bc5

sohojoe commited on

created chat_pipeline
730fe87

sohojoe commited on

add: pipelines nodes can now spawn one to many jobs via yield
8c9e2db

sohojoe commited on

create a pipeline class with basic test coverage
ed232fa

sohojoe commited on

create a node class to help things be a bit more robust
de8cac1

sohojoe commited on

added pipeline test for a simple pipeline
80eea9e

sohojoe commited on

added debug time to show the time multiple of actual audio time to streaming time
31bfb8d

sohojoe commited on

add some debug code that suggest that we are still been buffered somehow
ac171cf

sohojoe commited on

add _safe_enqueue_text_to_speak
1fe79e2

sohojoe commited on

fix issues with _should_we_send_to_voice and add a test
12f4772

sohojoe commited on

fix: close would lock
245e7f9

sohojoe commited on

streaming chat into speech
bd435b3

sohojoe commited on

streaming speech in the debug
4385b66

sohojoe commited on

fixes to have two sepakers in the debug.py
69f88db

sohojoe commited on

basic get speech working without streaming
9202468

sohojoe commited on

basic openai support
552fb1e

sohojoe commited on

debugging gpu
92b10f9

sohojoe commited on

prep to test on machine with gpu
35d97c8

sohojoe commited on

switch to open_clip
c58cbbc

sohojoe commited on

video not really work that well
c6ad8e3

sohojoe commited on

Merge branch 'main' of https://huggingface.co/spaces/sohojoe/project_charles
8bf5b8d

sohojoe commited on

get access to the image frames
30bac07

sohojoe commited on

fix python version
e369e39

sohojoe commited on

add basic text to speech
edce499

sohojoe commited on

first commit
4531ec5

sohojoe commited on

initial commit
9d382ff

sohojoe commited on