README.md

---
title: 🧠Omni GPT 4o Text Audio Image Video
emoji: 🐠🔬🧠
colorFrom: gray
colorTo: blue
sdk: streamlit
sdk_version: 1.34.0
app_file: app.py
pinned: true
license: mit
---


GPT-4o Documentation:  https://cookbook.openai.com/examples/gpt4o/introduction_to_gpt4o

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

This experimental multi agent mixture of expert system uses a variety of techniques and models to create different combinatorial AI solutions.

Models Used:

Mistral-7B-Instruct
Llama2-7B
Mixtral-8x7B-Instruct
Google Gemma-7B
OpenAI Whisper Small En
OpenAI GPT-4o, Whisper-1
ArXiV Embeddings
The techniques below which are not ML models but AI include:

Speech Synthesis using browser technology
Memory for semantic facts, and episodic emotional and event time series memories
Web integration using the q= standard for search linking allowing comparison of tech giant AI implementations:
Bing then Bing copilot with click 2
Google which does an AI search now
Twitter, the new home for technology discoveries, AI Output and Grok
Wikipedia for fact checking
YouTube
File and metadata integration combining text, audio, image, and video
This app also merges common theories in cognitive AI, AI with python libraries (e.g. NLTK, SKLearn).

The intent is to demonstrate SOTA AI/ML and combinations of Function-Input-Output for interoperability and knowledge management.

This space also serves as an experimental test bed for new technologies mixing it in with old for comparison and integration.

--Aaron