Beckett Dillon PRO
Severian
AI & ML interests
I make music, teach machines, study nature, and build things.
Articles
Organizations
Posts
8
Post
1895
I'm excited to share a really cool milestone in my AI/LLM journey.
Brief backstory: Before diving into AI, I spent over a decade working in ecological fields such as the conservation corps, biodynamic farming, and natural habitat restoration. This background instilled in me a deep concern about the environmental impact of scaling AI without sustainable practices.
Driven by this concern, I've spent months planning and experimenting to make my AI work more eco-friendly. I'm thrilled to announce that I've successfully transitioned my entire operation to run on 100% sustainable solar power!
My current setup includes multiple linked Mac Pro tower desktops and custom code built from open-source libraries. While it's a bit experimental, this configuration is working great for my needs. All my LLM research, development, and client services now run exclusively on solar energy.
I'm curious if anyone else here has experimented with renewable energy for their LLM work?
For those interested in more details, I've written a brief blog post about this journey here https://medium.com/@betalabsllm/powering-the-future-be-ta-labs-revolutionary-100-solar-powered-ai-operation-444433e61d43
Brief backstory: Before diving into AI, I spent over a decade working in ecological fields such as the conservation corps, biodynamic farming, and natural habitat restoration. This background instilled in me a deep concern about the environmental impact of scaling AI without sustainable practices.
Driven by this concern, I've spent months planning and experimenting to make my AI work more eco-friendly. I'm thrilled to announce that I've successfully transitioned my entire operation to run on 100% sustainable solar power!
My current setup includes multiple linked Mac Pro tower desktops and custom code built from open-source libraries. While it's a bit experimental, this configuration is working great for my needs. All my LLM research, development, and client services now run exclusively on solar energy.
I'm curious if anyone else here has experimented with renewable energy for their LLM work?
For those interested in more details, I've written a brief blog post about this journey here https://medium.com/@betalabsllm/powering-the-future-be-ta-labs-revolutionary-100-solar-powered-ai-operation-444433e61d43
Post
3225
GraphRAG-Ollama-UI
I've been working on a local version of Microsoft's GraphRAG that uses Ollama for everything. It's got a new interactive UI built with Gradio that makes it easier to manage data, run queries, and visualize results. It's not fully featured or set up to harness the entire GraphRAG library yet but it allows you to run all the standard commands for Indexing/Processing and chatting with your graph. Some key features:
Uses local models via Ollama for LLM and embeddings
3D graph visualization of the knowledge graph using Plotly
File management through the UI (upload, view, edit, delete)
Settings management in the interface
Real-time logging for debugging
https://github.com/severian42/GraphRAG-Ollama-UI
I've been working on a local version of Microsoft's GraphRAG that uses Ollama for everything. It's got a new interactive UI built with Gradio that makes it easier to manage data, run queries, and visualize results. It's not fully featured or set up to harness the entire GraphRAG library yet but it allows you to run all the standard commands for Indexing/Processing and chatting with your graph. Some key features:
Uses local models via Ollama for LLM and embeddings
3D graph visualization of the knowledge graph using Plotly
File management through the UI (upload, view, edit, delete)
Settings management in the interface
Real-time logging for debugging
https://github.com/severian42/GraphRAG-Ollama-UI
Collections
5
spaces
28
models
44
Severian/Nexus-IKM-RolePlay-StoryWriter-Hermes-2-Pro-7B-GGUF
Text Generation
•
Updated
•
47
•
1
Severian/Jamba-v0.1-Claude-Chat-GGUF
Updated
•
53
•
3
Severian/Jamba-Bagel-GGUF
Updated
•
115
•
4
Severian/Jamba-UltraInteract-Instruct-1B-gguf
Updated
•
64
•
2
Severian/Jamba-Nexus-4xMoE
Text Generation
•
Updated
•
38
•
10
Severian/Jamba-900M-GGUF
Updated
•
106
•
11
Severian/Llama-3-IMPACTS-2x8B-64k-GGUF
Text Generation
•
Updated
•
139
•
2
Severian/Llama-3-IMPACTS-2x8B-64k-MLX
Text Generation
•
Updated
•
11
•
4
Severian/Jamba-Hercules
Text Generation
•
Updated
•
32
•
12
Severian/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B
Text Generation
•
Updated
•
56
•
1
datasets
6
Severian/IMPACTS
Viewer
•
Updated
•
47.7k
•
66
•
5
Severian/Biomimicry-Nectar-BioDesign-STEM
Viewer
•
Updated
•
2.04M
•
63
•
2
Severian/Internal-Knowledge-Map
Viewer
•
Updated
•
4.69k
•
119
•
44
Severian/Internal-Knowledge-Map-StoryWriter-RolePlaying
Viewer
•
Updated
•
2.07k
•
62
•
10
Severian/Bio-Design-Process
Viewer
•
Updated
•
60k
•
46
•
2
Severian/Biomimicry
Viewer
•
Updated
•
4.85k
•
59
•
3