This Space is a playground designed to experiment with generating 360-degree images for use in Virtual Reality (VR) experiences. It utilizes A-Frame to render the images as WebXR using a Text-to-VR approach. This demonstration was presented at the MHESI Fair 2024 in Thailand.
It is conducted by the College of Creative Design and Entertainment Technology, Dhurakij Pundit University, in the lab of Asst. Prof. Banyapon Poolsawas under the MIT License.
SD-T2I-360PanoImage Generate 360° Panorama Image Generation
[Github]
[Models]
"""
def create_aframe_html(image):
buffered = io.BytesIO()
image.save(buffered, format="JPEG")
img_str = base64.b64encode(buffered.getvalue()).decode('utf-8')
return f"data:image/jpeg;base64,{img_str}"
with gr.Blocks(theme=gr.themes.Soft()) as demo:
gr.HTML(title)
with gr.Row():
with gr.Column():
t2p_input = gr.Textbox(label="Enter your prompt", lines=3)
t2p_upscale = gr.Checkbox(label="Upscale (takes about 60 seconds 6144x3072 resolution)")
t2p_generate = gr.Button("Generate 360° Image")
with gr.Column(variant="panel"):
t2p_output = Pannellum(show_label=False, interactive=True)
with gr.Row():
t2p_image_output = gr.Image(label="Generated 360°Image")
# New A-Frame Code Block
with gr.Row():
output_html = gr.Textbox(label="A-Frame HTML Code (Copy and use in Glitch)", lines=15, interactive=False)
gr.Markdown("""
**Copy this code for Glitch.com:**
1. Create a new Glitch project ([https://glitch.com/](https://glitch.com/)).
2. Choose the **hello-webpage** template.
3. Paste this HTML code into the `index.html` file.
""")
update_trigger = gr.State(value=0)
def generate_with_update(prompt, upscale, trigger):
output, image = text_to_pano(prompt, upscale)
image_url = create_aframe_html(image)
html = f"""