Lyell Hintz

Touchdesigner 2023 Released !! (Incompatibility warning / fixes coming soon)

Hey Friends ! I am super excited about all the new features / improvements that the new version of Touchdesigner has introduced and I expect it will lead to many new opportunities for optimization / new tricks with the operators. However, I do expect that some of the backwards compatibility issues may break some / many of my operators. I am going to be looking into it this ASAP and will be stre...

OpenAIAudio TOX [0.0.3 updated]

Updated TOX here - https://www.patreon.com/posts/102742032?pr=true

OpenAI speech-to-text (STT) and text-to-speech (TTS) API Integration for TouchDesigner

Uploaded 0.0.3 - Removes timer with error par.Length + a few menu cleanups. 

🎙️ Speech-to-Text - Uses the 'Whisper' API endpoin...

ChatTD 💬 + Dalle 3 + Vision + More [ 1.1.1 ]

Updated to include a few api endpoints that openai announced last Monday.
🙈  Vision - (must use model 'gpt-4-vision-preview') You can now input an image to chatTD op to be seen by the system along with the message. Top Image parameter will reference and save from a Top reference.
📷 Dalle Image Generation - Integrated DALL-E model for generating images directly from text prompts...

MusicGen🎶 1.6.2 TOX File

Lots of changes ! Extension class + callbacks / generally updated this to be more in line with my other current operators.
- Fixed Seed to be deterministic
- Fixed extra model loaded in vram (shouldn't go over ~16 at maximum for musicgen only)
- Added unload model command to free up vram but keep server listening
- Added support for Audiogen model (although haven't really gotten an...

MusicGen🎶 1.6

Playback UI + AudioGen support + callbacks + improved/fixed memory handling + more

ChatTD💬

I have been using this a lot recently and realized I haven't released it yet !
Available now !

ChatTD💬 1.0.0 TOX file

ChatGPT API operator with callable extension class. plus more:
- Callbacks (onGenerate, onDone, onError)
- 'Update / Add to Chat' toggle to freeze conversation for repeatable requests
- Conversation saving and loading (full conversation is based in a single table that can be edited / customized)
- Outs for last/selected response, CHOPs, full conversation, and full chat history outpu...

ComfyUI Demo Project ! (setup guide, AnimateDiff + more)

Hey ! here is a zipped project file with 4 different ComfyTD setups + notes on each workflow in one network. If you have ComfyUI installed, you can unzip the file and open the TDproject within the sample project folder structure.
Config-Net includes:
- txt2img
- img2img / loopback / simple deforum setup
- animatediff txt2vid simple
- animatediff vid2vid with controlnet input <...

ComfyTD 0.0.8 - New Features 🛠 [tiny update: 0.0.7 was missing new callbacks script]

Hey ! I've added some improvements for functionality and easier setup... see new features below ! A demo project file featuring 4 demo ComfyTD setups is available in a separate post. For feedback, feel free to DM me on Discord or post in our server - find the invite link in the 'About' parameter page of the operator.
- Lyell

• Alt + Hover Pop Ups - If you see something new/strange,...
  2023-10-21 22:37:05 +0000 UTC View Post

Update / Check in !

Hey friends !
Big recent change to the UI seems to make it a bit easier to see comments and things on Patreon... I see a few messages that I missed and will try and get back to you !
Discord is still the best way to @me or dm for support, questions, inquries, etc.
I plan to be putting out more release info / workflows this month. Ive been recently messing with my ComfyUI tool to test ...

TUTORIAL: Simple ControlNet Loops

Hey Friends 🌟

I did the thing (full tutorial... first of many ! ). I hope you find something in it helpful! It is a fairly simple project using a fun technique to create some looping animations with SDapi + ControlNet. Depending on your understand of Touchdesigner or SDapi, there are maybe some sections you can skip (check the time stamps), but I tried to include some helpful logic and...

ComfyTD 🧩

🎉 ! Excited to announce that ComfyTD is now available for all !

ComfyUI is a powerhouse node-based program that has gotten a ton of development lately! From simple text-2-image transformations to elaborate node setups that manage numerous upscaling/diffusion cycles, and some that do full deforum / warpfusion like animation setups. This operator allows any ComfyUI node setup to be pro...

ComfyUI Touchdesigner Operator

A quick video going over the setup of an early version of a Touchdesigner operator that works with ComfyUI, the node based Stable Diffusion GUI - https://github.com/comfyanonymous/ComfyUI

Available for early testers via discord #test-kitchen channel. Message me on discord to get added!

SD_API 2.0 pre-release version

Same version from my previous post if you have already downloaded it!
will likely update the operator slightly for the 2.0 official version, but this is very close with a few known bugs.

Controlnet outputs currently do not get sent back and saved per frame - I will be fixing this soon.
Dreamstudio is not currently working. I will need to add this back in for 2.0 or create a separ...

SDAPI 2.0 (early access) + Installing Automatic1111 from inside TD

Hey friends! Ive been super busy rebuilding the internals of SDapi to make it much more functional and even more of a powerhouse. It is still being tested as of now, but it is extremely close and ready for feedback. I'm going to attach an early version of SDapi 2.0 to a patreon only post. as it will be needed for this video and some others I have upcoming / planned. I was hoping to get more out...

SD API Basic Settings

Hey Friends ! This is a slightly outdated video but all the knowledge still applies. I hope to put out a lot more resources over the course of the next month so stay tuned! My goal is to post a few breakdowns of different ways to use SD_API in touchdesigner each week for August. If you have any ideas or things you would like to know more about, please comment or shoot me a message.

Some ...

SD_API 1.22

SD_API 1.22 !
New Features:
-One click launch automatic1111 from Touchdesigner
-Switch SD Models via SD_API
-Completely updated Dreamstudio API, including support for SDXL
-Multi-Controlnet - redesigned controlnet setup that adds an external controlnet operator per layer (released in 1.2)
-QOL improvements / organization across the operator
[removed the 'Outputlastframe' e...

[UPDATE 1.35 - improved workflow + more] Download Link - MusicGen TD + visualizer TOX

Hey Friends. Attached to this post are the base operator that contains everything you need to start generating music with AI in Touchdesigner and an accompanying visualizer.

I created a new channel on my discord for sharing fun outputs/prompts or techniques, etc. Hope to see you there ! 

MusicGen ! text2music in Touchdesigner

I've built a MusicGen Touchdesigner tool for creating music from text inside of Touchdesigner. Here is a little visualizer I made with some of the outputs from the past day of experimenting.

MusicGen TD is now available on my discord server for Patreons! As well as the visualizer used in this video.

The operator includes an easy one click install of all necessary libraries (must ...

Text2Video TD: Operator for AI-Generated Videos

Hey friends!

I am super excited to share Text2Video, a TouchDesigner operator designed to generate AI-generated videos using text prompts or input videos or images !

[ Project file includes a in-network GUI for easy control as well as the prompts used to create these videos !! AVAILABLE ON DISCORD - or if thats not your thing, shoot me a message on here or instagram and I can sha...

SD_API Major Update

Check out the latest features below.

SD_API 1.12 !!

New to SD_API 1.12:
- "img2img alternative test" script added. Check bottom of 'Main Settings' Tab
-  Controlnet text 2 image and image 2 image calls work with recent API changes + supports t2i Style Module / clip_vision
- Fixed the set end frame function in the 'Output Folder' Tab

Recent MAJOR updates (all sin...

Discord Stream / Demo / Questions 4pm EST

I'll be live on discord at 4pm EST !

Demoing Controlnet / Ebsynth / Improved color matching / framematching all within Touchdesigner.

Come hang out and say hello!

https://discord.gg/qyKThBtD?event=1080707645608038400

SD_API 1.02 update

Lots of CHOP info for easier network references!

Progress Bar / Connection status for automatic1111!

Improved asynchronous logic / no more FPS drops when images are sent/received

Improved UI + a few other bugs squashed

SD_API v1.0 released ! added Dreamstudio Beta

More updates coming soon!

*plus many more things available in the discord*

Discord Request / Project File with Notes

Someone posted a clip in the discord asking if a certain audio reactive effect was possible with the current tools... I took a stab at it and the setup ended up being a great example project to start creating audio reactive animations with TD + SD. Project is annotated to give a general overview of my logic / approach.

Touchdesigner / Automatic1111 workflow early access

Get early access to a procedural approach for Stable Diffusion in Touchdesigner with Automatic1111 on your local GPU. Create custom animations pipelines, photo tools, and new workflows.

txt2img & img2img & inpainting/outpainting

The base operator and a sample project with several other custom SD tools inside are available now to Patrons. Come test out Stable Diffusion with a...