IllustratorsLeak
3blue1brown
3blue1brown

patreon


The coming of ODEs, and some transitive thanks

Hi everyone,

It's been a little while since I've posted a video, and the next video is likely still a couple of weeks out, so I thought I'd give a little update for anyone curious.

Last month I started writing what I hoped would be a small script on the idea of exponentiating a matrix, not in the sense of M^n, but of e^M.  Oh, silly me.  Drilling in on the questions of "why would you care?" and "what would you need know ahead of time?" has expanded it into several scripts, likely forming the beginning miniseries on differential equations.

In this case, I was actually quite happy let let the scope creep kick in.  As I look over content from the past, the work I feel does the most for the world disproportionately includes videos from series.  If the next few months of effort can be pointed towards content that builds on itself to give a visual and substantive understanding of ODEs, I'd feel great.

Within the unconquerable mountain of requests, there is a fair number on topics related to differential equations, or which would otherwise benefit from a firm footing in that territory.  For example, it opens the door for talking about many interesting ideas from physics not covered in most pop-science outlets, like Hamiltonian mechanics.

Unlike other promised series from the past (*cough* probability *cough*), I have a clear view of what the unifying theme here is where 3b1b-style animations stand to be helpful.  It won't be meant as a comprehensive coverage of ODEs by any means, but will instead be a survey of topics which are made clearer when you have a good feel for phase space and phase flow.  The two main things I'd like to hit are linearization, with some discussion around the significance of eigenvectors for ODEs, and chaos, with discussion of strange attractors.

Although it's not in that theme, Laplace Transforms are heavily requested enough to potentially include in the sequence as well.

If any of these terms sound unfamiliar, don't worry, the first step here will be an introduction aimed at making everything as accessible as possible.

For the curious $4+ patrons among you, you will likely see animations for this start to populate the folder mentioned here this week.

------

Unrelatedly, many people write lovely notes to say thank you for 3blue1brown.  More recently I've started including in the site's contact form a little checkbox to ask if people are comfortable with me sharing their thanks with others who help make the channel possible.  Obviously you are key to making this happen, so I wanted to share a couple excerpts of my favorites from the last month.

To start, one from a high school student.

“Thanks for your videos! I really appreciate that you explain not just concepts but how to attack difficult problems. I just found out today I was the AMC 12 winner at my school and one of only 2 people to advance to AIME. I was super surprised to hear that I had beaten everyone on the math team since I'm more musically inclined and I kinda just tried the AMC for fun. I am sure the only way I did this was because your videos have changed the way I look at those types of problems.”

Here, one returning to math after high school.

“I always wanted to study engineering as a kid but at school I failed Maths badly and dropped it completely. Over my gap year I started watching your videos and you explained it all in a way that just made sense and it hooked my interest. About a year later I've started my BE and I'm loving it. A Thank you doesn't even come close to how much I appreciate you and your work. But Thank You for making an 9yo's dream come true.”

One step later up the academic ladder...

“I really cannot say how you have inspired me. I am an aerospace engineering graduate, with a fascination towards pure physics. I always never dared to venture the pure side of me, but after your videos something tipped inside me, now i am planning to pursue a full phd in physics...if it weren't for your videos I wouldn't have taken a leap of faith. Now I truly enjoy my learning journey of physics. So thank you for inspiring the physicist in me.”

I guess pulling someone from engineering towards math lands them in physics :)

And finally, one more from a high school student.

“Dutch high schools require pupils from the 11th/12th grade to do research related to one of the subjects they have chosen.  I did this with a good friend of mine and we chose the topic of Artificial Intelligence.  More specifically, we chose the topic of Voice Recognition (speaker identification) with Neural Networks.  We have managed to create a program that identifies a speaker based on a 3 second audio file (using the vowel 'E'). 
We wanted to thank you for your videos on Neural Networks and the Fourier Transform because these greatly helped us understanding what it was we were using and explaining them in our final paper.  We have gotten a 9.7/10 for it and we won the prize of the best paper of our school this year so we would like to thank you again for making such great educational videos on the internet for anyone to access and to understand topics that might not be so straight forward.”

More anecdotally, shifting from students to the working world, I recently paid a visit to OpenAI in SF.  I was touched to hear from many people there that they found 3b1b videos meaningful either for how they think about their work, or how they think about communicating it.  Of course, they may just have been saying this to be warm and welcoming hosts, but it made me smile nonetheless.

Thank you again for the support, and hopefully see you soon with some new content!

-Grant

Comments

One of the next videos I'll put out will be on the heat equation. Maybe I'll frame that as part of the differential equation series, or maybe just as its own thing. We'll see!

3blue1brown

Hmm...maybe I'll put in an order once the current batch starts running low. I could also potentially do a patron-only thing. Stay posted!

3blue1brown

The 3B1B store is also great. I have collected 3 blue plushies. When do the Brown Plushies arrive?

Can't wait! Will, there be any reference to PDEs, or maybe if and how they relate to ODEs?

Thanks for the kind words, it's always interesting to hear how viewers come from all walks of life. I think mathematicians vary widely in how much they try to visualize the formulas they work with. Those who do often don't need software for it, imagination can be a powerful enough tool, but many seem content to work with the logic alone.

3blue1brown

I am studying exact/inexact 1st order ODEs and have a strong feeling there is untapped insight hiding in the geometry. This question (<a href="https://math.stackexchange.com/questions/3141702/exact-differential-equation-geometry)" rel="nofollow noopener" target="_blank">https://math.stackexchange.com/questions/3141702/exact-differential-equation-geometry)</a> might be the start of an interesting video, fleshed out by an exploration of how various types of integrating factors (exact separable -&gt; exact separated, inexact separable -&gt; exact separated, exact linear pre-integrating factor -&gt; exact linear post-integrating factor, inexact linear pre-integrating factor -&gt; exact linear post-integrating factor, inexact nonlinear -&gt; exact nonlinear [where integrating factor is function of only x or only y], differential form manipulation [i.e., d(xy) = xdy + ydx], etc.) visually affect the curl or other attributes of the vector field [M N]^T. I think this could be super interesting and possibly even lead to a general technique for finding integrating factors that are functions of both x and y, which is currently considered hard I believe.

I am 81 and I have truly enjoyed your visualization of mathematical concepts. My last math class was calculus at Yale in 1957. In business, I worked as an investment banker on Wall St. At that time, we had state-of-the-art Wang calculators to run all the numbers on our corporate clients, both equity and debt. Thus, you can imagine what people my age enjoy with your type of program. Voila!!! The only question is---how did earlier mathematicians imagine the formulas they created?

John C. Vesey

The differential equations that show up in QM are generally partial differential equations (PDEs) and not ODEs. Still, I guess understanding ODEs can help with understanding PDEs, but they’re quite a different beast that would deserve their own video series

Sascha Baer

Did you see this one? <a href="https://www.youtube.com/watch?v=rB83DpBJQsE" rel="nofollow noopener" target="_blank">https://www.youtube.com/watch?v=rB83DpBJQsE</a>

3blue1brown

Thanks for sharing those lovely comments. You're having a positive impact, keep it up.

Andrew Mitchell

Well, I hope this gives some of what you're looking for. Necessarily it can't be comprehensive, but the aim will be for the selected topics and general framework to give some meaningful transferable intuitions.

3blue1brown

I am really psyched about this series. I've been very busy with differential equations the last year (PDEs in the moment) and always wished I could get to know the subject in a more intuitive/graphical way. Keep up the great work!

Please do include a vid on the laplace transform!!

John Bryant

A (mini)series on ODEs sounds great! It seems right to mix series on core topics with one-offs but I will admit that as someone who is trying to study undergrad math formally, I am particularly excited about another foundational area getting the 3b1b series treatment. I can't really make requests as it seems to me that you'd make fantastic and thoughtful video content in all the core areas of undergrad math. But differential equations sounds like a great next destination to me. Personally I haven't done a great job of getting into the basics: I've seen the basic material on manually solvable equations (separable equations and integrating factors etc), and I've been introduced to the idea that the solutions form a vector space. Then I tried a more theoretical course on existence theorems which was probably a bit too advanced for me, and now I'm thinking that perhaps I should take a introductory mathematical physics course and be introduced to DEs in a more concrete setting, but haven't got round to it.

Dan Davison

This post should contain all that have not been made public yet: <a href="https://www.patreon.com/posts/so-whats-deal-19845962">https://www.patreon.com/posts/so-whats-deal-19845962</a>

3blue1brown

Make video on format's last theorem , bill conjecture topics visualisation

Plz make video on visualisation on gradient, curl, Electro magnetic theory.

Grant, thank you for showing us how beautiful math is! Looking forward for the upcoming videos :)

A complete 3D image/model of the complex function w=e^s can be drawn with the w plane cutting the s plane which has been rolled into a cylinder by just adding an e^x shaped horn inside the cylinder with the axis aligned. You have the w plane and s cylinder part of this already as I saw in some of your past videos. Any point, line, or shape on w or s can then be mapped to s or w by projecting to the horn and then to the other plane. I envisioned this 3D model some 30+ years ago and have never published it, nor seen it completed anywhere. Nevertheless, I think this 3D mapping would be very useful for many of your videos (Laplace transform the most obvious). Other complex functions may be possible using a similar 3D model. Feel free to use it and please email me if my description is not clear. Thanks for the many good videos.

I'm so glad you're doing videos on ODE's I think it will help a lot of people. I'm currently in quantum mechanics learning about the Schrodinger equation and it's been difficult for me to wrap my head around eigenstates and eigenfunctions. I think a better visual intuition into ODE's will help a lot.

I had to google ODE. Look forward to what you do with Chaos and strange attractors.

Thanks Grant! I really appreciate your selection of topics. Since you mentioned exponentiating matrices...some recent papers at NIPS on neural ODEs connect finite differences of operators to propagators ala exp(-dtM). Since you've made content on neural networks, this could be an interesting loop to close.

Do you have a link to the whole collection of your Patreon videos?

Ludwig, no! I can only handle so many fascinating rabbit holes at a time. In seriousness, this looks fascinating. Maybe there will be a convergence between he ODE series and the (currently dormant) NN series in the future.

3blue1brown

I'm glad to hear that you're looking at creating a new series. I also feel that those have the most value.

If you want to go down another rabbit hole connecting your recent visit with the new series, take a look at this paper reframing residual networks as ODEs: <a href="https://arxiv.org/pdf/1806.07366.pdf" rel="nofollow noopener" target="_blank">https://arxiv.org/pdf/1806.07366.pdf</a>

Maybe, although the main focus will be on how exponentiating a matrix helps to understand linear ODEs (and local-linearizations of nonlinear ODEs), so to prevent further scope creep I might keep the focus on what problems this operation solves, rather than its cousin operations.

3blue1brown

Cool - sounds interesting. Will you also cover log of a matrix? That can be fun.

ordinary differential equation

What's an ODE?


More Creators