A great, slightly more in depth (without being mathy) explanation of transformer models. Mostly talking about AlexNet, an image classifier from 2012. Goes over some history and has some very interesting looks under the hood.

He does use some personifying language for these models, but that’s unfortunately the case for most information on the topic.

5 points

This is mostly about convolution neural networks, which don’t really work the same way as transformers. transformers weren’t invented until 2017 and they are most like a more complex version of a recurrent neural network (even that is simplifying it)

permalink
report
reply

Of course I messed it up. I thought the transformer paper was newer then 2012, but I remembered them being mentioned in the beginning of the video. I should have rewatched to make sure I understood.

permalink
report
parent
reply
2 points

Honestly the video made it sound like CNNs were a part of transformers, so I’d blame the video before yourself

permalink
report
parent
reply

I found a YouTube link in your post. Here are links to the same video on alternative frontends that protect your privacy:

permalink
report
reply

videos

!videos@hexbear.net

Create post

Breadtube if it didn’t suck.

Post videos you genuinely enjoy and want to share, duh. Celebrate the diversity of interests shared by chapochatters by posting a deep dive into Venetian kelp farming, I dunno. Also media criticism, bite-sized versions of left-wing theory, all the stuff you expected. But I am curious about that kelp farming thing now that you mentioned it.

Low effort / spam videos might be removed, especially weeb content.

There is a cytube that you can paste videos into and watch with whoever happens to be around. It’s open submission unless there’s something important to commandeer it with at the time.

A weekly watch party happens every Saturday (Sunday down under), with video nominations Saturday-Monday, voting Monday-Thursday. See the pin for whatever stage it’s currently in.

Community stats

  • 1.2K

    Monthly active users

  • 477

    Posts

  • 1.5K

    Comments