Blog posts

2024

DropPath

3 minute read

Published:

While working on my latest project, I had to dive deep into the huggingface’s transformers codebase. In the process, I ventured into Swin Transformer territory—an innovative vision transformer designed for hierarchical feature representation. It was here that I noticed something that piqued my curiosity. Below is the code block that initially caught my attention: