What
You’ll Learn
You’ll Learn
- What are transformer networks?
- State of the Art architectures for CV Apps like Image Classification
- Semantic Segmentation
- Object Detection and Video Processing
- Practical application of SoTA architectures like ViT
- DETR
- SWIN in Huggingface vision transformers
- Attention mechanisms as a general Deep Learning idea
- Inductive Bias and the landscape of DL models in terms of modeling assumptions
- Transformers application in NLP and Machine Translation
- Transformers in Computer Vision
- Different types of attention in Computer Vision
Requirements
- Practical Machine Learning course
- Practical Computer Vision course (ConvNets)
- Introduction to NLP course
Description
Transformer Networks are the new trend in Deep Learning nowadays. Transformer models have taken the world of NLP by storm since 2017. Since then, they become the mainstream model in almost ALL NLP tasks. Transformers in CV are still lagging, however they started to take over since 2020.
We will start by introducing attention and the transformer networks. Since transformers were first introduced in NLP, they are easier to be described with some NLP example first. From there, we will understand the pros and cons of this architecture. Also, we will discuss the importance of unsupervised or semi supervised pre-training for the transformer architectures, discussing Large Scale Language Models (LLM) in brief, like BERT and GPT.
This will pave the way to introduce transformers in CV. Here we will try to extend the attention idea into the 2D spatial domain of the image. We will discuss how convolution can be generalized using self attention, within the encoder-decoder meta architecture. We will see how this generic architecture is almost the same in image as in text and NLP, which makes transformers a generic function approximator. We will discuss the channel and spatial attention, local vs. global attention among other topics.
In the next three modules, we will discuss the specific networks that solve the big problems in CV: classification, object detection and segmentation. We will discuss Vision Transformer (ViT) from Google, Shifter Window Transformer (SWIN) from Microsoft, Detection Transformer (DETR) from Facebook research, Segmentation Transformer (SETR) and many others. Then we will discuss the application of Transformers in video processing, through Spatio-Temporal Transformers with application to Moving Object Detection, along with Multi-Task Learning setup.
Finally, we will show how those pre-trained arcthiectures can be easily applied in practice using the famous Huggingface library using the Pipeline interface.
Who this course is for:
- Intermediate to Advanced CV Engineers
- Intermediate to Advanced CV Researchers
🔝
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Infos:
Are you thinking about upgrading your home security systems?
It's a wise investment, especially in today's world. With crime rates on the rise, ensuring the safety of your loved ones and property is paramount. But where do you start? Well, let's break it down.
Firstly, consider consulting with a reputable personal injury lawyer. Accidents happen, and having legal protection in place can provide peace of mind. Whether it's a slip and fall incident or a car accident, having a legal expert on your side can make all the difference.
Once you've addressed your legal concerns, it's time to focus on your financial security. Exploring options like mortgage rates and personal loans can help you achieve your goals. Maybe you're considering a home renovation project or even looking into real estate investment opportunities. Whatever your financial aspirations, having the right information at your fingertips is crucial.
Now, let's talk technology. Cloud computing services are revolutionizing the way businesses operate. Whether you're a small startup or a multinational corporation, leveraging the power of the cloud can streamline your operations and enhance productivity. And don't forget about cybersecurity. With the increasing prevalence of cyber threats, investing in antivirus software is non-negotiable.
Of course, amidst all the hustle and bustle, it's essential to take care of your health. Health supplements can bolster your immune system and keep you feeling your best. And if you're considering cosmetic surgery, be sure to do your research and consult with a reputable provider.
Finally, let's not forget about relaxation and recreation. Planning a luxury vacation or a cruise getaway? Don't overlook the importance of travel insurance. It's a small investment that can save you a lot of hassle in the long run.
In conclusion, whether you're prioritizing your safety, financial security, technological advancement, health, or leisure, there are plenty of options available to you. By making informed decisions and seeking expert advice when needed, you can navigate life's challenges with confidence and ease Continue reading...: Click Here