Unit-IV

Deep Learning
Introduction
Deep learning has emerged as a pivotal technology in
artificial intelligence, allowing machines to learn from vast
amounts of data and make intelligent decisions.
01

Deep Learning
Concept
Definition of
deep learning

Deep learning is a subset of machine learning that utilizes

neural networks with three or more layers. These networks
are designed to simulate the way the human brain operates
and can learn from large volumes of data, thereby enabling
complex tasks such as image and speech recognition.
Key
characteristics
Key characteristics of deep learning include its ability to automatically
extract features from raw data, its reliance on large datasets for training,
and the use of multiple layers that allow for increasingly abstract
representations of data.
Additionally, deep learning models are generally more accurate than
traditional approaches for many tasks due to their capacity to learn
intricate patterns.
Comparison with traditional
machine learning
Deep learning fundamentally differs from traditional
machine learning in several ways. While traditional
machine learning often requires extensive feature
engineering—wherein a human expert extracts
features from raw data for the model to learn—deep
learning models automatically identify and learn
features through multi-layered neural networks.
This allows deep learning models to handle
unstructured data types such as images, text, and
audio more effectively, resulting in higher
performance on tasks like natural language processing
and image recognition.
Types of Deep
Learning
Supervised
learning

Supervised learning involves training a model on a labeled

dataset, where each training example is paired with an output
label. This method enables the model to learn the relationship
between inputs and outputs, making it suitable for tasks like
classification and regression.
The model's performance is evaluated using metrics that measure
how accurately it predicts outcomes on new, unseen data.
Unsupervised
learning
Unsupervised learning, in contrast, deals with unlabeled data. Here,
the model attempts to find hidden patterns or intrinsic structures
within the data, such as grouping similar items together (clustering)
or identifying associations among different variables (association).
This approach is commonly used in applications like customer
segmentation and anomaly detection.
Reinforcement learning

Reinforcement learning is a unique paradigm in which an

agent learns to make decisions by taking actions in an
environment to maximize cumulative rewards. Unlike
supervised learning, there are no explicit correct answers;
instead, the agent relies on trial and error to discover which
actions lead to the most favorable outcomes.
This approach has been successfully applied to game playing,
robotics, and autonomous systems.
Top Applications of Deep Learning Across Industries

• Self Driving Cars

• News Aggregation and Fraud News Detection
• Natural Language Processing
• Virtual Assistants
• Entertainment
• Visual Recognition
• Fraud Detection
• Healthcare
• Personalisations
• Detecting Developmental Delay in Children
Top Applications of Deep Learning Across Industries

• Colorization of Black and White images

• Adding sounds to silent movies
• Automatic Machine Translation
• Automatic Handwriting Generation
• Automatic Game Playing
• Language Translations
• Pixel Restoration
• Photo Descriptions
• Demographic and Election Predictions
• Deep Dreaming
What is a Neural Network?

• Neural networks are machine learning models that mimic the

complex functions of the human brain.
• These models consist of interconnected nodes or neurons
that process data, learn patterns, and enable tasks such as
pattern recognition and decision-making.
What is a Neural Network?
Neural Networks in Deep Learning
Neural networks are capable of learning and identifying patterns directly from
data without pre-defined rules. These networks are built from several key
components:
• Neurons: The basic units that receive inputs, each neuron is governed by a
threshold and an activation function.
• Connections: Links between neurons that carry information, regulated by
weights and biases.
• Weights and Biases: These parameters determine the strength and
influence of connections.
• Propagation Functions: Mechanisms that help process and transfer data
across layers of neurons.
• Learning Rule: The method that adjusts weights and biases over time to
improve accuracy.
Types of Neural Networks
• Feedforward Networks: A feedforward neural network is a simple artificial neural network
architecture in which data moves from input to output in a single direction.
• Singlelayer Perceptron: A single-layer perceptron consists of only one layer of neurons . It takes
inputs, applies weights, sums them up, and uses an activation function to produce an output.
• Multilayer Perceptron (MLP): MLP is a type of feedforward neural network with three or more layers,
including an input layer, one or more hidden layers, and an output layer. It uses nonlinear activation
functions.
• Convolutional Neural Network (CNN): A Convolutional Neural Network (CNN) is a specialized artificial
neural network designed for image processing. It employs convolutional layers to automatically learn
hierarchical features from input images, enabling effective image recognition and classification.
• Recurrent Neural Network (RNN): An artificial neural network type intended for sequential data
processing is called a Recurrent Neural Network (RNN). It is appropriate for applications where
contextual dependencies are critical, such as time series prediction and natural language processing,
since it makes use of feedback loops, which enable information to survive within the network.
• Long Short-Term Memory (LSTM): LSTM is a type of RNN that is designed to overcome the vanishing
gradient problem in training RNNs. It uses memory cells and gates to selectively read, write, and erase
information.
Applications of Neural Networks
• Image and Video Recognition: CNNs are extensively used in
applications such as facial recognition, autonomous driving, and
medical image analysis.
• Natural Language Processing (NLP): RNNs and transformers
power language translation, chatbots, and sentiment analysis.
• Finance: Predicting stock prices, fraud detection, and risk
management.
• Healthcare: Neural networks assist in diagnosing diseases,
analyzing medical images, and personalizing treatment plans.
• Gaming and Autonomous Systems: Neural networks enable real-
time decision-making, enhancing user experience in video games
and enabling autonomous systems like self-driving cars.