What is Deep Learning?

• Deep Learning networks are the mathematical models that are used to mimic the human
brains as it is meant to solve the problems using unstructured data, these mathematical
models are created in form of neural network that consists of neurons.
• The neural network is divided into three major layers that are input layer( first layer of neural
network), hidden layer (all the middle layer of neural network) and the output layer(last layer
of the neural network.).
• Based upon these types of data we will deal with these neural networks that are classified as
a feed-forward neural network, CNN, RNN, Modular neural network, etc.
• Deep learning is a subset of machine learning, which is essentially a neural network with
three or more layers. These neural networks attempt to simulate the behavior of the human
brain—albeit far from matching its ability—allowing it to “learn” from large amounts of data.
While a neural network with a single layer can still make approximate predictions, additional
hidden layers can help to optimize and refine for accuracy.
• Deep learning drives many artificial intelligence (AI) applications and services that improve
automation, performing analytical and physical tasks without human intervention. Deep
learning technology lies behind everyday products and services (such as digital assistants,
voice-enabled TV remotes, and credit card fraud detection) as well as emerging technologies
(such as self-driving cars).Deep
Understanding Neural Network
• In simple terms, neural networks are representative
of the human brain, and they are specificially made
to recognize patterns.
• They interpret data through various models. The
patterns that these models detect are all numerical
specifically in the form of vectors.
• Artificial neural networks are computation systems
that intend to imitate human learning capabilities via
a complex architecture that resembles the human
nervous system.
Understanding Neural Network
Neural Network

As seen above, there is an input layer, an output layer, and in between, there are
several hidden layers. For any neural network, there would be at least one hidden
layer. A deep neural network is one that has more than one hidden layer.
Neural Network
INPUT LAYER
The input layer accepts large volumes of data as input to build the neural network. The
data can be in the form of text, image, audio, etc.

HIDDEN LAYER
This layer processes data by performing complex computations and carries out feature
extraction. As part of the training, these layers have weights and biases that are
continuously updated until the training process is complete. Each neuron has multiple
weights and one bias. After computation, the values are passed to the output layer.

OUTPUT LAYER
The output layer generates predicted output by applying suitable activation functions.
The output can be in the form of numeric or categorical values.
Deep Learning Frame works
Many Deep Learning Frameworks are freely available in the market like TensorFlow,
Keras, Pytorch, Theano, MXNet, Caffe, Deeplearning4j, etc. Out of them, the most
popularly used frameworks are TensorFlow, Keras, and Pytorch
Tensorflow

• Tensorflow is popular deep learning framework developed by Google Brains and was
used propriety for conducting research. It is written in C++ and Python.
• It uses dataflow graphs as a data structure at the backend and the nodes of the
graph represent a set of mathematical operations to be performed. The edges of the
graph represent multidimensional arrays or tensors.
• Recently Tensorflow has integrated Keras in its latest v2.0 version as tf.keras
package. Like Keras, it is platform-independent and can run on CPU, GPU, and TPUs.
• It is also open source and it can be installed using python installer or by cloning the
Github repository.
Keras
• It is a high-level Open Source Neural Networks framework that is written in Python
and uses TensorFlow, CNTK, and Theano as backend.
• It has good documentation and is easy to use. Thus, it is used in fast-paced
environments, preferably in research where fast experimentation results are
needed.
• It is modular and extensible and platform-independent as it can run on CPU, GPU
as well as TPUs.
• Keras was developed and maintained by François Chollet, a Google engineer.

• Keras comes packaged with TensorFlow 2 as tensorflow.keras. To start using Keras,

simply install TensorFlow 2.
• Keras/TensorFlow are compatible with:
• Python 3.7–3.10
• Ubuntu 16.04 or later
• Windows 7 or later
Keras Models

• The Sequential model, which is very straightforward (a simple list of layers), but is
limited to single-input, single-output stacks of layers (as the name gives away).
• The Functional API, which is an easy-to-use, fully-featured API that supports
arbitrary model architectures. For most people and most use cases, this is what you
should be using. This is the Keras "industry strength" model.
• Model subclassing, where you implement everything from scratch on your own. Use
this if you have complex, out-of-the-box research use cases.
Deep Learning Advantages
1. No Need for Feature Engineering:
Feature engineering is the process of extracting features from raw data to better
describe the underlying problem. It is a fundamental job in machine learning as it
improves model accuracy. The process can sometimes require domain knowledge about
a given problem.
To better understand feature engineering, consider the following example.
In the real estate business, the location of a house has a significant impact on the selling
price. Suppose the location is given as the latitude and the longitude. Alone these two
numbers are not of any use but put together they represent a location. The act of
combining the latitude and the longitude to make one feature is feature engineering.

One of deep learning’s main advantages over other machine learning algorithms is its
capacity to execute feature engineering on it own. A deep learning algorithm will scan
the data to search for features that correlate and combine them to enable faster learning
without being explicitly told to do so. This ability means that data scientists can
sometimes save months of work. Besides, the neural networks that a deep learning
algorithm is made of can uncover new, more complex features that human can miss
Deep Learning Advantages
Best Results with Unstructured Data:
According to research from Gartner, up to 80% of a company’s data is unstructured
because most of it exists in different formats such as texts, pictures, pdf files and more.
Unstructured data is hard to analyze for most machine learning algorithms, which
means it’s also going unutilized. That is where deep learning can help.
Deep learning algorithms can be trained using different data formats, and still derive
insights that are relevant to the purpose of its training. For example, a deep learning
algorithm can uncover any existing relations between pictures, social media chatter,
industry analysis, weather forecast and more to predict future stock prices of a given
company.
Deep Learning Advantages
No Need for Labeling of Data:
Getting good-quality training data is one of the biggest problems in machine learning
because data labeling can be a tedious and expensive job.
Sometimes, the data labeling process is simple but time-consuming. For example,
labeling photos “dog” or “muffin” is an easy task, but an algorithm needs thousands of
pictures to tell the difference. Other times, data labeling may require the judgments of
highly skilled industry experts, and that is why, for some industries, getting high-quality
training data can be very expensive.

Let’s look at the example of Microsoft’s project InnerEye, a tool that uses computer
vision to analyze radiological images. To make correct, autonomous decisions, the
algorithm requires thousands of well-annotated images where different physical
anomalies of the human body are clearly labeled. Such work needs to be done by a
radiologist with experience and a trained eye. According to Glassdoor, an average base
salary for a radiologist is $290.000 a year, which puts the hourly rate just short of $200.
Given that around 4-5 images can be analyzed per hours, proper labeling of all images
will be expensive.
Deep Learning Advantages

Better Self-Learning Capabilities:

• The multiple layers in deep neural networks allow models to become more efficient
at learning complex features and performing more intensive computational tasks,
i.e., execute many complex operations simultaneously.
• It outshines machine learning in machine perception tasks (aka the ability to make
sense of inputs like images, sounds, and video like a human would) that involve
unstructured datasets.
• This is due to deep learning algorithms' ability to eventually learn from its own
errors. It can verify the accuracy of its predictions/outputs and make necessary
adjustments. On the other hand, classical machine learning models require varying
degrees of human intervention to determine the accuracy of output.
Important Link

• https://
www.simplilearn.com/machine-learning-vs-deep-learning-major-differences-you-n
eed-to-know-article
• https://www.simplilearn.com/flaws-in-machine-learning-and-how-deep-learning-
is-helping-article