Chapter-Four

Contents
• After accomplishing this chapter, Students will
be able to:
– Describe IoT
– Explain the history of IoT
– Describe the pros and cons of IoT
– Explain how IoT works
– Explain the architecture of IoT
– Describe IoT tools and platforms
– Describe some of the application areas of IoT
 Introduction
• The most important features of IoT include artificial intelligence, connectivity, sensors,
active engagement, and small device use. 
• AI: This can mean something as simple as enhancing your refrigerator and ca: “:binets
to detect when milk and your favorite cereal run low, and to then place an order with
your preferred grocer.
• Connectivity: . Networks can exist on a much smaller and cheaper scale while still
being practical. IoT creates these small networks between its system devices
• Sensors: They act as defining instruments that transform IoT from a standard passive
network of devices into an active system capable of real-world integration.
• Active engagement: IoT introduces a new paradigm for active content, product, or
service engagement.
• Small devices: Devices, as predicted, have become smaller, cheaper, and more
powerful over time. IoT exploits purpose-built small devices to deliver its precision,
scalability, and versatility.
 IoT= Services + Data + Networks + Sensors

Internet of things

describes the network of physical

objects—“things”—that are
embedded with sensors, software,
and other technologies for the
purpose of connecting and exchanging
data with other devices and systems
over the internet.
 More pros and cons of IOT
• Improved Customer Engagement
• Technology Optimization
• Reduced Waste
• Enhanced Data Collection −
 CONTINUED…
• As the number of connected devices increases and more
information is shared between devices, the potential that a
hacker could steal confidential information also increases.
• If there’s a bug in the system, it’s likely that every connected
device will become corrupted.
• Since there’s no international standard of compatibility for IoT,
it’s difficult for devices from different manufacturers to
communicate with each other.
• Enterprises may eventually have to deal with massive numbers
maybe even millions of IoT devices and collecting and managing
the data from all those devices will be challenging.
 Challenges of IoT
• Security: IoT creates an ecosystem of constantly connected devices communicating over
networks. The system offers little control despite any security measures. This leaves users
exposed to various kinds of attackers.
• Privacy: The sophistication of IoT provides substantial personal data in extreme detail
without the user's active participation.
• Complexity: Some find IoT systems complicated in terms of design, deployment, and
maintenance given their use of multiple technologies and a large set of new enabling
technologies.
• Flexibility: Many are concerned about the flexibility of an IoT system to integrate easily with
another. They worry about finding themselves with several conflicting or locking systems.
• Compliance: IoT, like any other technology in the realm of business, must comply with
regulations. Its complexity makes the issue of compliance seem incredibly challenging when
many consider standard software compliance a battle.
 How does iot works

• Architecture of IOT
 Continued…
• An IoT ecosystem consists of web-enabled smart devices that use embedded
processors, sensors and communication hardware to collect, send and act on data
they acquire from their environments.
• IoT devices share the sensor data they collect by connecting to an IoT gateway or
another edge device where data is either sent to the cloud to be analyzed or
analyzed locally.
• The devices do most of the work without human intervention, although people
can interact with the devices. For instance, to set them up, give them instructions
or access the data.
• The connectivity, networking and communication protocols used with these web-
enabled devices largely depend on the specific IoT applications deployed.
Continued…
 Sensing layer
• The main purpose of the sensing layer is to identify any phenomena in the devices’ peripheral
and obtain data from the real world.
• This layer consists of several sensors.
• Using multiple sensors for applications is one of the primary features of IoT devices.
• Sensors in IoT devices are usually integrated through sensor hubs.
• A sensor hub is a common connection point for multiple sensors that accumulate and
forward sensor data to the processing unit of a device. Actuators can also intervene to
change the physical conditions that generate the data.
• An actuator might, for example, shut off a power supply, adjust an airflow valve, or move a
robotic gripper in an assembly process. Sensors in IoT devices can be classified into three
broad categories :
 Sensing layer
• Motion Sensors: Motion sensors measure the change in motion as well as the orientation of
the devices. There are two types of motions one can observe in a device: linear and angular
motions. The linear motion refers to the linear displacement of an IoT device while the
angular motion refers to the rotational displacement of the device.
• Environmental Sensors: Sensors such as Light sensors, Pressure sensors, etc. are embedded
in IoT devices to sense the change in environmental parameters in the device’s peripheral.
The primary purpose of using environmental sensors in IoT devices is to help the devices to
take autonomous decisions according to the changes of a device’s peripheral. For instance,
environment sensors are used in many applications to improve user experience (e.g., home
automation systems, smart locks, smart lights, etc.).
• Position sensors: Position sensors of IoT devices deal with the physical position and location
of the device. The most common position sensors used in IoT devices are magnetic sensors
and Global Positioning System (GPS) sensors. Magnetic sensors are usually used as digital
compass and help to fix the orientation of the device display. On the other hand, GPS is used
for navigation purposes in IoT devices.
• Network Layer - The network layer acts as a communication channel to transfer data,
collected in the sensing layer, to other connected devices. In IoT devices, the network layer is
implemented by using diverse communication technologies (e.g., Wi-Fi, Bluetooth, Zigbee, Z-
Wave, LoRa, cellular network, etc.) to allow data flow between other devices within the same
network.
• Data Processing Layer - The data processing layer consists of the main data processing unit of
IoT devices. The data processing layer takes data collected in the sensing layer and analyses
the data to make decisions based on the result. In some IoT devices (e.g., smartwatch, smart
home hub, etc.), the data processing layer also saves the result of the previous analysis to
improve the user experience. This layer may share the result of data processing with other
connected devices via the network layer.
• Application Layer - The application layer
implements and presents the results of the
data processing layer to accomplish disparate
applications of IoT devices. The application
layer is a user-centric layer that executes
various tasks for the users. There exist diverse
IoT applications, which include smart
transportation, smart home, personal care,
healthcare, etc.
 Devices and Networks
• Connected devices are part of a scenario in which every device talks to other related
devices in an environment to automate home and industrial tasks, and to
communicate usable sensor data to users, businesses and other interested parties.
• IoT devices are meant to work in concern for people at home, in industry or in the
enterprise. As such, the devices can be categorized into three main groups: consumer,
enterprise and industrial.
• Consumer connected devices include smart TVs, smart speakers, toys, wearables, and
smart appliances. smart meters, commercial security systems and smart city
technologies such as those used to monitor traffic and weather conditions are
examples of industrial and enterprise IoT devices.
• enterprise, smart sensors located in a conference room can help an employee locate
and schedule an available room for a meeting, ensuring the proper room type, size
and features are available. When meeting attendees enter the room, the temperature
will adjust according to the occupancy, and the lights will dim as the appropriate
PowerPoint loads on the screen and the speaker begins his presentation.
 Continued…

• IoT network typically includes a number of devices with constrained resources (power,
processing, memory, among others) and some of those devices may be massively deployed
over large areas like smart cities, industrial plants, whereas others may be deployed in hard-
to-reach areas like pipelines hazardous zones, or even in hostile environments like war
zones.
• Therefore, the efficient management of IoT networks requires considering both the
constraints of low power IoT devices and the deployment complexity of the underlying
communication infrastructure.
• IoT landscape is depicted by an increasing number of connected devices characterized by
their heterogeneity and the presence of resources constrained networks.
• To ensure the correct functioning of those connected devices, they must be remotely
accessed to configure, monitoring their status, and so forth. Traditional management
solutions cannot be used for low power devices networks given their resources
limitation and scalability issues.
• Therefore, efficient and autonomic management of IoT networks is needed. Developing an
IoT network management solution is not an easy task because of the intrinsic constraints of
IoT networks (architecture, technologies, physical layer).
 Continued…
• Indeed, it is necessary to take into account several elements such as scalability,
interoperability, energy efficiency, topology control, Quality of Service (QoS), fault
tolerance, and security.
• The security, context-aware, and the standard model of messages still in an early stage
and should be resolved in a new management platform. Therefore, this work proposes
a platform for IoT networks and devices management, called M4DN.IoT (Management
for Device and Network in the Internet of Things). This solution integrates and controls
the individual functionalities of the devices in an IoT network as well as the status and
characteristics of this network. M4DN.
• IoT defines a management structure in two scopes: local management, where the
platform runs in the same environment as the devices, and remote management,
where the platform controls the devices in different networks.
 IoT Tools and Platforms

• There are many vendors in the industrial IoT platform marketplace, offering remarkably
similar capabilities and methods of deployment.
• These IoT Platform Solutions are based on the Internet of Things and cloud technology.
• They can be used in areas of smart home, city, enterprise, home automation, healthcare or
automotive.
 Application of iot

• Agriculture: For indoor planting, IoT makes monitoring and management of micro-climate conditions a
reality, which in turn increases production. For outside planting, devices using IoT technology can sense soil
moisture and nutrients, in conjunction with weather data, better control smart irrigation and fertilizer
systems. If the sprinkler systems dispense water only when needed, for example, this prevents wasting a
precious resource.

• Consumer Use - For private citizens, IoT devices in the form of wearables and smart homes make life easier.
Wearables cover accessories such as Fitbit, smartphones, Apple watches, health monitors, to name a few.
These devices improve entertainment, network connectivity, health, and fitness. Smart homes take care of
things like activating environmental controls so that your house is at peak comfort when you come home.

• Healthcare
• Manufacturing
• Retail
• Insurance
• Transportation
• Utilities
 IoT Based Smart Home

• Smart Home initiative allows subscribers to remotely manage and monitor

different home devices from anywhere via smartphones or over the web with no
physical distance limitations.

• With the ongoing development of mass-deployed broadband internet

connectivity and wireless technology, the concept of a Smart Home has become
a reality where all devices are integrated and interconnected via the wireless
network. These “smart” devices have the potential to share information with
each other given the permanent availability to access the broadband internet
connection.

• Remote Control Appliances: Switching on and off remotely appliances to avoid

accidents and save energy.

• Weather: Displays outdoor weather conditions such as humidity, temperature,

pressure, wind speed and rain levels with the ability to transmit data over long
distances.
 Continued…

• Smart Home Appliances: Refrigerators with LCD screen telling what’s inside, food
that’s about to expire, ingredients you need to buy and with all the information
available on a smartphone app. Washing machines allowing you to monitor the
laundry remotely, and. The kitchen ranges with the interface to a Smartphone app
allowing remotely adjustable temperature control and monitoring the oven’s self-
cleaning feature.
• Safety Monitoring: cameras, and home alarm systems making people feel safe in
their daily life at home.
• Intrusion Detection Systems: Detection of window and door openings and
violations to prevent intruders.
• Energy and Water Use: Energy and water supply consumption monitoring to
obtain advice on how to save cost and resources, & many more.
 IOT BASED SMART CITES

• In cities, the development of smart grids, data analytics, and autonomous vehicles will provide
an intelligent platform to deliver innovations in energy management, traffic management, and
security, sharing the benefits of this technology throughout society.
• Structural Health: Monitoring of vibrations and material conditions in buildings, bridges
and historical monuments.
• Lightning: intelligent and weather adaptive lighting in street lights.
• Safety: Digital video monitoring, fire control management, public announcement
systems.
• Transportation: Smart Roads and Intelligent High-ways with warning messages and
diversions according to climate conditions and unexpected events like accidents or
traffic jams.
• Smart Parking: Real-time monitoring of parking spaces available in the city making
residents able to identify and reserve the closest available spaces,
• Waste Management: Detection of rubbish levels in containers to optimize the trash
collection routes. Garbage cans and recycle bins with RFID tags allow the sanitation staff
to see when garbage has been put out.
 CHAPTER FIVE
Augmented reality(AR)
 Objectives

After completing this chapter, the students will be able to:

 Explain augmented reality

 Explain the features of augmented reality

 Explain the difference between AR, VR, and MR

 Explain the architecture of augmented reality systems

 Describe the application areas of augmented reality

 Overview

• The fundamental idea of AR is to combine, or mix, the view of the real

environment with additional, virtual content that is presented through computer
graphics.
• Its convincing effect is achieved by ensuring that the virtual content is aligned and
registered with the real objects. As a person moves in an environment and their
perspective view of real objects changes, the virtual content should also be
presented from the same perspective.
• Augmented reality (AR) is a form of emerging technology that allows users to
overlay computer- generated content in the real world. AR refers to a live view of a
physical real-world environment whose elements are merged with augmented
computer-generated images creating a mixed reality.
 Continued…

• The augmentation is typically done in real-time and in semantic context with

environmental elements. By using the latest AR techniques and technologies,
the information about the surrounding real world becomes interactive and
digitally usable. Through this augmented vision, a user can digitally interact
with and adjust information about their surrounding environment.
• Augmented Reality (AR) as a real-time direct or indirect view of a physical real-
world environment that has been enhanced/augmented by adding virtual
computer-generated information to it.
 Virtual reality (VR), Augmented Reality (AR) vs Mixed reality (MR)

• With constant development in computer vision and the exponential

advancement of computer processing power, virtual reality (VR),
augmented reality (AR), and mixed reality (MR) technology is becoming
more and more prominent.

Virtual Reality (VR)

• VR is fully immersive, which tricks your senses into thinking you’re in a different
environment or world apart from the real world.

• Using a head-mounted display (HMD) or headset, you’ll experience a

computer-generated world of imagery and sounds in which you can manipulate
objects and move around using haptic controllers while tethered to a console or
PC.

• It is also called a computer-simulated reality.

• It refers to computer technologies using reality headsets to generate realistic sounds,

images and other sensations that replicate a real environment or create an imaginary

world.

• Advanced VR environment will engage all five senses (taste, sight, smell, touch, sound),

but it is important to say that this is not always possible

• Using VR devices such as HTC Vive, Oculus Rift or Google Cardboard, users can be

transported into a number of real-world and imagined environments.

• Most VR headsets are connected to a computer (Oculus Rift)
or a gaming console (PlayStation VR) but there are
standalone devices (Google Cardboard is among the most
popular) as well. Most standalone VR headsets work in
combination with smartphones – you insert a smartphone, wear
a headset, and immerse in the virtual reality
 Augmented reality (AR)
 There’s a different way to experience augmented reality, though – with special AR headsets, such as
Google Glass, where digital content is displayed on a tiny screen in front of a user’s eye.
 AR adds digital elements to a live view often by using the camera on a smartphone. Examples of
augmented reality experiences include Snapchat lenses and the game Pokemon Go. Augmented Reality
(AR) is a live, direct or indirect view of a physical, real-world environment whose elements are augmented
(or supplemented) by computer-generated sensory input such as sound, video, graphics or GPS data
 Mixed Reality (MR)

• Mixed Reality (MR), sometimes referred to as hybrid reality, is the merging of real
and virtual worlds to produce new environments and visualizations where physical
and digital objects co-exist and interact in real-time.
• It means placing new imagery within a real space in such a way that the new
imagery is able to interact, to an extent, with what is real in the physical world we
know.
• For example, with MR, you can play a virtual video game, grab your real-world water
bottle, and smack an imaginary character from the game with the bottle.
Imagination and reality have never been so intermingled.
• The key characteristic of MR is that the synthetic content and the real-world content
are able to react to each other in real-time.
 In mixed reality, you interact with and manipulate both physical and virtual items and environments,
using next-generation sensing and imaging technologies.

 MR allows you to see and immerse yourself in the world around you even as you interact with a
virtual environment using your own hands—all without ever removing your headset.
• It provides the ability to have one foot (or hand) in the real world, and the other in an imaginary
place, breaking down basic concepts between real and imaginary, offering an experience that can
change the way you game and work today.

• One of the most obvious differences among augmented reality, virtual reality, and mixed reality is the
hardware requirements and also VR is content which is 100% digital and can be enjoyed in a fully
immersive environment, AR overlays digital content on top of the real-world. and MR is a digital
overlay that allows interactive virtual elements to integrate and interact with the real-world
environment. Numerous augmented reality apps and games can run on almost every smartphone on
the market.
• On the other hand, virtual reality programs require specialized VR headsets, noise-canceling
headphones, cameras to track room space and boundaries, and sometimes even motion
capture technology. Some of the biggest names in VR tech today are the Oculus Rift, HTC
Vive, and PlayStation VR. For the enjoyment of simple VR videos, there are affordable
makeshift VR headsets like the Google Cardboard, which work by running a video in 360
modes on your smartphone and inserting the phone into the headset.
• Mixed reality hardware is still emerging and hasn’t quite broken into the mainstream
consumer market, most likely due to the price. The consumer releases of the Microsoft
HoloLens and Magic Leap One retail for over $2000 USD, which is 3 to 4 times the cost of the
PlayStation VR and HTC Vive VR headsets. However, mixed reality applications sometimes
require exponentially more processing power and thus require more powerful hardware.
 The architecture of AR Systems
• The first Augmented Reality Systems (ARS) were usually designed with a basis
on three main blocks
1) Infrastructure Tracker Unit,
2) Processing Unit, and
3) Visual Unit.
• The Infrastructure Tracker Unit was responsible for collecting data from the
real world, sending them to the Processing Unit, which mixed the virtual
content with the real content and sent the result to the Video Out module
of the Visual Unit. Some designs used a Video In, to acquire required data
for the Infrastructure Tracker Unit.
 The Visual Unit can be classified into two types of system, depending on the followed
visualization technology:

1. Video see-through: It uses a Head-Mounted Display (HMD) that employs a

video-mixing and displays the merged images on a closed-view HMD.
2. Optical see-through: It uses an HMD that employs optical combiners to merge
the images within an open-view HMD.
HMDS have a lot of problems
– Ergonomics
– High prices
– Relatively low mobility
– HMDs interaction with the real environment, which places virtual interactive
zones to the user, making the collision with these zones hard due to the
difficulty to interact with multiple points in different depths.
• Alternative approaches to solve HMD is
the use of monitors and tablets.
Monitors are used as an option for the
indirect view since the user does not
look directly into the mixed world.
Tablets are used indirect view since the
user points the camera to the scene and
looks directly into the mixed world.
Both approaches still have difficulties in
getting a collision.
 Applications of AR Systems
• In education:
– Affordable learning materials
– Interactive lessons
– Higher engagement
– Higher retention
– Boost intellectual curiosity
 In Medicine

– Describing symptoms
– Nursing care
– Surgery
– Ultrasounds
– Diabetes management
– Education of future doctors
– Diagnostics
 In Entertainment
– games
– music
– TV
– E-Sports
– heater