Professional Documents
Culture Documents
Chapter 4: Threads & Concurrency: Silberschatz, Galvin and Gagne ©2018 Operating System Concepts - 10 Edition
Chapter 4: Threads & Concurrency: Silberschatz, Galvin and Gagne ©2018 Operating System Concepts - 10 Edition
Concurrency
Overview
Multicore Programming
Multithreading Models
Thread Libraries
Implicit Threading
Threading Issues
Operating System Examples
Operating System Concepts – 10th Edition 4.2 Silberschatz, Galvin and Gagne
Objectives
Operating System Concepts – 10th Edition 4.3 Silberschatz, Galvin and Gagne
Motivation
Operating System Concepts – 10th Edition 4.4 Silberschatz, Galvin and Gagne
Single and Multithreaded Processes
Operating System Concepts – 10th Edition 4.5 Silberschatz, Galvin and Gagne
Multithreaded Server Architecture
Operating System Concepts – 10th Edition 4.6 Silberschatz, Galvin and Gagne
Benefits
Operating System Concepts – 10th Edition 4.7 Silberschatz, Galvin and Gagne
Multicore Programming
Multicore or multiprocessor systems putting pressure on
programmers, challenges include:
• Dividing activities
• Balance
• Data splitting
• Data dependency
• Testing and debugging
Parallelism implies a system can perform more than one
task simultaneously
Concurrency supports more than one task making
progress
• Single processor / core, scheduler providing
concurrency
Operating System Concepts – 10th Edition 4.8 Silberschatz, Galvin and Gagne
Concurrency vs. Parallelism
Concurrent execution on single-core system:
Operating System Concepts – 10th Edition 4.9 Silberschatz, Galvin and Gagne
Multicore Programming
Types of parallelism
• Data parallelism – distributes subsets of the same
data across multiple cores, same operation on
each
• Task parallelism – distributing threads across
cores, each thread performing unique operation
Operating System Concepts – 10th Edition 4.10 Silberschatz, Galvin and Gagne
Data and Task Parallelism
Operating System Concepts – 10th Edition 4.11 Silberschatz, Galvin and Gagne
Amdahl’s Law
Identifies performance gains from adding additional cores
to an application that has both serial and parallel
components
S is serial portion
N processing cores
Operating System Concepts – 10th Edition 4.13 Silberschatz, Galvin and Gagne
User Threads and Kernel Threads
Operating System Concepts – 10th Edition 4.14 Silberschatz, Galvin and Gagne
User and Kernel Threads
Operating System Concepts – 10th Edition 4.15 Silberschatz, Galvin and Gagne
Multithreading Models
Many-to-One
One-to-One
Many-to-Many
Operating System Concepts – 10th Edition 4.16 Silberschatz, Galvin and Gagne
Many-to-One
Operating System Concepts – 10th Edition 4.17 Silberschatz, Galvin and Gagne
One-to-One
Operating System Concepts – 10th Edition 4.18 Silberschatz, Galvin and Gagne
Many-to-Many Model
Allows many user level threads to be mapped to many
kernel threads
Allows the operating system to create a sufficient
number of kernel threads
Windows with the ThreadFiber package
Otherwise not very common
Operating System Concepts – 10th Edition 4.19 Silberschatz, Galvin and Gagne
Two-level Model
Similar to M:M, except that it allows a user thread to be
bound to kernel thread
Operating System Concepts – 10th Edition 4.20 Silberschatz, Galvin and Gagne
Thread Libraries
Operating System Concepts – 10th Edition 4.21 Silberschatz, Galvin and Gagne
Pthreads
Operating System Concepts – 10th Edition 4.22 Silberschatz, Galvin and Gagne
Pthreads Example
Operating System Concepts – 10th Edition 4.23 Silberschatz, Galvin and Gagne
Pthreads Example (Cont.)
Operating System Concepts – 10th Edition 4.24 Silberschatz, Galvin and Gagne
Pthreads Code for Joining 10 Threads
Operating System Concepts – 10th Edition 4.25 Silberschatz, Galvin and Gagne
Windows Multithreaded C Program
Operating System Concepts – 10th Edition 4.26 Silberschatz, Galvin and Gagne
Windows Multithreaded C Program (Cont.)
Operating System Concepts – 10th Edition 4.27 Silberschatz, Galvin and Gagne
Java Threads
Operating System Concepts – 10th Edition 4.28 Silberschatz, Galvin and Gagne
Java Threads
Implementing Runnable interface:
Creating a thread:
Waiting on a thread:
Operating System Concepts – 10th Edition 4.29 Silberschatz, Galvin and Gagne
Java Executor Framework
Operating System Concepts – 10th Edition 4.30 Silberschatz, Galvin and Gagne
Java Executor Framework
Operating System Concepts – 10th Edition 4.31 Silberschatz, Galvin and Gagne
Java Executor Framework (Cont.)
Operating System Concepts – 10th Edition 4.32 Silberschatz, Galvin and Gagne
Implicit Threading
Operating System Concepts – 10th Edition 4.33 Silberschatz, Galvin and Gagne
Thread Pools
Create a number of threads in a pool where they await
work
Advantages:
• Usually slightly faster to service a request with an
existing thread than create a new thread
• Allows the number of threads in the application(s) to
be bound to the size of the pool
• Separating task to be performed from mechanics of
creating task allows different strategies for running
task
i.e.,Tasks could be scheduled to run periodically
Windows API supports thread pools:
Operating System Concepts – 10th Edition 4.34 Silberschatz, Galvin and Gagne
Java Thread Pools
Operating System Concepts – 10th Edition 4.35 Silberschatz, Galvin and Gagne
Java Thread Pools (Cont.)
Operating System Concepts – 10th Edition 4.36 Silberschatz, Galvin and Gagne
Fork-Join Parallelism
Operating System Concepts – 10th Edition 4.37 Silberschatz, Galvin and Gagne
Fork-Join Parallelism
Operating System Concepts – 10th Edition 4.38 Silberschatz, Galvin and Gagne
Fork-Join Parallelism
Operating System Concepts – 10th Edition 4.39 Silberschatz, Galvin and Gagne
Fork-Join Parallelism in Java
Operating System Concepts – 10th Edition 4.40 Silberschatz, Galvin and Gagne
Fork-Join Parallelism in Java
Operating System Concepts – 10th Edition 4.41 Silberschatz, Galvin and Gagne
Fork-Join Parallelism in Java
Operating System Concepts – 10th Edition 4.42 Silberschatz, Galvin and Gagne
OpenMP
Set of compiler
directives and an API
for C, C++, FORTRAN
Provides support for
parallel programming in
shared-memory
environments
Identifies parallel regions
– blocks of code that
can run in parallel
#pragma omp parallel
Create as many threads as
there are cores
Operating System Concepts – 10th Edition 4.43 Silberschatz, Galvin and Gagne
Run the for loop in parallel
Operating System Concepts – 10th Edition 4.44 Silberschatz, Galvin and Gagne
Grand Central Dispatch
Apple technology for macOS and iOS operating systems
Extensions to C, C++ and Objective-C languages, API, and
run-time library
Allows identification of parallel sections
Manages most of the details of threading
Block is in “^{ }” :
ˆ{ printf("I am a block"); }
Operating System Concepts – 10th Edition 4.45 Silberschatz, Galvin and Gagne
Grand Central Dispatch
Two types of dispatch queues:
• serial – blocks removed in FIFO order, queue is per
process, called main queue
Programmers can create additional serial queues
within program
• concurrent – removed in FIFO order but several may
be removed at a time
Four system wide queues divided by quality of
service:
o QOS_CLASS_USER_INTERACTIVE
o QOS_CLASS_USER_INITIATED
o QOS_CLASS_USER_UTILITY
o QOS_CLASS_USER_BACKGROUND
Operating System Concepts – 10th Edition 4.46 Silberschatz, Galvin and Gagne
Grand Central Dispatch
Operating System Concepts – 10th Edition 4.47 Silberschatz, Galvin and Gagne
Intel Threading Building Blocks (TBB)
Operating System Concepts – 10th Edition 4.48 Silberschatz, Galvin and Gagne
Threading Issues
Semantics of fork() and exec() system calls
Signal handling
• Synchronous and asynchronous
Thread cancellation of target thread
• Asynchronous or deferred
Thread-local storage
Scheduler Activations
Operating System Concepts – 10th Edition 4.49 Silberschatz, Galvin and Gagne
Semantics of fork() and exec()
Operating System Concepts – 10th Edition 4.50 Silberschatz, Galvin and Gagne
Signal Handling
Signals are used in UNIX systems to notify a process that
a particular event has occurred.
A signal handler is used to process signals
1. Signal is generated by particular event
2. Signal is delivered to a process
3. Signal is handled by one of two signal handlers:
1. default
2. user-defined
Every signal has default handler that kernel runs when
handling signal
• User-defined signal handler can override default
• For single-threaded, signal delivered to process
Operating System Concepts – 10th Edition 4.51 Silberschatz, Galvin and Gagne
Signal Handling (Cont.)
Where should a signal be delivered for multi-threaded?
• Deliver the signal to the thread to which the signal
applies
• Deliver the signal to every thread in the process
• Deliver the signal to certain threads in the process
• Assign a specific thread to receive all signals for the
process
Operating System Concepts – 10th Edition 4.52 Silberschatz, Galvin and Gagne
Thread Cancellation
Terminating a thread before it has finished
Thread to be canceled is target thread
Two general approaches:
• Asynchronous cancellation terminates the target
thread immediately
• Deferred cancellation allows the target thread to
periodically check if it should be cancelled
Pthread code to create and cancel a thread:
Operating System Concepts – 10th Edition 4.53 Silberschatz, Galvin and Gagne
Thread Cancellation (Cont.)
Invoking thread cancellation requests cancellation, but
actual cancellation depends on thread state
Operating System Concepts – 10th Edition 4.54 Silberschatz, Galvin and Gagne
Thread Cancellation in Java
Operating System Concepts – 10th Edition 4.55 Silberschatz, Galvin and Gagne
Thread-Local Storage
Operating System Concepts – 10th Edition 4.56 Silberschatz, Galvin and Gagne
Scheduler Activations
Both M:M and Two-level models
require communication to maintain
the appropriate number of kernel
threads allocated to the application
Typically use an intermediate data
structure between user and kernel
threads – lightweight process (LWP)
• Appears to be a virtual processor
on which process can schedule
user thread to run
• Each LWP attached to kernel
thread
• How many LWPs to create?
Scheduler activations provide upcalls -
a communication mechanism from
the kernel to the upcall handler in the
thread library
This communication allows an
application to maintain the
Operating System Concepts – 10th Edition4.57
correct Silberschatz, Galvin and Gagne
Operating System Examples
Windows Threads
Linux Threads
Operating System Concepts – 10th Edition 4.58 Silberschatz, Galvin and Gagne
Windows Threads
Windows API – primary API for Windows applications
Implements the one-to-one mapping, kernel-level
Each thread contains
• A thread id
• Register set representing state of processor
• Separate user and kernel stacks for when thread runs
in user mode or kernel mode
• Private data storage area used by run-time libraries
and dynamic link libraries (DLLs)
The register set, stacks, and private storage area are
known as the context of the thread
Operating System Concepts – 10th Edition 4.59 Silberschatz, Galvin and Gagne
Windows Threads (Cont.)
The primary data structures of a thread include:
• ETHREAD (executive thread block) – includes pointer
to process to which thread belongs and to KTHREAD,
in kernel space
• KTHREAD (kernel thread block) – scheduling and
synchronization info, kernel-mode stack, pointer to
TEB, in kernel space
• TEB (thread environment block) – thread id, user-
mode stack, thread-local storage, in user space
Operating System Concepts – 10th Edition 4.60 Silberschatz, Galvin and Gagne
Windows Threads Data Structures
Operating System Concepts – 10th Edition 4.61 Silberschatz, Galvin and Gagne
Linux Threads
Linux refers to them as tasks rather than threads
Thread creation is done through clone() system call
clone() allows a child task to share the address space
of the parent task (process)
• Flags control behavior
Operating System Concepts – 10th Edition 4.62 Silberschatz, Galvin and Gagne
End of Chapter 4