Professional Documents
Culture Documents
Virtual Provisioning
Virtual Provisioning
Agenda
Introduction to Virtual Provisioning
Virtual Provisioning features
FBA
CKD
Physical
Disk Drives
Thin Device
(TDEV)
Thin Pool
Three approaches:
RAID data protection
Meta Devices (Symmetrix)
Virtual Provisioning
6
VP Components
Thin Data Device (TDAT)
An internal, non-addressable
device
Provides the physical storage for
a thin device
Multiple RAID protection types
RAID 1, RAID 5, RAID 6
Thin Pool
a shared, physical storage
resource of a single RAID
protection and drive technology
the first TDAT added determines
the protection type
Thin Pool
FC_Raid1
Add (4) x 25GB Raid 1
TDATs
VP Components
Thin Device (TDEV)
Common
storage
Data
devices pool
10
Over Subscription
Thin device capacity > pool
11
Storage Group
FC_Raid1
200GB TDEV
Bind
TDEV
12
Storage Group
FC_Raid1
200GB TDEV
1000101
1000101
13
14
VP Threshold Settings
15
16
18
Any new technology should be tested and fully understood before being put
into production!
Check the vendors documentation and support matrix for requirements and/or restrictions
20
Storage Array
EMC VMAX @ Enginuity level 5876*
Other?
*Check the vendors support matrix for the specific details
22
/sys/bock/<device>/queue / discard_max_bytes
# cat discard_max_bytes
25165824
from kernel.org:
The discard_max_bytes parameter is set by the device driver to the maximum
number of bytes that can be discarded in a single operation. Discard requests
issued to the device must not exceed this limit. A discard_max_bytes value of 0
means that the device does not support discard functionality.
23
24
- skipping inode
# mount
/dev/sdb on /thin_mount type ext4 (rw,discard)
25
fstrim
mount ext4 filesystem without discard mount option
Filesystem mounted without the discard option
Does not frees up space on thin device at time of file deletion
26
101E -3390-9
Host
addressable
devices
Front End
(FICON)
Track
mapping
tables
Cache
Back End
Single
RAID rank
Disks
28
101D -3390-9
101E -3390-9
Front End
(FICON)
Track group
mapping
tables
Cache
Back End
Virtual Pool
Disks
Data
devices
29
30
Benefits
Wide striping
EMC FAST Fully Automated Storage Tiering
31
32
Rebalancing
Should be started after adding new TDATs to an existing
pool
Runs at a very low priority
Can be influenced by two extended pool attributes:
Rebalancing Variance %
controls whether a data device (TDAT) will be chosen for a
possible rebalance
33
VP Benefits
Improved capacity utilization (with VP LUNs and Linux)
Reduces the amount of allocated but unused physical storage
Avoids over-allocation of physical storage to applications
EFD
FC
SATA
Workload
35
36
TDAT
R53
TDAT
R53
TDAT
R1
TDAT
R1
TDAT
R1
TDAT
R614
TDAT
R614
TDAT
R614
TDAT
R614
TDAT
R614
TDAT
R53
TDAT
R53
TDAT
R1
TDAT
R1
TDAT
R1
TDAT
R614
TDAT
R614
TDAT
R614
TDAT
R614
TDAT
R614
R53_EFD_Pool
37
VP_DevApp1
R1_FC_Pool
R6_SATA_Pool
Storage Elements
Symmetrix Tier a shared storage resource with
common technologies (Virtual Pools)
FAST Policy manage Symmetrix Tiers to achieve
service levels for one or more Storage Groups
FAST Storage Group logical grouping of thin devices
for common management
FAST Storage
Groups
FAST Policies
Automatic
<100%
100%
Custom
38
R53_EFD_200GB
200 GB EFD
RAID 5 (3+1)
R1_FC_450GB
VP_Prod_DB2
VP_QA_DB2
Symmetrix Tiers
x%
y%
z%
450 GB 15K FC
RAID 1
R66_SATA_1TB
1 TB SATA
RAID 6 (6+2)
FAST VP Implementation
Performance data collected by
the system
Intelligent Tiering algorithm
generates movement requests
based on performance data
Allocation Compliance
algorithm generates movement
requests based on capacity
utilization
Algorithms continuously assess
I/O statistics and capacity use,
and make decisions for
promotion and demotion
39
Performance Data
Collection
Analyze
Performance Data
Intelligent Tiering
Algorithm
Execute Data
Movement
Allocation
Compliance
Algorithm
Summary
Virtual Provisioning = Thin Provisioning
Available for FBA/SCSI and CKD devices
FBA as SCSI devices
Space is allocated as needed
Over subscription
Cleanup of unused space via space reclamation or T10 SCSI
command standards
Linux and Storage array dependent
CKD
Fully allocated
Wide Striping
FAST VP Fully Automated Storage Tiering VP
Active performance management
40
THANK YOU
Gail Riley
EMC Corporation
[email protected]