isilon migration solution overview
DESCRIPTION
Isilon Migration Solution OverviewTRANSCRIPT
New Migration SolutionNetApp Migration
ToolMigration
Professional Services
Custom built to migrate of a NetApp (isi_vol_copy)
Handle CIFS,NFS and mixed mode data along with permissions
Faster and efficient– Minimize lengthy tree walks
Eliminate additional hosts for migration – ships as a part of the OneFS operating system
10,000TB+ Migrated to date
End to End handling of Data migration
• Project Planning and management
• Solution Architecture
• Environment analysis
• Test Planning
• Implementation and Handover
Access to Global resource footprint
EMC/Isilon PS team Delivered
People
Process
Technology
Isilon’s isi_vol_copyComparison with other host based tools
A Typical host based migration solution – first full copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/WriteFull copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
create directoryRead/Write
Source– NetApp
Read/Writevol\mkt
Ifs\ mkt
A Typical host based migration solution – first full copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/WriteFull copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
Open file ‘f3’
Read file ‘f3’
create directory
Create file ‘f1’
Write file ‘f1’
Read/Write
f1
Source– NetApp
Read/Writevol\mkt
Ifs\ mkt
A Typical host based migration solution – first full copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/WriteFull copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
Open file ‘f3’
Read file ‘f3’
create directory
Create file ‘f2’
Write file ‘f2’
Read/Write
f1f2
Source– NetApp
Read/Writevol\mkt
Ifs\ mkt
A Typical host based migration solution – first full copy
Destination– Isilon
Host running Robocopy/Rsync
vol\mkt
f2
f3
f1
Read/WriteFull copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
Open file ‘f3’
Read file ‘f3’
create directory
Create file ‘f3’
Write file ‘f3’
Read/WriteIfs\ mkt
f1f2
f3
Source– NetApp
Read/Write
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Writevol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Check time stamp on ‘f1’
Check time stamp on ‘f1’
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
If different
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f1’ Read file ‘f1’
Perform Hash and compare on both files
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f1’ Write to file ‘f1’
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Check time stamp on ‘f2’
Check time stamp on ‘f2’
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
If different
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f2’ Read file ‘f2’
Perform Hash and compare on both files
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f2’ Write to file ‘f2’
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Check time stamp on ‘f3’
Check time stamp on ‘f3’
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
If different
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f3’ Read file ‘f3’
Perform Hash and compare on both files
vol\mkt
Ifs\ mkt
A Typical host based migration solution – incremental copy
Destination– Isilon
Host running Robocopy/Rsync
f2
f3
f1
Read/Writeincremental copy vol\mkt to ifs\mkt
Open directory mkt
Read directory
Begin tree walk
create directory
Read directory
Begin treewalk
Read/Write
f1f2
f3
Source– NetApp
Read/Write
Read file ‘f3’ Write to file ‘f3’
vol\mkt
Ifs\ mkt
Key points to note Numerous CIFS/NFS client operations competing with
‘business workflows’
Tree walk and hashing bottleneck during incremental– Prolonged periods of incremental extends duration of
migration exponential to the file operations encountered on source during the migration
– Prolonged cut over windows on the source means extended downtime for end users
Provision additional hosts in the datacenter– Host count has to scale with growing file count , size and
copy rate– Separate hosts for CIFS and NFS migrations
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
Source– NetApp
Send NDMP stream Read NDMP stream
Full copy root\mkt to ifs\mkt
Root\mkt
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
Source– NetApp
Send NDMP stream Read NDMP stream
Full copy root\mkt to ifs\mkt
File system operations
Root\mkt
Ifs\ mkt
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
f1
Source– NetApp
Send NDMP stream Read NDMP stream
Full copy root\mkt to ifs\mkt
File system operations
Root\mkt
Ifs\ mkt
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
f1f2
Source– NetApp
Send NDMP stream Read NDMP stream
Full copy root\mkt to ifs\mkt
File system operations
Root\mkt
Ifs\ mkt
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
f1f2
f3
Source– NetApp
Send NDMP stream Read NDMP stream
Full copy root\mkt to ifs\mkt
File system operations
Root\mkt
Ifs\ mkt
Isilon solution – full copyDestination
– Isilon
f2
f3
f1
Read/Write
f1f2
f3
Source– NetApp
Send NDMP stream with changes since
last copy
Read NDMP stream
Incremental copy root\mkt to ifs\mkt
File system operations
Root\mkt
Ifs\ mkt
Benefits of isi_vol_copy Reduce client side operations and thereby overhead
on system performance
Leverages SnapDiff/ONTAP native file system operations to reduce tree walk/hashing overhead during migrations
Same tool handles CIFS/NFS. Ships as part of OneFS– Eliminate additional host requirements for migration– Utilize available compute resources on Isilon cluster for
migration
Comparison MatrixIsi_vol_copy Robocopy Rsync
CIFS Data Supported Supported Not supported
NFS Data Supported Not supported Supported
Computing requirements
Ships with Isilon cluster Additional hosts need to be provisioned
Additional hosts need to be provisioned
Performance enhancement features
• Tree walk & Hashing optimization
• Avoidance of CIFS/NFS protocol operations
• Incremental copies
Incremental copies Incremental copies
Sources supported
NetApp only Any system supporting CIFS
Any system supporting NFS
ONTAP requirements
7.3 and above. No ‘cluster mode’ support
NA NA