chris bailey june webinar: how to transfer large volumes of small files at accelerated speeds
DESCRIPTION
The Problem: Transferring Large Volumes of Small Files Each file needs set up/teardown FTP sends PASV command followed by STOR command Fine with large files, but with many small files it takes too long Introduce latency and it is even worse | © Copyright FileCatalyst,TRANSCRIPT
Chris Bailey
June Webinar: How to Transfer Large Volumes of Small Files at Accelerated Speeds
| © Copyright FileCatalyst, 20132
Agenda
• The Problem: Transferring large volumes of small files
• Test Case
• Alternatives
• Other Complementary Features
• Questions
| © Copyright FileCatalyst, 20133
The Problem: Transferring Large Volumes of Small Files
• Each file needs set up/teardown
• FTP sends PASV command followed by STOR command
• Fine with large files, but with many small files it takes too long
• Introduce latency and it is even worse
| © Copyright FileCatalyst, 20134
Test Case
• 37,000 files, 900 directories
• FileZilla – Takes too long to wait for!
• FileCatalyst HotFolder with Single Archive option – finishes quickly
| © Copyright FileCatalyst, 20135
Alternatives
• Zipping it yourself in manual, need to unzip other side
• What if one file changes? Send it all again
| © Copyright FileCatalyst, 20136
Other Complementary Features
• Transfer cache – detects what has changed
• File system monitoring
Questions?