![Page 1: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/1.jpg)
Using Samba with a Commercial Clustered File System
![Page 2: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/2.jpg)
2
Agenda
• Isilon Clustered Storage Overview• Developing OneFS• Samba and OneFS• Clustering Samba• Future Requirements
![Page 3: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/3.jpg)
3 3
Isilon OneFS Cluster
• Single file system (1.6 PB)• Fully symmetric peers
• 3 to 96+ nodes• Fast intra-cluster network
• InfiniBand• Multi-protocol access
• CIFS• NFS• FTP• HTTP/WebDAV• Local userspace
![Page 4: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/4.jpg)
4 4
What Makes Isilon OneFS Special?
• Single pool of storage• Granular data protection
» Down to the file level» 8x mirroring or +4 recovery
• Easy to manage and grow» Add additional nodes in 60 seconds» Automated data balancing
• Extreme performance for concurrent access• POSIX and Windows semantics supported
![Page 5: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/5.jpg)
5
(optional 2nd switch)
Isilon IQ Storage Layer
Intracluster Communication
Infiniband or GigE Layer
Servers
Client/Application Layer
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Standard Gigabit Ethernet Layer
Servers
Servers
5
Isilon IQ Network Architecture
![Page 6: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/6.jpg)
6 6
Writing a File with Isilon IQ
(optional 2nd switch)
(optional 2nd switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
![Page 7: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/7.jpg)
7 7
Writing a File with Isilon IQ
(optional 2nd switch)
![Page 8: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/8.jpg)
8 8
(optional 2nd switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
Writing a File with Isilon IQ
(optional 2nd switch)
Reading a File with Isilon IQ
![Page 9: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/9.jpg)
9 9
Reading a File with Isilon IQ
(optional 2nd switch)
Servers
NFS, CIFS,FTP, HTTP
(optional 2nd switch)
Servers
Servers
![Page 10: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/10.jpg)
10 10
Developer Perspective
Full Control
• File system• Kernel• Node’s userspace
applications
No Control
• Customer environment» Domain topology» Domain policy
• CIFS client• NFS client
![Page 11: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/11.jpg)
11 11
Samba in OneFS
Isilon Kernel Supported Samba Requirements
• Native Windows ACL storage & enforcement• Native createfile() syscall implementation• Alternate Data Streams• Snapshots with Volume Shadow Copy Service (VSS)• Zero-copy writes and other performance improvements
throughUsed over 4 years – 3.0.242.2
![Page 12: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/12.jpg)
12 12
Samba in OneFS Continued…
• Cluster coherent share-mode locking• Cluster coherent oplocks• Cluster coherent byte-range locks (in development)• Per-share case-sensitivity• Unicode normalization insensitive• Site locator support• Change notify• And more…
![Page 13: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/13.jpg)
13 13
IFS Clustering Protocols
IFS
Distributed Lock Manager(DLM)
Group Management Protocol(GMP)
smbd nfsd httpd ftpd bash
![Page 14: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/14.jpg)
14 14
OneFS Distributed Locking [under Samba]
Distributed Lock Manager
• Expressive• Arbitrary contention tables
• Two-tier model• Each node responsible for subset of cluster locks• Local lock caching
• Properly Models• Share mode locks• Oplocks
• Multi-protocol support without customized applications
![Page 15: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/15.jpg)
15 15
OneFS Group Membership [under Samba]
Group Management Protocol
• Rich predicates• More than just node “available” / “unavailable”• Operations based off health of node
• Individual I/O directions: Readable / Writeable• Predicates dependent on full cluster state
• Degraded read as last resort• Group changes integrate with other modules
• I/O automatically routed to available nodes• DLM can renegotiate
![Page 16: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/16.jpg)
16 16
CTDB on Clustered File Systems
Leverage Existing Technology
• CTDB is a promising solution for POSIX clustered file systems• Some file systems extend capabilities
» Native distributed locking mechanism» Native cluster membership tracking» Native ACLs and other feature obviate need for specific TDBs
• Native solutions benefit from» Performance tuning» Build on existing testing and deployment
• Samba should benefit from these capabilities when available
![Page 17: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/17.jpg)
17 17
Samba 3 Wish List
• Abstract interface for TDB based solutions» Kernel based solutions and CTDB coexisting» Existing examples
- iNotify for Linux- NTFS VFS layer in Samba 4
» Beneficial to other vendors
Moving forward…
![Page 18: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/18.jpg)
18 18
Samba 3 Wish List
• Increase communication» Share our features and bug fixes» Minimize parallel development» Vendor specific branches?» Ease merge burden
Moving forward…
![Page 19: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/19.jpg)
19
• Dedicated Windows enterprise QA team » Hundreds of bugs found» Integration in complex domain topologies
• Real world deployment in large production environments» 50,000+ Users» 300+ Domain Controllers
• Feature development» Windows 2008 Server Authentication
19
What We Give Back to the Community
Enterprise Testing and Deployment
![Page 20: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/20.jpg)
20
Isilon Customers and Leadership
Select Customers Recognition
"Isilon's clustered storage products will play a critical role in meeting the capacity and throughput requirements of leading applications.”
Richard Villars, Vice President of Storage Systems Research, IDC
![Page 21: Using Samba with a Commercial Clustered File System](https://reader036.vdocuments.net/reader036/viewer/2022062411/5681522a550346895dc071bd/html5/thumbnails/21.jpg)
21
• CIFS/Samba improvements» Many interesting challenges ahead» Clustered performance
- Closer integration with world-leading clustered storage solution• Customer Focus
» Our customers continue to push the envelope of Samba development
• Growth» Continue to get more involved with Samba community» We need more protocols developers! (Come join us!)
21
Future
2008 and Beyond