btrfs : introduction and performance evaluation

14
btrfs: Introduction and Performance Evaluation Douglas Fuller Oak Ridge Leadership Computing Facility / ORNL LUG 2011

Upload: niyati

Post on 23-Feb-2016

51 views

Category:

Documents


2 download

DESCRIPTION

btrfs : Introduction and Performance Evaluation. Douglas Fuller Oak Ridge Leadership Computing Facility / ORNL LUG 2011. btrfs : overview. Implemented in Linux 2.6.29 64-bit Extent-based Copy on write Multiple devices Object pools (RAID-0, RAID-1, and RAID-10 for now) - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: btrfs : Introduction and Performance Evaluation

btrfs: Introduction and Performance Evaluation

Douglas FullerOak Ridge Leadership Computing Facility / ORNLLUG 2011

Page 2: btrfs : Introduction and Performance Evaluation

2 Managed by UT-Battellefor the U.S. Department of Energy

btrfs: overview

• Implemented in Linux 2.6.29• 64-bit• Extent-based• Copy on write• Multiple devices– Object pools (RAID-0, RAID-1, and RAID-10 for now)– Dynamic rebalancing

• Subvolumes with snapshots• Available transparent compression (zlib)

Page 3: btrfs : Introduction and Performance Evaluation

3 Managed by UT-Battellefor the U.S. Department of Energy

btrfs: still to come

• Erasure coding (RAID-5/RAID-6)• fsck• Dedup• Encryption

Page 4: btrfs : Introduction and Performance Evaluation

4 Managed by UT-Battellefor the U.S. Department of Energy

Goals

• Determine baseline btrfs performance• Evaluate pooling at the filesystem layer– Avoids expensive RAID controllers– Provides additional features

• Evaluate overhead from additional features

Page 5: btrfs : Introduction and Performance Evaluation

5 Managed by UT-Battellefor the U.S. Department of Energy

Test Platform

• Target: LSI Engenio (xbb2), 1TB fibre channel disks– DDR InfiniBand– Each disk on a separate backend channel– Controller write cache disabled– O_DIRECT– 1MB request sizes– I/O elevator noop

• Initiator– Nehalem with Linux 2.6.37– SRP

Page 6: btrfs : Introduction and Performance Evaluation

6 Managed by UT-Battellefor the U.S. Department of Energy

Baseline Performance

1 2 3 40

20

40

60

80

100

120

140

160

180

200

Raw

LUNsDisks

Page 7: btrfs : Introduction and Performance Evaluation

7 Managed by UT-Battellefor the U.S. Department of Energy

Sequential write

1 2 3 40

20

40

60

80

100

120

140

160

Sequential Write

btrfs-multibtrfs-singleext3

Page 8: btrfs : Introduction and Performance Evaluation

8 Managed by UT-Battellefor the U.S. Department of Energy

Sequential read

1 2 3 40

50

100

150

200

250

Sequential Read

btrfs-singlebtrfs-multiext3

Page 9: btrfs : Introduction and Performance Evaluation

9 Managed by UT-Battellefor the U.S. Department of Energy

Random write

1 2 3 40

5

10

15

20

25

30

35

40

45

50

Random Write

btrfs-singlebtrfs-multiext3

Page 10: btrfs : Introduction and Performance Evaluation

10 Managed by UT-Battellefor the U.S. Department of Energy

Random Read

1 2 3 40

10

20

30

40

50

60

70

80

90

100

Random Read

btrfs-singlebtrfs-multiext3

Page 11: btrfs : Introduction and Performance Evaluation

11 Managed by UT-Battellefor the U.S. Department of Energy

Untar

1 2 3 40

50

100

150

200

250

untar

btrfs-singlebtrfs-single-rbtrfs-multibtrfs-multi-rext3

Page 12: btrfs : Introduction and Performance Evaluation

12 Managed by UT-Battellefor the U.S. Department of Energy

Untar with compression

1 2 3 40

20

40

60

80

100

120

140

160

180

untar

uncompressedsinglesingle-rmultimulti-r

Page 13: btrfs : Introduction and Performance Evaluation

13 Managed by UT-Battellefor the U.S. Department of Energy

Random reads with compression

1 2 3 40

10

20

30

40

50

60

70

80

90

100

Random Read

read-uncmp-sread-cmp-sread-uncmp-mread-cmp-m

Page 14: btrfs : Introduction and Performance Evaluation

14 Managed by UT-Battellefor the U.S. Department of Energy

Random write with compression

1 2 3 40

5

10

15

20

25

30

35

40

45

50

Random Write

write-uncmp-swrite-cmp-swrite-uncmp-mwrite-cmp-m