throughput, and bandwidth memory access cycle …€¦ · schaum’s outline of theory and problems...

12

Click here to load reader

Upload: phungkhue

Post on 28-Aug-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

1

Chapter 08: The Memory System

Lesson 10:Memory Access Cycle Time, Latency,

Throughput, and Bandwidth

Page 2: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

2

Objective

• Learn computation of access time, latency and bandwidths

Page 3: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

3

Latency, Throughput and bandwidth

Page 4: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

4

Latency and throughput term use in processor pipelines

• Latency─ the time taken to complete an individual operation

• Throughput─ the rate at which operations can be completed

Page 5: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

5

Latency and throughput term use in memory

• Latency─ the time taken to complete an individual memory read or write operation

• Throughput─ the rate at which operations can be completed

Page 6: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

6

Bandwidth term use in Memory

• Bandwidth─ the total rate at which data can be moved between the processor and memory

• Bandwidth─ can be thought of as the product of the throughput and the amount of data referenced by each memory operation

Page 7: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

7

Example

• Assume─ a memory system latency of 10 ns per operation

• Assume─ A data width of 32 bits• Assume─ only one operation can be

performed at a time and there is no delay between operations

Page 8: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

8

Solution for the throughput and bandwidth of the memory system

• Throughput = l/(latency) when operations execute sequentially

• = 1/ (10 ns) system = 100 million operations/s. • Each operation references 32 bits of data, the

bandwidth = 32 ×100 million operations/s = 3.2 billion bits/s, or (3.2 billion/8) = 400 million bytes/s

Page 9: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

9

Actual bandwidth achievable in practice

• Generally much less than the peak bandwidth when running programs on a computer

• No requests going to the memory system at certain times

• Conflicts for memory banks, and other factors at certain times

Page 10: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

10

Summary

Page 11: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

11

We learnt

• Computation of access time, latency and bandwidths

Page 12: Throughput, and Bandwidth Memory Access Cycle …€¦ · Schaum’s Outline of Theory and Problems of Computer Architecture ... • Throughput = l/(latency) when operations execute

Schaum’s Outline of Theory and Problems of Computer ArchitectureCopyright © The McGraw-Hill Companies Inc. Indian Special Edition 2009

12

End of Lesson 10 on Memory Access Cycle Time, Latency,

Throughput, and Bandwidth