10.1 Chapter 10 Error Detection and Correction Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
10.2 Data can be corrupted during transmission. Some applications require that errors be detected and corrected. Note
10.3 10-1 INTRODUCTION 10-1 INTRODUCTION Let us first discuss some issues related, directly or Let us first discuss some issues related, directly or indirectly, to error detection and correction. indirectly, to error detection and correction. Types of Errors Redundancy Detection Versus Correction Forward Error Correction Versus Retransmission Coding Modular Arithmetic Topics discussed in this section: Topics discussed in this section:
10.4 In a single-bit error, only 1 bit in the data unit has changed. Note
10.5 Figure 10.1 Single-bit error
10.6 A burst error means that 2 or more bits in the data unit have changed. Note
10.7 Figure 10.2 Burst error of length 8
10.8 To detect or correct errors, we need to send extra (redundant) bits with data. Note
10.9 Figure 10.3 The structure of encoder and decoder
10.10 In modulo-N arithmetic, we use only the integers in the range 0 to N −1, inclusive. Note
10.11 Figure 10.4 XORing of two single bits or two words
10.12 10-2 BLOCK CODING 10-2 BLOCK CODING In block coding, we divide our message into blocks, In block coding, we divide our message into blocks, each of k bits, called each of k bits, called datawords datawords. We add r redundant . We add r redundant bits to each block to make the length n = k + r. The bits to each block to make the length n = k + r. The resulting n-bit blocks are called resulting n-bit blocks are called codewords codewords. . Error Detection Error Correction Hamming Distance Minimum Hamming Distance Topics discussed in this section: Topics discussed in this section:
10.13 Figure 10.6 Process of error detection in block coding
10.14 Let us assume that k = 2 and n = 3. Table 10.1 shows the list of datawords and codewords (even parity). It is only good for detecting one bit error. Example 10.2 Table 10.1 A code for error detection (Example 10.2)
10.15 An error-detecting code can detect only the types of errors for which it is designed; other types of errors may remain undetected. Note
10.16 Figure 10.7 Structure of encoder and decoder in error correction
10.17 The Hamming distance between two words is the number of differences between corresponding bits. Note
10.18 Let us find the Hamming distance between two pairs of words. 1. The Hamming distance d(000, 011) is 2 because Example 10.4 2. The Hamming distance d(10101, 11110) is 3 because
10.19 The minimum Hamming distance is the smallest Hamming distance between all possible pairs in a set of words. Note
10.20 Find the minimum Hamming distance of the coding scheme in Table 10.1. Solution We first find all Hamming distances. Example 10.5 The dmin in this case is 2.
10.21 To guarantee the detection of up to s errors in all cases, the minimum Hamming distance in a block code must be dmin = s + 1. Note Why? More than s-bit error is possible to detect, but not guaranteed.
10.22 Figure 10.8 Geometric concept for finding dmin in error detection
10.23 Figure 10.9 Geometric concept for finding dmin in error correction
10.24 To guarantee correction of up to t errors in all cases, the minimum Hamming distance in a block code must be dmin = 2t + 1. Note
10.25 A code scheme has a Hamming distance dmin = 4. What is the error detection and correction capability of this scheme? Solution This code guarantees the detection of up to three errors (s = 3), but it can correct up to one error. In other words, if this code is used for error correction, part of its capability is wasted. Error correction codes should have an odd minimum distance (3, 5, 7, . . . ). Example 10.9
10.26 10-3 LINEAR BLOCK CODES 10-3 LINEAR BLOCK CODES Almost all block codes used today belong to a subset Almost all block codes used today belong to a subset called called linear block codes linear block codes. A linear block code is a code . A linear block code is a code in which the XOR (addition modulo-2) of two valid in which the XOR (addition modulo-2) of two valid codewords creates another valid codeword. codewords creates another valid codeword. Minimum Distance for Linear Block Codes Some Linear Block Codes Topics discussed in this section: Topics discussed in this section:
10.27 In a linear block code, the exclusive OR (XOR) of any two valid codewords creates another valid codeword. Note
10.28 Let us see if the two codes we defined in Table 10.1 belong to the class of linear block codes. The scheme in Table 10.1 is a linear block code because the result of XORing any codeword with any other codeword is a valid codeword. For example, the XORing of the second and third codewords creates the fourth one. Example 10.10
10.29 In our first code (Table 10.1), the numbers of 1s in the nonzero codewords are 2, 2, and 2. So the minimum Hamming distance is dmin = 2. Example 10.11 In a linear block code, the minimum Hamming distance is the number of 1s in the nonzero valid codeword with the smallest number of 1s. Note
10.30 A simple parity-check code is a single-bit error-detecting code in which n = k + 1 with dmin = 2. Note
10.31 Table 10.3 Simple parity-check code C(5, 4)
10.32 Figure 10.10 Encoder and decoder for simple parity-check code
Parity-check code  r0 = a3 + a2 + a1 + a1 (modulo-2)  Syndrome (calculated by the receiver)  s0 = b3 + b2 + b1 + b0 + q0 (modulo-2) 10.33
10.34 A simple parity-check code can detect an odd number of errors. Note
10.35 Figure 10.11 Two-dimensional parity-check code
10.36 Figure 10.11 Two-dimensional parity-check code
10.37 Figure 10.11 Two-dimensional parity-check code Two-dimensional parity-check can detect up to 3-bit errors
10.38 Table 10.4 Hamming code C(7, 4) C(n,k) dmin=3
10.39 Figure 10.12 The structure of the encoder and decoder for a Hamming code
Hamming Code  Parity checks are created as follow (using modulo-2)  r0 = a2 + a1 + a0  r1 = a3 + a2 + a1  r2 = a1 + a0 + a3 10.40
Hamming Code  The checker in the decoder creates a 3-bit syndrome (s2s1s0).  In which each bit is the parity check for 4 out of the 7 bits in the received codeword:  s0 = b2 + b1 + b0 + q0  s1 = b3 + b2 + b1 + q1  s2 = b1 + b0 + b3 + q2  The equations used by the checker are the same as those used by the generator with the parity-check bits added to the right-hand side of the equation. 10.41
10.42 Table 10.5 Logical decision made by the correction logic analyzer Hamming code C(7, 4) can : • detect up to 2-bit error (dmin -1) • can correct up to 1 bit error (dmin-1)/2
10.43 Figure 10.13 Burst error correction using Hamming code Split burst error between multiple codewords
10.44 10-4 CYCLIC CODES 10-4 CYCLIC CODES Cyclic codes Cyclic codes are special linear block codes with one are special linear block codes with one extra property. In a cyclic code, if a codeword is extra property. In a cyclic code, if a codeword is cyclically shifted (rotated), the result is another cyclically shifted (rotated), the result is another codeword. codeword. Cyclic Redundancy Check Hardware Implementation Polynomials Cyclic Code Analysis Advantages of Cyclic Codes Other Cyclic Codes Topics discussed in this section: Topics discussed in this section:
10.45 Table 10.6 A CRC code with C(7, 4)
10.46 Figure 10.14 CRC encoder and decoder
10.47 Figure 10.15 Division in CRC encoder
10.48 Figure 10.16 Division in the CRC decoder for two cases
10.49 Figure 10.20 General design of encoder and decoder of a CRC code
10.50 The divisor in a cyclic code is normally called the generator polynomial or simply the generator. Note
10.51 Figure 10.21 A polynomial to represent a binary word
10.52 Table 10.7 Standard polynomials
10.53 10-5 CHECKSUM 10-5 CHECKSUM The last error detection method we discuss here is The last error detection method we discuss here is called the checksum. The checksum is used in the called the checksum. The checksum is used in the Internet by several protocols although not at the data Internet by several protocols although not at the data link layer. However, we briefly discuss it here to link layer. However, we briefly discuss it here to complete our discussion on error checking complete our discussion on error checking Idea One’s Complement Internet Checksum Topics discussed in this section: Topics discussed in this section:
10.54 Suppose our data is a list of five 4-bit numbers that we want to send to a destination. In addition to sending these numbers, we send the sum of the numbers. For example, if the set of numbers is (7, 11, 12, 0, 6), we send (7, 11, 12, 0, 6, 36), where 36 is the sum of the original numbers. The receiver adds the five numbers and compares the result with the sum. If the two are the same, the receiver assumes no error, accepts the five numbers, and discards the sum. Otherwise, there is an error somewhere and the data are not accepted. Example 10.18
10.55 We can make the job of the receiver easier if we send the negative (complement) of the sum, called the checksum. In this case, we send (7, 11, 12, 0, 6, −36). The receiver can add all the numbers received (including the checksum). If the result is 0, it assumes no error; otherwise, there is an error. Example 10.19
10.56 How can we represent the number 21 in one’s complement arithmetic using only four bits? Solution The number 21 in binary is 10101 (it needs five bits). We can wrap the leftmost bit and add it to the four rightmost bits. We have (0101 + 1) = 0110 or 6. Example 10.20
10.57 How can we represent the number −6 in one’s complement arithmetic using only four bits? Solution In one’s complement arithmetic, the negative or complement of a number is found by inverting all bits. Positive 6 is 0110; negative 6 is 1001. If we consider only unsigned numbers, this is 9. In other words, the complement of 6 is 9. Example 10.21
10.58 Figure 10.24 Example 10.22 1 1 1 0
10.59 Sender site: 1. The message is divided into 16-bit words. 2. The value of the checksum word is set to 0. 3. All words including the checksum are added using one’s complement addition. 4. The sum is complemented and becomes the checksum. 5. The checksum is sent with the data. Note
10.60 Receiver site: 1. The message (including checksum) is divided into 16-bit words. 2. All words are added using one’s complement addition. 3. The sum is complemented and becomes the new checksum. 4. If the value of checksum is 0, the message is accepted; otherwise, it is rejected. Note
Internet Checksum Example  Note  When adding numbers, a carryout from the most significant bit needs to be added to the result  Example: add two 16-bit integers 1 1 1 1 0 0 1 1 0 0 1 1 0 0 1 1 0 1 1 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 1 0 0 1 0 1 0 0 0 1 0 0 0 1 0 0 0 0 1 1 wraparound sum checksum

Error Detection and Correction Data Communication and Networking

  • 1.
    10.1 Chapter 10 Error Detection andCorrection Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
  • 2.
    10.2 Data can becorrupted during transmission. Some applications require that errors be detected and corrected. Note
  • 3.
    10.3 10-1 INTRODUCTION 10-1 INTRODUCTION Letus first discuss some issues related, directly or Let us first discuss some issues related, directly or indirectly, to error detection and correction. indirectly, to error detection and correction. Types of Errors Redundancy Detection Versus Correction Forward Error Correction Versus Retransmission Coding Modular Arithmetic Topics discussed in this section: Topics discussed in this section:
  • 4.
    10.4 In a single-biterror, only 1 bit in the data unit has changed. Note
  • 5.
  • 6.
    10.6 A burst errormeans that 2 or more bits in the data unit have changed. Note
  • 7.
    10.7 Figure 10.2 Bursterror of length 8
  • 8.
    10.8 To detect orcorrect errors, we need to send extra (redundant) bits with data. Note
  • 9.
    10.9 Figure 10.3 Thestructure of encoder and decoder
  • 10.
    10.10 In modulo-N arithmetic,we use only the integers in the range 0 to N −1, inclusive. Note
  • 11.
    10.11 Figure 10.4 XORingof two single bits or two words
  • 12.
    10.12 10-2 BLOCK CODING 10-2BLOCK CODING In block coding, we divide our message into blocks, In block coding, we divide our message into blocks, each of k bits, called each of k bits, called datawords datawords. We add r redundant . We add r redundant bits to each block to make the length n = k + r. The bits to each block to make the length n = k + r. The resulting n-bit blocks are called resulting n-bit blocks are called codewords codewords. . Error Detection Error Correction Hamming Distance Minimum Hamming Distance Topics discussed in this section: Topics discussed in this section:
  • 13.
    10.13 Figure 10.6 Processof error detection in block coding
  • 14.
    10.14 Let us assumethat k = 2 and n = 3. Table 10.1 shows the list of datawords and codewords (even parity). It is only good for detecting one bit error. Example 10.2 Table 10.1 A code for error detection (Example 10.2)
  • 15.
    10.15 An error-detecting codecan detect only the types of errors for which it is designed; other types of errors may remain undetected. Note
  • 16.
    10.16 Figure 10.7 Structureof encoder and decoder in error correction
  • 17.
    10.17 The Hamming distancebetween two words is the number of differences between corresponding bits. Note
  • 18.
    10.18 Let us findthe Hamming distance between two pairs of words. 1. The Hamming distance d(000, 011) is 2 because Example 10.4 2. The Hamming distance d(10101, 11110) is 3 because
  • 19.
    10.19 The minimum Hammingdistance is the smallest Hamming distance between all possible pairs in a set of words. Note
  • 20.
    10.20 Find the minimumHamming distance of the coding scheme in Table 10.1. Solution We first find all Hamming distances. Example 10.5 The dmin in this case is 2.
  • 21.
    10.21 To guarantee thedetection of up to s errors in all cases, the minimum Hamming distance in a block code must be dmin = s + 1. Note Why? More than s-bit error is possible to detect, but not guaranteed.
  • 22.
    10.22 Figure 10.8 Geometricconcept for finding dmin in error detection
  • 23.
    10.23 Figure 10.9 Geometricconcept for finding dmin in error correction
  • 24.
    10.24 To guarantee correctionof up to t errors in all cases, the minimum Hamming distance in a block code must be dmin = 2t + 1. Note
  • 25.
    10.25 A code schemehas a Hamming distance dmin = 4. What is the error detection and correction capability of this scheme? Solution This code guarantees the detection of up to three errors (s = 3), but it can correct up to one error. In other words, if this code is used for error correction, part of its capability is wasted. Error correction codes should have an odd minimum distance (3, 5, 7, . . . ). Example 10.9
  • 26.
    10.26 10-3 LINEAR BLOCKCODES 10-3 LINEAR BLOCK CODES Almost all block codes used today belong to a subset Almost all block codes used today belong to a subset called called linear block codes linear block codes. A linear block code is a code . A linear block code is a code in which the XOR (addition modulo-2) of two valid in which the XOR (addition modulo-2) of two valid codewords creates another valid codeword. codewords creates another valid codeword. Minimum Distance for Linear Block Codes Some Linear Block Codes Topics discussed in this section: Topics discussed in this section:
  • 27.
    10.27 In a linearblock code, the exclusive OR (XOR) of any two valid codewords creates another valid codeword. Note
  • 28.
    10.28 Let us seeif the two codes we defined in Table 10.1 belong to the class of linear block codes. The scheme in Table 10.1 is a linear block code because the result of XORing any codeword with any other codeword is a valid codeword. For example, the XORing of the second and third codewords creates the fourth one. Example 10.10
  • 29.
    10.29 In our firstcode (Table 10.1), the numbers of 1s in the nonzero codewords are 2, 2, and 2. So the minimum Hamming distance is dmin = 2. Example 10.11 In a linear block code, the minimum Hamming distance is the number of 1s in the nonzero valid codeword with the smallest number of 1s. Note
  • 30.
    10.30 A simple parity-checkcode is a single-bit error-detecting code in which n = k + 1 with dmin = 2. Note
  • 31.
    10.31 Table 10.3 Simpleparity-check code C(5, 4)
  • 32.
    10.32 Figure 10.10 Encoderand decoder for simple parity-check code
  • 33.
    Parity-check code  r0= a3 + a2 + a1 + a1 (modulo-2)  Syndrome (calculated by the receiver)  s0 = b3 + b2 + b1 + b0 + q0 (modulo-2) 10.33
  • 34.
    10.34 A simple parity-checkcode can detect an odd number of errors. Note
  • 35.
  • 36.
  • 37.
    10.37 Figure 10.11 Two-dimensionalparity-check code Two-dimensional parity-check can detect up to 3-bit errors
  • 38.
    10.38 Table 10.4 Hammingcode C(7, 4) C(n,k) dmin=3
  • 39.
    10.39 Figure 10.12 Thestructure of the encoder and decoder for a Hamming code
  • 40.
    Hamming Code  Paritychecks are created as follow (using modulo-2)  r0 = a2 + a1 + a0  r1 = a3 + a2 + a1  r2 = a1 + a0 + a3 10.40
  • 41.
    Hamming Code  Thechecker in the decoder creates a 3-bit syndrome (s2s1s0).  In which each bit is the parity check for 4 out of the 7 bits in the received codeword:  s0 = b2 + b1 + b0 + q0  s1 = b3 + b2 + b1 + q1  s2 = b1 + b0 + b3 + q2  The equations used by the checker are the same as those used by the generator with the parity-check bits added to the right-hand side of the equation. 10.41
  • 42.
    10.42 Table 10.5 Logicaldecision made by the correction logic analyzer Hamming code C(7, 4) can : • detect up to 2-bit error (dmin -1) • can correct up to 1 bit error (dmin-1)/2
  • 43.
    10.43 Figure 10.13 Bursterror correction using Hamming code Split burst error between multiple codewords
  • 44.
    10.44 10-4 CYCLIC CODES 10-4CYCLIC CODES Cyclic codes Cyclic codes are special linear block codes with one are special linear block codes with one extra property. In a cyclic code, if a codeword is extra property. In a cyclic code, if a codeword is cyclically shifted (rotated), the result is another cyclically shifted (rotated), the result is another codeword. codeword. Cyclic Redundancy Check Hardware Implementation Polynomials Cyclic Code Analysis Advantages of Cyclic Codes Other Cyclic Codes Topics discussed in this section: Topics discussed in this section:
  • 45.
    10.45 Table 10.6 ACRC code with C(7, 4)
  • 46.
    10.46 Figure 10.14 CRCencoder and decoder
  • 47.
  • 48.
    10.48 Figure 10.16 Divisionin the CRC decoder for two cases
  • 49.
    10.49 Figure 10.20 Generaldesign of encoder and decoder of a CRC code
  • 50.
    10.50 The divisor ina cyclic code is normally called the generator polynomial or simply the generator. Note
  • 51.
    10.51 Figure 10.21 Apolynomial to represent a binary word
  • 52.
  • 53.
    10.53 10-5 CHECKSUM 10-5 CHECKSUM Thelast error detection method we discuss here is The last error detection method we discuss here is called the checksum. The checksum is used in the called the checksum. The checksum is used in the Internet by several protocols although not at the data Internet by several protocols although not at the data link layer. However, we briefly discuss it here to link layer. However, we briefly discuss it here to complete our discussion on error checking complete our discussion on error checking Idea One’s Complement Internet Checksum Topics discussed in this section: Topics discussed in this section:
  • 54.
    10.54 Suppose our datais a list of five 4-bit numbers that we want to send to a destination. In addition to sending these numbers, we send the sum of the numbers. For example, if the set of numbers is (7, 11, 12, 0, 6), we send (7, 11, 12, 0, 6, 36), where 36 is the sum of the original numbers. The receiver adds the five numbers and compares the result with the sum. If the two are the same, the receiver assumes no error, accepts the five numbers, and discards the sum. Otherwise, there is an error somewhere and the data are not accepted. Example 10.18
  • 55.
    10.55 We can makethe job of the receiver easier if we send the negative (complement) of the sum, called the checksum. In this case, we send (7, 11, 12, 0, 6, −36). The receiver can add all the numbers received (including the checksum). If the result is 0, it assumes no error; otherwise, there is an error. Example 10.19
  • 56.
    10.56 How can werepresent the number 21 in one’s complement arithmetic using only four bits? Solution The number 21 in binary is 10101 (it needs five bits). We can wrap the leftmost bit and add it to the four rightmost bits. We have (0101 + 1) = 0110 or 6. Example 10.20
  • 57.
    10.57 How can werepresent the number −6 in one’s complement arithmetic using only four bits? Solution In one’s complement arithmetic, the negative or complement of a number is found by inverting all bits. Positive 6 is 0110; negative 6 is 1001. If we consider only unsigned numbers, this is 9. In other words, the complement of 6 is 9. Example 10.21
  • 58.
  • 59.
    10.59 Sender site: 1. Themessage is divided into 16-bit words. 2. The value of the checksum word is set to 0. 3. All words including the checksum are added using one’s complement addition. 4. The sum is complemented and becomes the checksum. 5. The checksum is sent with the data. Note
  • 60.
    10.60 Receiver site: 1. Themessage (including checksum) is divided into 16-bit words. 2. All words are added using one’s complement addition. 3. The sum is complemented and becomes the new checksum. 4. If the value of checksum is 0, the message is accepted; otherwise, it is rejected. Note
  • 61.
    Internet Checksum Example Note  When adding numbers, a carryout from the most significant bit needs to be added to the result  Example: add two 16-bit integers 1 1 1 1 0 0 1 1 0 0 1 1 0 0 1 1 0 1 1 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 1 1 0 1 1 1 1 0 0 1 0 1 0 0 0 1 0 0 0 1 0 0 0 0 1 1 wraparound sum checksum

Editor's Notes

  • #61 Kurose and Ross forgot to say anything about wrapping the carry and adding it to low order bit