voiceband signal classifier

56
(12) US006708146B1 United States Patent Sewall et al. (10) Patent N0.: (45) Date of Patent: US 6,708,146 B1 Mar. 16, 2004 (54) (75) (73) (*) (21) (22) (63) (51) (52) (58) (56) VOICEBAND SIGNAL CLASSIFIER 5,579,435 A * 11/1996 Jansson .................... .. 704/208 5,602,938 A * 2/1997 Akiyama et a1. ......... .. 382/155 Inventors: Jeremy S. Sewall, Edmonton (CA); 5,611,019 A 3/1997 Nakatoh Bruce E Cockburn, Edmonton (CA); 2 i garreltlt et a1. ............. .. 704/255 7 7 8.11116 Deepak P‘ Sarda’ Petalum’ CA(US) 6,240,282 B1 * 5/2001 Kleider et a1. ......... .. 455/2201 Assigneez Telecommunications Research 6,272,479 B1 * 8/2001 Farry et al. ................. .. 706/13 Laboratories, EdIIlOIliOIl Notice? Subject_ to any disclaimer: the term of this YatsuZuka, Y., “Highly Sensitive Speech Detector and High Patent 15 extended or adlusted under 35 —Speed Voiceband Data Discriminator in DSI—ADPCM U50 154(1)) by 0 days- Systems,” IEEE Transactions on Communications 30:739—750 (Apr. 1982). Appl. N0.: 09/303,160 Roberge, C., and Adoul, .J.—P., “Fast On—Line Speech/ _ _ Voiceband—Data Discrimination for Statistical Multiplexing Feed‘ Apr‘ 30’ 1999 of Data With Telephone Conversations,” IEEE Transactions R l t d U S A l_ t_ D t on Communications 34:744—751 (Aug. 1986). e a e ' ' pp lea Ion a a Kobatake, H., TaWa, K., and Ishida, A., “Speech/Nonspeech - - _- _ - - Discrimination for Speech Recognition System under Real giftgjufgtg); ilrggaggzflggglelsenon NO' 08/779’862’ ?led on Life Noise Environments,” Conf. Proceedings of the IEEE ICASSP (IV, 1989), 365—368. Int. Cl.7 .............................................. .. G10L 15/08 U-S- Cl- ...................................... .. Primary Examiner_DaVid Knepper Field of Search ............................... .. 704/205—218, (74) Attorney, Agent, or Firm—Christensen O’Connor 704/231—234, 237, 238, 239, 255; 382/155; Johnson Kindness PLLC 455/2261; 706/13 (57) ABSTRACT References Cited A method and apparatus for classifying signals into a US‘ PATENT DOCUMENTS multiplicity of signal classes 'VVhI'Ch'CIIIPlOYS' discriminant functions of low-complexity discriminant variables that are 3,851,112 A 11/1974 Kusan computed directly from the passband signal. The method can 4,027,102 A 5/1977 Ando et al. be applied to the problem of classifying voiceband data 4,672,669 A 6/1987 DesBlanche (VBD), facsimile (FAX), native binary data, and speech on 4,720,862 A 1/1988 Nakata et a1. a 64 Kbps digital channel. In a hybrid tWo stage classi?ca 4,815,136 A 3/1989 Benvenllto tion system, the ?rst stage employs linear discriminant 4,815,137 A 3/1989 BFIIVCIIUFO functions to make classi?cation decisions into a smaller 49827150 A 1/1991 sllverstem et al- number of possible preliminary signal classes. The decisions 5,018,200 A * 5/1991 OZaWa ..................... .. 704/222 of the ?rst Stage are then re?ned by a Second Stage that uses 2210322 A 5/1993 Kenyon 1 nonlinear discriminant functions such as quadratic or 53%;; 2 g greteman et a‘ pseudo-quadratic functions. The second stage of a hybrid 5’311’575 A 41994 0110 classi?er then assigns the signal into a larger number of 5:315:7O4 A * 5/1994 Shinta et a1‘ ttttttttttttt N 704032 plossible classes than does the ?rst stage of the classi?er 5,325,425 A 6/1994 Novas et a1. a one 5,353,346 A 10/1994 COX et 211. 5,365,426 A 11/1994 Siegel et al. 20 Claims, 41 Drawing Sheets 22\ 2% > Power Idle Channel Estimalor Detector Y 1 st 1 Central 9'13 M- I F II- S d |O+Tra::1f3gn:ison T Fljecrllflelf _> $322‘ _> m + Moment '5 L c \ 18 w A ‘g 5 1% H41 _‘ ‘ ‘0 g T; 1Z1 E 8 5 E \5 8 T3 '3 g Class 7* E z _’ e F + a 2 + E g <5 5 .5 = Aulocorrelation ' '55 " 5m Em L’ Subsystem ' g > 2 ‘2kg -> —> 26 28 j 20 J

Upload: hoangkhanh

Post on 02-Jan-2017

240 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Voiceband signal classifier

(12)

US006708146B1

United States Patent Sewall et al.

(10) Patent N0.: (45) Date of Patent:

US 6,708,146 B1 Mar. 16, 2004

(54)

(75)

(73)

(*)

(21) (22)

(63)

(51) (52) (58)

(56)

VOICEBAND SIGNAL CLASSIFIER 5,579,435 A * 11/1996 Jansson .................... .. 704/208 5,602,938 A * 2/1997 Akiyama et a1. ......... .. 382/155

Inventors: Jeremy S. Sewall, Edmonton (CA); 5,611,019 A 3/1997 Nakatoh Bruce E Cockburn, Edmonton (CA); 2 i garreltlt et a1. ............. .. 704/255

7 7 8.11116

Deepak P‘ Sarda’ Petalum’ CA(US) 6,240,282 B1 * 5/2001 Kleider et a1. ......... .. 455/2201

Assigneez Telecommunications Research 6,272,479 B1 * 8/2001 Farry et al. ................. .. 706/13

Laboratories, EdIIlOIliOIl Notice? Subject_ to any disclaimer: the term of this YatsuZuka, Y., “Highly Sensitive Speech Detector and High Patent 15 extended or adlusted under 35 —Speed Voiceband Data Discriminator in DSI—ADPCM U50 154(1)) by 0 days- Systems,” IEEE Transactions on Communications

30:739—750 (Apr. 1982). Appl. N0.: 09/303,160 Roberge, C., and Adoul, .J.—P., “Fast On—Line Speech/

_ _ Voiceband—Data Discrimination for Statistical Multiplexing Feed‘ Apr‘ 30’ 1999 of Data With Telephone Conversations,” IEEE Transactions

R l t d U S A l_ t_ D t on Communications 34:744—751 (Aug. 1986). e a e ' ' pp lea Ion a a Kobatake, H., TaWa, K., and Ishida, A., “Speech/Nonspeech

- - _- _ - - Discrimination for Speech Recognition System under Real

giftgjufgtg); ilrggaggzflggglelsenon NO' 08/779’862’ ?led on Life Noise Environments,” Conf. Proceedings of the IEEE ICASSP (IV, 1989), 365—368.

Int. Cl.7 .............................................. .. G10L 15/08

U-S- Cl- ...................................... .. Primary Examiner_DaVid Knepper

Field of Search ............................... .. 704/205—218, (74) Attorney, Agent, or Firm—Christensen O’Connor 704/231—234, 237, 238, 239, 255; 382/155; Johnson Kindness PLLC

455/2261; 706/13 (57) ABSTRACT

References Cited A method and apparatus for classifying signals into a

US‘ PATENT DOCUMENTS multiplicity of signal classes 'VVhI'Ch'CIIIPlOYS' discriminant functions of low-complexity discriminant variables that are

3,851,112 A 11/1974 Kusan computed directly from the passband signal. The method can 4,027,102 A 5/1977 Ando et al. be applied to the problem of classifying voiceband data 4,672,669 A 6/1987 DesBlanche (VBD), facsimile (FAX), native binary data, and speech on 4,720,862 A 1/1988 Nakata et a1. a 64 Kbps digital channel. In a hybrid tWo stage classi?ca 4,815,136 A 3/1989 Benvenllto tion system, the ?rst stage employs linear discriminant 4,815,137 A 3/1989 BFIIVCIIUFO functions to make classi?cation decisions into a smaller 49827150 A 1/1991 sllverstem et al- number of possible preliminary signal classes. The decisions 5,018,200 A * 5/1991 OZaWa ..................... .. 704/222 of the ?rst Stage are then re?ned by a Second Stage that uses

2210322 A 5/1993 Kenyon 1 nonlinear discriminant functions such as quadratic or 53%;; 2 g greteman et a‘ pseudo-quadratic functions. The second stage of a hybrid 5’311’575 A 41994 0110 classi?er then assigns the signal into a larger number of 5:315:7O4 A * 5/1994 Shinta et a1‘ ttttttttttttt N 704032 plossible classes than does the ?rst stage of the classi?er 5,325,425 A 6/1994 Novas et a1. a one 5,353,346 A 10/1994 COX et 211. 5,365,426 A 11/1994 Siegel et al. 20 Claims, 41 Drawing Sheets

22\ 2% > Power Idle Channel

Estimalor Detector

Y 1 st 1 Central

9'13 M- I F II- S d |O+Tra::1f3gn:ison T Fljecrllflelf _> $322‘ _> m +

Moment '5 L c

\ 18 w A ‘g 5 1% H41 _‘ ‘ ‘0 g T; 1Z1 E 8 5

E \5 8 T3 '3 g Class 7* E z _’ e F + a 2 +

E g <5 5 .5 = Aulocorrelation ' '55 " 5m Em

L’ Subsystem ' g > ‘ 2

‘2kg -> —>

26 28 j 20 J

Page 2: Voiceband signal classifier

US 6,708,146 B1 Page 2

Benvenuto, N., “Detection of Modem Type and Bit Rate of FSK Voiceband Data Signals,” IEEE International Confer ence on Communications (Jun. 11—14, 1989),. 1101—1105. Benvenuto, N., “Classi?cation of Voiceband Data Signals Using the Constellation Magnitude,” IEEE Transactions on Communications 43:2759—2770 (Nov. 1995). Hipp, J .E., “Modulation Classi?cation Based on Statistical Moments,” Conf. Proceedings of the IEEE MILCOM (Oct. 1986), 20.2.1—20.2.6. Mammone, R.J., Rothaker, R.J., Podilchuk, C.I., Davi dovici, S., and Schilling, D.L., “Estimation of Carrier Fre quency, Modulation Type and Bit Rate of an Unknown Modulated Signal,” Conf. Proceedings of the IEEE Interna tional Conference on Communications (Jun. 1987), 28.4.1—28.4.7. Benvenuto, N., and Daumer, W.R., “Classi?cation of Voi ceband Data Signals,” IEEE International Conf. on Com munications (Apr. 16—19, 1990), 1010—1013. Benvenuto, N., “A Speech/Voiceband Data Discriminator,” IEEE Transactions on Communications 43:539—543 (Apr.

1993). “Dafotel NET—MONITOR System 2432,” Product Bro chure, Compression Technology Corp., Germantown, Mary land, undated. “AT&T Voice/Data Call Classi?er” Product Brochure, AT&T Network Systems, 1991. “Digital Channel Occupancy Analyser” Product Brochure, Tellabs Ltd., Lisle, Illinois, 1990. Law, R.A., Holm, T.W., and Cox, N.B., “Real—Time Mul ti—Channel Monitoring of Communications on a T1 Span,” IEEE Paci?c Rim Conference on Communications, Com puters and Signal Processing (May 9—10, 1991), 306—309. Shumway, R.H., “Discriminant Analysis for Time Series,” in PR. Krishnaiah and LN. Kanal, eds., Handbook of Statis tics, vol. 2, North—Holland Publishing Company (1982), 1—46. Norusis, M.J., “Discriminant Analysis,” in SPSS Profes sional Statistics 6—1, SPSS Inc. (1994), 1—45. Proakis, J .G., and Salehi, M., Section 2.4, in Communication Systems Engineering, Prentice—Hall (1994), 100—105. Oppenheim, A.V., and Shafer, R.W., “Spectrum Analysis of Random Signals Using Estimates of the Autocorrelation Sequence,” in Discrete—Time Signal Processing, Prentice —Hall (1989), 742—747.

Franks, L., “Representation of Bandpass Signals,” in Signal Theory, (1969), 79—97. O’Neal, Jr., J.B., and Stroh, R.W., “Differential PCM for Speech and Data Signals,” IEEE Transactions on Commu nications 20:900—913 (Oct. 1972). Carey, M.B., Chen, H.—T., DesclouX, A., Ingle, J.E., and Park, K.I., “1982/83 End Of?ce Connection Study: Analog Voice and Voiceband Data Transmission Performance Char acteriZation of the Public Switched Network,” AT &T Bell Laboratories Technical Journal, 63:2059—2119 (Nov. 1984). Sewall, J .S., and Cockburn, B.F., “Signal Classi?cation in Digital Telephone Networks,” IEEE Cdn. Conf. on Electri cal and Computer Engineering (Sep. 5—8, 1995), 957—961. Geisser, S., “Bayesian Discrimination,” in PR. Krishnaiah and LN. Kanal, eds., Handbook of Statistics, vol. 2, North— Holland Publishing Company (1982), 101—120. Hu, M.—K., “Visual Pattern Recognition by Moment Invari ants,” IRE Transactions on Information Theory (1968), 179—187.

Sewall, J .S., and Cockburn, B.F., “Near—Optimal Voiceband Signal Classi?cation Using the Autocorrelation Sequence and the Central Second—Order Moment,” accepted for pub lication, IEEE Transactions on Communications 45(Jul. 1997). J .S. Sewall, Signal Classi?cation in Digital Telephone Net works, unpublished dissertation, University of Alberta, Edmonton, Canada, 1996. Cockburn, BF. and Sarda, D.P., “Implementation and Evaluation of an Accurate Real—Time Voiceband Signal Classi?er,” submitted to programme committee of the 1998 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE 98) Nov. 28, 1997, and Mar. 23, 1998, Conference dates, May 24—28, 1998, Waterloo, Ontario, 4 pages. D.R Irvin, “Voice/Data Detector and Discriminator for Use in Transform Speech Coders,” IBM Technical Disclosure Bulletin, vol. 26, No. 1, Jun. 1983, pp. 363—365. Watanabe, Hideyuki et al., “Discriminative Metric Design For Pattern Recognition,” ICASSP—95., 1995 International Conference on Acoustics, Speech, and Signal Processing (May 9—12, 1995), pp. 3439—3442 and abstract page.

* cited by examiner

Page 3: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 1 6f 41 US 6,708,146 B1

wmmTQ ‘l

H .wHh.

@J

\(Q

Em m>w : F n w 5283:0023“

E2w>w .nsw

comwmomo 1;

\

EmEoE

6E0 6:20am ‘I CBGEBECEP lncoomm o>ma1zsm $220822

EbcmO {N 5

i 9 E56

Page 4: Voiceband signal classifier
Page 5: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 3 6f 41 US 6,708,146 B1

. .m

@ m 3

‘B: \I M

LI ii

6 6 W68

. . Emugmnsw S . N DA“ . 52226025. .44

n G o u. 2 1 @

wmmll rm 9 LL WW ‘I

a a w m m ,3

w w m \

a ,

bowmgzwm COMHMELOUwCS-P ‘1 330m ‘A wmwEoEmE ECmMw

» {N 363mm L

:m we 6520 22

Page 6: Voiceband signal classifier
Page 7: Voiceband signal classifier
Page 8: Voiceband signal classifier
Page 9: Voiceband signal classifier
Page 10: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 8 6f 41 US 6,708,146 B1

w JUNE w?éoc mm 9 22 mm 2 6520 ECEEQ

miowa 086 a

>

w goswm?iwgoa A

628 566 oz Egon“ ?cgw

Page 11: Voiceband signal classifier

Sheet 9 0f 41 US 6,708,146 B1

@ .02. 5:52am E568 m 6%, 2 #3699 620 8:8 @5 5 2362 $20 @5 59:0

+ m2? 526:2 EQEEEEU mgmmmbmv 8 96693 wmwm?o 363$ @5 com + mwEo @2898 comm L2 5:22 EQEEEEU . 695 9: v6 m2?

6520 29 25%;. 9: @8528 605%? 2 0 $20 5930 EmEEEmMo o5 Eoi

Mar. 16, 2004

w 882% m®> ECCGLQ Q2

U.S. Patent

dwwmQEmQ “Ea Ecgm o5 cmgozéi E2925 c2280 Ems:

Page 12: Voiceband signal classifier
Page 13: Voiceband signal classifier
Page 14: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 12 6f 41 US 6,708,146 B1

23m c2280

E?gwnsw c2230 25>: mmww?o ,6 a: Umtow

Awwwmgo :m P; .mw?u 6580 :5 "22:02“ 29.5 E2w>wn=w c2208 wcouom

E 6: 8:8

uBsnEnu :5 “2250mm wwws £22695 c2280 FEE

» 3628 6:520 22 E0:

NH

JFK

_. EmEEtowE . GHQ

33%;

Page 15: Voiceband signal classifier
Page 16: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 14 6f 41 US 6,708,146 B1

¥&\

6:5 All c2280 03 25>:

E?gwnsw c2280 25>:

3

mjf Eopw>mnsw Ail; c2280 mwmw?o . . .6 a: hmoEEoz 8:8

E?gwnsw All! 522000 $8.20 . .. Ba: 80:3 Brow

<%\

3628 6:520 22 E0:

._ EmEEtomE Po wwEm>

Page 17: Voiceband signal classifier
Page 18: Voiceband signal classifier

U.S. Patent Mar. 16, 2004 Sheet 16 6f 41 US 6,708,146 B1

899x53 £22020 6mm: @5 5 862mm @966 5930 Oz 658% 22 28%5 8 o @220 BQSO

@H .wHm

E2335 566% 63:5: 9: 5 862mm 320 S850

,, wmmmm? Emu: @5305 , GQE Q2 m5. 6* 8:6: 96:82 EmEEzoQw 8mg: .5: 9E

A.

m, 862% wo> 6:520 .22

@66228 wmmww? 8%: @5806 E05 03: 6am 5.6.08 25>: E58 @2025

Page 19: Voiceband signal classifier
Page 20: Voiceband signal classifier
Page 21: Voiceband signal classifier
Page 22: Voiceband signal classifier
Page 23: Voiceband signal classifier
Page 24: Voiceband signal classifier
Page 25: Voiceband signal classifier
Page 26: Voiceband signal classifier
Page 27: Voiceband signal classifier
Page 28: Voiceband signal classifier
Page 29: Voiceband signal classifier
Page 30: Voiceband signal classifier
Page 31: Voiceband signal classifier
Page 32: Voiceband signal classifier
Page 33: Voiceband signal classifier
Page 34: Voiceband signal classifier
Page 35: Voiceband signal classifier
Page 36: Voiceband signal classifier
Page 37: Voiceband signal classifier
Page 38: Voiceband signal classifier
Page 39: Voiceband signal classifier
Page 40: Voiceband signal classifier
Page 41: Voiceband signal classifier
Page 42: Voiceband signal classifier
Page 43: Voiceband signal classifier
Page 44: Voiceband signal classifier
Page 45: Voiceband signal classifier
Page 46: Voiceband signal classifier
Page 47: Voiceband signal classifier
Page 48: Voiceband signal classifier
Page 49: Voiceband signal classifier
Page 50: Voiceband signal classifier
Page 51: Voiceband signal classifier
Page 52: Voiceband signal classifier
Page 53: Voiceband signal classifier
Page 54: Voiceband signal classifier
Page 55: Voiceband signal classifier
Page 56: Voiceband signal classifier