voiceband signal classifier
TRANSCRIPT
(12)
US006708146B1
United States Patent Sewall et al.
(10) Patent N0.: (45) Date of Patent:
US 6,708,146 B1 Mar. 16, 2004
(54)
(75)
(73)
(*)
(21) (22)
(63)
(51) (52) (58)
(56)
VOICEBAND SIGNAL CLASSIFIER 5,579,435 A * 11/1996 Jansson .................... .. 704/208 5,602,938 A * 2/1997 Akiyama et a1. ......... .. 382/155
Inventors: Jeremy S. Sewall, Edmonton (CA); 5,611,019 A 3/1997 Nakatoh Bruce E Cockburn, Edmonton (CA); 2 i garreltlt et a1. ............. .. 704/255
7 7 8.11116
Deepak P‘ Sarda’ Petalum’ CA(US) 6,240,282 B1 * 5/2001 Kleider et a1. ......... .. 455/2201
Assigneez Telecommunications Research 6,272,479 B1 * 8/2001 Farry et al. ................. .. 706/13
Laboratories, EdIIlOIliOIl Notice? Subject_ to any disclaimer: the term of this YatsuZuka, Y., “Highly Sensitive Speech Detector and High Patent 15 extended or adlusted under 35 —Speed Voiceband Data Discriminator in DSI—ADPCM U50 154(1)) by 0 days- Systems,” IEEE Transactions on Communications
30:739—750 (Apr. 1982). Appl. N0.: 09/303,160 Roberge, C., and Adoul, .J.—P., “Fast On—Line Speech/
_ _ Voiceband—Data Discrimination for Statistical Multiplexing Feed‘ Apr‘ 30’ 1999 of Data With Telephone Conversations,” IEEE Transactions
R l t d U S A l_ t_ D t on Communications 34:744—751 (Aug. 1986). e a e ' ' pp lea Ion a a Kobatake, H., TaWa, K., and Ishida, A., “Speech/Nonspeech
- - _- _ - - Discrimination for Speech Recognition System under Real
giftgjufgtg); ilrggaggzflggglelsenon NO' 08/779’862’ ?led on Life Noise Environments,” Conf. Proceedings of the IEEE ICASSP (IV, 1989), 365—368.
Int. Cl.7 .............................................. .. G10L 15/08
U-S- Cl- ...................................... .. Primary Examiner_DaVid Knepper
Field of Search ............................... .. 704/205—218, (74) Attorney, Agent, or Firm—Christensen O’Connor 704/231—234, 237, 238, 239, 255; 382/155; Johnson Kindness PLLC
455/2261; 706/13 (57) ABSTRACT
References Cited A method and apparatus for classifying signals into a
US‘ PATENT DOCUMENTS multiplicity of signal classes 'VVhI'Ch'CIIIPlOYS' discriminant functions of low-complexity discriminant variables that are
3,851,112 A 11/1974 Kusan computed directly from the passband signal. The method can 4,027,102 A 5/1977 Ando et al. be applied to the problem of classifying voiceband data 4,672,669 A 6/1987 DesBlanche (VBD), facsimile (FAX), native binary data, and speech on 4,720,862 A 1/1988 Nakata et a1. a 64 Kbps digital channel. In a hybrid tWo stage classi?ca 4,815,136 A 3/1989 Benvenllto tion system, the ?rst stage employs linear discriminant 4,815,137 A 3/1989 BFIIVCIIUFO functions to make classi?cation decisions into a smaller 49827150 A 1/1991 sllverstem et al- number of possible preliminary signal classes. The decisions 5,018,200 A * 5/1991 OZaWa ..................... .. 704/222 of the ?rst Stage are then re?ned by a Second Stage that uses
2210322 A 5/1993 Kenyon 1 nonlinear discriminant functions such as quadratic or 53%;; 2 g greteman et a‘ pseudo-quadratic functions. The second stage of a hybrid 5’311’575 A 41994 0110 classi?er then assigns the signal into a larger number of 5:315:7O4 A * 5/1994 Shinta et a1‘ ttttttttttttt N 704032 plossible classes than does the ?rst stage of the classi?er 5,325,425 A 6/1994 Novas et a1. a one 5,353,346 A 10/1994 COX et 211. 5,365,426 A 11/1994 Siegel et al. 20 Claims, 41 Drawing Sheets
22\ 2% > Power Idle Channel
Estimalor Detector
Y 1 st 1 Central
9'13 M- I F II- S d |O+Tra::1f3gn:ison T Fljecrllflelf _> $322‘ _> m +
Moment '5 L c
\ 18 w A ‘g 5 1% H41 _‘ ‘ ‘0 g T; 1Z1 E 8 5
E \5 8 T3 '3 g Class 7* E z _’ e F + a 2 +
E g <5 5 .5 = Aulocorrelation ' '55 " 5m Em
L’ Subsystem ' g > ‘ 2
‘2kg -> —>
26 28 j 20 J
US 6,708,146 B1 Page 2
Benvenuto, N., “Detection of Modem Type and Bit Rate of FSK Voiceband Data Signals,” IEEE International Confer ence on Communications (Jun. 11—14, 1989),. 1101—1105. Benvenuto, N., “Classi?cation of Voiceband Data Signals Using the Constellation Magnitude,” IEEE Transactions on Communications 43:2759—2770 (Nov. 1995). Hipp, J .E., “Modulation Classi?cation Based on Statistical Moments,” Conf. Proceedings of the IEEE MILCOM (Oct. 1986), 20.2.1—20.2.6. Mammone, R.J., Rothaker, R.J., Podilchuk, C.I., Davi dovici, S., and Schilling, D.L., “Estimation of Carrier Fre quency, Modulation Type and Bit Rate of an Unknown Modulated Signal,” Conf. Proceedings of the IEEE Interna tional Conference on Communications (Jun. 1987), 28.4.1—28.4.7. Benvenuto, N., and Daumer, W.R., “Classi?cation of Voi ceband Data Signals,” IEEE International Conf. on Com munications (Apr. 16—19, 1990), 1010—1013. Benvenuto, N., “A Speech/Voiceband Data Discriminator,” IEEE Transactions on Communications 43:539—543 (Apr.
1993). “Dafotel NET—MONITOR System 2432,” Product Bro chure, Compression Technology Corp., Germantown, Mary land, undated. “AT&T Voice/Data Call Classi?er” Product Brochure, AT&T Network Systems, 1991. “Digital Channel Occupancy Analyser” Product Brochure, Tellabs Ltd., Lisle, Illinois, 1990. Law, R.A., Holm, T.W., and Cox, N.B., “Real—Time Mul ti—Channel Monitoring of Communications on a T1 Span,” IEEE Paci?c Rim Conference on Communications, Com puters and Signal Processing (May 9—10, 1991), 306—309. Shumway, R.H., “Discriminant Analysis for Time Series,” in PR. Krishnaiah and LN. Kanal, eds., Handbook of Statis tics, vol. 2, North—Holland Publishing Company (1982), 1—46. Norusis, M.J., “Discriminant Analysis,” in SPSS Profes sional Statistics 6—1, SPSS Inc. (1994), 1—45. Proakis, J .G., and Salehi, M., Section 2.4, in Communication Systems Engineering, Prentice—Hall (1994), 100—105. Oppenheim, A.V., and Shafer, R.W., “Spectrum Analysis of Random Signals Using Estimates of the Autocorrelation Sequence,” in Discrete—Time Signal Processing, Prentice —Hall (1989), 742—747.
Franks, L., “Representation of Bandpass Signals,” in Signal Theory, (1969), 79—97. O’Neal, Jr., J.B., and Stroh, R.W., “Differential PCM for Speech and Data Signals,” IEEE Transactions on Commu nications 20:900—913 (Oct. 1972). Carey, M.B., Chen, H.—T., DesclouX, A., Ingle, J.E., and Park, K.I., “1982/83 End Of?ce Connection Study: Analog Voice and Voiceband Data Transmission Performance Char acteriZation of the Public Switched Network,” AT &T Bell Laboratories Technical Journal, 63:2059—2119 (Nov. 1984). Sewall, J .S., and Cockburn, B.F., “Signal Classi?cation in Digital Telephone Networks,” IEEE Cdn. Conf. on Electri cal and Computer Engineering (Sep. 5—8, 1995), 957—961. Geisser, S., “Bayesian Discrimination,” in PR. Krishnaiah and LN. Kanal, eds., Handbook of Statistics, vol. 2, North— Holland Publishing Company (1982), 101—120. Hu, M.—K., “Visual Pattern Recognition by Moment Invari ants,” IRE Transactions on Information Theory (1968), 179—187.
Sewall, J .S., and Cockburn, B.F., “Near—Optimal Voiceband Signal Classi?cation Using the Autocorrelation Sequence and the Central Second—Order Moment,” accepted for pub lication, IEEE Transactions on Communications 45(Jul. 1997). J .S. Sewall, Signal Classi?cation in Digital Telephone Net works, unpublished dissertation, University of Alberta, Edmonton, Canada, 1996. Cockburn, BF. and Sarda, D.P., “Implementation and Evaluation of an Accurate Real—Time Voiceband Signal Classi?er,” submitted to programme committee of the 1998 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE 98) Nov. 28, 1997, and Mar. 23, 1998, Conference dates, May 24—28, 1998, Waterloo, Ontario, 4 pages. D.R Irvin, “Voice/Data Detector and Discriminator for Use in Transform Speech Coders,” IBM Technical Disclosure Bulletin, vol. 26, No. 1, Jun. 1983, pp. 363—365. Watanabe, Hideyuki et al., “Discriminative Metric Design For Pattern Recognition,” ICASSP—95., 1995 International Conference on Acoustics, Speech, and Signal Processing (May 9—12, 1995), pp. 3439—3442 and abstract page.
* cited by examiner
U.S. Patent Mar. 16, 2004 Sheet 1 6f 41 US 6,708,146 B1
wmmTQ ‘l
H .wHh.
@J
\(Q
Em m>w : F n w 5283:0023“
E2w>w .nsw
comwmomo 1;
\
EmEoE
6E0 6:20am ‘I CBGEBECEP lncoomm o>ma1zsm $220822
EbcmO {N 5
i 9 E56
U.S. Patent Mar. 16, 2004 Sheet 3 6f 41 US 6,708,146 B1
. .m
@ m 3
‘B: \I M
LI ii
6 6 W68
. . Emugmnsw S . N DA“ . 52226025. .44
n G o u. 2 1 @
wmmll rm 9 LL WW ‘I
a a w m m ,3
w w m \
a ,
bowmgzwm COMHMELOUwCS-P ‘1 330m ‘A wmwEoEmE ECmMw
» {N 363mm L
:m we 6520 22
U.S. Patent Mar. 16, 2004 Sheet 8 6f 41 US 6,708,146 B1
w JUNE w?éoc mm 9 22 mm 2 6520 ECEEQ
miowa 086 a
>
w goswm?iwgoa A
628 566 oz Egon“ ?cgw
Sheet 9 0f 41 US 6,708,146 B1
@ .02. 5:52am E568 m 6%, 2 #3699 620 8:8 @5 5 2362 $20 @5 59:0
+ m2? 526:2 EQEEEEU mgmmmbmv 8 96693 wmwm?o 363$ @5 com + mwEo @2898 comm L2 5:22 EQEEEEU . 695 9: v6 m2?
6520 29 25%;. 9: @8528 605%? 2 0 $20 5930 EmEEEmMo o5 Eoi
Mar. 16, 2004
w 882% m®> ECCGLQ Q2
U.S. Patent
dwwmQEmQ “Ea Ecgm o5 cmgozéi E2925 c2280 Ems:
U.S. Patent Mar. 16, 2004 Sheet 12 6f 41 US 6,708,146 B1
23m c2280
E?gwnsw c2230 25>: mmww?o ,6 a: Umtow
Awwwmgo :m P; .mw?u 6580 :5 "22:02“ 29.5 E2w>wn=w c2208 wcouom
E 6: 8:8
uBsnEnu :5 “2250mm wwws £22695 c2280 FEE
» 3628 6:520 22 E0:
NH
JFK
_. EmEEtowE . GHQ
33%;
U.S. Patent Mar. 16, 2004 Sheet 14 6f 41 US 6,708,146 B1
¥&\
6:5 All c2280 03 25>:
E?gwnsw c2280 25>:
3
mjf Eopw>mnsw Ail; c2280 mwmw?o . . .6 a: hmoEEoz 8:8
E?gwnsw All! 522000 $8.20 . .. Ba: 80:3 Brow
<%\
3628 6:520 22 E0:
._ EmEEtomE Po wwEm>
U.S. Patent Mar. 16, 2004 Sheet 16 6f 41 US 6,708,146 B1
899x53 £22020 6mm: @5 5 862mm @966 5930 Oz 658% 22 28%5 8 o @220 BQSO
@H .wHm
E2335 566% 63:5: 9: 5 862mm 320 S850
,, wmmmm? Emu: @5305 , GQE Q2 m5. 6* 8:6: 96:82 EmEEzoQw 8mg: .5: 9E
A.
m, 862% wo> 6:520 .22
@66228 wmmww? 8%: @5806 E05 03: 6am 5.6.08 25>: E58 @2025