hidden markov models selection criteria based on mean ... · hidden markov models selection...

37
Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite this version: Florence Forbes, Nathalie Peyrard. Hidden Markov Models Selection Criteria based on Mean Field-like approximations. [Research Report] RR-4371, INRIA. 2002. <inria-00072217> HAL Id: inria-00072217 https://hal.inria.fr/inria-00072217 Submitted on 23 May 2006 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destin´ ee au d´ epˆ ot et ` a la diffusion de documents scientifiques de niveau recherche, publi´ es ou non, ´ emanant des ´ etablissements d’enseignement et de recherche fran¸cais ou ´ etrangers, des laboratoires publics ou priv´ es.

Upload: others

Post on 24-May-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

Hidden Markov Models Selection Criteria based on

Mean Field-like approximations

Florence Forbes, Nathalie Peyrard

To cite this version:

Florence Forbes, Nathalie Peyrard. Hidden Markov Models Selection Criteria based on MeanField-like approximations. [Research Report] RR-4371, INRIA. 2002. <inria-00072217>

HAL Id: inria-00072217

https://hal.inria.fr/inria-00072217

Submitted on 23 May 2006

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinee au depot et a la diffusion de documentsscientifiques de niveau recherche, publies ou non,emanant des etablissements d’enseignement et derecherche francais ou etrangers, des laboratoirespublics ou prives.

Page 2: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

ISS

N 0

249-

6399

ISR

N IN

RIA

/RR

--43

71--

FR

+E

NG

ap por t de r ech er ch e

THÈME 4

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE

Hidden Markov Models Selection Criteria based onMean Field-like approximations

Florence Forbes — Nathalie Peyrard

N° 4371

Février 2001

Page 3: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite
Page 4: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

Unité de recherche INRIA Rhône-Alpes655, avenue de l’Europe, 38330 Montbonnot-St-Martin (France)

Téléphone : +33 4 76 61 52 00 — Télécopie +33 4 76 61 52 52

���������� � ������� ������������������������ � !"�#�$���%����� &'�(�)�� � � �� �*+�������-,.����� � �(/�/����10-��2 � ����� ���

3146587�9;:#<=9>3?5@7�AB9;CEDGF-HJILK#HM46NO9QP9=R?7SHT7VU

W�X.Y�Z\[^]�_ `bacZed.fhgjikamlonp[�i1lrqsitamZ�amutgvikaclrnw [^uyx;uyitY�Z�[�u1z�lrZ�q.fm[${b[�u

|~}tlL�y[�i����@��1goq.qMlr}�i w [(}t[�z�Xs[�}tz�Xs[�nT�#]=�=�b��_ �#���;}yam[�}1�v�r�s��_ �r��qJgo�r[�u

�p�����S�L�J�o�=��� a w.w [�n��Egv}t�olS��}tgon w loZ¡ J[�f w u�gvq.q8[�go}�nJgvitd.}kgvfmfcx�acn�q.}tlr¢sfm[�Z�u£uyd.z�X�gou�amZ\go�r[�ut[��j¤Z�[�n=i�gvitamlrne¥Xs[�}t[1gon¦d.ns�;nslL¥n\z�fmgoutuBgouyutac�rn.Z�[�n=iBXJgou~ikl ¢M[[�u�ikamZ\gvit[ we§ }tloZ¨ikXs[�lr¢.ut[�}y�vgvitamlrn.u § lr}[Vgvz�XEq.a©{s[�f«ªG¬£X.l;lruyamn.��ikXs[(qs}tlr¢Jgv¢.amfcamuyitamz�Z\l w [�f8ikXJgvi1¢M[�u�i�gvz�z�lod.n=iku § lr}%ikX.[(lr¢.uy[�}��r[ w�w gvikg�acugonamZ�qMlr}yikgon=i£ J}yuyi1uyit[�q § lr}£ikXs[(­®dJgvfmaci¯x\l § ikX.[^uyd.¢.ut[�­®d.[�n=i°[�uyitamZ\gvikaclrn�gon w gon.gofcx;utacu�ª~±²z�lrZ\Z�lrn.f³xd.uy[ w ut[�fm[�z�ikaclrn(z�}ta³ik[�}tamlon acu?itX.[%´%gVxo[�utamgoneµ¯n § lo}tZ\gvikaclrn ¬£}tacit[�}yamlrn-¶·´£µ�¬�¸�l § `bz�X=¥£go}t¹(¶º�S»=�o¼r¸)¢sdsi § lr}X.a w.w [�n'��go}t�vlL�p}kgon w lrZ½ .[�f w u�¾.a³iku%[${.gvz�iz�loZ\q.dbi�gvitamlrnpacu£n.lvi�ik}kgvz�i�gv¢.fm[ w d.[°ikleitX.[ w [�q8[�n w [�nsz�[uyit}td.z�ikd.}y[�amn w d.z�[ w ¢=x�ikX.[��Egv}t�olS�EZ\l w [�f·ª°¿À[�qs}tlrqMlrut[egoq.q.}ylS{bacZ-gvitamlrnsu�l § ´£µ�¬²¢Jgouy[ w lrn>ikXs[Z�[VgonÁ J[�f w qs}tamnsz�amqsfm[�l § uyi�gjikamu�ikaczVgofÂqsX®x;uyamz�u�ª�W�X.[�Z\[�gonQ .[�f w ikX.[�lr}yxÁqs}tlS�;a w [�u�goqsq.}tlV{bamZ\gvikaclrn.ul § �Ego}y�olS��}kgvn w lrZ½ J[�f w u�¢=x�uyx;uyit[�Z�ul § acn w [�q8[�n w [�n=i�vgo}tamgo¢.fc[�u%fc[Vg w acn.��itl¦it}kgoz�i�go¢sfm[°z�lrZ\qsdsi�gj¤ikaclrn.u�ª�Ã1utamns�pikX.acu q.}tacn.z�acq.fm[v¾8¥�[e J}tu�i w [�}yac�r[�gpz�fhgouyu l § z�}ta³ik[�}tahg\¢®xÄgoq.q.}ylV{sacZ-gjikamns�-ikX.[���go}t�vlL�w acuyik}yam¢.dbikamlon'acn�itX.[�d.uydJgof�´£µ�¬Å[�{bq.}y[�utuyamlrnÄgou°g�q8[�nJgofmac¹�[ w fmac�o[�fmamXslbl w ª�¿Æ[ itX.[�nE}t[�¥}yacit[e´£µ�¬Çacnik[�}tZ�ul § n.lo}tZ\gofmac¹�amns��z�lon.uyikgon=iku�¶OqJgo}�ikacitamlrn § dsn.z�itamlrn.uk¸%amn.u�ik[Vg w l § �Ego}y�olS� w amu�ik}yam¢.dsitamlrnsu�¾b¥Xsamz�X[�n.go¢.fm[�u�d.ueikl>dsut[p Jn.[�}�Z\[�gonÈ J[�f w goq.qs}tlV{bamZ\gvikaclrn.uegvn wÉw [�}yac�o['lvikX.[�}ez�}yacik[�}tamgEd.utacn.�>lrqsitamZ\goffmlS¥�[�}°¢Mlrd.n w u § lr}�itX.[�n.lr}yZ-gvfmam¹�amn.�¦z�lrn.uyikgon=iku�ª W?l�amfcfmd.u�ik}kgjik[^ikX.[eqM[�} § lr}tZ\gon.z�[el § lrds}°qJgo}�ikacitamlrn§ d.n.z�ikaclrnb¤¯¢.gout[ w goq.q.}ylV{sacZ-gjikamlon-l § ´£µ�¬Êgou£geZ\l w [�fMuy[�fc[�z�itamlrn-z�}ta³ik[�}tamlon˾;¥�[ § l;z�d.u�lrnpikX.[�q.}t[�fmamZ�¤amn.go}yx\amuyutd.[ l § z�X.l;lrutacn.�eikXs[ n;dsZe¢8[�}�l § z�fmgoutuy[�u¢8[ § lr}t[°itX.[ ut[��rZ�[�n=i�gvitamlrnpikgout�TªGÌ#{bq8[�}tamZ�[�n=itu�lrnutacZed.fmgvik[ w gon w }t[�gof w gvi�g'q8lracn=i�lrdbi�lrds}�z�}yacit[�}taclrnÆgou�q.}ylrZ�amutacn.�.Í(aci^i�gv�o[�u�utqJgvitahgofBacn § lr}tZ\gvitamlrnamn=itlÆgvz�z�lod.n=i\itX.}tlrds�rXÎitX.[E�Ego}t�vlS�+Z\l w [�f%gon w acZ\qs}tlS�r[�u¦itX.[�}t[�utd.f³iku�lr¢si�gvamn.[ w ¥a³ikXÏ´£µ�¬ § lr}amn w [�qM[�n w [�n=i�Z�a³{;itd.}t[°Z�l w [�fcu�ª

ÐsÑÓÒ�Ô«Õ�Öj×�Õ£ÐjÒ�Ô«ØvÕtÙÂÚÓÙÂÛ)ÕtÙ6ÕtÜ$ÔÝ×ÝÞLÕ�ÔtßràTÔ·Ò�áOÕºâGã�ärå=æ@ãÝç�èBãÝéêèBë;ìbí®îVï·é£ð�ñjîjò�æ?ósãÝè£ärô�æ8õLöLö¦÷�ø8ù^úbî�ð$ûýü?þ®ÿ��bñLî®æ���������� �bí�����;í®í ��Æäv÷�� í�vï � ÷;ÿ��� íTæ��@ÿr÷bí��oî®ùÁü��?÷�� ð������������! �"!�$#%���!��&���'!(�)* ��+)-,.�-/���'0#21��=ù�çG÷.=ë=÷;ð�� î3?î�4bÿr÷;ÿ=ú5�©ò6�vþ;ÿ=ÿ=îLí�=ð74�÷8�?î����oîLÿ9� :;=ë®î=<£ã�äoô@éêÿ=îvò�îS÷bÿ��oë9rîL÷��Gæ)ú>��� í�?E÷Eñ��sò@oï·ú>� �p÷.�ãÝèBã�äoé�æA ÷���ñLþ;ò%ú;îCBÂîS÷=þ®ð�� îjþTæ � ö ��D å èGîLí®í®îjò�æ0�Ëÿr÷;í��oî®ù#ü���÷ � ð+�E �/���F.��,!��G�(+)H��)�'!,$#21��=ù

Page 5: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� ������������� ���������� ��������������������� ��!���!"

#%$'&�(!)+* ��,��o� µ¯Z\go�r[Âuy[��rZ�[�n=ikgvikaclrn˾ � a w.w [�n���go}t�vlL�°}kgon w lrZê J[�f w u�¾v��l w [�fruy[�fm[�z�itamlrn˾L´£gSxo[�uyahgonµ¯n § lr}tZ\gvitamlrn�¬£}yacit[�}taclrn˾.��[Vgon' J[�f w goq.q.}ylS{bacZ-gvitamlrn@¾s|�go}yitacikaclrn § d.n.z�ikaclrn˪

-/.�Û0-/1

Page 6: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

! �������%�������� ���������������� ��� 2 �\�������� ��� � �#� ��� �£� ������ &��(�������p� ����¡�(/�/��#�0p��2 � ����� ������� �-/>� ����� 2 / 2 ��e�� �

��� ����� � ��� [�u°Z\l w Y�fm[�u w [�z�X.goZ\qsu w [¦�Egv}t�olS�EzVgoz�X.��u goq.q.go}kgoacutuy[�n=i nJgvitd.}t[�fmfc[�Z�[�n=i w gon.u w [�uq.}ylr¢.fmY�Z\[�u�it[�fmu�­®d.[ fhg(ut[��oZ\[�n®ikgvikaclrn w�� amZ\go�r[1l��pacf8u � gv�raci w�� gvitit}tam¢sd.[�}�z�XJgo­®d.[ q.a©{s[�f���dsn.[ z�fmgoutuy[��q.go}yitam} w [�u lr¢.ut[�}y�vgvitamlrn.u�ªE|?lrd.} z�[�fmgs¾#z�Xslramuyam}^fm[�Z\l w Y�fm[¦q.}tlo¢Jgo¢.acfmamu�ik[¦­®d.aGq.}t[�n w fm[�Z\ac[�db{>[�nz�loZ\qsit[~fm[�u w lrn.n.��[�u�lr¢.uy[�}��r��[�u#[�uyi?q.}tacZ\lo} w amgof«ª@Ã�n(z�}ta³ikY�}t[ w [~uy��fm[�z�itamlrn w [BZ�l w Y�fm[�z�lrZ�Zed.n.��Z\[�n=idsitamfmacut�([�u�i fm[�´%gVxr[�uyahgonÁµ¯n § lo}tZ\gvikaclrnĬ£}yacit[�}taclrn+¶6´£µ�¬�¸ w [¦`;z�X®¥£go}y¹E¶º�S»=�o¼r¸Z\goamu w gonsu fm[�z�gou w [�uz�XJgoZ�q.u w [1�Egv}t�olS�¦z�goz�X.��u�¾bfmg°uyit}td.z�ikd.}y[ w [ w [�qM[�n w gvn.z�[ w gon.uBfc[%Z\l w Y�fm[%}y[�n w fm[�z�gofmz�d.f.[�{sgoz�i w dz�}yacitY�}t[acZ\qMlrutuyam¢.fc[oª���lod.uBq.}tlrqMlruylrn.u w [�uGgoq.qs}tlV{bamZ\gvikaclrn.u w [�´£µ�¬+­;dsaJut[ § lrn w [�n®iGuyd.}�fc[�q.}tacn.z�acq8[w�� goq.q.}ylV{sacZ-gjikamlon [�nÊz�X.goZ\qÊZ�lSxr[�n acutuyd w [ÄfhgÆq.X=xbuyam­®d.[>u�i�gvitamuyitam­®d.[vª � gÆitX.��lo}tam[ w dÊz�XJgoZ�qZ�lLxo[�n § lrd.}tnsaci�d.ns[Àgoqsq.}tlV{bamZ\gvikaclrn w [�u'z�X.goZ\qsu w [Æ�Egv}t�olS� qJgo} w [�u'uyx;uyitY�Z�[�u w [Á�vgo}yahgo¢sfm[�uamn w ��qM[�n w gon=ik[�u¦qMlrd.}efc[�uy­;ds[�fmu�fc[�uez�gofmz�d.fmu utlrn=i�gofclr}tu § goamutgo¢.fm[�u�ª�� f � goa w [ w [�z�[�q.}yamn.z�amqM[o¾Ân.lod.uamn=it}tl w d.amuylrn.u w�� go¢Mlr} w d.n.[ § goZ�amfcfm[ w [Æz�}ta³ikY�}y[�u�lr¢sit[�n®d.u'[�nÇgoq.q.}ylS{bacZ-gon=i�fmg+fclra°Z\go}t�vlS�bac[�n.ns[­®d.a�goq.qJgo}tg��mi w gvn.u�f � [${bq.}t[�ututaclrnÄd.uyd.[�fcfm[ w [ ´£µ�¬Çutlrdsu § lr}yZ\[ w [(�b}tgoamuy[�Ze¢sfhgon.z�[ qM��n.gofmacut��[vª ��lod.uz�lon.uta w ��}ylrn.u�[�n.uyd.acit[~d.n.[B}t����z�}tacitd.}t[ w [�´�µ�¬Q[�n it[�}tZ�[�u w [Gz�lrn.u�i�gon=ik[�u w [~n.lr}tZ\gofcamukgjikamlon�¶ § lon.z�itamlrn.uw [qJgo}�ika³ikamlonT¸?­®d.aTg f � gV�vgon=i�go�r[ w [1qM[�}yZ\[�itit}t[�f � dsitamfmacukgvitamlrn w�� goq.q.}ylS{bacZ-gvitamlrnsu#q.fcd.u~ Jn.[�u�ª!��lrdsu~[�nw � w d.amuylrn.u w [�n.lods�r[�godb{-z�}ta³ikY�}t[�uG[�n-dsikacfmamutgon=i w [�u�¢8lr}yn.[�u�lrqsitamZ\gofm[�u w [�u § lrn.z�itamlrnsu w [�qJgo}�ikacitamlrnsu�ª|�lod.}�acfmfmdsuyik}y[�}(fm[�u qM[�} § lr}tZ\gon.z�[�u w [pz�[�u w [�}yn.am[�}tu�¾Ân.lrd.u�z�lrn.uya w ��}tlrnsuefm[�q.}tlo¢.fmY�Z\[ w dÉz�X.lra©{ w d¢Mlrn¦n.lrZe¢.}y[ w [z�fhgvutut[�uBq8lrds}Gfmg°ut[��rZ\[�n=i�gvitamlrn˪ � [�uB}t��utd.f³i�gvituGlo¢.ut[�}y�r��u£uyd.} w [�u w lrnsn.��[�u�uyamZed.fc��[�u[�i�}y��[�fcfm[�u�utlrn=i�q.}tloZ\[�itik[�d.}tu�ª+µ¯fmu¦z�lrnb J}tZ�[�n=i�­®d.[�z�[�i¯xbqM[ w [�z�}yacikY�}t[�u�qs}t[�n w ¢.ac[�n+[�nÎz�lrZ�qsit[f � amn § lr}tZ\gvikaclrn�utq.gvikamgofm[vªÌBn>q.go}yitamz�dsfmam[�}�¾Jfc[�u1}t��uyd.fcikgviku�lr¢sit[�n®d.u°uylrn=i°Z�[�amfcfm[�d.}tu­®d � gS�o[�z�fc[ z�}tacit��}y[´£µ�¬ zVgofcz�d.fc� q8lrds} w [�u1Z\l w Y�fm[�u w [^Z\��fhgon.�o[�u�amn w ��qM[�n w gon=iku�ª" * �L� ( �$# � �\� `b[��rZ\[�n=i�gvitamlrn w�� acZ-gv�r[o¾b¬£XJgoZ�q.u w [^�Ego}y�olS�\zVgoz�X.��u�¾T`;��fm[�z�itamlrn w [�Z�l w Y�fm[�u�¾s¬£}ta³¤ikY�}t[ w�� amn § lo}tZ\gvikaclrnp¢JgVxr��utac[�nɶ6´£µ�¬�¸�¾J±�q.q.}ylS{bacZ-gvitamlrn w d�z�X.goZ\q'Z�lLxo[�n˾T�Jlrnsz�ikaclrn w [^qJgo}�ika³ikamlon˪

Page 7: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

] ������������� ���������� ��������������������� ��!���!"

!¨� �¦������?�

� ��� �S� * ,��?�o��� * � �

� � � , , $ � " �s� *�� � * , $ #6�

� � � & $ ���O� ������� * � �À�s��� * ��� ��O� $ �� * � ���

� " $ � ��� $ # ,���� $ * � & ���]sªc� ��[Vgon' J[�f w goq.q.}ylS{bacZ-gvitamlrn-q.}tacn.z�acq.fm[ ª(ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �r�]sª � �#am}yuyilr} w [�}���[�gon' .[�f w goqsq.}tlV{bamZ\gvikaclrnpl § ikXs[(q.go}yitacikaclrn § d.n.z�ikaclrn ª(ª(ª ª^ª(ª ª(ª �L�

� " $ � ��� $ # , # � $ �"!#!�� *�$ � �Æ�s��� * � � * �%�&�'� ���( ªc� ±�q.q.}ylV{sacZ-gjikamns�eikX.[�) am¢.¢.u w amuyit}tac¢.dsikaclrn�ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �V]( ª � ±�q.q.}ylV{sacZ-gjikamns�eikX.[^qJgo}�ika³ikamlon § d.n.z�ikamlon ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �'*

� + $ ! $ �,� � $ � �L� �.-*bªc� � a wsw [�n0/�¤¯z�lofmlr}�|?loitituZ\l w [�fcuª ª^ª(ª ª(ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �S¼*bª � ��lracut[�¤Ýz�lr}y}td.qbik[ w uyx;n=ikXs[�ikacz acZ-gv�r[�u ª ª(ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �o�*bªÓ� )^}y[�x=¤¯fc[��r[�f)amZ\go�r[�u ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª ª(ª(ª ª(ª ª^ª(ª ª(ª(ª ª(ª ª(ª(ª ª^ª(ª ª(ª �o�

- 1 �6�V�$�?�V��� * � ���

-/.�Û0-/1

Page 8: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ (

�Æ���Ë� �����À�^&'����

� ��[��o}kg w [ w�� ¤¯z�lrfmlr}�|�loiyiku°Z�l w [�f·Í�`;[�fm[�z�it[ w�� d.utacn.��´£µ�¬ § lr}�acn w [�q8[�n w [�n=i^Z�a³{®¤ikd.}y[~Z\l w [�fmu~¶ �"!$#&%$')(~¸$¾jqsut[�d w lv¤¯fcam�v[�fmacX.l;l w ¶·| � µ�¬�¸Ëgon w Z\[�gon° J[�f w ¤Ýfmam�v[�¶ �"!$#+*-,/.)¸goq.q.}ylV{sacZ-gjikamlon.u£l § ´£µ�¬�ªJW�X.[(}t[�q8lr}�ik[ w �vgofcd.[�u1go}y[°ikX.[^n®d.Ze¢M[�}1l § ikamZ�[�ug��ra³�r[�n� acu�ut[�fm[�z�ik[ w lrdsil § �S�o�¦[${bq8[�}tamZ�[�n=itu�ª ª ª(ª(ª ª(ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �o�

� ��lracut[$¤¯z�lo}t}tdsqsik[ w uyx;n=ikX.[�ikacz�amZ\go�r[�u�Í?`b[�fc[�z�ik[ w0� d.uyamn.�°´£µ�¬ § lr}�acn w [�q8[�n w [�n=iBZ�a³{®¤ikd.}y[~Z\l w [�fmu~¶ �"!$# %$')( ¸$¾jqsut[�d w lv¤¯fcam�v[�fmacX.l;l w ¶·| � µ�¬�¸Ëgon w Z\[�gon° J[�f w ¤Ýfmam�v[�¶ �"!$# *-,/. ¸goq.q.}ylV{sacZ-gjikamlon.u£l § ´£µ�¬�ª ª ª(ª(ª ª(ª^ª ª(ª ª(ª(ª ª(ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �r�

� )^}y[�x=¤¯fc[��o[�f�acZ-gv�r[�u�ÍQ`b[�fc[�z�it[ w1� d.uyamn.�É´�µ�¬ § lr}\amn w [�qM[�n w [�n=i�Z\a©{bitd.}t['Z�l w [�fmu¶2�"!$# %$'3( ¸�¾�q.ut[�d w lv¤Ýfmam�v[�fcamX.l;l w ¶6| � µ�¬�¸�gvn w Z�[VgonQ J[�f w ¤¯fcam�o[�¶ �"!$# *-,/. ¸(goqsq.}tlV{ba³¤Z-gjikamlon.u%l § ´£µ�¬�ª ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª(ª ª(ª(ª ª(ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �o�

�Æ���Ë� ���Ê*+��4 �p�#��

� `bamZ�d.fhgvitamlrnsu l § g � ¤¯z�lrfmlo} |?loititueZ�l w [�f § lr} w a65@[�}t[�n®i �vgofmd.[�u�l §7� gvn w98 Í�¶·g=¸�;:=< ¾ 8�:�>@?BADC ¾�¶6¢J¸ �;:FE ¾ 8�:F>@?HG ¾?¶OzS¸ �I:�J ¾ 8K:ML ¾�¶ w ¸ �;:=N ¾ 8�:ML ª ª �S»

� ¬£X.[�z��v[�}y¢8l=gv} w amZ\go�r['Í>¶·gr¸ lr}tac�ramn.gofBamZ\go�r[o¾%¶6¢T¸�nslramuy[�¤¯z�lr}t}yd.qsit[ w amZ\go�r[v¾¶6zV¸��j¤z�lrfclr}(ut[��oZ\[�n®ikgvikaclrnÈd.uyamn.�ÄÌ�� § lo}�amn w [�qM[�n w [�n=i�Z�a³{;ikd.}y[�u�¾1¶ w ¸(gon w ¶6[V¸(]v¤Ýz�lrfclr}ut[��rZ\[�n=i�gvitamlrn.u�dsutamns�¦itX.[^utacZed.fhgjik[ w  .[�f w gon w µ�¬�� gofm�rlo}tacitX.Z�u�ª ª ª(ª(ª ª(ª^ª ª �b�

� � lr�rl^amZ\go�r[vÍ£¶6g=¸#lr}yam�racnJgofsacZ-gv�r[o¾T¶O¢T¸Ân.lracut[�¤Ýz�lr}y}td.qbik[ w acZ-go�o[o¾T¶OzS¸~gon w ¶ w ¸B�L¤Ýz�lrfclr}ut[��rZ\[�n=i�gvitamlrn.u\d.utacn.�+ÌG� § lr}-acn w [�qM[�n w [�n=i�Z�a³{;ikd.}y[�u�gvn w ikX.[EutamZ�d.fhgvit[ w  .[�f wgofm�olr}ta³ikX.Z'¾8¶6[S¸��j¤Ýz�lrfclr}£uy[��rZ�[�n=ikgvikaclrn�d.utacn.�¦µ�¬��ƪ ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �b�

] ´£d.lSx(amZ\go�r[1Í�¶·g=¸�lr}tac�ramnJgvf=amZ\go�r[o¾b¶O¢T¸�gon w ¶6zS¸?�°gon w �L¤¯z�lrfmlr}�uy[��rZ�[�n=i�gjikamlon.u#d.uyamn.�ikX.[ uyamZedsfhgvit[ w  J[�f w gofc�rlr}ta³ikX.Z }y[�utqM[�z�ika³�r[�f³x�amnsacikamgofmac¹�[ w ¢=xpitX.}t[�utX.lrf w amns�¦gon w ÌG�§ lr}~amn w [�qM[�n w [�n=i£Z�a³{;itd.}t[�u�¾8¶ w ¸#]j¤¯z�lofmlr}Âuy[��rZ�[�n=ikgvikaclrn\dsutamns� ÌG� § lr}~amn w [�qM[�n w [�n=iZ\a©{;ikd.}y[�u�¾e¶6[V¸�gvn w ¶ § ¸ *Îgon w �L¤¯z�lrfmlo}put[��rZ\[�n=i�gvitamlrn.u�d.uyamn.�+µ�¬�� }t[�uyq8[�z�itac�r[�fcxamn.a³ikamgofmac¹�[ w ¢=x�ikX.}y[�uyX.lrf w amn.�¦gon w ÌG� § lr}�amn w [�qM[�n w [�n=i�Z�a³{;ikds}t[�u�ª ª ª(ª(ª ª(ª^ª ª �o�

( |BÌBWǵ¯Z-go�o[ l § g w lr�¦fmdsn.�.Í�¶·g=¸%lr}yam�racnJgofMamZ\go�r[v¾�¶ w ¸��j¤Ýz�lrfclr}%uy[��rZ�[�n=i�gjikamlon�d.uyamn.�ÌG� § lr}�acn w [�q8[�n w [�n=i Z�a³{;itd.}t[�u�¾~¶O¢T¸�gvn w ¶6[V¸ *j¤Ýz�lrfclr}1gon w �j¤Ýz�lrfclr}1ut[��oZ\[�n®ikgvikaclrn.ud.utacn.��µ�¬��ƾ?¶OzS¸£gon w ¶ § ¸ *j¤¯z�lrfmlr}£gon w �j¤Ýz�lrfclr}£uy[��rZ�[�n=i�gjikamlon.u%d.uyamn.��ikXs[ utamZ�d.fhgvit[ w J[�f w gofm�rlo}tacitX.Z'ª²ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª(ª ª(ª(ª ª(ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �v]

* ¬£lrn.uyamuyit[�n.z�x�z�lrn w acitamlrn.u£utlrfcdsikaclrn.ugou 8 �vgo}yam[�u ª ª(ª ª(ª(ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �r�� |#go}�ika³ikamlon § d.n.z�ikamlon'fclr�=go}yacitX.Z gvn w i¯¥£l-goq.q.}ylS{bacZ-gvitamlrnsu�ª(ª(ª(ª ª(ª ª(ª(ª ª(ª^ª ª �s�¼ |#go}�ika³ikamlon § d.n.z�ikamlon'fclr�=go}yacitX.Z gvn w i¯¥£l-goq.q.}ylS{bacZ-gvitamlrnsu § lr}g E0OKE �r}ta w ª(ª^ª ª �=�» |#go}�ika³ikamlon § d.n.z�ikamlon'fclr�=go}yacitX.Z gvn w i¯¥£l-goq.q.}ylS{bacZ-gvitamlrnsu § lr}g E0OKE �r}ta w ª(ª^ª ª �r�

Û�Û Ö PRQ�SUTUV

Page 9: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

* ������������� ���������� ��������������������� ��!���!"

� � �¦�)����� �'�G����� �

|B}ylr¢.fc[�Z�u1acn=�rlrf³�bacn.�¦amn.z�lrZ�q.fm[�ik[ w gji�gs¾J¥X.[�}t[(qJgo}yi1l § ikX.[ w gvikg�acuZ\acututacn.�¦lr}d.n.lr¢sut[�}��vgo¢.fm[v¾Mgo}t[z�lrZ�Z\lon�amn�acZ-gv�r[£gvnJgofcx;uyamu�ª?W�X.[goacZ"Z-gVx ¢8[£itl }t[�z�lS�r[�}�gvn�lr}tac�ramnJgvf=amZ\go�r[B¥X.amz�X¦amu#X.a w.w [�n¦gon wXJgou#itl°¢8[£[�uyitamZ\gvik[ w�§ }tloZ g�nslramu�x�lr}�¢.fmds}t}t[ w �r[�}tutaclrn˪B�'lr}t[%�o[�n.[�}kgofcfcxr¾jikX.[£lr¢.ut[�}y�o[ w gon w X.a w.w [�nw gvi�g go}t[�n.loi£n.[�z�[�ututgo}tacfcx�l § itX.[�utgoZ\[�nJgvitd.}t[vª~W�X.[°lr¢.uy[�}��ogjikamlon.u�Z\gVx�}t[�qs}t[�uy[�n=iZ�[Vgouyd.}t[�Z\[�n®itu�¾�������\Zed.f³ika w amZ�[�n.uyamlrnJgvf��vgo}yahgo¢sfm[�u }y[�z�lr} w [ wƧ lr} [�goz�XÀqsa³{b[�f~l § gonÁamZ\go�r[e¥X.acfm[eitX.[¦X.a w.w [�n w gvi�gz�lrd.f w z�lrn.uyamu�i£l § gon�d.n.�®n.lS¥npz�fhgouyu�gvututac�rn.Z�[�n=iBikl(¢8[[�uyikacZ-gjik[ w�§ }ylrZ ikXs[1lo¢.ut[�}y�vgvikaclrn.u § lr}B[Vgvz�Xq.a³{b[�f·ª�W�X.amu^z�gout[¦amu dsutdJgofcfcxE}t[ § [�}t}y[ w itl'gou^amZ\go�r[euy[��rZ�[�n=i�gjikamlon˪�µ¯nQitX.[¦z�lrn=it[�{;i�l § u�i�gvitamuyitamz�gofamZ\go�r[¦ut[��rZ\[�n=i�gvitamlrn˾?z�X.l;lrutacn.�EitX.[-q.}ylr¢Jgo¢samfmacuyitamzeZ�l w [�f~ikXJgjie¢M[�uyiegoz�z�lrd.n=iku § lr}(itX.[-lo¢.ut[�}y�r[ ww gvi�gÄacu�gonÉacZ\qMlr}yikgon=i� J}yuyi¦u�ik[�q § lr} ikX.[�­®dJgofcaci¯xQl § ikXs[�utd.¢.uy[�­®d.[�n®i-[�u�ikamZ\gvitamlrnÀgon w gonJgvfcx;utacu�ªµ¯nQZ�lru�i°zVgvut[�u itX.[�z�X.lracz�[�amu w lrn.[�uyd.¢;�y[�z�ika³�r[�f³x>d.uyamn.��[${sqM[�}�i^�®n.lS¥fm[ w �r[�lr} �'" � � �1qs}tl;z�[ w d.}t[�ugon w ikX.[�}t[^amug¦uyit}tam�®acn.��fhgoz��-l § u�x;uyik[�Z-gjikamz w gji�gj¤Ý¢Jgout[ w goq.q.}yl=goz�X.[�u�ªB¿À[^}t[�zVgou�i�itX.amu�z�Xslramz�[ gvu�gq.}tlr¢sfm[�Z½l § q.}tlo¢Jgo¢.acfmamu�ikacz�Z�l w [�f@z�lrZ�qJgo}tacutlrnpgon w d.ut[ itX.[ uyikgon w go} w gvq.q.}tlrgoz�X�l § ´%gVxr[�u § goz�iklr}yu�ªÌ~�vgofcdJgvitamn.�pitX.[�´%gVxr[�u § goz�itlr} l § lrn.[¦Z\l w [�f~go�=goacn.uyi(gvn.loikXs[�}^amn=�rlofc�r[�u z�gofmz�d.fhgjikamns�-ikX.[�}kgjikaml�l §ikX.[�amn=ik[��r}kgvit[ w fmam�v[�fcamX.l;l w u § lr}£[�goz�XpZ�l w [�f«¾ ��� ���ÂikX.[�fmam�v[�fcamX.l;l w u~l § ikXs[ w gvikg amn=it[��r}tgvik[ w lS�r[�}£ikX.[}t[�uyq8[�z�itac�r[�Z�l w [�f�qJgo}kgvZ\[�ik[�}yu�ªQ�Jlr}egÄfcloiel § Z\l w [�fcu�l § acn®it[�}y[�uyi�¾ÂikX.[�ut[�amn=it[��r}tgvik[ w fmam�v[�fcamX.l;l w ugo}t[�X.am�oX w acZ\[�n.utaclrnJgofÂgon w acn=ik}kgvz�i�gv¢.fm[¦amn=it[��r}tgofmu^utl'ikXJgji�Z�lruyi gV�vgoamfmgo¢.fc[eutl § i¯¥£go}y[-amu(�r[�n.[�}tgofmf³xamn.[�\z�am[�n®i § lr} itX.[�ac}([��vgofmdJgjikamlon˪�Ggo}taclrd.u^goq.qs}tlV{bamZ\gvikaclrn.u XJgV�r[�¢M[�[�nÀq.}tlrqMlruy[ w ª\µ¯nÀqJgo}�ikacz�d.fmgo}ikX.[(´%gVxr[�utamgonEµ¯n § lo}tZ\gvikaclrn'¬£}ta³ik[�}yamlrnQ¶6´£µ�¬�¸goq.q.}ylS{bacZ-gvitamlrn�l § `bz�X=¥£go}t¹p¶��S»r�o¼=¸£amu�¢.gout[ w lrn�ikX.[� gvq.fhgoz�[°Z�[�ikXsl w�§ lr}%acn=ik[��o}kgofcu�ªÂµÝifc[Vg w u%itl�gon�[�­®dJgvitamlrn��ra³�;amn.�eitX.[ fmlr�j¤¯amn=it[��r}tgvik[ w fmac�o[�fcamX.l;l w gouikX.[�Z-gL{sacZ\ac¹�[ w fclr�v¤Ýfmam�v[�fcamX.l;l w Z�amn®d.u g'z�lr}t}y[�z�itamlrn ¶6lr}^qM[�nJgvfmam¹�gvikaclrnT¸1it[�}yZ gon w gvn ��� L�� [�}y}tlr}¶·gou%itX.[ ukgoZ�q.fc[°utac¹�[ ik[�n w u�ikl�acns Jn.a³i¯x.¸$ªB´£µ�¬ÊzVgon'¢8[ z�lrZ�qJgo}t[ w ikl�loitX.[�}�uy[�fm[�z�itamlrn�z�}yacit[�}tamgsª��°n.[l § ikX.[�Z¡acu£±�µ�¬ ¶O±��jgoac�o[�µ¯n § lr}tZ\gvikaclrn-¬£}tacit[�}yamlrn\l § ±��jgoac�o[��V»=�o�=¸~¥X.amz�X w a 58[�}tu § }tlrZ½´£µ�¬ amn�ikX.[z�lr}y}t[�z�ikaclrn�it[�}tZ ¢.dsi�XJgou�¢8[�[�n>utXslL¥nÄitlplS�r[�}t[�u�ikacZ-gvit[ itX.[en®d.Ze¢M[�}�l § qJgo}tgoZ\[�ik[�}tu�acnEq.}tgoz�itamz�[oªW�X.[z�}ta³ik[�}tamloneq.}tloq8lruy[ w amn¦�amuyukgon.[�n�¶��S»r¼o»=¸�amu~¢.gout[ w lon�u�ikl;z�XJgou�ikamzz�lrZ\qsfm[�{ba³i¯xegon w acuÂutacZ\acfhgo}�ikl´£µ�¬�¾;gon w Z�[�itX.l w u�dsutamns��z�}ylrutuG�vgofma w gvikaclrn�¶��@XJgon.�\�S»r»r�=¸Âuy[�[�Z q.}ylrZ�amutacn.� ¢.dsi�ikX.[�am}~ik}tgoz�ikgo¢.acfmaci¯xamnÀlod.} z�lrn=ik[${bieamu(n.loieu�ik}tgoam�rX=i § lr}y¥£go} wÆw d.[�ikl�itX.[ w [�qM[�n w [�n.z�[�u�ik}yd.z�itd.}t[pacnÆitX.[ w gji�gsªE�Egon=xloikX.[�}1goq.q.}yl=goz�X.[�u�z�gon�¢M[ § lrd.n w amn�itX.[^fmacit[�}tgvikd.}y[°lrn'Z\l w [�fËut[�fm[�z�ikaclrnȶOut[�[ § lr}�acn.uyikgon.z�[^itX.[^fmacuyil § }y[ § [�}t[�nsz�[�u1amn /^gouyu�gvn w �1g § it[�}yxE�S»r» ( ¸�ª´�µ�¬"XJgvu°¢8[�z�lrZ�[e­®d.a³ik[eqMlrq.d.fmgo} w d.[eikl-aciku�utamZ�q.fcamz�a³i¯x�gon w a³iku��rlbl w }y[�utdsfciku�amnÄz�gout[�u^¥Xs[�}t[

qb¤Ý�vgofcd.[�u�gon w itX.[puyikgon w gv} w Z�l w [�fGut[�fc[�z�ikamlonÀq.}ylbz�[ w d.}y[�u�¢Jgvut[ w lonÀikX.[�Z ¥�[�}y[�d.n.utgvikacu § goz�iklr}�xrªµ¯n ´£µ�¬�¾ÂitX.[���� L�� [�}y}tlr} w l;[�u¦uyd.�r�r[�uyi�ikX.['goq.qs}tlV{bamZ\gvikaclrnÀiklÁ¢M[�utlrZ�[�¥XJgji\z�}td w [oª � lS¥�[��r[�}[�Z�q.am}yamzVgvf@[�{bqM[�}yam[�nsz�[(XJgou § lrd.n w ikXs[ gvq.q.}tlV{bamZ\gvitamlrnpitl�¢M[^Z\lo}t[^goz�z�d.}tgvik[(amn�q.}tgoz�itamz�[°itXJgon�ikX.[

-/.�Û0-/1

Page 10: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �

��� L�� [�}t}tlo}Âik[�}yZ ¥�lrd.f w uyd.�r�r[�uyiVª#±�uB}t[��=go} w uGZ�l w [�fbut[�fc[�z�ikamlon˾�/^goutuGgon w �1g § ik[�}yx�¶��S»r» ( ¸�lr¢.uy[�}��r[ikX.gvi^ikX.[�z�}yacik[�}taclrn w lb[�u^n.loi(ut[�[�Z�ikl'¢8[¦�r}ylrutuyfcxÁZ�amuyfm[Vg w amn.�-amnÆg'­®dJgofcacikgvika³�r[euy[�n.uy[pgou(fmlrns��gvuikXs[Än®d.Ze¢M[�}pl §^w [��r}y[�[�u�l § § }t[�[ w lrZ amn=�rlrf³�r[ w amnÏitX.[>z�loZ\qJgv}tamuylrn acu-}y[�fhgjikac�o[�f³x+utZ\gofmf1}t[�fhgvitac�r[iklQukgvZ\q.fc[�utac¹�[oª+µ¯n+ikX.acu¦qJgoqM[�}�¾G¥£['z�lon.uta w [�}\�Ego}y�olS�+Z�l w [�f³¤Ý¢Jgout[ w amZ\go�r[puy[��rZ�[�n=i�gjikamlonÏgvn w§ l;z�d.uy[�lonÁitX.[�d.uy[\l § ´£µ�¬ § lr}°ikXs[�d.n w [�}tfcx;acn.��amutuyd.[¦l § z�X.l;lrutacn.�'g�Z�l w [�f § }ylrZ�g�z�lrfmfc[�z�ikamlonÄl §X.a w.w [�n��Ego}t�vlS�p}kgvn w lrZ� J[�f w u�ª~µ¯npikX.acu�z�gout[v¾s¥£[�XJgV�r[ n.leuyq8[�z�a³ Jz°}t[�utd.f³iku�lrn-ikXs[°­®dJgofma³i¯x�l § ´£µ�¬gou gonÆgoq.q.}ylS{bacZ-gvitamlrnÁl § ikX.[�amn=it[��r}tgvik[ w fcam�o[�fmacX.lbl w gon w ikX.acu^z�X.lramz�[-gvu�g�ut[�fm[�z�ikaclrnÆz�}ta³ik[�}yamlrnÁacugo}y�rdJgo¢.fc[oª � lS¥£[��r[�}�¾.ikX.[�­®d.[�u�ikamlon�l § ikXs[°z�}yacik[�}taclrn-gv¢.amfcaci¯xeitl�gouyx;Z�qsiklvikamz�gofmf³x�z�X.l;lrut[�ikX.[�z�lr}y}t[�z�iZ�l w [�fËzVgvn�¢M[(g w.w }y[�utuy[ w amn w [�q8[�n w [�n®itfcx�l § ikXs[(acn=ik[��o}kgvit[ w fmac�o[�fcamX.l;l w goq.q.}ylV{sacZ-gjikamlonpamuyutd.[vªG±�ugonÎamfcfmd.u�ik}kgjikamlon˾ )^goutuyahgvi�¶·�o�r�s�S¸ q.}tlS�o[ w }y[�z�[�n=ikf³xÉikXJgvi § lo}eikX.['Z\lo}t[puyq8[�z�ahgvf�¢.dsi�}t[�fhgvit[ w zVgouy[l § X.a w.w [�n ��go}t�vlL� z�XJgoamnsu�¾1d.n w [�}�}t[VgvutlrnJgv¢.fm[Äz�lrn w a³ikaclrn.u�¾�itX.[�� �U� �����R�I� � ��������� "9� �������� ��������'������ � � "Â[�u�ikamZ\gvitlr}@l § ikXs[~n;dsZe¢8[�}�l § X.a w.w [�n(uyi�gjik[�u�acn°ikX.[~z�XJgvamn ¥%gvu?z�lrn.uyamuyit[�n=iVª�W�X.amu�[�uyikacZ-gjiklr}amu w [� Jns[ w�§ lr}Âg°z�fhgouyuÂl § qM[�nJgofcam¹�gvikaclrn(it[�}yZ\u#itXJgvi~acn.z�fcd w [�u#ikX.[%´£µ�¬+z�lr}t}y[�z�ikamloneik[�}yZ gvn w amn=�rlofc�r[�ugon�gvq.q.}tlV{bamZ\gvitamlrn¦l § itX.[°Z\gj{bamZ�am¹�[ w fmlr�j¤¯fmac�o[�fmamXslbl w ¥X.acz�XpamuGn.loi£n.[�z�[�ututgo}tacfcx��rl;l w ¾bnJgvZ\[�fcx�ikXs[Z\gj{bamZ�am¹�[ w fmlr�j¤¯Z\go}t�racnJgofTfmac�o[�fmamXslbl w ªÂµ¯n'qJgo}�ikamz�d.fhgv}�¾bitX.amuz�}tacit[�}yamlrn�amu�z�lrn.uyamuyit[�n=i�[��r[�nÄa § ikXs[�}t[^acun.le�odJgo}kgvn®it[�[�itXJgvi£aci�q.}tlS�;a w [�u�g��rl;l w goq.qs}tlV{bamZ\gvikaclrn\l § ikX.[�amn=ik[��r}kgvit[ w fcam�v[�fmacX.l;l w ª�W�X.[ z�Xslramz�[l § ´£µ�¬ § lr} Xsa w.w [�nÈ��go}t�vlL�ÁZ�l w [�fÂuy[�fc[�z�itamlrnÆgoq.qM[Vgv}tu ikX.[�nÆ}y[VgouylrnJgo¢sfm[�gon w ¥£[¦¥amfcf#uyX.lS¥ ikXJgjiz�}yacit[�}tamg�¥acitX'�olbl w [�{bqM[�}tacZ\[�n=i�gof)¢M[�XJgV�;amlo}�zVgon'¢8[ w [�}ta³�r[ w�§ }tloZ aci�ªW�X.[ w a ��z�dsfci¯x�acn�itX.[(z�lrn=ik[${;i�l § X.a w.w [�nE�Ego}y�olS�'}kgon w lrZ  J[�f w ufcam[�u�acn�ikXJgviitX.[^Z-gj{bacZ\ac¹�[ w

fmlo�v¤¯fcam�o[�fmacX.lbl w qJgv}yi°acn>´£µ�¬Åamn=�olrfc�o[�u^�Egv}t�olS� w amu�ik}yam¢.dsitamlrnsu1¥X.lout[e[${.gvz�i^z�loZ\q.dbi�gvitamlrn'}t[�­;dsam}t[�ugonp[${bq8lrns[�n=ikamgofËgoZ�lrd.n=i£l § ikacZ\[vªÂ±�u%}y[��=gv} w u%lo¢.ut[�}y�r[ w �Ego}t�vlS�p}kgvn w lrZ  J[�f w u%uy[�fm[�z�itamlrn˾��oaËgvn w`b[�xbZ�lrd.}(¶º�S»r» *r¸Gq.}ylrq8lout[^gez�lon.utacuyik[�n=iq.}tl;z�[ w d.}t[ ¢.gout[ w lrn�qM[�n.gofmac¹�[ w ´�[�ukgv��qsut[�d w lv¤¯fcam�v[�fmacX.l;l w¶·´�[�ukgv�E�S»=� ( ¸�gon w Z\[�n®itamlrn § [�¥ÅloikX.[�}�qs}t[��;aclrd.u¥£lr}y�®u�¶6uy[�[(ikX.[(}t[ § [�}t[�n.z�[�u�itX.[�}y[�amnJ¸�ª£¿ X.[�nEikXs[ J[�f w u�go}t[1X.a w.w [�n@¾bfcacititfm[%X.gou�¢M[�[�n w lrns[1itleg w.w }t[�uyu�itX.[�uy[�fc[�z�itamlrn�q.}ylr¢.fm[�Z�ª�W?¥�l�goqsq.}tlV{bamZ\gvikaclrn.ul § ´£µ�¬ go}y[\q.}ylrqMlrut[ w amnÆ`;ikgon § lr} w gon w �1g § ik[�}yx϶·�o�r�s�L¸$Í § lr} ikX.[\| � µ�¬ ¶·|~ut[�d w lv¤Ýfmam�v[�fcamX.l;l w µ¯n;¤§ lr}yZ-gvitamlrn'¬£}yacit[�}taclrnT¸�itX.[ }y[�­®d.ac}t[ w Z-gL{sacZ\ac¹�[ w'w amuyit}tac¢.dsikaclrn�amu1goqsq.}tlV{bamZ\gvik[ w ¢=x�itX.[��°amgonEgvn wW�aciyik[�}tamns�oiklrn(q.uy[�d w lj¤¯fmac�o[�fmamXslbl w ¶��°ahgon gon w W�a³itit[�}tacn.�oitlrn-�S»o»s�L¸�¾L¥X.acfm[�g�utacZ\q.fc[�}?goq.qs}tlV{bamZ\gvikaclrn˾�Ä��µ�¬ ¶·�Ego}t�oamnJgofG�'a³{;ikd.}y[-µ¯n § lo}tZ\gvikaclrnƬ£}tacit[�}yamlrnT¸°acu ¢Jgvut[ w lrnÀikXs[-Z\go}t�racnJgof w amuyit}tac¢.dsikaclrnÁl §q.a©{s[�f8�vgofcd.[�u�ªÂµ¯n�q.}kgvz�ikacz�[v¾s�rl;l w }t[�uyd.fcitu�go}y[�}t[�q8lo}yik[ wp§ lr}%| � µ�¬Êamn�`;ikgon § lr} w gon w �1g § it[�}yxE¶·�o�r�s�L¸¥X.[�}t[Vgvu �Ä��µ�¬Åacu1fc[�uyu�ukgjikamu § goz�itlr}yxoª%µ¯n�itX.amu1qJgoqM[�}�¾J¥£[ q.}tlrqMlruy[egoq.qs}tlV{bamZ\gvikaclrn.u�l § ´£µ�¬Ç¢Jgouy[ wlrn>ikXs[�Z�[VgvnQ J[�f w q.}yamn.z�amq.fc[oª¦��[�gonÁ J[�f w itX.[�lo}yx>l § uyikgvikacuyitamzVgvfÂq.X=x;utamz�up¶·¬£XJgon w fm[�}��V»r¼=�r¸�acu^gongoq.qs}tl=goz�X�qs}tlS�;a w acn.�egon�gvq.q.}tlV{bamZ\gvitamlrn�l § g��Egv}t�olS�-}kgon w lrZ� J[�f w ¢®x-g�u�xbu�ik[�Z l § amn w [�qM[�n w [�n=i�vgo}tamgo¢.fc[�u�gon w fc[Vg w acn.�¦ikl\it}kgoz�i�go¢sfm[(z�lrZ�q.dsikgvikaclrn.u�ª¿Æ[�d.uy[�g-�r[�n.[�}tgofmac¹Vgvitamlrn�l § itX.[eZ�[Vgon' J[�f wq.}yamn.z�amq.fc[%q.}t[�ut[�n®it[ w acn�g^qs}t[��;aclrd.u~¥£lo}t�'¶«¬£[�fm[�db{8¾b�Jlr}y¢8[�u�¾;gon w |�[�x;}kgo} w �o�r�r�r¸#gon w�w [�}tac�o[1g(z�fhgouyu

Û�Û Ö PRQ�SUTUV

Page 11: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

¼ ������������� ���������� ��������������������� ��!���!"

l § z�}yacit[�}tamg�itXJgvi amn.z�fmd w [�ue| � µ�¬ gou�gEqJgo}�ikamz�d.fhgv}(z�gout[-gon w gvueg�}y[�uyd.fci��rac�o[�u�uylrZ�[\n.[�¥½amn.uyam�rX=ilrnÁaciku n.gvikd.}y[oª�¿Æ[�gofmuyl�utX.lS¥ itXJgvi itX.[�uyit}kgoac�rX=i § lr}�¥%go} w d.ut[¦l § ikX.[�Z�[VgvnÁ .[�f w goqsq.}tlV{bamZ\gvikaclrnzVgon>¢M[�acZ\q.}ylS�r[ w ¢=x�}t[�¥}taciyikacn.�p´£µ�¬ÅacnEik[�}tZ�u°l § n.lr}yZ-gvfmam¹�amn.�¦z�lrn.uyikgon=iku�¶OqJgo}yitacitamlrn § d.n.z�ikamlon.u�¸amn.u�ik[Vg w l § �Egv}t�olS� w amuyit}tac¢.dsikaclrn.u�gvn w itX.[�n+d.uyamn.�ÁlrqbikamZ\gof�Z\[�gonÉ J[�f w fclS¥£[�}�¢8lrdsn w u�¶ ) am¢.¢su�¤´£lr�rlrfcamd.¢MlS�=¤º�J[�x;n.Z\gonÄ¢Mlrd.n w u�¸ § lr} ikX.[¦n.lr}yZ-gvfmam¹�amn.�-z�lrn.u�i�gon=itu�ª\¿Æ[ w [�}yac�r[�itX.amu ¥£gSxÆgonQloitX.[�}ik}kgvz�i�gv¢.fm[pz�}ta³ik[�}yamlrn w [�n.loit[ w ¢=x �"!$# *-,-. ª �°d.[�u�ikamlon.u�l § amn=ik[�}t[�u�i�}t[�fc[��vgon=i�iklÁZ�l w [�f£uy[�fc[�z�itamlrnamn.z�fmd w [�z�X.lbloutamns��itX.[\�Ego}y�olS�> J[�f w n.[�ac�rX®¢8lr}yX.l;l w lr} Z�lr}y[e�r[�ns[�}kgvfmfcxEacitu [�n.[�}t�ox § dsn.z�itamlrnQgon wz�X.lbloutamns�EikX.[\n®d.Ze¢M[�}el § z�fhgvutut[�u�amnQ¥X.amz�XÈitlÄut[��rZ\[�n=i�ikXs[ w gvikgsªEW�X.[�xÈz�gonÉgofcfG¢M[�g wsw }t[�utut[ wuyik}tgoam�oX®i § lr}y¥£go} w fcx�amn¦lrd.} § }tgoZ\[�¥£lo}t�e¢.dbiG¥�[ § lbz�d.uBlrn�itX.[fhgviyik[�}~¢8[�zVgod.uy[�l § acitu~q.}kgvz�ikaczVgofsamZ�q8lr}º¤i�gon.z�[oª£ÌÂ{bqM[�}yamZ�[�n=iku1lrnEuyamZedsfhgvit[ w gon w }t[�gof w gvi�g¦qMlramn=i1lrdsi �"!$# *-,-. gvu�g¦q.}tloZ\acutamns��z�}ta³ik[�}tamlon˪µÝi�acu�[�gouyx�ikl�z�loZ\q.dbik[egvn w uyX.lS¥u��rl;l w gon w uyi�gv¢.fm[^qM[�} § lo}tZ\gon.z�[vª�µÝi�ikgo�o[�u°utq.gvikamgof)amn § lo}tZ\gvikaclrnamn=ikl¦goz�z�lrdsn®iitX.}tlrds�rXpikX.[ �Egv}t�olS��Z�l w [�f@gon w amZ�q.}tlS�o[�u%ikXs[ }t[�uyd.fcitu�lr¢sikgoamn.[ w ¥acikX�´�µ�¬ § lr}%acnb¤w [�qM[�n w [�n=iGZ\a©{bitd.}t[�Z\l w [�fmu�ª?µ¯n¦qJgo}�ikamz�d.fhgv}�¾oa³iÂuy[�[�Z�uÂikl^gV�olra w itX.[�lS�r[�}y[�u�ikamZ\gvitamlrnel § itX.[%n®d.Ze¢M[�}l § z�fhgouyut[�u1lo¢.ut[�}y�r[ w amn'´£ac[�}ynJgoz��®a«¾T¬£[�fm[�db{8¾Tgon w )^lS�vgo[�}�i ¶«�o�o�r�=¸�ªW�Xs[�z�lrZ�q.fm[�ik[ qJgo}kgvZ\[�ik}tacz�Z�l w [�fmu § lr}�itX.[elr¢.uy[�}��r[ w gon w dsn.lr¢.uy[�}y�o[ wÆw gvi�g-go}t[�uyq8[�z�ac .[ w amn

`b[�z�ikamlonÈ��gon w ikX.[�¢Jgouyamz�u § lo} ´�µ�¬ go}t[¦}y[�zVgvfmfm[ w amnÀ`b[�z�ikamlonÀ�sª�W�X.[�Z\[�gonÁ J[�f w goqsq.}tlV{bamZ\gvikaclrnq.}tacn.z�acq.fm[(amu�¢.}tac[ � x�q.}t[�ut[�n®it[ w amnÁ`;[�z�itamlrnE]�gon w acnÁ`b[�z�ikaclrn ( ¥�[�utX.lS¥ X.lS¥¨¥�[eq.}ylrqMlrut[�itl�d.ut[aci�itl�z�lrZ�q.dsit[�goq.qs}tlV{bamZ\gvikaclrn.u1l § ´£µ�¬ gvn w>w [�}yac�o[en.[�¥ z�lrZ�q.dsikgvikaclrnJgof³xpik}tgoz�ikgo¢.fc[ez�}yacik[�}tamg § lr}X.a w.w [�n �Ego}t�vlS�+Z\l w [�f�uy[�fc[�z�itamlrn@ªÏÌ#{bqM[�}tacZ\[�n=iku\go}t[�}t[�q8lo}yik[ w acnÏ`b[�z�ikamlon *Qgon w g w amutz�d.utuyamlrnut[�z�ikaclrn�[�n w uikXs[(q.goq8[�}�ª

� �����'���� � �#� ��� 2 ���������

� [�i�� ¢M[eg� Jn.a³ik[(ut[�i°l § uyacit[�u¥acikXEg\n.[�am�rX®¢Mlr}tXslbl w u�x;uyik[�Z w [� Jn.[ w lrnEa³iVª � [�i������ :Qw [�n.loik[ikX.['n®d.Ze¢M[�}-l § uta³ik[�u�ª ± i¯x;q.aczVgof1[�{sgoZ�q.fm[�acn amZ\go�r['gon.gofcx;utacu¦amu¦ikX.['i¯¥£l w amZ�[�n.uyamlrnJgvf%fhgviyikacz�[¥acikXQg�ut[�z�lrn w lr} w [�}^n.[�ac�rX®¢8lo}tX.l;l w u�xbu�ik[�Z�ª-�Tlo} [Vgoz�XÆutacit[o¾)ikXs[\n.[�am�rX®¢Mlr}tu^gv}t[�ikX.[�[�ac�rX=i^uta³ik[�uutd.}y}tlrd.n w amn.�ÀaciVªÇ± ut[�i�l § uta³ik[�u�� acupzVgvfmfm[ w gÀz�fmac­;ds[Ea § itX.[Äuyacik[�u�go}y[Ägofcf�n.[�am�rX®¢Mlr}tu�ª � [�i� ¢8[�gE Jnsacik[-ut[�i�¥a³ikX � [�fc[�Z�[�n=iku�ªÈÌBgoz�X+l § ikX.[�Z ¥amfcf�¢M[�}t[�q.}t[�ut[�n®it[ w ¢®xÈgÄ¢.amn.go}yxÆ�r[�z�iklr}�l §fm[�ns�oikX � ¥a³ikXplon.[�z�lrZ\qMlrn.[�n=i�¢8[�amn.�\�r¾.gvfmfTloikXs[�}tu£¢8[�amn.���b¾buyleikXJgvi� ¥amfcfT¢8[�ut[�[�n'gou£acn.z�fcd w [ wamn�� >��UL���� ªÉ¿À[ w [� Jn.[�g w amutz�}t[�ik[E�Ego}t�vlS�+}kgon w lrZ  J[�f w gou\gÁz�lrfmfc[�z�ikamlonÉl §�w amutz�}t[�ik['}kgon w lrZ�ogv}tahgv¢.fm[�u�¾�� : ����� ����� � � ¾ w [� Jn.[ w lrn ��¾;[Vgvz�X����8ikgo�®amn.�^�vgofmd.[�u�acn ¦¾;¥Xslrut[~�ylramn=iGq.}tlo¢Jgo¢.acfmaci¯xw amu�ik}tac¢.dsitamlrnputgvikacuy J[�u1itX.[ § lrfcfmlS¥amn.��q.}tlrqM[�}�ikac[�u�¾

!#"$� % * �'&(��� "*)�+-, �/. � : % * �'&(����&10 �324�65 � � � �7� ¶��L¸!#"$� % * � " �98 >�� ¶«�r¸

-/.�Û0-/1

Page 12: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ »

¥X.[�}t[ " )�+-, �/. w [�n.loit[�u�gQ}t[�gofmac¹VgvitamlrnÉl § ikX.[' J[�f w }t[�uyit}tamz�ik[ w ikl � � � � ��: � 2 � � � 2��: � � gvn w5 � � ��w [�n.loit[�u ikX.[¦uy[�i^l § n.[�ac�rX®¢8lo}tu°l § � ªe��lr}y[��r[�n.[�}kgofcfcxo¾Ëa §�� amu°g�uyd.¢.uy[�i(l § �%¾Ë¥£[�¥amfcf?¥}yacit["��À§ lr} ��&(� � � ��� � ªeµ¯nÁ¥�lr} w u�¾�q.}tlrqM[�}�i¯xζ��S¸�Z\[�gon.u°ikX.gvi^amn=ik[�}kgoz�ikaclrn.u ¢M[�i¯¥�[�[�nÆuta³ik[ � gon w ikXs[loitX.[�}1uta³ik[�u�goz�ikdJgofcfcx�}y[ w dsz�[ itl-acn®it[�}tgoz�itamlrn.u�¥a³ikXEa³ikun.[�am�rX®¢Mlr}tu�ª|B}ylrqM[�}yi¯xƶ·�r¸�amu1amZ�q8lr}�i�gon=i § lr}ikXs[ � goZ�Z\[�}tuyfm[�x=¤º¬£fma 58lr} w itX.[�lr}y[�Z ikl>X.lrf w ªÁW�X.amu ikX.[�lr}t[�Z uyikgvik[�ueikXJgjieikX.[ �yloamn=ieq.}ylr¢Jgo¢samfma³i¯xw acuyik}yam¢.dbikamlonÀl § g>��go}t�vlL�Æ J[�f w amu�g ) am¢.¢.u w amu�ik}yam¢.dsitamlrn ¶ § lr}(¥X.amz�XÈ¥�[pd.uy[pikX.[-n.loi�gjikamlon % * ¸�ra³�r[�n'¢=x

% * � " � : � ������� ����� � " � � � ¶·�r¸

¥X.[�}t[�� acu%ikX.[^[�n.[�}y�ox § d.n.z�ikaclrn

� � " � : ��� � � " � ��? ¶6]=¸

W�X.[ utd.Z amu1lS�r[�}�ikX.[ ut[�i�l § z�fmam­®d.[�u�gvn w ikXs[ � � u�go}t[^ikX.[ z�fcam­®d.[(q8loit[�n=ikamgofmu¥X.acz�XÄZ-gVx w [�q8[�n wlrnpq.go}kgoZ�[�it[�}yu�¾snsloi�utqM[�z�ac J[ w amn-itX.[°n.lvi�gvitamlrn˾ : � " ����� ����� � " � � acu�itX.[°n.lr}yZ-gvfmam¹�amn.� § gvz�iklo}gofcutl¦zVgofcfm[ w ikX.[^qJgo}�ika³ikamlon § d.n.z�itamlrn@ªÂ¿À[ ¥amfcf@¥}ta³ik[ � " ¶O}t[�uyq˪ �"�� ¸g�uyd.Z�lS�r[�}�gofcf@qMlrutuyam¢.fc[°�ogvfmd.[�ul §�" ¶6}y[�utq@ª "�� ¸�ª�W�Xs[-z�loZ\q.dbi�gvitamlrnÁl §� amn=�rlrf³�r[�uegofcf~q8lruyutac¢.fm[¦}t[�gofmac¹Vgvitamlrnsu " l § itX.[���go}t�vlL� J[�f w ªÈW�Xs[�}t[ § lr}t[v¾£a³i�amu�acnÉ�r[�n.[�}kgof�[${bq8lrns[�n=ikamgofmf³xÀz�lrZ\qsfm[�{Égon w n.loi¦z�lrZ�q.dsi�gjikamlonJgofmf³x § [Vgouyam¢.fc[oªW�X.acuezVgonÉ¢M[�gÄq.}ylr¢.fc[�Z�¥X.[�n+d.uyamn.�ÄitX.[�uy[�Z\l w [�fmu�acnÈuta³ikdJgjikamlon.u(¥Xs[�}t[�gvnÉ[�{bq.}t[�utuyamlrn+l § ikXs[�ylracn®i w acuyik}yam¢.dbikamlon % * � " � acu£}y[�­®d.am}y[ w ª~±�n�goq.q.}ylV{sacZ-gjikamlon\l § itX.[ w amuyit}tac¢.dsikaclrn>¶6�=¸Gacu�itX.[�q.uy[�d w lv¤fmac�o[�fmamXslbl w acn®it}tl w d.z�[ w ¢®x�´£[�utgo�Ķº�S»=� ( ¸%gon w�w [� .n.[ w gou

�! � " � : "�$# ) % * �'&(��� " '&% �(' � ? ¶ ( ¸

ÌBgoz�X�ik[�}yZ amn�itX.[^q.}tl w d.z�i�acu�[Vgou�x�ikl¦z�loZ\q.dbik[o¾

% * �'&(��� " '&% �(' � :�)��� ��� ��+* �

� � " � � �� ,.-/����� �0�1��+* �

� � "32� � � � ¶ *r¸

¥acitX " 2 � : ��& 2� � &10 � 2 �54�� 26�: � � ªÂÌ#{bq.}t[�ututaclrn�¶ ( ¸�amu#g°�r[�n®d.acn.[%q.}ylr¢Jgo¢.acfma³i¯x w amu�ik}yam¢.dsitamlrn lrn.f³x(¥Xs[�nikXs[¦�vgo}yahgo¢sfm[�u^gv}t[�amn w [�qM[�n w [�n=i�¢sdsi(aci^zVgvnÆ¢M[¦d.ut[ w ikl�lr¢bi�goacnQ[�uyitamZ\gvik[�u l § g��Ego}y�olS�Á}kgvn w lrZ J[�f w q.go}kgoZ�[�it[�}yu�ª-µÝi XJgou(¢M[�[�nÀd.ut[ w ¢=xÆ`;i�gon § lr} w ¶��S»r»o»=¸�amnÁikX.[\Z\l w [�f~ut[�fc[�z�ikamlonÆz�lrn=ik[�{;i�¶6ut[�[`b[�z�ikaclrn ( ¸�ª#µ¯nÄ`b[�z�itamlrn ( ¾b¥£[ ¥amfcf8dsut[^loikXs[�}goq.qs}tlV{bamZ\gvikaclrn.u£¢.gout[ w lrn�u�x;uyik[�Z\u1l § amn w [�qM[�n w [�n=i�vgo}tamgo¢.fc[�u�ª W�Xs[�am} § goz�itlr}tac¹Vgvitamlrn'q.}tloq8[�}yikac[�u°uyamZ�q.fma § x�z�lrZ�q.dsikgvikaclrn.u�gou�¶ ( ¸�gon w itX.[�xEz�lr}y}t[�utqMlrn wikl��vgofca w q.}ylr¢Jgo¢.acfma³i¯x\Z�l w [�fcu�ª

Û�Û Ö PRQ�SUTUV

Page 13: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�S� ������������� ���������� ��������������������� ��!���!"

µ¯Z\go�r[�uy[��rZ�[�n=ikgvikaclrnÆacn=�rlrf³�r[�u^lr¢sut[�}��r[ wÈw gvikg�gon w d.nslr¢.ut[�}y�o[ wÈw gji�gpikl'¢8[¦}y[�z�lS�o[�}t[ w ªpW�X.[d.n.lr¢.uy[�}��r[ wÎw gvikgEamu�Z\l w [�fc[ w gou�g w acutz�}y[�it[��Ego}y�olS�È}tgon w lrZ  J[�f w ¾ �¾Âgou w [� Jn.[ w amnʶ·�=¸ ¥acikX[�n.[�}t�ox § d.n.z�ikaclrn � w [�qM[�n w amn.��lrnpg(qJgo}kgvZ\[�ik[�} 8 ªÂµ¯npXsa w.w [�n��Egv}t�olS��Z�l w [�fmu�¾®itX.[�lo¢.ut[�}y�vgvikaclrn.u� go}y[�z�lon w acitamlrn.gofmf³x�amn w [�qM[�n w [�n=i �rac�o[�n �%¾)goz�z�lr} w amn.��ikl�g w [�n.uta³i¯x��Á¥X.amz�X>acu°gouyutd.Z�[ w itl�¢8[l § itX.[ § lrfmfclS¥amn.��i¯x;qM[\¶���amug�qJgo}tgoZ�[�ik[�}gon w ikX.[�� � � u�gv}t[ �ra³�r[�nJ¸�¾

� ��� � "$� � � : "�$# ) � � ���� ��&(� � � � ¶«�r¸

: ����� � ��$# )� ��� � � ���� ��&(� � � �7� �

goutuyd.Z\acn.�^ikXJgvi�gofcf.ikX.[�� � ���� ��&(� � � � gv}t[q8loutacitac�o[oªÂW�X.acu�Z\go�v[�uBikX.[1Z\l w [�fMuyamZ�amfmgo}�itl�gon\amn w [�qM[�nb¤w [�n=i Z�a³{;ikds}t[(Z\l w [�f�¶ ��� �(�'z � goz�X.fmgon>gon w |�[�[�fB�o�r�o�=¸�ª1±�nÄacn w [�q8[�n w [�n=i^Z�a³{;ikds}t[(Z\l w [�f�z�lrd.f w¢8[ut[�[�n-gou£g^X.a w.w [�n-�Ego}y�olS�¦Z�l w [�f.¥X.[�}y[1itX.[X.a wsw [�n� J[�f w �ÆamuBlrns[1l § amn w [�qM[�n w [�n=i£a w [�n=itamzVgvfmfcxw amu�ik}tac¢.dsit[ w �vgo}tamgo¢.fm[�u�ªÂµ¯n�ikXs[(�o[�n.[�}kgof)z�gout[v¾.ikX.[^z�loZ\q.fc[�it[ fmam�v[�fcamX.l;l w amu��ra³�r[�n�¢=x

% * ��� � " ��� ��8 � : � ��� � "$� � � % * � " � 8 �: � 8 � � "

�$# ) � � ���� ��&(� � � � " � ����� � �� � � " � � 8 �7� ¶·¼=¸

: � 8 � � ����� � ��� � " � 8 ���1��$# ) ���� � � ���� ��&(� � � �7� ?

W�X;dsu1itX.[^z�lrn w acikaclrnJgofM J[�f w � �oac�r[�n�� : �Éamug��Egv}t�olS�� J[�f w gou �Ïamu�ª~µÝiku[�n.[�}t�ox § d.n.z�itamlrn�acu� � " ��� � � ��8 � : � � " � 8 � � �

�$# ) ���� � � ���� ��&(� � � � ? ¶·»=¸

µ¯nÁitX.[ § lrfcfmlS¥amns� w [��r[�fclrq.Z�[�n=iku�¾)¥£[e¥acfmf?}t[ § [�}°ikl'�Egv}t�olS�Ä .[�f w u �êgon w � �ra³�r[�n�� : � gvu�ikX.[Z-go}y�ramn.gof@gvn w z�lrn w a³ikaclrnJgofM J[�f w ugon w'w [�nsloik[^¢=x�� : ��� ��8 � itX.[ �r[�z�iklr}qJgv}kgoZ�[�it[�}�ª

� � � e��)���(� � � �v�^�Â2 � ������� !"�������%����� �

µ¯nêg+´%gVxo[�utamgon § }kgoZ�[�¥�lr}t�T¾�gÀ¥%gVx l § ut[�fm[�z�ikacn.�ÎgÉZ\l w [�f�goZ�lrn.��� Z\l w [�fcu � � � �"! �U?U?U? � �$#z�lrn.uyamu�iku�l § z�X.lbloutamns�EikX.[\Z\l w [�fB¥a³ikXÈXsam�rX.[�uyi�q8lru�ik[�}tamlo} q.}ylr¢Jgo¢samfma³i¯xrª�´�xÀ´%gVxr[�ueikX.[�lr}t[�Z�¾?ikX.[q8lru�ik[�}tamlo}%q.}tlo¢Jgo¢.acfmaci¯x\l § �"%�¶�& � � L �U?U?U? � � � ¸£�ra³�r[�n�itX.[ w gvi�g'�Éacu

% �(�"%�� � � : % * �)� �*�"% � % �(�"% �#�+-, � % * ��� �*� + � % �(� + ��

¥X.[�}y[ % * �)���*�"% � acuGitX.[�acn®it[��r}tgvik[ w lr}GZ\go}t�racnJgofJfcam�o[�fmacX.lbl w l § Z�l w [�f.�"%%gon w�% �(�"% � acu�a³ikuGq.}taclr}q.}tlr¢.go¢.amfcaci¯xoª)±�utuyd.Z�amn.�ikXJgji#gvfmf=Z�l w [�fmu)XJgV�o[£[�­®dJgvf;qs}tamlo})q.}tlr¢.go¢.amfcacitam[�u�¾Sz�X.l;lrutacn.��ikX.[GZ\l w [�fr¥acikX

-/.�Û0-/1

Page 14: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �r�

ikXs[�X.ac�rX.[�uyiGq8louyik[�}taclr}Bq.}tlr¢.go¢.amfcaci¯x amuB[�­®d.a³�vgofm[�n®iGikl(ut[�fm[�z�iGikX.[1Z\l w [�fs¥acitX\ikXs[�fmgo}t�r[�uyiBacn®it[��r}tgvik[ wfmac�o[�fmamXslbl w ¾

% * ��� �*�"% � :�� % * �����*��% � �"% � % ����%�� �"% ��� ��% � ¶��S�=¸

¥X.[�}t[ ��%^�vgo}tac[�u^amnÁikXs[\Z�l w [�f �"% qJgo}tgoZ�[�ik[�}^utqJgoz�[pgon w % �(��%��*�"% � acu^itX.[�q.}taclr} w amu�ik}yam¢.dsitamlrnlrn���% § lr} itX.[-utgoZ\[\Z\l w [�f«ªE¬£lrZ\qsdsikacn.�ɶº�S�=¸(acu�n.lvied.uydJgofmf³x>ik}tgoz�ikgo¢.fm[vªE±¡utamZ�q.fc[-gon w l § ik[�n}t[�fmamgo¢.fm[�¥%gVx ikl�goq.qs}tlV{bamZ\gvik[~ikXs[Gacn=ik[��o}kgvit[ w fmam�v[�fcamX.l;l w amu�q.}tlS�;a w [ w ¢®x^itX.[G´%gVxr[�uyahgon µ¯n § lr}yZ-gvitamlrn¬£}ta³ik[�}tamlonQ¶·´£µ�¬�¸%l § `bz�X=¥%gv}t¹�¶º�S»=�o¼r¸°¶6uy[�[ § lr}�amn.u�i�gonsz�[ /^goutu1gon w �1g § ik[�}yx>�V»r» ( ¸$¾

< �� � % * �)� � �"% ��� �"!$# ���"% � : < ��� % * �)� ������% � � � % ��� � � � ¶��r�L¸

¥X.[�}t[ � ��% acu%ikX.[^Z\gj{bamZed.Z½fmac�o[�fmamXslbl w [�uyikacZ-gjik[ l § ��%V¾���% : � � ��� � ���� % * ��� ����% � �"% �7�

gon w�� %Gamu~ikX.[n®d.Ze¢M[�}Gl §8§ }t[�[qJgv}kgoZ�[�it[�}tuBacn\Z�l w [�f �"%VªÂµÝiGXJgouG¢8[�[�n\¥a w [�f³xed.uy[ w acn�ikX.[1z�lrn=it[�{;il § ut[�fc[�z�ikamns�\ikXs[ n®d.Ze¢M[�}1l § z�lrZ�q8lrns[�n=iku1amn'amn w [�qM[�n w [�n=i°Z�a³{;ikd.}y[^Z\l w [�fcu ¶·�J}kgofc[�x�gvn w �1g § ik[�}yx�S»r»o¼s¾J�lb[ w [�}gon w ¿Àgoutuy[�}yZ-gonÁ�S»o»=�r¸�ª~µ¯n�ikXsamu�z�lon®it[�{;i�´£µ�¬ fcamZ�aci�gjikamlon.uBXJgV�r[(¢8[�[�n'q8lracn=ik[ w lrdbigon w acneqJgo}�ikamz�d.fhgv}�¾oa³i~XJgou~¢M[�[�n¦lr¢.ut[�}y�o[ w ikXJgviBacneq.}tgoz�itamz�[%itX.[�z�}yacit[�}taclrnez�gon�ik[�n w itl lS�r[�}y[�u�ikamZ\gvit[ikXs[�}yam�rX=iGn®d.Ze¢M[�}Gl § z�loZ\qMlrn.[�n®ituG¥Xs[�n-itX.[1it}td.[1Z�l w [�fJamuGn.loiGamn ��� � �U? ?U? ? �$# � ¶6uy[�[°´�am[�}ynJgoz��®a«¾¬£[�fc[�db{8¾Tgon w ) lS�ogv[�}yi��v�r�r�=¸$ª�Jlr} � a w.w [�n>��go}t�vlL�'Z�l w [�fmu�itX.[ w a ��z�d.f³i¯x�z�lrZ�[�u § }tlrZ¡ikXJgvi � ���% gon w6% * ��� � � ��% � go}y[ n.lvi

gV�vgoamfmgo¢.fm[vª��Jlr}#´�µ�¬�¾oZ�[�ikXsl w u?d.uyamn.��utamZ�d.fhgvitamlrnsu?X.gS�o[%¢M[�[�n�amn=�r[�uyikac�=gvit[ w acn ��[�¥�iklrnegon w �1g § ik[�}yx¶��V»r»o]®¸�¥X.acfm[^`®i�gon § lo} w ¶��S»r»o»=¸£q.}tloq8lruy[ w d.utacn.��ikX.[^q.uy[�d w lv¤¯fcam�o[�fmacX.lbl w ¶ ( ¸�gou1gon'goq.q.}ylS{bacZ-gvitamlrniklikXs[�acn®it}kgoz�i�go¢sfm[G�Ego}y�olS� w amu�ik}yam¢.dsitamlrn@ª)µ¯n ikXsamu�qJgoqM[�}�¾j¥�[£uyd.�r�r[�uyi�d.utacn.�1itX.[GZ\[�gon( .[�f w goq.qs}tlV{®¤amZ\gvitamlrnÄqs}tamnsz�amqsfm[�itl w [�}ta³�r[�g�z�fmgoutu^l § loikXs[�} ik}tgoz�ikgo¢.fm[�z�}ta³ik[�}yahgsª ±�u § lr}°ikXs[�qsut[�d w lv¤¯fcam�v[�fmacX.l;l wgoq.qs}tlV{bamZ\gvikaclrn˾sa³i1z�lrn.uyamu�iku1l § }y[�q.fmgoz�acn.��ikX.[(lr}yam�racnJgof)��go}t�vlL� w acuyit}tam¢sdsikaclrn�¢=x'g\q.}yl w dsz�i1[Vgouyam[�}ikl w [�gofJ¥acikX@ª#¿À[1}t[�zVgofcf.ikX.[1Z�[Vgon¦ J[�f w qs}tamnsz�amqsfm[�amn¦ikXs[�n.[${;i%ut[�z�itamlrn\gon w\w [�uyz�}tac¢8[�goq.qsfmamz�gvikaclrn.uamn�itX.[^Z\l w [�f@ut[�fc[�z�ikamlon'z�lrn=ik[${bi1acnE`;[�z�itamlrn ( ª

� ��(� �'����� � �����^�

����� ��� ��!#"� $&%'��()(�*�+ ,.-�/0�213-�+�!#(�*4-�!)56-7($&�W�X.[�Z\[�gon\ J[�f w gvq.q.}tlV{bamZ\gvitamlrn�¶��������G¬£XJgon w fm[�}��S»o¼=�r¸~amuGlr}tac�ramnJgvfmfcx g(Z\[�ikX.l w l § goq.q.}ylS{bacZ-gvitamlrn§ lr} ikXs[\z�lrZ\qsdsi�gvitamlrnÁl § ikX.[¦Z�[VgonQl § gÄ�Ego}y�olS�Á}kgvn w lrZ  J[�f w ª\µÝi(zVgonÆ¢8[�d.ut[ w itl�q.}ylS�ba w [\gon

Û�Û Ö PRQ�SUTUV

Page 15: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�L� ������������� ���������� ��������������������� ��!���!"

goq.q.}ylS{bacZ-gvitamlrn�l § ikX.[ w acuyit}tam¢sdsikaclrnÄl § g'�Ego}y�olS�>}kgvn w lrZ  J[�f w ªeW�X.[�a w [Vgp¥X.[�nÆz�lrn.uta w [�}yamn.��gqJgo}yitamz�d.fhgo}�uyacik[ � acu?itl�n.[��rfm[�z�i#itX.[ � d.z�itdJgvikaclrn.u�l § ikX.[�uta³ik[�u�amn=ik[�}kgoz�ikacn.��¥a³ikX � ª#W�X.[£}t[�uyd.fcitamn.��uyx;u�¤ik[�Z ¢M[�XJgV�r[�u£gvuÂlrn.[%z�lrZ�q8lruy[ w l § acn w [�qM[�n w [�n=i~�vgo}tamgo¢.fc[�u § lo}#¥X.amz�X�z�lrZ�q.dsi�gjikamlone�r[�itu#ik}tgoz�ikgo¢.fc[oª��lr}t[¦uyq8[�z�ac .zVgofcfcxr¾ § lr}^gofmf 2�w a65@[�}t[�n=i § }tloZ � ¾)itX.[4� 0 � u gv}t[� s{b[ w ikl�ikX.[�am}°Z�[VgvnQ�vgofcd.[���� * � � 0 � ª� lS¥£[��r[�}�¾�itX.[�uy[\Z�[VgvnÁ�vgofcd.[�u(go}y[�d.n.�®n.lS¥nÉgon w a³i amu^goz�ikdJgvfmfcx�ikX.[¦�rlrgofÂl § ikX.[�goqsq.}tlV{bamZ\gvikaclrnikl�z�loZ\q.dbik[�itX.[�Z'ª W�Xs[�}t[ § lr}t[v¾)ikX.[�Z�[�itX.l wEw [�qM[�n w u lrnÁgpuy[�f § ¤¯z�lon.utacuyik[�n.z�xEz�lrn w acitamlrnE¥Xsamz�XÁamuikXJgvi(ikXs[\Z�[VgonÆz�lrZ�q.dsit[ w ¢Jgout[ w lrnQikX.[\goq.q.}ylV{sacZ-gjikamlonQZ�d.uyi ¢8[�[�­®dJgvfGitl�ikXs[\Z�[VgonÆd.ut[ w iklw [� Jns[ ikXsamu1goq.q.}ylV{sacZ-gjikamlon˪BW�X.[�Z�[Vgon� J[�f w gvq.q.}tlV{bamZ\gvitamlrn % ��� � " � l § ikXs[&) am¢.¢su w amuyit}tac¢.dsikaclrnamu~ikX.[�n w [� Jn.[ w ¢=x¦}t[�q.fhgoz�amn.� itX.[�[${sgoz�i�Z\[�gon��vgofmd.[�uB¢®x�itX.[1Z\[�gon��vgofcd.[�uBacn¦itX.[�goq.q.}ylS{bacZ-gvitamlrn@¾w [�n.lvik[ w ¢=x��" : � �&10 � 2�� � � ¾

% ��� � " � : "�$# ) % ���� � &(� � � ¶º�L�r¸

¥X.[�}y[ % ���� � &(� � : % * �'&(����" '&% �(' ��?±�q.q.f³xbacn.��ikX.[^uy[�f § ¤Ýz�lrnsutamu�ik[�n.z�x�z�lrn w a³ikaclrn�fm[�g w u%ikl

�" : ���"�� :� � � � � � �&10 � 2�� 5 � L��1� �ªªª�� �-� �&10 � 2 � 5 � �7� �

� ¶º�S�=¸

¥acikX !#��� � �� � �-� �&10 � 2��65 � � �7� �9: � , / &(� % ���� �'&(� ��?W�Xs[�Z\[�gonÀ J[�f w goqsq.}tlV{bamZ\gvikaclrnQz�lrn.uyamu�iku�l § uylrfc�;amns��ikXsamu  b{s[ w q8lracn=ie[�­®dJgjikamlonÉgon w ikgo�®amn.�

ikX.[euylrfmdbikamlon �" : � �&(� � � � � � gou gon>[�uyikacZ-gjik[�l § ikX.[e[${sgoz�i^Z�[Vgon� J[�f w ª(��lr}y[ w [�ikgoamfcu°go}y[e�ra³�r[�namn-¬£XJgon w fc[�}°¶��S»r¼r�r¸�ª�µ¯npqJgo}�ikamz�d.fhgv}�¾=aciGz�gonp¢M[�utXslL¥n\ikXJgvi % ��� Z�amn.acZ\ac¹�[�u#ikX.[ / d.fmfc¢Jgoz��r¤ � [�ac¢.fm[�}w ac�o[�}t�o[�n.z�[�������� �� � �

� %�� '��� %�� ' ��� lL�o[�})ikXs[Guy[�i�l § q.}ylr¢Jgo¢.acfma³i¯x w amuyit}tac¢.dsikaclrn.u % ikXJgji § goz�itlr}tac¹�[oª�W�X.[BZ�[Vgon J[�f w goqsq.}tlV{bamZ\gvikaclrnpz�gonÄgofcutl¦¢M[(qs}t[�uy[�n=ik[ w d.utacn.��ikX.[(z�lon.z�[�qsi�l § ��� ���� � "� � � � ���&� �� � � ������� �����/� ����� �gon w g>�ogv}tahgjikamlonJgofGq.}tacn.z�acq.fm[vªÉW�X.amu�goq.qs}tl=goz�XÎq.}y[�ut[�n=iku-itX.[�Z\[�gonÉ J[�f w goqsq.}tlV{bamZ\gvikaclrngo¢8lS�o[ gvu�g�¹�[�}tlvikXb¤Ýlr} w [�}1goq.q.}ylS{bacZ-gvitamlrnpgon w q.}tlS�;a w [�u1g¦n.gvikd.}tgof@ J}yuyi1lr} w [�}1goq.qs}tlV{bamZ\gvikaclrn § lr}ikX.[1qJgo}�ikacitamlrn § d.nsz�ikaclrn˪#¿Æ[1utqM[�z�a § x¦ikX.acuG J}yuyi�lr} w [�}Gamn\itX.[ § lrfmfclL¥acn.�^ut[�z�ikaclrn˪µ¯np`b[�z�ikaclrn ( ª³�r¾®¥£[w [�}yac�r[�´£µ�¬²goq.q.}ylV{sacZ-gjikamlon.u¢Jgout[ w lrn % *�� % ��� ¥X.acfm[(amn>`;[�z�itamlrn ( ª �;¾M¥�[ed.uy[�ikX.[( J}tu�i lr} w [�}goq.q.}ylS{bacZ-gvitamlrn-l § itX.[^qJgo}�ikacitamlrn § d.n.z�itamlrn@ª

�)�! " -7*$# 1 +�*�%�� * ��� ��! "� $&%'��()(�*�+ ,.-�/0�213-�+�!'+&% 1('���(���* 13-713-&+�!)%+*)!�5 13-&+�!� [�i � ��� ¾ ��� gon w ��� ��� w [�n.lvik[E}y[�uyq8[�z�ika³�r[�fcxÎikX.[�[�n.[�}t�ox § d.n.z�ikaclrn˾£itX.[EqJgv}yika³ikaclrn § d.n.z�itamlrngon w itX.[e[�{bqM[�z�i�gvitamlrnÄdsn w [�}�Z\l w [�f£¶��S�r¸�ª�±�n>goqsq.}tl=gvz�X>z�lrn.uyamu�iku°l § q8[�} § lr}yZ\acn.�pg-qM[�}�ikd.}y¢Jgvitamlrn

-/.�Û0-/1

Page 16: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �S�

ikXs[�lr}�x\¥a³ikX-itX.[ Z\[�gon- J[�f w Z�l w [�f#¶��L�o¸�gou£itX.[°}y[ § [�}y[�n.z�[ Z\l w [�f8lr}�¹�[�}tloitX�lr} w [�}%Z�l w [�f«ª�µ¯npikX.acugoq.qs}tl=goz�X@¾M¥�[egouyutd.Z�[ itXJgvi1ikX.[ � d.z�ikdJgjikamlon.u°go¢MlrdsiitX.[�Z�[Vgon� J[�f w [�n.[�}y�ox � ��� go}t[(utZ\gofmf·¾0��� ���ikXs[ w a65@[�}t[�nsz�[�� � : � �!� ��� acu�uyZ-gvfmf«ª)W�Xs[%uyikgo}yitamn.�1q8loamn=i#acu?itX.[ § lofmfmlS¥acn.�[�{sgoz�i § goz�itlr}tac¹Vgvitamlrnl § ikX.[^qJgv}yika³ikaclrn § d.n.z�ikaclrn˾

: � , �)� � �0� � � ��� � & � � � � � & � � �

: ���� ��� ��� � ����� ����� � � � � ��� ? ¶��V]®¸

`bacn.z�[�� ��amu�utZ\gofcf«¾®ikX.[^ut[�z�lrn w�§ goz�iklr}�acnÀ¶º�V]®¸£z�gon�¢M[ [�{bqJgvn w [ w ¾

��� ��� � �)��� �0��� � �'� � � � : ��� ��� � L ��� � � � � �1?U?U? �: L � ��� ��� ��� � � � � � ��? ?U?

W�X.[� .}tuyi�ik[�}tZ�u£l § itX.[�}yam�rX=i�¤¯XJgon w uta w [�go¢8lS�o[ go}t[1ikX.[1 J}tu�i£it[�}tZ�u£acn\itX.[�[${sq.gon.utaclrn�go}ylrd.n w ¹�[�}yll §&�)� � �0� ��� ��� ��� � �'� ��� � uylpikXJgji�n.[��rfm[�z�itamn.��ikX.[euy[�z�lrn w gon w X.am�rXs[�}�lo} w [�}tu�it[�}yZ\u�amn�� � fc[Vg w uikl(ikX.[ § lrfmfclS¥amn.�  J}yuyi�lr} w [�}GqM[�}yitd.¢Jgvitamlrn�ikX.[�lr}yx\}t[�utd.f³iVªÂµÝi£�rac�o[�u£gonpgoqsq.}tlV{bamZ\gvikaclrn�l § ikXs[�[�{sgoz�iqJgo}�ika³ikamlon § d.n.z�ikamlon ¾

� *-,-. : ��� ����� ��� ��� ��� � � � � � � � ��� �'� ��� �&? ¶�� ( ¸

W�X.[ ­®dJgofcaci¯x\l § ikX.acu�goq.qs}tlV{bamZ\gvikaclrn-z�gon�¢8[°acn=�r[�u�ikac�=gvik[ w ikX.}ylrd.�rXpitX.[ § lrfmfclS¥amn.�(amn.[�­®dJgofma³i¯xr¾sgofmuylzVgvfmfm[ w ikX.[�) am¢.¢su�¤º´�lr�rlrfcamd.¢MlS�®¤¯�J[�x;n.Z\gon>¶ )(´%�¸£¢8lrdsn w ¶«¬£XJgon w fm[�}(�V»r¼=�r¸$¾

��� �)� � �0� ��� ��� � � �'� � � � ��� � � � � �"? ¶��'*=¸

W�X.[�}y[ § lr}y[o¾Ë¥�[¦gofc¥£gVx;u XJgV�r[ � *-,/. ª(±�u g- J}yuyi lr} w [�}^gvq.q.}tlV{bamZ\gvitamlrn˾J¥�[�zVgonÁ[${sqM[�z�i *-,-. ikl�¢M[ gez�fclrut[�}�goq.q.}ylV{sacZ-gjikamlon\ikX.gon ��� ¥X.amz�X�z�lr}t}y[�uyq8lrn w u�ikl�itX.[ ¹�[�}tloitX'lo} w [�}�ª~W�X.acuamu�amfcfmd.u�ik}kgjik[ w ¢=x�itX.[e[${.gvZ\q.fc[�acn�ikXs[e±�q.qM[�n w a³{'¥X.[�}t[e¥�[ez�lrZ�qJgo}y[ itX.[�ikXs}t[�[�­;d.gon=ikacitam[�u § lr}�g�L¤Ýz�lrfclr}%|?loititu�Z�l w [�f«ª ��loit[ ikXJgvi�itX.[^ukgoZ�[ amns[�­®dJgofcaci¯x\amu%�vgofma wp§ lr}�gon=x�[�n.[�}y�ox�loitX.[�}%itXJgon � ��� ª� lS¥�[��o[�}�¾bikX.[�Z\[�gon\ J[�f w Z\l w [�f�¶º�L�r¸~amuBlrqsitamZ\gofTgoZ�lrn.�(Z\l w [�fcu~¥acikX § goz�itlr}tac¹Vgvitamlrn¦q.}ylrqM[�}yi¯xo¾sacnikXs[(uy[�n.uy[(itXJgvi1aci%Z-gj{bacZ\ac¹�[�u�ikX.[�)^´%�È¢8lod.n w amnƶ��'*r¸ § lr}�utd.z�X�Z\l w [�fmu�ª

��(� �'����� ������� �(/�/����10-��2 � ����� ��� � � � � !

W�X.[GZ\[�gon^ J[�f w goqsq.}tl=gvz�X z�lrn.utacuyitu�l § n.[��ofm[�z�ikacn.� � d.z�itdJgvitamlrn.u § }ylrZÇikXs[GZ�[Vgvn acn^itX.[G[�n=�;am}tlon.Z\[�n=il § [Vgoz�X�q.a³{b[�f·ª���lr}t[(�r[�n.[�}tgofmf³xr¾s¥�[(ikgofm�-go¢Mlrdsi1Z\[�gon� J[�f w ¤¯fcam�o[°goq.q.}ylS{bacZ-gvitamlrnsu%¥X.[�n'ikX.[^�vgofmd.[gvi�uyacit[ � w l;[�u�n.loi w [�qM[�n w lrnÉitX.[-�vgofmds[�u¦gvi�lvikX.[�}euta³ik[�ue¥Xsamz�XÎgo}t[pgofmfGut[�i�iklÁz�lrnsuyi�gvn®itu'¶6n.lvi

Û�Û Ö PRQ�SUTUV

Page 17: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�V] ������������� ���������� ��������������������� ��!���!"

n.[�z�[�ututgo}tacfcxÆikX.[�Z�[Vgon.uk¸�amn w [�qM[�n w [�n=ikfcxÀl § ikX.[p�vgofcd.[�gvi¦uta³ik[ � ¶·¬£[�fm[�db{8¾£�Jlr}y¢8[�u�¾Ggon w |�[�x;}kgo} w�o�r�=�r¸$ª~µ¯n>`b[�z�itamlrn ( ª³�r¾.¥�[�goqsq.fcx\ikX.acu1a w [Vgeitl\}y[�fm[�gout[ itX.[^z�lrZ�q.dsikgvikaclrnJgof8¢.d.} w [�n�¥Xs[�n w [Vgofcamn.�¥acikXpitX.[^amn=ik}tgoz�ikgo¢.fc[ w amu�ik}yam¢.dsitamlrn % * �)� � � � amn�´£µ�¬ z�lrZ�q.dsikgvikaclrn˪#W�Xsamu1goq.q.}yl=goz�X�amu%itX.[ Z�lruyiuyik}tgoam�oX®i § lr}y¥£go} w z�lrnsuta w [�}tacn.��[�{bq.}y[�uyutamlon ¶º�r�L¸l § ´£µ�¬ gvn w amn.z�fmd w [�u°z�}tacit[�}yamlrn>| � µ�¬²amn=ik}yl w dsz�[ wamn+`;ikgon § lr} w ¶��V»r»r»=¸(gon w }t[�zVgofcfm[ w ¢8[�fmlS¥^ª � lL¥�[��o[�}�¾�¥�[-¥amfcf�uyX.lS¥¡itXJgvieacnÈq.}tgoz�itamz�[v¾ÂikX.acu w l;[�un.loi1gof³¥%gVx;ufm[Vg w itl\utgvikacu § x;amns��}t[�uyd.fcitu�ªBµ¯nE`b[�z�ikamlon ( ªÓ�b¾s¥�[(utX.lS¥ÇitXJgvi�goq.qs}tlV{bamZ\gvikacn.��ikXs[^¥Xslrfm[w amu�ik}tac¢.dsitamlrn'amu�goz�itdJgofcfcx�n.lvi°n.[�z�[�uyukgo}�x>gon w ¥£[ w [�}yac�r[�gofcit[�}ynJgvika³�r[(z�}yacik[�}tamg-goq.qs}tlV{bamZ\gvikacn.��´£µ�¬d.utacn.�ÄikX.[\ J}tu�i¦lr} w [�}eqJgo}�ika³ikamlon § d.n.z�ikaclrn+goq.q.}ylV{sacZ-gjikamlonʶ�� ( ¸�ªÁÌ#{bq8[�}tacZ\[�n®ikgof%}y[�utdsfciku�z�lrns .}tZikX.[^utdsq8[�}tamlo}taci¯x-l § ikX.acu�Z\[�ikX.l w ª±�u�}y[��=gv} w u�ikXs[ n.lvi�gvitamlrn˾b¥£[(z�lrnsuta w [�}�g�Z�l w [�f �"%�goZ�lrn.� � Xsa w.w [�nÄ��go}t�vlL�'Z�l w [�fmu(¶�& :

L �U?U?U? � �^¸�gou w [� Jn.[ w ¢=xƶ·�=¸%gvn w ¶«�r¸£¥acitX�qJgo}kgvZ\[�ik[�}yu ��% : ��� % � 8 % � ª

� ��� � (�()*�+ ,.-�/0�214-&!�� 1(')��� -���� # %)-�# 1 *�-�� *�13-&+ !±¨Z�[Vgon' J[�f w fcam�o[ goq.qs}tlV{bamZ\gvikaclrn�l § g ) am¢s¢.u w amu�ik}tac¢.dsitamlrn'zVgon�¢8[ w [� .n.[ w gou § lrfcfmlS¥u�ª ) ac�o[�nÄgz�lrns .�rd.}kgjikamlon" ¾@uy[�i°itX.[en.[�am�rX®¢Mlr}tu1ikl�" ' % � '�gon w }t[�q.fhgoz�[�ikXs[�Z\go}t�racnJgof w acuyit}tam¢sdsikaclrn % * � " � 8 % �¢®x

%��" � " � 8 % � : "� # ) % * � &(� � " ' % � ' ��8 % ��? ¶º�L�r¸

µÝiz�lr}y}t[�uyq8lon w uikl�gon'lr¢.ut[�}y�o[ w fcam�v[�fmacX.l;l w l § itX.[ § lr}tZ

%��" �)� � ��% � : �"� ��� � "$� � % � %��" � " � 8 % �

: "�$# ) � , /

� � ���� ��&(� � � % ��% * �'&(��� " '&% �(' ��8 % �: "�$# ) % * ���� ��" '&% �(' � � % ��? ¶º�S¼=¸

¿Æ[%z�lrn.uta w [�} %��" �)� � ��% � gvu~g°zVgon w a w gjik[ § lo}Âgon¦goqsq.}tlV{bamZ\gvikaclrn(l § ikX.[%acn=ik}kgvz�i�gv¢.fm[ % * �)� ����% �amn=�rlrf³�r[ w acn�[�{bq.}y[�utuyamlrnƶº�r�L¸�l § ´£µ�¬�ªJW�Xs[ � [�{bam¢samfma³i¯x�l § lrd.}�q.}ylrq8loutacitamlrn\amu£itX.[�n�acnpikX.[ z�X.loamz�[ l §ikX.[��vgofmds[�u�" ª¦± nJgvikds}kgof~z�gon w a w gvik[e¥�lrd.f w ¢M[¦lrn.[�ikX.gvi^fm[�g w u ikl'g�}t[VgvutlrnJgv¢.fm[¦goqsq.}tlV{bamZ\gvikaclrnl § % * ��� � " � ��% � ª¡µ¯nêlrd.}�Z\l w [�f«¾ % * � " � 8 % � gon w % * � " � � � ��% � go}y[Æn.lviEgV�vgoacfhgo¢.fc[E¥X.acfm[� ��� � "$� � % � amu�ª / n.lS¥amns� � ��� � "$� � % � ¾�a³ipacup[�n.lod.�rXÊiklÎgoq.qs}tlV{bamZ\gvik[�lrn.[>l § ikXs[>d.n.�®n.lS¥n­;d.gon=ikacitam[�u�¾Ë[�acikXs[�} % * � " � 8 % � lr} % * � " � � � ��% � ¾Ëikl w [�}ta³�r[�gonÁgoqsq.}tlV{bamZ\gvikaclrnÄl § itX.[�loikXs[�}^gon wl § itX.[��ylramn=i w amu�ik}yam¢.dsitamlrn@ª�W�X.[�}y[ § lr}y[o¾#lod.}^ut[�fc[�z�ikamlonÆl § " z�gonÀ¢M[ w }ta³�r[�nÆ¢=x>ikX.[�­®dJgofma³i¯xÄl § ikX.[z�lr}y}t[�uyq8lon w amns� gvq.q.}tlV{bamZ\gvitamlrnel § % * � " � 8 % � lr} % * � " ��� � � % � ª�±�uB}t[��=go} w uBitX.[ / d.fmfc¢Jgoz��r¤ � [�ac¢.fm[�}w ac�o[�}t�o[�n.z�[o¾sitX.[ goq.qs}tlV{bamZ\gvikaclrn.uGzVgon.nsloi%¢M[°¢MloikXploqsikacZ-gofMgon w ukgvitamu § x\itX.[ ´%gVxr[�u�}td.fc[oªÂµÝi%ut[�[�Z\u

-/.�Û0-/1

Page 18: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ � (

Z�lr}t[ }t[VgvutlrnJgv¢.fm[(ikl-¢.gout[elod.}°z�X.lracz�[ lrnEikXs[ez�lrn w acitamlrnJgvf� .[�f wEw amu�ik}tac¢.dsitamlrn'}kgvitX.[�}1ikXJgvnÄlrnÄikXs[Z\go}t�racnJgofG J[�f wÏw acuyit}tam¢sdsikaclrn˪ɵÝi�XJgou¦ikX.['g w �ogvn®ikgo�r['l § i�go�®amns�QitX.[�lr¢.ut[�}y�vgvitamlrn.u w ac}t[�z�ikf³xÉamn=itlgoz�z�lrd.n=i�ª'��lr}t[�lS�r[�}�¾#ikXs[-uyitd w xQl § ikX.[\zVgouy[-l § ikX.[�X.lrZ�lr�r[�n.[�lrdsu acutloit}tlrq.acz�|�loiyiku(Z\l w [�fB�ra³�r[�u}t[�goutlon.u w amutd.g w amns� § }ylrZ dsutamns�(itX.[Z\[�gon� J[�f w goqsq.}tlV{bamZ\gvikaclrn�lrn�ikXs[�Z\go}t�oamnJgof® J[�f w ¶6ut[�[�±�}tz�X.[�}gon w W�aciyik[�}tamns�oiklrn'�v�r�r��gon w ¬£[�fc[�db{8¾T�Jlr}y¢8[�u�¾Tgon w |�[�x;}kgo} w �o�o�=�r¸�ª�Jlr}�z�lrZ�q.dsitamn.��´£µ�¬�¾Ta³i%ikX.[�nE}y[�Z\goamn.u%itX.[^q.}tlo¢.fm[�Z l § z�lrZ�q.dsitamn.�eitX.[ Z\gj{bamZ�d.Z¡fcam�v[�fmacX.l;l w

[�u�ikacZ-gvitlr} � ��% ª � [�i����%1¢M[ gvn�gvq.q.}tlV{bamZ\gvitamlrnpl § � ��% ª~±�nEgoqsq.}tlV{bamZ\gvikaclrn § lr}´�µ�¬ amu%itX.[�n@¾�"!$# �" �����% � : < �� � %��" �)� �����% � � � % ��� � ��? ¶��S»=¸

±�u�}t[��=go} w u�ikXs[e­®dJgofma³i¯x�l § uyd.z�XÁgon>goqsq.}tlV{bamZ\gvikaclrn˾Ja³i�acu�n.lvi°z�fc[Vgo}¥X.[�ikX.[�} " gon w �� %�Zed.u�i°¢M[z�X.lruy[�nÁamn w [�qM[�n w [�n=ikf³xElr}1n.loi�ª°±�u°gonÄ[�{sgoZ�q.fc[o¾TikX.[�|~uy[�d w lj¤ � am�v[�fmacX.l;l w µ¯n § lr}yZ-gvitamlrnE¬£}ta³ik[�}tamlon¶·| � µ�¬�¸Âl § `;i�gvn § lr} w ¶º�S»r»r»=¸?amuBg°qJgo}�ikacz�d.fmgo}ÂzVgvut[l § �"!$# �" �����% � ª#µ¯n w [�[ w ¾ba § ikX.[�d.nsutd.qM[�}��bacut[ w µ�¬��gofc�rlr}ta³ikX.Z amu£dsut[ w itle�r[�i�gonp[�u�ikacZ-gvit[ � %����% gon w ge}t[�u�iklr}tgvikaclrn " %����% gvn w ikX.[�n���%�gon w " uy[�i%itlikXs[�ut[^�vgofmds[�u�¾.goq.q.}ylS{bacZ-gvitamlrn>¶��S»=¸£¢M[�z�lrZ�[�u

�"!$# "� ���� �(� %����% � : < ���� � %�� ��� �)� � � %����% � � � � % ��� � �: ��� !$# ���"% � ? ¶«�o�=¸

µ¯n ikX.acu)zVgouy[��� %?gvn w " ¥�[�}y[�z�lrZ\qsdsik[ w dsutamns��g%uyamn.�ofm[~acit[�}tgvika³�r[Âq.}ylbz�[ w ds}t[�¶6µ�¬��ĸ@¥X.acz�X(gofcit[�}tn.gvik[�u¢M[�i¯¥�[�[�nÎ[�u�ikacZ-gvitamn.� ��%�gon w [�uyitamZ\gvikacn.� " utlÄitXJgvi ikX.[p Jn.gof£[�uyikacZ-gjik[�u zVgon+¢M[ w [ w d.z�[ wɧ }tlrZlrn.[Egon.loitX.[�}�ªÇµ¯n itX.amu\qJgoqM[�}�¾%¥£[Äqs}tlrqMlrut['iklÈdsut[ § lr}����%-itX.[Elrdbikq.dsi-l § ikXs[ÄÌG� gofm�olr}ta³ikX.Z�¤¢Jgouy[ w qs}tl;z�[ w d.}t[�u w [�uyz�}yam¢M[ w amnE¬£[�fc[�db{8¾@�Tlo}t¢M[�u�¾8gon w |�[�x;}tgo} w ¶·�o�r�=�r¸�gon w }t[ § [�}t}y[ w itlpgou � � ��� �� " �����'� ��� � �������� � ��acnÊ¥XJgvi § lrfmfclL¥u�ª � ac�o[Áµ�¬��ƾ�ikXs[Àgofc�rlr}yacikXsZ\u-gofcit[�}tn.gvika³�r[�f³x q.}yl w d.z�[Ægz�lons J�rd.}tgvikaclrn " gon w d.uyamn.�϶��V¼=¸�gonÉ[�uyikacZ-gjikamlon ���%VªÆ¿Æ[pikXs[�n § lrd.n w nJgjikd.}tgof£ikl>uy[�i " ikl>ikXs[lrn.[�ued.uy[ w amnÆlrd.}eq.}ylbz�[ w ds}t[�u�¾Bz�lr}y}t[�uyq8lon w amns�Ä[�a³ikX.[�} iklÄgon+goq.q.}ylV{sacZ-gjikamlonÆl § itX.[pz�lrn w a³ikamlonJgofZ�[Vgon˾BikXs[�z�lrn w a³ikamlonJgof%Z�l w [�lr}�iklÆgQuyamZed.fmgvik[ w }t[Vgvfmam¹�gvikaclrnÈl § ikX.[�z�lrn w a³ikamlonJgof w acuyit}tam¢sdsikaclrn˪´%gouy[ w lrnQitX.[�uyikd w xQamnƬ£[�fc[�db{8¾Â�Jlr}y¢8[�u�¾�gon w |�[�xb}tgo} w ¶«�o�r�r�r¸�¾)¥�[\z�X.lout[-uyamZedsfhgvit[ w " itX.}tlrds�rXikXs[ ������ � ��� � " � �� "Egvfm�rlr}yacitX.Z ¥X.acz�X utX.lS¥�[ w �rl;l w qM[�} § lo}tZ\gon.z�[�gou\}t[��rgo} w u\X.a wsw [�n ��go}t�vlL�}kgvn w lrZ  .[�f w u�qJgo}kgvZ\[�ik[�}�[�uyitamZ\gvikaclrn�gon w lrdsitq8[�} § lr}yZ\[ w µ�¬�� amnpitX.amu�ikgout�pacn�Z\lru�i�zVgvut[�u�ª| � µ�¬ÊutXslL¥u£q.}tlrZ�amuyamn.� }t[�utd.f³iku�¥Xs[�n�d.ut[ w ikleuy[�fc[�z�i£ikX.[°n®d.Z�¢8[�}£l § z�lrZ\qMlrn.[�n=iku%acn-ik[�uyiku£lrn

uyx;n=ikXs[�ikaczpgon w }t[�gofBamZ\go�r[�u(}y[�qMlr}yit[ w amnÀ`;i�gon § lr} w ¶��S»r»o»=¸�ªpµ¯nÈ`b[�z�ikaclrn *s¾�¥�[-}t[�q8lo}yi�g w.w a³ikamlonJgof}t[�utd.f³iku § lr}�" gvn w �� %%ut[�i�itl��ogvfmd.[�u%q.}tlS�;a w [ w ¢=x-ikXs[ µ�¬�� gofc�rlr}yacikXsZ ¶·| � µ�¬�¸�ª.W�X.[^}y[�utdsfciku%¥Xs[�n" gon w����%^gv}t[elr¢bi�goacn.[ w �;amg-Z\[�gonE J[�f w ¤Ýfmac�o[egvfm�rlr}yacitX.Z\u1go}y[�n.lvi }t[�q8lr}�ik[ w ¢.dsi z�gon>¢8[ § lrd.n w acn|�[�x;}kgo} w ¶·�o�r�s�L¸$ªÂW�X.[�x�¥£[�}t[^ukgvitamu § xbacn.� § lr}�}y[Vgof w gvi�ge¢.dbi�uyd.}tqs}tamuyamn.�ofcx\d.n.uyikgo¢.fc[o¾Jgou�}y[��=gv} w u�ikXs[n®d.Ze¢M[�}l § z�lrZ�qMlrn.[�n=itu�¾Jlrn�utacZed.fmgvik[ w'w gvi�g'¶6uyamZedsfhgvit[ w |�lvitikuZ�l w [�fmu%gouamn�`b[�z�ikaclrn *sªc�S¸�ª

Û�Û Ö PRQ�SUTUV

Page 19: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�'* ������������� ���������� ��������������������� ��!���!"

µ¯npitX.amu� J}tu�i1goq.q.}yl=goz�X˾;ikX.[ d.uy[ l § ikX.[�utamZ�d.fhgvit[ w  .[�f w gofm�rlo}tacitX.Z § lr} ���%gvq.q8[�go}tu£}t[VgvutlrnJgv¢.fm[gon w ¥�[�¥acfmfJ�v[�[�qpitX.amuB[�uyikacZ-gjikamlon�qs}tl;z�[ w d.}t[�amn\itX.[1n.[�{;i%uy[�z�ikamlon˪~±�uG}t[��=go} w u�ikXs[�­®dJgofcaci¯x¦l § ikX.[goq.q.}ylS{bacZ-gvitamlrn'l §�% * ��� � ��% � ¢®x %��" ��� � ��% � ¾8aci�amu�nsloi°[�gouyx'ikl�gvutut[�utu ¢.dbi°amn�¥XJgvi § lofmfmlS¥u¥£[¥amfmf8q.}tloq8lruy[(g¦Z�lr}y[ ukgvitamu § x;acn.�¦gofcit[�}ynJgvika³�r[vª

� �! � (�()*�+ ,.-�/0�214-&!�� 1(')��(��*313- 13-&+ ! %+*�!)5 13-&+ !µ¯n�itX.amuBut[�z�itamlrn˾=itX.[a w [�g(acuÂikl(d.ut[�gon�[�{bq.}t[�utuyamlrn § lr}B´£µ�¬ÎitXJgviGamn=�rlofc�r[�u�lon.fcx�qJgo}yitacitamlrn § d.nsz�ikaclrn.uutl�itXJgvi�ikX.[Gq.}tlo¢.fm[�Z l § goq.q.}ylV{sacZ-gjikamns�itX.[£�Ego}t�vlS� w acuyit}tam¢sdsikaclrn.u�zVgon�¢8[G}t[�q.fhgoz�[ w ¢=x^ikX.gvi#l § goqb¤q.}tlV{bamZ\gvikacn.� ikX.[�qJgo}yitacitamlrn § d.n.z�ikaclrn.u�ª~W�Xs[ g w �vgon=i�gv�r[�acuGitXJgvi£itX.[�q.go}yitacikaclrn § d.n.z�itamlrn� J}tu�i�lr} w [�}goq.q.}ylS{bacZ-gvitamlrnsu£q.}y[�ut[�n=ik[ w amn�`b[�z�ikaclrn�].ª �ez�gon�¢M[^d.ut[ w gon w }y[�uyd.fcitu1acn�¢8[�itik[�}1goq.q.}ylS{bacZ-gvitamlrnsu�ª

� [�i ��� � � � gon w � 8 � ¢M[1itX.[�q.go}yitacikaclrn § d.n.z�ikamlon.u § lr}~itX.[�z�lrn w a³ikamlonJgofTgon w Z-gv}t�racnJgof. J[�f w u}t[�uyq8[�z�itac�r[�fcxo¾

� 8 � : �"����� ����� � " � 8 � �

��� � � � : �"����� ����� � " � � � � � � ?

Ã�utacn.�¦n.loikgvikaclrn�l § `b[�z�ikamlonE�;¾Jaci�z�lrZ\[�u § }tlrZ

% * �)� � � � : % * �)� � " ��� �% * � " ��� � � �: � ��� � "$� � ��% * � " � 8 �% * � " ��� � � �

ikXJgvi

% * ��� ��� � : � �)� � "$� � � �)��� ����� � " � 8 � ������ ����� � " � � � � � �

��� � � � � 8 � �

¥X.amz�X'd.utacn.��¶·»=¸£uyamZ�q.fma³ J[�u£amn=ikl

% * ��� ��� � : �)� � � � � 8 � ? ¶·�b�L¸

W�X.[�}y[ § lr}y[>[�{bq.}t[�utuyamlrn¨¶��o�L¸\l § ´£µ�¬�amu-[�­®d.ac�vgofc[�n=ipitlÀikX.[ § lofmfmlS¥acn.�Ælon.[Ä¥X.amz�XÊdsut[�u�lrnsfcx+ikX.[qJgo}yitacitamlrn § dsn.z�itamlrn.u ��� � � � gvn w6 � 8 � ¾

� !$# ���"% � : < ��� ��� � ����% � � < ��� � 8 ���% � � � % ��� � ��? ¶·�r�r¸

� [�i � ��� � " � 8 � gon w � ��� � " � � � � �pw [�n.loit[QitX.[ÆZ�[Vgvn  .[�f w [�{bq.}y[�uyutamlon.u § lr}�itX.[ÆZ\go}y�ramnJgvf°gon wz�lrn w acikaclrnJgof. .[�f w [�n.[�}t�rac[�u�ªBÃ1utacn.��ikXs[� J}yuyi%lo} w [�}�goq.q.}ylV{sacZ-gjikamlon.u § lr}GitX.[°qJgv}yika³ikaclrn § d.n.z�itamlrnsu�¾.g

-/.�Û0-/1

Page 20: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �L�

n.[�¥²goq.qs}tlV{bamZ\gvikaclrn�l § ´£µ�¬ acu�Í

�"!$# *-,/. �����% � : < ��� ��� ��� � �� % � � < ��� ��� � � � � � � � ���% � � � ��� � ��� � � ���% � � � �� < ���� ��� � �8 % � � < ��� ��� � � � ��� �8 % � � � ��� � � � �8 % ���� � % ���� � � ? ¶«�o�=¸

±�u?¢M[ § lr}y[o¾��� %�Z�d.uyi?¢M[�[�uyikacZ-gjik[ w gon w ¥�[�dsut[ w Z\[�gon^ J[�f w ¤¯fcam�o[Âgofm�rlo}tacitX.Z�u)gon w Z\lo}t[~utqM[�z�ac Jz�gofmf³xr¾ikXs[ utamZ�d.fhgvit[ w  .[�f w gvfm�rlr}yacitX.Z ¶«¬£[�fm[�d;{@¾.�Tlo}t¢M[�u�¾.gon w |�[�x;}kgo} w �o�o�=�r¸�ª#W�X.[ Z-gv}t�racnJgofMgon w z�lon w a³¤ikaclrnJgofTZ�[Vgon� J[�f w goq.qs}tlV{bamZ\gvikaclrn.u~¥£[�}t[�itX.[�n�z�lrZ�q.dsik[ w ¾sdsutamns� ikXsamu��vgofcd.[1l § ikX.[�qJgo}tgoZ\[�ik[�}�¾;¢®xutlofc�;amn.�eitX.[^z�lr}y}t[�utqMlrn w acn.�� b{s[ w qMlracn®i[�­®dJgvikaclrn.u ¶��V�=¸�ªW�X.[�[${bq.}t[�ututaclrn�l § � !$# *-,/. ¶«�o�=¸Âacu�Z�lr}t[1ukgjikamu § x;amn.�^ikXJgvnpgoq.qs}tlV{bamZ\gvikaclrn �"!$# �" ¶��V»=¸�ª�±ê¥£gSx

ikl¦uy[�[^ikX.[^amZ�q.}ylL�o[�Z�[�n=iamu%itl¦}t[�¥}yacit[ %��" ��� ����% � amnQ¶º�S¼=¸£d.uyamn.�¦qJgo}�ika³ikamlon § d.n.z�itamlrnsugouamnƶ«�b�S¸�¾

%��" ��� � ��% � : �" �)� � ��% � �" � 8 % � ?

Ì#{bq.}t[�ututaclrn.u § lr}%¢MloikX�­®dJgon=itacikac[�u�acnpikX.[ }tgvikacl¦go}t[ [�goutacfcx w [ w dsz�[ w'§ }tlrZ ¶��S�r¸%gon w ¶ *r¸�ª~W�X.[^}kgjikaml¶«�;�L¸Gacu£ikX®d.u�¢M[�iyik[�}gvq.q.}tlV{bamZ\gvit[ w acn �"!$# *-,-. ikXJgon�acn �"!$# �" utacn.z�[^gvu%[�{bq.fmgoamn.[ w amn�`;[�z�itamlrn�]sª �b¾aci¦dsut[�u¦ikXs[�¢M[�u�i\fclS¥£[�}\¢Mlrd.n w ¶���*=¸ § lr}¦[Vgoz�XÏqJgo}�ikacitamlrn § d.n.z�itamlrn@ªÏW�X.[�}t[ § lr}t[v¾�ikXs[�}t[�go}y['uylrZ�[ikXs[�lr}y[�ikaczVgof�gvn w [${sqM[�}yamZ�[�n=i�gvf)}t[Vgvutlrn.u1ikl�¢8[�fmac[��r[^ikX.gvi1lrd.} �"!$# *-,-. amu1g¦¢8[�itit[�}�goq.q.}ylS{bacZ-gvitamlrnl § ikX.[�ik}yd.[���� � ikXJgonÏ| � µ�¬�ª � !$# *-,-. amu¦¢Jgouy[ w lrn gÁ¢M[�itit[�}\goq.q.}ylV{sacZ-gjikamlonÉl § % * ��� � ��% �gon w ikX.['q.}ylbz�[ w d.}y[Ea³i\dsut[�u\iklQz�lrZ�q.dsit[ ���%\XJgou�utX.lS¥n itlÀ¢M[Egou�}t[�fmamgo¢.fm[�a § n.lvi-¢M[�iyik[�}¦ikX.gonµ�¬�� amn'q.}tgoz�itamz�[p¶«¬£[�fm[�d;{@¾@�Jlr}t¢M[�u�¾@gon w |�[�xb}tgo} w �v�r�=�r¸$ª � lS¥£[��r[�}�¾)n.loit[(itXJgvi°gou�}y[��=go} w u�Z�l w [�fut[�fm[�z�ikaclrn˾ËitX.amu w l;[�u^n.lvi ns[�z�[�ututgo}tacfcx>[�n.utd.}y[�itXJgvi itX.[¦}t[�uyd.fcitamn.��z�}ta³ik[�}yamlrnÄ¥�lrd.f w fc[Vg w itl�¢M[�iyik[�}}t[�utd.f³iku1gof³ikX.lrds�rXpikX.[^[${sqM[�}yamZ�[�n=iku}y[�qMlr}yit[ w amn�`b[�z�ikaclrn *¦it[�n w ikl¦z�lons J}tZ¡ikX.acu�ª

� � 0-/>�%�#��2 ����?�

µ¯nÊikX.acu�ut[�z�ikaclrn˾1ikX.[>�=gvamnÊamn gvq.q.}tlV{bamZ\gvitamn.�QikX.[ÁqJgo}�ika³ikamlon § d.n.z�ikaclrn.uQ¶2� !$# *-,-. ¤Ýfmac�o[Äz�}tacit[�}yahg=¸}kgjikX.[�}itXJgon�ikXs[^¥Xslrfm[(�Egv}t�olS� w acuyit}tam¢sdsikaclrnQ¶·| � µ�¬G¤¯fcam�o[ z�}ta³ik[�}yahg=¸Gamu�amn=�o[�uyitam�=gjik[ w ªB¿Æ[^[�{sgoZ�amn.[ikXs[ÆqM[�} § lr}tZ\gon.z�[>l § itX.[>i¯¥£l goq.q.}yl=goz�X.[�uÄgou�}t[��=go} w u�ikX.[Qq.}tlo¢.fm[�Z l § z�X.lbloutamns�ÎitX.[Æn®d.Z�¢8[�}l § z�fmgoutuy[�u¦amnÈitX.[�ut[��rZ�[�n=i�gvitamlrn@ªÆ¿Æ[�}t[�qMlr}�i¦[�{bq8[�}tacZ\[�n®itu�lrnÉikX.}y[�[pi¯x;qM[�u�l § amZ\go�r[�u�ªÀ�Jlr}egofmf[�{sgoZ�q.fc[�u�¾.itX.[(lr¢.ut[�}y�o[ w acZ-go�o[�u�go}y[^z�lrn.uya w [�}t[ w gou}t[�gofmac¹Vgvitamlrnsu%l § itX.[^utacZ\q.fc[ § lrfmfclS¥amn.�eXsa w.w [�n�Ego}y�olS� Z�l w [�f«ª W�X.[ w amu�ik}tac¢.dsitamlrn l § itX.[>X.a wsw [�n  J[�f w amupuyd.q.qMlrut[ w ikl+¢M[Qg � ¤Ýz�lrfclr}p|?loitituZ�l w [�fM¥Xs[�}t[ [�goz�X�&(�Ëi�gv�o[�u�lon.[°l § � uyikgvik[�u�¾s¥Xsamz�X�}t[�q.}t[�ut[�n®i ��w a65@[�}t[�n=i�z�fhgouyu%gouyutac�rn.Z�[�n=iku%lo}z�lofmlr}yu�ª~�[�z�gofmfTikXJgji�[Vgoz�X�l § itX.[°u�i�gvit[�u�amu£}t[�qs}t[�uy[�n=ik[ w ¢=xpg�¢.amn.go}yx��r[�z�iklo}�l § fm[�n.�oikX � ¥a³ikX�lrns[

Û�Û Ö PRQ�SUTUV

Page 21: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�S¼ ������������� ���������� ��������������������� ��!���!"

z�lrZ�q8lon.[�n=i�¢M[�acn.���r¾.gvfmfMloikX.[�}tu�¢M[�acn.�¦�sª~W�X.[ w acuyit}tam¢sdsikaclrnpl § g � ¤¯z�lrfmlo}%|�lvitiku�Z�l w [�fMamu w [� Jn.[ w¢®xo¾

% * � " � 8 � : � 8 � ���)��� � 8!����*0&��� &10 � � ¶·�v]®¸

¥X.[�}y[ 8 acu g'}t[�gofBn.lrnb¤Ýn.[��=gjikac�o[¦qJgo}kgvZ\[�ik[�} gon w ikX.[�n.loikgvikaclrn � � 2 }y[�q.}y[�uy[�n=iku�gvfmf~z�lod.q.fm[�u l §utacit[�u � � � 2 � ¥X.amz�X�go}y[ n.[�ac�rX®¢8lr}yu�ª�Jlr}~itX.[ � � � uB¥£[�z�lrn.uya w [�}t[ w )^god.utuyahgon w acuyit}tam¢sdsikaclrn.u�ª�µ § uyacik[ � amu~acn\z�fhgouyu��M¾ � �@acu~ikX.[%)^god.utuyahgon

w amu�ik}tac¢.dsitamlrnQ¥acikXÉZ�[Vgvn�� + gon w u�i�gon w go} w+w [��;ahgvitamlrn� + ªÆW�X.[�q.go}kgoZ�[�it[�}�itl>¢8[�[�uyitamZ\gvik[ w amuikX.[�n � 8�� � � ¥acitX$� : � �� + � � + � � � : L��U?U?U? � � � ª � [�i'� � ¢8[¦ikXs[\Z�l w [�f w [� Jn.[ w go¢8lS�o[\¥X.[�nikX.[^n®d.Ze¢M[�}l § z�lrfclr}tu�acu � ªGW?l\goutuy[�utu1acitu1go¢.amfcaci¯x¦ikl�ut[�fm[�z�i�g�}t[�fc[��vgon=i1n®d.Ze¢M[�} � ¾.ikX.[^z�}tacit[�}yamlrnamu�z�loZ\q.dbik[ w+§ lr}�Z�l w [�f � � ¥a³ikX � : � � � � ikl � : � ���� ª+W�X.[�}t[�­®d.am}y[ w [�uyitamZ\gvikaclrn.uel §�� � § lr}e[Vgvz�X+�vgofcd.[-l § � z�lon.uta w [�}y[ w ¥�[�}t[�lr¢bi�goacn.[ w ¥a³ikXÀitX.[�utacZed.fhgjik[ w  J[�f w gofm�rlo}tacitX.Z gon w�"!$# *-,-. � �� � � ¥%gvupz�lrZ�q.dsit[ w gvu w [� Jn.[ w acn²¶·�o�=¸�ªÊ¿Æ[ÄgofcutlÆ}t[�qMlr}�i\�vgofcd.[�u\l § ´£µ�¬ ¥X.[�n ikX.[amZ\go�r[�u%go}t[ uy[�[�nEgou}t[�gofmac¹Vgvitamlrn.u�l § amn w [�q8[�n w [�n®i1Z�a³{;ikds}t[ Z�l w [�fmu%acn�lr} w [�}%ikl¦Z�[Vgouyd.}t[ ikXs[(�rgoamnl § ikgo�®amn.��utqJgvitahgof~acn § lr}yZ-gvitamlrn>acn=ikl�goz�z�lrd.n=i�¥X.[�nÈut[�fm[�z�ikacn.��itX.[�n;dsZe¢8[�}�l § z�fmgoutuy[�u�ª�W�X.[-ÌG�gofm�rlo}tacitX.Z¡¥£gou�d.ut[ w ikl\[�uyitamZ\gvik[ itX.[�qJgv}kgoZ�[�it[�}tu�gon w ikX.[(z�}yacit[�}taclrnÀ¶6z�loZ\q.dbik[ w [�{sgoz�ikfcx'acn'itX.amuzVgouy[S¸�amu w [�nsloik[ w ¢=x �"!$#&% '3(£ª�¿Æ[ gofmuyl�z�lrZ�qJgo}t[ w ¥a³ikX�| � µ�¬ê¢.gout[ w lrn'ikX.[(µ�¬�� gofc�rlr}yacikXsZ gougon'gofcit[�}tn.gvika³�r[ z�}yacit[�}taclrn�gouyutd.Z�amn.��g�utq.gvikamgofËZ�l w [�f«ª¿ Xs[�npn.lvi£loitX.[�}�¥amuy[�uyq8[�z�ac .[ w ¾;ikX.[�gofm�rlo}tacitX.Z�u¶«`bacZed.fmgvik[ w  .[�f w ¾sÌG��gvn w µ�¬�� gofc�rlr}yacikXsZ\uk¸

¥£[�}t[(amn.a³ikahgvfmam¹�[ w d.utacn.��ikX.[^utgoZ\[ uy[��rZ�[�n=ikgvikaclrn�z�lrZ�q.dsit[ w ¢®xputamZ�q.fc[�ikX.}y[�uyX.lrf w amn.�.ª�¿À[ w a³�ba w [ wikX.[pqsa³{b[�fB�vgofmd.[�u�}tgon.�r[v¾~amnÆitX.[ w [��r}kg w [ w acZ-go�o[o¾#acn=iklE}y[��rdsfhgo}(amn=ik[�}y�vgofcuegon w goutuyam�rn.[ w [Vgoz�XÉl §ikX.[�Z ikl�g�z�lrZ�qMlrn.[�n=i�ªGW�Xs[ gvfm�rlr}yacitX.Z\uG¥£[�}t[ gofmf8uyitlrq.qM[ w g § ik[�} 5 : LU> > acik[�}kgvitamlrnsu�ªW�Xs[£amZ\go�r[�u�d.ut[ w�§ lr}�ikX.[�[�{bq8[�}tacZ\[�n®ituÂgo}y[ w [�utz�}tac¢8[ w ¢8[�fmlS¥^ª?µ¯n¦`b[�z�ikaclrn&*sª³�r¾L¥£[G J}tu�iÂz�lrZ\q.go}t[

ikX.[pz�}ta³ik[�}yahg'lrn § d.fcfcxÁutacZed.fmgvik[ wÈw gvikgsªÄW�X.[pZ�l w [�fcu�d.uy[ wȧ lr}(ikX.[puyamZedsfhgvitamlrn.u(go}y[-ikXs[pZ\l w [�fmud.ut[ w § lr}�itX.[Euy[��rZ�[�n=ikgvikaclrn.u�ª µ¯n `b[�z�itamlrn *bª �b¾�¥£[Äz�lrn.uya w [�}-uyx;n=ikXs[�ikaczÄamZ\go�r[�u w [��r}tg w [ w ¥acikXutlrZ�[°utacZed.fmgvik[ w )^god.utuyahgon�nslramuy[oª~W�X.[°it}td.[ � amu��®n.lS¥n�¢.dbi%ikX.[�amZ\go�r[�u£go}t[�n.loi�}y[Vgofcam¹Vgjikamlon.u�l §g¦�®n.lS¥n�q.}tlr¢.go¢.amfcamu�ikamz1Z�l w [�f«ªÂµ¯nE`b[�z�ikaclrn0*sªÓ��}y[Vgof©¤¯fma § [�acZ-gv�r[�u�gv}t[^z�lrnsuta w [�}t[ w ª

� ��� ��-&%�%)� !���� 56+�$&+�*�� +21 1 # /0+ %)� $�#¿À[� J}yuyi¦ik[�uyik[ w itX.[�z�}ta³ik[�}tahgÄlonÎacZ-gv�r[�ueuyamZedsfhgvit[ wȧ }tloZ X.a wsw [�nÏ|�loiyiku¦Z�l w [�fmu § lo}e¥X.amz�X+ikX.[ik}tds[�q.go}kgoZ�[�it[�}yu 8 gon w �p¥�[�}t[��®n.lS¥n˪�¿À[¦z�}t[Vgjik[ w L > > O L > > acZ-gv�r[�u ¢=x>uyamZed.fmgvikacn.�>¶ )^ac¢.¢.u`sgoZ�q.fmacn.�pl § )^[�Z-gonQgon w ) [�Z\gon+�S»r¼o]=¸ � � � ¤Ýz�lrfclr}^|�lvitiku(Z�l w [�fmu¦¶·�v]®¸ § lr} � : < � ?U?U?�� gon ww a 58[�}y[�n=i��vgofcd.[�u°l § 8 ¾8gon w itX.[�nÁg w.w amns�pg )^god.uyutahgvnÄn.lracut[oª�¿À[ez�Xslrut[ 8 utl\ikXJgvi�ikX.[�utamZ�d.fhgvit[ w

-/.�Û0-/1

Page 22: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �S»

¶·g=¸ ¶6¢T¸

¶OzS¸ ¶ w ¸

�#ac�rd.}t[ �rÍB`bacZed.fmgvikaclrn.uGl § g � ¤¯z�lrfmlr}£|�loiyiku�Z�l w [�f § lr} w a65@[�}t[�n=i%�vgofcd.[�u£l § � gvn w 8 Í1¶·g=¸ �;:=< ¾8K:F>@?BADC ¾�¶6¢J¸ �I:=E ¾ 8K:=>@?HG ¾�¶OzS¸ �I:1J ¾ 8K: L ¾?¶ w ¸ �I: N ¾ 8K: L ª

amZ\go�r[�u%q.}y[�ut[�n=i°X.lrZ�lr�r[�n.[�lod.u}t[��oamlrn.ugvn w uylrZ�[(uyqJgvitahgofËu�ik}yd.z�itd.}t[-¶��������G�#am�rds}t[��L¸ § lr}�acn'lvikX.[�}zVgvut[�u�¥�[ÁzVgon.nsloi�}t[�gofmf³x [${sqM[�z�i�ikX.[>z�}tacit[�}yahgÀiklÉ}y[�z�lL�o[�}�ikX.[Äit}td.[ � ª �Tlo}putZ\gofmfc[�}��ogvfmd.[�upl §8 i¯x;q.amz�gof�}y[Vgofcam¹�gvikaclrn.ufml;lr�pZedsz�X>n.lramuyam[�}�gon w go}t[(�;amutd.gofmf³x�z�fmlout[ itlpamn w [�qM[�n w [�n=ikf³x w amuyit}tac¢.dsik[ wz�lofmlr}yu�ª��Tlo}#fhgv}t�r[�}?�vgofcd.[�u�¾oikX.[�utacZed.fhgjikamlon.u�fm[Vg w ikl°z�fmlruy[�itl°Z\lon.lbz�lrfmlo}?acZ-gv�r[�u�¥XJgvit[��r[�}ÂikX.[�ik}tds[� d.ut[ wQ§ lr}°itX.[�utacZed.fmgvikaclrn.u�ª^¿Æ[�z�lrn.uya w [�}t[ w gp J}yuyi^lr} w [�} n.[�am�rX®¢Mlr}tXslbl w ¾ ��� ��� § lrd.} ns[�am�oX;¢Mlr}yu§ lr} [Vgoz�XÉq.a©{b[�f«ª'W�X.[puyamZedsfhgvit[ wÀw gvi�gEz�lr}t}y[�uyq8lrn w iklÄXsa w.w [�n � ¤¯z�lrfmlo}�|?loititueZ\l w [�fmu § lr}(¥Xsamz�X� : � �� + � � + � � � : L �U?U?U? � � ¥acitX � + : �Ïgon w � + : >@? N ¾ § lr} � : L �U?U? ? � ªÊ¿Æ[Ed.uy[ w lrds}�®n.lS¥fm[ w �r[Äl § gÆz�lrn.u�i�gon=ip�vgo}yahgonsz�[o¾ § lo}\ikXs[ � uyikgvik[�u�¾iklÆ si�gÀZ�l w [�f�gvn w }t[�z�lS�r[�}pikX.[�ik}tds[amZ\go�r[vªÀ�Jlr}�[Vgoz�XÎZ\l w [�f%z�lrnsuta w [�}t[ w ¾1�S�r�ÄutacZed.fmgvikaclrn.u ¥�[�}y[�zVgo}y}tam[ w lrdsiVªÆW�X.[�z�lr}y}t[�utqMlrn w acn.�z�}yacit[�}tamg�}t[�uyd.fcitu�gv}t[^}t[�q8lr}�ik[ w amn'W�go¢.fm[¦�rª�µÝi°gvq.q8[�go}tuikX.gvi1z�}ta³ik[�}tahg0�"!$# *-,-. gon w | � µ�¬êqM[�} § lr}tZ¥�[�fmfsgon w lrdbikqM[�} § lo}tZ �"!$#&% '3(�¥X.acz�X�uyX.lS¥u w [��o}kg w gjikamloneamneuy[�fc[�z�itamn.�°itX.[%}yam�rX=iÂn®d.Z�¢8[�}Âl § z�lrfclr}tu¥X.[�n � amu�fmgo}t�r[�}£ikX.gon�].ª~W�X.amu�z�lrns J}yZ\u%itX.[^g w �vgon=ikgo�r[ l § d.utacn.��utq.gvikamgofËZ�l w [�fmu�[��r[�n�itX.}tlrds�rXgoq.qs}tlV{bamZ\gvikaclrn.u^¢.dsi w lb[�u�n.lvie[�n.go¢.fm[�ikl w a 58[�}y[�n=ikamgvik[ �"!$# *-,-. § }tlrZ | � µ�¬�ª~��lo}t[ w a 58[�}t[�n.z�[�ugoq.qM[Vgv}�amn�ikX.[^n.[${;i�i¯¥�l\uy[�z�ikamlon.u�ª

Û�Û Ö PRQ�SUTUV

Page 23: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�o� ������������� ���������� ��������������������� ��!���!"

�I: < ¾ 8�:F>R?BA Cuy[�fm[�z�it[ w � ��"!$#&% '3( �V�r���� !$# �V�r�

�"!$# *-,-. �V�r�

� :=E ¾ 8�:F>@?HGut[�fm[�z�ik[ w � ��"!$#&%$')( �S�o���� !$# �S�o�

�"!$# *-,-. �S�o�

�I:FJ ¾ 8K: Luy[�fm[�z�it[ w�� � ] (�"!$#&% '3( �r¼ *=� ���� !$# � �S�o� �

� !$# *-,-. � »r» �

�;:=N ¾ 8 :MLut[�fm[�z�ik[ w � ] ( *

�"!$# %$')( �o» �b� �� � !$# � �S�r� �

�"!$# *-,-. � »=� ¼

�;: � ¾ 8 : L ?6Lut[�fm[�z�ik[ w � ] ( * �� !$# % '3( �V� ¼r� � ���� !$# � � »r¼ �

�"!$# *-,-. � � »r» �

W#go¢sfm[Ä�rÍ ��[��r}tg w [ w � ¤Ýz�lrfclr}e|?loititu¦Z\l w [�f·Íp`;[�fm[�z�it[ w � dsutamns�Á´£µ�¬ § lr}�amn w [�q8[�n w [�n®i�Z�a³{;ikds}t[Z\l w [�fcu¦¶2� !$# % '3( ¸�¾�q.uy[�d w lv¤¯fcam�o[�fmacX.lbl w ¶6| � µ�¬�¸ gon w Z�[VgvnÁ .[�f w ¤¯fmac�o[�¶ �"!$# *-,-. ¸°goq.q.}ylV{sacZ-gjikamlon.ul § ´�µ�¬�ª1W�Xs[Æ}y[�qMlr}yit[ w �ogvfmd.[�u�gv}t[>ikX.[Qn®d.Ze¢M[�}�l § ikacZ\[�u�gÉ�ra³�r[�n � acu�ut[�fm[�z�ik[ w lrdsi'l § �S�r�[�{bq8[�}tacZ\[�n®itu�ª

� �! � +�-�#3� � 56+�*4* *)()13� % #�� ! 1 ')�613-�5 -�/0� ��� #µ¯nÎitX.amu¦ut[�z�itamlrn˾G¥£['z�lon.uta w [�}�n.lracut[�¤Ýz�lr}y}td.qbik[ w amZ\go�r[�u�z�lr}y}t[�utqMlrn w acn.�QitlÁ�;nslL¥nÏ�ogvfmd.[�u�l §� ªµ¯Z-go�o[-¶O¢T¸�l § �#ac�rd.}y[���amu1g L < C0O�L < C amZ\go�r[ lr¢sikgoamns[ w ¢®x�g wsw amn.��utloZ\[�)^god.utuyahgon'n.lracut[^ikl¦ikX.[J ¤¯z�lrfmlr}~acZ-gv�r[(¶·g=¸Âl § �#am�rds}t[��bªÂW�X.[1n.lracut[1qJgo}tgoZ\[�ik[�}tu�go}t[1�rac�o[�n\¢®x � : � �� + � � + �7� � : L �U?U? ? ��J �¥acikX � + : �egon w � + :=>R?BN�§ lr} � :ML �U?U?U? ��J ª�W�X.[�loitX.[�}~[${.gvZ\q.fc[ ¶6�#am�rds}t[%�r¸�amu~g LUE E"O LUJ < n.lramuy[�¤z�lr}y}td.qsit[ w �S¤¯z�lofmlr}BamZ\go�r[vª?¿Æ[�dsut[ w )^god.uyutamgon w [�n.uta³ikac[�u�¥a³ikX\z�fhgvutu�¤ w [�qM[�n w [�n=i%�vgo}yahgon.z�[�uGutl�itXJgviikX.[�ik}yd.[¦n.lracut[�qJgo}tgoZ�[�ik[�}tu^go}y[ � � � � � � � : � NRL �ULUE >�� gon w �� ! � � ! � : � < N N � E > >�� ª�W�X.[�uy[\acZ-go�o[�u¢8[ § lr}t[ w [��r}kg w gvikaclrn>go}y[�n.loi }y[Vgofcam¹�gvikaclrn.u § }ylrZ�g��®n.lS¥nÀ�Ego}y�olS�Ä J[�f w Z\l w [�f«ª(�Jlr}°[�u�ikacZ-gvitamlrn@¾¥£[-goutuyd.Z\[ w g�Z�l w [�fÂ¥a³ikXÀuy[�z�lrn w lr} w [�} n.[�ac�rX®¢8lo}tX.l;l w ¶ ��� ���pikXs[-[�ac�rX=i�z�fmlruy[�u�i�n.[�am�rX®¢Mlr}tu § lr}[Vgoz�XÉq.a©{b[�f ¸$ªÄW�X.[�uy[�fm[�z�it[ w � go}t[-}t[�qMlr}�ik[ w acnÀW�go¢.fc[��bªÄµ¯nÈitX.[�uy[�[�{bq8[�}tacZ\[�n®itu�¾ �"!$# *-,-. gon w| � µ�¬Ê¢8[�XJgV�r[ w a65@[�}t[�n®itfcxoª#¿À[ lo¢.ut[�}y�r[°itXJgvi � !$# *-,-. acu£¢M[�itit[�}%acnput[�fm[�z�ikacn.�eikXs[°}tac�rX=i%n®d.Ze¢M[�}%l §z�lrfclr}tu § lr}GamZ\go�r[�uBq.}y[�uy[�n=ikacn.�eikX.acn § [�gvikd.}y[�u°¶��������B�#am�rds}t[��=¸~¥Xsamfm[ikXs[�x\¢8loitX-qM[�} § lr}tZ�¥�[�fmfT¥X.[�namZ\go�r[�ugv}t[�Z\g w [^l § fhgo}y�r[�}�}y[��raclrn.u�¶���������#am�rds}t[ �r¸�ª�± wsw acitamlrnJgvfË[�{bqM[�}tacZ\[�n=iku�¥�[�}y[�z�go}t}yam[ w lrdsi¥acikX�loitX.[�}acZ-go�o[�u%z�lrn=i�goacn.amn.�eitX.amn�fcamn.[�u�gon w utX.lS¥�[ w uyamZ�amfmgo}�}y[�uyd.fcitu1acn § gV�rlr}l § �"!$# *-,-. ª

� ��� � *4��� � $&����� $�-�/0� ��� #¿À[�[��r[�n=itdJgofmf³xÄik}yam[ w itX.[�z�}yacit[�}tamgplrnÁ}t[�gofÂamZ\go�r[�u § lr}�¥Xsamz�XQaci w l;[�u^n.lvi^[�{bamu�i(g�it}td.[��vgofcd.[ § lr}� ¶Oamn�}t[Vgvf³¤¯fca § [v¾Ma³i°acu�d.uydJgofmf³x'qJgo}yi�l § ikXs[eq.}tlo¢.fm[�Z itl�goutuy[�uyu(a³iku1�ogvfmd.[V¸1¢.dsi § lr}�¥X.acz�X>amn=ikdsacikaclrnlr} [�{bqM[�}yi �®n.lS¥fm[ w �r[¦z�lrdsf w �rac�o[�gonÆacn w aczVgvitamlrnÄl § ¥XJgji(¥�lrd.f w ¢M[¦g�}t[VgvutlrnJgv¢.fm[e�vgofcd.[oª¦±�u(gon

-/.�Û0-/1

Page 24: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �b�

����� �����

����� ���� ����

�� ������ �������������� � �! �� � �" � � #�#�����$ �% ��� '& ��( �" � � �)*���+� & ', .-/�� �%�0��132 � �" � � �)����4�65�-/�7 �(' �, ��" &82 � 2% &9�3,% '&3�;:�<>= �? �& � 1 & � &82@"� BAC2%��� , )���+�$� & D��4�FEG-/�� �(' �$, ��" &82 � 2% &3,H��,% �&��2 �3 ,0 '"I� (J� 2 7LKM�('N� & NO0� < ��( � �0 �2 � "�,�P

����� �����

����� ���� ����

�� ������ L53�#QR � �" � � ��S�T���@ �0 '�� �& ��( '" � � G)F���+� & ', U-V�7 �0�%��132 7 '" � � G)F���4�W� & X��+�Y�Z-/�7 �(' �, ��" &82 � 2% &3,[�3,% '&3�\:�< = �Y '& 3 1 & � &82]"[ ^A_2`�3� , � & 2 �� ,% '"W� (J� 2 7aKM�('b��( � �% ^2 � " )F��4�5c-V�7 �(� �d, ��" &82 � 2% &e��,0 '&�� O0� <fP

ghgji�k_l�m4n7o

Page 25: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�r� ������������� ���������� ��������������������� ��!���!"

¬£X.[�z��v[�}y¢8l=gv} w acZ-gv�r[z�}tacit[�}yamlrn ut[�fm[�z�ik[ w ��"!$#"%$'3( ���� !$# ]

�"!$# *-,-. ]

� lr�rl¦amZ\go�r[z�}tacit[�}yamlrn ut[�fm[�z�ik[ w ��"!$#&%$')( ���� !$# �

�"!$# *-,-. �

W#go¢sfm[��bÍ ��lracut[$¤¯z�lo}t}tdsqsik[ w uyx;n=ikX.[�ikaczeamZ\go�r[�u�Í`b[�fm[�z�ik[ wK� d.uyamn.��´�µ�¬ § lr}�acn w [�qM[�n w [�n=i Z�a³{;ikds}t[Z\l w [�fcu¦¶2� !$# % '3( ¸�¾�q.uy[�d w lv¤¯fcam�o[�fmacX.lbl w ¶6| � µ�¬�¸ gon w Z�[VgvnÁ .[�f w ¤¯fmac�o[�¶ �"!$# *-,-. ¸°goq.q.}ylV{sacZ-gjikamlon.ul § ´�µ�¬�ª

amfmfcd.uyit}kgvitamlrn@¾.�#ac�rd.}t[(]>¶6g=¸�amu°gvnÄgo[�}tahgvf LU> >0O LU> > acZ-go�o[(l § g-¢.d.lSx�go�=gvamn.u�i°g�¢Jgoz��®�r}tlod.n wÄw gv}t�¥%gvit[�}�gon w �#am�od.}t[ ( ¶·g=¸#acuGg L <DC O L <DC |BÌ~W acZ-go�o[%l § g w lr�(fmdsn.�\¶6ut[�[°`®i�gon § lo} w ¶��S»r»o»=¸ § lr}~Z�lr}t[w [�ikgoamfcu%lrn�ikX.[�am}�nJgvitd.}t[^gvn w lo}tam�oamnT¸$ª�Jlr}^ikXs[\ J}yuyieacZ-gv�r[o¾�¥£[-utd.uyq8[�z�ieitXJgvie��amu g�}y[�fm[��vgon=i��vgofmds[ § lr} � ª'µ¯Z-go�o[\]ȶ·g=¸^q.}t[�ut[�n=itu

utlrZ�[^go}yita § goz�i ¶6X.lo}tam¹�lrn=i�gof@utzVgvn�fcamn.[�u § }tlrZ½ikX.[^amZ\go�racn.�eq.}ylbz�[�uyu�¸�ª£`blrZ�[^q.}t[$¤¯q.}ylbz�[�uyutamns��u�ik[�q�ikl}t[�Z�lS�r[�ikX.acu��®n.lS¥n+go}yita § goz�i(z�lrd.f w ¢M[-z�go}t}yam[ w lrdsi�gou�acnÉ`;ikgon § lr} w ¶��S»o»r»=¸°¢.dsi ¥£[-it[�u�ik[ w Xs[�}t[ikX.[¦z�}yacit[�}tamg-lrn>ikXs[�}tgV¥ w gvikgsªeW�X.[�ut[�fm[�z�ik[ w � go}y[�uyX.lS¥nÆacnÁW#go¢sfm[¦��gon w ikXs[�z�lr}t}y[�uyq8lrn w amn.�ut[��oZ\[�n®ikgvikaclrn.u(amnÆ�#am�od.}t[¦].ª � !$# *-,-.Ïq8[�} § lr}yZ\u(Zed.z�XÆ¢8[�itik[�}(itXJgonÀ| � µ�¬¨¥X.acz�XÈut[�fm[�z�iku�g'itlblfhgo}y�r[£n®d.Ze¢M[�}Bl § z�lrZ\qMlrn.[�n=ikuÂ¥X.acfm[+�"!$# %$')( qs}tlr¢Jgv¢.fcx�utd@58[�}yu § }ylrZ n.loi~i�gv�;acn.� amn=itl^goz�z�lrd.n=i~ikX.[utqJgvitahgof)acn § lr}yZ-gvitamlrn@¾sgou1zVgvnE¢M[ uy[�[�nElrn�uy[��rZ�[�n=ikgvikaclrnȶ w ¸�ª£W�X.[�uy[�}t[�utd.f³iku¥£[�}t[ lr¢si�gvamn.[ w d.uyamn.�¢Jgoutacz1itX.}t[�utX.lof w acn.�(itl�q.}yl w d.z�[�amn.a³ikahgvf.ut[��rZ\[�n=i�gvitamlrn.u § lr}BikX.[�[�u�ikamZ\gvitamlrn�gofc�rlr}ta³ikX.Z�u¶OutamZ�d.fhgvit[ w J[�f w gon w µ�¬�� gofm�olr}ta³ikX.Z�u�¸$ª�¿Æ[-ik}yam[ w � !$# *-,-. gon w | � µ�¬ ¥acitXÈZ\lo}t[p}y[� Jn.[ w amn.a³ikahgvfmam¹�gvikaclrn.ud.utacn.��ikX.[�amn w [�qM[�n w [�n=i�Z�a³{;ikds}t[�u^ÌG� gofm�rlo}tacitX.Z ut[��rZ\[�n=i�gvitamlrn.u(gou  J}yuyi(amZ\go�r[�u�ª�W�X.acu^zVgonÆ¢8[ut[�[�n�gou£g q.}y[�¤¯qs}tl;z�[�uyutacn.�euyit[�q˪~W�Xs[�ut[�fm[�z�ik[ w � ¥£gou£ikXs[�n�� § lr} �"!$# *-,/. ¶·�#ac�rd.}t[]p¶6zS¸y¸B¢sdsi%u�ikamfcfikl;l�fhgo}y�r[�¶«�r¸ § lo}| � µ�¬Ê¥X.amz�X'fm[�g w u�ikl�g�Z\[�gon.acn.�rfm[�utu�uy[��rZ�[�n=i�gjikamlonÀ¶6�#am�od.}t[°]�¶ § ¸y¸�ª�Jlr}^ikXs[ w lr�Äfcd.n.��amZ\go�r[o¾�ikXs[�goamZ�acu itl w amu�ikacn.�rd.acutXÁikX.[pfcd.n.� § }tlrZ�ikXs[p}t[�uyiel § ikX.[pacZ-gv�r[

amnElo} w [�}�ikl\Z\[�goutds}t[�itX.[�X.[�ik[�}tlr�r[�n.[�a³i¯xEl § ikX.[(ikacututds[eamn'ikX.[ }t[��oamlrn�l § amn=ik[�}t[�uyiVª �°n.fcx�q.a©{b[�fmu�amnikX.acu w [�fcamZ�acit[ w go}y[Vg-¥acfmf�itX.[�nÁ¢M[�z�lrnsuta w [�}t[ w itl�z�lrZ�q.dsit[¦g�X.[�it[�}tlo�r[�n.[�aci¯xEZ\[�goutd.}y[o¾�utdsz�XÀgou^gz�l;[ ��z�ac[�n=i l § �vgo}yahgvitamlrn˪�| � µ�¬ gon w �"!$#+*-,-.Éut[�fc[�z�i }kgvitX.[�} w a 58[�}y[�n=i � ¥acitX>go�=gvamnÄg�ikl;lpfhgo}y�r[�ogvfmd.[ § lr}�| � µ�¬�¶OW#go¢sfm[ �=¸�ªW�X.[ z�lr}y}t[�uyq8lon w amns�-ut[��rZ�[�n=i�gvitamlrnsu°go}y[ uyX.lS¥n>amnÄ��am�rd.}y[ ( ¶6¢J¸�gon w¶ § ¸�ª W�X.[¦�j¤Ýz�lrfclr}1ut[��oZ\[�n®ikgvikaclrn>lr¢sikgoamns[ w d.uyamn.� � !$# *-,/. gon w ikX.[euyamZedsfhgvit[ w  J[�f w gvfm�rlr}yacitX.Z�amuikX.[1Z\lo}t[ukgvitamu § xbacn.�(gouG}t[��rgo} w uGamn=it[�}tqs}t[�ikgvikaclrn˪�µÝi�uyX.lS¥u%lrn.[z�lrfmlr} § lr}~itX.[�¢.goz��®�r}tlrdsn w gon w i¯¥�l§ lr}GitX.[�fcd.n.� acikuy[�f § ªÂW�X.amu�amuGn.loi£utd.}yq.}tacutamns��utacn.z�[1ikX.[�amZ\go�r[amu�z�lrnsuyik}yd.z�it[ w ¢Jgvut[ w lonp}kg w aml=goz�ika³�r[[�Z�amutuyamlrnsu § }tlrZ��=gou^amnÄitX.[¦fmd.ns�.ªeW�X.[�i¯¥�l�uy[��rZ�[�n=iku goz�z�lrd.n=i § lr}°itX.[¦X.am�rX>�rgou w [�nsutaci¯xÁacnÄikX.[amn=ik[�}tamlo}�l § ikX.[�fmd.ns�Ègon w ikX.[�utlrZ�[�¥XJgjipfmlS¥�[�}\�=gou w [�n.uyaci¯xÏgo}tlod.n w itX.[EqM[�}yamq.X.[�}yxoª=�"!$# %$')(

-/.�Û0-/1

Page 26: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �o�

¶6g=¸ ¶6¢J¸ ¶6zV¸

¶ w ¸ ¶6[V¸ ¶ § ¸

�#ac�rd.}t[�]sÍ�´£dslLxÁacZ-gv�r[�Íp¶6g=¸°lr}tac�ramn.gof#acZ-go�o[o¾G¶6¢J¸^gvn w ¶OzS¸ ��gvn w �L¤Ýz�lrfclr}°uy[��rZ�[�n=i�gjikamlon.u^d.utacn.�ikXs[\uyamZed.fmgvik[ w  J[�f w gofc�rlr}ta³ikX.Z }t[�utqM[�z�ikac�o[�f³xÁamn.a³ikahgvfmam¹�[ w ¢=xÁikXs}t[�uyX.lrf w amn.�'gon w ÌG� § lr}^acn w [�qM[�n;¤w [�n®i(Z�a³{;ikds}t[�u�¾G¶ w ¸�]j¤¯z�lofmlr}�ut[��oZ\[�n®ikgvikaclrnÁd.utacn.�'ÌG� § lo} amn w [�q8[�n w [�n®i(Z�a³{;ikds}t[�u�¾G¶6[V¸°gon w ¶ § ¸ *gon w �L¤Ýz�lrfclr}euy[��rZ�[�n=i�gjikamlon.u�d.utacn.�>µ�¬�� }y[�uyq8[�z�ika³�r[�fcxÉacn.acitahgofcam¹�[ w ¢=xÈitX.}t[�utX.lof w acn.�Ágon w ÌG� § lr}amn w [�qM[�n w [�n=i�Z�a³{;itd.}t[�u�ª

´£d.lSx�acZ-go�o[z�}ta³ik[�}tamlon uy[�fm[�z�it[ w ��"!$# % '3( ]��� !$# *

� !$# *-,-. �

��lr��fmd.n.�¦acZ-go�o[z�}ta³ik[�}tamlon uy[�fm[�z�it[ w ��"!$# % '3( ���� !$# *

� !$# *-,-. �

W�go¢.fm[B�bÍ#)^}y[�x=¤¯fc[��r[�f=amZ\go�r[�u�Í�`b[�fm[�z�ik[ w � d.utacn.��´£µ�¬ § lr})acn w [�q8[�n w [�n=i?Z�a³{;ikd.}y[~Z\l w [�fmuB¶ �"!$# % '3( ¸�¾q.uy[�d w lj¤¯fmac�o[�fmamXslbl w ¶·| � µ�¬�¸�gon w Z\[�gon� J[�f w ¤¯fcam�v[¦¶2�"!$# *-,-. ¸%goqsq.}tlV{bamZ\gvikaclrn.u%l § ´£µ�¬�ª

gofcutl>ut[�fm[�z�iku¦�Äz�lrfmlo}tue¢.dbi�ikX.[�z�lr}t}y[�utqMlrn w amn.�Áut[��rZ�[�n=i�gvitamlrnÀamu�}kgjikX.[�} w a 58[�}y[�n=i § l;z�d.uyamn.�>Z�lr}t[lrnÈitX.[�go}yitac Jz�ahgofG¢Jgoz��®�r}ylrd.n w z�ac}tz�fm[oª>¿Æ[pikX.[�n gvfmutlEz�lrZ�q.dsit[ w �"!$# *-,-. gon w | � µ�¬�d.uyamn.�>ikXs[amn w [�qM[�n w [�n=i�Z�a³{;ikd.}y[�u�Ì�� uy[��rZ�[�n=ikgvikaclrn.u�acn.uyit[Vg w l § ikXs[plrn.[�uelr¢sikgoamn.[ w �;ahg'ikX.}y[�utXslrf w acn.�Ägvuamnsacikamgofmac¹�acn.�^amZ\go�r[�u£¢.dsi1n.loitamz�[ w nsl�uyam�rnsac Jz�gon=i w a 58[�}y[�n.z�[oª

Û�Û Ö PRQ�SUTUV

Page 27: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�v] ������������� ���������� ��������������������� ��!���!"

¶·gr¸ ¶6¢T¸ ¶6zS¸

¶ w ¸ ¶6[S¸ ¶ § ¸

�#am�rds}t[ ( ÍG|BÌ~W²µ¯Z-go�o[ l § g w lr��fmd.ns�.Í�¶·g=¸%lr}yam�racnJgofMamZ\go�r[o¾)¶ w ¸��j¤Ýz�lrfclr}�ut[��rZ\[�n=i�gvitamlrn�d.uyamn.�\ÌG�§ lr}£acn w [�qM[�n w [�n=i1Z\a©{;ikd.}y[�u�¾Ë¶6¢T¸�gon w ¶6[V¸ *j¤¯z�lrfmlo}£gon w �L¤¯z�lofmlr}Gut[��rZ\[�n=i�gvitamlrn.u£d.utacn.��µ�¬��ƾ�¶OzS¸%gon w¶ § ¸ *j¤¯z�lrfmlr}%gon w �j¤¯z�lrfmlo}%ut[��rZ\[�n=i�gvitamlrn.u�dsutamns�¦itX.[^utacZed.fhgjik[ w  .[�f w gofc�rlr}ta³ikX.Z'ª

-/.�Û0-/1

Page 28: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ � (

� � ����� �����)��� �

µ¯n>ikX.[¦z�lrn=ik[�{;i(l § �Ego}y�olS�>Z�l w [�fÂut[�fm[�z�ikaclrn˾)u�i�go}�ikamns� § }tlrZ�´£µ�¬¨gvu lrd.} ut[�fm[�z�ikaclrnÁz�}yacik[�}taclrn˾@¥�[q.}ylrq8lout[ w d.uyamn.�Z�[Vgon° .[�f w ¤¯fmac�o[#goq.q.}ylS{bacZ-gvitamlrnsu8ikl w [Vgofo¥a³ikX ikXs[~z�lrZ�q.dsikgvikaclrn°l § ikXs[~amn=ik}tgoz�ikgo¢.fm[�Ego}y�olS� w amu�ik}yam¢.dsitamlrnÁacnÀ´£µ�¬ [�{bq.}t[�utuyamlrn˪���lo}t[�utqM[�z�a³ JzVgvfmfcxo¾�lrn.[-l § lrd.}^z�lrn=ik}tac¢.dsitamlrn.u^¥£gou(itln.loitamz�[ÂikXJgvi)´£µ�¬Qz�lrd.f w ¢M[B}t[�¥}taciyik[�n(acn°ik[�}tZ�u)l § qJgo}yitacitamlrn § dsn.z�itamlrn.u § lo}@¥X.amz�X g£ J}yuyi?lr} w [�})}kgjikX.[�}ikX.gonƹ�[�}yloikXQlr} w [�} Z�[VgonÁ J[�f w goq.q.}ylS{bacZ-gvitamlrn�¥%gou gV�vgoamfmgo¢.fm[p¶«`b[�z�itamlrn ( ªÓ�r¸�ª�W�Xs[-g w �ogvn®ikgo�r[�acuikX.gviikX.[(­®dJgofma³i¯x�l § ikX.[ goq.q.}ylV{sacZ-gjikamlon�amu[Vgouyam[�}itl-gvutut[�utu°uyamn.z�[ a³id.ut[�u�itX.[ ¢M[�u�i�fclS¥£[�}1¢Mlrd.n w u§ lr}~ikXs[1q.go}yitacikaclrn § d.n.z�ikaclrn.u�ª�¿À[1amn=ik}yl w d.z�[ w g^z�fmgoutuBl § n.[�¥Êz�}ta³ik[�}yahg goZ�lrn.� ¥X.acz�X\¥�[�z�Xslrut[�lrn.[o¾ikXs[�utlv¤ÝzVgofcfm[ w �"!$# *-,/. ¶O[�­®dJgvitamlrn'¶·�o�=¸t¸?¢Jgout[ w loneikX.[�ut[�ikX.[�lr}t[�ikaczVgof.z�lrn.uya w [�}kgvitamlrn.u#}t[��rgo} w acn.�°ikXs[­®dJgofcaci¯x l § ikX.[£goq.q.}ylV{sacZ-gjikamlon l § itX.[�acn=ik}kgvz�i�gv¢.fm[Bfmac�o[�fmamXslbl w gon w ¢Jgouy[ w lrn q.}t[��;amlrd.u?[�{bqM[�}yamZ�[�n=i�gof}t[�utd.f³iku�gou1}t[��rgo} w u1qJgo}tgoZ�[�ik[�}[�uyitamZ\gvikaclrn § lr}1g��vgo}yamlrd.u�i¯x;qM[�u�l § amZ\go�r[�u�ª£�#am}yuyiaci�goqsq8[�go}tuikXJgjii�gv�;acn.�euyqJgvikamgofTamn § lo}tZ\gvikaclrn¦amn=ikl�gvz�z�lod.n=i�fm[�g w u�itleutloZ\[�amZ�q.}tlS�r[�Z\[�n=iku£¥X.[�n�z�lrZ�qJgo}y[ w itl�´£µ�¬§ lr}¦amn w [�qM[�n w [�n=i-Z�a³{;itd.}t[�Z�l w [�fmu'¶ �"!$# %$')( ¸$ª W�X.[�n˾%lrd.}¦z�}tacit[�}yamlrn w a65@[�}t[�n=itahgvit[�u § }tlrZ | � µ�¬¶·´�µ�¬¨goq.qs}tlV{bamZ\gvikaclrnE¢Jgvut[ w lrn>ikXs[�qsut[�d w lv¤¯fcam�v[�fmacX.l;l w ¸�amn>a³iku^go¢samfma³i¯x�ikl w [�gof~¢8[�itit[�}°¥acitX>ikX.acn§ [Vgjikd.}y[�uamn�amZ\go�r[�u�ªÂµÝi1gvfmutl¦uyX.lS¥u1�olbl w q8[�} § lr}yZ-gonsz�[ lrn�}t[�gofËacZ-go�o[�u�gof³ikX.lod.�rXp¥�[ z�gon�utd.uyq8[�z�iw [�z�}t[�goutacn.�>qM[�} § lo}tZ\gon.z�[�amnÆikX.[\q.}t[�ut[�nsz�[�l § go}�ika § goz�ip¶6fcam�o[\utz�gonÉfmacn.[�uk¸ itXJgvi�itX.[-z�}ta³ik[�}yamlrnÆZ-gVxz�lon.uta w [�}BgouB}y[�fm[��vgon=iBamn § lr}yZ-gjikamlon acn.uyit[Vg w l § n.lracut[oª � lS¥£[��r[�}GitX.amu~acuÂfmac�o[�f³x itl^¢8[�XJgvn w fm[�¢=x�uylrZ�[q.}y[�¤¯qs}tl;z�[�uyutacn.�\u�ik[�q�d.uyamn.�¦}y[VgouylrnJgo¢.fc[^amn.a³ikahgvfmam¹�gvikaclrn.u1¶6Ì�� § lr}�acn w [�qM[�n w [�n=i�Z\a©{bitd.}t[�u�¸$ª± § it[�}1zVgo}y}yx;amn.��lrdsi�vgo}yamlrd.u�[${bq8[�}tamZ�[�n=itu�¾Maci1goq.qM[Vgv}t[ w ikXJgji�g¦ut[�n.utac¢.fm[(q.}ylbz�[ w d.}y[ § lo}1Z�l w [�f

ut[�fm[�z�ikaclrn¦¥£lrdsf w ¢8[�ikl^ J}yuyiGq8[�} § lr}yZ utacZ\qsfm[�q.}ylbz�[ w d.}y[�u�ªB�Tlo}~[�{sgoZ�q.fm[v¾ § lo}~ut[�fc[�z�ikamns�(itX.[�n®d.Z�¢8[�}l § z�lrZ�q8lon.[�n=iku�amn=ikl^¥X.acz�X\ikl(ut[��rZ�[�n=i�gon�amZ\go�r[v¾®g nJgjikd.}tgofJq.}tl;z�[ w d.}y[�amu~itX.[�ÌG� gvfm�rlr}yacitX.Z § lr}amn w [�qM[�n w [�n=i%Z�a³{;ikds}t[�uGZ�l w [�fmuB[Vgvuyx�ikl�acZ\qsfm[�Z�[�n=iGgon w\§ lr}B¥X.amz�Xp´£µ�¬Ï�vgofmd.[�u�z�gon-¢M[�z�lrZ�q.dsik[ w[�{sgoz�ikf³xrª(µ¯nQuylrZ�[ezVgouy[�u�¾ËikX.acu°z�lrdsf w fm[�g w ikl�}y[VgouylrnJgo¢sfcx�ukgvitamu § x;acn.�put[�fm[�z�ikaclrnÁgon w uy[��rZ�[�n=i�gjikamlonutl�ikX.gvi^d.ut[�}tu(Z-gVxEz�X.lblout[¦n.loi itl'�ol § ds}yikXs[�}�ª¦µ § n.loi�¾�gou^aci^amu�fmam�v[�f³xEikl�l;z�z�d.} § lr} amZ\go�r[�u�¥acitXutac�rn.a³ JzVgvitac�o[\uyqJgvikamgofBuyit}td.z�ikd.}y[o¾ÂikXs[pz�lr}y}t[�utqMlrn w acn.�Äq.}ylbz�[ w d.}y[-z�lrd.f w q8lruyutac¢.fcxÁ¢M[ § d.}�ikX.[�}�d.uy[ wiklEamn.a³ikahgvfmam¹�[eZ�lr}t[\}t[� .n.[ w gofc�rlr}ta³ikX.Z�u ¢Jgouy[ w lrnÈuyqJgvitahgofBZ�l w [�fmu�ªÄ�Jlr}�[${sgoZ\qsfm[o¾~`;i�gon § lr} w gvn w�1g § ik[�}yx'¶·�o�r�s�L¸?uyikd w am[ w µ�¬�� gon w d.ut[ w ikXs[1qsut[�d w lv¤¯fcam�v[�fmacX.l;l w gvq.q.}tlV{bamZ\gvitamlrn�¥Xsamfm[%¥�[1q.}tlrqMlruy[ikl�d.ut[�ikX.[\utacZed.fhgjik[ w  J[�f w gvfm�rlr}yacitX.Z l § ¬£[�fm[�db{8¾Â�Jlr}y¢8[�u�¾Âgvn w |�[�x;}kgo} w ¶«�o�o�=�r¸ gon w itX.[�Z\[�gon J[�f w goqsq.}tlV{bamZ\gvikaclrn�q.}tacn.z�acq.fm[ itlpz�lrZ�q.dsit[�z�}tacit[�}yamlrn��"!$# *-,-. ª �°nEitX.[�uy[�i l § amZ\go�r[�u1it[�uyit[ w acnlrd.}#[�{bq8[�}tacZ\[�n®itu�¾rlod.}Âq.}ylbz�[ w d.}y[%utXslL¥�[ w Zed.z�X�¢M[�iyik[�}Âq8[�} § lr}yZ-gvn.z�[%[�utqM[�z�ahgofcfcx^lrn�}y[Vgof w gvi�gbª�¿Æ[¢M[�fmac[��o[�ikXJgji°ikX.acu°amu�Z-gvamn.f³x w d.[eikl�g\¢8[�itik[�}^goq.q.}ylV{sacZ-gjikamlonEl § itX.[�fmac�o[�fcamX.l;l w acnK�"!$# *-,-. ¶6ut[�[ikXs[ ±�q.qM[�n w a³{ § lr}�gon�acfmfmdsuyik}tgvikaclrn�l § ikX.[ uyd.q8[�}taclr}ta³i¯x\l § itX.[° J}yuyilr} w [�}�gvq.q.}tlV{bamZ\gvitamlrnT¸~z�lod.q.fm[ wikl�g�ukgjikamu § x;amn.�¦[�u�ikacZ-gvitamlrn-l § itX.[^qJgo}tgoZ\[�ik[�}�q.}tlS�;a w [ w ¢=x�itX.[^utamZ�d.fhgvit[ w  J[�f w gofc�rlr}ta³ikX.Z'ª

Û�Û Ö PRQ�SUTUV

Page 29: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� * ������������� ���������� ��������������������� ��!���!"

W�Xsamu�u�ikd w x�}y[�Z\goamnsu�uylrZ\[�¥XJgvi�fmacZ\a³ik[ w acn�itXJgvi�aci1amu1Z-gvamn.f³xp[�{bq.fclr}kgjiklr}�x'gon w ¢Jgvut[ w lrnE[${;¤q8[�}tamZ�[�n=itu�ª\¿Æ[ w a w n.loi g w.w }t[�uyu itX.[\­®d.[�uyitamlrnÆl § itX.[\z�lrn.uyamuyit[�n.z�xQl § itX.[��vgo}yamlrdsu(z�}ta³ik[�}yahgsª�±�u§ go}1gou�¥�[��®n.lS¥ n.l-uyd.z�XÄ}y[�utdsfciku�go}t[(z�ds}t}t[�n=ikfcx�gV�vgoamfmgo¢.fc[ § lr}X.a w.w [�nÁ�Egv}t�olS�'}kgvn w lrZ� J[�f w u�ª�µ¯nutlrZ�[ }t[�z�[�n=i¥�lr}t�T¾ )^goutuyahgvi(¶·�o�r�s�S¸Gz�lon.uta w [�}1geZ\gj{bamZ�am¹�[ w qM[�nJgofcam¹�[ w Z\go}t�racnJgofMfmac�o[�fcamX.l;l w z�}yacit[�¤}tamlon § lr}([�u�ikacZ-gvitamn.��itX.[\n®d.Z�¢8[�}�l § Xsa w.w [�nÀu�i�gvit[�u�acnÀX.a w.w [�nÉ�Ego}y�olS�Æz�XJgoamnsu�ª0)(gvututamgvi-¶«�o�o�s�L¸q.}tlS�r[�upgÁz�lrnsutamu�ik[�n.z�xÎ}t[�utd.f³i § lo}eikX.acu\z�}tacit[�}yamlrnÎgof³ikX.lrds�rXÉikX.['Z-gv}t�racnJgof£fcam�v[�fmacX.l;l w acn=�rlrf³�r[ w amun.loi�n.[�z�[�ututgo}tacfcx'z�fclrut[(ikl�ikX.[ fmam�v[�fcamX.l;l w ¶ ikX.[�xEgv}t[�[�­®dJgof?lrn.fcx�¥Xs[�nÄikXs[ �vgo}tamgo¢.fc[�u1go}t[ amn w [�qM[�nb¤w [�n=i$¸$ªÆW�Xsamueuyd.�r�r[�uyiku�itXJgvi¦gE�olbl w goq.qs}tlV{bamZ\gvikaclrnÀl § itX.[pZ\gj{bamZ�am¹�[ w fclr�v¤¯fcam�v[�fmacX.l;l w acuen.loi¦guyik}ylrn.��}t[�­;dsam}t[�Z\[�n=i1itl\lo¢si�goacn�z�lrn.uyamu�ik[�n=i�z�}ta³ik[�}tahgbª~±¨�v[�x'q8loamn=iamn0)^goutuyahgvi ¶·�o�r�s�L¸%uy[�[�Z�uikl�¢8[ikX.[ w [�z�loZ\qMlruta³ikaclrnÆl § ikX.[pz�}ta³ik[�}yamlrnÀgouegÄuyd.Z l § a w [�n=ikamz�gofmf³x w acuyik}yam¢.dbik[ w ik[�}yZ\u�ªÄW�X.[pz�}ta³ik[�}yahgq.}tlrqMlruy[ w amn�ikX.acu°qJgoqM[�}°z�gonÁgofcutlp¢M[�¥}ta³itit[�n>gou uyd.Z ¢8[�zVgod.uy[�l § ikX.[ § goz�itlr}tac¹Vgvitamlrn�q.}tlrqM[�}�i¯xEl §ikX.[ w amuyit}tac¢.dsikaclrn.u amn=�rlrf³�r[ w ªÁW�X.[p�r[�n.[�}tgofmac¹VgvitamlrnÆamu�nsloi�uyit}kgoac�rX=i § lr}�¥%gv} w ¢.dsielrd.}en.[${;i�uyit[�q+amuikX.[�}t[ § lo}t[ ikl¦amn=�o[�uyitam�=gjik[^a § z�lon.utacuyik[�n.z�x�}y[�uyd.fcitu1z�gon'¢8[ w [ w d.z�[ w acn�g�uyamZ�amfhgv}G¥£gVxrª

� ��\����� ���� 4 �2 ����?�

W�X.[(godsikXslr}tu1go}y[(�o}kgvit[ § d.f@itl )¦ªT¬£[�fm[�db{ § lr}�Z\gon=x-�vgofmd.go¢.fm[�z�lrZ�Z\[�n=iku�ª

� �+�v�%������£��

±��jgoac�o[v¾T�ƪ�¶º�S»=�o�=¸$ªbµ¯n § lr}tZ\gvikaclrn\itX.[�lo}yx�gvn w gon�[�{;ik[�n.utaclrn'l § ikX.[ Z\gj{bamZedsZ½fcam�v[�fmacX.l;l w q.}tacnb¤z�acq.fm[vªbµ¯n'´�ª � ª.|?[�it}tlV{�gon w �£ªJ¬%gouy�®aB¶·Ì w u�ª ¸$¾ � ������ " � � �� ��� ���� ��� � �� � � �� �R� �� � � ������ ��� ������ � ����� j¾.q.q@ªM� *=�bª

±�}yz�X.[�}�¾ )�ª®Ì�ªs´�ª;gon w ��ªb�ƪ;W�aciyik[�}yamn.�viklrn�¶«�v�r�r�=¸$ª®|#go}tgoZ\[�ik[�}�[�uyikacZ-gjikamlon § lo}GXsa w.w [�n��Egv}t�olS�z�XJgoacn.u�ª�� � ����� � �������� � � � ��� � �� ����� ���� ��� ��� � � �� �� � � � ��������oª

´£[�ukgo�.¾ �sª)¶��S»=� ( ¸�ªT`®i�gvitamuyitamz�gofËgon.gofcx;utacu�l § n.lrnb¤Ýfhgviyikamz�[ w gvikgsª� � �� ����� ���� ���� ��� �J¾Ë�S�o»��M�S» ( ª´£ac[�}tn.goz��®a«¾;¬�ª³¾.)�ª®¬£[�fm[�d;{@¾bgon w )�ª�)^lS�vgo[�}yi�¶«�v�r�r�=¸$ªo±�uyut[�ututacn.�eg^Z�a³{;ikd.}y[%Z�l w [�f § lr}~z�fmd.u�ik[�}yamn.�¥acitX\ikXs[�amn=it[��r}tgvik[ w z�loZ\q.fc[�it[ w fcam�v[�fmacX.l;l w ª �+���������!���� � �� ��������� � ��� � �� �� ���� ���� �� "� � ��� ���� � � ������ � �������=¾M�b�S» �s�r� ( ª

¬£[�fc[�db{8¾ )¦ª³¾o��ªL�Tlo}t¢M[�u�¾ogon w � ªj|�[�x;}kgo} w ¶«�o�o�=�r¸�ªVÌ�� q.}tl;z�[ w d.}y[�u#dsutamns��Z�[Vgon^ J[�f w ¤¯fcam�v[Bgoq.q.}ylS{®¤amZ\gvikaclrn.u § lr}1�Ego}y�olS��Z\l w [�f³¤¯¢.gout[ w amZ\go�r[°uy[��rZ�[�n=i�gjikamlon˪� � ����� � ������ � ��� � �� �������� �� ���� ����?ª

-/.�Û0-/1

Page 30: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �r�

¬£X.gon w fc[�}�¾ ��ª(¶��S»o¼=�r¸�ª � � ��� " � �� ���� � �9� � " �� �� � ��� ���� ��� ���7� �������� ������ª ��{ § lr} w Ã1n.ac�o[�}yutaci¯x|~}t[�utu�ª

�J}tgofm[�xr¾=¬�ªogon w ± ªr�1g § ik[�}yxp¶��S»r»o¼=¸�ª � lS¥ÏZ-gvn®x(z�fmd.u�ik[�}yu���¿ X.amz�X�z�fmd.u�ik[�}yamn.��Z\[�ikX.l w ��±�n.u�¥£[�}tu�;ahg�Z�l w [�f©¤¯¢Jgouy[ w z�fcd.uyit[�}1gonJgvfcx;utacu�ª ��� � � � �� � � � � ��� ���o¾ ( �v¼�� ( ¼r¼bª

)^gouyutahgjiV¾�Ì�ª�¶«�o�r�b�L¸�ª � am�v[�fmacX.l;l w }kgjikamlQamns[�­®dJgofcacikac[�u�¥acitX goqsq.fmaczVgvitamlrn.u�itlÆ�vgo}taclrd.u�Z\a©{;ikd.}y[�u�ªW?[�z�X.nsamzVgvf��[�qMlr}�i��o�r�s��¤º�o�s¾.�EgvikXs[�Z\gvikac­;ds[�u�¾ �°}tutgSxoª

) [�Z\gon˾(`Mª�gon w ��ª ) [�Z\gon ¶��S»r¼v]®¸�ª�`;itlbz�XJgvuyikaczÆ}y[�fmgj{sgvikaclrn˾ ) am¢.¢.u w acuyik}yam¢.dbikamlon.uEgvn w ikXs[´%gVxo[�utamgonE}y[�u�iklr}tgvikaclrn�l § acZ-gv�r[�u�ª �+����� � �!���� � �� ������ �� � ��� � �� �� ���� ���� �� " � � ��� ����� � ������ � �������j¾M�r�b� �s�j].�rª

�oa·¾b¬�ªsgon w�� ªs`;[�x;Z\lod.}°¶º�S»r» *r¸�ª®±êz�lrn.uyamuyit[�n=i�Z�l w [�fJut[�fm[�z�ikaclrn-qs}tl;z�[ w d.}t[ § lr}%��go}t�vlL�\}kgvn w lrZ J[�f w u¢Jgvut[ w lrn�q8[�nJgofcam¹�[ w q.ut[�d w lrfcam�o[�fmacX.lbl w ª � ��� �+� � �"��� ����� " � �������'� ������� ��j¾s]®�o���;]o]=�sª

/^gouyu�¾M�^ª8gvn w ± ªM��g § it[�}�xQ¶��S»o» ( ¸�ªT´£gSxo[�u § goz�itlr}�ª � � � � ��� � � ��� � � � �� ��� �� � � ��� ���� ���� ��� � ��� ����� ��� ������j¾T�o�r� �s�o» ( ª

�'z � goz�X.fmgon˾ )�ª �sªTgon w ��ªT|?[�[�f�¶·�o�r�r�=¸$ª � �� ��� � � � � ��� � �� � " �� ��ª.¿ acfm[�xoª�1[�¥�itlrn˾1�ƪ�gon w ±�ªG��g § ik[�}�xê¶��S»o»o]®¸�ªB±�q.q.}tlV{bamZ\gvit[�´£gSxo[�uyahgon µ¯n § [�}t[�n.z�[E¢®x+itX.[�¿ [�am�rX=ik[ w

� am�v[�fcamX.l;l w ´£lblvikuyit}kgoqƶ ¥acikX w amutz�d.utuyamlrnJ¸�ª � � � � ����� � �/� � � �� ���� � � ��� ���� ��� ��� � � ����� � � �� ���� ��j¾J���;]r¼sª

|?[�x;}kgv} w ¾ �(ª�¶·�o�r�s�L¸$ª �"��� � ��� ��� ��� ������ " � � � � ����� � � � �� '� " ��� � � "������ " � ����� � � " �� �����'��� � � � � � � � � � � � ����� ���� " � " �� �������� ����� � ��������ªL|~X˪���ªSikX.[�utamu�¾rÃ(ªÓ�£ªý�^ª w�� acn § lr}yZ-gvitam­®d.[[�i w [(Z\gvitX.��Z\gvikac­®d.[�ugoqsq.fmac­;ds��[�u�¾JÃ�nsac�r[�}tuyacik� �olruy[�q.XE�Jlrd.}tac[�}�¾ ) }t[�nslr¢.fm[ µ�¾T�J}tgon.z�[vª

�°amgon˾�¿"ªGgon w ��ª��ƪBW�aciyik[�}tamns�oiklrnǶ��V»r»s�L¸$ªBÌBu�ikacZ-gvitamlrnÉl § qJgo}tgoZ\[�ik[�}tu�amnÎX.a w.w [�nÊ��go}t�vlL�Z�l w [�fmu�ª � � ��� ��� �!������ � � � � ����� �� "�� ��¶6�r�=�r¸$¾s]=�r� �;]®�o¼bª

�amuyukgons[�n˾��sªM¶��S»o¼r»=¸�ª;`®ikl;z�XJgouyitamzz�loZ\q.fc[�{baci¯xeamn�uyi�gjikamu�ikaczVgofJacn.­®d.am}�xrª�� ���!"�� ���� � � � ����� � ������ � �� ��� � ���� � Tª

�l;[ w [�}�¾ /�ª#gvn w � ª�± ª�¿Àgoutuy[�}tZ\gon ¶º�S»r»=�r¸$ª#|~}tgoz�itamzVgvf£´%gVxo[�utamgon ��[�n.uta³i¯xÉÌ~uyitamZ\gvikaclrnÀÃ1utacn.���a©{;ikd.}y[�u1l § �1lr}tZ\gofcu�ª � � � � ����� � �/� � � � �� ��� �� � � ��� ���� ��� ��� � ��� � �� ��� ������ =¾J¼r»o]��b»r�=�bª

`;z�X®¥£go}y¹o¾ )�ª1¶��S»=�v¼=¸�ªBÌ~uyitamZ\gvikacn.�ÄikXs[ w acZ\[�n.utaclrn+l § gÁZ�l w [�f«ª � � � � ��� � � � � � ��� ���� �������j¾] *b� �;] *o]sª

`®i�gon § lo} w ¾@��ª�¶��V»r»r»=¸$ª �0���� � � � ��� ��� ����� �� � � �� � ��� � " � � � � � � � � � � ����� ���� �� "� � � �����+�� ������ ���� ���� ����� � ��� � ���� � � � � ������� ����ªT|BX@ª ��ªTikXs[�utacu�¾ ��[�q.go}yitZ\[�n®i�l § `®i�gvitamuyitamz�u�¾MÃ�n.a³�r[�}tuta³i¯x�l §¿ÀgoutXsamn.�oitlrn˾T`;[Vgviyikfm[vª

Û�Û Ö PRQ�SUTUV

Page 31: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�o¼ ������������� ���������� ��������������������� ��!���!"

`;ikgon § lr} w ¾@� ªsgon w ±�ª;�1g § ik[�}yxE¶·�J[�¢s}tdJgo}�x-�o�r�s�L¸$ª ��[�it[�}yZ\acn.amn.�(ikX.[ ��d.Z�¢8[�}�l § ¬£lrfmlr}yu£lr} ) }kgVx� [��r[�fmu¦amnÎgon+µ¯Z\go�r[�Ã1utamns�Q±�q.q.}ylS{bacZ-gvit[�´%gVxr[�u-�Tgoz�iklr}yu�Í�W�X.['|~ut[�d w lrfcam�v[�fmacX.l;l w µ¯n § lr}�¤Z-gjikamlonʬ£}ta³ik[�}tamlon²¶·| � µ�¬�¸�ª£W�[�z�X.n.amz�gof°}y[�qMlr}yi�¾ ��[�qJgo}�ikZ�[�n=i�l § `®i�gvitamuyitamz�u�¾1Ã�n.a³�r[�}tuta³i¯x l §¿ÈgvutX.acn.�oiklon˾.X=ititqËÍ����j¥�¥�¥^ªýu�i�gvi�ª ¥£gouyX.amn.�viklrn˪ [ w d��bª

�@XJgons�.¾G|�ª1¶��V»r»r�=¸$ª~��l w [�f�uy[�fc[�z�itamlrnÈ�;amgÁZ�d.fcita § lrf w z�}ylrutu��vgofca w gvitamlrn@ª � � � � ��� �%� � � ����� ������ ����� �o¾T�v»r»��b�s�V�sª

� /�/>������$0����>�%���(��� � ��� ���#�Ë� �^�Â���%� �(/�/����10-��2 � ����� ���I�v�^�������/�� �?����������� �����'�G����� � ���Ê� � ,J�£�(���(�� �(�)�?�¡2 �\�����

W�X.[�nsloi�gvitamlrn�acu~ikXJgviGl § `b[�z�ikaclrn�].ª �;ªB¬£lrn.uya w [�}tamns�(uyamZ�q.fm[|?loititu�Z�l w [�fcu�¾=lrd.}BgvamZ acuÂikl(amfmfcd.uyit}kgvit[ikXJgvi *-,-. ¶O[�­®dJgvitamlrn ¶�� ( ¸t¸ zVgonÆ¢8[\g'¢M[�iyik[�}egoq.qs}tlV{bamZ\gvikaclrn>l § itXJgonQikX.[�uyikgon w go} w Z�[Vgon J[�f w gvq.q.}tlV{bamZ\gvitamlrn ��� ª~W�X.[ [�n.[�}y�ox�l § g¦|�loiyiku1Z\l w [�fËzVgon�¢M[ ¥}taciyik[�n

� � " � 8 � : � 8 ����*0& �� &10 : � 8

<��� , �& �� �0)# '&% �('

&10 �

aci § lrfcfmlS¥u%ikXs[ ¹�[�}yloikX'lr} w [�}Z�[Vgon� J[�f w goq.q.}ylS{bacZ-gvitamlrn

� ��� � " � 8 � : � 8��� , �& �� �0)# '&% �('

& 0 �

¥acikX & 0 : ��� ��� � � 0 � ª~W�Xs[�n��� ��� � � � � � 8 � � : � 8

<��� , �& �� �0)# '&% �('

& 0 : L< ��� ��� � � ��� � � � 8 � � �

utl¦ikXJgvi ��� : �

"����� ����� ��� � " � 8 � ��:

��� , �

� , /����� � 8 & �� �

0 # ' % � '& 0 �7�

gon w *-,-. : ��� ����� �!��� ��� � � � � � 8 � � ��: ��� ����� ��� 8

<��� , �& �� �0)# '&% �('

& 0 ��?

Ã�utacn.�Quyx;Z\Z�[�it}tac[�u�¾ § lr}�gofmf � : L �U?U? ? � ¾£¥�[�z�gonÏ¥}yacik[ &�� :� ¥a³ikX ¢M[�amns�.¾�acnÎitX.[�i¯¥�lv¤z�lrfclr}^zVgouy[o¾#itX.[�i¯¥�lv¤Ýz�lrZ�q8lon.[�n=i��o[�z�iklr}�� � � � � ! � � ukgjikamu § x;amn.��� � � � ! :;L gon w itX.[ § lofmfmlS¥acn.�z�lrn.uyamu�ik[�nsz�x�z�lon w acitamlrnsu�¾

-/.�Û0-/1

Page 32: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �o»

� � : ����� � 8 5 � � ������ � 8 5 � � � � ����� � 8 5 � ! �� ! : ����� � 8 5 � ! �

����� � 8 5 � � � � ����� � 8 5 � ! � �¥X.[�}t[ 5 : � 5 � � � �;amu%ikXs[(n®d.Z�¢8[�}1l § n.[�am�rX®¢Mlr}tugvututdsZ\[ w ikXs[(utgoZ�[ § lr}gofmf8uta³ik[�u�ªW�X.acu1acu�[�­®d.a³�ogvfm[�n=i�itl�uylrfc�o[

� � : �)� � � 8 5 � � ������ � 8 5 � � � ������� � 835 � L � � � � �: L

L ������� � 835 � L � < � � � � ? ¶«� ( ¸

��lvik[¦ikXJgvi a § � � utgvikacuy J[�u�¶«� ( ¸�¾�ikX.[�n L � � � amu gofmuyl�uylrfmdsitamlrn@ªp�Jlr} 8 � ���(5 ¾ ��� ��� 8 � <�� 5ikXs[�}t[�amuGlrn.f³x¦lrn.[�uylrfmdbikamlon � � :ML�� < ª~�Jlr} 8 8 <�� 5 ikXs[�}t[�go}t[i¯¥�l¦g w.w a³ikamlonJgof.uylrfmdsitamlrnsu � � gvn wL � � � ¥acitX � � 8 L�� < ª�¿Æ[ § l;z�dsu�lrn'utlofmdsitamlrn.u � � �: L�� < ª�`bdsz�XÄg\uylrfmdbikamlon'acu1g\n.lrn;¤¯z�lon.uyikgon=i§ d.n.z�ikaclrnÄl § 8 ¥X.lout[�z�fclrut[ wE§ lr}yZ [${bq.}t[�ututaclrnÁamu�n.loi gV�vgoacfhgo¢.fc[oª � lS¥�[��o[�}�¾)dsutamns�Á¶«� ( ¸�¾ 8 z�gon>¢M[[�{bq.}y[�uyut[ w gou1g § dsn.z�itamlrn��Äl § � � �ra³�r[�n�¢=x

8 : � � � � � : L5 � L � < � � � �� � �

L � � �� � � ? ¶«� *=¸

µÝi�amuG[Vgou�x�itl z�Xs[�z��\itXJgvi � � L � � � � : � � � � � utl(ikXJgviGi¯¥�leuyx;Z�Z\[�ik}taczutlrfcdsikaclrn.uBfm[�g w itl itX.[�utgoZ�[8 gvu [�{bq8[�z�it[ w ª¦¿À[�z�gonÆgofmuyl�z�X.[�z��>ikX.gvi�� � � � � it[�n w u^itl <��(5 ¥X.[�n � � ik[�n w u ikl L�� < gon w itlamnb Jn.aci¯x\¥X.[�n � � it[�n w uitl��oª~W�X.[^�r}kgoqsX�l § � � ���� 8 amu�uyX.lS¥nEamn'�#ac�rd.}y[ *sªW�X.[G­;d.gon=ikaci¯x � � goq.qM[Vgo}yu�acn ikX.[G[�{bq.}y[�utuyamlrnsu#l § ��� gvn w *-,-. ¾L¥X.amfc[ÂikX.[Bik}yd.[ w [�q8[�n w u

lrn.f³x�lrn 8 ª � lS¥£[��r[�}�¾s¥X.[�n amuGgV�vgoamfmgo¢.fc[�amn�z�fmlout[ w�§ lr}tZ'¾=d.uyamn.�p¶«� *=¸$¾=ikX.[ikX.}y[�[�­;d.gon=ikacitam[�u�z�gon¢M[([${bq.}t[�utut[ w gon w z�loZ\qJgv}t[ w gou § d.nsz�ikaclrn.u�l § � � ªB�Jlr}�qM[�}tacl w amz°¢Mlrd.n w go}yx�z�lrn w a³ikaclrn.u�¾baciz�lrZ\[�u

��� : � ����� � 8 5 � � � � ����� � 8 5 � L � � � � � � � ¶«�r�r¸

gon w

*-,-. : ��� ����� ��� 8< 5 � �

! � � � L � � � � ! � �&? ¶«�o¼=¸

µÝi § lrfmfclS¥u�¾sdsutamns�E¶·� ( ¸

�� � � ���� � : 8 5� � � � �� � � L ���)��� � 8 5 � L � < � � � � � ¶«�o»=¸: 8 5� � � � ���� � � � �

Û�Û Ö PRQ�SUTUV

Page 33: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

�r� ������������� ���������� ��������������������� ��!���!"

beta

m1

0 1 2 3 4

0.0

0.2

0.4

0.6

0.8

1.0

������������ �������������������������! "��#��������%$!�'&&�(�)�*����+ ,��������&�������.-0/214365879/21:;�'<=&?>���)��'�2@�����A#����B�����C&?���#�DE#��������F&?���'���G�'�;HJI��'�������K�'���

LNM�O -QPSR�T�UV:XW H Y[Z]\ -_^'/21[7 Y /a`1 7b5":dc \ L�M�O -C5ecgfihBj!-_H Z -k5%7 Y /21�::�:Gl m_n�oqpr �����q�'����sPutv�w#��N�����A<0����x���8���'&s�6I��'�N�y�'z��Ns���A��������'�+Ks{%�}|~4I����t��N�2&?>�w������������������������#6�'��s<0�'�,|;>���#�> Z W Y �'��i�B�������N���]�'<�P ���

P W -_f4hBj!-0H�:dc�5":k�;c�-_fihBj!-_H�:�7b5":���l��&;���,&?>���2��'��D�&?��#��������'��(&?>�s�N���q�'���N&?>��)��K[����� Z W Y t

L�M�O -QP��[��:XW Y \ /21kHac \ L�M�O -k5�cgf4hBj!- Y H�-C5G7 Y /21�:�::L�M'O -+P R�T�U :XW \ -0^�/21�7 Y / ` 1 7�5":CHwc \ LNM�O -C5ec9f4hBj�- Y H�-k5G7 Y /21::�:L�M'O -+PS:XW \ Hwc \ LNM�O -k5~c9f4hBj!-C7%H�::dc L�M�O)� 5�c � 5;7�f4hBj!-C7%H�:5�cgf4hBj!-k78H�:�� � � l�����GHJ��5�t�/21=W�5"� Y t��N&,#�������

L�M'O -+P ��� :�W \ Hac \ L�M�O - Y :~3L�M�O -QP R�T�U :�W \ H Y c \ L�M�O - Y :~l�0���d�0�

Page 34: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � "'" ��� �����'����� � " �� �� ������� ����� � ��� �� � � ����� � " ���� � �� � ���� " � �����'� ����� ����� ��� ��� ������ �s�

beta

Par

titio

n fu

nctio

n lo

garit

hm a

nd 2

app

roxi

mat

ions

0 1 2 3 4

100

200

300

400

���N�������B ��������N�)�����N�����'�Gm Z W Y p� }��#��'�����s$!�'&&� ���B����=|;�N&?> \ W 5����]���N&��� 4���'#�& ���'�C&?�N&�����<0����#4&?�N��� �N���q�'���N&?>�� m_����������E#�����I�6p��'���g&�|~� �'�������}�B�N����&��������<0�'�)H�����K�G>�2#����������#����CI�#��'����� �������;&?� LNM�O P R�T�U �'���a&>�s�'&?>���;�����&?� L�M'O P ��� K�G>�s#��'����� �������N�������?�'��>��%�'����>��}|;�2���]���N�������BK��>���EH���5 &?>���s��� �����'���'�FD*&��#��'��4�B������������a<0���,/21����G��<0����#4&?�N���a�'<VH z���&,|��#6���a�����'&&?>������'��>���z D �N� I'��C&?������m+ ��qp)m� B�������'������piK��%�'&?�&?>���& LNM�O -+P ��� :��'��� L�M'O -+P R�T�U :����)�'�N�&?>�(�?�'�� |;>���E/21~�N�~#�>���������a&�w5~7 /214K=��&;�'��� ��'��,#�����'��FD)�'�w&?>�(�����'&�&?>���& L�M�O -+P R�T�U :����~�<_�'�Gz �&�&?��%�'������6�B���)��&?�N���w�'<!&?>� i���'#�& L�M'O -+PS:�&?>��'� LNM�O -QP ��� :4K���������������������� ������&?�� &>��'���'t�&?>����6�'� @���N� �'������6�B���)��&?�N��� 4�B��������������am+ ���ps�'���bm+ ��qp�'����C&?�N����I��'�N��� z��B& &>��#���������&?��&?�N��� �'<e&?>��&?����)P ����i�B� ������q&?���'���FDA#��'�)���N4� K��J)�����&��N#�&?��&?>����&?� ������s����N�vt�������� \ W�����N&����'����#���������������)���#�#�����FI���ND Z W ^ �'��� Z W� �����N��> z �'���K����� Z W ^�t�&>�s4���'#4&8���'��&�N&?�N���w<0����#4&?�N���E����t

P W 5!� Y f4hBjV-�"'H�: c 5�^�^�f4hBjV-� �H�: c 5!�� =fih�jv-C5!��H�: cJ^# =fih�j!-k5 Y H�:�c 5! =f4hBjV-k56^�H�:�c Y fihBjV-C5! �H�:~l����� Z W$ �t��F&G#��'�)��P W Y�%�Y fih�jd-C5!"'H�:vc�5!"� =f4hBjV-k5! 'H�:vc'& Y f4hBjV- Y'Y H�:vc 5! =fih�j!- Y 'H�:vc Y fihBjV-���"�H�:il

�G>�����'�C&?�F&?���'��<0����#4&?�N���A���'�q�'��F&?>�� �'��� �N&�(�'������6�B���)��&?�N�����8�'� �>��}|;� ��� ������������(�w�'���*)�K���)&>�%�������?�'��#��'��tB|;>���wH2&?������e&?� �N��@����F&�D�t*P z �>��6I'��sm0�N<,+ ������'&?���&?>�8� ���.z ��e�'<d#������'���p�'�-+Sf4hBj!- \vZ H�� Y :4t |;>��N#�> ���8&>�������������'�q&8&��� ���2&>������ �}I���s�'���!� �'���Nz����#����B@��������&?�N������K�V�/.�02143�5�6

Page 35: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

��� ������� ����������� ������������������ �!" #�$���$%

beta

Par

titio

n fu

nctio

n lo

garit

hm a

nd 2

app

roxi

mat

ions

0.0 0.5 1.0 1.5 2.0

1020

3040

��������� �� "��#������'��$��'&�&?���)�*�������� � � � �E����N�vt Z W ^�������'>*z ������ 4���'#�&����'�C&?�F&?���'�A<0����#�&����������q����N&>��Xm0�)�N������s#�����I'}p(�'����&�|~�E�'������6�B���)��&?�N�����G<0���8H'����K �G>�.#���������8#����CI��#��'����� �������&?� L�M�O P R�T�U �'���a&?>�s�'&>���;����s&� L�M�O P �[� K�G>�2&?��� \vZ � Y ���)&>�A�)���B���.��� �*���.z ��w�'<�>����)�'�����������w#����'&*�����K���&w�*#�#������<0���)6�'#�>b��<&?>� + �������*#��'������#�����@������?��&?���'����K �G>����<0�'�'te|;>��� H &�������&?� �N��@����F&�D L�M�O -+PS: z �>��6I���w�'�\vZ H�� Y c LNM�O + K���>���J�N�B��(*�N���a��&(4�B���������������m+ )qp �'��� m_n�oqp8�F&s�'��� 6�'���(&?>���&�|;>��� H &������&?�����B@����N&�D't�/21�&?������G&?��o����(� �'���E�N�az �'&>E#6�'���� L�M�O -+P �[� :~z �>��6I'��8�'� \vZ H �'��� LNM�O -+P R�T�U :�'� \vZ H�� Y K �G>��N�G������'���&�,|,�6D*�G&?���N�)�����}I� &>�s�'�������6���N����&?���'����K �G>� L�M�O - Y :=W$�Bl "��.���') �����#�z 4&�|~��� L�M�O -+PS:!����� L�M'O -+P R�T�U :V�'��� 6�'���[�)�'�e#�����'��FDs���.������������ � �'����)�K r �q�'��� t LNM�O -+P R�T�U :�'��� 6�'���;&��z ���.��#�>]z 4&&��%�'�������6���N����&?���'�w�'< L�M�O -QPS:�&?>��'� L�M'O -+P ��� :4K

�0���d�0�

Page 36: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

� � %�% ��� ������� � � � % � ��� ���� � � ���� � ��� � � � ���� % ���� ��� � � � % ������ � ��� ����� ��� ��� � ���� � �

beta

Par

titio

n fu

nctio

n lo

garit

hm a

nd 2

app

roxi

mat

ions

0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4

1020

3040

50

���N����� )B . "��#����N���s$���&&?� ���B����[��� ��� �����������vt Z W E����N��> z �'��� 4���'#4& ���'��&�N&?�N��� <0����#4&?���'����'�q�'��F&?>�� m_���������Ns#����CI�}p(�����2&�|��E�'�������}�B�N����&�������;<0�'� H ����K(�G>�.#��N����� #�����I��#���������� �������&?� LNM�O P R�T�U �'���E&?>� ��&?>���G�����&?� L�M'O P ��� K

�V�/.�02143�5�6

Page 37: Hidden Markov Models Selection Criteria based on Mean ... · Hidden Markov Models Selection Criteria based on Mean Field-like approximations Florence Forbes, Nathalie Peyrard To cite

Unité de recherche INRIA Rhône-Alpes655, avenue de l’Europe - 38330 Montbonnot-St-Martin (France)

Unité de recherche INRIA Lorraine : LORIA, Technopôle de Nancy-Brabois - Campus scientifique615, rue du Jardin Botanique - BP 101 - 54602 Villers-lès-Nancy Cedex (France)

Unité de recherche INRIA Rennes : IRISA, Campus universitaire de Beaulieu - 35042 Rennes Cedex (France)Unité de recherche INRIA Rocquencourt : Domaine de Voluceau - Rocquencourt - BP 105 - 78153 Le Chesnay Cedex (France)

Unité de recherche INRIA Sophia Antipolis : 2004, route des Lucioles - BP 93 - 06902 Sophia Antipolis Cedex (France)

ÉditeurINRIA - Domaine de Voluceau - Rocquencourt, BP 105 - 78153 Le Chesnay Cedex (France)��������� ���� ���������� ��� ���

ISSN 0249-6399