《對(duì)稱(chēng)信道與弱對(duì)稱(chēng)信道的信道容量.ppt》由會(huì)員分享,可在線閱讀,更多相關(guān)《對(duì)稱(chēng)信道與弱對(duì)稱(chēng)信道的信道容量.ppt(23頁(yè)珍藏版)》請(qǐng)?jiān)谘b配圖網(wǎng)上搜索。
1、1、對(duì)稱(chēng)信道矩陣的行可置換矩陣中每一行都是集合中各元素的不同排列矩陣的列可置換矩陣中每一列都是集合中各元素的不同排列對(duì)稱(chēng)信道信道轉(zhuǎn)移概率矩陣既行可置換又列可置換q,q,q M21 p,p,p N21 pp pp)1/1(P)1/0(P )0/1(P)0/0(P)X/Y(P )X/Y(PX/Y1:二進(jìn)制對(duì)稱(chēng)信道例p,p,p,p行可置換 p,p,p,p列可置換 6/13/13/16/1 3/16/16/13/1)1/3(P)1/2(P)1/1(P)1/0(P )0/3(P)0/2(P)0/1(P)0/0(P)X/Y(P )X/Y(PX/Y422對(duì)稱(chēng)信道:例6/1,3/1,3/1,6/1,3/1,6
2、/1,6/1,3/1行可置換 6/1,3/1,3/1,6/1,3/1,6/1,6/1,3/1列可置換 2、對(duì)稱(chēng)信道的信道容量信道容量C達(dá)到信道容量C的信源概率P(X)q,q,q(HMlogC 1M21 N,2,1iN1)x(P i 對(duì)稱(chēng)信道行可置換)q,q,q(Hqlogqqlogq)x(P )x/y(Plog)x/y(P)x(P)x/y(Plog)x/y(P)x(P)X/Y(H 1M21M1j jjN1i M1j jji N1i M1j ijijiN1i M1j ijiji )q,q,q(HMlog)q,q,q(H)Y(Hmax )X/Y(H)Y(Hmax)Y;X(ImaxC 1M21?1M
3、21)X(P )X(P)X(P 信宿等概率是否可達(dá)?對(duì)稱(chēng)信道列可置換,不失一般性,記信道轉(zhuǎn)移概率矩陣 1N N1N 32 21 pp pp pp pp)X/Y(P 如果信宿等概率 M1)x(Pp)x(Pp)x(Pp)x(Pp)y(P M1)x(Pp)x(Pp)x(Pp)x(Pp)y(P N11NN23122 NN1N1N22111 )x(P)x(P)x(P N21 解出 N,2,1iN1)x(P 1)x(NP)x(Pi iN1i i pp pp)X/Y(P )X/Y(PX/Y3:二進(jìn)制對(duì)稱(chēng)信道例求信道容量C及達(dá)到C的信源概率P(X)plogpplogp1)p(H2logC 21)1(P)0(P
4、 6/13/13/16/1 3/16/16/13/1)X/Y(P )X/Y(PX/Y424對(duì)稱(chēng)信道:例求信道容量C及達(dá)到C的信源概率P(X) )bit(082.061log61231log3122)61,61,31(H4logC 21)1(P)0(P 3、弱對(duì)稱(chēng)信道弱對(duì)稱(chēng)信道信道轉(zhuǎn)移概率矩陣行可置換,且按列分為s個(gè)不相交的子信道,各子信道的轉(zhuǎn)移概率矩陣既行可置換又列可置換 10 01)1/1(P)1/e(P)1/0(P )0/1(P)0/e(P)0/0(P)X/Y(P )X/Y(PX/Y5:二進(jìn)制刪除信道例1,0,0,1 行可置換按列分為兩個(gè)不相交的子信道 10 01)1/1(P)1/0(P
5、)0/1(P)0/0(P)X/Y(P1 1,0,0,1 行可置換 1,0,0,1 列可置換 )1/e(P )0/e(P)X/Y(P2 , 行可置換 , 列可置換 4、弱對(duì)稱(chēng)信道的信道容量信道容量C達(dá)到信道容量C的信源概率P(X)個(gè)子信宿的平均概率為第個(gè)子信宿的消息個(gè)數(shù),為第其中kPkm )q,q,q(HPlogPmC kk 1M21s1k kkk N,2,1iN1)x(P i 弱對(duì)稱(chēng)信道行可置換)q,q,q(Hqlogqqlogq)x(P )x/y(Plog)x/y(P)x(P)x/y(Plog)x/y(P)x(P)X/Y(H 1M21M1j jjN1i M1j jji N1i M1j iji
6、jiN1i M1j ijiji )q,q,q(HMlog)q,q,q(H)Y(Hmax )X/Y(H)Y(Hmax)Y;X(ImaxC 1M21?1M21)X(P )X(P)X(P 信宿等概率是否可達(dá)? 9.01.00 01.09.0)X/Y(P設(shè)如果信宿等概率31)x(P9.0)y(P 31)x(P1.0)x(P1.0)y(P 31)x(P9.0)y(P 23 212 11 0)x(P)x(P 0)x(P1.0)x(P8.0 21 21 矛盾!信宿等概率不可達(dá) 按列分為s個(gè)不相交的子信道,各子信道的轉(zhuǎn)移概率矩陣既行可置換又列可置換對(duì)應(yīng)于各子信道的子信宿等概率是否可達(dá)?)q,q,q(HPlog
7、Pm)q,q,q(H)Y(Hmax )X/Y(H)Y(Hmax)Y;X(ImaxC 1M21kks1k k?1M21s1k k)X(P )X(P)X(P 弱對(duì)稱(chēng)信道的子信道列可置換,不失一般性,記第k個(gè)子信道的轉(zhuǎn)移概率矩陣s,2,1kpp pp pp pp)X/Y(P 1kkN kN1kN 3k2k 2k1kk 如果子信宿等概率 s,2,1kP)x(Pp)x(Pp)x(Pp)x(Pp)y(P P)x(Pp)x(Pp)x(Pp)x(Pp)y(P kN1k1NkN23k12k2k kNkN1N1kN22k11k1k )x(P)x(P)x(P N21 解出N,2,1iN1)x(P 1)x(NP)x(P i iN1i i s,2,1kpN1P N1i kik 9.01.00 01.09.0)X/Y(P )X/Y(PX/Y6:二進(jìn)制刪除信道例求信道容量C及達(dá)到C的信源概率P(X) 9.00 09.0)X/Y(P1 1.01.0)X/Y(P2 45.0)09.0(21p21P2m 21i i111 ,1.0)1.01.0(21p21P1m 21i i222 ,)bit(9.0 1.0log1.09.0log9.01.0log1.045.0log9.0 )1.0,9.0(H1.0log1.0145.0log45.02C 21)1(P)0(P