← Back to MoNaVLA
Action-Token Attention Analysis
Action token이 image(64) 영역과 text 영역 중 어디에 attend하는지 측정합니다.
각 모델에 동일 이미지(한 개)를 주고 좌/우/전진 instruction을 바꿔가며 forward 후, 마지막 layer의 action row에서 image/text region attention 합계를 비교합니다.
가설: image_ratio가 text_ratio를 크게 상회하면 instruction 무시의 구조적 원인이 확인됨.
Summary (Last Layer / Mean over Layers)
| Model | Instruction | text_len |
Last Img% | Last Text% |
Mean Img% | Mean Text% |
| exp41b_resume_exp40_pta | left | 12 | 100.0% | 0.0% | 83.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 12 | 100.0% | 0.0% | 83.6% | 0.0% |
| exp41b_resume_exp40_pta | forward | 11 | 100.0% | 0.0% | 83.5% | 0.0% |
| exp41c_scratch_pta | left | 12 | 98.9% | 0.0% | 61.3% | 0.0% |
| exp41c_scratch_pta | right | 12 | 98.9% | 0.0% | 61.3% | 0.0% |
| exp41c_scratch_pta | forward | 11 | 98.6% | 0.0% | 61.2% | 0.0% |
| exp42_counterfactual_pta | left | 12 | 99.0% | 0.0% | 63.4% | 0.0% |
| exp42_counterfactual_pta | right | 12 | 99.0% | 0.0% | 63.4% | 0.0% |
| exp42_counterfactual_pta | forward | 11 | 99.0% | 0.0% | 63.1% | 0.0% |
| exp43_cross_attn_text | left | 12 | 99.7% | 0.0% | 67.0% | 0.0% |
| exp43_cross_attn_text | right | 12 | 99.7% | 0.0% | 67.0% | 0.0% |
| exp43_cross_attn_text | forward | 11 | 99.7% | 0.0% | 67.0% | 0.0% |
Per Layer
| Model | Instruction | Layer |
Image% | Text% |
| exp41b_resume_exp40_pta | left | 0 | 46.4% | 0.0% |
| exp41b_resume_exp40_pta | left | 1 | 22.3% | 0.0% |
| exp41b_resume_exp40_pta | left | 2 | 12.1% | 0.0% |
| exp41b_resume_exp40_pta | left | 3 | 32.6% | 0.0% |
| exp41b_resume_exp40_pta | left | 4 | 63.7% | 0.0% |
| exp41b_resume_exp40_pta | left | 5 | 71.7% | 0.0% |
| exp41b_resume_exp40_pta | left | 6 | 86.3% | 0.0% |
| exp41b_resume_exp40_pta | left | 7 | 89.5% | 0.0% |
| exp41b_resume_exp40_pta | left | 8 | 95.0% | 0.0% |
| exp41b_resume_exp40_pta | left | 9 | 98.6% | 0.0% |
| exp41b_resume_exp40_pta | left | 10 | 97.3% | 0.0% |
| exp41b_resume_exp40_pta | left | 11 | 95.9% | 0.0% |
| exp41b_resume_exp40_pta | left | 12 | 98.8% | 0.0% |
| exp41b_resume_exp40_pta | left | 13 | 99.4% | 0.0% |
| exp41b_resume_exp40_pta | left | 14 | 99.2% | 0.0% |
| exp41b_resume_exp40_pta | left | 15 | 99.0% | 0.0% |
| exp41b_resume_exp40_pta | left | 16 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | left | 17 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | left | 18 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | left | 19 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | left | 20 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | left | 21 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | left | 22 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | left | 23 | 100.0% | 0.0% |
| exp41b_resume_exp40_pta | right | 0 | 46.4% | 0.0% |
| exp41b_resume_exp40_pta | right | 1 | 22.3% | 0.0% |
| exp41b_resume_exp40_pta | right | 2 | 12.1% | 0.0% |
| exp41b_resume_exp40_pta | right | 3 | 32.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 4 | 63.7% | 0.0% |
| exp41b_resume_exp40_pta | right | 5 | 71.7% | 0.0% |
| exp41b_resume_exp40_pta | right | 6 | 86.3% | 0.0% |
| exp41b_resume_exp40_pta | right | 7 | 89.5% | 0.0% |
| exp41b_resume_exp40_pta | right | 8 | 95.0% | 0.0% |
| exp41b_resume_exp40_pta | right | 9 | 98.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 10 | 97.3% | 0.0% |
| exp41b_resume_exp40_pta | right | 11 | 95.9% | 0.0% |
| exp41b_resume_exp40_pta | right | 12 | 98.8% | 0.0% |
| exp41b_resume_exp40_pta | right | 13 | 99.4% | 0.0% |
| exp41b_resume_exp40_pta | right | 14 | 99.2% | 0.0% |
| exp41b_resume_exp40_pta | right | 15 | 99.0% | 0.0% |
| exp41b_resume_exp40_pta | right | 16 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | right | 17 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 18 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 19 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | right | 20 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | right | 21 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | right | 22 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | right | 23 | 100.0% | 0.0% |
| exp41b_resume_exp40_pta | forward | 0 | 46.2% | 0.0% |
| exp41b_resume_exp40_pta | forward | 1 | 21.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 2 | 11.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 3 | 32.8% | 0.0% |
| exp41b_resume_exp40_pta | forward | 4 | 63.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 5 | 72.4% | 0.0% |
| exp41b_resume_exp40_pta | forward | 6 | 86.8% | 0.0% |
| exp41b_resume_exp40_pta | forward | 7 | 89.2% | 0.0% |
| exp41b_resume_exp40_pta | forward | 8 | 95.2% | 0.0% |
| exp41b_resume_exp40_pta | forward | 9 | 98.3% | 0.0% |
| exp41b_resume_exp40_pta | forward | 10 | 97.1% | 0.0% |
| exp41b_resume_exp40_pta | forward | 11 | 95.4% | 0.0% |
| exp41b_resume_exp40_pta | forward | 12 | 98.8% | 0.0% |
| exp41b_resume_exp40_pta | forward | 13 | 99.3% | 0.0% |
| exp41b_resume_exp40_pta | forward | 14 | 99.1% | 0.0% |
| exp41b_resume_exp40_pta | forward | 15 | 98.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 16 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | forward | 17 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | forward | 18 | 99.5% | 0.0% |
| exp41b_resume_exp40_pta | forward | 19 | 99.6% | 0.0% |
| exp41b_resume_exp40_pta | forward | 20 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 21 | 99.9% | 0.0% |
| exp41b_resume_exp40_pta | forward | 22 | 99.7% | 0.0% |
| exp41b_resume_exp40_pta | forward | 23 | 100.0% | 0.0% |
| exp41c_scratch_pta | left | 0 | 31.6% | 0.0% |
| exp41c_scratch_pta | left | 1 | 38.9% | 0.0% |
| exp41c_scratch_pta | left | 2 | 5.2% | 0.0% |
| exp41c_scratch_pta | left | 3 | 16.3% | 0.0% |
| exp41c_scratch_pta | left | 4 | 27.0% | 0.0% |
| exp41c_scratch_pta | left | 5 | 21.2% | 0.0% |
| exp41c_scratch_pta | left | 6 | 26.1% | 0.0% |
| exp41c_scratch_pta | left | 7 | 27.4% | 0.0% |
| exp41c_scratch_pta | left | 8 | 30.1% | 0.0% |
| exp41c_scratch_pta | left | 9 | 38.5% | 0.0% |
| exp41c_scratch_pta | left | 10 | 61.1% | 0.0% |
| exp41c_scratch_pta | left | 11 | 74.7% | 0.0% |
| exp41c_scratch_pta | left | 12 | 67.5% | 0.0% |
| exp41c_scratch_pta | left | 13 | 84.9% | 0.0% |
| exp41c_scratch_pta | left | 14 | 89.0% | 0.0% |
| exp41c_scratch_pta | left | 15 | 83.8% | 0.0% |
| exp41c_scratch_pta | left | 16 | 91.0% | 0.0% |
| exp41c_scratch_pta | left | 17 | 96.5% | 0.0% |
| exp41c_scratch_pta | left | 18 | 90.6% | 0.0% |
| exp41c_scratch_pta | left | 19 | 90.7% | 0.0% |
| exp41c_scratch_pta | left | 20 | 91.4% | 0.0% |
| exp41c_scratch_pta | left | 21 | 89.8% | 0.0% |
| exp41c_scratch_pta | left | 22 | 99.9% | 0.0% |
| exp41c_scratch_pta | left | 23 | 98.9% | 0.0% |
| exp41c_scratch_pta | right | 0 | 31.6% | 0.0% |
| exp41c_scratch_pta | right | 1 | 38.9% | 0.0% |
| exp41c_scratch_pta | right | 2 | 5.2% | 0.0% |
| exp41c_scratch_pta | right | 3 | 16.3% | 0.0% |
| exp41c_scratch_pta | right | 4 | 27.0% | 0.0% |
| exp41c_scratch_pta | right | 5 | 21.2% | 0.0% |
| exp41c_scratch_pta | right | 6 | 26.1% | 0.0% |
| exp41c_scratch_pta | right | 7 | 27.4% | 0.0% |
| exp41c_scratch_pta | right | 8 | 30.1% | 0.0% |
| exp41c_scratch_pta | right | 9 | 38.5% | 0.0% |
| exp41c_scratch_pta | right | 10 | 61.1% | 0.0% |
| exp41c_scratch_pta | right | 11 | 74.7% | 0.0% |
| exp41c_scratch_pta | right | 12 | 67.5% | 0.0% |
| exp41c_scratch_pta | right | 13 | 84.9% | 0.0% |
| exp41c_scratch_pta | right | 14 | 89.0% | 0.0% |
| exp41c_scratch_pta | right | 15 | 83.8% | 0.0% |
| exp41c_scratch_pta | right | 16 | 91.0% | 0.0% |
| exp41c_scratch_pta | right | 17 | 96.5% | 0.0% |
| exp41c_scratch_pta | right | 18 | 90.6% | 0.0% |
| exp41c_scratch_pta | right | 19 | 90.7% | 0.0% |
| exp41c_scratch_pta | right | 20 | 91.4% | 0.0% |
| exp41c_scratch_pta | right | 21 | 89.8% | 0.0% |
| exp41c_scratch_pta | right | 22 | 99.9% | 0.0% |
| exp41c_scratch_pta | right | 23 | 98.9% | 0.0% |
| exp41c_scratch_pta | forward | 0 | 30.9% | 0.0% |
| exp41c_scratch_pta | forward | 1 | 36.6% | 0.0% |
| exp41c_scratch_pta | forward | 2 | 5.0% | 0.0% |
| exp41c_scratch_pta | forward | 3 | 16.4% | 0.0% |
| exp41c_scratch_pta | forward | 4 | 27.0% | 0.0% |
| exp41c_scratch_pta | forward | 5 | 21.0% | 0.0% |
| exp41c_scratch_pta | forward | 6 | 26.4% | 0.0% |
| exp41c_scratch_pta | forward | 7 | 28.2% | 0.0% |
| exp41c_scratch_pta | forward | 8 | 30.4% | 0.0% |
| exp41c_scratch_pta | forward | 9 | 39.6% | 0.0% |
| exp41c_scratch_pta | forward | 10 | 61.2% | 0.0% |
| exp41c_scratch_pta | forward | 11 | 74.8% | 0.0% |
| exp41c_scratch_pta | forward | 12 | 67.3% | 0.0% |
| exp41c_scratch_pta | forward | 13 | 84.6% | 0.0% |
| exp41c_scratch_pta | forward | 14 | 88.2% | 0.0% |
| exp41c_scratch_pta | forward | 15 | 83.4% | 0.0% |
| exp41c_scratch_pta | forward | 16 | 90.3% | 0.0% |
| exp41c_scratch_pta | forward | 17 | 96.4% | 0.0% |
| exp41c_scratch_pta | forward | 18 | 90.6% | 0.0% |
| exp41c_scratch_pta | forward | 19 | 90.7% | 0.0% |
| exp41c_scratch_pta | forward | 20 | 91.4% | 0.0% |
| exp41c_scratch_pta | forward | 21 | 89.6% | 0.0% |
| exp41c_scratch_pta | forward | 22 | 99.9% | 0.0% |
| exp41c_scratch_pta | forward | 23 | 98.6% | 0.0% |
| exp42_counterfactual_pta | left | 0 | 35.0% | 0.0% |
| exp42_counterfactual_pta | left | 1 | 53.2% | 0.0% |
| exp42_counterfactual_pta | left | 2 | 9.0% | 0.0% |
| exp42_counterfactual_pta | left | 3 | 10.6% | 0.0% |
| exp42_counterfactual_pta | left | 4 | 22.8% | 0.0% |
| exp42_counterfactual_pta | left | 5 | 22.6% | 0.0% |
| exp42_counterfactual_pta | left | 6 | 30.5% | 0.0% |
| exp42_counterfactual_pta | left | 7 | 34.3% | 0.0% |
| exp42_counterfactual_pta | left | 8 | 32.0% | 0.0% |
| exp42_counterfactual_pta | left | 9 | 46.2% | 0.0% |
| exp42_counterfactual_pta | left | 10 | 63.0% | 0.0% |
| exp42_counterfactual_pta | left | 11 | 82.7% | 0.0% |
| exp42_counterfactual_pta | left | 12 | 83.6% | 0.0% |
| exp42_counterfactual_pta | left | 13 | 90.5% | 0.0% |
| exp42_counterfactual_pta | left | 14 | 93.0% | 0.0% |
| exp42_counterfactual_pta | left | 15 | 87.0% | 0.0% |
| exp42_counterfactual_pta | left | 16 | 91.9% | 0.0% |
| exp42_counterfactual_pta | left | 17 | 92.6% | 0.0% |
| exp42_counterfactual_pta | left | 18 | 81.0% | 0.0% |
| exp42_counterfactual_pta | left | 19 | 87.6% | 0.0% |
| exp42_counterfactual_pta | left | 20 | 85.9% | 0.0% |
| exp42_counterfactual_pta | left | 21 | 91.5% | 0.0% |
| exp42_counterfactual_pta | left | 22 | 96.7% | 0.0% |
| exp42_counterfactual_pta | left | 23 | 99.0% | 0.0% |
| exp42_counterfactual_pta | right | 0 | 35.0% | 0.0% |
| exp42_counterfactual_pta | right | 1 | 53.2% | 0.0% |
| exp42_counterfactual_pta | right | 2 | 9.0% | 0.0% |
| exp42_counterfactual_pta | right | 3 | 10.6% | 0.0% |
| exp42_counterfactual_pta | right | 4 | 22.8% | 0.0% |
| exp42_counterfactual_pta | right | 5 | 22.6% | 0.0% |
| exp42_counterfactual_pta | right | 6 | 30.5% | 0.0% |
| exp42_counterfactual_pta | right | 7 | 34.3% | 0.0% |
| exp42_counterfactual_pta | right | 8 | 32.0% | 0.0% |
| exp42_counterfactual_pta | right | 9 | 46.2% | 0.0% |
| exp42_counterfactual_pta | right | 10 | 63.0% | 0.0% |
| exp42_counterfactual_pta | right | 11 | 82.7% | 0.0% |
| exp42_counterfactual_pta | right | 12 | 83.6% | 0.0% |
| exp42_counterfactual_pta | right | 13 | 90.5% | 0.0% |
| exp42_counterfactual_pta | right | 14 | 93.0% | 0.0% |
| exp42_counterfactual_pta | right | 15 | 87.0% | 0.0% |
| exp42_counterfactual_pta | right | 16 | 91.9% | 0.0% |
| exp42_counterfactual_pta | right | 17 | 92.6% | 0.0% |
| exp42_counterfactual_pta | right | 18 | 81.0% | 0.0% |
| exp42_counterfactual_pta | right | 19 | 87.6% | 0.0% |
| exp42_counterfactual_pta | right | 20 | 85.9% | 0.0% |
| exp42_counterfactual_pta | right | 21 | 91.5% | 0.0% |
| exp42_counterfactual_pta | right | 22 | 96.7% | 0.0% |
| exp42_counterfactual_pta | right | 23 | 99.0% | 0.0% |
| exp42_counterfactual_pta | forward | 0 | 33.8% | 0.0% |
| exp42_counterfactual_pta | forward | 1 | 44.7% | 0.0% |
| exp42_counterfactual_pta | forward | 2 | 7.9% | 0.0% |
| exp42_counterfactual_pta | forward | 3 | 10.4% | 0.0% |
| exp42_counterfactual_pta | forward | 4 | 22.5% | 0.0% |
| exp42_counterfactual_pta | forward | 5 | 22.7% | 0.0% |
| exp42_counterfactual_pta | forward | 6 | 31.1% | 0.0% |
| exp42_counterfactual_pta | forward | 7 | 34.8% | 0.0% |
| exp42_counterfactual_pta | forward | 8 | 32.6% | 0.0% |
| exp42_counterfactual_pta | forward | 9 | 46.3% | 0.0% |
| exp42_counterfactual_pta | forward | 10 | 63.8% | 0.0% |
| exp42_counterfactual_pta | forward | 11 | 83.3% | 0.0% |
| exp42_counterfactual_pta | forward | 12 | 84.1% | 0.0% |
| exp42_counterfactual_pta | forward | 13 | 90.8% | 0.0% |
| exp42_counterfactual_pta | forward | 14 | 93.0% | 0.0% |
| exp42_counterfactual_pta | forward | 15 | 86.7% | 0.0% |
| exp42_counterfactual_pta | forward | 16 | 91.6% | 0.0% |
| exp42_counterfactual_pta | forward | 17 | 91.9% | 0.0% |
| exp42_counterfactual_pta | forward | 18 | 80.1% | 0.0% |
| exp42_counterfactual_pta | forward | 19 | 87.9% | 0.0% |
| exp42_counterfactual_pta | forward | 20 | 86.2% | 0.0% |
| exp42_counterfactual_pta | forward | 21 | 91.5% | 0.0% |
| exp42_counterfactual_pta | forward | 22 | 96.7% | 0.0% |
| exp42_counterfactual_pta | forward | 23 | 99.0% | 0.0% |
| exp43_cross_attn_text | left | 0 | 38.8% | 0.0% |
| exp43_cross_attn_text | left | 1 | 11.0% | 0.0% |
| exp43_cross_attn_text | left | 2 | 6.5% | 0.0% |
| exp43_cross_attn_text | left | 3 | 12.5% | 0.0% |
| exp43_cross_attn_text | left | 4 | 18.7% | 0.0% |
| exp43_cross_attn_text | left | 5 | 21.5% | 0.0% |
| exp43_cross_attn_text | left | 6 | 38.0% | 0.0% |
| exp43_cross_attn_text | left | 7 | 40.4% | 0.0% |
| exp43_cross_attn_text | left | 8 | 44.7% | 0.0% |
| exp43_cross_attn_text | left | 9 | 63.0% | 0.0% |
| exp43_cross_attn_text | left | 10 | 85.4% | 0.0% |
| exp43_cross_attn_text | left | 11 | 90.5% | 0.0% |
| exp43_cross_attn_text | left | 12 | 84.8% | 0.0% |
| exp43_cross_attn_text | left | 13 | 93.2% | 0.0% |
| exp43_cross_attn_text | left | 14 | 94.0% | 0.0% |
| exp43_cross_attn_text | left | 15 | 89.4% | 0.0% |
| exp43_cross_attn_text | left | 16 | 95.2% | 0.0% |
| exp43_cross_attn_text | left | 17 | 97.4% | 0.0% |
| exp43_cross_attn_text | left | 18 | 92.1% | 0.0% |
| exp43_cross_attn_text | left | 19 | 95.0% | 0.0% |
| exp43_cross_attn_text | left | 20 | 98.0% | 0.0% |
| exp43_cross_attn_text | left | 21 | 99.3% | 0.0% |
| exp43_cross_attn_text | left | 22 | 99.9% | 0.0% |
| exp43_cross_attn_text | left | 23 | 99.7% | 0.0% |
| exp43_cross_attn_text | right | 0 | 38.8% | 0.0% |
| exp43_cross_attn_text | right | 1 | 11.0% | 0.0% |
| exp43_cross_attn_text | right | 2 | 6.5% | 0.0% |
| exp43_cross_attn_text | right | 3 | 12.5% | 0.0% |
| exp43_cross_attn_text | right | 4 | 18.7% | 0.0% |
| exp43_cross_attn_text | right | 5 | 21.5% | 0.0% |
| exp43_cross_attn_text | right | 6 | 38.0% | 0.0% |
| exp43_cross_attn_text | right | 7 | 40.4% | 0.0% |
| exp43_cross_attn_text | right | 8 | 44.7% | 0.0% |
| exp43_cross_attn_text | right | 9 | 63.0% | 0.0% |
| exp43_cross_attn_text | right | 10 | 85.4% | 0.0% |
| exp43_cross_attn_text | right | 11 | 90.5% | 0.0% |
| exp43_cross_attn_text | right | 12 | 84.8% | 0.0% |
| exp43_cross_attn_text | right | 13 | 93.2% | 0.0% |
| exp43_cross_attn_text | right | 14 | 94.0% | 0.0% |
| exp43_cross_attn_text | right | 15 | 89.4% | 0.0% |
| exp43_cross_attn_text | right | 16 | 95.2% | 0.0% |
| exp43_cross_attn_text | right | 17 | 97.4% | 0.0% |
| exp43_cross_attn_text | right | 18 | 92.1% | 0.0% |
| exp43_cross_attn_text | right | 19 | 95.0% | 0.0% |
| exp43_cross_attn_text | right | 20 | 98.0% | 0.0% |
| exp43_cross_attn_text | right | 21 | 99.3% | 0.0% |
| exp43_cross_attn_text | right | 22 | 99.9% | 0.0% |
| exp43_cross_attn_text | right | 23 | 99.7% | 0.0% |
| exp43_cross_attn_text | forward | 0 | 38.6% | 0.0% |
| exp43_cross_attn_text | forward | 1 | 10.4% | 0.0% |
| exp43_cross_attn_text | forward | 2 | 6.4% | 0.0% |
| exp43_cross_attn_text | forward | 3 | 12.4% | 0.0% |
| exp43_cross_attn_text | forward | 4 | 18.2% | 0.0% |
| exp43_cross_attn_text | forward | 5 | 21.3% | 0.0% |
| exp43_cross_attn_text | forward | 6 | 37.6% | 0.0% |
| exp43_cross_attn_text | forward | 7 | 40.1% | 0.0% |
| exp43_cross_attn_text | forward | 8 | 44.6% | 0.0% |
| exp43_cross_attn_text | forward | 9 | 62.9% | 0.0% |
| exp43_cross_attn_text | forward | 10 | 85.1% | 0.0% |
| exp43_cross_attn_text | forward | 11 | 91.0% | 0.0% |
| exp43_cross_attn_text | forward | 12 | 84.9% | 0.0% |
| exp43_cross_attn_text | forward | 13 | 93.4% | 0.0% |
| exp43_cross_attn_text | forward | 14 | 93.6% | 0.0% |
| exp43_cross_attn_text | forward | 15 | 89.4% | 0.0% |
| exp43_cross_attn_text | forward | 16 | 95.2% | 0.0% |
| exp43_cross_attn_text | forward | 17 | 97.4% | 0.0% |
| exp43_cross_attn_text | forward | 18 | 92.8% | 0.0% |
| exp43_cross_attn_text | forward | 19 | 95.4% | 0.0% |
| exp43_cross_attn_text | forward | 20 | 98.3% | 0.0% |
| exp43_cross_attn_text | forward | 21 | 99.4% | 0.0% |
| exp43_cross_attn_text | forward | 22 | 99.9% | 0.0% |
| exp43_cross_attn_text | forward | 23 | 99.7% | 0.0% |