falcon-7b-instruct


Find this model in the Falcon model summary

Model source: https://huggingface.co/tiiuae/falcon-7b-instruct

falcon-7b-instruct Model Summary Plots

falcon-7b-instruct Model Selected Details
  layer_type N M Q alpha D alpha-hat log_SN rank_loss
layer_id                  
3 DENSE 4672 4544 1.03 2.70 0.02 7.39 2.74 0
4 DENSE 4544 4544 1.00 2.71 0.01 5.96 2.20 4
5 DENSE 18176 4544 4.00 2.73 0.01 9.96 3.65 0
6 DENSE 18176 4544 4.00 5.07 0.02 12.15 2.40 0
8 DENSE 4672 4544 1.03 3.52 0.03 8.46 2.41 0
9 DENSE 4544 4544 1.00 4.11 0.02 7.20 1.75 2
10 DENSE 18176 4544 4.00 2.75 0.01 10.02 3.65 0
11 DENSE 18176 4544 4.00 3.40 0.01 8.47 2.49 0
13 DENSE 4672 4544 1.03 2.62 0.02 6.00 2.29 0
14 DENSE 4544 4544 1.00 3.67 0.01 6.05 1.65 3
15 DENSE 18176 4544 4.00 2.80 0.02 9.39 3.36 0
16 DENSE 18176 4544 4.00 3.78 0.07 7.54 1.99 0
18 DENSE 4672 4544 1.03 3.01 0.02 6.83 2.27 0
19 DENSE 4544 4544 1.00 3.45 0.05 5.33 1.55 4
20 DENSE 18176 4544 4.00 3.03 0.02 10.15 3.35 0
21 DENSE 18176 4544 4.00 3.80 0.05 8.60 2.26 0
23 DENSE 4672 4544 1.03 2.74 0.03 6.63 2.42 0
24 DENSE 4544 4544 1.00 3.37 0.03 5.38 1.60 3
25 DENSE 18176 4544 4.00 3.37 0.03 11.34 3.36 0
26 DENSE 18176 4544 4.00 4.17 0.03 9.80 2.35 0
28 DENSE 4672 4544 1.03 2.22 0.04 5.17 2.33 0
29 DENSE 4544 4544 1.00 2.60 0.04 4.40 1.69 4
30 DENSE 18176 4544 4.00 3.89 0.03 12.81 3.29 0
31 DENSE 18176 4544 4.00 4.85 0.04 10.11 2.09 0
33 DENSE 4672 4544 1.03 3.19 0.02 8.00 2.51 0
34 DENSE 4544 4544 1.00 3.07 0.04 5.06 1.65 4
35 DENSE 18176 4544 4.00 3.97 0.02 12.67 3.19 0
36 DENSE 18176 4544 4.00 4.49 0.03 8.03 1.79 0
38 DENSE 4672 4544 1.03 2.34 0.03 5.50 2.35 0
39 DENSE 4544 4544 1.00 3.63 0.03 5.47 1.51 3
40 DENSE 18176 4544 4.00 3.45 0.02 11.16 3.24 0
41 DENSE 18176 4544 4.00 3.45 0.02 6.42 1.86 0
43 DENSE 4672 4544 1.03 3.06 0.02 7.59 2.48 0
44 DENSE 4544 4544 1.00 3.45 0.04 5.44 1.58 3
45 DENSE 18176 4544 4.00 3.41 0.03 10.87 3.19 0
46 DENSE 18176 4544 4.00 3.56 0.01 6.35 1.79 0
48 DENSE 4672 4544 1.03 2.36 0.03 5.59 2.37 0
49 DENSE 4544 4544 1.00 3.24 0.05 5.43 1.68 3
50 DENSE 18176 4544 4.00 3.65 0.00 11.79 3.23 0
51 DENSE 18176 4544 4.00 3.45 0.01 6.43 1.87 0
53 DENSE 4672 4544 1.03 2.56 0.03 6.33 2.47 0
54 DENSE 4544 4544 1.00 2.89 0.03 5.37 1.86 3
55 DENSE 18176 4544 4.00 3.65 0.02 11.75 3.22 0
56 DENSE 18176 4544 4.00 3.68 0.01 6.81 1.85 0
58 DENSE 4672 4544 1.03 2.99 0.03 7.37 2.46 0
59 DENSE 4544 4544 1.00 3.09 0.05 5.13 1.66 5
60 DENSE 18176 4544 4.00 3.72 0.01 11.81 3.17 0
61 DENSE 18176 4544 4.00 3.63 0.01 6.12 1.69 0
63 DENSE 4672 4544 1.03 2.60 0.03 6.25 2.40 0
64 DENSE 4544 4544 1.00 2.87 0.04 4.69 1.63 5
65 DENSE 18176 4544 4.00 3.92 0.01 12.40 3.16 0
66 DENSE 18176 4544 4.00 3.66 0.02 5.87 1.60 0
68 DENSE 4672 4544 1.03 2.52 0.01 6.23 2.47 0
69 DENSE 4544 4544 1.00 3.96 0.05 5.79 1.46 3
70 DENSE 18176 4544 4.00 3.70 0.01 11.74 3.17 0
71 DENSE 18176 4544 4.00 3.39 0.02 5.88 1.73 0
73 DENSE 4672 4544 1.03 2.45 0.03 6.05 2.47 0
74 DENSE 4544 4544 1.00 2.81 0.04 4.96 1.77 3
75 DENSE 18176 4544 4.00 3.88 0.01 12.32 3.17 0
76 DENSE 18176 4544 4.00 3.72 0.02 6.52 1.75 0
78 DENSE 4672 4544 1.03 2.53 0.02 6.24 2.47 0
79 DENSE 4544 4544 1.00 2.93 0.04 4.90 1.67 3
80 DENSE 18176 4544 4.00 3.85 0.01 12.21 3.17 0
81 DENSE 18176 4544 4.00 3.84 0.02 6.81 1.78 0
83 DENSE 4672 4544 1.03 2.66 0.02 6.55 2.47 0
84 DENSE 4544 4544 1.00 3.10 0.03 4.99 1.61 3
85 DENSE 18176 4544 4.00 3.89 0.01 12.29 3.16 0
86 DENSE 18176 4544 4.00 4.54 0.02 8.71 1.92 0
88 DENSE 4672 4544 1.03 2.65 0.03 6.47 2.45 0
89 DENSE 4544 4544 1.00 2.93 0.04 4.94 1.69 4
90 DENSE 18176 4544 4.00 3.96 0.01 12.56 3.17 0
91 DENSE 18176 4544 4.00 5.60 0.02 9.30 1.66 0
93 DENSE 4672 4544 1.03 2.66 0.01 6.55 2.46 0
94 DENSE 4544 4544 1.00 3.90 0.05 5.70 1.46 3
95 DENSE 18176 4544 4.00 4.06 0.01 12.75 3.14 0
96 DENSE 18176 4544 4.00 4.10 0.02 6.98 1.70 0
98 DENSE 4672 4544 1.03 2.28 0.01 5.62 2.47 0
99 DENSE 4544 4544 1.00 2.92 0.03 4.60 1.57 3
100 DENSE 18176 4544 4.00 4.04 0.01 12.69 3.14 0
101 DENSE 18176 4544 4.00 4.19 0.01 7.67 1.83 0
103 DENSE 4672 4544 1.03 2.69 0.03 6.75 2.51 0
104 DENSE 4544 4544 1.00 2.74 0.05 5.00 1.82 3
105 DENSE 18176 4544 4.00 4.08 0.02 12.72 3.12 0
106 DENSE 18176 4544 4.00 4.39 0.03 7.66 1.75 0
108 DENSE 4672 4544 1.03 2.75 0.02 7.09 2.58 0
109 DENSE 4544 4544 1.00 2.66 0.03 4.75 1.79 3
110 DENSE 18176 4544 4.00 4.11 0.02 12.61 3.07 0
111 DENSE 18176 4544 4.00 4.68 0.02 8.09 1.73 0
113 DENSE 4672 4544 1.03 2.81 0.01 7.14 2.54 0
114 DENSE 4544 4544 1.00 3.16 0.03 4.97 1.57 3
115 DENSE 18176 4544 4.00 4.05 0.01 12.33 3.04 0
117 DENSE 18176 4544 4.00 4.88 0.02 8.56 1.75 0
119 DENSE 4672 4544 1.03 2.85 0.01 7.69 2.70 0
120 DENSE 4544 4544 1.00 2.96 0.04 5.04 1.70 2
121 DENSE 18176 4544 4.00 4.05 0.01 12.36 3.05 0
122 DENSE 18176 4544 4.00 5.39 0.01 9.37 1.74 0
124 DENSE 4672 4544 1.03 2.59 0.02 6.43 2.48 0
125 DENSE 4544 4544 1.00 2.84 0.03 4.87 1.71 3
126 DENSE 18176 4544 4.00 4.24 0.01 12.84 3.03 0
127 DENSE 18176 4544 4.00 5.75 0.01 11.34 1.97 0
129 DENSE 4672 4544 1.03 2.85 0.03 7.15 2.51 0
130 DENSE 4544 4544 1.00 4.42 0.04 6.19 1.40 3
131 DENSE 18176 4544 4.00 4.27 0.01 12.96 3.03 0
132 DENSE 18176 4544 4.00 6.11 0.02 11.46 1.88 0
134 DENSE 4672 4544 1.03 2.86 0.01 7.06 2.47 0
135 DENSE 4544 4544 1.00 2.66 0.04 4.78 1.80 3
136 DENSE 18176 4544 4.00 4.14 0.01 12.55 3.03 0
137 DENSE 18176 4544 4.00 6.04 0.02 11.30 1.87 0
139 DENSE 4672 4544 1.03 2.30 0.04 6.12 2.66 0
140 DENSE 4544 4544 1.00 8.74 0.08 10.79 1.23 3
141 DENSE 18176 4544 4.00 4.10 0.01 12.15 2.96 0
142 DENSE 18176 4544 4.00 6.01 0.01 11.01 1.83 0
144 DENSE 4672 4544 1.03 3.11 0.02 7.95 2.56 0
145 DENSE 4544 4544 1.00 3.95 0.02 7.07 1.79 3
146 DENSE 18176 4544 4.00 4.18 0.02 12.35 2.95 0
147 DENSE 18176 4544 4.00 5.53 0.01 10.47 1.89 0
149 DENSE 4672 4544 1.03 3.06 0.01 8.11 2.65 0
150 DENSE 4544 4544 1.00 3.15 0.02 7.40 2.35 4
151 DENSE 18176 4544 4.00 4.45 0.01 13.11 2.95 0
152 DENSE 18176 4544 4.00 6.08 0.01 12.13 2.00 0
154 DENSE 4672 4544 1.03 3.41 0.02 9.20 2.70 0
155 DENSE 4544 4544 1.00 4.82 0.02 9.68 2.01 2
156 DENSE 18176 4544 4.00 4.39 0.01 13.08 2.98 0
157 DENSE 18176 4544 4.00 3.93 0.04 9.28 2.36 0
159 DENSE 4672 4544 1.03 3.03 0.02 7.79 2.57 0
160 DENSE 4544 4544 1.00 3.29 0.01 6.58 2.00 4
161 DENSE 18176 4544 4.00 3.64 0.01 11.01 3.03 0
162 DENSE 18176 4544 4.00 4.30 0.02 12.81 2.98 0