wanchichen commited on
Commit
3757ab4
·
verified ·
1 Parent(s): f11aca0

Create model/config.yaml

Browse files
Files changed (1) hide show
  1. model/config.yaml +2273 -0
model/config.yaml ADDED
@@ -0,0 +1,2273 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ config: conf/tuning/train_ssl_espnethubert_ebf_ce_large_p3.yaml
2
+ print_config: false
3
+ log_level: INFO
4
+ drop_last_iter: true
5
+ dry_run: false
6
+ iterator_type: sequence
7
+ valid_iterator_type: null
8
+ output_dir: exp_900k/hubert_iter2_train_ssl_espnethubert_ebf_ce_large_p3_raw
9
+ ngpu: 1
10
+ seed: 1
11
+ num_workers: 4
12
+ num_att_plot: 0
13
+ dist_backend: nccl
14
+ dist_init_method: env://
15
+ dist_world_size: 4
16
+ dist_rank: 0
17
+ local_rank: 0
18
+ dist_master_addr: localhost
19
+ dist_master_port: 38545
20
+ dist_launcher: null
21
+ multiprocessing_distributed: true
22
+ unused_parameters: false
23
+ sharded_ddp: false
24
+ static_graph: true
25
+ gradient_as_bucket_view: true
26
+ broadcast_buffers: false
27
+ bucket_cap_mb: 10
28
+ compress_gradients: true
29
+ cudnn_enabled: true
30
+ cudnn_benchmark: false
31
+ cudnn_deterministic: false
32
+ collect_stats: false
33
+ write_collected_feats: false
34
+ max_epoch: 38
35
+ patience: null
36
+ val_scheduler_criterion:
37
+ - valid
38
+ - loss
39
+ early_stopping_criterion:
40
+ - valid
41
+ - loss
42
+ - min
43
+ best_model_criterion:
44
+ - - valid
45
+ - hubert_losses_m_18
46
+ - min
47
+ keep_nbest_models: 5
48
+ nbest_averaging_interval: 0
49
+ grad_clip: 10.0
50
+ grad_clip_type: 2.0
51
+ grad_noise: false
52
+ accum_grad: 1
53
+ no_forward_run: false
54
+ resume: true
55
+ train_dtype: float32
56
+ use_amp: true
57
+ log_interval: null
58
+ use_matplotlib: true
59
+ use_tensorboard: false
60
+ create_graph_in_tensorboard: false
61
+ use_wandb: false
62
+ wandb_project: null
63
+ wandb_id: null
64
+ wandb_entity: null
65
+ wandb_name: null
66
+ wandb_model_log_interval: -1
67
+ detect_anomaly: false
68
+ use_adapter: false
69
+ adapter: lora
70
+ save_strategy: all
71
+ adapter_conf: {}
72
+ pretrain_path: null
73
+ init_param: []
74
+ ignore_init_mismatch: false
75
+ freeze_param: []
76
+ num_iters_per_epoch: null
77
+ batch_size: 20
78
+ valid_batch_size: null
79
+ batch_bins: 1600000
80
+ valid_batch_bins: null
81
+ train_shape_file:
82
+ - exp_900k/hubert_iter2_stats_raw/splits200/speech_shape
83
+ valid_shape_file:
84
+ - exp_900k/hubert_iter2_stats_raw/valid/speech_shape
85
+ batch_type: grouped
86
+ valid_batch_type: null
87
+ fold_length:
88
+ - 80000
89
+ - 400
90
+ sort_in_batch: descending
91
+ shuffle_within_batch: false
92
+ sort_batch: descending
93
+ multiple_iterator: true
94
+ validate_each_iter_factory: true
95
+ chunk_length: 500
96
+ chunk_shift_ratio: 0.5
97
+ num_cache_chunks: 1024
98
+ chunk_excluded_key_prefixes: []
99
+ chunk_default_fs: null
100
+ train_data_path_and_name_and_type:
101
+ - - exp_900k/hubert_iter2_stats_raw/splits200/wav.scp
102
+ - speech
103
+ - kaldi_ark
104
+ - - exp_900k/hubert_iter2_stats_raw/splits200/text
105
+ - text
106
+ - text
107
+ valid_data_path_and_name_and_type:
108
+ - - dump/raw/de_cp_dev/wav.scp
109
+ - speech
110
+ - kaldi_ark
111
+ - - dump/raw/de_cp_dev/text
112
+ - text
113
+ - text
114
+ allow_variable_data_keys: false
115
+ max_cache_size: 0.0
116
+ max_cache_fd: 32
117
+ allow_multi_rates: false
118
+ valid_max_cache_size: null
119
+ exclude_weight_decay: false
120
+ exclude_weight_decay_conf: {}
121
+ optim: adam
122
+ optim_conf:
123
+ lr: 0.0003
124
+ scheduler: warmuplr
125
+ scheduler_conf:
126
+ warmup_steps: 32000
127
+ token_list:
128
+ - '0'
129
+ - '1'
130
+ - '2'
131
+ - '3'
132
+ - '4'
133
+ - '5'
134
+ - '6'
135
+ - '7'
136
+ - '8'
137
+ - '9'
138
+ - '10'
139
+ - '11'
140
+ - '12'
141
+ - '13'
142
+ - '14'
143
+ - '15'
144
+ - '16'
145
+ - '17'
146
+ - '18'
147
+ - '19'
148
+ - '20'
149
+ - '21'
150
+ - '22'
151
+ - '23'
152
+ - '24'
153
+ - '25'
154
+ - '26'
155
+ - '27'
156
+ - '28'
157
+ - '29'
158
+ - '30'
159
+ - '31'
160
+ - '32'
161
+ - '33'
162
+ - '34'
163
+ - '35'
164
+ - '36'
165
+ - '37'
166
+ - '38'
167
+ - '39'
168
+ - '40'
169
+ - '41'
170
+ - '42'
171
+ - '43'
172
+ - '44'
173
+ - '45'
174
+ - '46'
175
+ - '47'
176
+ - '48'
177
+ - '49'
178
+ - '50'
179
+ - '51'
180
+ - '52'
181
+ - '53'
182
+ - '54'
183
+ - '55'
184
+ - '56'
185
+ - '57'
186
+ - '58'
187
+ - '59'
188
+ - '60'
189
+ - '61'
190
+ - '62'
191
+ - '63'
192
+ - '64'
193
+ - '65'
194
+ - '66'
195
+ - '67'
196
+ - '68'
197
+ - '69'
198
+ - '70'
199
+ - '71'
200
+ - '72'
201
+ - '73'
202
+ - '74'
203
+ - '75'
204
+ - '76'
205
+ - '77'
206
+ - '78'
207
+ - '79'
208
+ - '80'
209
+ - '81'
210
+ - '82'
211
+ - '83'
212
+ - '84'
213
+ - '85'
214
+ - '86'
215
+ - '87'
216
+ - '88'
217
+ - '89'
218
+ - '90'
219
+ - '91'
220
+ - '92'
221
+ - '93'
222
+ - '94'
223
+ - '95'
224
+ - '96'
225
+ - '97'
226
+ - '98'
227
+ - '99'
228
+ - '100'
229
+ - '101'
230
+ - '102'
231
+ - '103'
232
+ - '104'
233
+ - '105'
234
+ - '106'
235
+ - '107'
236
+ - '108'
237
+ - '109'
238
+ - '110'
239
+ - '111'
240
+ - '112'
241
+ - '113'
242
+ - '114'
243
+ - '115'
244
+ - '116'
245
+ - '117'
246
+ - '118'
247
+ - '119'
248
+ - '120'
249
+ - '121'
250
+ - '122'
251
+ - '123'
252
+ - '124'
253
+ - '125'
254
+ - '126'
255
+ - '127'
256
+ - '128'
257
+ - '129'
258
+ - '130'
259
+ - '131'
260
+ - '132'
261
+ - '133'
262
+ - '134'
263
+ - '135'
264
+ - '136'
265
+ - '137'
266
+ - '138'
267
+ - '139'
268
+ - '140'
269
+ - '141'
270
+ - '142'
271
+ - '143'
272
+ - '144'
273
+ - '145'
274
+ - '146'
275
+ - '147'
276
+ - '148'
277
+ - '149'
278
+ - '150'
279
+ - '151'
280
+ - '152'
281
+ - '153'
282
+ - '154'
283
+ - '155'
284
+ - '156'
285
+ - '157'
286
+ - '158'
287
+ - '159'
288
+ - '160'
289
+ - '161'
290
+ - '162'
291
+ - '163'
292
+ - '164'
293
+ - '165'
294
+ - '166'
295
+ - '167'
296
+ - '168'
297
+ - '169'
298
+ - '170'
299
+ - '171'
300
+ - '172'
301
+ - '173'
302
+ - '174'
303
+ - '175'
304
+ - '176'
305
+ - '177'
306
+ - '178'
307
+ - '179'
308
+ - '180'
309
+ - '181'
310
+ - '182'
311
+ - '183'
312
+ - '184'
313
+ - '185'
314
+ - '186'
315
+ - '187'
316
+ - '188'
317
+ - '189'
318
+ - '190'
319
+ - '191'
320
+ - '192'
321
+ - '193'
322
+ - '194'
323
+ - '195'
324
+ - '196'
325
+ - '197'
326
+ - '198'
327
+ - '199'
328
+ - '200'
329
+ - '201'
330
+ - '202'
331
+ - '203'
332
+ - '204'
333
+ - '205'
334
+ - '206'
335
+ - '207'
336
+ - '208'
337
+ - '209'
338
+ - '210'
339
+ - '211'
340
+ - '212'
341
+ - '213'
342
+ - '214'
343
+ - '215'
344
+ - '216'
345
+ - '217'
346
+ - '218'
347
+ - '219'
348
+ - '220'
349
+ - '221'
350
+ - '222'
351
+ - '223'
352
+ - '224'
353
+ - '225'
354
+ - '226'
355
+ - '227'
356
+ - '228'
357
+ - '229'
358
+ - '230'
359
+ - '231'
360
+ - '232'
361
+ - '233'
362
+ - '234'
363
+ - '235'
364
+ - '236'
365
+ - '237'
366
+ - '238'
367
+ - '239'
368
+ - '240'
369
+ - '241'
370
+ - '242'
371
+ - '243'
372
+ - '244'
373
+ - '245'
374
+ - '246'
375
+ - '247'
376
+ - '248'
377
+ - '249'
378
+ - '250'
379
+ - '251'
380
+ - '252'
381
+ - '253'
382
+ - '254'
383
+ - '255'
384
+ - '256'
385
+ - '257'
386
+ - '258'
387
+ - '259'
388
+ - '260'
389
+ - '261'
390
+ - '262'
391
+ - '263'
392
+ - '264'
393
+ - '265'
394
+ - '266'
395
+ - '267'
396
+ - '268'
397
+ - '269'
398
+ - '270'
399
+ - '271'
400
+ - '272'
401
+ - '273'
402
+ - '274'
403
+ - '275'
404
+ - '276'
405
+ - '277'
406
+ - '278'
407
+ - '279'
408
+ - '280'
409
+ - '281'
410
+ - '282'
411
+ - '283'
412
+ - '284'
413
+ - '285'
414
+ - '286'
415
+ - '287'
416
+ - '288'
417
+ - '289'
418
+ - '290'
419
+ - '291'
420
+ - '292'
421
+ - '293'
422
+ - '294'
423
+ - '295'
424
+ - '296'
425
+ - '297'
426
+ - '298'
427
+ - '299'
428
+ - '300'
429
+ - '301'
430
+ - '302'
431
+ - '303'
432
+ - '304'
433
+ - '305'
434
+ - '306'
435
+ - '307'
436
+ - '308'
437
+ - '309'
438
+ - '310'
439
+ - '311'
440
+ - '312'
441
+ - '313'
442
+ - '314'
443
+ - '315'
444
+ - '316'
445
+ - '317'
446
+ - '318'
447
+ - '319'
448
+ - '320'
449
+ - '321'
450
+ - '322'
451
+ - '323'
452
+ - '324'
453
+ - '325'
454
+ - '326'
455
+ - '327'
456
+ - '328'
457
+ - '329'
458
+ - '330'
459
+ - '331'
460
+ - '332'
461
+ - '333'
462
+ - '334'
463
+ - '335'
464
+ - '336'
465
+ - '337'
466
+ - '338'
467
+ - '339'
468
+ - '340'
469
+ - '341'
470
+ - '342'
471
+ - '343'
472
+ - '344'
473
+ - '345'
474
+ - '346'
475
+ - '347'
476
+ - '348'
477
+ - '349'
478
+ - '350'
479
+ - '351'
480
+ - '352'
481
+ - '353'
482
+ - '354'
483
+ - '355'
484
+ - '356'
485
+ - '357'
486
+ - '358'
487
+ - '359'
488
+ - '360'
489
+ - '361'
490
+ - '362'
491
+ - '363'
492
+ - '364'
493
+ - '365'
494
+ - '366'
495
+ - '367'
496
+ - '368'
497
+ - '369'
498
+ - '370'
499
+ - '371'
500
+ - '372'
501
+ - '373'
502
+ - '374'
503
+ - '375'
504
+ - '376'
505
+ - '377'
506
+ - '378'
507
+ - '379'
508
+ - '380'
509
+ - '381'
510
+ - '382'
511
+ - '383'
512
+ - '384'
513
+ - '385'
514
+ - '386'
515
+ - '387'
516
+ - '388'
517
+ - '389'
518
+ - '390'
519
+ - '391'
520
+ - '392'
521
+ - '393'
522
+ - '394'
523
+ - '395'
524
+ - '396'
525
+ - '397'
526
+ - '398'
527
+ - '399'
528
+ - '400'
529
+ - '401'
530
+ - '402'
531
+ - '403'
532
+ - '404'
533
+ - '405'
534
+ - '406'
535
+ - '407'
536
+ - '408'
537
+ - '409'
538
+ - '410'
539
+ - '411'
540
+ - '412'
541
+ - '413'
542
+ - '414'
543
+ - '415'
544
+ - '416'
545
+ - '417'
546
+ - '418'
547
+ - '419'
548
+ - '420'
549
+ - '421'
550
+ - '422'
551
+ - '423'
552
+ - '424'
553
+ - '425'
554
+ - '426'
555
+ - '427'
556
+ - '428'
557
+ - '429'
558
+ - '430'
559
+ - '431'
560
+ - '432'
561
+ - '433'
562
+ - '434'
563
+ - '435'
564
+ - '436'
565
+ - '437'
566
+ - '438'
567
+ - '439'
568
+ - '440'
569
+ - '441'
570
+ - '442'
571
+ - '443'
572
+ - '444'
573
+ - '445'
574
+ - '446'
575
+ - '447'
576
+ - '448'
577
+ - '449'
578
+ - '450'
579
+ - '451'
580
+ - '452'
581
+ - '453'
582
+ - '454'
583
+ - '455'
584
+ - '456'
585
+ - '457'
586
+ - '458'
587
+ - '459'
588
+ - '460'
589
+ - '461'
590
+ - '462'
591
+ - '463'
592
+ - '464'
593
+ - '465'
594
+ - '466'
595
+ - '467'
596
+ - '468'
597
+ - '469'
598
+ - '470'
599
+ - '471'
600
+ - '472'
601
+ - '473'
602
+ - '474'
603
+ - '475'
604
+ - '476'
605
+ - '477'
606
+ - '478'
607
+ - '479'
608
+ - '480'
609
+ - '481'
610
+ - '482'
611
+ - '483'
612
+ - '484'
613
+ - '485'
614
+ - '486'
615
+ - '487'
616
+ - '488'
617
+ - '489'
618
+ - '490'
619
+ - '491'
620
+ - '492'
621
+ - '493'
622
+ - '494'
623
+ - '495'
624
+ - '496'
625
+ - '497'
626
+ - '498'
627
+ - '499'
628
+ - '500'
629
+ - '501'
630
+ - '502'
631
+ - '503'
632
+ - '504'
633
+ - '505'
634
+ - '506'
635
+ - '507'
636
+ - '508'
637
+ - '509'
638
+ - '510'
639
+ - '511'
640
+ - '512'
641
+ - '513'
642
+ - '514'
643
+ - '515'
644
+ - '516'
645
+ - '517'
646
+ - '518'
647
+ - '519'
648
+ - '520'
649
+ - '521'
650
+ - '522'
651
+ - '523'
652
+ - '524'
653
+ - '525'
654
+ - '526'
655
+ - '527'
656
+ - '528'
657
+ - '529'
658
+ - '530'
659
+ - '531'
660
+ - '532'
661
+ - '533'
662
+ - '534'
663
+ - '535'
664
+ - '536'
665
+ - '537'
666
+ - '538'
667
+ - '539'
668
+ - '540'
669
+ - '541'
670
+ - '542'
671
+ - '543'
672
+ - '544'
673
+ - '545'
674
+ - '546'
675
+ - '547'
676
+ - '548'
677
+ - '549'
678
+ - '550'
679
+ - '551'
680
+ - '552'
681
+ - '553'
682
+ - '554'
683
+ - '555'
684
+ - '556'
685
+ - '557'
686
+ - '558'
687
+ - '559'
688
+ - '560'
689
+ - '561'
690
+ - '562'
691
+ - '563'
692
+ - '564'
693
+ - '565'
694
+ - '566'
695
+ - '567'
696
+ - '568'
697
+ - '569'
698
+ - '570'
699
+ - '571'
700
+ - '572'
701
+ - '573'
702
+ - '574'
703
+ - '575'
704
+ - '576'
705
+ - '577'
706
+ - '578'
707
+ - '579'
708
+ - '580'
709
+ - '581'
710
+ - '582'
711
+ - '583'
712
+ - '584'
713
+ - '585'
714
+ - '586'
715
+ - '587'
716
+ - '588'
717
+ - '589'
718
+ - '590'
719
+ - '591'
720
+ - '592'
721
+ - '593'
722
+ - '594'
723
+ - '595'
724
+ - '596'
725
+ - '597'
726
+ - '598'
727
+ - '599'
728
+ - '600'
729
+ - '601'
730
+ - '602'
731
+ - '603'
732
+ - '604'
733
+ - '605'
734
+ - '606'
735
+ - '607'
736
+ - '608'
737
+ - '609'
738
+ - '610'
739
+ - '611'
740
+ - '612'
741
+ - '613'
742
+ - '614'
743
+ - '615'
744
+ - '616'
745
+ - '617'
746
+ - '618'
747
+ - '619'
748
+ - '620'
749
+ - '621'
750
+ - '622'
751
+ - '623'
752
+ - '624'
753
+ - '625'
754
+ - '626'
755
+ - '627'
756
+ - '628'
757
+ - '629'
758
+ - '630'
759
+ - '631'
760
+ - '632'
761
+ - '633'
762
+ - '634'
763
+ - '635'
764
+ - '636'
765
+ - '637'
766
+ - '638'
767
+ - '639'
768
+ - '640'
769
+ - '641'
770
+ - '642'
771
+ - '643'
772
+ - '644'
773
+ - '645'
774
+ - '646'
775
+ - '647'
776
+ - '648'
777
+ - '649'
778
+ - '650'
779
+ - '651'
780
+ - '652'
781
+ - '653'
782
+ - '654'
783
+ - '655'
784
+ - '656'
785
+ - '657'
786
+ - '658'
787
+ - '659'
788
+ - '660'
789
+ - '661'
790
+ - '662'
791
+ - '663'
792
+ - '664'
793
+ - '665'
794
+ - '666'
795
+ - '667'
796
+ - '668'
797
+ - '669'
798
+ - '670'
799
+ - '671'
800
+ - '672'
801
+ - '673'
802
+ - '674'
803
+ - '675'
804
+ - '676'
805
+ - '677'
806
+ - '678'
807
+ - '679'
808
+ - '680'
809
+ - '681'
810
+ - '682'
811
+ - '683'
812
+ - '684'
813
+ - '685'
814
+ - '686'
815
+ - '687'
816
+ - '688'
817
+ - '689'
818
+ - '690'
819
+ - '691'
820
+ - '692'
821
+ - '693'
822
+ - '694'
823
+ - '695'
824
+ - '696'
825
+ - '697'
826
+ - '698'
827
+ - '699'
828
+ - '700'
829
+ - '701'
830
+ - '702'
831
+ - '703'
832
+ - '704'
833
+ - '705'
834
+ - '706'
835
+ - '707'
836
+ - '708'
837
+ - '709'
838
+ - '710'
839
+ - '711'
840
+ - '712'
841
+ - '713'
842
+ - '714'
843
+ - '715'
844
+ - '716'
845
+ - '717'
846
+ - '718'
847
+ - '719'
848
+ - '720'
849
+ - '721'
850
+ - '722'
851
+ - '723'
852
+ - '724'
853
+ - '725'
854
+ - '726'
855
+ - '727'
856
+ - '728'
857
+ - '729'
858
+ - '730'
859
+ - '731'
860
+ - '732'
861
+ - '733'
862
+ - '734'
863
+ - '735'
864
+ - '736'
865
+ - '737'
866
+ - '738'
867
+ - '739'
868
+ - '740'
869
+ - '741'
870
+ - '742'
871
+ - '743'
872
+ - '744'
873
+ - '745'
874
+ - '746'
875
+ - '747'
876
+ - '748'
877
+ - '749'
878
+ - '750'
879
+ - '751'
880
+ - '752'
881
+ - '753'
882
+ - '754'
883
+ - '755'
884
+ - '756'
885
+ - '757'
886
+ - '758'
887
+ - '759'
888
+ - '760'
889
+ - '761'
890
+ - '762'
891
+ - '763'
892
+ - '764'
893
+ - '765'
894
+ - '766'
895
+ - '767'
896
+ - '768'
897
+ - '769'
898
+ - '770'
899
+ - '771'
900
+ - '772'
901
+ - '773'
902
+ - '774'
903
+ - '775'
904
+ - '776'
905
+ - '777'
906
+ - '778'
907
+ - '779'
908
+ - '780'
909
+ - '781'
910
+ - '782'
911
+ - '783'
912
+ - '784'
913
+ - '785'
914
+ - '786'
915
+ - '787'
916
+ - '788'
917
+ - '789'
918
+ - '790'
919
+ - '791'
920
+ - '792'
921
+ - '793'
922
+ - '794'
923
+ - '795'
924
+ - '796'
925
+ - '797'
926
+ - '798'
927
+ - '799'
928
+ - '800'
929
+ - '801'
930
+ - '802'
931
+ - '803'
932
+ - '804'
933
+ - '805'
934
+ - '806'
935
+ - '807'
936
+ - '808'
937
+ - '809'
938
+ - '810'
939
+ - '811'
940
+ - '812'
941
+ - '813'
942
+ - '814'
943
+ - '815'
944
+ - '816'
945
+ - '817'
946
+ - '818'
947
+ - '819'
948
+ - '820'
949
+ - '821'
950
+ - '822'
951
+ - '823'
952
+ - '824'
953
+ - '825'
954
+ - '826'
955
+ - '827'
956
+ - '828'
957
+ - '829'
958
+ - '830'
959
+ - '831'
960
+ - '832'
961
+ - '833'
962
+ - '834'
963
+ - '835'
964
+ - '836'
965
+ - '837'
966
+ - '838'
967
+ - '839'
968
+ - '840'
969
+ - '841'
970
+ - '842'
971
+ - '843'
972
+ - '844'
973
+ - '845'
974
+ - '846'
975
+ - '847'
976
+ - '848'
977
+ - '849'
978
+ - '850'
979
+ - '851'
980
+ - '852'
981
+ - '853'
982
+ - '854'
983
+ - '855'
984
+ - '856'
985
+ - '857'
986
+ - '858'
987
+ - '859'
988
+ - '860'
989
+ - '861'
990
+ - '862'
991
+ - '863'
992
+ - '864'
993
+ - '865'
994
+ - '866'
995
+ - '867'
996
+ - '868'
997
+ - '869'
998
+ - '870'
999
+ - '871'
1000
+ - '872'
1001
+ - '873'
1002
+ - '874'
1003
+ - '875'
1004
+ - '876'
1005
+ - '877'
1006
+ - '878'
1007
+ - '879'
1008
+ - '880'
1009
+ - '881'
1010
+ - '882'
1011
+ - '883'
1012
+ - '884'
1013
+ - '885'
1014
+ - '886'
1015
+ - '887'
1016
+ - '888'
1017
+ - '889'
1018
+ - '890'
1019
+ - '891'
1020
+ - '892'
1021
+ - '893'
1022
+ - '894'
1023
+ - '895'
1024
+ - '896'
1025
+ - '897'
1026
+ - '898'
1027
+ - '899'
1028
+ - '900'
1029
+ - '901'
1030
+ - '902'
1031
+ - '903'
1032
+ - '904'
1033
+ - '905'
1034
+ - '906'
1035
+ - '907'
1036
+ - '908'
1037
+ - '909'
1038
+ - '910'
1039
+ - '911'
1040
+ - '912'
1041
+ - '913'
1042
+ - '914'
1043
+ - '915'
1044
+ - '916'
1045
+ - '917'
1046
+ - '918'
1047
+ - '919'
1048
+ - '920'
1049
+ - '921'
1050
+ - '922'
1051
+ - '923'
1052
+ - '924'
1053
+ - '925'
1054
+ - '926'
1055
+ - '927'
1056
+ - '928'
1057
+ - '929'
1058
+ - '930'
1059
+ - '931'
1060
+ - '932'
1061
+ - '933'
1062
+ - '934'
1063
+ - '935'
1064
+ - '936'
1065
+ - '937'
1066
+ - '938'
1067
+ - '939'
1068
+ - '940'
1069
+ - '941'
1070
+ - '942'
1071
+ - '943'
1072
+ - '944'
1073
+ - '945'
1074
+ - '946'
1075
+ - '947'
1076
+ - '948'
1077
+ - '949'
1078
+ - '950'
1079
+ - '951'
1080
+ - '952'
1081
+ - '953'
1082
+ - '954'
1083
+ - '955'
1084
+ - '956'
1085
+ - '957'
1086
+ - '958'
1087
+ - '959'
1088
+ - '960'
1089
+ - '961'
1090
+ - '962'
1091
+ - '963'
1092
+ - '964'
1093
+ - '965'
1094
+ - '966'
1095
+ - '967'
1096
+ - '968'
1097
+ - '969'
1098
+ - '970'
1099
+ - '971'
1100
+ - '972'
1101
+ - '973'
1102
+ - '974'
1103
+ - '975'
1104
+ - '976'
1105
+ - '977'
1106
+ - '978'
1107
+ - '979'
1108
+ - '980'
1109
+ - '981'
1110
+ - '982'
1111
+ - '983'
1112
+ - '984'
1113
+ - '985'
1114
+ - '986'
1115
+ - '987'
1116
+ - '988'
1117
+ - '989'
1118
+ - '990'
1119
+ - '991'
1120
+ - '992'
1121
+ - '993'
1122
+ - '994'
1123
+ - '995'
1124
+ - '996'
1125
+ - '997'
1126
+ - '998'
1127
+ - '999'
1128
+ - '1000'
1129
+ - '1001'
1130
+ - '1002'
1131
+ - '1003'
1132
+ - '1004'
1133
+ - '1005'
1134
+ - '1006'
1135
+ - '1007'
1136
+ - '1008'
1137
+ - '1009'
1138
+ - '1010'
1139
+ - '1011'
1140
+ - '1012'
1141
+ - '1013'
1142
+ - '1014'
1143
+ - '1015'
1144
+ - '1016'
1145
+ - '1017'
1146
+ - '1018'
1147
+ - '1019'
1148
+ - '1020'
1149
+ - '1021'
1150
+ - '1022'
1151
+ - '1023'
1152
+ - '1024'
1153
+ - '1025'
1154
+ - '1026'
1155
+ - '1027'
1156
+ - '1028'
1157
+ - '1029'
1158
+ - '1030'
1159
+ - '1031'
1160
+ - '1032'
1161
+ - '1033'
1162
+ - '1034'
1163
+ - '1035'
1164
+ - '1036'
1165
+ - '1037'
1166
+ - '1038'
1167
+ - '1039'
1168
+ - '1040'
1169
+ - '1041'
1170
+ - '1042'
1171
+ - '1043'
1172
+ - '1044'
1173
+ - '1045'
1174
+ - '1046'
1175
+ - '1047'
1176
+ - '1048'
1177
+ - '1049'
1178
+ - '1050'
1179
+ - '1051'
1180
+ - '1052'
1181
+ - '1053'
1182
+ - '1054'
1183
+ - '1055'
1184
+ - '1056'
1185
+ - '1057'
1186
+ - '1058'
1187
+ - '1059'
1188
+ - '1060'
1189
+ - '1061'
1190
+ - '1062'
1191
+ - '1063'
1192
+ - '1064'
1193
+ - '1065'
1194
+ - '1066'
1195
+ - '1067'
1196
+ - '1068'
1197
+ - '1069'
1198
+ - '1070'
1199
+ - '1071'
1200
+ - '1072'
1201
+ - '1073'
1202
+ - '1074'
1203
+ - '1075'
1204
+ - '1076'
1205
+ - '1077'
1206
+ - '1078'
1207
+ - '1079'
1208
+ - '1080'
1209
+ - '1081'
1210
+ - '1082'
1211
+ - '1083'
1212
+ - '1084'
1213
+ - '1085'
1214
+ - '1086'
1215
+ - '1087'
1216
+ - '1088'
1217
+ - '1089'
1218
+ - '1090'
1219
+ - '1091'
1220
+ - '1092'
1221
+ - '1093'
1222
+ - '1094'
1223
+ - '1095'
1224
+ - '1096'
1225
+ - '1097'
1226
+ - '1098'
1227
+ - '1099'
1228
+ - '1100'
1229
+ - '1101'
1230
+ - '1102'
1231
+ - '1103'
1232
+ - '1104'
1233
+ - '1105'
1234
+ - '1106'
1235
+ - '1107'
1236
+ - '1108'
1237
+ - '1109'
1238
+ - '1110'
1239
+ - '1111'
1240
+ - '1112'
1241
+ - '1113'
1242
+ - '1114'
1243
+ - '1115'
1244
+ - '1116'
1245
+ - '1117'
1246
+ - '1118'
1247
+ - '1119'
1248
+ - '1120'
1249
+ - '1121'
1250
+ - '1122'
1251
+ - '1123'
1252
+ - '1124'
1253
+ - '1125'
1254
+ - '1126'
1255
+ - '1127'
1256
+ - '1128'
1257
+ - '1129'
1258
+ - '1130'
1259
+ - '1131'
1260
+ - '1132'
1261
+ - '1133'
1262
+ - '1134'
1263
+ - '1135'
1264
+ - '1136'
1265
+ - '1137'
1266
+ - '1138'
1267
+ - '1139'
1268
+ - '1140'
1269
+ - '1141'
1270
+ - '1142'
1271
+ - '1143'
1272
+ - '1144'
1273
+ - '1145'
1274
+ - '1146'
1275
+ - '1147'
1276
+ - '1148'
1277
+ - '1149'
1278
+ - '1150'
1279
+ - '1151'
1280
+ - '1152'
1281
+ - '1153'
1282
+ - '1154'
1283
+ - '1155'
1284
+ - '1156'
1285
+ - '1157'
1286
+ - '1158'
1287
+ - '1159'
1288
+ - '1160'
1289
+ - '1161'
1290
+ - '1162'
1291
+ - '1163'
1292
+ - '1164'
1293
+ - '1165'
1294
+ - '1166'
1295
+ - '1167'
1296
+ - '1168'
1297
+ - '1169'
1298
+ - '1170'
1299
+ - '1171'
1300
+ - '1172'
1301
+ - '1173'
1302
+ - '1174'
1303
+ - '1175'
1304
+ - '1176'
1305
+ - '1177'
1306
+ - '1178'
1307
+ - '1179'
1308
+ - '1180'
1309
+ - '1181'
1310
+ - '1182'
1311
+ - '1183'
1312
+ - '1184'
1313
+ - '1185'
1314
+ - '1186'
1315
+ - '1187'
1316
+ - '1188'
1317
+ - '1189'
1318
+ - '1190'
1319
+ - '1191'
1320
+ - '1192'
1321
+ - '1193'
1322
+ - '1194'
1323
+ - '1195'
1324
+ - '1196'
1325
+ - '1197'
1326
+ - '1198'
1327
+ - '1199'
1328
+ - '1200'
1329
+ - '1201'
1330
+ - '1202'
1331
+ - '1203'
1332
+ - '1204'
1333
+ - '1205'
1334
+ - '1206'
1335
+ - '1207'
1336
+ - '1208'
1337
+ - '1209'
1338
+ - '1210'
1339
+ - '1211'
1340
+ - '1212'
1341
+ - '1213'
1342
+ - '1214'
1343
+ - '1215'
1344
+ - '1216'
1345
+ - '1217'
1346
+ - '1218'
1347
+ - '1219'
1348
+ - '1220'
1349
+ - '1221'
1350
+ - '1222'
1351
+ - '1223'
1352
+ - '1224'
1353
+ - '1225'
1354
+ - '1226'
1355
+ - '1227'
1356
+ - '1228'
1357
+ - '1229'
1358
+ - '1230'
1359
+ - '1231'
1360
+ - '1232'
1361
+ - '1233'
1362
+ - '1234'
1363
+ - '1235'
1364
+ - '1236'
1365
+ - '1237'
1366
+ - '1238'
1367
+ - '1239'
1368
+ - '1240'
1369
+ - '1241'
1370
+ - '1242'
1371
+ - '1243'
1372
+ - '1244'
1373
+ - '1245'
1374
+ - '1246'
1375
+ - '1247'
1376
+ - '1248'
1377
+ - '1249'
1378
+ - '1250'
1379
+ - '1251'
1380
+ - '1252'
1381
+ - '1253'
1382
+ - '1254'
1383
+ - '1255'
1384
+ - '1256'
1385
+ - '1257'
1386
+ - '1258'
1387
+ - '1259'
1388
+ - '1260'
1389
+ - '1261'
1390
+ - '1262'
1391
+ - '1263'
1392
+ - '1264'
1393
+ - '1265'
1394
+ - '1266'
1395
+ - '1267'
1396
+ - '1268'
1397
+ - '1269'
1398
+ - '1270'
1399
+ - '1271'
1400
+ - '1272'
1401
+ - '1273'
1402
+ - '1274'
1403
+ - '1275'
1404
+ - '1276'
1405
+ - '1277'
1406
+ - '1278'
1407
+ - '1279'
1408
+ - '1280'
1409
+ - '1281'
1410
+ - '1282'
1411
+ - '1283'
1412
+ - '1284'
1413
+ - '1285'
1414
+ - '1286'
1415
+ - '1287'
1416
+ - '1288'
1417
+ - '1289'
1418
+ - '1290'
1419
+ - '1291'
1420
+ - '1292'
1421
+ - '1293'
1422
+ - '1294'
1423
+ - '1295'
1424
+ - '1296'
1425
+ - '1297'
1426
+ - '1298'
1427
+ - '1299'
1428
+ - '1300'
1429
+ - '1301'
1430
+ - '1302'
1431
+ - '1303'
1432
+ - '1304'
1433
+ - '1305'
1434
+ - '1306'
1435
+ - '1307'
1436
+ - '1308'
1437
+ - '1309'
1438
+ - '1310'
1439
+ - '1311'
1440
+ - '1312'
1441
+ - '1313'
1442
+ - '1314'
1443
+ - '1315'
1444
+ - '1316'
1445
+ - '1317'
1446
+ - '1318'
1447
+ - '1319'
1448
+ - '1320'
1449
+ - '1321'
1450
+ - '1322'
1451
+ - '1323'
1452
+ - '1324'
1453
+ - '1325'
1454
+ - '1326'
1455
+ - '1327'
1456
+ - '1328'
1457
+ - '1329'
1458
+ - '1330'
1459
+ - '1331'
1460
+ - '1332'
1461
+ - '1333'
1462
+ - '1334'
1463
+ - '1335'
1464
+ - '1336'
1465
+ - '1337'
1466
+ - '1338'
1467
+ - '1339'
1468
+ - '1340'
1469
+ - '1341'
1470
+ - '1342'
1471
+ - '1343'
1472
+ - '1344'
1473
+ - '1345'
1474
+ - '1346'
1475
+ - '1347'
1476
+ - '1348'
1477
+ - '1349'
1478
+ - '1350'
1479
+ - '1351'
1480
+ - '1352'
1481
+ - '1353'
1482
+ - '1354'
1483
+ - '1355'
1484
+ - '1356'
1485
+ - '1357'
1486
+ - '1358'
1487
+ - '1359'
1488
+ - '1360'
1489
+ - '1361'
1490
+ - '1362'
1491
+ - '1363'
1492
+ - '1364'
1493
+ - '1365'
1494
+ - '1366'
1495
+ - '1367'
1496
+ - '1368'
1497
+ - '1369'
1498
+ - '1370'
1499
+ - '1371'
1500
+ - '1372'
1501
+ - '1373'
1502
+ - '1374'
1503
+ - '1375'
1504
+ - '1376'
1505
+ - '1377'
1506
+ - '1378'
1507
+ - '1379'
1508
+ - '1380'
1509
+ - '1381'
1510
+ - '1382'
1511
+ - '1383'
1512
+ - '1384'
1513
+ - '1385'
1514
+ - '1386'
1515
+ - '1387'
1516
+ - '1388'
1517
+ - '1389'
1518
+ - '1390'
1519
+ - '1391'
1520
+ - '1392'
1521
+ - '1393'
1522
+ - '1394'
1523
+ - '1395'
1524
+ - '1396'
1525
+ - '1397'
1526
+ - '1398'
1527
+ - '1399'
1528
+ - '1400'
1529
+ - '1401'
1530
+ - '1402'
1531
+ - '1403'
1532
+ - '1404'
1533
+ - '1405'
1534
+ - '1406'
1535
+ - '1407'
1536
+ - '1408'
1537
+ - '1409'
1538
+ - '1410'
1539
+ - '1411'
1540
+ - '1412'
1541
+ - '1413'
1542
+ - '1414'
1543
+ - '1415'
1544
+ - '1416'
1545
+ - '1417'
1546
+ - '1418'
1547
+ - '1419'
1548
+ - '1420'
1549
+ - '1421'
1550
+ - '1422'
1551
+ - '1423'
1552
+ - '1424'
1553
+ - '1425'
1554
+ - '1426'
1555
+ - '1427'
1556
+ - '1428'
1557
+ - '1429'
1558
+ - '1430'
1559
+ - '1431'
1560
+ - '1432'
1561
+ - '1433'
1562
+ - '1434'
1563
+ - '1435'
1564
+ - '1436'
1565
+ - '1437'
1566
+ - '1438'
1567
+ - '1439'
1568
+ - '1440'
1569
+ - '1441'
1570
+ - '1442'
1571
+ - '1443'
1572
+ - '1444'
1573
+ - '1445'
1574
+ - '1446'
1575
+ - '1447'
1576
+ - '1448'
1577
+ - '1449'
1578
+ - '1450'
1579
+ - '1451'
1580
+ - '1452'
1581
+ - '1453'
1582
+ - '1454'
1583
+ - '1455'
1584
+ - '1456'
1585
+ - '1457'
1586
+ - '1458'
1587
+ - '1459'
1588
+ - '1460'
1589
+ - '1461'
1590
+ - '1462'
1591
+ - '1463'
1592
+ - '1464'
1593
+ - '1465'
1594
+ - '1466'
1595
+ - '1467'
1596
+ - '1468'
1597
+ - '1469'
1598
+ - '1470'
1599
+ - '1471'
1600
+ - '1472'
1601
+ - '1473'
1602
+ - '1474'
1603
+ - '1475'
1604
+ - '1476'
1605
+ - '1477'
1606
+ - '1478'
1607
+ - '1479'
1608
+ - '1480'
1609
+ - '1481'
1610
+ - '1482'
1611
+ - '1483'
1612
+ - '1484'
1613
+ - '1485'
1614
+ - '1486'
1615
+ - '1487'
1616
+ - '1488'
1617
+ - '1489'
1618
+ - '1490'
1619
+ - '1491'
1620
+ - '1492'
1621
+ - '1493'
1622
+ - '1494'
1623
+ - '1495'
1624
+ - '1496'
1625
+ - '1497'
1626
+ - '1498'
1627
+ - '1499'
1628
+ - '1500'
1629
+ - '1501'
1630
+ - '1502'
1631
+ - '1503'
1632
+ - '1504'
1633
+ - '1505'
1634
+ - '1506'
1635
+ - '1507'
1636
+ - '1508'
1637
+ - '1509'
1638
+ - '1510'
1639
+ - '1511'
1640
+ - '1512'
1641
+ - '1513'
1642
+ - '1514'
1643
+ - '1515'
1644
+ - '1516'
1645
+ - '1517'
1646
+ - '1518'
1647
+ - '1519'
1648
+ - '1520'
1649
+ - '1521'
1650
+ - '1522'
1651
+ - '1523'
1652
+ - '1524'
1653
+ - '1525'
1654
+ - '1526'
1655
+ - '1527'
1656
+ - '1528'
1657
+ - '1529'
1658
+ - '1530'
1659
+ - '1531'
1660
+ - '1532'
1661
+ - '1533'
1662
+ - '1534'
1663
+ - '1535'
1664
+ - '1536'
1665
+ - '1537'
1666
+ - '1538'
1667
+ - '1539'
1668
+ - '1540'
1669
+ - '1541'
1670
+ - '1542'
1671
+ - '1543'
1672
+ - '1544'
1673
+ - '1545'
1674
+ - '1546'
1675
+ - '1547'
1676
+ - '1548'
1677
+ - '1549'
1678
+ - '1550'
1679
+ - '1551'
1680
+ - '1552'
1681
+ - '1553'
1682
+ - '1554'
1683
+ - '1555'
1684
+ - '1556'
1685
+ - '1557'
1686
+ - '1558'
1687
+ - '1559'
1688
+ - '1560'
1689
+ - '1561'
1690
+ - '1562'
1691
+ - '1563'
1692
+ - '1564'
1693
+ - '1565'
1694
+ - '1566'
1695
+ - '1567'
1696
+ - '1568'
1697
+ - '1569'
1698
+ - '1570'
1699
+ - '1571'
1700
+ - '1572'
1701
+ - '1573'
1702
+ - '1574'
1703
+ - '1575'
1704
+ - '1576'
1705
+ - '1577'
1706
+ - '1578'
1707
+ - '1579'
1708
+ - '1580'
1709
+ - '1581'
1710
+ - '1582'
1711
+ - '1583'
1712
+ - '1584'
1713
+ - '1585'
1714
+ - '1586'
1715
+ - '1587'
1716
+ - '1588'
1717
+ - '1589'
1718
+ - '1590'
1719
+ - '1591'
1720
+ - '1592'
1721
+ - '1593'
1722
+ - '1594'
1723
+ - '1595'
1724
+ - '1596'
1725
+ - '1597'
1726
+ - '1598'
1727
+ - '1599'
1728
+ - '1600'
1729
+ - '1601'
1730
+ - '1602'
1731
+ - '1603'
1732
+ - '1604'
1733
+ - '1605'
1734
+ - '1606'
1735
+ - '1607'
1736
+ - '1608'
1737
+ - '1609'
1738
+ - '1610'
1739
+ - '1611'
1740
+ - '1612'
1741
+ - '1613'
1742
+ - '1614'
1743
+ - '1615'
1744
+ - '1616'
1745
+ - '1617'
1746
+ - '1618'
1747
+ - '1619'
1748
+ - '1620'
1749
+ - '1621'
1750
+ - '1622'
1751
+ - '1623'
1752
+ - '1624'
1753
+ - '1625'
1754
+ - '1626'
1755
+ - '1627'
1756
+ - '1628'
1757
+ - '1629'
1758
+ - '1630'
1759
+ - '1631'
1760
+ - '1632'
1761
+ - '1633'
1762
+ - '1634'
1763
+ - '1635'
1764
+ - '1636'
1765
+ - '1637'
1766
+ - '1638'
1767
+ - '1639'
1768
+ - '1640'
1769
+ - '1641'
1770
+ - '1642'
1771
+ - '1643'
1772
+ - '1644'
1773
+ - '1645'
1774
+ - '1646'
1775
+ - '1647'
1776
+ - '1648'
1777
+ - '1649'
1778
+ - '1650'
1779
+ - '1651'
1780
+ - '1652'
1781
+ - '1653'
1782
+ - '1654'
1783
+ - '1655'
1784
+ - '1656'
1785
+ - '1657'
1786
+ - '1658'
1787
+ - '1659'
1788
+ - '1660'
1789
+ - '1661'
1790
+ - '1662'
1791
+ - '1663'
1792
+ - '1664'
1793
+ - '1665'
1794
+ - '1666'
1795
+ - '1667'
1796
+ - '1668'
1797
+ - '1669'
1798
+ - '1670'
1799
+ - '1671'
1800
+ - '1672'
1801
+ - '1673'
1802
+ - '1674'
1803
+ - '1675'
1804
+ - '1676'
1805
+ - '1677'
1806
+ - '1678'
1807
+ - '1679'
1808
+ - '1680'
1809
+ - '1681'
1810
+ - '1682'
1811
+ - '1683'
1812
+ - '1684'
1813
+ - '1685'
1814
+ - '1686'
1815
+ - '1687'
1816
+ - '1688'
1817
+ - '1689'
1818
+ - '1690'
1819
+ - '1691'
1820
+ - '1692'
1821
+ - '1693'
1822
+ - '1694'
1823
+ - '1695'
1824
+ - '1696'
1825
+ - '1697'
1826
+ - '1698'
1827
+ - '1699'
1828
+ - '1700'
1829
+ - '1701'
1830
+ - '1702'
1831
+ - '1703'
1832
+ - '1704'
1833
+ - '1705'
1834
+ - '1706'
1835
+ - '1707'
1836
+ - '1708'
1837
+ - '1709'
1838
+ - '1710'
1839
+ - '1711'
1840
+ - '1712'
1841
+ - '1713'
1842
+ - '1714'
1843
+ - '1715'
1844
+ - '1716'
1845
+ - '1717'
1846
+ - '1718'
1847
+ - '1719'
1848
+ - '1720'
1849
+ - '1721'
1850
+ - '1722'
1851
+ - '1723'
1852
+ - '1724'
1853
+ - '1725'
1854
+ - '1726'
1855
+ - '1727'
1856
+ - '1728'
1857
+ - '1729'
1858
+ - '1730'
1859
+ - '1731'
1860
+ - '1732'
1861
+ - '1733'
1862
+ - '1734'
1863
+ - '1735'
1864
+ - '1736'
1865
+ - '1737'
1866
+ - '1738'
1867
+ - '1739'
1868
+ - '1740'
1869
+ - '1741'
1870
+ - '1742'
1871
+ - '1743'
1872
+ - '1744'
1873
+ - '1745'
1874
+ - '1746'
1875
+ - '1747'
1876
+ - '1748'
1877
+ - '1749'
1878
+ - '1750'
1879
+ - '1751'
1880
+ - '1752'
1881
+ - '1753'
1882
+ - '1754'
1883
+ - '1755'
1884
+ - '1756'
1885
+ - '1757'
1886
+ - '1758'
1887
+ - '1759'
1888
+ - '1760'
1889
+ - '1761'
1890
+ - '1762'
1891
+ - '1763'
1892
+ - '1764'
1893
+ - '1765'
1894
+ - '1766'
1895
+ - '1767'
1896
+ - '1768'
1897
+ - '1769'
1898
+ - '1770'
1899
+ - '1771'
1900
+ - '1772'
1901
+ - '1773'
1902
+ - '1774'
1903
+ - '1775'
1904
+ - '1776'
1905
+ - '1777'
1906
+ - '1778'
1907
+ - '1779'
1908
+ - '1780'
1909
+ - '1781'
1910
+ - '1782'
1911
+ - '1783'
1912
+ - '1784'
1913
+ - '1785'
1914
+ - '1786'
1915
+ - '1787'
1916
+ - '1788'
1917
+ - '1789'
1918
+ - '1790'
1919
+ - '1791'
1920
+ - '1792'
1921
+ - '1793'
1922
+ - '1794'
1923
+ - '1795'
1924
+ - '1796'
1925
+ - '1797'
1926
+ - '1798'
1927
+ - '1799'
1928
+ - '1800'
1929
+ - '1801'
1930
+ - '1802'
1931
+ - '1803'
1932
+ - '1804'
1933
+ - '1805'
1934
+ - '1806'
1935
+ - '1807'
1936
+ - '1808'
1937
+ - '1809'
1938
+ - '1810'
1939
+ - '1811'
1940
+ - '1812'
1941
+ - '1813'
1942
+ - '1814'
1943
+ - '1815'
1944
+ - '1816'
1945
+ - '1817'
1946
+ - '1818'
1947
+ - '1819'
1948
+ - '1820'
1949
+ - '1821'
1950
+ - '1822'
1951
+ - '1823'
1952
+ - '1824'
1953
+ - '1825'
1954
+ - '1826'
1955
+ - '1827'
1956
+ - '1828'
1957
+ - '1829'
1958
+ - '1830'
1959
+ - '1831'
1960
+ - '1832'
1961
+ - '1833'
1962
+ - '1834'
1963
+ - '1835'
1964
+ - '1836'
1965
+ - '1837'
1966
+ - '1838'
1967
+ - '1839'
1968
+ - '1840'
1969
+ - '1841'
1970
+ - '1842'
1971
+ - '1843'
1972
+ - '1844'
1973
+ - '1845'
1974
+ - '1846'
1975
+ - '1847'
1976
+ - '1848'
1977
+ - '1849'
1978
+ - '1850'
1979
+ - '1851'
1980
+ - '1852'
1981
+ - '1853'
1982
+ - '1854'
1983
+ - '1855'
1984
+ - '1856'
1985
+ - '1857'
1986
+ - '1858'
1987
+ - '1859'
1988
+ - '1860'
1989
+ - '1861'
1990
+ - '1862'
1991
+ - '1863'
1992
+ - '1864'
1993
+ - '1865'
1994
+ - '1866'
1995
+ - '1867'
1996
+ - '1868'
1997
+ - '1869'
1998
+ - '1870'
1999
+ - '1871'
2000
+ - '1872'
2001
+ - '1873'
2002
+ - '1874'
2003
+ - '1875'
2004
+ - '1876'
2005
+ - '1877'
2006
+ - '1878'
2007
+ - '1879'
2008
+ - '1880'
2009
+ - '1881'
2010
+ - '1882'
2011
+ - '1883'
2012
+ - '1884'
2013
+ - '1885'
2014
+ - '1886'
2015
+ - '1887'
2016
+ - '1888'
2017
+ - '1889'
2018
+ - '1890'
2019
+ - '1891'
2020
+ - '1892'
2021
+ - '1893'
2022
+ - '1894'
2023
+ - '1895'
2024
+ - '1896'
2025
+ - '1897'
2026
+ - '1898'
2027
+ - '1899'
2028
+ - '1900'
2029
+ - '1901'
2030
+ - '1902'
2031
+ - '1903'
2032
+ - '1904'
2033
+ - '1905'
2034
+ - '1906'
2035
+ - '1907'
2036
+ - '1908'
2037
+ - '1909'
2038
+ - '1910'
2039
+ - '1911'
2040
+ - '1912'
2041
+ - '1913'
2042
+ - '1914'
2043
+ - '1915'
2044
+ - '1916'
2045
+ - '1917'
2046
+ - '1918'
2047
+ - '1919'
2048
+ - '1920'
2049
+ - '1921'
2050
+ - '1922'
2051
+ - '1923'
2052
+ - '1924'
2053
+ - '1925'
2054
+ - '1926'
2055
+ - '1927'
2056
+ - '1928'
2057
+ - '1929'
2058
+ - '1930'
2059
+ - '1931'
2060
+ - '1932'
2061
+ - '1933'
2062
+ - '1934'
2063
+ - '1935'
2064
+ - '1936'
2065
+ - '1937'
2066
+ - '1938'
2067
+ - '1939'
2068
+ - '1940'
2069
+ - '1941'
2070
+ - '1942'
2071
+ - '1943'
2072
+ - '1944'
2073
+ - '1945'
2074
+ - '1946'
2075
+ - '1947'
2076
+ - '1948'
2077
+ - '1949'
2078
+ - '1950'
2079
+ - '1951'
2080
+ - '1952'
2081
+ - '1953'
2082
+ - '1954'
2083
+ - '1955'
2084
+ - '1956'
2085
+ - '1957'
2086
+ - '1958'
2087
+ - '1959'
2088
+ - '1960'
2089
+ - '1961'
2090
+ - '1962'
2091
+ - '1963'
2092
+ - '1964'
2093
+ - '1965'
2094
+ - '1966'
2095
+ - '1967'
2096
+ - '1968'
2097
+ - '1969'
2098
+ - '1970'
2099
+ - '1971'
2100
+ - '1972'
2101
+ - '1973'
2102
+ - '1974'
2103
+ - '1975'
2104
+ - '1976'
2105
+ - '1977'
2106
+ - '1978'
2107
+ - '1979'
2108
+ - '1980'
2109
+ - '1981'
2110
+ - '1982'
2111
+ - '1983'
2112
+ - '1984'
2113
+ - '1985'
2114
+ - '1986'
2115
+ - '1987'
2116
+ - '1988'
2117
+ - '1989'
2118
+ - '1990'
2119
+ - '1991'
2120
+ - '1992'
2121
+ - '1993'
2122
+ - '1994'
2123
+ - '1995'
2124
+ - '1996'
2125
+ - '1997'
2126
+ - '1998'
2127
+ - '1999'
2128
+ - '2000'
2129
+ - '2001'
2130
+ - '2002'
2131
+ - '2003'
2132
+ - '2004'
2133
+ - '2005'
2134
+ - '2006'
2135
+ - '2007'
2136
+ - '2008'
2137
+ - '2009'
2138
+ - '2010'
2139
+ - '2011'
2140
+ - '2012'
2141
+ - '2013'
2142
+ - '2014'
2143
+ - '2015'
2144
+ - '2016'
2145
+ - '2017'
2146
+ - '2018'
2147
+ - '2019'
2148
+ - '2020'
2149
+ - '2021'
2150
+ - '2022'
2151
+ - '2023'
2152
+ - '2024'
2153
+ - '2025'
2154
+ - '2026'
2155
+ - '2027'
2156
+ - '2028'
2157
+ - '2029'
2158
+ - '2030'
2159
+ - '2031'
2160
+ - '2032'
2161
+ - '2033'
2162
+ - '2034'
2163
+ - '2035'
2164
+ - '2036'
2165
+ - '2037'
2166
+ - '2038'
2167
+ - '2039'
2168
+ - '2040'
2169
+ - '2041'
2170
+ - '2042'
2171
+ - '2043'
2172
+ - '2044'
2173
+ - '2045'
2174
+ - '2046'
2175
+ - '2047'
2176
+ - <unk>
2177
+ - <sos/eos>
2178
+ init: xavier_uniform
2179
+ collate_fn_conf:
2180
+ label_downsampling: 1
2181
+ pad: false
2182
+ rand_crop: true
2183
+ crop_audio: true
2184
+ mix_speech: true
2185
+ noise_apply_prob: 0.2
2186
+ dynamic_mixing_prob: 0.5
2187
+ reverb_speech: true
2188
+ rir_apply_prob: 0.3
2189
+ input_size: null
2190
+ num_classes: 2048
2191
+ use_preprocessor: true
2192
+ token_type: word
2193
+ bpemodel: null
2194
+ non_linguistic_symbols: null
2195
+ cleaner: null
2196
+ g2p: null
2197
+ speech_volume_normalize: null
2198
+ rir_scp: null
2199
+ rir_apply_prob: 1.0
2200
+ noise_scp: null
2201
+ noise_apply_prob: 1.0
2202
+ noise_db_range: '13_15'
2203
+ pred_masked_weight: 1.0
2204
+ pred_nomask_weight: 0.0
2205
+ loss_weights: 0.0
2206
+ frontend: wav2vec_cnn
2207
+ frontend_conf:
2208
+ norm_mode: layer_norm
2209
+ conv_mode: standard
2210
+ bias: true
2211
+ normalize_audio: true
2212
+ fs: 16k
2213
+ specaug: null
2214
+ specaug_conf: {}
2215
+ normalize: null
2216
+ normalize_conf: {}
2217
+ preencoder: linear
2218
+ preencoder_conf:
2219
+ output_size: 1024
2220
+ encoder: e_branchformer
2221
+ encoder_conf:
2222
+ output_size: 1024
2223
+ attention_heads: 8
2224
+ attention_layer_type: selfattn
2225
+ pos_enc_layer_type: conv
2226
+ rel_pos_type: latest
2227
+ cgmlp_linear_units: 4096
2228
+ cgmlp_conv_kernel: 31
2229
+ use_linear_after_conv: false
2230
+ gate_activation: identity
2231
+ num_blocks: 19
2232
+ dropout_rate: 0.1
2233
+ positional_dropout_rate: 0.1
2234
+ attention_dropout_rate: 0.1
2235
+ input_layer: wav2vec
2236
+ layer_drop_rate: 0.0
2237
+ linear_units: 4096
2238
+ positionwise_layer_type: linear
2239
+ macaron_ffn: true
2240
+ use_ffn: true
2241
+ merge_conv_kernel: 31
2242
+ use_flash_attn: false
2243
+ activation_ckpt: true
2244
+ model: espnet
2245
+ model_conf:
2246
+ feature_grad_mult: 0.1
2247
+ masker: hubert
2248
+ masker_conf:
2249
+ mask_prob: 0.8
2250
+ mask_selection: uniform #static
2251
+ mask_other: 0.0
2252
+ mask_length: 10
2253
+ no_mask_overlap: false
2254
+ mask_min_space: 1
2255
+ mask_channel_prob: 0.0
2256
+ mask_channel_selection: static
2257
+ mask_channel_other: 0.0
2258
+ mask_channel_length: 10
2259
+ no_mask_channel_overlap: false
2260
+ mask_channel_min_space: 0
2261
+ loss: hubert_ce
2262
+ loss_conf:
2263
+ num_classes: 2048
2264
+ final_dim: 768
2265
+ layers:
2266
+ - 18
2267
+ layer_weights:
2268
+ - 1.0
2269
+ required:
2270
+ - output_dir
2271
+ - token_list
2272
+ version: '202402'
2273
+ distributed: true