You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-28 - 14:16

x86 Intel Core i5-8365UE @1600 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4.osadl.org (updated Tue Mar 28, 2023 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2878702233176,19sleep30-21swapper/319:06:403
2880832232197,24sleep00-21swapper/019:09:420
2879852229176,19sleep60-21swapper/619:08:196
2880022222188,22sleep50-21swapper/519:08:345
2878272222188,23sleep70-21swapper/719:06:037
2879802221188,22sleep10-21swapper/119:08:151
2878152221193,18sleep40-21swapper/419:05:534
2879812219185,22sleep20-21swapper/219:08:162
28835699650,62cyclictest0-21swapper/500:24:035
3759232490,0sleep20-21swapper/221:25:152
3484592490,0sleep00-21swapper/020:50:220
5586492470,0sleep20-21swapper/200:05:222
288360994747,0cyclictest0-21swapper/623:37:516
4426872460,0sleep70-21swapper/722:25:197
4419062440,0sleep40-21swapper/422:25:164
288340994239,3cyclictest0-21swapper/000:24:020
288350993938,1cyclictest0-21swapper/300:24:033
288345993838,0cyclictest0-21swapper/222:09:242
28834299330,33cyclictest0-21swapper/122:23:321
28834099330,33cyclictest0-21swapper/021:15:010
28834099330,32cyclictest391718-21idleruntime-cro21:40:010
28835699320,31cyclictest0-21swapper/521:14:475
28835699320,28cyclictest0-21swapper/522:48:245
288345993228,1cyclictest151rcu_preempt23:00:222
28834099320,3cyclictest0-21swapper/022:21:480
28834099320,32cyclictest0-21swapper/022:59:340
28834099320,32cyclictest0-21swapper/022:11:150
28834099320,31cyclictest470156-21perf22:49:590
288360993131,0cyclictest0-21swapper/621:10:566
288356993127,4cyclictest0-21swapper/500:25:135
28835699310,31cyclictest0-21swapper/523:34:025
28835699310,31cyclictest0-21swapper/522:37:475
28835699310,30cyclictest357510-21diskmemload21:34:285
28835699310,28cyclictest0-21swapper/521:50:195
28835699310,1cyclictest357510-21diskmemload23:46:445
28835699310,0cyclictest0-21swapper/523:52:235
28835699310,0cyclictest0-21swapper/523:16:405
28835699310,0cyclictest0-21swapper/523:16:405
28835699310,0cyclictest0-21swapper/500:30:375
28835099310,30cyclictest357510-21diskmemload21:35:083
28835099310,30cyclictest0-21swapper/322:21:373
288342993131,0cyclictest0-21swapper/121:39:241
288340993127,4cyclictest0-21swapper/022:50:000
28834099310,31cyclictest0-21swapper/023:59:590
28834099310,31cyclictest0-21swapper/023:17:240
28834099310,31cyclictest0-21swapper/023:17:240
28834099310,31cyclictest0-21swapper/023:11:020
28834099310,31cyclictest0-21swapper/023:01:230
28834099310,31cyclictest0-21swapper/022:44:310
28834099310,31cyclictest0-21swapper/022:28:270
28834099310,31cyclictest0-21swapper/022:17:180
28834099310,31cyclictest0-21swapper/021:51:330
28834099310,31cyclictest0-21swapper/021:20:520
28834099310,31cyclictest0-21swapper/021:16:020
28834099310,31cyclictest0-21swapper/000:00:040
28834099310,30cyclictest0-21swapper/023:05:200
28834099310,30cyclictest0-21swapper/022:02:020
28834099310,30cyclictest0-21swapper/021:45:030
28834099310,30cyclictest0-21swapper/000:36:290
28834099310,30cyclictest0-21swapper/000:11:270
28836499300,29cyclictest357510-21diskmemload21:47:187
28836499300,1cyclictest590097-21munin-run00:34:597
288356993028,2cyclictest0-21swapper/523:04:345
288356993027,3cyclictest0-21swapper/522:17:315
288356993027,2cyclictest357510-21diskmemload21:55:245
288356993026,4cyclictest0-21swapper/522:00:205
28835699300,29cyclictest0-21swapper/521:00:115
28835699300,28cyclictest0-21swapper/523:35:505
28835699300,28cyclictest0-21swapper/522:54:095
28835699300,28cyclictest0-21swapper/521:25:575
28835699300,27cyclictest0-21swapper/522:21:485
28835699300,0cyclictest0-21swapper/523:41:565
28835699300,0cyclictest0-21swapper/523:05:075
28835699300,0cyclictest0-21swapper/522:59:305
28835699300,0cyclictest0-21swapper/521:45:135
28835699300,0cyclictest0-21swapper/519:11:385
28835699300,0cyclictest0-21swapper/500:16:555
288350993027,2cyclictest0-21swapper/323:58:073
28835099300,30cyclictest0-21swapper/322:02:013
28835099300,30cyclictest0-21swapper/300:30:413
28835099300,30cyclictest0-21swapper/300:00:103
28835099300,29cyclictest493442-21turbostat.cron23:10:013
28835099300,29cyclictest357510-21diskmemload21:22:453
28835099300,29cyclictest291155-21latency_hist19:15:013
28835099300,29cyclictest0-21swapper/323:40:153
28835099300,29cyclictest0-21swapper/323:11:163
28835099300,29cyclictest0-21swapper/300:12:323
28835099300,1cyclictest0-21swapper/323:22:243
28835099300,1cyclictest0-21swapper/321:45:023
288345993029,1cyclictest0-21swapper/223:40:492
28834599301,29cyclictest63850irq/124-eno122:25:252
28834599300,28cyclictest0-21swapper/222:36:402
288342993030,0cyclictest0-21swapper/122:30:271
288340993028,2cyclictest0-21swapper/023:22:370
288340993028,2cyclictest0-21swapper/000:17:070
288340993027,3cyclictest0-21swapper/021:26:010
288340993027,3cyclictest0-21swapper/000:25:290
28834099300,30cyclictest0-21swapper/023:52:130
28834099300,30cyclictest0-21swapper/023:46:130
28834099300,30cyclictest0-21swapper/023:36:120
28834099300,30cyclictest0-21swapper/023:34:360
28834099300,30cyclictest0-21swapper/022:37:560
28834099300,30cyclictest0-21swapper/022:07:150
28834099300,30cyclictest0-21swapper/021:41:110
28834099300,30cyclictest0-21swapper/000:32:030
28834099300,2cyclictest0-21swapper/023:28:210
28834099300,29cyclictest0-21swapper/023:40:160
28834099300,29cyclictest0-21swapper/022:32:370
288364992927,1cyclictest546244-21apt-get23:55:187
28836499290,29cyclictest357510-21diskmemload23:24:137
28836499290,29cyclictest0-21swapper/723:44:217
28836499290,29cyclictest0-21swapper/723:32:407
28836499290,29cyclictest0-21swapper/723:17:217
28836499290,29cyclictest0-21swapper/723:17:217
28836499290,29cyclictest0-21swapper/723:00:027
28836499290,29cyclictest0-21swapper/722:32:507
28836499290,29cyclictest0-21swapper/722:14:407
28836499290,29cyclictest0-21swapper/722:08:207
28836499290,29cyclictest0-21swapper/721:57:377
28836499290,29cyclictest0-21swapper/721:41:347
28836499290,29cyclictest0-21swapper/721:17:297
28836499290,29cyclictest0-21swapper/700:36:237
28836499290,28cyclictest322971-21latency_hist20:10:007
28836499290,28cyclictest0-21swapper/700:26:587
28836499290,1cyclictest357510-21diskmemload23:47:037
28836499290,1cyclictest357510-21diskmemload23:10:477
28836499290,1cyclictest357510-21diskmemload00:18:047
28836499290,1cyclictest0-21swapper/721:35:157
28836499290,0cyclictest357510-21diskmemload23:26:347
288360992928,1cyclictest590072-21ssh00:34:596
288360992928,1cyclictest357510-21diskmemload00:08:296
288360992928,1cyclictest0-21swapper/622:50:146
28836099290,29cyclictest0-21swapper/622:19:406
28836099290,28cyclictest0-21swapper/622:35:146
28836099290,28cyclictest0-21swapper/621:02:296
28836099290,1cyclictest357510-21diskmemload23:10:126
28836099290,1cyclictest357510-21diskmemload21:35:436
288356992927,2cyclictest0-21swapper/522:26:425
288356992927,2cyclictest0-21swapper/521:39:585
288356992927,2cyclictest0-21swapper/500:36:205
288356992927,2cyclictest0-21swapper/500:04:135
288356992927,1cyclictest357510-21diskmemload22:43:075
288356992927,1cyclictest320-21systemd-journal20:15:005
288356992926,3cyclictest0-21swapper/521:41:025
28835699290,29cyclictest0-21swapper/521:19:575
28835699290,28cyclictest357510-21diskmemload23:20:175
28835699290,28cyclictest0-21swapper/523:10:115
28835699290,28cyclictest0-21swapper/522:33:415
28835699290,27cyclictest76-21kcompactd019:41:075
28835699290,1cyclictest511093-21ssh23:25:115
28835699290,0cyclictest0-21swapper/523:59:435
28835699290,0cyclictest0-21swapper/522:12:135
28835699290,0cyclictest0-21swapper/500:05:585
288354992927,1cyclictest573578-21turbostat.cron00:20:004
28835499290,28cyclictest0-21swapper/420:58:074
28835499290,28cyclictest0-21swapper/400:25:204
28835499290,1cyclictest357510-21diskmemload23:42:084
288350992927,2cyclictest0-21swapper/322:17:513
288350992927,1cyclictest0-21swapper/323:46:443
28835099290,29cyclictest357510-21diskmemload23:52:123
28835099290,29cyclictest0-21swapper/323:00:053
28835099290,29cyclictest0-21swapper/322:59:353
28835099290,29cyclictest0-21swapper/322:50:013
28835099290,29cyclictest0-21swapper/322:47:493
28835099290,29cyclictest0-21swapper/322:25:133
28835099290,29cyclictest0-21swapper/322:05:353
28835099290,29cyclictest0-21swapper/321:40:073
28835099290,29cyclictest0-21swapper/321:25:473
28835099290,29cyclictest0-21swapper/300:36:423
28835099290,28cyclictest0-21swapper/322:35:423
28835099290,28cyclictest0-21swapper/322:30:183
28835099290,28cyclictest0-21swapper/321:30:023
28835099290,1cyclictest357510-21diskmemload23:15:573
28835099290,1cyclictest357510-21diskmemload23:15:563
28835099290,1cyclictest0-21swapper/322:10:123
28835099290,1cyclictest0-21swapper/321:10:013
28835099290,1cyclictest0-21swapper/300:25:233
28835099290,0cyclictest357510-21diskmemload21:15:453
28835099290,0cyclictest0-21swapper/323:33:383
288345992927,1cyclictest63850irq/124-eno122:30:242
288345992927,1cyclictest0-21swapper/220:04:592
28834599290,29cyclictest0-21swapper/223:27:592
28834599290,29cyclictest0-21swapper/221:44:192
28834599290,29cyclictest0-21swapper/221:34:042
28834599290,29cyclictest0-21swapper/221:13:592
28834599290,29cyclictest0-21swapper/200:38:412
28834599290,29cyclictest0-21swapper/200:25:162
28834599290,28cyclictest563241-21apt-get00:10:152
28834599290,28cyclictest0-21swapper/223:35:132
28834599290,28cyclictest0-21swapper/222:10:102
28834599290,28cyclictest0-21swapper/200:23:252
28834599290,1cyclictest357510-21diskmemload23:30:092
28834599290,1cyclictest0-21swapper/222:43:122
28834599290,1cyclictest0-21swapper/221:56:492
28834599290,1cyclictest0-21swapper/220:19:592
28834599290,0cyclictest0-21swapper/222:57:522
288342992928,1cyclictest357510-21diskmemload23:25:321
288342992928,1cyclictest0-21swapper/122:58:321
28834299290,28cyclictest357510-21diskmemload21:50:361
28834299290,28cyclictest0-21swapper/123:05:121
28834299290,28cyclictest0-21swapper/120:15:121
28834299290,1cyclictest518437-21ssh23:30:221
28834299290,1cyclictest416034-21cat22:00:221
28834299290,1cyclictest0-21swapper/100:05:001
288340992927,2cyclictest0-21swapper/021:55:340
288340992927,2cyclictest0-21swapper/020:12:470
28834099290,29cyclictest0-21swapper/021:34:350
28834099290,29cyclictest0-21swapper/000:06:010
28834099290,28cyclictest0-21swapper/020:20:260
288364992828,0cyclictest0-21swapper/722:17:397
288364992828,0cyclictest0-21swapper/721:50:437
288364992828,0cyclictest0-21swapper/721:20:027
288364992828,0cyclictest0-21swapper/700:11:467
288364992827,1cyclictest471901-21memory22:50:217
288364992827,1cyclictest0-21swapper/721:07:247
28836499280,28cyclictest357510-21diskmemload00:05:207
28836499280,28cyclictest0-21swapper/723:52:547
28836499280,28cyclictest0-21swapper/723:38:297
28836499280,28cyclictest0-21swapper/722:55:327
28836499280,28cyclictest0-21swapper/722:40:167
28836499280,28cyclictest0-21swapper/722:20:137
28836499280,28cyclictest0-21swapper/722:00:227
28836499280,28cyclictest0-21swapper/721:30:077
28836499280,28cyclictest0-21swapper/721:10:417
28836499280,28cyclictest0-21swapper/720:36:167
28836499280,28cyclictest0-21swapper/700:20:157
28836499280,0cyclictest357510-21diskmemload23:09:447
28836499280,0cyclictest357510-21diskmemload00:01:407
28836499280,0cyclictest0-21swapper/722:46:097
28836499280,0cyclictest0-21swapper/722:35:417
28836499280,0cyclictest0-21swapper/721:26:087
28836499280,0cyclictest0-21swapper/720:51:017
28836499280,0cyclictest0-21swapper/719:50:257
288360992828,0cyclictest0-21swapper/620:16:056
288360992827,1cyclictest357510-21diskmemload21:45:366
288360992827,1cyclictest0-21swapper/623:01:596
288360992827,1cyclictest0-21swapper/622:30:076
28836099280,28cyclictest357510-21diskmemload21:25:146
28836099280,28cyclictest0-21swapper/623:50:086
28836099280,28cyclictest0-21swapper/623:45:306
28836099280,28cyclictest0-21swapper/623:40:366
28836099280,28cyclictest0-21swapper/623:25:046
28836099280,28cyclictest0-21swapper/623:23:246
28836099280,28cyclictest0-21swapper/623:17:336
28836099280,28cyclictest0-21swapper/623:17:336
28836099280,28cyclictest0-21swapper/623:06:216
28836099280,28cyclictest0-21swapper/622:55:566
28836099280,28cyclictest0-21swapper/622:41:076
28836099280,28cyclictest0-21swapper/622:26:296
28836099280,28cyclictest0-21swapper/622:21:036
28836099280,28cyclictest0-21swapper/622:05:416
28836099280,28cyclictest0-21swapper/621:56:256
28836099280,28cyclictest0-21swapper/621:50:206
28836099280,28cyclictest0-21swapper/621:40:426
28836099280,28cyclictest0-21swapper/621:21:476
28836099280,28cyclictest0-21swapper/621:15:346
28836099280,28cyclictest0-21swapper/600:35:406
28836099280,28cyclictest0-21swapper/600:25:136
28836099280,28cyclictest0-21swapper/600:21:156
28836099280,28cyclictest0-21swapper/600:11:396
28836099280,28cyclictest0-21swapper/600:01:456
28836099280,0cyclictest357510-21diskmemload22:13:016
28836099280,0cyclictest357510-21diskmemload21:30:266
28836099280,0cyclictest0-21swapper/623:58:296
28836099280,0cyclictest0-21swapper/623:30:236
28836099280,0cyclictest0-21swapper/622:45:236
28836099280,0cyclictest0-21swapper/622:00:106
288356992827,1cyclictest0-21swapper/522:06:565
288356992827,1cyclictest0-21swapper/520:53:125
288356992826,2cyclictest0-21swapper/500:12:175
28835699280,28cyclictest357510-21diskmemload21:23:185
288354992828,0cyclictest0-21swapper/421:20:484
28835499280,28cyclictest357510-21diskmemload23:45:174
28835499280,28cyclictest357510-21diskmemload23:36:454
28835499280,28cyclictest357510-21diskmemload23:25:554
28835499280,28cyclictest357510-21diskmemload23:10:164
28835499280,28cyclictest0-21swapper/423:55:254
28835499280,28cyclictest0-21swapper/423:51:404
28835499280,28cyclictest0-21swapper/423:33:204
28835499280,28cyclictest0-21swapper/423:21:354
28835499280,28cyclictest0-21swapper/423:15:164
28835499280,28cyclictest0-21swapper/423:15:164
28835499280,28cyclictest0-21swapper/423:00:154
28835499280,28cyclictest0-21swapper/422:56:274
28835499280,28cyclictest0-21swapper/422:45:474
28835499280,28cyclictest0-21swapper/422:36:384
28835499280,28cyclictest0-21swapper/422:31:294
28835499280,28cyclictest0-21swapper/422:16:214
28835499280,28cyclictest0-21swapper/422:10:124
28835499280,28cyclictest0-21swapper/422:06:494
28835499280,28cyclictest0-21swapper/422:01:544
28835499280,28cyclictest0-21swapper/421:56:414
28835499280,28cyclictest0-21swapper/421:46:174
28835499280,28cyclictest0-21swapper/421:35:534
28835499280,28cyclictest0-21swapper/421:34:044
28835499280,28cyclictest0-21swapper/421:14:124
28835499280,28cyclictest0-21swapper/419:50:154
28835499280,28cyclictest0-21swapper/419:22:024
28835499280,28cyclictest0-21swapper/400:32:164
28835499280,28cyclictest0-21swapper/400:22:354
28835499280,28cyclictest0-21swapper/400:10:174
28835499280,28cyclictest0-21swapper/400:07:254
28835499280,1cyclictest393119-21perl21:40:204
28835499280,0cyclictest357510-21diskmemload23:05:394
28835499280,0cyclictest357510-21diskmemload22:43:054
28835499280,0cyclictest357510-21diskmemload21:53:454
28835499280,0cyclictest0-21swapper/422:50:484
28835499280,0cyclictest0-21swapper/422:21:034
28835499280,0cyclictest0-21swapper/421:25:564
28835499280,0cyclictest0-21swapper/421:16:124
28835499280,0cyclictest0-21swapper/400:37:594
288350992828,0cyclictest0-21swapper/322:41:083
288350992827,1cyclictest0-21swapper/321:55:333
288350992827,1cyclictest0-21swapper/321:00:113
28835099280,28cyclictest0-21swapper/321:50:573
28835099280,28cyclictest0-21swapper/320:20:273
28835099280,28cyclictest0-21swapper/319:52:353
28835099280,28cyclictest0-21swapper/319:24:453
28835099280,28cyclictest0-21swapper/319:15:133
28835099280,28cyclictest0-21swapper/300:15:113
28835099280,28cyclictest0-21swapper/300:08:463
28835099280,0cyclictest0-21swapper/323:36:433
28835099280,0cyclictest0-21swapper/323:25:033
288345992828,0cyclictest0-21swapper/221:35:082
288345992827,1cyclictest470709-21apt-get22:50:152
288345992827,1cyclictest0-21swapper/222:21:432
28834599280,28cyclictest553334-21strings00:00:242
28834599280,28cyclictest357510-21diskmemload23:45:352
28834599280,28cyclictest357510-21diskmemload22:15:242
28834599280,28cyclictest0-21swapper/223:21:502
28834599280,28cyclictest0-21swapper/223:15:222
28834599280,28cyclictest0-21swapper/223:15:222
28834599280,28cyclictest0-21swapper/223:10:192
28834599280,28cyclictest0-21swapper/222:48:162
28834599280,28cyclictest0-21swapper/222:02:112
28834599280,28cyclictest0-21swapper/221:53:262
28834599280,28cyclictest0-21swapper/221:45:152
28834599280,28cyclictest0-21swapper/221:20:212
28834599280,28cyclictest0-21swapper/221:15:202
28834599280,28cyclictest0-21swapper/220:05:412
28834599280,28cyclictest0-21swapper/219:17:072
28834599280,28cyclictest0-21swapper/200:31:032
28834599280,28cyclictest0-21swapper/200:19:052
28834599280,0cyclictest0-21swapper/223:55:152
28834599280,0cyclictest0-21swapper/223:50:282
28834599280,0cyclictest0-21swapper/223:07:162
288342992828,0cyclictest0-21swapper/123:37:281
288342992828,0cyclictest0-21swapper/122:06:101
288342992827,1cyclictest357510-21diskmemload22:51:071
288342992827,1cyclictest357510-21diskmemload22:25:381
28834299280,28cyclictest76-21kcompactd020:44:281
28834299280,28cyclictest357510-21diskmemload21:20:581
28834299280,28cyclictest357510-21diskmemload00:21:341
28834299280,28cyclictest357510-21diskmemload00:10:081
28834299280,28cyclictest0-21swapper/123:55:101
28834299280,28cyclictest0-21swapper/123:40:041
28834299280,28cyclictest0-21swapper/123:23:151
28834299280,28cyclictest0-21swapper/123:15:121
28834299280,28cyclictest0-21swapper/123:15:121
28834299280,28cyclictest0-21swapper/123:10:511
28834299280,28cyclictest0-21swapper/123:00:471
28834299280,28cyclictest0-21swapper/122:42:231
28834299280,28cyclictest0-21swapper/122:35:131
28834299280,28cyclictest0-21swapper/122:17:141
28834299280,28cyclictest0-21swapper/122:10:341
28834299280,28cyclictest0-21swapper/121:56:171
28834299280,28cyclictest0-21swapper/121:45:261
28834299280,28cyclictest0-21swapper/121:40:331
28834299280,28cyclictest0-21swapper/121:25:131
28834299280,28cyclictest0-21swapper/119:31:191
28834299280,28cyclictest0-21swapper/100:35:031
28834299280,28cyclictest0-21swapper/100:31:211
28834299280,28cyclictest0-21swapper/100:26:101
28834299280,28cyclictest0-21swapper/100:05:161
28834299280,1cyclictest0-21swapper/123:45:111
28834299280,0cyclictest357510-21diskmemload22:45:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional