You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 23:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Mon Jun 16, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321527899500,48cyclictest643-21systemd-journal15:48:327
3215278994443,0cyclictest0-21swapper/715:43:277
3215254994139,2cyclictest3215518-21kworker/u16:2+events_unbound15:43:284
3215271994037,2cyclictest3701644-21kworker/u16:0+events_unbound20:49:286
3215271993937,2cyclictest3806328-21kworker/u16:4+flush-8:020:44:046
3215271993633,2cyclictest3465112-21kworker/u16:0+flush-8:018:04:256
3215271993633,2cyclictest2447960-21kworker/u16:5+events_unbound16:54:126
37485122330,1chrt3748511-21kthreadcore19:49:337
35147242330,1chrt0-21swapper/717:54:357
3215271993129,2cyclictest3414204-21kworker/u16:2+flush-8:017:29:046
3215271993129,2cyclictest2447960-21kworker/u16:5+flush-8:016:14:056
3215271993128,2cyclictest3270430-21kworker/u16:3+events_unbound16:44:246
3215271993028,2cyclictest3414204-21kworker/u16:2+events_unbound17:14:446
3215271993028,2cyclictest2447960-21kworker/u16:5+events_unbound16:59:456
3215271993027,2cyclictest3701644-21kworker/u16:0+events_unbound20:54:296
3215271993027,2cyclictest2447960-21kworker/u16:5+flush-8:017:39:256
3215271992927,2cyclictest3701644-21kworker/u16:0+events_unbound20:04:046
3215271992927,2cyclictest2447960-21kworker/u16:5+events_unbound15:40:596
3215271992926,2cyclictest2447960-21kworker/u16:5+events_unbound15:54:116
3215278992827,0cyclictest0-21swapper/719:45:327
3215278992827,0cyclictest0-21swapper/718:05:197
3215271992826,2cyclictest3289989-21kworker/u16:1+events_unbound17:29:116
3215271992826,2cyclictest3281395-21kworker/u16:0+flush-8:016:09:096
3215278992726,0cyclictest0-21swapper/719:31:537
3215271992725,2cyclictest3701644-21kworker/u16:0+flush-8:020:14:346
3215278992625,0cyclictest0-21swapper/718:01:467
3215278992625,0cyclictest0-21swapper/717:11:157
321527899260,24cyclictest3486056-21latency_hist17:44:107
3215271992624,2cyclictest3784606-21kworker/u16:3+events_unbound20:24:086
3215271992624,2cyclictest3763073-21kworker/u16:1+events_unbound20:24:276
3215271992624,2cyclictest3414204-21kworker/u16:2+events_unbound18:25:096
3215278992524,0cyclictest0-21swapper/721:02:407
3215278992524,0cyclictest0-21swapper/720:46:287
3215278992524,0cyclictest0-21swapper/720:00:137
3215278992524,0cyclictest0-21swapper/718:32:447
3215271992523,2cyclictest3414204-21kworker/u16:2+events_unbound17:54:106
3215278992424,0cyclictest0-21swapper/719:38:577
3215278992423,0cyclictest0-21swapper/720:57:137
3215278992423,0cyclictest0-21swapper/720:35:287
3215278992423,0cyclictest0-21swapper/720:35:287
3215278992423,0cyclictest0-21swapper/720:31:337
3215278992423,0cyclictest0-21swapper/720:26:447
3215278992423,0cyclictest0-21swapper/719:25:447
321527899240,23cyclictest3466175-21sendmail17:34:107
3215271992421,2cyclictest2447960-21kworker/u16:5+events_unbound17:09:136
3215278992322,1cyclictest0-21swapper/719:10:297
3215278992322,0cyclictest0-21swapper/719:19:257
3215278992322,0cyclictest0-21swapper/718:51:247
3215278992322,0cyclictest0-21swapper/715:55:337
3215271992321,2cyclictest3659888-21kworker/u16:7+flush-8:019:39:296
3215271992321,2cyclictest3508120-21kworker/u16:3+flush-8:018:34:246
3215271992321,2cyclictest3508120-21kworker/u16:3+events_unbound18:09:356
3215278992221,0cyclictest0-21swapper/720:39:247
3215278992221,0cyclictest0-21swapper/720:12:077
3215278992221,0cyclictest0-21swapper/719:57:337
3215278992221,0cyclictest0-21swapper/718:28:077
3215278992221,0cyclictest0-21swapper/718:10:087
3215278992221,0cyclictest0-21swapper/716:47:017
3215278992221,0cyclictest0-21swapper/716:14:527
3215278992220,1cyclictest0-21swapper/717:16:087
321527899220,21cyclictest3814647-21latency_hist20:24:087
3215271992220,2cyclictest3270430-21kworker/u16:3+flush-8:016:14:276
3215271992219,2cyclictest3352334-21kworker/u16:2+flush-8:016:49:166
3215263992218,3cyclictest3239142-21pool-/usr/libex15:40:375
3215278992121,0cyclictest0-21swapper/719:03:397
3215278992121,0cyclictest0-21swapper/719:03:397
3215278992121,0cyclictest0-21swapper/716:58:137
3215278992120,0cyclictest0-21swapper/719:17:007
3215278992120,0cyclictest0-21swapper/717:46:137
3215278992120,0cyclictest0-21swapper/716:22:177
3215278992120,0cyclictest0-21swapper/715:49:577
3215271992119,2cyclictest3609108-21kworker/u16:4+flush-8:018:54:096
3215271992118,2cyclictest3611558-21kworker/u16:5+events_unbound19:09:276
3215271992118,2cyclictest3270430-21kworker/u16:3+flush-8:016:39:226
3215271992118,2cyclictest3270430-21kworker/u16:3+flush-8:016:39:226
3215278992019,0cyclictest0-21swapper/720:05:367
3215278992019,0cyclictest0-21swapper/719:40:047
3215278992019,0cyclictest0-21swapper/718:24:047
3215278992019,0cyclictest0-21swapper/718:17:537
3215278992019,0cyclictest0-21swapper/718:17:537
3215278992019,0cyclictest0-21swapper/717:25:567
3215278992019,0cyclictest0-21swapper/716:40:127
3215278992019,0cyclictest0-21swapper/716:40:127
3215271992018,2cyclictest3670872-21kworker/u16:0+events_unbound19:14:246
3215271992018,2cyclictest3259757-21kworker/u16:2+flush-8:015:54:096
3215271992017,2cyclictest2447960-21kworker/u16:5+events_unbound15:59:236
3215271991917,2cyclictest3876101-21kworker/u16:1+flush-8:020:59:396
3215271991917,2cyclictest3414204-21kworker/u16:2+events_unbound17:34:346
3215271991916,2cyclictest3701644-21kworker/u16:0+events_unbound19:29:236
3215278991818,0cyclictest0-21swapper/719:08:487
3215278991817,0cyclictest0-21swapper/716:35:297
3215271991816,2cyclictest3701644-21kworker/u16:0+events_unbound19:36:096
3215271991815,2cyclictest3588980-21kworker/u16:0+events_unbound18:54:266
3215278991717,0cyclictest0-21swapper/720:17:517
3215271991715,2cyclictest3466185-21kworker/u16:4+events_unbound18:14:456
3215271991715,2cyclictest3466185-21kworker/u16:4+events_unbound18:14:456
3215271991715,2cyclictest3289989-21kworker/u16:1+flush-8:016:34:046
321526399170,17cyclictest0-21swapper/515:49:335
321525499170,1cyclictest0-21swapper/416:49:354
3215278991615,0cyclictest0-21swapper/718:36:457
3215278991615,0cyclictest0-21swapper/716:11:567
321527899160,14cyclictest643-21systemd-journal15:34:117
3215271991614,2cyclictest3549578-21kworker/u16:1+flush-8:018:59:346
3215271991614,2cyclictest3549578-21kworker/u16:1+flush-8:018:59:346
3215254991612,3cyclictest3396151-21kthreadcore16:59:314
3215278991514,0cyclictest0-21swapper/717:52:337
3215278991514,0cyclictest0-21swapper/716:31:367
3215278991512,2cyclictest3635817-21kthreadcore18:54:327
321527899150,14cyclictest1313-21snmpd17:24:087
3215271991513,2cyclictest3825663-21kworker/u16:2+flush-8:020:29:546
3215271991513,2cyclictest3691265-21kworker/u16:1+flush-8:019:24:446
3215263991512,2cyclictest3466185-21kworker/u16:4+events_unbound17:34:285
3215278991414,0cyclictest0-21swapper/716:06:597
3215278991413,0cyclictest0-21swapper/718:45:367
3215271991413,1cyclictest0-21swapper/620:04:316
3215271991412,2cyclictest3206937-21kworker/u16:1+events_unbound15:34:306
3215263991413,1cyclictest0-21swapper/515:34:325
321526399140,8cyclictest0-21swapper/516:44:275
321526399140,14cyclictest0-21swapper/516:19:285
3215254991412,2cyclictest3806328-21kworker/u16:4+flush-8:020:59:094
33722152130,0sleep40-21swapper/416:44:454
3215278991311,1cyclictest3383346-21turbostat16:54:097
3215271991311,2cyclictest3847018-21kworker/u16:3+flush-8:020:44:316
3215271991311,2cyclictest3414204-21kworker/u16:2+events_unbound18:39:356
321527199130,12cyclictest0-21swapper/619:22:106
3215263991312,1cyclictest0-21swapper/519:09:245
321526399130,13cyclictest0-21swapper/520:00:295
321526399130,12cyclictest0-21swapper/519:24:235
3215254991312,1cyclictest0-21swapper/417:44:364
3215254991311,1cyclictest3505786-21sensors_fan17:49:394
321525499130,6cyclictest0-21swapper/416:14:264
321525499130,13cyclictest0-21swapper/417:09:464
3215278991212,0cyclictest0-21swapper/716:28:407
321527899120,11cyclictest1313-21snmpd16:02:067
321527899120,10cyclictest3873963-21cut20:49:347
321527199129,2cyclictest2447960-21kworker/u16:5+events_unbound17:19:276
3215271991210,2cyclictest3701644-21kworker/u16:0+flush-8:019:58:526
321527199120,1cyclictest0-21swapper/618:02:156
3215263991211,1cyclictest0-21swapper/520:04:445
3215263991211,1cyclictest0-21swapper/516:12:415
321526399120,1cyclictest0-21swapper/520:26:495
321526399120,1cyclictest0-21swapper/519:21:525
321526399120,12cyclictest0-21swapper/517:09:455
321526399120,12cyclictest0-21swapper/517:01:155
3215254991211,1cyclictest0-21swapper/418:34:344
321525499120,1cyclictest0-21swapper/419:36:414
321525499120,1cyclictest0-21swapper/419:06:344
321525499120,1cyclictest0-21swapper/418:52:334
321525499120,1cyclictest0-21swapper/417:36:054
321525499120,12cyclictest0-21swapper/418:22:174
321527899116,4cyclictest27763-21gvfs-afc-volume17:04:267
3215278991111,0cyclictest0-21swapper/718:39:447
321527899110,10cyclictest1313-21snmpd17:31:567
321527899110,10cyclictest1313-21snmpd16:59:387
321527199119,2cyclictest3722598-21kworker/u16:2+flush-8:019:51:326
321527199118,2cyclictest3609108-21kworker/u16:4+events_unbound18:44:246
321527199117,3cyclictest3289989-21kworker/u16:1+events_unbound17:04:306
3215271991110,1cyclictest0-21swapper/619:09:016
321527199110,1cyclictest0-21swapper/617:58:056
321527199110,11cyclictest0-21swapper/620:37:566
321527199110,11cyclictest0-21swapper/620:37:566
321527199110,11cyclictest0-21swapper/618:31:206
321526399119,2cyclictest3348623-21kthreadcore16:34:325
3215263991110,1cyclictest0-21swapper/521:02:175
3215263991110,1cyclictest0-21swapper/520:51:055
3215263991110,1cyclictest0-21swapper/520:47:375
3215263991110,1cyclictest0-21swapper/520:15:475
3215263991110,1cyclictest0-21swapper/519:56:145
3215263991110,1cyclictest0-21swapper/519:35:165
3215263991110,1cyclictest0-21swapper/519:16:025
3215263991110,1cyclictest0-21swapper/518:25:165
3215263991110,1cyclictest0-21swapper/518:12:495
3215263991110,1cyclictest0-21swapper/517:44:265
3215263991110,1cyclictest0-21swapper/516:02:265
321526399110,1cyclictest0-21swapper/517:53:355
321526399110,11cyclictest0-21swapper/520:38:575
321526399110,11cyclictest0-21swapper/520:38:575
321526399110,11cyclictest0-21swapper/520:33:455
321526399110,11cyclictest0-21swapper/520:11:315
321526399110,11cyclictest0-21swapper/519:06:065
321526399110,11cyclictest0-21swapper/518:44:495
321526399110,11cyclictest0-21swapper/518:15:205
321526399110,11cyclictest0-21swapper/518:15:205
321526399110,11cyclictest0-21swapper/516:05:075
321526399110,11cyclictest0-21swapper/515:58:205
3215254991110,1cyclictest0-21swapper/420:25:054
3215254991110,1cyclictest0-21swapper/419:41:444
3215254991110,1cyclictest0-21swapper/419:15:434
3215254991110,1cyclictest0-21swapper/419:03:164
3215254991110,1cyclictest0-21swapper/419:03:164
3215254991110,1cyclictest0-21swapper/418:55:514
3215254991110,1cyclictest0-21swapper/418:13:554
3215254991110,1cyclictest0-21swapper/418:05:344
3215254991110,1cyclictest0-21swapper/416:57:474
3215254991110,1cyclictest0-21swapper/415:54:434
321525499110,11cyclictest0-21swapper/420:33:454
321525499110,11cyclictest0-21swapper/419:24:044
321525499110,11cyclictest0-21swapper/418:48:274
321525499110,11cyclictest0-21swapper/417:42:524
321525499110,11cyclictest0-21swapper/416:13:194
321525499110,11cyclictest0-21swapper/415:47:004
321525499110,11cyclictest0-21swapper/415:34:514
321527199109,1cyclictest0-21swapper/618:21:346
321527199108,2cyclictest3158339-21kworker/u16:0+flush-8:015:48:216
321527199101,8cyclictest3350735-21cut16:34:336
321526399109,1cyclictest0-21swapper/519:51:585
321526399109,1cyclictest0-21swapper/519:46:565
321526399109,1cyclictest0-21swapper/519:41:065
321526399109,1cyclictest0-21swapper/519:32:445
321526399109,1cyclictest0-21swapper/517:25:505
321526399107,2cyclictest3464361-21missed_timers17:29:365
321526399106,3cyclictest3405421-21cat17:04:275
321526399100,10cyclictest0-21swapper/518:39:565
321525499109,1cyclictest0-21swapper/420:23:214
321525499109,1cyclictest0-21swapper/419:59:334
321525499109,1cyclictest0-21swapper/419:44:154
321525499109,1cyclictest0-21swapper/419:13:124
321525499109,1cyclictest0-21swapper/418:30:284
321525499109,1cyclictest0-21swapper/416:39:484
321525499109,1cyclictest0-21swapper/416:39:484
321525499109,1cyclictest0-21swapper/416:05:454
321525499109,1cyclictest0-21swapper/415:52:594
32152719998,1cyclictest0-21swapper/619:44:106
32152639998,1cyclictest0-21swapper/520:54:335
32152639998,1cyclictest0-21swapper/518:58:415
32152639998,1cyclictest0-21swapper/518:06:595
32152639996,2cyclictest0-21swapper/517:14:265
32152639995,3cyclictest0-21swapper/516:54:275
32152639994,4cyclictest3307284-21kthreadcore16:14:315
32152549998,1cyclictest0-21swapper/420:45:064
32152549998,1cyclictest0-21swapper/420:16:344
32152549998,1cyclictest0-21swapper/420:12:194
32152549998,1cyclictest0-21swapper/417:05:304
32152549998,1cyclictest0-21swapper/416:19:194
32152549994,4cyclictest3437675-21kthreadcore17:19:304
32152719987,1cyclictest0-21swapper/616:28:516
32152719986,2cyclictest2447960-21kworker/u16:5+flush-8:016:19:366
32152719980,7cyclictest0-21swapper/620:13:316
32152639987,1cyclictest0-21swapper/519:02:005
32152639987,1cyclictest0-21swapper/519:02:005
32152639987,1cyclictest0-21swapper/518:20:235
32152639987,1cyclictest0-21swapper/516:49:245
32152639986,1cyclictest0-21swapper/517:54:315
32152639986,1cyclictest0-21swapper/517:19:275
32152639986,1cyclictest0-21swapper/516:39:295
32152639986,1cyclictest0-21swapper/516:39:295
32152639986,1cyclictest0-21swapper/515:44:335
32152639983,4cyclictest3334394-21cat16:29:285
32152549987,1cyclictest0-21swapper/420:50:184
32152549987,1cyclictest0-21swapper/420:39:544
32152549987,1cyclictest0-21swapper/419:57:494
32152549987,1cyclictest0-21swapper/419:25:484
32152549987,1cyclictest0-21swapper/418:18:584
32152549987,1cyclictest0-21swapper/418:18:584
32152549987,1cyclictest0-21swapper/417:14:434
32152549987,1cyclictest0-21swapper/416:32:054
32152549985,2cyclictest3461663-21kthreadcore17:29:334
32152549984,3cyclictest3507622-21cat17:54:274
32152549983,4cyclictest3449549-21cut17:24:334
3520453270,1sleep50-21swapper/517:59:315
32152719973,3cyclictest3488033-21kthreadcore17:44:306
32152639974,3cyclictest3476617-21cpuspeed17:39:255
32152549976,1cyclictest0-21swapper/418:25:354
32152549973,3cyclictest3322508-21grep16:24:224
32152549972,4cyclictest3343372-21expr16:34:254
32152549972,4cyclictest3272355-21sort15:59:264
32152639965,1cyclictest0-21swapper/520:20:025
32152639964,1cyclictest32153942chrt15:34:115
32152639962,3cyclictest3322510-21awk16:24:225
32152639960,1cyclictest0-21swapper/520:42:505
32152549965,1cyclictest0-21swapper/420:34:424
32152549965,1cyclictest0-21swapper/420:34:424
32152549965,1cyclictest0-21swapper/419:49:184
32152549965,1cyclictest0-21swapper/418:03:034
32152549962,3cyclictest1-21systemd19:34:084
32152789950,4cyclictest3214673-21cron15:34:117
32152719951,1cyclictest991rcuop/715:34:116
32152639950,4cyclictest3579217-21taskset18:29:185
32152639950,1cyclictest0-21swapper/518:49:265
32152639950,1cyclictest0-21swapper/518:34:125
32152549950,4cyclictest3887257-21taskset20:59:174
32152549950,4cyclictest3774369-21taskset20:04:204
32152549950,4cyclictest3599773-21taskset18:39:194
3214659220,1sleep40-21swapper/415:34:114
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional