You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 01:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu May 28, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
370429725141,7sleep40-21swapper/419:03:524
3704815994947,2cyclictest3910299-21kworker/u16:1+events_unbound23:22:296
370433624913,31sleep70-21swapper/719:04:277
3704813994846,2cyclictest83376-21kworker/u16:2+events_unbound00:12:355
628089430,36rtkit-daemon0-21swapper/519:02:455
3704823994338,4cyclictest3962978-21latency_hist21:17:087
3704823994338,4cyclictest3962978-21latency_hist21:17:087
3704813994239,2cyclictest83376-21kworker/u16:2+events_unbound23:37:095
3704813994238,4cyclictest3622499-21kworker/u16:2+flush-8:020:07:085
3704813994138,2cyclictest3910299-21kworker/u16:1+flush-8:022:57:085
3704813994038,2cyclictest4168097-21kworker/u16:2+events_unbound23:13:265
3704813993937,2cyclictest59025-21kworker/u16:0+events_unbound23:30:225
3704813993937,2cyclictest4096008-21kworker/u16:3+events_unbound22:58:105
3704813993937,2cyclictest4096008-21kworker/u16:3+events_unbound22:40:505
3704813993937,2cyclictest4096008-21kworker/u16:3+events_unbound00:33:415
3704813993937,2cyclictest3972685-21kworker/u16:3+events_unbound21:25:145
3704813993836,2cyclictest4096008-21kworker/u16:3+events_unbound23:24:255
3704813993836,2cyclictest3996858-21kworker/u16:0+events_unbound21:31:195
3704813993735,2cyclictest4096008-21kworker/u16:3+flush-8:023:47:315
3704813993735,2cyclictest3910299-21kworker/u16:1+events_unbound23:33:055
3704813993635,1cyclictest3910299-21kworker/u16:1+flush-8:023:57:455
3704813993634,2cyclictest4168097-21kworker/u16:2+events_unbound22:49:145
3704813993634,2cyclictest4096008-21kworker/u16:3+flush-8:000:02:455
3704813993634,2cyclictest3996858-21kworker/u16:0+flush-8:021:52:505
3704813993634,2cyclictest3996858-21kworker/u16:0+flush-8:021:52:505
3704813993634,2cyclictest3996858-21kworker/u16:0+events_unbound21:43:505
3704813993634,2cyclictest3910299-21kworker/u16:1+events_unbound22:36:305
3704813993634,2cyclictest3727756-21kworker/u16:3+flush-8:019:32:085
3704813993533,2cyclictest4096008-21kworker/u16:3+events_unbound23:54:055
3704813993533,2cyclictest4096008-21kworker/u16:3+events_unbound23:43:305
3704813993533,2cyclictest4096008-21kworker/u16:3+events_unbound23:20:305
3704813993533,2cyclictest4096008-21kworker/u16:3+events_unbound00:18:135
3704813993533,2cyclictest3996858-21kworker/u16:0+events_unbound22:22:495
3704813993533,2cyclictest3996858-21kworker/u16:0+events_unbound21:41:495
3704813993533,2cyclictest3949484-21kworker/u16:2+events_unbound22:04:505
3704813993533,2cyclictest3910299-21kworker/u16:1+events_unbound22:09:105
3704813993533,2cyclictest3910299-21kworker/u16:1+events_unbound21:35:185
3704813993533,2cyclictest3910299-21kworker/u16:1+events_unbound00:11:335
3704813993533,2cyclictest226118-21kworker/u16:1+events_unbound00:30:105
3704813993432,2cyclictest4168097-21kworker/u16:2+flush-8:023:07:415
3704813993432,2cyclictest4096008-21kworker/u16:3+flush-8:023:03:295
3704813993432,2cyclictest3949484-21kworker/u16:2+events_unbound21:59:145
3704815993331,2cyclictest3622499-21kworker/u16:2+flush-8:019:22:096
3704813993331,2cyclictest4096008-21kworker/u16:3+flush-8:022:18:065
3704813993331,2cyclictest4096008-21kworker/u16:3+events_unbound22:27:175
3704813993331,2cyclictest3949484-21kworker/u16:2+events_unbound21:49:145
3704813993331,2cyclictest3891321-21kworker/u16:0+flush-8:021:19:545
3704813993331,2cyclictest3823677-21kworker/u16:4+events_unbound21:08:065
38717862320,1chrt3871788-21turbostat.cron20:32:087
3704813993230,2cyclictest4168097-21kworker/u16:2+events_unbound22:43:265
3704813993230,2cyclictest3727756-21kworker/u16:3+events_unbound19:42:365
3704813993230,2cyclictest226118-21kworker/u16:1+events_unbound00:23:105
3704823993130,0cyclictest0-21swapper/700:22:337
3704813993129,2cyclictest3833656-21kworker/u16:1+flush-8:020:12:365
3704813993129,2cyclictest3622499-21kworker/u16:2+events_unbound19:52:385
3704809993129,2cyclictest4096008-21kworker/u16:3+flush-8:023:17:334
3704813993028,2cyclictest3949484-21kworker/u16:2+events_unbound22:14:545
3704813993028,2cyclictest3891321-21kworker/u16:0+events_unbound21:15:105
3704813993028,2cyclictest3891321-21kworker/u16:0+events_unbound21:15:105
3704823992928,0cyclictest0-21swapper/721:42:227
3704823992928,0cyclictest0-21swapper/719:22:347
3704823992928,0cyclictest0-21swapper/719:17:317
3704815992927,2cyclictest226118-21kworker/u16:1+flush-8:000:27:036
3704815992926,2cyclictest3996858-21kworker/u16:0+flush-8:022:27:096
3704813992927,2cyclictest3727756-21kworker/u16:3+events_unbound20:17:115
3704823992826,1cyclictest0-21swapper/721:02:297
3704823992823,4cyclictest635-21systemd-journal22:57:037
3704815992826,2cyclictest3996858-21kworker/u16:0+flush-8:021:52:266
3704815992826,2cyclictest3996858-21kworker/u16:0+flush-8:021:52:266
3704813992826,2cyclictest3704590-21kworker/u16:1+events_unbound19:38:185
3704815992724,2cyclictest4096008-21kworker/u16:3+events_unbound22:47:256
3704813992726,1cyclictest3823677-21kworker/u16:4+events_unbound20:57:075
40441482260,1chrt4044149-21needreboot21:47:327
3704823992625,0cyclictest0-21swapper/723:02:317
3704813992624,2cyclictest3823677-21kworker/u16:4+events_unbound20:26:175
3704809992624,2cyclictest3823677-21kworker/u16:4+events_unbound21:07:234
370440122616,7sleep60-21swapper/619:05:226
3704823992524,0cyclictest0-21swapper/722:07:337
3704813992523,2cyclictest3785355-21kworker/u16:0+events_unbound19:57:105
3704815992422,2cyclictest3910299-21kworker/u16:1+events_unbound21:47:376
3704809992422,2cyclictest4096008-21kworker/u16:3+events_unbound00:32:234
3704809992422,2cyclictest3910299-21kworker/u16:1+flush-8:022:37:234
3704809992422,2cyclictest3910299-21kworker/u16:1+events_unbound23:52:234
3704823992322,0cyclictest0-21swapper/723:57:227
3704815992321,2cyclictest83376-21kworker/u16:2+events_unbound00:27:206
3704815992321,2cyclictest4096008-21kworker/u16:3+flush-8:022:42:336
3704815992321,2cyclictest3785355-21kworker/u16:0+flush-8:020:07:346
3704815992317,6cyclictest3910299-21kworker/u16:1+flush-8:023:32:306
3704823992221,0cyclictest0-21swapper/721:56:167
3704823992221,0cyclictest0-21swapper/721:56:167
3704823992221,0cyclictest0-21swapper/719:32:227
3704823992220,1cyclictest0-21swapper/722:27:257
3704823992220,1cyclictest0-21swapper/719:12:297
3704815992220,2cyclictest3996858-21kworker/u16:0+flush-8:021:32:376
3704815992220,2cyclictest3650944-21kworker/u16:0+events_unbound19:12:226
3704815992219,2cyclictest3891321-21kworker/u16:0+flush-8:021:12:096
3704815992219,2cyclictest3891321-21kworker/u16:0+flush-8:021:12:096
3704813992220,2cyclictest3891321-21kworker/u16:0+flush-8:020:58:025
3704813992220,2cyclictest3843065-21kworker/u16:2+events_unbound20:45:185
3704813992220,2cyclictest3785355-21kworker/u16:0+events_unbound20:07:335
3704813992220,2cyclictest3727756-21kworker/u16:3+flush-8:019:21:175
1409302220,1chrt0-21swapper/423:47:344
3704823992120,0cyclictest0-21swapper/720:07:237
3704823992117,3cyclictest124-21kswapd022:47:217
3704815992119,2cyclictest3891321-21kworker/u16:0+flush-8:020:57:306
3704815992119,2cyclictest3843065-21kworker/u16:2+flush-8:020:32:236
3704815992119,2cyclictest3843065-21kworker/u16:2+flush-8:020:32:236
3704815992119,2cyclictest3843065-21kworker/u16:2+flush-8:020:22:196
3704813992119,2cyclictest3650944-21kworker/u16:0+events_unbound19:13:195
3704809992119,2cyclictest4168097-21kworker/u16:2+events_unbound22:42:224
3704809992119,2cyclictest3650944-21kworker/u16:0+flush-8:019:12:234
370482399200,18cyclictest124-21kswapd022:57:217
3704815992018,2cyclictest3910299-21kworker/u16:1+flush-8:023:07:346
3704823991918,0cyclictest0-21swapper/719:52:217
3704823991913,5cyclictest3814004-21latency_hist20:02:087
3704813991917,2cyclictest3843065-21kworker/u16:2+events_unbound20:30:195
3704823991817,0cyclictest0-21swapper/721:18:017
3704823991817,0cyclictest0-21swapper/720:57:377
3704823991817,0cyclictest0-21swapper/720:42:357
3704823991817,0cyclictest0-21swapper/719:48:017
3704823991816,1cyclictest0-21swapper/722:37:257
3704823991815,2cyclictest124-21kswapd022:12:217
3704815991814,3cyclictest3910299-21kworker/u16:1+flush-8:022:17:316
3704823991716,0cyclictest0-21swapper/719:37:337
3704823991716,0cyclictest0-21swapper/700:27:317
3704823991715,1cyclictest0-21swapper/723:17:287
370482399170,1cyclictest0-21swapper/721:07:317
370482399170,1cyclictest0-21swapper/719:07:337
370482399170,15cyclictest1234-21snmpd22:23:157
370482399170,15cyclictest0-21swapper/723:22:327
3704815991715,2cyclictest3704590-21kworker/u16:1+events_unbound19:22:306
3704809991714,3cyclictest3949484-21kworker/u16:2+flush-8:021:22:344
3704823991615,0cyclictest0-21swapper/720:12:457
3704823991614,1cyclictest3938893-21diskmemload00:19:057
3704815991614,2cyclictest4096008-21kworker/u16:3+flush-8:000:02:456
3704815991613,2cyclictest3910299-21kworker/u16:1+events_unbound21:02:286
3704813991614,2cyclictest3910299-21kworker/u16:1+flush-8:021:02:245
3704809991612,3cyclictest3910299-21kworker/u16:1+flush-8:021:12:334
3704809991612,3cyclictest3910299-21kworker/u16:1+flush-8:021:12:334
3704823991514,0cyclictest0-21swapper/723:27:327
3704823991514,0cyclictest0-21swapper/720:26:097
3704823991513,1cyclictest4008759-21ssh21:32:427
3704823991513,1cyclictest0-21swapper/721:27:357
3704823991513,1cyclictest0-21swapper/721:25:297
3704815991513,2cyclictest4168097-21kworker/u16:2+flush-8:023:12:356
3704815991513,2cyclictest3823677-21kworker/u16:4+flush-8:020:47:306
3704813991513,2cyclictest3704590-21kworker/u16:1+events_unbound19:22:425
3704809991514,1cyclictest0-21swapper/422:29:314
370482399147,6cyclictest6032-21gmain20:02:337
370482399146,7cyclictest6101-21gmain20:47:337
3704823991413,0cyclictest0-21swapper/700:02:377
3704823991412,1cyclictest0-21swapper/722:43:057
3704823991411,2cyclictest191450-21ssh00:10:467
3704823991411,2cyclictest114660-21ssh23:37:287
370482399140,13cyclictest47103-21turbostat23:12:077
3704815991413,1cyclictest0-21swapper/623:17:496
3704815991413,1cyclictest0-21swapper/623:03:476
3704815991413,1cyclictest0-21swapper/621:57:536
3704815991413,1cyclictest0-21swapper/621:38:576
3704815991412,2cyclictest4096008-21kworker/u16:3+events_unbound23:27:306
3704815991412,2cyclictest3949484-21kworker/u16:2+flush-8:022:07:206
370481599140,14cyclictest0-21swapper/600:16:186
370480999149,4cyclictest3738385-21cat19:22:224
3704809991413,1cyclictest0-21swapper/422:04:084
3704809991412,2cyclictest3996858-21kworker/u16:0+events_unbound21:32:384
370480999140,1cyclictest0-21swapper/423:16:494
370480999140,1cyclictest0-21swapper/421:57:504
370480999140,1cyclictest0-21swapper/421:02:294
370480999140,14cyclictest0-21swapper/423:40:094
370480999140,14cyclictest0-21swapper/421:38:554
370480999140,14cyclictest0-21swapper/421:22:024
370482399139,3cyclictest1234-21snmpd22:34:587
3704823991313,0cyclictest0-21swapper/719:27:597
3704823991311,1cyclictest4070128-21ssh21:59:387
3704823991311,1cyclictest0-21swapper/700:34:507
3704823991310,2cyclictest0-21swapper/719:42:377
3704815991312,1cyclictest0-21swapper/623:41:376
3704815991312,1cyclictest0-21swapper/622:36:216
3704815991312,1cyclictest0-21swapper/622:29:536
3704815991311,2cyclictest4096008-21kworker/u16:3+flush-8:000:17:336
3704815991311,2cyclictest3891321-21kworker/u16:0+events_unbound20:52:226
3704815991311,2cyclictest3843065-21kworker/u16:2+events_unbound20:27:216
3704815991311,2cyclictest3727756-21kworker/u16:3+events_unbound20:17:236
3704815991310,3cyclictest3622499-21kworker/u16:2+flush-8:020:07:046
3704813991311,2cyclictest3823677-21kworker/u16:4+events_unbound20:40:075
370480999134,9cyclictest0-21swapper/422:17:214
3704809991312,1cyclictest0-21swapper/423:02:564
3704809991312,1cyclictest0-21swapper/422:23:034
3704809991312,1cyclictest0-21swapper/421:27:244
3704809991312,1cyclictest0-21swapper/400:03:194
3704809991311,2cyclictest3843065-21kworker/u16:2+events_unbound20:27:234
3704809991311,2cyclictest226118-21kworker/u16:1+events_unbound00:27:364
370480999130,13cyclictest0-21swapper/423:24:234
370480999130,13cyclictest0-21swapper/423:07:304
370480999130,13cyclictest0-21swapper/422:16:454
370480999130,13cyclictest0-21swapper/421:51:314
370482399129,2cyclictest1234-21snmpd23:55:267
370482399129,2cyclictest1234-21snmpd20:18:037
370482399128,3cyclictest1234-21snmpd23:48:507
370482399128,3cyclictest1234-21snmpd22:17:097
370482399126,5cyclictest5975-21gmain20:54:057
3704823991212,0cyclictest0-21swapper/723:33:147
3704823991211,1cyclictest0-21swapper/723:15:337
3704823991211,0cyclictest0-21swapper/722:02:277
3704823991211,0cyclictest0-21swapper/721:37:187
3704823991211,0cyclictest0-21swapper/720:32:227
3704823991211,0cyclictest0-21swapper/720:32:227
3704815991211,1cyclictest0-21swapper/623:57:236
3704815991211,1cyclictest0-21swapper/621:45:066
3704815991211,1cyclictest0-21swapper/619:28:346
3704815991211,1cyclictest0-21swapper/619:11:236
3704815991210,2cyclictest83376-21kworker/u16:2+events_unbound00:32:356
3704815991210,2cyclictest3704590-21kworker/u16:1+flush-8:019:42:326
370481599120,12cyclictest0-21swapper/620:14:086
370481599120,0cyclictest0-21swapper/621:27:086
3704813991210,1cyclictest3727756-21kworker/u16:3+flush-8:019:37:085
370481399120,12cyclictest0-21swapper/520:50:185
3704809991211,1cyclictest0-21swapper/421:44:544
3704809991211,1cyclictest0-21swapper/420:13:274
3704809991211,1cyclictest0-21swapper/400:24:464
3704809991211,1cyclictest0-21swapper/400:12:474
3704809991210,2cyclictest202522-21kworker/u16:0+events_unbound00:17:364
370480999120,12cyclictest0-21swapper/419:42:524
370482399115,5cyclictest6382-21gvfs-afc-volume00:15:447
3704823991110,1cyclictest3938893-21diskmemload23:44:067
370481599119,2cyclictest3727756-21kworker/u16:3+events_unbound19:37:236
370481599117,3cyclictest3793600-21chrt19:47:286
370481599117,3cyclictest3757604-21cat19:32:246
370481599116,4cyclictest128658-21ntpq23:42:316
370481599114,6cyclictest0-21swapper/622:12:286
3704815991110,1cyclictest0-21swapper/623:49:206
3704815991110,1cyclictest0-21swapper/620:45:496
370481599110,3cyclictest4164471-21grep22:37:296
370481599110,3cyclictest3806337-21cut19:57:256
370481399119,2cyclictest3785355-21kworker/u16:0+events_unbound19:49:545
370481399119,2cyclictest3622499-21kworker/u16:2+events_unbound19:11:305
3704813991110,1cyclictest0-21swapper/520:33:355
3704813991110,1cyclictest0-21swapper/520:33:355
370480999118,2cyclictest3804878-21cpuspeed_turbos19:57:204
3704809991110,1cyclictest0-21swapper/423:32:064
3704809991110,1cyclictest0-21swapper/422:56:104
3704809991110,1cyclictest0-21swapper/420:04:384
3704809991110,1cyclictest0-21swapper/419:54:134
370480999110,5cyclictest0-21swapper/420:47:234
370480999110,11cyclictest0-21swapper/420:53:594
370482399109,0cyclictest0-21swapper/720:37:287
370481599109,1cyclictest0-21swapper/621:21:276
370481599109,1cyclictest0-21swapper/620:37:476
370481599109,1cyclictest0-21swapper/619:56:196
370481599108,2cyclictest3910299-21kworker/u16:1+flush-8:023:52:246
370481599108,2cyclictest3910299-21kworker/u16:1+flush-8:021:07:376
370481599101,8cyclictest4072380-21ls22:02:216
370481599100,4cyclictest182357-21kthreadcore00:07:256
370480999109,1cyclictest0-21swapper/422:49:044
370480999109,1cyclictest0-21swapper/422:35:404
370480999109,1cyclictest0-21swapper/422:10:174
370480999109,1cyclictest0-21swapper/420:45:474
370480999109,1cyclictest0-21swapper/420:37:444
370480999108,2cyclictest3910299-21kworker/u16:1+flush-8:000:07:334
370480999108,1cyclictest0-21swapper/420:17:244
370480999106,3cyclictest3920872-21cat20:57:234
370480999106,3cyclictest3705807-21cat19:07:234
37048159998,1cyclictest0-21swapper/622:57:006
37048159996,2cyclictest19905-21ntp_states22:57:326
37048159995,3cyclictest3988357-21cat21:27:226
37048099997,2cyclictest3704590-21kworker/u16:1+flush-8:019:32:234
37048099990,8cyclictest3785570-21/usr/sbin/munin19:47:194
37048099984,3cyclictest3856545-21kthreadcore20:22:244
37048099983,4cyclictest4050329-21tr21:52:254
37048099983,4cyclictest4050329-21tr21:52:254
37048099983,4cyclictest3728127-21grep19:17:204
37048099983,4cyclictest122129-21cut23:42:254
37048099983,4cyclictest11566-21grep22:57:194
37048099980,7cyclictest3748817-21kthreadcore19:27:264
37048099975,2cyclictest4096008-21kworker/u16:3+flush-8:023:57:124
37048099975,1cyclictest0-21swapper/423:32:224
37048099973,3cyclictest3767002-21grep19:37:224
37048099972,4cyclictest3874530-21tr20:32:254
37048099972,4cyclictest3874530-21tr20:32:254
37048099960,5cyclictest3824718-21grep20:07:224
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional