You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 06:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 31, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
371490627664,8sleep40-21swapper/419:08:224
371469925342,8sleep50-21swapper/519:05:265
371479424636,7sleep60-21swapper/619:06:486
37148712417,30sleep70-21swapper/719:07:537
3715211993732,4cyclictest3951573-21latency_hist21:08:467
3715211993732,4cyclictest3951573-21latency_hist21:08:467
3715211993328,4cyclictest4145638-21latency_hist22:48:457
3715211993328,4cyclictest4145638-21latency_hist22:48:457
3715201993026,3cyclictest3025724-21kworker/u16:0+flush-8:019:44:114
3715201992925,3cyclictest4087059-21kworker/u16:4+flush-8:022:19:034
3715211992520,4cyclictest650-21systemd-journal19:58:417
39804062240,1chrt3980407-21unixbench_singl21:19:167
3715206992421,2cyclictest3696005-21kworker/u16:3+flush-8:019:49:006
3715206992421,2cyclictest3025724-21kworker/u16:0+events_unbound20:33:596
3715201992422,2cyclictest3893567-21kworker/u16:1+flush-8:020:44:224
3715201992321,2cyclictest3025724-21kworker/u16:0+flush-8:020:04:014
3715201992220,2cyclictest48073-21kworker/u16:4+flush-8:023:54:114
3715206992119,2cyclictest3757867-21kworker/u16:1+events_unbound20:14:046
3715211992014,5cyclictest3922452-21latency_hist20:53:467
371520699202,2cyclictest146359-21kworker/u16:3+flush-8:000:38:406
3715206992018,2cyclictest4117012-21kworker/u16:0+flush-8:023:44:166
371520199200,3cyclictest3734866-21grep19:14:054
3715211991913,5cyclictest650-21systemd-journal00:18:457
371521199190,17cyclictest3940147-21tr20:59:087
3715201991917,2cyclictest3985264-21kworker/u16:0+flush-8:021:29:354
3715211991810,7cyclictest3893367-21latency_hist20:38:467
3715206991815,2cyclictest3737627-21kworker/u16:2+events_unbound19:23:596
3715204991815,2cyclictest4117012-21kworker/u16:0+flush-8:023:04:115
371520199180,1cyclictest0-21swapper/423:34:104
371521199173,13cyclictest6045-21gmain23:19:107
3715211991713,3cyclictest3991638-21cat21:29:037
3715211991712,4cyclictest4088661-21cat22:19:017
3715211991710,6cyclictest1267-21snmpd20:47:367
3715206991715,2cyclictest3946392-21kworker/u16:4+flush-8:021:19:086
371520199170,1cyclictest3835222-21kworker/4:120:19:374
371520199170,1cyclictest0-21swapper/423:59:464
371520199170,1cyclictest0-21swapper/423:49:314
371520199170,1cyclictest0-21swapper/423:44:244
371520199170,1cyclictest0-21swapper/423:39:174
371520199170,1cyclictest0-21swapper/423:29:034
371520199170,1cyclictest0-21swapper/423:23:554
371520199170,1cyclictest0-21swapper/423:18:484
371520199170,1cyclictest0-21swapper/423:14:424
371520199170,1cyclictest0-21swapper/423:09:354
371520199170,1cyclictest0-21swapper/423:04:284
371520199170,1cyclictest0-21swapper/422:59:214
371520199170,1cyclictest0-21swapper/422:54:144
371520199170,1cyclictest0-21swapper/422:49:074
371520199170,1cyclictest0-21swapper/422:43:594
371520199170,1cyclictest0-21swapper/422:43:594
371520199170,1cyclictest0-21swapper/422:38:524
371520199170,1cyclictest0-21swapper/422:34:464
371520199170,1cyclictest0-21swapper/422:29:394
371520199170,1cyclictest0-21swapper/422:24:324
371520199170,1cyclictest0-21swapper/422:14:184
371520199170,1cyclictest0-21swapper/422:09:104
371520199170,1cyclictest0-21swapper/422:04:034
371520199170,1cyclictest0-21swapper/421:58:564
371520199170,1cyclictest0-21swapper/421:58:564
371520199170,1cyclictest0-21swapper/421:53:494
371520199170,1cyclictest0-21swapper/421:49:434
371520199170,1cyclictest0-21swapper/421:44:364
371520199170,1cyclictest0-21swapper/421:39:294
371520199170,1cyclictest0-21swapper/421:34:224
371520199170,1cyclictest0-21swapper/421:24:074
371520199170,1cyclictest0-21swapper/421:19:004
371520199170,1cyclictest0-21swapper/421:13:534
371520199170,1cyclictest0-21swapper/421:09:474
371520199170,1cyclictest0-21swapper/421:09:474
371520199170,1cyclictest0-21swapper/421:04:404
371520199170,1cyclictest0-21swapper/421:04:404
371520199170,1cyclictest0-21swapper/420:59:334
371520199170,1cyclictest0-21swapper/420:54:264
371520199170,1cyclictest0-21swapper/420:49:184
371520199170,1cyclictest0-21swapper/420:39:044
371520199170,1cyclictest0-21swapper/420:33:574
371520199170,1cyclictest0-21swapper/420:28:504
371520199170,1cyclictest0-21swapper/420:24:444
371520199170,1cyclictest0-21swapper/420:24:444
371520199170,1cyclictest0-21swapper/420:14:304
371520199170,1cyclictest0-21swapper/420:09:224
371520199170,1cyclictest0-21swapper/419:59:084
371520199170,1cyclictest0-21swapper/419:54:014
371520199170,1cyclictest0-21swapper/419:48:544
371520199170,1cyclictest0-21swapper/419:39:414
371520199170,1cyclictest0-21swapper/419:34:334
371520199170,1cyclictest0-21swapper/419:29:264
371520199170,1cyclictest0-21swapper/419:24:194
371520199170,1cyclictest0-21swapper/419:19:124
371520199170,1cyclictest0-21swapper/419:08:584
371520199170,1cyclictest0-21swapper/400:34:354
371520199170,1cyclictest0-21swapper/400:29:274
371520199170,1cyclictest0-21swapper/400:24:204
371520199170,1cyclictest0-21swapper/400:19:134
371520199170,1cyclictest0-21swapper/400:19:134
371520199170,1cyclictest0-21swapper/400:14:064
371520199170,1cyclictest0-21swapper/400:08:594
371520199170,1cyclictest0-21swapper/400:03:514
40980612160,0sleep74098062-21expr22:23:587
371521199166,3cyclictest5944-21gmain21:39:117
371521199160,14cyclictest4079016-21cat22:14:027
371521199160,14cyclictest0-21swapper/719:59:127
371521199160,10cyclictest4170516-21kthreadcore22:59:077
371520699167,8cyclictest0-21swapper/600:29:466
3715206991614,2cyclictest3696005-21kworker/u16:3+flush-8:019:34:036
3715206991613,2cyclictest3893567-21kworker/u16:1+flush-8:020:48:466
371521199159,5cyclictest4116627-21latency_hist22:33:457
371521199159,5cyclictest1267-21snmpd21:44:257
371521199159,5cyclictest1267-21snmpd19:18:017
3715211991513,1cyclictest0-21swapper/723:09:047
3715206991512,2cyclictest3025724-21kworker/u16:0+flush-8:020:39:046
371521199149,4cyclictest88977-21cat23:59:037
371521199149,4cyclictest1267-21snmpd23:07:397
371521199148,5cyclictest4030847-21grep21:49:037
371521199148,5cyclictest3922845-21/usr/sbin/munin20:54:117
371521199148,5cyclictest3835638-21/usr/sbin/munin20:09:107
371521199148,5cyclictest154778-21ntp_states00:29:167
371521199148,5cyclictest1267-21snmpd00:10:027
371521199148,4cyclictest138329-21grep00:24:047
371521199147,6cyclictest1267-21snmpd19:22:137
371521199146,2cyclictest3903059-21idleruntime-cro20:43:467
3715211991411,2cyclictest4057518-21ntpq21:59:137
3715211991411,2cyclictest4057518-21ntpq21:59:137
3715204991412,2cyclictest68808-21kworker/u16:2+events_unbound23:50:585
3715204991412,2cyclictest3025724-21kworker/u16:0+flush-8:020:34:015
371521199139,3cyclictest38439-21ntp_states23:29:117
371521199138,4cyclictest4002657-21grep21:34:047
371521199138,4cyclictest126991-21/usr/sbin/munin00:19:027
371521199138,4cyclictest126991-21/usr/sbin/munin00:19:027
371521199138,4cyclictest0-21swapper/723:49:117
371521199136,2cyclictest6053-21gmain23:25:107
371521199131,4cyclictest157314-21kthreadcore00:34:047
3715211991310,2cyclictest4154379-21ntpq22:49:127
3715211991310,2cyclictest4135053-21ntpq22:39:157
371521199130,2cyclictest3981992-21iostat_ios21:24:037
371521199130,12cyclictest0-21swapper/719:39:147
371521199130,11cyclictest3955764-21kthreadcore21:09:067
371521199130,11cyclictest3955764-21kthreadcore21:09:067
3715206991312,1cyclictest0-21swapper/621:28:186
3715206991311,2cyclictest3696005-21kworker/u16:3+flush-8:019:44:126
3715206991310,2cyclictest116728-21kworker/u16:2+flush-8:000:13:456
3715204991312,1cyclictest0-21swapper/500:29:195
371520499130,6cyclictest0-21swapper/519:59:025
371520499130,13cyclictest0-21swapper/520:49:045
371520499130,13cyclictest0-21swapper/520:24:005
371520499130,13cyclictest0-21swapper/520:24:005
371520499130,13cyclictest0-21swapper/519:28:595
371520499130,0cyclictest0-21swapper/519:44:175
40584502120,0sleep50-21swapper/522:03:455
40584502120,0sleep50-21swapper/522:03:455
371521199129,2cyclictest1267-21snmpd19:51:567
371521199129,2cyclictest0-21swapper/723:13:597
371521199128,3cyclictest1267-21snmpd22:36:517
371521199128,3cyclictest1267-21snmpd21:15:197
371521199127,4cyclictest4059636-21cat22:04:037
371521199126,5cyclictest1267-21snmpd23:34:377
371521199125,6cyclictest0-21swapper/722:56:187
371521199124,7cyclictest3776818-21sshd-session19:35:187
371521199121,2cyclictest0-21swapper/720:18:597
371521199120,4cyclictest4042809-21kthreadcore21:54:067
371521199120,1cyclictest0-21swapper/720:29:007
371521199120,10cyclictest78502-21/usr/sbin/munin23:54:027
371521199120,10cyclictest4069350-21cat22:09:047
3715206991211,1cyclictest0-21swapper/621:14:446
3715206991211,1cyclictest0-21swapper/620:59:086
3715206991211,1cyclictest0-21swapper/619:22:586
371520699120,1cyclictest0-21swapper/622:15:356
371520699120,1cyclictest0-21swapper/619:15:526
371520699120,12cyclictest0-21swapper/621:52:256
371520699120,12cyclictest0-21swapper/620:11:036
371520699120,11cyclictest0-21swapper/600:15:536
371520499129,2cyclictest4117012-21kworker/u16:0+flush-8:023:23:565
3715204991211,1cyclictest0-21swapper/522:34:145
371521199118,2cyclictest0-21swapper/700:04:017
371521199117,3cyclictest1267-21snmpd19:08:497
371521199116,4cyclictest49559-21cpuspeed_turbos23:38:587
371521199114,6cyclictest0-21swapper/719:29:107
371521199113,4cyclictest6184-21gvfs-afc-volume19:27:197
371521199112,5cyclictest6045-21gmain19:44:027
371521199110,9cyclictest3845373-21/usr/sbin/munin20:14:097
371521199110,2cyclictest0-21swapper/720:24:097
371521199110,2cyclictest0-21swapper/720:24:097
371521199110,10cyclictest64280-21tr23:44:077
371520699119,2cyclictest48073-21kworker/u16:4+flush-8:023:59:216
371520699119,2cyclictest3855050-21kworker/u16:3+events_unbound20:29:036
3715206991110,1cyclictest0-21swapper/623:50:026
3715206991110,1cyclictest0-21swapper/620:26:206
3715206991110,1cyclictest0-21swapper/620:26:206
3715206991110,1cyclictest0-21swapper/620:07:546
371520699110,1cyclictest0-21swapper/621:57:286
371520699110,11cyclictest0-21swapper/623:35:316
371520699110,11cyclictest0-21swapper/622:05:026
371520699110,11cyclictest0-21swapper/620:20:306
371520699110,11cyclictest0-21swapper/619:58:176
371520699110,11cyclictest0-21swapper/619:30:036
371520499119,2cyclictest20186-21kworker/u16:1+flush-8:023:28:565
371520499117,3cyclictest4077881-21sd-mkdcreds22:13:465
3715204991110,1cyclictest0-21swapper/523:44:425
3715204991110,1cyclictest0-21swapper/523:13:105
3715204991110,1cyclictest0-21swapper/522:52:405
3715204991110,1cyclictest0-21swapper/521:35:545
3715204991110,1cyclictest0-21swapper/520:39:185
3715204991110,1cyclictest0-21swapper/519:54:315
371520499110,1cyclictest0-21swapper/519:11:015
371520499110,11cyclictest0-21swapper/523:39:495
371520499110,11cyclictest0-21swapper/523:20:255
371520499110,11cyclictest0-21swapper/522:26:405
371520499110,11cyclictest0-21swapper/519:18:065
371520499110,11cyclictest0-21swapper/500:00:095
371520699109,1cyclictest0-21swapper/622:59:166
371520699109,1cyclictest0-21swapper/622:51:326
371520699109,1cyclictest0-21swapper/622:23:386
371520699109,1cyclictest0-21swapper/621:39:016
371520699109,1cyclictest0-21swapper/621:36:206
371520699109,1cyclictest0-21swapper/621:06:516
371520699109,1cyclictest0-21swapper/621:06:516
371520699109,1cyclictest0-21swapper/619:08:566
371520699109,1cyclictest0-21swapper/600:26:176
371520699108,2cyclictest4117012-21kworker/u16:0+flush-8:023:28:406
371520699107,2cyclictest4139926-21kworker/u16:1+flush-8:023:03:516
371520499109,1cyclictest0-21swapper/522:42:075
371520499109,1cyclictest0-21swapper/521:57:305
371520499109,1cyclictest0-21swapper/521:27:325
371520499109,1cyclictest0-21swapper/521:10:595
371520499109,1cyclictest0-21swapper/521:10:595
371520499109,1cyclictest0-21swapper/521:00:255
371520499109,1cyclictest0-21swapper/520:57:545
371520499109,1cyclictest0-21swapper/520:30:005
37152119995,3cyclictest1267-21snmpd20:04:177
37152069998,1cyclictest0-21swapper/623:40:156
37152069998,1cyclictest0-21swapper/623:18:496
37152069998,1cyclictest0-21swapper/622:46:206
37152069998,1cyclictest0-21swapper/622:46:206
37152069998,1cyclictest0-21swapper/622:10:146
37152069998,1cyclictest0-21swapper/622:02:306
37152069998,1cyclictest0-21swapper/622:02:306
37152069998,1cyclictest0-21swapper/621:44:326
37152069998,1cyclictest0-21swapper/621:09:236
37152069998,1cyclictest0-21swapper/621:09:236
37152069998,1cyclictest0-21swapper/620:50:566
37152069998,1cyclictest0-21swapper/619:41:056
37152069998,1cyclictest0-21swapper/600:05:296
37152069997,2cyclictest4047893-21kworker/u16:6+flush-8:022:29:046
37152049998,1cyclictest0-21swapper/523:18:035
37152049998,1cyclictest0-21swapper/521:47:155
37152049998,1cyclictest0-21swapper/520:21:015
37152049998,1cyclictest0-21swapper/520:04:465
37152049998,1cyclictest0-21swapper/500:37:215
37152049998,1cyclictest0-21swapper/500:13:235
37152049994,4cyclictest3778242-21cat19:39:045
37152049994,4cyclictest3739460-21cat19:19:035
37152069987,1cyclictest0-21swapper/623:30:386
37152069987,1cyclictest0-21swapper/623:09:026
37152069987,1cyclictest0-21swapper/622:54:046
37152069987,1cyclictest0-21swapper/622:36:056
37152069987,1cyclictest0-21swapper/621:33:396
37152069987,1cyclictest0-21swapper/620:54:056
37152069983,4cyclictest3824520-21sed19:59:086
37152049987,1cyclictest0-21swapper/522:31:425
37152049987,1cyclictest0-21swapper/522:15:565
37152049987,1cyclictest0-21swapper/521:05:385
37152049987,1cyclictest0-21swapper/521:05:385
37152049987,1cyclictest0-21swapper/520:45:465
37152049987,1cyclictest0-21swapper/519:51:035
37152049987,1cyclictest0-21swapper/519:25:125
37152049987,1cyclictest0-21swapper/500:23:575
37152049987,1cyclictest0-21swapper/500:05:215
37152049984,3cyclictest3853219-21cut20:14:085
37152049983,4cyclictest3772854-21tr19:34:055
37152069976,1cyclictest0-21swapper/622:26:006
37152049976,1cyclictest0-21swapper/522:44:385
37152049976,1cyclictest0-21swapper/522:44:385
37152049976,1cyclictest0-21swapper/522:05:135
37152049972,4cyclictest6244-21gdbus23:58:455
37152069965,1cyclictest0-21swapper/623:16:276
37152049965,1cyclictest0-21swapper/522:55:125
37152049965,1cyclictest0-21swapper/521:21:525
37152049961,4cyclictest3835921-21cstates20:08:595
37152049960,2cyclictest0-21swapper/521:40:265
37152049960,2cyclictest0-21swapper/500:21:205
37152049960,2cyclictest0-21swapper/500:21:205
37152049960,1cyclictest0-21swapper/523:35:335
37152049960,1cyclictest0-21swapper/522:19:035
37152049960,1cyclictest0-21swapper/521:50:065
37152049960,1cyclictest0-21swapper/521:29:435
37152049960,1cyclictest0-21swapper/521:13:575
37152069950,4cyclictest78488-21taskset23:53:476
37152069950,4cyclictest4127910-21chrt22:39:046
37152069950,4cyclictest135301-21chrt00:19:116
37152069950,4cyclictest135301-21chrt00:19:116
37152049950,1cyclictest0-21swapper/522:58:515
37152049950,1cyclictest0-21swapper/500:13:495
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional