You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 06:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Fri May 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40738032960,1sleep40-21swapper/400:13:004
339123325949,7sleep40-21swapper/419:06:344
339102525746,7sleep50-21swapper/519:03:385
3391647995249,2cyclictest3629766-21kworker/u16:0+flush-8:021:08:275
3391647994240,2cyclictest3710773-21kworker/u16:0+events_unbound21:48:295
33911612416,30sleep70-21swapper/719:05:327
3391647994037,2cyclictest3481816-21kworker/u16:2+events_unbound20:13:145
3391654993933,5cyclictest3433706-21latency_hist19:28:017
3391647993735,2cyclictest3855841-21kworker/u16:2+events_unbound22:51:465
3391647993735,2cyclictest3650200-21kworker/u16:3+events_unbound22:04:505
3391647993634,2cyclictest3928451-21kworker/u16:4+events_unbound23:36:215
3391647993634,2cyclictest3855841-21kworker/u16:2+events_unbound00:11:535
3391647993634,2cyclictest3820702-21kworker/u16:0+events_unbound23:49:215
3391647993634,2cyclictest3820702-21kworker/u16:0+events_unbound22:34:425
3391647993634,2cyclictest3820702-21kworker/u16:0+events_unbound22:34:425
3391647993634,2cyclictest3646893-21kworker/u16:2+events_unbound21:20:265
3391647993634,2cyclictest3629766-21kworker/u16:0+flush-8:021:16:185
3391647993634,2cyclictest3521774-21kworker/u16:4+flush-8:021:32:415
3391647993533,2cyclictest3820702-21kworker/u16:0+events_unbound23:32:215
3391647993533,2cyclictest3806515-21kworker/u16:1+flush-8:022:22:215
3391647993533,2cyclictest3806515-21kworker/u16:1+events_unbound22:56:415
3391647993533,2cyclictest3650200-21kworker/u16:3+events_unbound21:42:545
3391647993432,2cyclictest4025013-21kworker/u16:1+events_unbound00:06:505
3391647993432,2cyclictest3855841-21kworker/u16:2+events_unbound23:16:495
3391647993432,2cyclictest3820702-21kworker/u16:0+events_unbound23:40:495
3391647993432,2cyclictest3710773-21kworker/u16:0+events_unbound21:53:495
3391647993432,2cyclictest3710773-21kworker/u16:0+events_unbound21:53:495
3391647993432,2cyclictest3521774-21kworker/u16:4+events_unbound22:01:465
3391647993432,2cyclictest3344322-21kworker/u16:4+flush-8:019:33:545
3391647993431,2cyclictest3820702-21kworker/u16:0+flush-8:022:28:505
3391647993331,2cyclictest4025013-21kworker/u16:1+events_unbound00:15:175
3391647993331,2cyclictest3855841-21kworker/u16:2+events_unbound23:02:295
3391647993331,2cyclictest3855841-21kworker/u16:2+events_unbound00:01:185
3391647993331,2cyclictest3820702-21kworker/u16:0+flush-8:022:39:455
3391647993331,2cyclictest3820702-21kworker/u16:0+events_unbound23:09:455
3391647993331,2cyclictest3806515-21kworker/u16:1+events_unbound23:04:185
3391647993331,2cyclictest3650200-21kworker/u16:3+events_unbound22:24:465
3391647993331,2cyclictest3646893-21kworker/u16:2+events_unbound21:34:175
3391647993331,2cyclictest3521774-21kworker/u16:4+events_unbound21:27:185
3391647993230,2cyclictest3928451-21kworker/u16:4+events_unbound23:45:135
3391647993230,2cyclictest3928451-21kworker/u16:4+events_unbound23:25:135
3391647993230,2cyclictest3855842-21kworker/u16:4+events_unbound22:45:385
3391647993230,2cyclictest3855841-21kworker/u16:2+flush-8:000:31:175
3391647993230,2cyclictest3710773-21kworker/u16:0+events_unbound22:15:255
3391647993230,2cyclictest3521774-21kworker/u16:4+events_unbound22:09:415
3391647993129,2cyclictest3928451-21kworker/u16:4+events_unbound23:55:265
3391647993129,2cyclictest3650200-21kworker/u16:3+events_unbound21:44:225
3391647993129,2cyclictest3521774-21kworker/u16:4+events_unbound20:57:095
3391647993129,2cyclictest3401246-21kworker/u16:2+events_unbound19:32:105
3391649993028,2cyclictest3127692-21kworker/u16:1+flush-8:019:33:266
3391649993026,3cyclictest3855841-21kworker/u16:2+flush-8:022:48:056
3391649993026,3cyclictest3710773-21kworker/u16:0+flush-8:022:03:006
3391647993028,2cyclictest4097643-21kworker/u16:0+events_unbound00:25:015
3391647993028,2cyclictest3928451-21kworker/u16:4+events_unbound23:21:185
3391647993028,2cyclictest3855841-21kworker/u16:2+events_unbound00:37:495
3391647993028,2cyclictest3471180-21kworker/u16:3+events_unbound20:06:555
339165499290,27cyclictest1234-21snmpd20:33:157
3391647992927,2cyclictest4061442-21kworker/u16:3+events_unbound00:20:295
3391647992927,2cyclictest3453179-21kworker/u16:0+flush-8:019:55:355
3391654992824,3cyclictest124-21kswapd000:12:597
3391647992826,2cyclictest3471180-21kworker/u16:3+events_unbound20:00:545
3391643992826,2cyclictest4025013-21kworker/u16:1+events_unbound00:13:154
3391654992722,4cyclictest3637918-21latency_hist21:13:007
3391647992725,2cyclictest3521774-21kworker/u16:4+events_unbound21:04:545
3391647992725,2cyclictest3127692-21kworker/u16:1+events_unbound19:27:545
3391647992724,2cyclictest3481816-21kworker/u16:2+events_unbound20:23:105
41334472260,1chrt4133445-21ssh00:37:157
3391649992624,2cyclictest3453179-21kworker/u16:0+flush-8:019:53:156
3391647992624,2cyclictest3401246-21kworker/u16:2+events_unbound19:19:105
3391654992524,0cyclictest0-21swapper/722:53:207
339165499250,23cyclictest827-21dbus-daemon19:23:017
3391647992523,2cyclictest3521774-21kworker/u16:4+flush-8:020:33:235
339109222515,7sleep60-21swapper/619:04:356
3391654992423,0cyclictest0-21swapper/723:08:217
3391654992422,1cyclictest0-21swapper/721:53:177
3391654992422,1cyclictest0-21swapper/721:53:177
3391654992418,5cyclictest3452950-21latency_hist19:38:007
3391643992421,2cyclictest3481816-21kworker/u16:2+flush-8:020:28:254
3391643992421,2cyclictest3481816-21kworker/u16:2+flush-8:020:28:254
3391654992318,3cyclictest3860500-21kthreadcore22:43:227
339165499230,21cyclictest3854594-21taskset22:40:577
3391647992321,2cyclictest3521774-21kworker/u16:4+flush-8:020:22:535
3391654992217,4cyclictest3819466-21latency_hist22:27:597
3391654992217,4cyclictest3686382-21latency_hist21:33:007
339165499221,20cyclictest857-21udisksd22:17:387
3391649992220,2cyclictest3928451-21kworker/u16:4+flush-8:023:18:256
3391649992220,2cyclictest3855841-21kworker/u16:2+flush-8:000:03:306
3391649992220,2cyclictest3521774-21kworker/u16:4+flush-8:021:58:006
3391649992220,2cyclictest3521774-21kworker/u16:4+flush-8:021:58:006
3391647992220,2cyclictest3453179-21kworker/u16:0+events_unbound20:12:535
3391654992119,1cyclictest3781032-21ssh22:09:027
3391654992119,1cyclictest0-21swapper/721:03:167
3391654992118,2cyclictest3832861-21iostat22:33:167
3391654992118,2cyclictest3832861-21iostat22:33:167
3391654992115,5cyclictest635-21systemd-journal20:03:007
3391647992119,2cyclictest3471180-21kworker/u16:3+flush-8:020:39:575
339165499200,18cyclictest3513799-21cut20:08:177
3391647992018,2cyclictest3481816-21kworker/u16:2+flush-8:020:32:575
3391647992018,2cyclictest3481816-21kworker/u16:2+flush-8:020:32:575
3391654991916,2cyclictest0-21swapper/720:53:017
3391649991917,2cyclictest3453179-21kworker/u16:0+flush-8:020:08:266
39563852180,2sleep73956386-21rm23:23:187
3391654991813,4cyclictest4037048-21latency_hist23:57:597
339165499180,17cyclictest124-21kswapd000:18:227
3391647991816,2cyclictest3521774-21kworker/u16:4+events_unbound21:00:305
3391647991816,2cyclictest3521774-21kworker/u16:4+events_unbound20:44:425
3391647991816,2cyclictest3471180-21kworker/u16:3+flush-8:019:46:425
3391647991816,2cyclictest3471180-21kworker/u16:3+flush-8:019:46:425
3391654991716,0cyclictest0-21swapper/722:07:097
3391647991715,2cyclictest3521774-21kworker/u16:4+flush-8:020:52:145
3391647991715,2cyclictest3127692-21kworker/u16:1+events_unbound19:16:425
3391654991615,0cyclictest0-21swapper/723:38:267
3391654991614,1cyclictest0-21swapper/721:33:157
3391643991612,1cyclictest0-21swapper/422:13:584
3391654991512,2cyclictest0-21swapper/720:23:007
339165499150,13cyclictest3807050-21sh22:22:257
3391649991513,2cyclictest3127692-21kworker/u16:1+flush-8:019:28:266
3391647991513,2cyclictest3127692-21kworker/u16:1+events_unbound19:09:385
339165499148,5cyclictest3710570-21latency_hist21:43:007
3391654991413,0cyclictest0-21swapper/722:58:157
3391654991412,1cyclictest0-21swapper/721:18:007
3391654991412,1cyclictest0-21swapper/700:23:297
3391654991411,2cyclictest1234-21snmpd23:51:187
3391654991411,2cyclictest0-21swapper/721:48:287
3391654991411,2cyclictest0-21swapper/720:38:007
3391654991410,2cyclictest3558565-21munin-run20:33:007
3391654991410,2cyclictest3558565-21munin-run20:33:007
339165499140,1cyclictest0-21swapper/721:58:257
339165499140,13cyclictest0-21swapper/700:28:247
3391647991412,2cyclictest3453179-21kworker/u16:0+events_unbound19:52:225
3391643991413,1cyclictest0-21swapper/423:19:524
3391643991413,1cyclictest0-21swapper/422:57:194
339164399140,14cyclictest0-21swapper/423:57:044
339164399140,14cyclictest0-21swapper/421:53:474
339164399140,14cyclictest0-21swapper/421:53:474
339164399140,14cyclictest0-21swapper/421:15:284
339165499139,3cyclictest1234-21snmpd22:29:287
339165499139,3cyclictest1234-21snmpd20:47:287
339165499139,3cyclictest1234-21snmpd20:05:317
339165499139,3cyclictest1234-21snmpd19:51:367
339165499139,3cyclictest1234-21snmpd19:44:217
339165499139,3cyclictest1234-21snmpd19:44:217
3391654991312,0cyclictest0-21swapper/720:13:227
3391654991310,2cyclictest1234-21snmpd00:00:187
339164999138,4cyclictest4098932-21cat00:23:156
3391643991312,1cyclictest0-21swapper/421:26:314
339164399130,13cyclictest0-21swapper/421:35:584
339165499129,2cyclictest1234-21snmpd21:47:247
339165499129,2cyclictest1234-21snmpd19:42:127
339165499128,3cyclictest6382-21gvfs-afc-volume21:13:157
339165499128,3cyclictest1234-21snmpd21:24:477
339165499128,3cyclictest1234-21snmpd19:54:277
339165499128,3cyclictest1234-21snmpd00:04:277
339165499127,4cyclictest6895-21gmain23:03:257
339165499127,3cyclictest0-21swapper/723:43:247
339165499126,5cyclictest6382-21gvfs-afc-volume22:48:447
339165499120,11cyclictest1234-21snmpd23:32:057
339164999122,9cyclictest3424774-21cstates19:23:116
3391649991211,1cyclictest0-21swapper/622:08:276
3391649991211,1cyclictest0-21swapper/621:24:566
3391649991210,2cyclictest3928451-21kworker/u16:4+flush-8:023:58:136
339164399128,3cyclictest3650200-21kworker/u16:3+flush-8:022:38:414
339164399127,4cyclictest3521352-21cat20:13:154
3391643991211,1cyclictest0-21swapper/422:37:564
3391643991211,1cyclictest0-21swapper/422:37:564
3391643991211,1cyclictest0-21swapper/422:24:514
339164399120,1cyclictest0-21swapper/420:45:314
339164399120,1cyclictest0-21swapper/400:23:004
339165499118,2cyclictest1234-21snmpd19:15:157
339165499118,2cyclictest0-21swapper/723:33:227
339165499117,3cyclictest1234-21snmpd20:49:137
339165499116,4cyclictest6382-21gvfs-afc-volume23:18:257
339165499115,5cyclictest6382-21gvfs-afc-volume23:13:397
339164999119,2cyclictest3820702-21kworker/u16:0+events_unbound23:28:286
339164999116,4cyclictest3881043-21tune2fs22:53:146
339164999116,4cyclictest3639230-21cat21:13:176
3391649991110,1cyclictest0-21swapper/622:26:356
3391649991110,1cyclictest0-21swapper/621:38:116
3391649991110,1cyclictest0-21swapper/621:05:236
3391649991110,1cyclictest0-21swapper/620:47:066
339164999110,1cyclictest0-21swapper/600:10:196
339164999110,10cyclictest3403850-21kthreadcore19:13:036
339164799119,2cyclictest3453179-21kworker/u16:0+flush-8:019:38:355
3391643991110,1cyclictest0-21swapper/421:44:384
339164399110,11cyclictest0-21swapper/421:02:234
339165499109,0cyclictest0-21swapper/720:18:137
339165499108,1cyclictest0-21swapper/700:13:277
339165499104,4cyclictest3611348-21grep20:58:197
339165499100,9cyclictest1234-21snmpd19:10:457
339164999109,1cyclictest0-21swapper/620:24:056
339164999108,2cyclictest86-21ksoftirqd/622:38:216
339164999108,2cyclictest86-21ksoftirqd/622:37:416
339164999108,2cyclictest86-21ksoftirqd/622:37:416
339164999108,2cyclictest86-21ksoftirqd/622:22:066
339164999108,2cyclictest86-21ksoftirqd/621:33:206
339164999108,2cyclictest86-21ksoftirqd/621:18:246
339164999108,2cyclictest86-21ksoftirqd/600:18:286
339164999108,2cyclictest3471180-21kworker/u16:3+flush-8:019:48:256
339164999106,3cyclictest3470768-21cut19:43:216
339164999106,3cyclictest3470768-21cut19:43:216
339164999103,2cyclictest4115821-21kthreadcore00:28:206
339164999101,8cyclictest0-21swapper/620:38:166
339164999100,9cyclictest3977461-21expr23:33:136
339164999100,9cyclictest3856358-21tr22:43:136
339164999100,9cyclictest3822541-21kthreadcore22:28:186
339164999100,9cyclictest3787451-21tr22:13:186
339164999100,9cyclictest3767921-21ntp_kernel_pll_22:03:236
339164999100,9cyclictest3504200-21kthreadcore20:03:206
339164999100,4cyclictest3934649-21grep23:13:196
339164999100,4cyclictest3719638-21pmu-power21:43:276
339164399109,1cyclictest0-21swapper/419:12:494
339164399105,4cyclictest3893360-21tune2fs22:58:154
339164399105,4cyclictest3626916-21tune2fs21:08:154
33916499997,2cyclictest86-21ksoftirqd/621:08:046
33916499997,2cyclictest86-21ksoftirqd/620:18:266
33916499997,2cyclictest86-21ksoftirqd/600:33:136
33916499997,1cyclictest0-21swapper/623:23:206
33916499996,2cyclictest0-21swapper/619:58:126
33916499995,3cyclictest4027886-21kthreadcore23:53:196
33916499995,3cyclictest3905152-21expr23:03:126
33916499995,3cyclictest3550136-21cat20:28:156
33916499995,3cyclictest3550136-21cat20:28:156
33916499990,8cyclictest4001808-21expr23:43:126
33916499990,8cyclictest3993333-21kthreadcore23:38:196
33916499990,8cyclictest3893457-21ip_192.168.114.22:58:176
33916499990,8cyclictest3609508-21kthreadcore20:58:186
33916499990,8cyclictest3589367-21grep20:48:166
33916499990,8cyclictest3455199-21kthreadcore19:38:176
33916499990,4cyclictest4014271-21ip_192.168.114.23:48:166
33916499990,4cyclictest3919404-21kthreadcore23:08:216
33916499990,4cyclictest3678330-21kthreadcore21:28:196
33916499990,3cyclictest4074395-21cat00:13:126
33916499990,2cyclictest3597304-21/usr/sbin/munin20:53:286
33916439998,1cyclictest0-21swapper/420:27:594
33916439994,4cyclictest3804907-21/usr/sbin/munin22:18:274
33916439994,4cyclictest3491857-21cat19:58:124
33916439994,4cyclictest3471700-21grep19:43:284
33916439994,4cyclictest3471700-21grep19:43:284
33916549983,4cyclictest3437440-21cut19:28:177
33916499983,4cyclictest3415517-21cut19:18:136
33916499980,7cyclictest0-21swapper/621:48:136
33916439986,1cyclictest0-21swapper/419:38:204
33916439985,2cyclictest0-21swapper/423:33:164
33916439985,2cyclictest0-21swapper/420:53:194
33916439985,2cyclictest0-21swapper/420:03:214
33916439985,2cyclictest0-21swapper/419:33:174
33916439985,2cyclictest0-21swapper/400:03:204
33916439984,3cyclictest4114504-21kthreadcore00:28:194
33916439984,3cyclictest4046329-21sed23:58:284
33916439984,3cyclictest4017099-21kthreadcore23:48:184
33916439984,3cyclictest3909307-21kthreadcore23:03:194
33916439984,3cyclictest3750473-21kthreadcore21:58:184
33916439984,3cyclictest3653480-21cut21:18:184
33916439984,3cyclictest3473330-21cat19:48:154
33916439984,3cyclictest3424762-21/usr/sbin/munin19:23:114
33916439983,4cyclictest4124317-21kthreadcore00:33:194
33916439983,4cyclictest3967095-21kthreadcore23:28:184
33916439983,4cyclictest3961251-21latency23:23:214
33916439983,4cyclictest3920196-21cut23:08:214
33916439983,4cyclictest3857946-21tr22:43:184
33916439983,4cyclictest3773178-21cut22:08:174
33916439983,4cyclictest3619909-21cut21:03:174
33916439983,4cyclictest3530525-21cat20:18:114
33916439983,4cyclictest3512518-21cut20:08:164
33916439983,4cyclictest3484088-21cut19:53:174
33916439983,4cyclictest3438529-21cut19:28:184
33916439983,4cyclictest3416855-21cut19:18:164
33916439983,4cyclictest3404749-21grep19:13:044
33916499976,1cyclictest0-21swapper/620:33:256
33916499970,7cyclictest0-21swapper/620:13:156
33916499970,1cyclictest0-21swapper/619:08:146
33916439975,1cyclictest0-21swapper/421:48:134
33916439974,2cyclictest4001848-21diskstats23:43:134
33916439974,2cyclictest3929430-21fschecks_count23:13:134
33916439974,2cyclictest3868301-21/usr/sbin/munin22:48:124
33916439974,2cyclictest3821307-21kthreadcore22:28:174
33916439973,3cyclictest3990749-21tr23:38:174
33916439973,3cyclictest3762256-21cut22:03:174
33916439973,3cyclictest3700376-21tr21:38:164
33916439973,3cyclictest3588229-21forks20:48:134
33916439972,4cyclictest4099308-21cut00:23:164
33916439972,4cyclictest3676399-21grep21:28:174
33916439972,4cyclictest3573437-21grep20:38:194
33916439950,4cyclictest3558953-21cpu20:33:134
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional