You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 03:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Mar 11, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2754883995856,2cyclictest2745456-21kworker/u16:1+flush-8:021:09:356
275440525444,7sleep50-21swapper/519:01:195
2754885995044,4cyclictest3360446-21latency_hist23:39:037
275445124837,8sleep40-21swapper/419:01:584
275441724736,8sleep60-21swapper/619:01:286
2754874994644,2cyclictest3336401-21kworker/u16:3+events_unbound23:44:384
2754883994240,2cyclictest3372471-21kworker/u16:1+events_unbound23:46:106
2754883994139,2cyclictest3240613-21kworker/u16:2+events_unbound22:54:506
2754883994139,2cyclictest3213644-21kworker/u16:5+events_unbound22:52:066
2754883994139,2cyclictest3059634-21kworker/u16:0+events_unbound22:32:226
2754883994139,2cyclictest2745456-21kworker/u16:1+events_unbound21:30:546
2754874994138,2cyclictest2939815-21kworker/u16:2+events_unbound21:49:064
2754883994038,2cyclictest3372471-21kworker/u16:1+events_unbound23:52:376
2754883994038,2cyclictest3336401-21kworker/u16:3+events_unbound23:57:386
2754883994038,2cyclictest3025250-21kworker/u16:3+events_unbound22:03:506
2754883994038,2cyclictest2745456-21kworker/u16:1+events_unbound21:19:066
2754874994037,2cyclictest3336401-21kworker/u16:3+events_unbound00:14:054
2754883993937,2cyclictest3336401-21kworker/u16:3+events_unbound00:03:496
2754883993937,2cyclictest3213644-21kworker/u16:5+events_unbound23:03:306
2754883993937,2cyclictest3059634-21kworker/u16:0+events_unbound21:36:346
2754883993937,2cyclictest2745456-21kworker/u16:1+flush-8:019:14:056
2754883993936,2cyclictest3025250-21kworker/u16:3+events_unbound21:39:146
2754883993936,2cyclictest2745456-21kworker/u16:1+events_unbound20:24:066
2754883993936,2cyclictest2745456-21kworker/u16:1+events_unbound20:24:066
2754874993936,2cyclictest3025250-21kworker/u16:3+events_unbound22:04:074
2754874993936,2cyclictest2745456-21kworker/u16:1+flush-8:021:04:144
2754874993936,2cyclictest2745456-21kworker/u16:1+flush-8:021:04:144
27459892392,31sleep70-21swapper/718:59:207
2754885993835,2cyclictest3005970-21kthreadcore21:09:287
2754885993833,4cyclictest3228147-21latency_hist22:44:047
275488599380,37cyclictest124-21kswapd023:29:187
2754883993836,2cyclictest3213644-21kworker/u16:5+events_unbound22:40:136
2754883993836,2cyclictest3204071-21kworker/u16:3+events_unbound23:06:306
2754883993836,2cyclictest3204071-21kworker/u16:3+events_unbound23:06:306
2754883993836,2cyclictest2939815-21kworker/u16:2+events_unbound21:52:186
2754883993835,2cyclictest3336401-21kworker/u16:3+events_unbound00:14:136
2754874993836,2cyclictest3228169-21kworker/u16:0+events_unbound23:40:144
2754883993735,2cyclictest3431186-21kworker/u16:1+events_unbound00:07:506
2754883993735,2cyclictest3336401-21kworker/u16:3+events_unbound00:20:556
2754883993735,2cyclictest3228169-21kworker/u16:0+events_unbound23:27:586
2754883993735,2cyclictest3059634-21kworker/u16:0+events_unbound22:10:586
2754883993735,2cyclictest2909999-21kworker/u16:4+events_unbound21:05:396
2754883993735,2cyclictest2909999-21kworker/u16:4+events_unbound21:05:396
2754883993734,2cyclictest3228169-21kworker/u16:0+events_unbound23:35:176
2754874993735,2cyclictest3396668-21kworker/u16:4+events_unbound00:07:384
2754874993735,2cyclictest3155915-21kworker/u16:2+events_unbound22:24:464
2754874993735,2cyclictest3155915-21kworker/u16:2+events_unbound22:24:464
2754874993735,2cyclictest3025250-21kworker/u16:3+events_unbound22:13:014
2754874993735,2cyclictest3025250-21kworker/u16:3+events_unbound21:43:594
2754874993734,2cyclictest3106619-21kworker/u16:4+events_unbound21:54:074
2754883993635,1cyclictest3059634-21kworker/u16:0+events_unbound22:27:196
2754883993635,1cyclictest3059634-21kworker/u16:0+events_unbound22:27:196
2754883993634,2cyclictest3431186-21kworker/u16:1+events_unbound00:11:506
2754883993634,2cyclictest3276638-21kworker/u16:1+events_unbound23:13:306
2754883993634,2cyclictest3228169-21kworker/u16:0+events_unbound23:43:536
2754883993634,2cyclictest3131874-21kworker/u16:1+events_unbound22:44:386
2754883993634,2cyclictest3059634-21kworker/u16:0+events_unbound21:58:496
2754874993634,2cyclictest3059634-21kworker/u16:0+events_unbound21:37:254
2754883993533,2cyclictest3456893-21kworker/u16:0+events_unbound00:25:546
2754883993533,2cyclictest3456893-21kworker/u16:0+events_unbound00:25:546
2754883993533,2cyclictest3336401-21kworker/u16:3+events_unbound00:30:496
2754883993533,2cyclictest3213644-21kworker/u16:5+events_unbound22:37:506
2754883993533,2cyclictest3204071-21kworker/u16:3+events_unbound23:16:086
2754883993533,2cyclictest3059634-21kworker/u16:0+events_unbound22:20:176
2754883993533,2cyclictest3059634-21kworker/u16:0+events_unbound22:18:236
2754883993533,2cyclictest3025250-21kworker/u16:3+events_unbound22:07:016
2754883993533,2cyclictest3025250-21kworker/u16:3+events_unbound21:25:476
2754883993533,2cyclictest2745456-21kworker/u16:1+events_unbound21:17:116
2754883993532,2cyclictest2735913-21kworker/u16:2+events_unbound19:24:146
2754874993533,2cyclictest3396668-21kworker/u16:4+events_unbound23:54:544
2754874993533,2cyclictest3213644-21kworker/u16:5+events_unbound23:02:234
2754883993432,2cyclictest3323723-21kworker/u16:2+events_unbound23:33:346
2754879993432,2cyclictest3228169-21kworker/u16:0+events_unbound00:04:265
2754874993432,2cyclictest3323723-21kworker/u16:2+events_unbound23:25:374
2754874993432,2cyclictest3276638-21kworker/u16:1+events_unbound23:16:224
2754874993432,2cyclictest3228169-21kworker/u16:0+events_unbound23:11:034
2754874993432,2cyclictest3025250-21kworker/u16:3+events_unbound22:03:054
2754885993331,1cyclictest0-21swapper/722:09:187
2754874993331,2cyclictest3323723-21kworker/u16:2+events_unbound23:38:374
2754874993331,2cyclictest3204071-21kworker/u16:3+events_unbound22:49:534
2754874993331,2cyclictest3059634-21kworker/u16:0+events_unbound22:22:064
2754874993331,2cyclictest2745456-21kworker/u16:1+flush-8:021:19:384
2754883993230,2cyclictest2939815-21kworker/u16:2+events_unbound21:48:276
2754883993230,2cyclictest2939815-21kworker/u16:2+events_unbound21:48:276
2754874993230,2cyclictest2745456-21kworker/u16:1+events_unbound20:09:304
2754874993229,2cyclictest2999496-21kworker/u16:0+flush-8:021:14:144
33000362310,1chrt3300037-21sh23:13:377
2754883993129,2cyclictest3228169-21kworker/u16:0+events_unbound23:19:536
2754883993129,2cyclictest2745456-21kworker/u16:1+events_unbound20:06:076
2754883993128,2cyclictest2735913-21kworker/u16:2+events_unbound19:19:076
2754874993129,2cyclictest3213644-21kworker/u16:5+events_unbound22:55:234
2754874993128,2cyclictest3131874-21kworker/u16:1+events_unbound22:14:134
2754874993028,2cyclictest3456893-21kworker/u16:0+events_unbound00:25:504
2754874993028,2cyclictest3456893-21kworker/u16:0+events_unbound00:25:504
2754874993028,2cyclictest3431186-21kworker/u16:1+events_unbound00:10:384
2754874993028,2cyclictest3131874-21kworker/u16:1+events_unbound22:46:514
2754874993028,2cyclictest2999496-21kworker/u16:0+events_unbound21:11:454
2754883992927,2cyclictest2745456-21kworker/u16:1+flush-8:019:29:506
2754874992927,2cyclictest3372471-21kworker/u16:1+events_unbound23:52:294
2754874992927,2cyclictest3204071-21kworker/u16:3+events_unbound23:05:134
2754874992927,2cyclictest3204071-21kworker/u16:3+events_unbound23:05:134
2754874992927,2cyclictest3059634-21kworker/u16:0+flush-8:022:29:384
2754874992927,2cyclictest3025250-21kworker/u16:3+events_unbound21:45:124
2754874992927,2cyclictest3025250-21kworker/u16:3+events_unbound21:45:124
2754883992826,2cyclictest2735913-21kworker/u16:2+events_unbound19:39:016
2754874992827,1cyclictest3336401-21kworker/u16:3+events_unbound00:21:174
2754874992827,1cyclictest3131874-21kworker/u16:1+events_unbound22:42:394
2754874992826,2cyclictest3336401-21kworker/u16:3+events_unbound00:30:384
2754874992826,2cyclictest3204071-21kworker/u16:3+events_unbound22:38:584
2754874992826,2cyclictest2939815-21kworker/u16:2+events_unbound21:33:264
2754874992826,2cyclictest2735913-21kworker/u16:2+events_unbound19:19:224
2754883992725,2cyclictest2939815-21kworker/u16:2+events_unbound20:44:336
2754883992725,2cyclictest2745456-21kworker/u16:1+events_unbound20:17:156
2754874992725,2cyclictest2745456-21kworker/u16:1+flush-8:021:25:014
2754885992624,1cyclictest0-21swapper/723:24:257
2754885992621,4cyclictest3288269-21perf23:09:037
2754885992621,4cyclictest3288269-21perf23:09:037
2754883992624,2cyclictest2745456-21kworker/u16:1+events_unbound19:06:236
2754874992624,2cyclictest3276638-21kworker/u16:1+events_unbound23:23:024
2754885992524,0cyclictest0-21swapper/720:49:347
2754883992523,2cyclictest2939815-21kworker/u16:2+events_unbound21:01:156
2754883992523,2cyclictest2939815-21kworker/u16:2+events_unbound20:41:146
2754879992522,2cyclictest2939815-21kworker/u16:2+flush-8:021:49:215
2754874992523,2cyclictest3336401-21kworker/u16:3+events_unbound00:01:214
2754885992419,4cyclictest3432735-21latency_hist00:09:047
2754885992322,0cyclictest0-21swapper/721:04:287
2754885992322,0cyclictest0-21swapper/721:04:287
275488599230,22cyclictest3461522-21ssh00:19:227
2754883992321,2cyclictest2909999-21kworker/u16:4+flush-8:020:54:056
2754883992321,2cyclictest2745456-21kworker/u16:1+events_unbound20:35:026
2754883992321,2cyclictest2735913-21kworker/u16:2+events_unbound19:50:586
2754874992321,2cyclictest3228169-21kworker/u16:0+events_unbound23:30:224
334796622218,2sleep53336401-21kworker/u16:3+events_unbound23:33:165
2754885992220,1cyclictest2987442-21diskmemload21:54:297
2754885992219,2cyclictest3377519-21kthreadcore23:44:247
2754885992217,4cyclictest3131835-21latency_hist22:04:047
2754874992220,2cyclictest2909999-21kworker/u16:4+events_unbound20:54:044
2754883992119,2cyclictest2745456-21kworker/u16:1+flush-8:019:16:156
2754874992119,2cyclictest2745456-21kworker/u16:1+events_unbound19:04:354
2754874992119,2cyclictest2735913-21kworker/u16:2+flush-8:019:59:204
2754885992019,0cyclictest0-21swapper/721:44:197
2754885992019,0cyclictest0-21swapper/721:44:197
2754883992018,2cyclictest2939815-21kworker/u16:2+events_unbound20:58:496
2754883992018,2cyclictest2745456-21kworker/u16:1+events_unbound20:32:556
2754883992018,2cyclictest2735913-21kworker/u16:2+events_unbound20:20:546
2754883992018,2cyclictest2735913-21kworker/u16:2+events_unbound19:43:546
2754879992018,2cyclictest3059634-21kworker/u16:0+flush-8:021:59:305
2754874992018,2cyclictest2745456-21kworker/u16:1+flush-8:020:14:304
2754874992018,2cyclictest2735913-21kworker/u16:2+flush-8:019:09:054
2754885991916,2cyclictest3179954-21munin-run22:24:047
2754883991917,2cyclictest2806333-21kworker/u16:3+events_unbound19:46:586
2754883991917,2cyclictest2745456-21kworker/u16:1+events_unbound20:13:156
2754883991917,2cyclictest2735913-21kworker/u16:2+events_unbound20:01:026
2754879991916,2cyclictest3336401-21kworker/u16:3+flush-8:000:09:225
2754874991917,2cyclictest2939815-21kworker/u16:2+flush-8:020:44:344
275488599179,7cyclictest0-21swapper/722:44:287
275488599178,8cyclictest0-21swapper/722:49:267
2754885991715,1cyclictest0-21swapper/721:49:287
2754885991715,1cyclictest0-21swapper/700:14:307
2754885991714,2cyclictest1267-21snmpd19:42:177
2754885991711,5cyclictest2863385-21latency_hist19:59:057
2754879991712,4cyclictest3084119-21munin-node21:44:165
2754879991712,4cyclictest3084119-21munin-node21:44:165
275488599167,8cyclictest0-21swapper/723:19:247
275488599167,8cyclictest0-21swapper/720:04:237
275488599166,9cyclictest0-21swapper/722:34:267
275488599166,8cyclictest0-21swapper/721:34:227
2754885991613,2cyclictest0-21swapper/719:04:067
275488599157,7cyclictest6344-21gmain20:59:297
275488599157,7cyclictest0-21swapper/722:16:537
275488599157,7cyclictest0-21swapper/721:19:247
275488599156,8cyclictest0-21swapper/722:29:287
2754885991511,3cyclictest1267-21snmpd00:31:077
275488599150,14cyclictest3059599-21turbostat21:34:047
2754883991513,2cyclictest2745456-21kworker/u16:1+events_unbound19:58:226
2754874991513,2cyclictest2735913-21kworker/u16:2+flush-8:019:39:324
275488599147,6cyclictest0-21swapper/723:59:197
275488599146,7cyclictest0-21swapper/723:49:177
275488599146,7cyclictest0-21swapper/722:59:267
275488599146,7cyclictest0-21swapper/700:29:037
275488599146,7cyclictest0-21swapper/700:29:037
275488599145,8cyclictest1060-21runrttasks21:40:337
2754885991411,2cyclictest0-21swapper/720:24:057
2754885991411,2cyclictest0-21swapper/720:24:057
2754885991410,3cyclictest3261079-21ssh22:54:277
275488599140,12cyclictest0-21swapper/720:34:307
2754879991413,1cyclictest0-21swapper/523:45:175
2754879991413,1cyclictest0-21swapper/522:50:535
2754879991413,1cyclictest0-21swapper/521:38:315
2754879991413,1cyclictest0-21swapper/519:24:315
2754879991412,2cyclictest3228169-21kworker/u16:0+events_unbound23:04:175
2754879991412,2cyclictest3228169-21kworker/u16:0+events_unbound23:04:175
2754879991412,2cyclictest3059634-21kworker/u16:0+flush-8:022:04:355
2754879991411,3cyclictest3228169-21kworker/u16:0+events_unbound23:49:295
2754879991411,2cyclictest2939815-21kworker/u16:2+flush-8:021:55:075
275487999140,1cyclictest0-21swapper/523:35:115
275487999140,1cyclictest0-21swapper/522:29:175
275487999140,1cyclictest0-21swapper/500:17:175
275487999140,14cyclictest0-21swapper/523:12:585
275487999140,14cyclictest0-21swapper/521:28:545
275487999140,0cyclictest0-21swapper/522:15:445
2754874991411,2cyclictest2735913-21kworker/u16:2+flush-8:019:24:164
275488599139,3cyclictest1267-21snmpd20:40:077
275488599136,6cyclictest0-21swapper/723:41:337
275488599136,6cyclictest0-21swapper/723:14:277
275488599136,6cyclictest0-21swapper/721:24:217
275488599136,6cyclictest0-21swapper/721:15:377
275488599136,6cyclictest0-21swapper/719:26:047
2754885991313,0cyclictest0-21swapper/722:04:197
2754885991310,2cyclictest0-21swapper/700:09:047
275488599130,2cyclictest2891024-21ntpq20:09:297
275488599130,11cyclictest1096-21ntpd19:19:077
2754879991312,1cyclictest0-21swapper/522:35:075
2754879991312,1cyclictest0-21swapper/521:06:035
2754879991312,1cyclictest0-21swapper/521:06:035
2754879991312,1cyclictest0-21swapper/500:21:135
2754879991311,2cyclictest3204071-21kworker/u16:3+events_unbound22:44:295
275487999130,13cyclictest0-21swapper/522:43:005
275487999130,0cyclictest0-21swapper/520:49:305
2754874991311,2cyclictest2745456-21kworker/u16:1+events_unbound20:04:334
2754874991310,2cyclictest2909999-21kworker/u16:4+events_unbound20:59:244
275487499130,12cyclictest0-21swapper/420:54:074
275488599129,2cyclictest1267-21snmpd22:24:127
275488599129,2cyclictest1267-21snmpd22:24:127
275488599128,3cyclictest1267-21snmpd20:18:517
275488599128,3cyclictest1267-21snmpd19:44:147
275488599128,3cyclictest1267-21snmpd19:35:207
275488599125,6cyclictest0-21swapper/723:54:127
2754885991210,1cyclictest2930260-21cut20:34:047
275488599120,10cyclictest1096-21ntpd19:59:077
2754879991211,1cyclictest0-21swapper/523:14:515
2754879991211,1cyclictest0-21swapper/522:19:315
2754879991211,1cyclictest0-21swapper/521:32:415
2754879991211,1cyclictest0-21swapper/521:21:115
2754879991211,1cyclictest0-21swapper/521:17:245
2754879991211,1cyclictest0-21swapper/520:22:045
275487999120,1cyclictest0-21swapper/519:46:175
275487999120,12cyclictest0-21swapper/521:11:435
275487499128,3cyclictest2921784-21cat20:29:204
2754874991210,2cyclictest2806333-21kworker/u16:3+events_unbound19:44:334
275488599118,2cyclictest1267-21snmpd20:21:277
275488599117,3cyclictest1267-21snmpd20:48:077
275488599117,3cyclictest1267-21snmpd19:14:287
275488599115,5cyclictest6184-21gvfs-afc-volume20:54:227
275488599114,6cyclictest0-21swapper/719:33:337
275488599110,10cyclictest2853820-21turbostat19:54:047
275488599110,10cyclictest2768419-21/usr/sbin/munin19:09:257
275487999118,2cyclictest3252784-21cpuspeed_turbos22:54:155
2754879991110,1cyclictest0-21swapper/521:40:255
2754879991110,1cyclictest0-21swapper/520:24:075
2754879991110,1cyclictest0-21swapper/520:24:075
2754879991110,1cyclictest0-21swapper/520:03:185
2754879991110,1cyclictest0-21swapper/519:39:395
2754879991110,1cyclictest0-21swapper/500:33:125
2754879991110,1cyclictest0-21swapper/500:27:135
2754879991110,1cyclictest0-21swapper/500:27:135
275487999110,11cyclictest0-21swapper/520:11:395
275487999110,11cyclictest0-21swapper/519:57:005
275487999109,1cyclictest0-21swapper/523:26:595
275487999109,1cyclictest0-21swapper/523:22:535
275487999109,1cyclictest0-21swapper/522:25:215
275487999109,1cyclictest0-21swapper/522:25:215
275487999109,1cyclictest0-21swapper/520:15:455
275487999108,2cyclictest3228169-21kworker/u16:0+events_unbound23:59:185
275487999106,3cyclictest2769198-21cat19:09:195
275487499108,2cyclictest2806333-21kworker/u16:3+flush-8:019:49:304
275487499108,2cyclictest2735913-21kworker/u16:2+flush-8:019:15:134
275487499108,2cyclictest2735913-21kworker/u16:2+events_unbound19:34:254
275487499100,9cyclictest0-21swapper/419:54:224
27548799998,1cyclictest0-21swapper/523:55:135
27548799990,8cyclictest0-21swapper/520:44:235
27548749998,1cyclictest0-21swapper/420:41:394
27548749998,1cyclictest0-21swapper/420:35:214
27548799986,1cyclictest0-21swapper/519:29:255
27548799985,2cyclictest0-21swapper/520:34:225
27548799984,3cyclictest2946056-21cut20:39:235
27548799984,3cyclictest2845467-21cat19:49:195
27548799983,4cyclictest3267524-21grep22:59:225
27548799983,4cyclictest2969459-21gltestperf20:54:175
27548799983,4cyclictest2929676-21timerwakeupswit20:29:335
27548799983,4cyclictest2877295-21cut20:04:235
27548749985,2cyclictest0-21swapper/420:24:264
27548749985,2cyclictest0-21swapper/420:24:264
27548749983,4cyclictest2906778-21kthreadcore20:19:224
27548749983,4cyclictest2812326-21grep19:29:254
27548799973,3cyclictest3144607-21grep22:09:175
27548799973,3cyclictest2979255-21sed20:59:205
27548799973,3cyclictest2818694-21cut19:34:225
27548799973,3cyclictest2757666-21grep19:04:235
27548799972,4cyclictest2778275-21cat19:14:175
27548799963,2cyclictest3360968-21cpu23:39:155
27548799960,1cyclictest0-21swapper/519:21:445
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional