You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 08:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Wed Jul 01, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233878326252,7sleep40-21swapper/419:09:024
232947225319,29sleep70-21swapper/719:04:167
2339089994640,5cyclictest2488369-21latency_hist20:24:057
2339087994441,2cyclictest2792131-21kworker/u16:0+flush-8:023:49:056
2339089994342,0cyclictest0-21swapper/723:14:077
233855424333,7sleep50-21swapper/519:05:505
2339087993937,2cyclictest2792131-21kworker/u16:0+flush-8:023:38:596
2339082993936,2cyclictest2998006-21kworker/u16:2+events_unbound00:21:075
233868923928,8sleep60-21swapper/619:07:446
2339082993836,2cyclictest2646122-21kworker/u16:2+events_unbound23:14:235
2339089993735,1cyclictest2611360-21ssh21:22:457
2339082993734,2cyclictest2646122-21kworker/u16:2+events_unbound21:49:085
2339087993634,2cyclictest2536920-21kworker/u16:3+events_unbound21:39:006
2339087993634,2cyclictest2536920-21kworker/u16:3+events_unbound21:39:006
2339082993634,2cyclictest2792131-21kworker/u16:0+events_unbound23:09:515
2339087993532,2cyclictest2998006-21kworker/u16:2+flush-8:000:14:056
2339082993533,2cyclictest2952403-21kworker/u16:3+events_unbound23:59:045
2339082993533,2cyclictest2792131-21kworker/u16:0+events_unbound22:37:155
2339089993432,1cyclictest2672081-21sh21:47:367
2339089993432,1cyclictest2575645-21diskmemload23:50:127
2339087993432,2cyclictest2646122-21kworker/u16:2+events_unbound22:54:406
2339087993432,2cyclictest2646122-21kworker/u16:2+events_unbound22:54:406
2339082993431,2cyclictest2536920-21kworker/u16:3+events_unbound21:28:085
2339089993331,1cyclictest2575645-21diskmemload21:35:087
2339089993331,1cyclictest2575645-21diskmemload21:35:087
2339082993331,2cyclictest2998006-21kworker/u16:2+events_unbound00:12:565
2339082993331,2cyclictest2624628-21kworker/u16:4+events_unbound21:30:365
2339082993331,2cyclictest2448768-21kworker/u16:1+events_unbound21:48:005
2339089993231,0cyclictest0-21swapper/700:37:087
2339089993230,1cyclictest2866724-21ssh23:08:007
2339089993230,1cyclictest2732179-21ssh22:11:297
2339089993230,1cyclictest0-21swapper/721:24:097
2339082993230,2cyclictest2792131-21kworker/u16:0+flush-8:022:43:155
2339082993230,2cyclictest2733986-21kworker/u16:4+events_unbound23:07:155
2339082993230,2cyclictest2646122-21kworker/u16:2+events_unbound23:19:125
2339082993230,2cyclictest2546980-21kworker/u16:2+flush-8:021:14:005
2339082993230,2cyclictest2448768-21kworker/u16:1+events_unbound22:05:215
2339089993130,0cyclictest0-21swapper/722:01:217
2339089993130,0cyclictest0-21swapper/700:25:237
2339089993129,1cyclictest2829353-21ssh22:51:097
2339089993129,1cyclictest2575645-21diskmemload21:10:097
2339089993129,1cyclictest2575645-21diskmemload00:00:327
2339089993128,2cyclictest3026758-21ssh00:16:127
2339089993128,2cyclictest2963874-21ssh23:48:017
2339089993128,2cyclictest2598638-21ssh21:16:447
2339087993129,2cyclictest2733568-21kworker/u16:0+events_unbound22:14:406
2339087993129,2cyclictest2733568-21kworker/u16:0+events_unbound22:14:406
2339082993129,2cyclictest2877221-21kworker/u16:1+events_unbound23:30:165
2339082993129,2cyclictest2792131-21kworker/u16:0+events_unbound23:37:165
2339082993129,2cyclictest2733986-21kworker/u16:4+events_unbound22:17:365
2339082993129,2cyclictest2733986-21kworker/u16:4+events_unbound22:17:365
2339082993129,2cyclictest2646122-21kworker/u16:2+events_unbound22:26:165
2339082993129,2cyclictest2536920-21kworker/u16:3+events_unbound21:18:295
2339082993129,2cyclictest2448768-21kworker/u16:1+events_unbound21:58:515
2339082993127,3cyclictest2646122-21kworker/u16:2+flush-8:022:04:055
2339089993029,0cyclictest0-21swapper/723:03:087
2339089993029,0cyclictest0-21swapper/722:56:167
2339089993029,0cyclictest0-21swapper/722:56:167
2339089993028,1cyclictest0-21swapper/722:21:397
2339089993025,4cyclictest2804748-21ssh22:40:367
2339087993028,2cyclictest2646122-21kworker/u16:2+flush-8:021:39:446
2339082993028,2cyclictest2877221-21kworker/u16:1+events_unbound23:41:235
2339082993028,2cyclictest2733986-21kworker/u16:4+events_unbound22:20:155
2339089992928,0cyclictest0-21swapper/723:58:197
2339089992928,0cyclictest0-21swapper/723:24:077
2339089992928,0cyclictest0-21swapper/722:37:407
2339089992928,0cyclictest0-21swapper/721:40:527
2339089992928,0cyclictest0-21swapper/700:23:087
2339082992927,2cyclictest2792131-21kworker/u16:0+events_unbound22:49:595
2339082992927,2cyclictest2391688-21kworker/u16:2+flush-8:020:04:055
2339089992827,0cyclictest0-21swapper/722:48:357
2339089992827,0cyclictest0-21swapper/721:52:247
2339089992827,0cyclictest0-21swapper/700:11:327
2339089992826,1cyclictest2938066-21ssh23:35:087
2339089992826,1cyclictest0-21swapper/722:16:327
2339089992826,1cyclictest0-21swapper/722:16:327
2339089992825,2cyclictest2878670-21sh23:12:417
2339089992825,2cyclictest2636195-21ssh21:33:447
2339087992826,2cyclictest2536920-21kworker/u16:3+events_unbound21:24:296
2339089992726,0cyclictest0-21swapper/723:31:057
2339089992726,0cyclictest0-21swapper/722:28:047
2339089992726,0cyclictest0-21swapper/700:31:527
2339089992725,1cyclictest2901548-21ssh23:19:557
2339089992725,1cyclictest2380670-21ntp_states19:24:317
2339089992722,4cyclictest2721450-21latency_hist22:09:057
2339087992725,2cyclictest2952403-21kworker/u16:3+events_unbound23:57:166
2339087992725,2cyclictest2877221-21kworker/u16:1+events_unbound23:16:166
2339087992725,2cyclictest2536920-21kworker/u16:3+flush-8:022:09:366
2339087992725,2cyclictest2391688-21kworker/u16:2+events_unbound20:44:046
2339082992725,2cyclictest2877221-21kworker/u16:1+events_unbound23:24:525
2339089992625,0cyclictest0-21swapper/700:08:357
2339082992624,2cyclictest3052636-21kworker/u16:1+events_unbound00:37:345
2339082992624,2cyclictest3052636-21kworker/u16:1+events_unbound00:30:085
2339082992624,2cyclictest2998006-21kworker/u16:2+events_unbound00:08:055
2339082992624,2cyclictest2998006-21kworker/u16:2+events_unbound00:01:365
2339082992624,2cyclictest2877221-21kworker/u16:1+events_unbound23:51:345
2339082992624,2cyclictest2792131-21kworker/u16:0+events_unbound22:55:045
2339082992624,2cyclictest2792131-21kworker/u16:0+events_unbound22:55:045
2339082992624,2cyclictest2733986-21kworker/u16:4+events_unbound23:00:035
2339082992624,2cyclictest2646122-21kworker/u16:2+events_unbound22:45:005
2339082992624,2cyclictest2646122-21kworker/u16:2+events_unbound22:12:515
2339082992624,2cyclictest2536920-21kworker/u16:3+events_unbound21:34:395
2339082992624,2cyclictest2536920-21kworker/u16:3+events_unbound21:34:395
2339082992624,2cyclictest1592756-21kworker/u16:3+events_unbound19:49:365
2339089992524,0cyclictest0-21swapper/723:43:047
2339089992522,2cyclictest2779965-21ssh22:29:447
2339087992523,2cyclictest2536920-21kworker/u16:3+events_unbound21:54:056
2339082992523,2cyclictest2792131-21kworker/u16:0+events_unbound00:18:525
2339082992523,2cyclictest2536920-21kworker/u16:3+flush-8:021:04:005
2339082992523,2cyclictest2536920-21kworker/u16:3+flush-8:021:04:005
2339082992523,2cyclictest2536920-21kworker/u16:3+events_unbound21:21:065
2339082992523,2cyclictest2448768-21kworker/u16:1+events_unbound21:43:165
2339087992422,2cyclictest2733568-21kworker/u16:0+events_unbound22:19:416
2339087992421,2cyclictest2536920-21kworker/u16:3+events_unbound21:09:126
2339087992420,3cyclictest2792131-21kworker/u16:0+flush-8:000:04:056
2339082992422,2cyclictest2391688-21kworker/u16:2+events_unbound20:29:365
2339089992321,1cyclictest2695704-21ssh21:56:327
233908999230,22cyclictest2449555-21latency_hist20:04:057
2339087992320,3cyclictest2448768-21kworker/u16:1+flush-8:021:58:306
2339082992321,2cyclictest2733986-21kworker/u16:4+flush-8:022:29:495
2339087992220,2cyclictest2877221-21kworker/u16:1+events_unbound23:31:156
2339087992220,2cyclictest2792131-21kworker/u16:0+events_unbound23:23:166
2339082992220,2cyclictest1592756-21kworker/u16:3+flush-8:019:49:015
2339089992120,0cyclictest0-21swapper/720:18:167
2339087992119,2cyclictest2624628-21kworker/u16:4+events_unbound21:31:096
2339087992119,2cyclictest2497229-21kworker/u16:0+flush-8:020:54:006
2339087992119,2cyclictest2391688-21kworker/u16:2+events_unbound20:14:196
2339087992118,3cyclictest2733986-21kworker/u16:4+flush-8:022:25:046
2339082992119,2cyclictest2998006-21kworker/u16:2+events_unbound00:26:165
2339082992119,2cyclictest2792131-21kworker/u16:0+events_unbound23:46:125
2339082992119,2cyclictest2411083-21kworker/u16:0+flush-8:019:54:245
2339089992019,0cyclictest0-21swapper/720:54:417
233908999200,18cyclictest2348626-21latency_hist19:14:057
2339087992018,2cyclictest3052636-21kworker/u16:1+events_unbound00:29:086
2339087992018,2cyclictest3028325-21kworker/u16:3+events_unbound00:20:596
2339087992017,3cyclictest2536920-21kworker/u16:3+flush-8:021:14:366
2339087991917,2cyclictest2877221-21kworker/u16:1+events_unbound23:51:566
2339087991917,2cyclictest2792131-21kworker/u16:0+events_unbound00:36:476
2339087991917,2cyclictest2546980-21kworker/u16:2+flush-8:020:59:296
2339087991917,2cyclictest2546980-21kworker/u16:2+flush-8:020:59:296
2339087991916,2cyclictest2904190-21kworker/u16:3+events_unbound23:24:306
2339082991917,2cyclictest2338819-21kworker/u16:0+flush-8:019:24:495
2339087991816,2cyclictest2792131-21kworker/u16:0+events_unbound23:41:156
2339087991816,2cyclictest2792131-21kworker/u16:0+events_unbound00:11:156
2339087991816,2cyclictest2536920-21kworker/u16:3+events_unbound21:47:096
2339087991816,2cyclictest2420572-21kworker/u16:4+events_unbound19:49:186
2339082991816,2cyclictest2391688-21kworker/u16:2+events_unbound20:34:275
233908999170,15cyclictest1278-21snmpd20:27:547
2339087991715,2cyclictest2792131-21kworker/u16:0+events_unbound00:06:416
2339087991715,2cyclictest2733986-21kworker/u16:4+events_unbound23:01:446
2339087991715,2cyclictest2733986-21kworker/u16:4+events_unbound22:30:366
2339087991715,2cyclictest2448768-21kworker/u16:1+flush-8:020:44:266
2339087991715,2cyclictest1592756-21kworker/u16:3+flush-8:019:24:316
2339089991615,0cyclictest0-21swapper/720:04:127
2339089991613,2cyclictest2432007-21kthreadcore19:54:237
233908999160,14cyclictest0-21swapper/720:39:307
2339087991614,2cyclictest2792131-21kworker/u16:0+flush-8:022:39:306
2339087991614,2cyclictest2733986-21kworker/u16:4+events_unbound23:07:016
2339087991614,2cyclictest2391688-21kworker/u16:2+flush-8:020:34:266
2339087991614,2cyclictest1592756-21kworker/u16:3+flush-8:019:24:006
2339087991614,2cyclictest1592756-21kworker/u16:3+events_unbound19:29:206
2339082991614,2cyclictest1592756-21kworker/u16:3+events_unbound20:19:365
233908999150,14cyclictest1278-21snmpd19:22:027
2339087991513,2cyclictest2646122-21kworker/u16:2+flush-8:022:04:516
2339087991513,2cyclictest2646122-21kworker/u16:2+events_unbound22:34:176
2339087991513,2cyclictest2546980-21kworker/u16:2+events_unbound21:21:046
2339082991513,2cyclictest1592756-21kworker/u16:3+flush-8:020:04:295
2339082991513,2cyclictest1592756-21kworker/u16:3+events_unbound19:29:285
233907199150,1cyclictest0-21swapper/423:17:214
233907199150,1cyclictest0-21swapper/421:40:334
233907199150,14cyclictest0-21swapper/419:19:344
233908999148,5cyclictest6341-21gvfs-afc-volume19:29:227
233908999148,5cyclictest2536916-21latency_hist20:49:057
2339089991411,2cyclictest1278-21snmpd19:42:357
233908999140,12cyclictest0-21swapper/720:34:287
2339087991413,1cyclictest0-21swapper/622:49:556
2339087991412,2cyclictest2998006-21kworker/u16:2+events_unbound00:25:356
233908799140,14cyclictest0-21swapper/620:24:336
2339082991412,2cyclictest1592976-21kworker/u16:4+flush-8:019:14:325
2339071991413,1cyclictest631rcuc/422:50:434
2339071991413,1cyclictest2712748-21kthreadcore22:04:234
2339071991413,1cyclictest0-21swapper/423:01:264
2339071991413,1cyclictest0-21swapper/422:38:444
2339071991413,1cyclictest0-21swapper/422:14:254
2339071991413,1cyclictest0-21swapper/422:14:254
2339071991413,1cyclictest0-21swapper/421:28:344
2339071991413,1cyclictest0-21swapper/421:15:014
233907199140,1cyclictest0-21swapper/423:44:294
233907199140,1cyclictest0-21swapper/423:37:044
233907199140,14cyclictest65-21ksoftirqd/419:14:344
233907199140,14cyclictest631rcuc/420:04:234
233907199140,14cyclictest0-21swapper/423:09:294
233908999139,3cyclictest1278-21snmpd19:44:247
2339089991312,0cyclictest0-21swapper/720:33:487
2339089991312,0cyclictest0-21swapper/719:14:147
233908799139,3cyclictest2353628-21cat19:14:206
233908799139,3cyclictest2338819-21kworker/u16:0+flush-8:019:09:316
2339087991311,2cyclictest2646122-21kworker/u16:2+events_unbound22:45:156
2339087991310,2cyclictest2546980-21kworker/u16:2+events_unbound21:04:276
2339087991310,2cyclictest2546980-21kworker/u16:2+events_unbound20:54:236
2339071991312,1cyclictest0-21swapper/423:43:414
2339071991312,1cyclictest0-21swapper/423:30:274
2339071991312,1cyclictest0-21swapper/421:45:554
2339071991312,1cyclictest0-21swapper/421:19:074
2339071991312,1cyclictest0-21swapper/400:09:044
2339071991310,2cyclictest2470403-21irqcore20:14:214
233907199130,0cyclictest0-21swapper/400:00:524
233908999129,2cyclictest1278-21snmpd21:04:407
2339089991211,0cyclictest0-21swapper/720:49:327
233908999120,10cyclictest1278-21snmpd20:11:067
233908999120,10cyclictest1278-21snmpd20:11:067
233908799121,3cyclictest2394430-21cut19:34:236
2339087991211,1cyclictest0-21swapper/619:46:146
2339087991210,2cyclictest2448768-21kworker/u16:1+events_unbound20:11:166
2339087991210,2cyclictest2448768-21kworker/u16:1+events_unbound20:11:166
233908799120,1cyclictest0-21swapper/620:23:086
2339082991210,2cyclictest2391688-21kworker/u16:2+events_unbound19:40:415
2339071991211,1cyclictest0-21swapper/423:26:304
2339071991211,1cyclictest0-21swapper/423:22:344
2339071991211,1cyclictest0-21swapper/423:04:074
2339071991211,1cyclictest0-21swapper/419:09:414
2339071991211,1cyclictest0-21swapper/400:11:454
2339071991210,1cyclictest2556911-21cpuspeed_turbos20:59:164
2339071991210,1cyclictest2556911-21cpuspeed_turbos20:59:164
233907199120,12cyclictest0-21swapper/420:48:514
233908999117,3cyclictest1278-21snmpd21:00:317
233908999117,3cyclictest1278-21snmpd21:00:317
233908999116,4cyclictest6341-21gvfs-afc-volume19:49:277
233908999116,4cyclictest6083-21gmain19:34:287
233908799119,2cyclictest2733986-21kworker/u16:4+flush-8:023:09:156
233908799119,2cyclictest2448768-21kworker/u16:1+events_unbound22:03:486
233908799110,11cyclictest0-21swapper/620:33:236
233908799110,11cyclictest0-21swapper/619:39:476
233908299119,2cyclictest2448768-21kworker/u16:1+events_unbound20:54:335
233908299119,2cyclictest2338819-21kworker/u16:0+events_unbound19:34:335
2339082991110,1cyclictest0-21swapper/520:15:555
2339082991110,1cyclictest0-21swapper/519:13:195
233908299110,11cyclictest0-21swapper/521:06:315
233908299110,11cyclictest0-21swapper/519:21:315
233907199119,1cyclictest0-21swapper/422:39:234
233907199111,4cyclictest2771126-21/usr/sbin/munin22:29:184
233907199111,3cyclictest2500009-21cut20:29:224
2339071991110,1cyclictest65-21ksoftirqd/420:10:324
2339071991110,1cyclictest65-21ksoftirqd/420:10:324
2339071991110,1cyclictest0-21swapper/423:55:314
2339071991110,1cyclictest0-21swapper/423:51:344
2339071991110,1cyclictest0-21swapper/422:45:214
2339071991110,1cyclictest0-21swapper/421:29:504
2339071991110,1cyclictest0-21swapper/421:04:284
2339071991110,1cyclictest0-21swapper/420:28:214
2339071991110,1cyclictest0-21swapper/419:25:554
233907199110,1cyclictest65-21ksoftirqd/420:41:264
233907199110,1cyclictest0-21swapper/420:20:564
233907199110,11cyclictest631rcuc/422:12:454
233907199110,0cyclictest0-21swapper/419:47:034
233908799100,3cyclictest2452017-21kthreadcore20:04:236
233908299109,1cyclictest0-21swapper/520:49:585
233908299109,1cyclictest0-21swapper/520:39:345
233908299108,2cyclictest2448768-21kworker/u16:1+flush-8:020:09:355
233908299108,2cyclictest2448768-21kworker/u16:1+flush-8:020:09:355
233908299108,2cyclictest2391688-21kworker/u16:2+events_unbound20:24:175
233908299107,3cyclictest2391688-21kworker/u16:2+events_unbound20:44:215
233907199109,1cyclictest2733986-21kworker/u16:4-events_unbound22:25:024
233907199109,1cyclictest2411083-21kworker/u16:0-events_unbound19:54:344
233907199109,1cyclictest0-21swapper/422:58:454
233907199109,1cyclictest0-21swapper/422:58:454
233907199109,1cyclictest0-21swapper/422:19:254
233907199109,1cyclictest0-21swapper/421:59:304
233907199109,1cyclictest0-21swapper/421:52:424
233907199109,1cyclictest0-21swapper/421:34:284
233907199109,1cyclictest0-21swapper/421:34:284
233907199109,1cyclictest0-21swapper/419:49:274
233907199109,1cyclictest0-21swapper/400:14:304
233907199108,1cyclictest0-21swapper/421:54:264
233907199108,1cyclictest0-21swapper/420:54:254
233907199107,1cyclictest201rcu_preempt00:29:274
233907199105,4cyclictest3029426-21tune2fs00:19:214
233907199105,4cyclictest2576941-21cat21:09:214
233907199102,7cyclictest0-21swapper/419:34:204
233907199101,2cyclictest2539150-21grep20:49:224
233907199100,3cyclictest65-21ksoftirqd/400:24:314
23390879998,1cyclictest0-21swapper/619:59:016
23390879996,2cyclictest0-21swapper/619:59:246
23390719998,1cyclictest0-21swapper/419:59:214
23390719998,1cyclictest0-21swapper/419:39:284
23390719998,1cyclictest0-21swapper/419:29:184
23390719998,1cyclictest0-21swapper/400:34:194
23390719994,4cyclictest2508910-21cat20:34:204
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional