You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 03:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Mar 23, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177406827348,7sleep50-21swapper/519:02:175
177405625847,8sleep40-21swapper/419:02:084
1774435994843,4cyclictest2199938-21latency_hist22:23:167
1774435994338,4cyclictest2139662-21latency_hist21:58:167
1774421994240,2cyclictest2417278-21kworker/u16:4+events_unbound23:58:284
177443599400,38cyclictest1797196-21systemd-run19:13:177
17649342393,30sleep70-21swapper/718:58:187
1774426993836,2cyclictest2320896-21kworker/u16:1+events_unbound23:28:435
1774421993836,2cyclictest1883083-21kworker/u16:1+events_unbound20:18:344
24762392370,0chrt2476241-21ssh00:16:387
1774421993634,2cyclictest2126493-21kworker/u16:2+events_unbound21:53:314
1774421993634,2cyclictest1783900-21kworker/u16:4+events_unbound19:18:314
177443599350,33cyclictest5747-21gnome-shell23:15:267
1774435993431,1cyclictest1835329-21latency_hist19:33:167
1774421993331,2cyclictest2417229-21kworker/u16:3+events_unbound00:13:384
1774421993331,2cyclictest2076610-21kworker/u16:4+events_unbound21:38:404
1774421993331,2cyclictest1062586-21kworker/u16:2+events_unbound19:28:314
177411423323,7sleep60-21swapper/619:02:586
1774430993230,2cyclictest2163823-21kworker/u16:0+flush-8:022:24:226
1774421993230,2cyclictest2320896-21kworker/u16:1+events_unbound23:43:424
1774435993131,0cyclictest0-21swapper/721:08:137
1774426993128,2cyclictest1883083-21kworker/u16:1+events_unbound20:08:305
1774421993028,2cyclictest2016047-21kworker/u16:1+events_unbound21:08:444
1774435992928,0cyclictest0-21swapper/721:13:277
1774435992927,1cyclictest2306836-21ssh23:05:187
1774435992925,3cyclictest2392468-21ssh23:42:467
1774435992924,4cyclictest2007258-21latency_hist21:03:167
177443599290,28cyclictest2270254-21ssh22:49:307
1774426992927,2cyclictest2417229-21kworker/u16:3+events_unbound00:08:415
1774426992927,2cyclictest1806755-21kworker/u16:0+flush-8:019:33:325
1774421992927,2cyclictest2163823-21kworker/u16:0+events_unbound23:03:294
1774426992826,2cyclictest2417278-21kworker/u16:4+events_unbound00:28:355
1774426992826,2cyclictest2417278-21kworker/u16:4+events_unbound00:28:355
1774426992826,2cyclictest2076610-21kworker/u16:4+events_unbound22:18:325
1774426992826,2cyclictest1774187-21kworker/u16:3+events_unbound19:08:215
1774421992826,2cyclictest2320896-21kworker/u16:1+events_unbound00:03:444
1774421992826,2cyclictest1883083-21kworker/u16:1+events_unbound20:28:384
1774435992726,0cyclictest0-21swapper/722:54:297
1774435992725,1cyclictest0-21swapper/719:18:427
1774435992722,3cyclictest2092822-21ssh21:38:327
1774421992725,2cyclictest2281946-21kworker/u16:2+events_unbound23:23:334
1774435992626,0cyclictest0-21swapper/723:50:177
1774435992626,0cyclictest0-21swapper/723:50:177
1774435992626,0cyclictest0-21swapper/723:18:497
1774435992624,1cyclictest2150112-21ssh22:00:237
177443599260,25cyclictest5747-21gnome-shell22:11:267
1774426992624,2cyclictest2126493-21kworker/u16:2+events_unbound22:03:315
1774426992624,2cyclictest1987000-21kworker/u16:0+events_unbound20:48:445
1774426992624,2cyclictest1950097-21kworker/u16:3+events_unbound21:13:435
1774426992624,2cyclictest1806755-21kworker/u16:0+events_unbound19:38:315
1774426992624,2cyclictest1783900-21kworker/u16:4+events_unbound20:13:355
1774435992523,1cyclictest0-21swapper/721:33:217
1774435992522,2cyclictest1267-21snmpd00:24:417
1774426992523,2cyclictest2281946-21kworker/u16:2+events_unbound23:13:395
1774426992523,2cyclictest2076610-21kworker/u16:4+events_unbound22:43:455
1774426992523,2cyclictest1062586-21kworker/u16:2+flush-8:019:58:325
1774421992523,2cyclictest2031353-21kworker/u16:0+events_unbound21:18:284
1774421992523,2cyclictest1883083-21kworker/u16:1+events_unbound20:18:114
1774421992523,2cyclictest1806755-21kworker/u16:0+events_unbound19:53:314
1774435992424,0cyclictest0-21swapper/722:27:357
1774435992424,0cyclictest0-21swapper/700:30:377
1774435992424,0cyclictest0-21swapper/700:30:377
1774435992423,0cyclictest0-21swapper/719:33:427
177443599240,23cyclictest2426800-21ssh23:54:277
1774426992422,2cyclictest1062586-21kworker/u16:2+events_unbound19:53:395
1774421992422,2cyclictest2091548-21kworker/u16:0+events_unbound21:46:544
1774435992323,0cyclictest0-21swapper/722:04:397
1774435992323,0cyclictest0-21swapper/721:47:397
1774435992323,0cyclictest0-21swapper/721:21:597
1774435992323,0cyclictest0-21swapper/700:00:467
1774435992321,1cyclictest2065335-21diskmemload21:24:267
177443599230,22cyclictest2078162-21ssh21:30:577
1774430992321,2cyclictest2417278-21kworker/u16:4+events_unbound00:18:456
1774430992321,2cyclictest1921311-21kworker/u16:2+flush-8:021:23:426
1774426992321,2cyclictest2163823-21kworker/u16:0+events_unbound22:28:555
1774426992321,2cyclictest2076610-21kworker/u16:4+flush-8:022:38:465
1774426992321,2cyclictest1950097-21kworker/u16:3+events_unbound21:48:405
1774426992321,2cyclictest1950097-21kworker/u16:3+events_unbound21:48:405
1774421992321,2cyclictest1883083-21kworker/u16:1+events_unbound19:58:444
1774435992222,0cyclictest0-21swapper/721:50:027
1774435992222,0cyclictest0-21swapper/721:50:027
1774435992221,0cyclictest0-21swapper/723:43:507
1774435992220,1cyclictest2380687-21idleruntime-cro23:38:167
177443599220,20cyclictest1921272-21latency_hist20:18:167
1774426992220,2cyclictest2281946-21kworker/u16:2+flush-8:023:48:315
1774426992220,2cyclictest2281946-21kworker/u16:2+flush-8:023:48:315
1774426992220,2cyclictest1921311-21kworker/u16:2+events_unbound20:43:435
1774426992220,2cyclictest1806755-21kworker/u16:0+events_unbound20:28:305
1774421992220,2cyclictest2320896-21kworker/u16:1+events_unbound23:40:024
1774421992220,2cyclictest2281946-21kworker/u16:2+events_unbound23:12:134
1774421992220,2cyclictest2281946-21kworker/u16:2+events_unbound23:12:134
1774421992220,2cyclictest2076610-21kworker/u16:4+events_unbound23:16:074
1774421992220,2cyclictest1950097-21kworker/u16:3+events_unbound22:32:544
1774435992121,0cyclictest0-21swapper/723:10:497
1774435992121,0cyclictest0-21swapper/723:10:497
1774435992121,0cyclictest0-21swapper/722:30:237
1774435992121,0cyclictest0-21swapper/700:11:147
1774435992120,1cyclictest0-21swapper/721:11:227
1774435992116,4cyclictest2489195-21latency_hist00:23:167
1774426992119,2cyclictest2320896-21kworker/u16:1+flush-8:000:24:495
1774426992119,2cyclictest2126493-21kworker/u16:2+events_unbound22:08:325
1774426992119,2cyclictest2076610-21kworker/u16:4+events_unbound22:18:125
1774426992119,2cyclictest1921311-21kworker/u16:2+events_unbound21:23:315
1774426992119,2cyclictest1062586-21kworker/u16:2+flush-8:019:23:465
1774426992119,2cyclictest1062586-21kworker/u16:2+events_unbound19:18:425
1774421992119,2cyclictest2417229-21kworker/u16:3+events_unbound00:21:374
1774421992119,2cyclictest2281946-21kworker/u16:2+flush-8:023:33:534
1774421992119,2cyclictest2126493-21kworker/u16:2+events_unbound21:58:364
1774421992119,2cyclictest1950097-21kworker/u16:3+events_unbound22:06:414
1774435992019,1cyclictest2453050-21ssh00:08:147
1774435992018,1cyclictest2234871-21ssh22:36:037
1774426992018,2cyclictest1987000-21kworker/u16:0+flush-8:020:53:325
1774426992018,2cyclictest1921311-21kworker/u16:2+events_unbound20:33:295
1774421992018,2cyclictest2417229-21kworker/u16:3+events_unbound00:23:384
1774421992018,2cyclictest2233143-21kworker/u16:5+events_unbound22:52:504
1774421992018,2cyclictest2126493-21kworker/u16:2+events_unbound22:12:034
1774421992018,2cyclictest2076610-21kworker/u16:4+events_unbound22:59:544
1774421992018,2cyclictest2076610-21kworker/u16:4+events_unbound22:20:454
1774421992018,2cyclictest1950097-21kworker/u16:3+events_unbound21:16:024
1774421992018,2cyclictest1062586-21kworker/u16:2+events_unbound19:13:454
1774421992017,2cyclictest2163823-21kworker/u16:0+events_unbound22:33:194
1774435991918,0cyclictest0-21swapper/720:23:327
1774426991917,2cyclictest2417278-21kworker/u16:4+flush-8:000:03:585
1774426991917,2cyclictest2369054-21kworker/u16:0+events_unbound23:35:015
1774426991917,2cyclictest2163823-21kworker/u16:0+flush-8:022:23:325
1774426991917,2cyclictest2091548-21kworker/u16:0+events_unbound21:42:215
1774426991917,2cyclictest2016047-21kworker/u16:1+events_unbound21:08:385
1774421991917,2cyclictest2417229-21kworker/u16:3+events_unbound00:10:464
1774421991917,2cyclictest2076610-21kworker/u16:4+events_unbound22:54:024
1774421991917,2cyclictest1950097-21kworker/u16:3+events_unbound21:26:024
1774421991917,2cyclictest1062586-21kworker/u16:2+events_unbound19:43:354
1774435991818,0cyclictest0-21swapper/722:42:057
1774435991816,1cyclictest2367093-21ssh23:30:277
177443599180,17cyclictest2354199-21sh23:23:547
177443599180,17cyclictest1930896-21cat20:23:167
1774426991816,2cyclictest2417278-21kworker/u16:4+flush-8:023:58:365
1774426991816,2cyclictest2076610-21kworker/u16:4+flush-8:022:53:435
1774426991816,2cyclictest2076239-21kworker/u16:1+events_unbound21:33:455
1774426991816,2cyclictest1062586-21kworker/u16:2+flush-8:019:29:125
1774426991815,2cyclictest2320896-21kworker/u16:1+events_unbound23:38:265
1774421991816,2cyclictest2320896-21kworker/u16:1+events_unbound23:19:194
1774421991816,2cyclictest2281946-21kworker/u16:2+events_unbound23:30:254
1774421991816,2cyclictest2076610-21kworker/u16:4+events_unbound22:27:394
1774421991816,2cyclictest1950097-21kworker/u16:3+events_unbound21:07:594
177443599170,15cyclictest1988132-21latency_hist20:53:177
1774426991715,2cyclictest2163823-21kworker/u16:0+events_unbound22:58:515
1774426991715,2cyclictest1883083-21kworker/u16:1+flush-8:020:18:475
1774426991715,2cyclictest1806755-21kworker/u16:0+events_unbound20:23:395
1774426991714,2cyclictest2163823-21kworker/u16:0+events_unbound23:08:345
1774426991714,2cyclictest2163823-21kworker/u16:0+events_unbound23:08:345
1774421991715,2cyclictest2076610-21kworker/u16:4+events_unbound22:42:384
1774421991715,2cyclictest2076610-21kworker/u16:4+events_unbound21:51:224
1774421991715,2cyclictest2076610-21kworker/u16:4+events_unbound21:51:224
1774421991715,2cyclictest2076610-21kworker/u16:4+events_unbound21:36:154
1774421991715,2cyclictest2076610-21kworker/u16:4+events_unbound21:31:164
1774421991715,2cyclictest1806755-21kworker/u16:0+events_unbound19:48:344
1774435991616,0cyclictest0-21swapper/719:05:277
177443099168,3cyclictest2418099-21cat23:53:326
1774426991614,2cyclictest2320896-21kworker/u16:1+events_unbound23:23:585
1774426991614,2cyclictest2233143-21kworker/u16:5+events_unbound22:37:275
1774426991614,2cyclictest1806755-21kworker/u16:0+flush-8:020:03:445
1774426991614,2cyclictest1806755-21kworker/u16:0+flush-8:019:48:395
1774426991613,2cyclictest2417229-21kworker/u16:3+flush-8:000:13:215
1774421991614,2cyclictest2417229-21kworker/u16:3+events_unbound00:30:034
1774421991614,2cyclictest2417229-21kworker/u16:3+events_unbound00:30:034
1774421991614,2cyclictest2320896-21kworker/u16:1+events_unbound23:53:584
1774421991614,2cyclictest2281946-21kworker/u16:2+events_unbound23:49:424
1774421991614,2cyclictest2281946-21kworker/u16:2+events_unbound23:49:424
1774421991614,2cyclictest1987000-21kworker/u16:0+events_unbound20:57:594
1774421991614,2cyclictest1883083-21kworker/u16:1+events_unbound20:40:264
1774435991513,1cyclictest2294557-21ssh22:59:467
1774435991512,2cyclictest0-21swapper/720:38:427
177443599150,14cyclictest2007259-21diskmemload22:13:417
1774426991513,2cyclictest2417229-21kworker/u16:3+events_unbound00:18:575
1774426991513,2cyclictest2076610-21kworker/u16:4+events_unbound21:32:035
1774426991513,2cyclictest1745689-21kworker/u16:1+events_unbound19:03:415
1774421991513,2cyclictest2233143-21kworker/u16:5+events_unbound22:47:064
1774421991513,2cyclictest1987000-21kworker/u16:0+events_unbound20:59:274
1774421991513,2cyclictest1950097-21kworker/u16:3+events_unbound20:35:384
1774421991513,2cyclictest1806755-21kworker/u16:0+events_unbound19:43:144
1774421991513,2cyclictest1062586-21kworker/u16:2+events_unbound19:24:284
1774421991512,2cyclictest2076610-21kworker/u16:4+events_unbound22:13:234
177443599147,6cyclictest0-21swapper/722:43:357
1774435991413,0cyclictest0-21swapper/720:08:297
177443599140,13cyclictest5747-21gnome-shell20:33:267
177443599140,13cyclictest1802851-21grep19:13:387
1774430991411,2cyclictest2404784-21kworker/u16:0+flush-8:023:48:226
1774430991411,2cyclictest2404784-21kworker/u16:0+flush-8:023:48:226
1774430991411,2cyclictest2281946-21kworker/u16:2+flush-8:023:43:206
1774430991411,2cyclictest1950097-21kworker/u16:3+flush-8:020:33:426
177443099140,1cyclictest0-21swapper/622:57:246
177443099140,1cyclictest0-21swapper/621:03:306
177443099140,13cyclictest0-21swapper/623:58:246
1774426991413,1cyclictest0-21swapper/522:48:365
1774426991412,2cyclictest2281946-21kworker/u16:2+events_unbound23:45:165
1774426991412,2cyclictest2126493-21kworker/u16:2+events_unbound22:02:345
1774426991412,2cyclictest2076610-21kworker/u16:4+events_unbound23:03:445
1774426991412,2cyclictest1950097-21kworker/u16:3+events_unbound21:45:035
177442699140,13cyclictest0-21swapper/521:03:275
1774421991412,2cyclictest1883083-21kworker/u16:1+events_unbound20:45:154
177442199140,14cyclictest0-21swapper/420:53:174
177443599134,8cyclictest5944-21gmain19:43:427
177443099139,3cyclictest1931977-21cat20:23:326
1774430991312,1cyclictest0-21swapper/623:30:496
1774430991312,1cyclictest0-21swapper/623:14:066
1774430991312,1cyclictest0-21swapper/622:44:386
1774430991311,2cyclictest1950097-21kworker/u16:3+flush-8:021:13:426
1774430991311,2cyclictest1774187-21kworker/u16:3+events_unbound19:03:346
177443099130,1cyclictest0-21swapper/622:06:476
177443099130,13cyclictest0-21swapper/619:08:396
177443099130,12cyclictest0-21swapper/621:43:276
1774426991311,2cyclictest2076610-21kworker/u16:4+flush-8:021:54:265
1774426991311,2cyclictest1921311-21kworker/u16:2+events_unbound21:20:185
177442699130,0cyclictest0-21swapper/523:19:025
1774421991311,2cyclictest1774187-21kworker/u16:3+events_unbound19:04:284
1774421991311,2cyclictest1062586-21kworker/u16:2+events_unbound20:06:394
1774421991311,2cyclictest1062586-21kworker/u16:2+events_unbound19:12:394
177443599129,2cyclictest1267-21snmpd19:27:267
177443599129,2cyclictest0-21swapper/720:33:167
177443599128,3cyclictest96-21ksoftirqd/720:03:307
177443599128,3cyclictest1267-21snmpd20:58:017
177443599128,3cyclictest1267-21snmpd19:53:477
177443599125,6cyclictest6344-21gmain19:58:457
1774435991212,0cyclictest0-21swapper/719:48:437
177443599120,11cyclictest0-21swapper/720:43:377
177443099128,3cyclictest1846054-21cat19:38:326
1774430991211,1cyclictest0-21swapper/623:39:106
1774430991211,1cyclictest0-21swapper/622:42:356
1774430991211,1cyclictest0-21swapper/622:08:506
1774430991211,1cyclictest0-21swapper/600:15:366
177443099120,1cyclictest0-21swapper/622:15:186
177443099120,1cyclictest0-21swapper/619:59:056
177443099120,12cyclictest0-21swapper/621:10:216
177443099120,0cyclictest0-21swapper/600:04:526
1774426991210,2cyclictest2320896-21kworker/u16:1+events_unbound23:56:385
1774426991210,2cyclictest1062586-21kworker/u16:2+events_unbound19:43:435
177442199123,3cyclictest201rcu_preempt20:08:354
1774421991210,2cyclictest1883083-21kworker/u16:1+events_unbound20:27:384
177443599117,3cyclictest6184-21gvfs-afc-volume19:38:377
1774430991110,1cyclictest0-21swapper/623:37:086
1774430991110,1cyclictest0-21swapper/623:05:456
1774430991110,1cyclictest0-21swapper/621:49:466
1774430991110,1cyclictest0-21swapper/621:49:466
1774430991110,1cyclictest0-21swapper/621:20:366
1774430991110,1cyclictest0-21swapper/621:01:506
1774430991110,1cyclictest0-21swapper/620:11:526
1774430991110,1cyclictest0-21swapper/620:07:366
1774430991110,1cyclictest0-21swapper/600:24:066
177443099110,11cyclictest0-21swapper/620:57:256
177443099110,11cyclictest0-21swapper/620:16:076
177443099110,11cyclictest0-21swapper/619:21:066
177442699119,2cyclictest1062586-21kworker/u16:2+events_unbound19:17:595
177442699110,11cyclictest0-21swapper/520:59:025
177443099109,1cyclictest0-21swapper/623:24:316
177443099109,1cyclictest0-21swapper/619:56:446
177443099106,3cyclictest2285699-21cat22:58:326
177443099100,5cyclictest0-21swapper/621:58:316
177442199108,1cyclictest1835848-21cpuspeed_turbos19:33:294
17744309998,1cyclictest0-21swapper/623:22:286
17744309998,1cyclictest0-21swapper/623:12:046
17744309998,1cyclictest0-21swapper/623:12:046
17744309998,1cyclictest0-21swapper/622:53:086
17744309998,1cyclictest0-21swapper/622:36:166
17744309998,1cyclictest0-21swapper/622:21:376
17744309998,1cyclictest0-21swapper/621:39:126
17744309998,1cyclictest0-21swapper/621:33:036
17744309998,1cyclictest0-21swapper/620:29:036
17744309998,1cyclictest0-21swapper/619:49:286
17744309998,1cyclictest0-21swapper/619:30:336
17744309998,1cyclictest0-21swapper/619:13:326
17744309998,1cyclictest0-21swapper/600:32:476
17744309998,1cyclictest0-21swapper/600:32:476
17744309994,4cyclictest2080736-21cat21:33:326
17744269997,2cyclictest1950097-21kworker/u16:3+events_unbound20:39:235
17744309987,1cyclictest0-21swapper/620:20:226
17744309983,4cyclictest2462214-21switchtime00:08:436
17744309983,4cyclictest2212996-21grep22:28:296
17744309983,4cyclictest1970317-21sed20:43:346
17744309975,1cyclictest0-21swapper/620:48:316
17744309975,1cyclictest0-21swapper/619:43:316
17744309974,2cyclictest2128826-21gltestperf21:53:316
17744309973,3cyclictest1959881-21cat20:38:286
17744309972,4cyclictest1837513-21kthreadcore19:33:346
17744309972,4cyclictest1818716-21cut19:23:346
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional