You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 15:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Jan 12, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13127219513,127sleep213137-21systemd-run07:09:192
13127219513,127sleep213137-21systemd-run07:09:192
13250991054,45cyclictest1971-21ps10:24:511
12203210512,65sleep112210-21memory07:04:501
12203210512,65sleep112210-21memory07:04:501
13250991023,45cyclictest5337-21fschecks_time11:25:111
1325099993,32cyclictest352-21runrttasks09:46:541
1315229913,49sleep00-21swapper/007:09:210
1315229913,49sleep00-21swapper/007:09:210
1325099984,32cyclictest10926-21/usr/sbin/munin08:39:521
1325099983,41cyclictest4536-21fschecks_count10:29:391
1325099983,41cyclictest4536-21fschecks_count10:29:391
1324099973,75cyclictest18621-21apt-get09:59:300
1325099964,41cyclictest13378-21unixbench_multi09:49:541
1325099964,41cyclictest13378-21unixbench_multi09:49:541
1325099945,38cyclictest15730-21sh09:54:411
1325099944,37cyclictest2939-21interrupts08:14:401
13240998956,26cyclictest12086-21ssh12:31:330
13240998945,11cyclictest0-21swapper/009:49:380
13240998945,11cyclictest0-21swapper/009:49:380
13250998753,11cyclictest181rcu_preempt08:49:311
13240998766,15cyclictest16639-21ssh10:49:430
13240998766,15cyclictest16639-21ssh10:49:430
13258998559,19cyclictest19884-21processes10:54:492
13258998529,11cyclictest0-21swapper/210:39:302
13250998561,18cyclictest6216-21ssh12:21:521
13250998560,19cyclictest32249-21sh09:28:501
13250998559,18cyclictest28532-21latency_hist07:54:211
13258998461,17cyclictest4098-21apt-key08:19:202
13250998456,20cyclictest7236-21timerandwakeup09:39:541
13250998456,20cyclictest7236-21timerandwakeup09:39:541
13250998363,14cyclictest7787-21sh10:34:451
1325099834,50cyclictest11071-21fschecks_count11:34:381
13250998264,11cyclictest7744-21cpu08:29:341
13240998233,16cyclictest3828-21ssh09:34:450
13240998223,36cyclictest0-21swapper/011:04:530
13250998165,9cyclictest0-21swapper/107:14:311
13250998165,9cyclictest0-21swapper/107:14:311
13240998127,12cyclictest0-21swapper/008:54:520
13240998127,12cyclictest0-21swapper/008:54:520
13258998053,20cyclictest30063-21latency_hist07:59:202
13258998051,21cyclictest19921-21sh11:49:342
13258998051,21cyclictest19921-21sh11:49:342
13250998061,14cyclictest20369-21diskmemload09:29:551
13250998061,14cyclictest20369-21diskmemload09:29:551
1324099803,38cyclictest32268-21latency08:04:440
1324099803,38cyclictest18527-21gpgv09:59:220
1324099800,26cyclictest0-21swapper/011:29:290
1324099800,26cyclictest0-21swapper/011:29:290
13250997943,15cyclictest181rcu_preempt08:59:201
13258997857,11cyclictest0-21swapper/212:29:522
13258997854,15cyclictest30461-21fschecks_time07:59:392
13258997854,15cyclictest30461-21fschecks_time07:59:392
13250997851,17cyclictest16280-21latency_hist12:39:201
13250997851,17cyclictest16280-21latency_hist12:39:201
1325099783,41cyclictest20979-21ssh09:09:391
13240997832,36cyclictest1-21systemd10:59:180
13258997753,12cyclictest0-21swapper/207:34:542
13258997744,21cyclictest0-21swapper/208:29:402
13250997756,15cyclictest17124-21sendmail08:59:171
13258997657,13cyclictest28655-21timerandwakeup10:14:532
13258997642,12cyclictest181rcu_preempt12:02:482
1325899763,33cyclictest11099-21fschecks_count11:34:382
1325899762,41cyclictest4724-21apt-config11:24:212
13250997651,11cyclictest58-21kcompactd011:54:301
13240997656,12cyclictest3955-21latency_hist08:19:220
13240997626,29cyclictest0-21swapper/012:37:500
13240997626,29cyclictest0-21swapper/012:37:500
1324099760,45cyclictest27666-21ssh12:01:540
13258997554,15cyclictest21974-21latency_hist07:34:202
13258997552,14cyclictest15022-21apt-key07:14:212
13258997551,17cyclictest30384-21sh11:13:022
13258997544,22cyclictest15616-21sh09:54:402
13240997556,11cyclictest2020-21ssh10:24:510
13240997554,15cyclictest15933-21fschecks_count07:15:080
13240997554,15cyclictest15933-21fschecks_count07:15:080
13240997553,16cyclictest8214-21switchtime12:24:510
13240997527,34cyclictest0-21swapper/012:08:190
13258997445,22cyclictest11670-21switchtime08:39:542
13250997454,13cyclictest15286-21kworker/u17:0-xprtiod09:17:181
13250997451,17cyclictest25603-21kernelversion11:04:421
1324099743,37cyclictest8195-21wc10:34:540
1324099740,38cyclictest20369-21diskmemload12:14:190
119332748,35sleep30-21swapper/307:04:433
119332748,35sleep30-21swapper/307:04:433
13258997356,11cyclictest300-21rs:main2
13258997349,14cyclictest0-21swapper/212:19:502
13250997359,10cyclictest13230-21cyclictest12:29:441
13250997351,16cyclictest13230-21cyclictest08:34:411
13250997339,11cyclictest0-21swapper/110:14:451
13250997335,11cyclictest181rcu_preempt11:44:191
13240997337,29cyclictest30169-21ssh10:18:340
1324099733,40cyclictest29968-21fschecks_count09:24:380
13240997331,14cyclictest0-21swapper/007:54:170
13258997244,14cyclictest0-21swapper/208:29:212
13250997246,8cyclictest181rcu_preempt10:04:321
13250997234,12cyclictest181rcu_preempt11:10:321
1325099723,31cyclictest26459-21ntp_states11:59:481
1325099722,43cyclictest19428-21fschecks_count10:54:381
13250997215,14cyclictest181rcu_preempt10:04:221
13240997255,11cyclictest3696-21ssh12:18:140
13240997255,11cyclictest3696-21ssh12:18:140
13240997252,14cyclictest7355-21ssh09:39:550
13240997252,14cyclictest7355-21ssh09:39:550
1324099724,46cyclictest1551-21latency_hist11:19:200
13240997229,19cyclictest29055-21ssh09:23:170
13240997229,19cyclictest29055-21ssh09:23:170
1325899715,29cyclictest22417-21/usr/sbin/munin10:59:382
13258997150,12cyclictest0-21swapper/207:19:182
13258997150,12cyclictest0-21swapper/207:19:182
1325899713,48cyclictest4991-21ssh11:24:372
1325899713,41cyclictest12314-21/usr/sbin/munin09:49:442
1325899713,41cyclictest12314-21/usr/sbin/munin09:49:442
1325899712,30cyclictest9882-21wc08:34:482
13250997155,10cyclictest4915-21kernelversion08:20:421
13250997148,17cyclictest7963-21ntp_kernel_pll_12:24:441
13250997147,7cyclictest181rcu_preempt10:45:401
1325099713,29cyclictest27744-21unixbench_multi09:19:541
1325099713,29cyclictest27744-21unixbench_multi09:19:541
13250997118,36cyclictest25514-21mailstats10:09:521
13250997118,36cyclictest25514-21mailstats10:09:521
13240997152,13cyclictest31698-21latency_hist08:04:200
13240997152,13cyclictest31698-21latency_hist08:04:200
13240997151,14cyclictest22930-21sh10:59:510
13240997149,11cyclictest0-21swapper/009:49:170
1324099714,50cyclictest30753-21/usr/sbin/munin10:19:500
1324099713,33cyclictest25499-21modprobe11:59:160
13240997131,35cyclictest0-21swapper/009:14:010
1324099711,30cyclictest30259-21seq11:12:400
13258997048,13cyclictest31475-21fschecks_time11:14:392
13258997048,12cyclictest0-21swapper/207:24:172
13258997048,12cyclictest0-21swapper/207:24:172
13258997047,12cyclictest20369-21diskmemload12:24:402
13258997045,15cyclictest0-21swapper/208:54:192
1325899703,34cyclictest982-21apt10:24:162
13258997030,23cyclictest39-21ksoftirqd/211:31:352
13258997030,23cyclictest39-21ksoftirqd/211:31:352
13250997046,14cyclictest0-21swapper/110:19:541
1325099704,25cyclictest3275-21/usr/sbin/munin09:34:511
1324099704,51cyclictest2840-21vmstat11:19:560
1324099704,49cyclictest21806-21apt-get10:04:330
13240997042,17cyclictest0-21swapper/007:44:210
13240997034,29cyclictest0-21swapper/008:34:420
13240997033,8cyclictest0-21swapper/007:29:390
13258996952,11cyclictest200-21systemd-journal10:33:552
13258996952,11cyclictest200-21systemd-journal10:33:552
1325899694,39cyclictest18620-21apt09:59:492
13250996953,10cyclictest277-21dbus-daemon11:54:181
13250996953,10cyclictest277-21dbus-daemon11:54:181
13250996950,13cyclictest18897-21idleruntime-cro10:54:171
13250996950,13cyclictest18897-21idleruntime-cro10:54:171
13250996947,12cyclictest0-21swapper/112:09:521
13250996934,28cyclictest8817-21kworker/u18:1+nfsiod10:43:091
1324099692,49cyclictest14486-21ssh11:39:470
13258996846,12cyclictest0-21swapper/210:34:552
13258996841,16cyclictest0-21swapper/209:09:532
13258996821,11cyclictest381ktimers/208:14:172
13250996847,13cyclictest29019-21kworker/u17:0-events_unbound07:09:451
13250996842,18cyclictest18738-21modprobe09:04:171
13250996836,24cyclictest0-21swapper/112:04:331
13250996834,12cyclictest181rcu_preempt08:09:201
1325099683,32cyclictest31130-21unixbench_multi07:59:541
1325099683,32cyclictest31130-21unixbench_multi07:59:541
13250996833,13cyclictest24023-21tune2fs07:39:391
1324099685,32cyclictest19820-21/usr/sbin/munin11:49:550
1324099685,32cyclictest19820-21/usr/sbin/munin11:49:550
13240996847,13cyclictest20369-21diskmemload12:20:240
13240996847,10cyclictest19000-21cpuspeed07:24:340
13240996847,10cyclictest19000-21cpuspeed07:24:340
13240996833,28cyclictest29242-21kworker/u17:1+xprtiod10:48:380
1324099683,31cyclictest352-21runrttasks11:38:460
13240996819,36cyclictest12936-21latency_hist10:44:170
13258996748,11cyclictest32455-21diskmemload09:29:172
1325899674,47cyclictest2387-21grep10:24:552
13258996744,12cyclictest0-21swapper/207:49:382
13258996740,19cyclictest11949-21sh09:49:062
1325899673,44cyclictest352-21runrttasks09:32:192
1325899673,44cyclictest352-21runrttasks09:32:192
13250996749,13cyclictest58-21kcompactd012:16:241
13250996749,13cyclictest58-21kcompactd012:16:241
13250996746,15cyclictest8817-21timerwakeupswit11:29:541
13250996746,15cyclictest8817-21timerwakeupswit11:29:541
13250996731,13cyclictest181rcu_preempt07:34:201
13250996723,22cyclictest1634-21sort11:19:211
1324099675,30cyclictest0-21swapper/010:29:550
1324099675,30cyclictest0-21swapper/010:29:550
13240996751,10cyclictest5861-21systemd-run08:24:190
13240996736,24cyclictest10945-21apt-get08:39:300
1324099673,54cyclictest4923-21/usr/sbin/munin11:25:150
1325899666,34cyclictest21273-21apt-get10:04:332
13258996648,14cyclictest22269-21kworker/u17:3+events_unbound11:59:172
13258996646,13cyclictest24121-21sh09:14:452
1325899664,41cyclictest6450-21cstates09:39:342
1325899664,41cyclictest6450-21cstates09:39:342
13258996642,18cyclictest15945-21fschecks_count08:54:392
13258996642,18cyclictest15945-21fschecks_count08:54:392
13250996651,10cyclictest13230-21cyclictest11:20:211
1325099663,43cyclictest28971-21cut07:54:421
13240996639,21cyclictest23674-21rm09:14:260
13240996637,22cyclictest15224-21kworker/u17:1+xprtiod11:45:220
13240996632,24cyclictest0-21swapper/009:30:530
13240996632,24cyclictest0-21swapper/009:30:530
1324099662,42cyclictest7632-21latency_hist08:29:210
1324099661,28cyclictest25397-21/usr/sbin/munin10:09:480
1324099661,28cyclictest25397-21/usr/sbin/munin10:09:480
1325899653,44cyclictest4481-21apt-get08:19:332
1325899652,43cyclictest25123-21latency_hist07:44:202
1325899652,35cyclictest39-21ksoftirqd/209:22:262
1325899652,35cyclictest39-21ksoftirqd/209:22:262
13250996550,9cyclictest18536-21runrttasks11:46:321
13250996546,14cyclictest544-21cron08:29:171
13250996527,11cyclictest181rcu_preempt08:44:311
13240996541,18cyclictest26320-21unixbench_singl07:44:550
1324099653,30cyclictest30089-21latency_hist07:59:210
1325899649,17cyclictest13272-21runrttasks10:44:312
1325899648,26cyclictest39-21ksoftirqd/212:07:092
13258996446,13cyclictest25875-21sh10:09:562
13258996446,13cyclictest25875-21sh10:09:562
13258996441,15cyclictest526-21sh12:10:052
13258996439,17cyclictest0-21swapper/209:09:172
13258996439,17cyclictest0-21swapper/209:09:172
13258996436,20cyclictest25439-21fschecks_count11:04:382
1325899643,30cyclictest17606-21fschecks_count08:59:382
1325099644,41cyclictest19270-21fschecks_time09:04:391
1325099644,41cyclictest19270-21fschecks_time09:04:391
1325099644,38cyclictest352-21runrttasks07:20:261
1325099644,38cyclictest352-21runrttasks07:20:261
13250996435,12cyclictest181rcu_preempt08:09:531
1325099643,38cyclictest20406-21ls07:29:201
1325099643,38cyclictest20406-21ls07:29:201
1324099642,42cyclictest352-21runrttasks07:38:320
13240996417,18cyclictest0-21swapper/009:04:260
13240996417,18cyclictest0-21swapper/009:04:260
1324099641,25cyclictest14721-21/usr/sbin/munin08:49:490
13258996346,11cyclictest16054-21ssh11:42:582
13258996340,16cyclictest6493-21kworker/u17:0+events_unbound12:39:172
13258996340,16cyclictest6493-21kworker/u17:0+events_unbound12:39:172
13258996339,13cyclictest0-21swapper/211:44:532
1325899633,41cyclictest3936-21ssh09:34:492
1325099633,41cyclictest23684-21sort07:39:211
1325099633,40cyclictest25605-21fschecks_count07:44:401
13240996327,26cyclictest0-21swapper/008:45:320
13258996239,12cyclictest0-21swapper/208:04:542
1325899622,27cyclictest39-21ksoftirqd/212:14:402
1325899622,27cyclictest39-21ksoftirqd/212:14:402
1325899622,25cyclictest39-21ksoftirqd/210:49:222
1325899622,25cyclictest39-21ksoftirqd/210:49:222
13250996247,11cyclictest13230-21cyclictest11:00:221
13240996242,10cyclictest0-21swapper/007:24:200
13240996242,10cyclictest0-21swapper/007:24:200
13240996235,21cyclictest2486-21latency_hist08:14:200
1324099622,42cyclictest18299-21tail08:59:530
1325899612,30cyclictest39-21ksoftirqd/207:45:502
1324099613,40cyclictest14935-21cat07:14:200
1324099612,42cyclictest7759-21cpuspeed08:29:350
1326499603,38cyclictest30682-21chrt10:19:213
1325899602,30cyclictest19331-21latency07:24:422
1325899602,30cyclictest19331-21latency07:24:422
1326499594,37cyclictest4374-21chrt08:19:223
1326499593,39cyclictest31234-21chrt12:08:333
1326499592,44cyclictest8694-21taskset12:25:273
13264995922,15cyclictest0-21swapper/311:24:303
1326499574,38cyclictest32267-21taskset08:04:443
1326499573,39cyclictest28255-21chrt12:03:343
1326499573,37cyclictest9223-21chrt11:30:383
1326499573,37cyclictest9223-21chrt11:30:383
1326499573,37cyclictest917-21kworker/3:1+events09:39:413
1326499573,37cyclictest917-21kworker/3:1+events09:39:413
1326499572,40cyclictest8214-21taskset08:29:463
1326499572,38cyclictest18219-21taskset10:52:253
1326499572,38cyclictest18219-21taskset10:52:253
1326499564,36cyclictest31795-21chrt12:09:263
1326499563,38cyclictest31928-21chrt11:14:503
1326499563,36cyclictest5971-21taskset10:31:333
1326499563,36cyclictest5971-21taskset10:31:333
1326499563,36cyclictest24028-21taskset09:14:433
1326499563,34cyclictest23142-21taskset11:54:383
1326499562,40cyclictest20541-21taskset07:29:283
1326499554,34cyclictest23277-21chrt10:59:553
1326499553,40cyclictest2518-21taskset12:14:573
1326499553,40cyclictest2518-21taskset12:14:573
1326499553,39cyclictest12718-21taskset12:33:223
1326499553,34cyclictest22473-21taskset09:11:473
1326499553,33cyclictest11801-21taskset08:39:553
1326499544,22cyclictest0-21swapper/309:59:453
1326499543,37cyclictest19123-21chrt09:04:333
1326499543,37cyclictest19123-21chrt09:04:333
1326499543,36cyclictest14321-21taskset10:44:553
1326499543,35cyclictest2747-21chrt10:25:543
1326499543,35cyclictest14771-21taskset07:14:173
1326499543,34cyclictest917-21kworker/3:1+events11:49:283
1326499543,34cyclictest917-21kworker/3:1+events11:49:283
1326499543,34cyclictest14575-21chrt12:35:083
1326499543,34cyclictest14575-21chrt12:35:083
1326499543,33cyclictest9422-21taskset08:34:323
1326499543,33cyclictest31566-21chrt09:26:553
1326499542,39cyclictest11208-21taskset09:47:023
1326499533,35cyclictest22160-21chrt10:05:023
1326499533,34cyclictest12459-21chrt09:49:333
1326499533,34cyclictest12459-21chrt09:49:333
1326499533,33cyclictest4375-21chrt12:19:233
1326499532,37cyclictest18697-21taskset07:24:183
1326499532,37cyclictest18697-21taskset07:24:183
1326499532,34cyclictest25562-21chrt10:09:523
1326499532,34cyclictest25562-21chrt10:09:523
1326499532,29cyclictest15637-21taskset09:54:403
1326499526,31cyclictest16039-21chrt11:42:553
1326499523,35cyclictest27727-21chrt09:19:543
1326499523,35cyclictest27727-21chrt09:19:543
1326499523,35cyclictest12891-21chrt08:44:413
1326499523,33cyclictest22795-21chrt07:34:513
1326499523,32cyclictest18758-21chrt09:04:173
1326499523,31cyclictest25756-21chrt11:04:453
1326499522,33cyclictest28477-21taskset11:09:393
1326499522,32cyclictest2401-21chrt08:14:193
1326499513,36cyclictest24569-21taskset07:39:533
1326499512,37cyclictest4518-21chrt11:24:193
1326499512,35cyclictest14431-21chrt08:49:393
1326499512,31cyclictest7319-21taskset10:34:333
1326499503,34cyclictest4792-21chrt09:35:593
1326499502,35cyclictest2698-21chrt09:33:323
1326499502,35cyclictest2698-21chrt09:33:323
1326499502,34cyclictest6594-21taskset08:24:443
1326499502,34cyclictest27943-21chrt07:49:533
1326499493,32cyclictest29313-21chrt07:54:513
1326499493,31cyclictest12798-21chrt11:37:193
1326499492,32cyclictest17788-21chrt11:44:533
1326499482,32cyclictest15540-21chrt07:14:303
1326499482,32cyclictest15540-21chrt07:14:303
1326499482,31cyclictest20587-21chrt10:55:413
1326499473,31cyclictest31350-21chrt10:19:453
1326499473,29cyclictest30728-21chrt07:59:453
1326499473,29cyclictest30728-21chrt07:59:453
1326499463,32cyclictest19294-21chrt07:24:423
1326499463,32cyclictest19294-21chrt07:24:423
1326499462,30cyclictest12056-21chrt10:41:513
1326499462,29cyclictest5285-21taskset08:20:513
1326499452,30cyclictest16595-21chrt08:54:543
1326499452,30cyclictest16595-21chrt08:54:543
1326499403,26cyclictest25362-21taskset07:44:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional