You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 16:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Sat Sep 12, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2556821307,15sleep00-21swapper/007:08:040
2556821307,15sleep00-21swapper/007:08:040
25827991153,81cyclictest26884-21apt-get10:44:390
258379910944,10cyclictest0-21swapper/209:49:372
258279910769,20cyclictest0-21swapper/009:29:530
258379910646,13cyclictest1-21systemd11:40:412
258379910639,12cyclictest0-21swapper/211:29:242
24511210611,67sleep124512-21diskstats07:04:471
24511210611,67sleep124512-21diskstats07:04:471
258379910342,13cyclictest0-21swapper/210:19:252
258379910027,26cyclictest5620-21timerwakeupswit11:54:582
258379910027,26cyclictest5620-21timerwakeupswit11:54:582
2583799999,73cyclictest27045-21ssh10:44:592
25837999678,12cyclictest8129-21latency_hist10:14:222
245132948,56sleep224562-21fschecks_count07:04:482
245132948,56sleep224562-21fschecks_count07:04:482
2583099937,55cyclictest6181-21kworker/u19:0+ext4-rsv-conversion11:59:391
25827999173,12cyclictest317-21dbus-daemon10:19:210
25827999060,20cyclictest6232-21ssh11:04:220
25827999060,20cyclictest6232-21ssh11:04:220
2583799892,67cyclictest1576-21kworker/u17:1+ext4-rsv-conversion11:50:482
2583799892,67cyclictest1576-21kworker/u17:1+ext4-rsv-conversion11:50:482
25830998922,30cyclictest343-21runrttasks11:18:091
25830998922,30cyclictest343-21runrttasks11:18:091
25830998912,39cyclictest0-21swapper/109:26:471
25830998912,39cyclictest0-21swapper/109:26:471
25827998967,14cyclictest16894-21latency_hist08:19:250
25837998865,15cyclictest200-21systemd-journal12:36:412
25830998823,25cyclictest5399-21seq11:02:041
25830998823,25cyclictest5399-21seq11:02:041
25827998712,66cyclictest2484-21ssh10:04:450
189502860,20sleep018924-21sh11:24:450
25837998562,17cyclictest9158-21fschecks_count07:54:432
25837998562,17cyclictest9158-21fschecks_count07:54:432
25837998558,20cyclictest22798-21netstat09:44:492
2583099853,69cyclictest10240-21kworker/u17:0+ext4-rsv-conversion11:50:261
2583099853,69cyclictest10240-21kworker/u17:0+ext4-rsv-conversion11:50:261
25830998525,25cyclictest18211-21seq08:21:511
25830998521,31cyclictest31383-21runrttasks12:38:071
2584399848,59cyclictest0-21swapper/309:50:023
2584399844,37cyclictest0-21swapper/310:44:463
25837998453,13cyclictest181rcu_preempt10:39:352
25837998453,13cyclictest181rcu_preempt10:39:352
25837998453,12cyclictest58-21kcompactd012:19:282
25837998453,12cyclictest58-21kcompactd012:19:282
25830998423,25cyclictest392-21seq09:08:151
25827998462,8cyclictest181rcu_preempt07:39:400
25827998429,31cyclictest15-21ksoftirqd/008:54:210
25827998429,31cyclictest15-21ksoftirqd/008:54:210
25837998360,17cyclictest521-21apt-key07:29:252
25837998360,17cyclictest521-21apt-key07:29:252
25837998345,16cyclictest181rcu_preempt07:47:092
25830998322,23cyclictest27317-21seq07:14:161
25830998322,23cyclictest27317-21seq07:14:161
25830998321,29cyclictest5320-21ssh09:15:581
25830998321,24cyclictest1296-21cat11:49:251
25830998321,24cyclictest1296-21cat11:49:251
25830998320,23cyclictest0-21swapper/107:57:251
25830998320,23cyclictest0-21swapper/107:57:251
25830998319,28cyclictest0-21swapper/110:05:431
25827998364,11cyclictest6882-21sh09:19:310
25827998355,11cyclictest181rcu_preempt07:34:410
2582799834,59cyclictest1086-21apt-get11:49:370
2582799834,59cyclictest1086-21apt-get11:49:370
25827998328,30cyclictest15-21ksoftirqd/008:59:590
25837998266,11cyclictest25811-21cyclictest08:59:442
25837998246,11cyclictest181rcu_preempt11:09:572
2583799823,66cyclictest2423-21apt-get10:04:412
25830998222,30cyclictest17946-21seq09:36:451
25830998222,29cyclictest200-21systemd-journal12:29:411
25830998221,23cyclictest27779-21seq08:50:261
25830998221,23cyclictest27779-21seq08:50:261
25830998218,28cyclictest0-21swapper/110:34:531
25837998162,12cyclictest5504-21idleruntime-cro07:44:222
25837998159,16cyclictest14211-21latency_hist10:24:242
25830998159,15cyclictest506-21diskmemload12:10:381
25830998121,32cyclictest506-21diskmemload11:24:161
25830998121,29cyclictest0-21swapper/111:58:041
25830998121,29cyclictest0-21swapper/111:58:041
25830998114,31cyclictest11896-21chrt12:04:581
25830998114,31cyclictest11896-21chrt12:04:581
25837998028,16cyclictest12875-21ssh09:29:252
25837998028,16cyclictest12875-21ssh09:29:252
25830998059,12cyclictest24974-21cut09:49:221
25830998023,24cyclictest8023-21seq10:14:061
25830998023,20cyclictest29812-21seq09:55:261
25830998020,24cyclictest19841-21seq08:27:091
25830998020,24cyclictest19841-21seq08:27:091
25830998018,33cyclictest343-21runrttasks09:52:051
25830998017,25cyclictest0-21swapper/108:09:511
25830998014,30cyclictest0-21swapper/110:45:251
25830998013,33cyclictest0-21swapper/112:15:411
25827998059,14cyclictest506-21diskmemload11:23:400
25827998045,26cyclictest0-21swapper/011:14:210
2583799794,39cyclictest29404-21apt-get07:19:372
2583799792,19cyclictest29626-21kworker/2:0-mm_percpu_wq11:46:192
2583799792,19cyclictest29626-21kworker/2:0-mm_percpu_wq11:46:192
25837997921,13cyclictest0-21swapper/207:49:352
25830997961,12cyclictest19207-21ssh10:31:321
25830997954,14cyclictest27960-21kworker/u18:2+rpciod09:29:501
2583099793,40cyclictest25757-21latency_hist12:29:231
25830997924,22cyclictest9578-21seq10:15:041
25830997920,23cyclictest30197-21seq07:20:481
2582799795,38cyclictest15-21ksoftirqd/011:14:380
2582799795,38cyclictest15-21ksoftirqd/011:14:380
25827997952,8cyclictest181rcu_preempt08:54:520
25827997944,11cyclictest0-21swapper/012:14:450
25827997935,32cyclictest17251-21grep08:19:430
2582799793,38cyclictest20538-21fschecks_time08:29:460
2582799793,38cyclictest20538-21fschecks_time08:29:460
25837997852,10cyclictest21806-21kworker/u17:3-ext4-rsv-conversion09:44:262
25837997850,22cyclictest27722-21cpu07:14:302
25830997863,10cyclictest25811-21cyclictest08:39:411
25830997822,23cyclictest31220-21seq09:02:571
25830997821,25cyclictest6878-21seq07:46:361
25830997820,26cyclictest10779-21seq11:10:151
25830997820,22cyclictest0-21swapper/109:42:451
25830997819,23cyclictest21881-21seq08:34:341
25830997817,25cyclictest1574-21mailstats09:09:561
25830997812,30cyclictest0-21swapper/111:08:041
2582799785,40cyclictest15-21ksoftirqd/008:41:430
25827997851,19cyclictest15331-21latency_hist08:14:250
25827997846,9cyclictest181rcu_preempt11:47:410
25827997846,9cyclictest181rcu_preempt11:47:410
25827997843,29cyclictest1321-21latency09:09:490
25827997842,25cyclictest0-21swapper/012:31:020
2582799783,42cyclictest10938-21find12:04:320
2582799783,42cyclictest10938-21find12:04:320
25837997760,10cyclictest23621-21ssh11:32:112
25830997720,32cyclictest21472-21chrt08:32:291
25830997720,32cyclictest21472-21chrt08:32:291
25830997717,22cyclictest0-21swapper/107:50:561
25827997757,14cyclictest506-21diskmemload10:39:510
25827997757,14cyclictest506-21diskmemload10:39:510
25827997752,11cyclictest181rcu_preempt08:02:090
25837997657,11cyclictest29430-21ssh09:55:002
25837997655,15cyclictest6555-21cron09:19:232
25837997655,14cyclictest1-21systemd10:58:412
25837997614,49cyclictest14542-21ssh10:24:352
25837997614,49cyclictest14542-21ssh10:24:352
25830997638,30cyclictest18718-21ssh11:24:351
25830997622,25cyclictest31709-21ssh10:51:541
25830997621,25cyclictest8636-21seq09:21:411
2582799764,45cyclictest12619-21cron09:29:220
2582799764,45cyclictest12619-21cron09:29:220
2582799763,56cyclictest343-21runrttasks07:49:250
25837997559,10cyclictest10240-21kworker/u17:0-xprtiod10:34:152
25837997514,39cyclictest8830-21irqstats12:01:082
2583099759,35cyclictest0-21swapper/108:05:231
25830997521,25cyclictest2196-21seq07:33:401
25830997521,24cyclictest16626-21seq10:27:441
25830997521,24cyclictest16626-21seq10:27:441
25830997520,25cyclictest11766-21fschecks_count10:19:461
25830997518,20cyclictest0-21swapper/111:35:261
25830997513,28cyclictest0-21swapper/110:54:461
25827997547,20cyclictest24222-21ssh12:25:080
25827997547,11cyclictest181rcu_preempt09:34:550
25827997544,16cyclictest181rcu_preempt10:02:160
25827997544,16cyclictest181rcu_preempt10:02:160
25837997456,13cyclictest3093-21sh09:13:102
25837997456,12cyclictest16949-21latency_hist08:19:252
25830997421,25cyclictest23041-21taskset11:30:361
25830997421,23cyclictest32691-21seq07:27:201
25830997421,23cyclictest32691-21seq07:27:201
25830997421,22cyclictest5412-21seq07:43:241
25830997421,20cyclictest29649-21seq08:58:521
2582799746,40cyclictest15-21ksoftirqd/009:49:360
25827997452,8cyclictest181rcu_preempt12:21:360
25827997452,8cyclictest181rcu_preempt12:21:360
25827997449,8cyclictest181rcu_preempt10:54:430
25837997352,10cyclictest0-21swapper/209:39:242
25830997319,34cyclictest343-21runrttasks12:21:501
25830997319,34cyclictest343-21runrttasks12:21:501
25830997319,25cyclictest343-21runrttasks11:43:091
25830997318,26cyclictest0-21swapper/108:00:211
25830997317,22cyclictest0-21swapper/108:18:261
25830997316,24cyclictest0-21swapper/107:37:291
25827997357,10cyclictest317-21dbus-daemon07:19:230
25827997356,11cyclictest506-21diskmemload11:04:430
25827997344,12cyclictest181rcu_preempt10:29:100
25827997344,12cyclictest181rcu_preempt10:29:100
25827997334,9cyclictest181rcu_preempt09:55:140
25827997325,11cyclictest181rcu_preempt09:46:070
25837997248,16cyclictest506-21diskmemload10:02:482
25837997248,16cyclictest506-21diskmemload10:02:482
25837997246,17cyclictest0-21swapper/208:09:482
25837997244,13cyclictest58-21kcompactd010:36:592
25837997242,9cyclictest181rcu_preempt07:09:422
25837997242,9cyclictest181rcu_preempt07:09:422
2583799723,40cyclictest7036-21cstates09:19:402
25837997228,9cyclictest181rcu_preempt07:32:322
25837997226,14cyclictest181rcu_preempt08:19:582
25837997221,27cyclictest0-21swapper/212:24:502
25827997248,9cyclictest181rcu_preempt10:11:540
2582799724,36cyclictest15-21ksoftirqd/011:38:490
2582799724,35cyclictest17534-21/usr/sbin/munin10:29:520
25827997241,22cyclictest29959-21switchtime12:34:570
25827997236,9cyclictest181rcu_preempt08:38:110
25827997235,22cyclictest181rcu_preempt11:54:320
25827997235,22cyclictest181rcu_preempt11:54:320
2582799723,39cyclictest343-21runrttasks12:14:200
2582799723,38cyclictest10696-21latency_hist12:04:240
25843997114,46cyclictest0-21swapper/311:49:373
25843997114,46cyclictest0-21swapper/311:49:373
25837997146,7cyclictest0-21swapper/208:29:492
25837997146,7cyclictest0-21swapper/208:29:492
25837997113,30cyclictest58-21kcompactd008:44:572
25837997113,30cyclictest58-21kcompactd008:44:572
25830997121,20cyclictest1429-21seq10:03:121
25830997121,20cyclictest1429-21seq10:03:121
25830997116,22cyclictest0-21swapper/110:41:581
25830997116,22cyclictest0-21swapper/110:41:581
25827997157,10cyclictest25811-21cyclictest11:43:380
25827997146,8cyclictest181rcu_preempt09:42:590
25827997142,12cyclictest181rcu_preempt10:22:480
25827997126,13cyclictest181rcu_preempt07:21:060
25827997118,19cyclictest15-21ksoftirqd/009:18:080
25837997048,11cyclictest0-21swapper/209:30:272
25837997036,13cyclictest181rcu_preempt12:19:152
25837997033,17cyclictest181rcu_preempt11:07:402
25830997021,19cyclictest29237-21seq07:17:361
25830997018,20cyclictest0-21swapper/108:47:591
25830997018,20cyclictest0-21swapper/108:47:591
25827997042,20cyclictest32746-21latency_hist10:54:250
25837996949,12cyclictest0-21swapper/209:04:572
25837996947,16cyclictest13560-21idleruntime-cro08:09:222
25837996940,9cyclictest181rcu_preempt08:49:382
25837996940,9cyclictest181rcu_preempt08:49:382
2583799693,47cyclictest28839-21munin-run12:34:212
2583799691,12cyclictest13968-21ssh12:09:342
25827996947,8cyclictest181rcu_preempt07:11:470
25827996947,8cyclictest181rcu_preempt07:11:470
25827996941,20cyclictest8986-21cpu07:54:380
25827996941,20cyclictest8986-21cpu07:54:380
2582799693,33cyclictest15-21ksoftirqd/011:31:590
25827996931,8cyclictest181rcu_preempt09:04:480
25837996850,12cyclictest23401-21latency_hist08:39:252
25837996849,12cyclictest0-21swapper/208:44:262
25837996845,16cyclictest1-21systemd08:54:412
25837996838,9cyclictest181rcu_preempt11:39:242
2583799683,34cyclictest343-21runrttasks11:01:122
2583799683,34cyclictest343-21runrttasks11:01:122
2583799682,35cyclictest3148-21grep07:34:562
2582799676,37cyclictest15-21ksoftirqd/010:34:350
25827996730,13cyclictest181rcu_preempt08:04:440
25827996729,11cyclictest0-21swapper/007:29:340
277092660,5sleep30-21swapper/312:31:183
25827996646,14cyclictest25150-21cpu08:44:390
25827996646,14cyclictest25150-21cpu08:44:390
2583799652,30cyclictest20230-21latency_hist08:29:252
2583799652,30cyclictest20230-21latency_hist08:29:252
25827996540,11cyclictest181rcu_preempt07:54:000
2582799652,33cyclictest18675-21acpi08:24:340
2582799652,33cyclictest18675-21acpi08:24:340
2584399643,37cyclictest901-21kworker/3:1+events07:14:573
25837996440,7cyclictest181rcu_preempt11:14:582
25837996440,7cyclictest181rcu_preempt11:14:582
25837996432,12cyclictest181rcu_preempt11:19:502
25827996417,18cyclictest31781-21fschecks_time07:24:450
25827996417,18cyclictest31781-21fschecks_time07:24:450
2584399634,32cyclictest0-21swapper/310:05:103
2584399633,36cyclictest0-21swapper/311:59:373
25837996349,10cyclictest25811-21cyclictest10:50:262
25837996342,12cyclictest0-21swapper/208:04:222
2584399622,31cyclictest901-21kworker/3:1+events07:24:333
2584399622,31cyclictest901-21kworker/3:1+events07:24:333
2583799622,47cyclictest11520-21ntp_kernel_pll_12:04:502
2583799622,47cyclictest11520-21ntp_kernel_pll_12:04:502
245632627,31sleep30-21swapper/307:04:493
245632627,31sleep30-21swapper/307:04:493
2584399573,41cyclictest13302-21chrt11:14:563
2584399573,41cyclictest13302-21chrt11:14:563
2584399573,39cyclictest13036-21chrt08:04:573
25843995727,21cyclictest30681-21taskset08:59:563
2584399563,35cyclictest11182-21chrt12:04:443
2584399563,35cyclictest11182-21chrt12:04:443
2584399555,30cyclictest0-21swapper/307:29:463
2584399554,34cyclictest7225-21taskset09:19:463
2584399553,36cyclictest22082-21chrt08:34:463
2584399547,31cyclictest0-21swapper/309:29:373
2584399543,38cyclictest3552-21chrt10:59:363
2584399543,38cyclictest3552-21chrt10:59:363
2584399543,37cyclictest11342-21chrt11:11:483
2584399543,33cyclictest21850-21chrt08:34:253
2584399542,38cyclictest11219-21taskset09:25:293
2584399542,38cyclictest11219-21taskset09:25:293
2584399533,38cyclictest7280-21taskset10:12:033
2584399533,38cyclictest17712-21chrt11:22:333
2584399532,39cyclictest24066-21chrt09:46:543
2584399532,38cyclictest7879-21chrt07:49:513
2584399532,35cyclictest27481-21chrt08:49:563
2584399532,35cyclictest27481-21chrt08:49:563
2584399523,36cyclictest23838-21taskset11:32:463
2584399523,35cyclictest28614-21chrt09:54:403
2584399523,34cyclictest14577-21taskset10:24:393
2584399523,34cyclictest14577-21taskset10:24:393
2584399523,33cyclictest5055-21chrt11:54:473
2584399523,33cyclictest5055-21chrt11:54:473
2584399523,33cyclictest17485-21chrt08:19:473
2584399523,33cyclictest11321-21chrt10:19:243
2584399522,35cyclictest28367-21taskset11:39:523
2584399522,33cyclictest14437-21taskset08:09:553
2584399514,34cyclictest25023-21taskset10:40:473
2584399514,34cyclictest25023-21taskset10:40:473
2584399514,16cyclictest0-21swapper/307:20:393
2584399513,35cyclictest4496-21taskset07:39:463
2584399513,35cyclictest21239-21chrt11:28:573
2584399513,34cyclictest384-21taskset11:47:293
2584399513,34cyclictest384-21taskset11:47:293
2584399513,34cyclictest28840-21chrt08:54:503
2584399513,34cyclictest2035-21chrt10:04:253
2584399513,34cyclictest2035-21chrt10:04:253
2584399513,34cyclictest12100-21chrt10:19:533
2584399513,33cyclictest20883-21chrt09:41:263
2584399513,30cyclictest24922-21chrt12:27:043
2584399512,33cyclictest17599-21chrt10:29:413
2584399503,37cyclictest18360-21chrt09:37:543
2584399503,36cyclictest26324-21chrt07:09:493
2584399503,36cyclictest26324-21chrt07:09:493
2584399503,35cyclictest20777-21chrt10:34:443
2584399503,35cyclictest14509-21chrt12:09:503
2584399503,33cyclictest1354-21chrt10:54:583
2584399503,32cyclictest9396-21chrt11:09:253
2584399503,30cyclictest15419-21chrt08:14:333
2584399502,35cyclictest1293-21chrt09:09:493
2584399493,34cyclictest7095-21taskset07:49:223
2584399493,31cyclictest4524-21chrt09:14:553
2584399492,34cyclictest20159-21chrt12:19:393
2584399492,34cyclictest20159-21chrt12:19:393
2584399474,30cyclictest25920-21taskset08:44:583
2584399474,30cyclictest25920-21taskset08:44:583
2584399472,34cyclictest27081-21chrt11:38:223
2584399463,34cyclictest24234-21taskset08:39:563
2584399463,30cyclictest2879-21chrt07:34:483
2584399444,30cyclictest31068-21chrt10:50:083
2584399444,28cyclictest10322-21chrt07:59:223
2584399444,28cyclictest10322-21chrt07:59:223
2584399442,30cyclictest901-21kworker/3:1+events12:37:393
2584399442,26cyclictest12083-21chrt08:04:253
2584399413,30cyclictest18670-21chrt12:16:353
2584399413,26cyclictest20453-21taskset08:29:433
2584399413,25cyclictest32009-21taskset09:04:463
2584399412,24cyclictest901-21kworker/3:1+events08:24:343
2584399412,24cyclictest901-21kworker/3:1+events08:24:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional