You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 15:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 11, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
76821257,19sleep00-21swapper/006:58:230
76821257,19sleep00-21swapper/006:58:230
9879912411,97cyclictest2767-21apt-get11:29:570
32526211811,75sleep132532-21/usr/sbin/munin06:54:571
32526211811,75sleep132532-21/usr/sbin/munin06:54:571
9879911732,12cyclictest0-21swapper/011:55:230
9879911732,12cyclictest0-21swapper/011:55:230
987991166,43cyclictest22720-21apt-get11:09:340
9879911513,26cyclictest24409-21sh10:19:170
987991128,86cyclictest28988-21apt-get11:19:420
987991128,86cyclictest28988-21apt-get11:19:420
9879910935,44cyclictest13511-21apt-get10:54:360
987991073,49cyclictest18772-21kworker/u18:4+ext4-rsv-conversion10:09:580
987991073,49cyclictest18772-21kworker/u18:4+ext4-rsv-conversion10:09:580
2913821050,7sleep20-21swapper/210:25:502
9879910071,20cyclictest6362-21latency_hist09:49:210
82321006,72sleep20-21swapper/206:59:062
82321006,72sleep20-21swapper/206:59:062
1005991009,57cyclictest0-21swapper/311:19:373
1005991009,57cyclictest0-21swapper/311:19:373
98799996,41cyclictest19589-21apt-get07:54:320
997999851,8cyclictest181rcu_preempt10:00:022
100599988,79cyclictest0-21swapper/311:54:513
100599988,79cyclictest0-21swapper/311:54:513
987999664,15cyclictest181rcu_preempt09:34:310
997999374,13cyclictest352-21runrttasks09:49:212
99799923,61cyclictest18722-21apt-get10:09:332
99799923,61cyclictest18722-21apt-get10:09:332
997998957,7cyclictest181rcu_preempt09:01:502
997998957,7cyclictest181rcu_preempt09:01:502
987998959,21cyclictest28260-21latency_hist08:19:210
997998853,7cyclictest181rcu_preempt08:04:482
98799885,44cyclictest3456-21apt-get07:04:330
992998749,12cyclictest181rcu_preempt10:10:281
992998749,12cyclictest181rcu_preempt10:10:281
987998746,31cyclictest0-21swapper/012:09:500
997998655,9cyclictest181rcu_preempt08:49:212
997998642,9cyclictest0-21swapper/207:34:212
992998664,15cyclictest13215-21latency_hist10:54:211
99299862,48cyclictest31-21ksoftirqd/108:46:581
987998669,9cyclictest15-21ksoftirqd/008:34:200
987998664,14cyclictest15-21ksoftirqd/010:04:210
997998544,12cyclictest181rcu_preempt08:19:542
99799853,57cyclictest13511-21apt-get10:54:342
992998512,38cyclictest31-21ksoftirqd/112:05:451
992998512,38cyclictest31-21ksoftirqd/112:05:451
987998558,17cyclictest3953-21latency_hist08:44:210
997998436,13cyclictest181rcu_preempt10:19:432
997998436,13cyclictest181rcu_preempt10:19:432
997998367,9cyclictest14613-21apt-key07:39:212
997998362,8cyclictest181rcu_preempt12:19:212
99299838,44cyclictest31-21ksoftirqd/112:01:191
992998363,14cyclictest14272-21processes10:55:041
992998348,8cyclictest181rcu_preempt08:22:161
99299834,40cyclictest31-21ksoftirqd/108:56:101
99299832,35cyclictest31-21ksoftirqd/109:40:421
99299832,35cyclictest31-21ksoftirqd/109:40:421
3211128317,38sleep30-21swapper/306:54:393
3211128317,38sleep30-21swapper/306:54:393
997998267,9cyclictest31091-21ssh11:22:432
997998267,9cyclictest31091-21ssh11:22:432
997998258,8cyclictest181rcu_preempt08:14:532
997998247,10cyclictest22877-21ssh10:15:042
997998240,12cyclictest32576-21sh10:32:012
99799823,50cyclictest20092-21apt-get07:54:322
992998248,10cyclictest7570-21users09:49:571
992998248,10cyclictest7570-21users09:49:571
99299822,38cyclictest31-21ksoftirqd/109:33:511
987998255,18cyclictest8613-21diskmemload11:44:320
992998138,16cyclictest181rcu_preempt09:06:541
992998138,16cyclictest181rcu_preempt09:06:541
992998136,12cyclictest181rcu_preempt09:26:041
992998136,12cyclictest181rcu_preempt09:26:041
987998155,16cyclictest6594-21latency_hist07:14:200
987998155,16cyclictest6594-21latency_hist07:14:200
98799813,32cyclictest8613-21diskmemload10:44:540
997998058,8cyclictest181rcu_preempt12:22:382
997998055,9cyclictest181rcu_preempt11:26:032
992998060,14cyclictest8613-21diskmemload10:19:201
992998035,12cyclictest181rcu_preempt08:54:211
987998060,14cyclictest7272-21cpu08:54:340
987998040,10cyclictest181rcu_preempt10:04:330
997997962,11cyclictest5507-21ssh11:34:202
997997960,13cyclictest6917-21cat09:49:442
997997960,13cyclictest6917-21cat09:49:442
997997948,7cyclictest181rcu_preempt12:01:102
997997936,12cyclictest30954-21sh09:34:542
997997924,27cyclictest39-21ksoftirqd/207:09:382
997997924,27cyclictest39-21ksoftirqd/207:09:382
992997945,10cyclictest17001-21ssh11:53:261
992997945,10cyclictest17001-21ssh11:53:261
99299792,32cyclictest31-21ksoftirqd/111:01:501
987997959,14cyclictest9943-21unixbench_multi08:59:540
987997959,14cyclictest9943-21unixbench_multi08:59:540
987997957,14cyclictest25364-21ssh10:19:490
987997957,14cyclictest25364-21ssh10:19:490
1005997947,21cyclictest0-21swapper/308:04:453
997997844,8cyclictest0-21swapper/211:14:492
997997844,8cyclictest0-21swapper/211:14:492
997997843,12cyclictest17343-21ssh11:54:182
997997843,12cyclictest17343-21ssh11:54:182
99799783,57cyclictest22162-21apt-get11:09:342
997997835,11cyclictest181rcu_preempt09:04:312
997997835,11cyclictest181rcu_preempt09:04:312
99799782,56cyclictest2516-21apt-get07:04:332
99299788,47cyclictest31-21ksoftirqd/107:35:281
99299787,56cyclictest31-21ksoftirqd/111:20:351
99299787,56cyclictest31-21ksoftirqd/111:20:351
992997856,16cyclictest4476-21sh09:44:541
99299782,28cyclictest31-21ksoftirqd/111:41:101
99299782,28cyclictest31-21ksoftirqd/111:41:101
987997851,18cyclictest7079-21latency_hist08:54:200
987997850,21cyclictest1564-21sh10:34:390
98799783,43cyclictest17644-21apt-config11:54:210
98799783,43cyclictest17644-21apt-config11:54:210
98799783,38cyclictest352-21runrttasks12:27:350
987997833,28cyclictest10892-21ssh10:49:480
98799782,20cyclictest26695-21grep08:14:210
997997763,10cyclictest2842-21kworker/u17:0-xprtiod09:55:292
997997754,8cyclictest181rcu_preempt09:11:142
997997745,11cyclictest181rcu_preempt12:14:342
99299779,42cyclictest31-21ksoftirqd/107:17:271
99299779,42cyclictest31-21ksoftirqd/107:17:271
992997747,9cyclictest181rcu_preempt09:14:391
992997747,9cyclictest181rcu_preempt09:14:391
987997728,13cyclictest23329-21latency_hist08:04:210
98799772,63cyclictest23547-21apt-get08:04:310
987997712,42cyclictest6034-21fschecks_time11:34:390
997997653,17cyclictest978-21cyclictest10:42:412
997997644,10cyclictest181rcu_preempt09:24:152
992997653,18cyclictest6913-21sh10:44:171
992997645,22cyclictest12344-21grep07:29:541
99299762,38cyclictest31-21ksoftirqd/112:10:141
987997663,9cyclictest58-21kcompactd008:21:540
987997647,9cyclictest181rcu_preempt09:24:340
987997647,9cyclictest181rcu_preempt09:24:340
98799762,22cyclictest499-21fschecks_count12:19:380
1005997619,36cyclictest0-21swapper/307:40:013
997997555,14cyclictest17977-21sendmail07:49:172
997997555,14cyclictest17977-21sendmail07:49:172
997997554,13cyclictest0-21swapper/210:09:222
997997530,12cyclictest181rcu_preempt09:27:502
997997530,12cyclictest181rcu_preempt09:27:502
99299759,44cyclictest31-21ksoftirqd/112:15:531
99299759,44cyclictest31-21ksoftirqd/112:15:531
992997559,10cyclictest30902-21cstates10:29:371
992997556,12cyclictest18621-21latency_hist10:09:221
992997555,14cyclictest8613-21diskmemload11:44:421
987997556,13cyclictest20143-21rm11:04:500
987997551,9cyclictest15-21ksoftirqd/009:39:360
987997551,9cyclictest15-21ksoftirqd/009:39:360
997997458,11cyclictest58-21kcompactd012:08:222
997997458,11cyclictest58-21kcompactd012:08:222
997997458,10cyclictest27132-21idleruntime12:09:412
997997453,9cyclictest181rcu_preempt08:34:332
997997443,9cyclictest0-21swapper/209:31:082
997997440,8cyclictest181rcu_preempt07:59:522
997997411,25cyclictest39-21ksoftirqd/211:34:272
99299746,41cyclictest31-21ksoftirqd/111:09:041
992997455,12cyclictest978-21cyclictest09:10:401
992997435,11cyclictest181rcu_preempt09:55:371
987997455,7cyclictest181rcu_preempt09:10:550
987997433,12cyclictest978-21cyclictest10:41:490
98799743,28cyclictest12249-21ssh09:04:400
98799743,28cyclictest12249-21ssh09:04:400
987997428,7cyclictest181rcu_preempt09:18:120
987997428,7cyclictest181rcu_preempt09:18:120
997997356,12cyclictest18422-21fschecks_count07:49:392
997997356,12cyclictest18422-21fschecks_count07:49:392
997997340,8cyclictest181rcu_preempt08:49:482
997997338,19cyclictest29083-21kworker/u17:0-xprtiod11:39:332
997997338,19cyclictest29083-21kworker/u17:0-xprtiod11:39:332
997997337,17cyclictest8287-21/usr/sbin/munin07:19:362
99299733,34cyclictest31-21ksoftirqd/107:44:321
99299733,34cyclictest31-21ksoftirqd/107:44:321
99299732,40cyclictest31-21ksoftirqd/111:13:521
99299732,35cyclictest31-21ksoftirqd/112:26:091
992997312,28cyclictest31-21ksoftirqd/109:36:451
992997312,24cyclictest31-21ksoftirqd/111:14:451
992997312,24cyclictest31-21ksoftirqd/111:14:451
987997326,26cyclictest15-21ksoftirqd/007:34:210
100599734,33cyclictest3849-21chrt09:44:413
997997236,17cyclictest181rcu_preempt11:55:362
997997236,17cyclictest181rcu_preempt11:55:362
997997231,10cyclictest181rcu_preempt08:54:562
997997213,32cyclictest39-21ksoftirqd/211:49:122
992997253,13cyclictest277-21dbus-daemon07:04:191
992997253,13cyclictest277-21dbus-daemon07:04:191
99299722,48cyclictest31-21ksoftirqd/111:57:561
99299722,48cyclictest31-21ksoftirqd/111:57:561
99299722,30cyclictest31-21ksoftirqd/112:22:511
992997221,42cyclictest31-21ksoftirqd/108:34:261
992997221,23cyclictest31-21ksoftirqd/108:39:301
992997214,47cyclictest31-21ksoftirqd/111:36:001
987997252,14cyclictest15-21ksoftirqd/008:34:420
98799724,36cyclictest32336-21idleruntime11:24:430
987997239,10cyclictest181rcu_preempt11:59:410
997997140,7cyclictest181rcu_preempt09:42:472
997997140,7cyclictest181rcu_preempt09:42:472
997997140,11cyclictest181rcu_preempt11:00:592
997997115,25cyclictest39-21ksoftirqd/210:49:352
997997113,50cyclictest381ktimers/210:35:402
997997112,33cyclictest39-21ksoftirqd/207:44:212
99299717,30cyclictest31-21ksoftirqd/111:32:521
99299715,40cyclictest31-21ksoftirqd/109:22:491
992997143,9cyclictest181rcu_preempt10:37:571
992997139,7cyclictest181rcu_preempt11:27:271
992997134,10cyclictest181rcu_preempt07:49:311
992997134,10cyclictest181rcu_preempt07:49:311
992997110,26cyclictest31-21ksoftirqd/107:29:201
987997147,17cyclictest277-21dbus-daemon07:54:200
987997147,17cyclictest277-21dbus-daemon07:54:200
987997146,12cyclictest978-21cyclictest09:24:060
987997135,21cyclictest25731-21ssh12:07:170
987997135,21cyclictest25731-21ssh12:07:170
98799712,36cyclictest10330-21timerandwakeup09:54:520
1005997115,34cyclictest0-21swapper/311:09:383
99799702,19cyclictest39-21ksoftirqd/207:24:402
997997014,27cyclictest19919-21ssh11:04:432
992997052,11cyclictest6112-21kworker/u17:2-rpciod10:29:181
992997036,15cyclictest181rcu_preempt08:26:381
992997036,15cyclictest181rcu_preempt08:26:381
992997032,8cyclictest181rcu_preempt07:59:321
987997053,12cyclictest0-21swapper/007:14:420
987997053,12cyclictest0-21swapper/007:14:420
98799703,57cyclictest2374-21systemd-journal09:50:170
98799703,57cyclictest2374-21systemd-journal09:50:170
98799703,34cyclictest30725-21sort12:14:540
98799703,34cyclictest30725-21sort12:14:540
325552703,6sleep00-21swapper/010:31:570
100599703,26cyclictest5658-21chrt08:49:323
997996949,14cyclictest8613-21diskmemload09:19:182
997996949,14cyclictest8613-21diskmemload09:19:182
997996942,10cyclictest181rcu_preempt08:09:302
997996938,8cyclictest181rcu_preempt10:45:102
992996954,9cyclictest3542-21cpuspeed07:04:531
99299694,39cyclictest31-21ksoftirqd/108:05:221
992996936,16cyclictest181rcu_preempt08:32:491
992996936,10cyclictest181rcu_preempt10:24:201
992996936,10cyclictest181rcu_preempt10:24:201
99299692,31cyclictest31-21ksoftirqd/107:42:581
992996915,37cyclictest31-21ksoftirqd/110:02:541
987996947,15cyclictest11352-21idleruntime-cro11:44:170
987996947,15cyclictest11352-21idleruntime-cro11:44:170
987996946,15cyclictest0-21swapper/007:24:530
98799694,27cyclictest13351-21fschecks_count07:34:390
987996940,20cyclictest2634-21apt-key07:04:200
987996940,20cyclictest2634-21apt-key07:04:200
987996938,10cyclictest181rcu_preempt11:16:430
987996938,10cyclictest181rcu_preempt11:16:430
98799693,54cyclictest16800-21fschecks_count07:44:390
98799693,54cyclictest16800-21fschecks_count07:44:390
98799693,34cyclictest28719-21unixbench_multi10:24:540
1005996917,43cyclictest0-21swapper/310:54:393
997996852,10cyclictest29991-21/usr/sbin/munin08:24:382
997996852,10cyclictest29991-21/usr/sbin/munin08:24:382
997996839,9cyclictest181rcu_preempt08:39:322
997996835,10cyclictest181rcu_preempt12:24:342
992996830,8cyclictest181rcu_preempt07:55:091
99299682,27cyclictest31-21ksoftirqd/107:11:111
99299682,27cyclictest31-21ksoftirqd/107:11:111
992996811,40cyclictest31-21ksoftirqd/107:19:591
987996851,11cyclictest2374-21systemd-journal08:49:180
987996845,17cyclictest19160-21idleruntime-cro11:04:170
987996845,15cyclictest15-21ksoftirqd/009:29:430
100599683,30cyclictest5699-21chrt12:28:483
997996746,8cyclictest181rcu_preempt08:34:212
997996737,10cyclictest181rcu_preempt07:04:182
997996737,10cyclictest181rcu_preempt07:04:182
992996744,17cyclictest26807-21cpu08:14:331
992996713,26cyclictest31-21ksoftirqd/109:00:051
992996713,26cyclictest31-21ksoftirqd/109:00:051
987996737,8cyclictest181rcu_preempt07:19:340
98799673,43cyclictest4116-21kworker/u17:0+ext4-rsv-conversion07:40:200
100599679,37cyclictest0-21swapper/311:29:323
100599673,28cyclictest517-21chrt08:34:173
100599672,28cyclictest12982-21chrt11:45:323
997996626,11cyclictest181rcu_preempt07:17:062
997996626,11cyclictest181rcu_preempt07:17:062
992996636,9cyclictest181rcu_preempt10:44:471
98799663,41cyclictest29991-21/usr/sbin/munin08:24:360
98799663,41cyclictest29991-21/usr/sbin/munin08:24:360
100599662,28cyclictest1957-21chrt12:21:353
100599662,26cyclictest14428-21taskset07:38:363
100599653,32cyclictest4376-21chrt08:44:423
100599653,23cyclictest22238-21chrt07:59:463
100599653,22cyclictest18198-21chrt10:09:173
100599652,26cyclictest21911-21chrt10:14:373
100599652,24cyclictest10657-21chrt10:49:423
99299643,36cyclictest31-21ksoftirqd/108:10:451
100599643,24cyclictest1996-21chrt09:41:093
100599643,24cyclictest1996-21chrt09:41:093
100599642,30cyclictest21877-21chrt11:59:553
100599642,21cyclictest9991-21chrt07:24:343
100599642,21cyclictest1860-21chrt06:59:513
100599642,21cyclictest1860-21chrt06:59:513
100599642,19cyclictest9702-21taskset09:54:383
100599638,37cyclictest0-21swapper/310:09:553
100599638,37cyclictest0-21swapper/310:09:553
100599634,25cyclictest8880-21taskset11:39:363
100599634,25cyclictest8880-21taskset11:39:363
100599633,23cyclictest23819-21taskset12:04:333
100599633,23cyclictest23819-21taskset12:04:333
100599633,23cyclictest12651-21chrt09:59:373
100599633,22cyclictest19548-21chrt09:16:193
100599633,22cyclictest19548-21chrt09:16:193
100599633,20cyclictest2948-21chrt08:39:483
100599632,27cyclictest4835-21chrt10:39:463
100599632,25cyclictest7548-21taskset10:44:403
100599632,24cyclictest11177-21taskset09:03:053
100599632,24cyclictest11177-21taskset09:03:053
100599632,23cyclictest31342-21chrt10:29:493
100599632,23cyclictest14891-21taskset09:09:223
100599632,22cyclictest8654-21chrt09:52:563
100599632,22cyclictest8654-21chrt09:52:563
100599632,21cyclictest27133-21taskset08:14:413
100599632,21cyclictest14854-21chrt11:49:373
100599632,21cyclictest14854-21chrt11:49:373
100599623,24cyclictest27600-21taskset09:29:503
100599623,22cyclictest15171-21chrt09:09:383
100599623,21cyclictest26646-21chrt10:22:153
100599623,21cyclictest26646-21chrt10:22:153
100599623,21cyclictest25294-21chrt09:25:403
100599623,21cyclictest25294-21chrt09:25:403
100599623,20cyclictest20882-21chrt09:19:233
100599622,26cyclictest17869-21chrt11:00:413
100599622,21cyclictest29071-21chrt12:13:163
100599622,20cyclictest32266-21chrt12:18:553
100599622,20cyclictest32266-21chrt12:18:553
100599614,20cyclictest31082-21chrt08:25:593
100599614,20cyclictest31082-21chrt08:25:593
100599613,35cyclictest201002sleep307:54:323
100599612,22cyclictest32615-21taskset09:39:183
100599612,21cyclictest26273-21chrt08:11:043
100599612,21cyclictest17793-21taskset07:47:273
100599612,21cyclictest17793-21taskset07:47:273
100599603,21cyclictest29899-21chrt10:27:583
100599603,20cyclictest7087-21chrt11:35:393
100599603,20cyclictest12911-21chrt07:34:183
100599602,22cyclictest20961-21chrt11:06:003
100599602,21cyclictest1331-21chrt08:34:463
100599602,20cyclictest27091-21chrt11:15:323
100599602,20cyclictest27091-21chrt11:15:323
100599602,20cyclictest13481-21chrt09:06:103
100599602,19cyclictest7737-21chrt07:15:313
100599602,19cyclictest7737-21chrt07:15:313
100599602,19cyclictest4629-21chrt07:07:133
100599594,18cyclictest29432-21chrt08:20:243
100599592,21cyclictest1239-21chrt10:34:273
100599592,20cyclictest6398-21chrt07:14:013
100599592,20cyclictest6398-21chrt07:14:013
100599592,19cyclictest9354-21chrt07:20:373
100599584,19cyclictest1854-21chrt11:28:213
100599582,18cyclictest7295-21chrt08:54:353
100599582,18cyclictest19271-21chrt07:50:183
100599582,18cyclictest19271-21chrt07:50:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional