You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 15:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat May 23, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1280521327,17sleep00-21swapper/006:57:410
1280521327,17sleep00-21swapper/006:57:410
12276210715,54sleep212325-21awk06:56:162
12276210715,54sleep212325-21awk06:56:162
1319699973,42cyclictest25125-21ssh11:50:492
1319699973,42cyclictest25125-21ssh11:50:492
1319199943,37cyclictest15593-21/usr/sbin/munin10:41:111
13196999244,42cyclictest8238-21timerwakeupswit08:21:122
13196999244,41cyclictest18699-21latency_hist08:55:392
1319199923,33cyclictest3418-21ssh10:20:371
13200999111,70cyclictest5828-21chrt08:16:023
13191999036,47cyclictest0-21swapper/109:21:021
13187999065,9cyclictest181rcu_preempt08:56:030
13187999065,9cyclictest181rcu_preempt08:56:030
1319199894,43cyclictest8915-21apt-get09:35:481
1319199894,35cyclictest29992-21ntpq09:16:051
1319199892,37cyclictest5862-21unixbench_multi12:11:121
13187998968,15cyclictest18422-21latency_hist07:15:370
13196998859,21cyclictest10941-21switchtime11:26:102
13196998859,21cyclictest10941-21switchtime11:26:102
13196998844,37cyclictest0-21swapper/209:06:122
1319699883,39cyclictest17921-21runrttasks09:50:502
1319199883,34cyclictest27587-21/usr/sbin/munin11:01:071
13191998832,49cyclictest0-21swapper/111:56:131
1319199882,35cyclictest29331-21latency_hist09:15:391
13187998865,17cyclictest8838-21latency_hist08:25:370
13196998739,40cyclictest22585-21switchtime07:26:162
13196998739,40cyclictest22585-21switchtime07:26:162
1319699873,41cyclictest6338-21ssh10:25:362
1319699872,30cyclictest30958-21taskset07:51:292
1319199874,36cyclictest31422-21/usr/sbin/munin12:00:501
1319199874,28cyclictest7504-21timerandwakeup10:26:141
1319199874,28cyclictest7504-21timerandwakeup10:26:141
1319199873,34cyclictest25047-21latency_hist07:35:381
1319199873,34cyclictest25047-21latency_hist07:35:381
1319199873,34cyclictest2219-21latency_hist08:05:381
1319199873,34cyclictest2219-21latency_hist08:05:381
1319199873,34cyclictest18907-21fschecks_count08:55:561
1319199873,34cyclictest18907-21fschecks_count08:55:561
1319199873,33cyclictest3114-21grep08:06:101
1319199873,31cyclictest352-21runrttasks12:27:431
1319199872,33cyclictest31757-21/usr/sbin/munin07:55:581
1319199872,32cyclictest20634-21ssh09:00:581
13191998721,21cyclictest10738-21sh11:26:061
13191998721,21cyclictest10738-21sh11:26:061
1319699869,64cyclictest5808-21apt-get08:16:022
13196998659,17cyclictest544-21cron07:15:392
13196998643,36cyclictest0-21swapper/207:05:352
13196998643,36cyclictest0-21swapper/207:05:352
1319699863,6cyclictest0-21swapper/207:45:502
1319699863,40cyclictest31909-21ssh12:01:032
13196998629,34cyclictest7880-21cat11:21:092
1319199865,53cyclictest9637-21ssh10:30:471
1319199863,34cyclictest25541-21kernelversion11:51:001
1319199863,34cyclictest25541-21kernelversion11:51:001
1319199863,33cyclictest20194-21latency_hist07:20:391
1319199863,29cyclictest13192-21latency_hist07:00:391
1319199863,29cyclictest13192-21latency_hist07:00:391
1319199862,35cyclictest22692-21grep10:51:111
13191998623,23cyclictest13903-21cpu08:40:511
13191998623,23cyclictest13903-21cpu08:40:511
13196998565,13cyclictest2374-21systemd-journal08:30:352
13196998562,13cyclictest21343-21kworker/u17:3-xprtiod11:45:352
1319699853,8cyclictest0-21swapper/210:00:512
13196998538,37cyclictest0-21swapper/207:25:392
1319699853,33cyclictest22645-21nfs4_client11:46:032
1319699852,38cyclictest5261-21/usr/sbin/munin12:11:002
1319199853,35cyclictest4719-21ntp_kernel_pll_11:16:031
1319199853,34cyclictest12072-21df09:40:541
1319199852,31cyclictest21144-21fschecks_count09:55:571
1319199852,31cyclictest21144-21fschecks_count09:55:571
1319199852,31cyclictest18597-21latency_hist08:55:381
13187998557,20cyclictest30365-21latency_hist11:05:370
13187998547,11cyclictest181rcu_preempt09:01:150
13196998461,16cyclictest13175-21cyclictest09:22:402
1319699844,37cyclictest12818-21/usr/sbin/munin08:36:072
13196998441,35cyclictest0-21swapper/210:56:102
1319699843,33cyclictest17241-21sort07:10:582
1319699842,28cyclictest4272-21/usr/sbin/munin11:15:522
1319199843,36cyclictest28930-21find07:46:091
1319199843,35cyclictest15303-21fschecks_count07:05:451
13191998433,43cyclictest0-21swapper/111:35:511
1319199843,33cyclictest31477-21latency_hist07:55:381
1319199843,33cyclictest25379-21fschecks_time07:35:591
1319199842,56cyclictest27170-21sh10:06:001
1319199842,33cyclictest18626-21awk09:51:101
1319199842,32cyclictest22823-21unixbench_singl07:26:191
1319199842,32cyclictest22823-21unixbench_singl07:26:191
13191998410,26cyclictest15477-21sort10:40:381
13187998459,16cyclictest803-21sendmail-mta07:19:050
1318799844,60cyclictest15165-21fschecks_time09:45:580
1318799844,60cyclictest15165-21fschecks_time09:45:580
13196998341,36cyclictest20081-21diskmemload09:41:142
1319699833,6cyclictest0-21swapper/211:30:502
1319699833,39cyclictest30600-21sh11:05:472
1319699833,37cyclictest10026-21awk10:30:592
1319699833,32cyclictest25415-21/usr/sbin/munin07:36:002
1319699833,30cyclictest28300-21/usr/sbin/munin11:56:442
1319699832,7cyclictest0-21swapper/208:10:452
1319699832,7cyclictest0-21swapper/208:10:452
1319699832,34cyclictest31107-21timerwakeupswit10:11:142
1319199834,29cyclictest24473-21unixbench_singl09:06:131
13191998338,38cyclictest0-21swapper/109:30:501
13191998336,42cyclictest0-21swapper/107:15:351
1319199833,32cyclictest4633-21latency_hist12:10:371
1319199833,32cyclictest4633-21latency_hist12:10:371
1319199833,31cyclictest8941-21latency_hist08:25:381
1319199832,35cyclictest14704-21munin-plugin-st07:05:351
1319199832,35cyclictest14704-21munin-plugin-st07:05:351
1319199832,32cyclictest30807-21grep11:05:561
13191998315,22cyclictest25742-21seq10:03:211
13187998355,11cyclictest181rcu_preempt11:55:400
1319699829,62cyclictest27098-21apt-get10:05:502
13196998237,38cyclictest0-21swapper/210:00:312
13196998237,38cyclictest0-21swapper/210:00:312
1319699823,36cyclictest28136-21/usr/sbin/munin11:01:162
1319699823,32cyclictest24184-21/usr/sbin/munin07:31:102
1319699823,32cyclictest24184-21/usr/sbin/munin07:31:102
1319699823,32cyclictest1241-21/usr/sbin/munin08:01:052
1319699823,32cyclictest1241-21/usr/sbin/munin08:01:052
1319699823,31cyclictest1207-21sh10:16:042
1319699823,29cyclictest21608-21awk10:50:452
1319699822,7cyclictest0-21swapper/211:35:472
13196998222,46cyclictest0-21swapper/209:10:532
1319699822,16cyclictest6624-21ssh10:25:472
1319699822,16cyclictest6624-21ssh10:25:472
1319199824,31cyclictest27387-21latency_hist11:00:371
1319199824,30cyclictest13774-21/usr/sbin/munin11:31:061
1319199824,29cyclictest3945-21/usr/sbin/munin08:11:051
1319199824,29cyclictest3945-21/usr/sbin/munin08:11:051
1319199824,29cyclictest27189-21ntpq07:41:031
13191998234,41cyclictest0-21swapper/108:30:391
1319199823,33cyclictest9968-21latency_hist11:25:371
1319199823,33cyclictest2089-21grep11:11:111
1319199823,32cyclictest7940-21cpuspeed12:15:511
1319199822,30cyclictest10911-21cpuspeed12:20:511
1319199822,25cyclictest22415-21rm11:45:581
1318799824,43cyclictest352-21runrttasks11:45:570
13187998241,25cyclictest181rcu_preempt08:11:060
13187998241,25cyclictest181rcu_preempt08:11:060
13196998155,11cyclictest13175-21cyclictest09:46:112
13196998155,11cyclictest13175-21cyclictest09:46:112
1319699813,6cyclictest0-21swapper/212:15:472
1319699813,37cyclictest352-21runrttasks12:21:212
1319699813,37cyclictest12804-21df_inode10:35:552
1319699813,34cyclictest2477-21diskstats08:05:552
1319699813,33cyclictest29683-21fschecks_time09:15:582
1319699813,32cyclictest11345-21/usr/sbin/munin08:31:092
1319699813,31cyclictest14218-21/usr/sbin/munin12:25:592
1319699813,30cyclictest6285-21ls09:30:582
1319699813,30cyclictest15841-21/usr/sbin/munin07:06:032
1319699812,33cyclictest20448-21ssh09:00:522
1319199814,31cyclictest18773-21expr10:45:531
1319199814,31cyclictest18773-21expr10:45:531
1319199813,32cyclictest6437-21latency_hist10:25:371
1319199813,31cyclictest316-21latency_hist10:15:371
13191998129,44cyclictest0-21swapper/109:45:511
13191998129,44cyclictest0-21swapper/109:45:511
1319199812,60cyclictest684-21kworker/u18:2+ext4-rsv-conversion08:16:021
13187998158,16cyclictest300-21rs:main0
13187998154,10cyclictest181rcu_preempt10:50:560
13187998146,28cyclictest26727-21rm09:10:580
13196998040,33cyclictest0-21swapper/212:06:042
13196998040,33cyclictest0-21swapper/212:06:042
1319699803,32cyclictest1947-21sh11:11:092
1319699803,30cyclictest19710-21/usr/sbin/munin10:46:142
1319699803,30cyclictest19710-21/usr/sbin/munin10:46:142
1319699803,28cyclictest27633-21/usr/sbin/munin07:41:122
1319699802,32cyclictest32118-21runrttasks07:56:082
1319199804,29cyclictest352-21runrttasks11:42:091
1319199803,31cyclictest11012-21kernelversion08:31:011
13187998057,16cyclictest27908-21apt-key11:55:380
13187998057,16cyclictest27908-21apt-key11:55:380
13187998056,16cyclictest12160-21latency_hist08:35:380
13187998054,11cyclictest181rcu_preempt10:09:060
13187998051,11cyclictest181rcu_preempt11:23:590
1319699793,35cyclictest15839-21kernelversion08:46:012
1319699793,32cyclictest15926-21cut10:40:582
1319699793,30cyclictest14072-21fschecks_count08:40:562
1319699793,30cyclictest14072-21fschecks_count08:40:562
1319699793,27cyclictest2909-21/usr/sbin/munin09:25:472
1319699792,32cyclictest9316-21/usr/sbin/munin09:36:002
1319199794,35cyclictest15679-21fschecks_count08:45:571
1319199793,27cyclictest352-21runrttasks09:26:111
1319199793,25cyclictest12764-21seq08:36:031
1319199792,29cyclictest21777-21latency_hist07:25:391
13187997961,11cyclictest10190-21ssh10:31:030
1318799795,60cyclictest4512-21apt12:10:340
1318799795,60cyclictest4512-21apt12:10:340
13187997952,21cyclictest17099-21kworker/u19:2+events_unbound09:10:350
13187997951,11cyclictest181rcu_preempt10:01:120
13187997946,12cyclictest181rcu_preempt12:15:580
13187997938,32cyclictest0-21swapper/012:10:570
13187997932,12cyclictest181rcu_preempt11:16:250
1319699783,28cyclictest352-21runrttasks08:59:432
1319699783,28cyclictest352-21runrttasks08:59:432
13187997863,9cyclictest14679-21ssh10:38:540
13187997847,13cyclictest181rcu_preempt09:50:430
13187997843,14cyclictest181rcu_preempt09:24:570
13187997840,27cyclictest0-21swapper/009:15:530
13187997836,12cyclictest181rcu_preempt07:21:000
1318799783,44cyclictest2876-21kworker/u17:2+xprtiod10:20:340
1318799773,44cyclictest15-21ksoftirqd/008:44:410
1318799773,44cyclictest15-21ksoftirqd/008:44:410
13187997661,9cyclictest11978-21ssh12:21:210
13187997657,14cyclictest684-21kworker/u18:2-ext4-rsv-conversion08:16:310
13187997649,19cyclictest21465-21sh11:44:440
13187997649,11cyclictest181rcu_preempt07:32:320
13187997649,11cyclictest181rcu_preempt07:32:320
1318799764,61cyclictest15761-21ssh10:40:530
13187997642,13cyclictest181rcu_preempt07:42:240
1318799763,58cyclictest6390-21latency09:31:010
1320099753,39cyclictest24388-21chrt09:06:123
13187997550,18cyclictest352-21runrttasks12:00:540
13187997548,20cyclictest484-21latency_hist10:15:380
1318799754,39cyclictest10090-21/usr/sbin/munin11:26:050
1318799754,39cyclictest10090-21/usr/sbin/munin11:26:050
13187997543,11cyclictest181rcu_preempt11:31:100
13187997515,44cyclictest30875-21fschecks_time11:05:570
13187997512,17cyclictest15-21ksoftirqd/007:05:410
13187997452,14cyclictest21762-21ssh09:56:110
13187997452,14cyclictest21762-21ssh09:56:110
13187997438,13cyclictest181rcu_preempt10:50:390
13187997438,13cyclictest181rcu_preempt10:50:390
1318799742,39cyclictest15-21ksoftirqd/008:05:460
1318799741,36cyclictest25954-21timerwakeupswit07:36:120
1320099733,37cyclictest26389-21taskset10:05:103
13187997339,16cyclictest181rcu_preempt07:29:070
13187997339,16cyclictest181rcu_preempt07:29:070
13187997313,43cyclictest11570-21modprobe09:40:340
1320099722,40cyclictest27058-21chrt10:05:433
13187997242,8cyclictest181rcu_preempt11:12:200
13187997234,21cyclictest13643-21chrt07:00:580
13187997234,21cyclictest13643-21chrt07:00:580
1318799723,33cyclictest352-21runrttasks08:25:580
13187997230,12cyclictest181rcu_preempt08:00:390
13187997137,9cyclictest0-21swapper/008:50:380
1318799713,59cyclictest13185-21ssh09:41:430
1318799713,38cyclictest6962-21fschecks_time10:26:010
1318799713,38cyclictest6962-21fschecks_time10:26:010
163832700,7sleep30-21swapper/307:06:153
13187997043,10cyclictest181rcu_preempt07:50:480
13187997041,8cyclictest181rcu_preempt11:39:180
1318799703,30cyclictest12561-21idleruntime08:35:580
13187996944,9cyclictest181rcu_preempt10:23:310
13187996936,17cyclictest181rcu_preempt08:02:030
13187996936,17cyclictest181rcu_preempt08:02:030
13187996934,12cyclictest181rcu_preempt10:55:520
1318799692,39cyclictest5603-21munin-run09:30:350
1320099682,26cyclictest12388-21taskset12:22:293
1320099673,32cyclictest14698-21chrt07:05:343
1320099673,32cyclictest14698-21chrt07:05:343
1320099673,28cyclictest28348-21taskset11:55:503
1320099673,26cyclictest11850-21chrt09:40:423
13187996753,10cyclictest13175-21cyclictest08:52:520
1320099663,30cyclictest28285-21chrt09:13:213
1320099663,26cyclictest28655-21taskset07:46:003
1320099663,24cyclictest13823-21chrt12:25:463
1320099663,23cyclictest17055-21chrt09:49:133
1320099663,23cyclictest17055-21chrt09:49:133
1320099662,29cyclictest6828-21taskset10:25:583
1320099662,29cyclictest6828-21taskset10:25:583
1320099662,24cyclictest10313-21chrt11:25:553
1320099662,24cyclictest10313-21chrt11:25:553
1320099662,22cyclictest22868-21chrt11:46:093
13200996619,37cyclictest153592chrt11:34:223
1186826615,28sleep30-21swapper/306:56:013
1186826615,28sleep30-21swapper/306:56:013
1320099655,24cyclictest26144-21chrt11:51:123
1320099655,24cyclictest26144-21chrt11:51:123
1320099653,26cyclictest25434-21taskset07:36:003
1320099653,21cyclictest18799-21chrt07:15:553
1320099652,30cyclictest23636-21taskset07:30:543
1320099652,30cyclictest23636-21taskset07:30:543
1320099652,27cyclictest18806-21taskset10:45:563
1320099652,27cyclictest18806-21taskset10:45:563
1320099652,23cyclictest2028-21chrt12:05:553
1320099652,23cyclictest2028-21chrt12:05:553
1320099652,22cyclictest24341-21chrt10:55:363
1320099643,25cyclictest6705-21chrt11:20:203
1320099643,24cyclictest26713-21chrt07:40:503
1320099643,23cyclictest15635-21chrt08:45:543
1320099642,24cyclictest1474-21chrt09:22:263
1318799643,18cyclictest28656-21/usr/sbin/munin07:46:010
1320099633,26cyclictest4183-21taskset09:26:393
1320099633,26cyclictest10328-21chrt08:30:193
1320099633,25cyclictest29576-21chrt11:03:383
1320099633,25cyclictest12040-21taskset10:34:533
1320099633,24cyclictest29611-21chrt09:15:573
1320099633,23cyclictest8013-21chrt12:15:533
1320099633,23cyclictest4501-21chrt10:21:123
1320099633,23cyclictest21469-21chrt07:24:093
1320099632,26cyclictest8030-21chrt09:34:013
1320099632,25cyclictest17161-21chrt10:42:273
1320099632,24cyclictest31571-21chrt10:12:123
1320099632,23cyclictest24789-21chrt10:55:523
13200996318,36cyclictest0-21swapper/310:16:093
1320099623,23cyclictest3546-21chrt08:09:093
1320099623,23cyclictest19862-21taskset08:57:573
1320099623,23cyclictest19862-21taskset08:57:573
1320099623,23cyclictest11733-21taskset08:32:183
1320099623,22cyclictest7576-21chrt08:20:563
1320099622,25cyclictest22327-21chrt09:57:083
1320099622,25cyclictest22327-21chrt09:57:083
1320099622,25cyclictest13379-21taskset08:37:403
1320099622,24cyclictest561-21chrt12:02:553
1320099622,24cyclictest14881-21chrt08:41:213
1320099622,24cyclictest14881-21chrt08:41:213
1320099622,23cyclictest22874-21chrt07:26:323
1320099622,23cyclictest22874-21chrt07:26:323
13200996212,40cyclictest0-21swapper/308:00:583
13200996212,40cyclictest0-21swapper/308:00:583
1320099613,23cyclictest2648-21chrt11:12:183
1320099612,25cyclictest18200-21taskset08:52:143
1320099612,24cyclictest8405-21chrt11:21:423
1320099612,23cyclictest19136-21taskset11:40:503
1320099612,20cyclictest31719-21chrt07:55:573
13200996112,40cyclictest0-21swapper/309:51:093
1320099603,23cyclictest18508-21chrt11:39:493
1320099602,25cyclictest30937-21chrt07:51:153
1320099602,23cyclictest10551-21chrt09:37:423
13200996011,39cyclictest0-21swapper/311:06:033
1320099593,22cyclictest18065-21chrt07:11:383
1320099592,24cyclictest14880-21chrt10:39:273
1320099592,22cyclictest5196-21chrt08:14:233
1320099592,22cyclictest5196-21chrt08:14:233
1320099582,26cyclictest22222-21chrt09:03:123
1320099582,22cyclictest7268-21chrt12:14:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional