You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 05:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Mar 23, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10627214816,92sleep110654-21apt-config19:04:461
10627214816,92sleep110654-21apt-config19:04:461
10798991402,106cyclictest8586-21apt-get22:35:101
10798991402,106cyclictest8586-21apt-get22:35:101
10798991233,86cyclictest12019-21apt-get23:34:591
107989910273,13cyclictest181rcu_preempt23:14:451
10798991013,65cyclictest21657-21apt-get19:35:051
10798999647,10cyclictest181rcu_preempt22:29:571
10798999647,10cyclictest181rcu_preempt22:29:571
10801999523,25cyclictest39-21ksoftirqd/200:25:242
10798999334,26cyclictest10756-21cyclictest23:59:111
10801999214,49cyclictest39-21ksoftirqd/219:45:572
10801999214,49cyclictest39-21ksoftirqd/219:45:572
10798999274,10cyclictest10248-21ssh21:43:241
1079899913,64cyclictest29380-21kworker/u18:0+ext4-rsv-conversion20:45:261
1079899913,64cyclictest29380-21kworker/u18:0+ext4-rsv-conversion20:45:261
1080699903,51cyclictest0-21swapper/323:35:083
10798999038,13cyclictest181rcu_preempt00:25:131
1079899903,61cyclictest23612-21ssh23:54:421
10801998923,25cyclictest39-21ksoftirqd/222:24:512
10801998849,11cyclictest181rcu_preempt22:58:402
10801998828,23cyclictest39-21ksoftirqd/222:10:162
10785998814,30cyclictest28289-21apt-get21:19:520
10798998746,13cyclictest181rcu_preempt23:29:441
10798998739,14cyclictest25699-21ssh23:03:381
10798998739,14cyclictest25699-21ssh23:03:381
10785998723,24cyclictest32008-1kworker/0:1H+mmc_complete00:19:450
1079899862,54cyclictest11072-21seq19:05:081
10785998518,37cyclictest0-21swapper/022:50:480
10785998518,37cyclictest0-21swapper/022:50:480
10801998463,14cyclictest19476-21sh21:05:022
10801998440,21cyclictest8989-21diskstats23:30:012
10801998430,26cyclictest39-21ksoftirqd/200:18:042
10801998430,26cyclictest39-21ksoftirqd/200:18:042
10798998463,14cyclictest29250-21timerwakeupswit21:20:181
10798998445,12cyclictest181rcu_preempt21:25:111
10785998425,48cyclictest0-21swapper/022:04:560
10798998348,14cyclictest181rcu_preempt19:14:451
10798998328,30cyclictest0-21swapper/121:59:451
10798998328,30cyclictest0-21swapper/121:59:451
10785998329,20cyclictest0-21swapper/000:25:040
10785998317,29cyclictest7427-21apt-get20:29:520
10785998311,26cyclictest8082-21true22:34:430
10785998311,26cyclictest8082-21true22:34:430
10798998254,15cyclictest181rcu_preempt19:49:451
10798998254,15cyclictest181rcu_preempt19:49:451
10785998263,13cyclictest8925-21kworker/u17:4+nfsiod00:31:280
10785998218,41cyclictest0-21swapper/022:42:120
10801998144,8cyclictest181rcu_preempt23:59:582
10801998126,29cyclictest39-21ksoftirqd/223:41:012
10798998159,15cyclictest12551-21unixbench_multi22:40:181
10798998155,9cyclictest181rcu_preempt20:15:151
10798998155,9cyclictest181rcu_preempt20:15:151
10798998132,11cyclictest181rcu_preempt22:48:191
10798998118,32cyclictest27186-21ssh23:05:151
10785998113,37cyclictest0-21swapper/022:19:370
3682800,16sleep1375-21unixbench_singl20:06:091
1080699806,47cyclictest0-21swapper/322:35:353
1080699806,47cyclictest0-21swapper/322:35:353
1080699803,52cyclictest0-21swapper/321:29:593
10801998056,18cyclictest19991-21kworker/u17:1+events_unbound22:54:412
10801998056,18cyclictest19991-21kworker/u17:1+events_unbound22:54:412
10798998054,9cyclictest31965-21ssh22:20:001
10798998041,14cyclictest181rcu_preempt19:17:361
10798998038,12cyclictest181rcu_preempt22:17:341
10798998036,10cyclictest181rcu_preempt21:07:401
10798998030,29cyclictest0-21swapper/122:04:581
10785998062,12cyclictest200-21systemd-journal21:46:470
10785998062,12cyclictest200-21systemd-journal21:46:470
10785998034,34cyclictest28014-21kworker/u17:2+nfsiod22:22:590
10785998028,25cyclictest18966-21diskmemload21:43:240
10785998027,40cyclictest19790-21apt-get19:29:550
10785998024,23cyclictest0-21swapper/023:45:110
10785998020,29cyclictest0-21swapper/021:34:550
103132806,60sleep20-21swapper/219:02:352
103132806,60sleep20-21swapper/219:02:352
1080199797,34cyclictest39-21ksoftirqd/222:18:122
10798997946,8cyclictest181rcu_preempt00:04:571
10798997946,8cyclictest181rcu_preempt00:04:571
10798997943,12cyclictest181rcu_preempt20:39:521
10798997938,23cyclictest0-21swapper/100:24:401
10785997913,28cyclictest0-21swapper/021:49:540
1080199782,40cyclictest39-21ksoftirqd/220:04:452
10801997818,31cyclictest39-21ksoftirqd/220:30:172
10801997816,35cyclictest39-21ksoftirqd/223:04:062
10801997816,35cyclictest39-21ksoftirqd/223:04:062
10798997838,11cyclictest181rcu_preempt23:21:041
10798997838,11cyclictest181rcu_preempt23:21:041
1078599789,33cyclictest20772-21taskset21:06:240
1078599789,27cyclictest8871-21/usr/sbin/munin23:29:570
1078599787,31cyclictest15467-21apt-get20:54:550
10785997860,12cyclictest26177-21latency_hist23:04:440
10785997860,12cyclictest26177-21latency_hist23:04:440
10785997857,14cyclictest25501-21sh21:15:030
10785997825,31cyclictest0-21swapper/022:14:420
10785997816,22cyclictest6403-21ps20:25:150
1080699776,43cyclictest0-21swapper/320:55:233
1080199778,36cyclictest39-21ksoftirqd/221:49:282
1080199778,36cyclictest39-21ksoftirqd/221:49:282
1080199777,41cyclictest39-21ksoftirqd/221:53:012
10801997751,18cyclictest4109-21latency_hist20:19:442
10801997751,18cyclictest4109-21latency_hist20:19:442
10801997738,11cyclictest24236-21perl23:55:042
10801997733,21cyclictest658-21fw_packets00:10:032
10801997725,25cyclictest39-21ksoftirqd/220:22:322
10801997725,25cyclictest39-21ksoftirqd/220:22:322
1080199772,33cyclictest39-21ksoftirqd/222:45:332
10801997723,31cyclictest39-21ksoftirqd/219:20:182
10801997713,41cyclictest39-21ksoftirqd/222:36:192
10801997713,41cyclictest39-21ksoftirqd/222:36:192
10798997755,16cyclictest240-21rpcbind22:25:021
10798997748,9cyclictest181rcu_preempt20:30:171
10798997747,10cyclictest181rcu_preempt22:10:031
10798997729,13cyclictest181rcu_preempt00:02:481
10798997718,27cyclictest0-21swapper/123:44:451
10785997713,27cyclictest1916-21grep20:10:180
10785997712,38cyclictest1-21systemd19:59:420
1056127711,40sleep010626-21gpgv19:04:450
1056127711,40sleep010626-21gpgv19:04:450
1080199766,37cyclictest39-21ksoftirqd/220:47:232
1080199766,37cyclictest39-21ksoftirqd/220:47:232
10801997660,9cyclictest0-21swapper/223:20:592
10801997660,9cyclictest0-21swapper/223:20:592
10801997657,13cyclictest27175-21sh23:05:142
10801997647,11cyclictest181rcu_preempt20:44:202
10798997649,21cyclictest12509-21fschecks_time00:30:061
10798997646,9cyclictest181rcu_preempt21:17:581
10798997645,8cyclictest181rcu_preempt19:50:031
10798997642,18cyclictest181rcu_preempt00:14:271
10798997637,15cyclictest181rcu_preempt21:45:041
10798997637,15cyclictest181rcu_preempt21:45:041
10785997644,24cyclictest0-21swapper/023:44:450
10785997620,17cyclictest4733-21tr20:20:110
10785997620,17cyclictest4733-21tr20:20:110
10801997559,9cyclictest0-21swapper/221:40:052
10801997558,11cyclictest7022-21ssh00:20:172
10801997557,12cyclictest18966-21diskmemload00:30:162
10801997543,11cyclictest181rcu_preempt22:02:272
10801997535,9cyclictest13570-21kworker/u17:0-rpciod23:09:452
10801997533,7cyclictest181rcu_preempt19:32:142
1080199752,56cyclictest12072-21apt-get23:35:002
10801997522,29cyclictest39-21ksoftirqd/221:25:412
10801997515,37cyclictest39-21ksoftirqd/219:26:012
10801997515,23cyclictest39-21ksoftirqd/219:05:192
10801997514,36cyclictest39-21ksoftirqd/221:58:402
10801997514,36cyclictest39-21ksoftirqd/221:58:402
10798997552,14cyclictest5289-21fschecks_count21:35:041
10798997546,9cyclictest21655-21ssh22:02:031
10798997530,14cyclictest19892-21ssh23:47:441
10798997527,14cyclictest181rcu_preempt21:14:401
10798997512,26cyclictest30723-21find20:00:171
1078599758,29cyclictest32276-21ssh00:09:100
1078599758,29cyclictest32276-21ssh00:09:100
10785997559,10cyclictest2092-21sh00:12:110
10785997557,12cyclictest277-21dbus-daemon00:19:420
10785997557,11cyclictest200-21systemd-journal19:09:470
10785997554,15cyclictest15880-21latency_hist20:54:450
1078599755,29cyclictest27254-21irqstats00:00:040
10785997525,21cyclictest0-21swapper/020:46:310
10785997525,21cyclictest0-21swapper/020:46:310
10785997514,28cyclictest2390-21apt-get22:24:520
10785997511,28cyclictest1546-21systemctl21:29:420
10801997435,14cyclictest181rcu_preempt22:40:112
10801997426,29cyclictest23611-21mandb23:54:442
10798997450,14cyclictest0-21swapper/122:50:161
10798997450,14cyclictest0-21swapper/122:50:161
10798997445,8cyclictest181rcu_preempt23:32:451
10798997444,13cyclictest181rcu_preempt19:33:471
10798997431,17cyclictest181rcu_preempt21:34:241
1078599749,28cyclictest20147-21/usr/sbin/munin22:00:000
1078599745,23cyclictest0-21swapper/023:54:530
1078599743,30cyclictest6605-21ssh00:20:060
10785997413,30cyclictest28046-21cron19:54:410
10785997413,18cyclictest2612-21apt-get20:14:540
10785997413,18cyclictest2612-21apt-get20:14:540
10785997410,29cyclictest31314-21apt-get20:04:550
10785997410,21cyclictest9597-21seq20:35:120
10801997359,10cyclictest10756-21cyclictest22:23:372
10801997334,11cyclictest13074-21/usr/sbin/munin19:10:182
10798997353,13cyclictest374-21sshd20:55:481
10798997326,9cyclictest0-21swapper/119:26:011
1078599739,25cyclictest19160-21ssh21:58:210
1078599739,25cyclictest19160-21ssh21:58:210
1078599736,31cyclictest21730-21apt-get19:35:440
1078599736,27cyclictest5813-21/usr/sbin/munin23:25:020
10785997312,27cyclictest28848-21ssh23:09:090
10785997310,28cyclictest1496-21apt-get21:29:540
1080199722,22cyclictest15773-21gpgv20:54:442
10801997215,35cyclictest39-21ksoftirqd/220:39:452
10798997243,9cyclictest181rcu_preempt20:24:441
10798997243,9cyclictest181rcu_preempt20:24:441
10798997242,9cyclictest181rcu_preempt19:20:101
1078599722,35cyclictest15107-21kernelversion19:15:090
10785997220,10cyclictest0-21swapper/023:50:150
1080199715,43cyclictest39-21ksoftirqd/223:26:452
10801997148,7cyclictest181rcu_preempt21:32:222
1080199714,30cyclictest39-21ksoftirqd/223:14:582
10801997131,9cyclictest181rcu_preempt22:07:442
10801997119,24cyclictest39-21ksoftirqd/219:16:142
10798997139,8cyclictest181rcu_preempt20:49:571
10798997135,21cyclictest0-21swapper/121:00:311
10798997128,9cyclictest181rcu_preempt20:35:051
1079899712,50cyclictest21071-21ntp_states22:55:111
1078599717,24cyclictest12696-21/usr/sbin/munin23:36:010
1078599714,30cyclictest30874-21grep20:00:190
10785997118,13cyclictest17481-21chrt19:22:220
10785997114,24cyclictest21075-21ssh22:55:110
10785997112,25cyclictest10502-21sh22:37:420
10785997112,25cyclictest10502-21sh22:37:420
10785997111,28cyclictest14460-21rm22:44:500
1080199706,40cyclictest39-21ksoftirqd/220:05:152
10801997052,14cyclictest27967-21kworker/u17:3+events_unbound19:59:422
10801997049,15cyclictest32022-21sh00:08:272
10801997049,15cyclictest32022-21sh00:08:272
10801997042,7cyclictest181rcu_preempt20:59:122
1080199702,37cyclictest39-21ksoftirqd/221:22:372
1080199702,27cyclictest39-21ksoftirqd/219:36:222
1080199701,34cyclictest39-21ksoftirqd/219:40:202
1080199701,34cyclictest39-21ksoftirqd/219:40:202
10798997051,11cyclictest181rcu_preempt00:17:221
10798997051,11cyclictest181rcu_preempt00:17:221
10798997045,18cyclictest544-21cron23:19:411
10798997028,13cyclictest181rcu_preempt19:54:581
10798997018,25cyclictest0-21swapper/119:40:051
10798997018,25cyclictest0-21swapper/119:40:051
1078599708,29cyclictest22673-21/usr/sbin/munin21:10:050
1078599704,30cyclictest18177-21apt19:24:520
1078599704,28cyclictest5505-21cron23:24:410
1078599704,28cyclictest5505-21cron23:24:410
10785997020,22cyclictest18444-21timerwakeupswit21:00:280
10801996954,11cyclictest10756-21cyclictest22:30:152
10801996954,11cyclictest10756-21cyclictest22:30:152
10801996931,10cyclictest0-21swapper/223:46:032
10801996913,29cyclictest39-21ksoftirqd/221:15:102
1078599698,25cyclictest31695-21rm23:13:480
10785996923,14cyclictest26532-21latency_hist19:49:430
10785996923,14cyclictest26532-21latency_hist19:49:430
1080699688,31cyclictest0-21swapper/319:05:083
10801996838,7cyclictest181rcu_preempt19:49:582
1080199683,24cyclictest22303-21cpu21:09:572
10801996830,7cyclictest181rcu_preempt20:10:072
10798996844,16cyclictest0-21swapper/121:52:051
1078599686,24cyclictest974-21sh23:15:180
1078599683,24cyclictest23267-21apt-get19:39:580
1078599683,24cyclictest23267-21apt-get19:39:580
1078599682,32cyclictest0-21swapper/019:05:190
10785996819,9cyclictest10961-21basename20:40:040
10801996712,31cyclictest39-21ksoftirqd/220:27:142
190552660,9sleep3451rcuc/321:58:033
190552660,9sleep3451rcuc/321:58:033
10798996619,12cyclictest1181-21fschecks_count20:10:041
1080699652,29cyclictest0-21swapper/320:04:573
10806996512,28cyclictest0-21swapper/319:45:023
10806996512,28cyclictest0-21swapper/319:45:023
1080199658,30cyclictest39-21ksoftirqd/221:35:102
10801996532,9cyclictest181rcu_preempt21:02:572
1079899653,41cyclictest6045-21fschecks_time20:25:041
1080699624,37cyclictest13917-21taskset00:32:013
1080699622,37cyclictest917-21kworker/3:1+events19:40:083
1080699622,37cyclictest917-21kworker/3:1+events19:40:083
1080699583,36cyclictest14968-21taskset22:45:073
1080699582,33cyclictest0-21swapper/320:45:293
1080699582,33cyclictest0-21swapper/320:45:293
1080699573,36cyclictest26739-21taskset23:59:443
1080699563,36cyclictest2312-21chrt20:14:423
1080699562,41cyclictest24085-21chrt22:05:323
1080699562,27cyclictest32063-21chrt23:14:423
1080699553,40cyclictest31334-21taskset21:24:593
1080699553,36cyclictest24654-21chrt23:00:403
1080699553,36cyclictest24654-21chrt23:00:403
1080699552,39cyclictest18614-21chrt23:45:133
1080699552,37cyclictest21942-21chrt22:56:223
10806995512,27cyclictest0-21swapper/319:34:573
1080699543,36cyclictest16993-21chrt23:42:543
1080699543,32cyclictest27131-21chrt19:50:073
1080699542,39cyclictest23812-21chrt23:54:463
1080699533,41cyclictest7662-21taskset22:33:443
1080699533,41cyclictest7662-21taskset22:33:443
1080699533,39cyclictest11606-21chrt23:34:433
1080699533,34cyclictest27319-21chrt22:11:203
1080699532,40cyclictest30120-21taskset00:05:033
1080699532,40cyclictest30120-21taskset00:05:033
1080699532,36cyclictest23052-21taskset21:10:153
1080699523,37cyclictest30255-21taskset21:22:443
1080699523,34cyclictest29196-21taskset22:15:043
1080699523,33cyclictest3143-21chrt23:20:053
1080699523,33cyclictest3143-21chrt23:20:053
1080699523,33cyclictest18267-21chrt22:50:143
1080699523,33cyclictest18267-21chrt22:50:143
1080699523,32cyclictest14286-21chrt21:50:043
1080699523,32cyclictest11553-21chrt21:45:103
1080699523,32cyclictest11553-21chrt21:45:103
1080699522,34cyclictest7871-21taskset23:27:593
10806995213,30cyclictest0-21swapper/319:24:563
1080699513,37cyclictest32505-21taskset23:14:583
1080699513,36cyclictest27632-21chrt21:18:463
1080699513,35cyclictest12425-21chrt22:40:173
1080699513,32cyclictest12072-21chrt20:44:433
1080699513,31cyclictest9074-21taskset21:40:193
1080699513,31cyclictest17859-21chrt21:00:143
1080699503,37cyclictest28406-21taskset23:07:533
1080699503,34cyclictest10124-21chrt00:25:173
1080699503,33cyclictest27253-21chrt00:00:043
1080699503,32cyclictest20156-21chrt21:05:173
1080699502,36cyclictest7935-21chrt00:21:523
1080699502,36cyclictest31642-21taskset20:04:453
1080699502,34cyclictest15688-21chrt19:15:203
1080699502,33cyclictest14282-21chrt20:50:013
1080699502,32cyclictest9256-21chrt20:35:033
1080699498,28cyclictest17788-21chrt19:24:443
1080699493,34cyclictest4095-21chrt20:19:443
1080699493,34cyclictest4095-21chrt20:19:443
1080699493,33cyclictest2088-21taskset22:24:413
1080699493,32cyclictest22397-21chrt22:04:103
1080699492,33cyclictest7742-21taskset20:30:053
1080699492,33cyclictest7696-21chrt21:39:383
1080699473,31cyclictest5090-21chrt22:29:433
1080699464,31cyclictest3641-21chrt00:15:043
1080699464,31cyclictest3641-21chrt00:15:043
105232469,23sleep30-21swapper/319:04:443
105232469,23sleep30-21swapper/319:04:443
1080699454,29cyclictest1590-21chrt00:10:463
10806994517,17cyclictest0-21swapper/319:09:463
1080699443,30cyclictest6167-21chrt20:25:073
1080699423,29cyclictest4898-21taskset20:20:173
1080699423,29cyclictest4898-21taskset20:20:173
1080699423,24cyclictest21278-21chrt19:34:443
1080699422,27cyclictest28358-21taskset19:54:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional