You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 17:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Fri Mar 27, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14871991152,89cyclictest7152-21apt-get11:19:582
14867991062,85cyclictest6123-21apt-get10:24:401
14867991062,85cyclictest6123-21apt-get10:24:401
985121000,7sleep00-21swapper/009:37:270
1486799973,77cyclictest11097-21apt-get09:39:401
1469929612,53sleep014731-21munin-run07:04:240
1373029610,59sleep213743-21kernelversion06:59:532
14867999549,39cyclictest0-21swapper/111:10:001
1354229556,20sleep10-21swapper/106:59:481
14867999444,42cyclictest0-21swapper/109:44:341
1487199933,57cyclictest39-21ksoftirqd/212:29:342
14871999064,17cyclictest2580-21processes09:24:592
1486799904,8cyclictest0-21swapper/111:29:371
1486799904,8cyclictest0-21swapper/111:29:371
1486799903,72cyclictest0-21swapper/108:49:371
14871998970,13cyclictest13903-21apt-key09:44:262
14867998945,37cyclictest0-21swapper/112:29:591
1486799892,25cyclictest27673-21sh11:54:061
14871998865,15cyclictest31392-21ssh11:59:452
14867998872,10cyclictest20124-21idleruntime-cro08:59:241
14867998872,10cyclictest20124-21idleruntime-cro08:59:241
1486799883,34cyclictest4501-21ntp_kernel_pll_11:14:511
1486299887,61cyclictest15-21ksoftirqd/010:34:410
1486299887,61cyclictest15-21ksoftirqd/010:34:410
14867998774,8cyclictest0-21swapper/111:19:461
14867998768,12cyclictest10609-21unin-run09:39:241
1486799874,72cyclictest0-21swapper/109:54:341
1486799874,71cyclictest0-21swapper/110:44:391
1486799873,39cyclictest3999-21runrttasks10:20:011
1486799873,39cyclictest28815-21/usr/sbin/munin07:44:501
14862998755,24cyclictest3998-21apt-key08:09:280
14871998649,9cyclictest181rcu_preempt10:14:592
14871998629,8cyclictest181rcu_preempt08:50:002
1486799863,8cyclictest0-21swapper/110:04:351
1486799863,77cyclictest0-21swapper/110:49:351
1486799863,74cyclictest0-21swapper/107:49:361
1486799863,34cyclictest4217-21apt-get08:09:451
1486799862,9cyclictest0-21swapper/107:59:381
1486299865,39cyclictest15-21ksoftirqd/012:32:510
1487199854,46cyclictest12018-21modprobe08:34:242
1487199854,46cyclictest12018-21modprobe08:34:242
1486799854,75cyclictest0-21swapper/109:49:391
1486799854,75cyclictest0-21swapper/109:49:391
1486799854,14cyclictest21921-21apt-get07:24:361
1486799853,71cyclictest10685-21ssh12:19:391
1486799853,39cyclictest27649-21/usr/sbin/munin07:39:581
1486799853,38cyclictest15023-21/usr/sbin/munin07:04:341
1486799853,38cyclictest15023-21/usr/sbin/munin07:04:341
1486799853,37cyclictest16548-21kernelversion11:34:481
1486799853,37cyclictest14377-21/usr/sbin/munin08:39:501
1486799853,27cyclictest9088-21/usr/sbin/munin10:29:401
1486799852,40cyclictest29917-21/usr/sbin/munin10:09:521
1486799852,40cyclictest29917-21/usr/sbin/munin10:09:521
14871998464,14cyclictest2952-21systemd-journal11:34:522
14871998450,11cyclictest181rcu_preempt07:32:162
1487199844,70cyclictest6233-21ssh10:24:522
1487199844,70cyclictest6233-21ssh10:24:522
1486799843,8cyclictest0-21swapper/109:19:341
1486799843,8cyclictest0-21swapper/109:19:341
14867998435,39cyclictest0-21swapper/109:29:361
14867998435,39cyclictest0-21swapper/109:29:361
1486799842,38cyclictest16880-21/usr/sbin/munin08:49:251
14871998359,18cyclictest21983-21diskmemload10:42:562
14867998361,13cyclictest24590-21ssh11:48:501
14867998361,13cyclictest24590-21ssh11:48:501
1486799834,16cyclictest1866-21apt-get09:24:401
14867998338,37cyclictest0-21swapper/109:59:581
14867998338,37cyclictest0-21swapper/109:59:581
1486799833,74cyclictest0-21swapper/111:04:351
1486799833,34cyclictest30963-21latency_hist11:59:251
1486799833,33cyclictest24578-21/usr/sbin/munin10:54:431
1486799833,33cyclictest24578-21/usr/sbin/munin10:54:431
1486799832,41cyclictest21974-21latency_hist09:04:271
1486799832,41cyclictest21974-21latency_hist09:04:271
1486799832,33cyclictest19504-21/usr/sbin/munin11:39:471
1486299838,56cyclictest6123-21apt-get10:24:520
1486299838,56cyclictest6123-21apt-get10:24:520
1486299834,46cyclictest15-21ksoftirqd/008:29:340
1486299834,46cyclictest15-21ksoftirqd/008:29:340
1486299832,62cyclictest7152-21apt-get11:19:410
1487199826,65cyclictest14319-21apt-get09:44:472
14871998250,8cyclictest181rcu_preempt11:15:052
14871998248,12cyclictest181rcu_preempt11:52:412
14871998233,11cyclictest181rcu_preempt09:54:472
14871998230,23cyclictest5577-21apt-get10:24:232
14867998258,16cyclictest2952-21systemd-journal12:05:521
1486799823,8cyclictest0-21swapper/108:24:371
1486799823,40cyclictest27279-21ssh10:59:271
1486799822,7cyclictest0-21swapper/109:14:341
1486799822,33cyclictest8371-21/usr/sbin/munin12:14:551
1486799822,33cyclictest14361-21/usr/sbin/munin12:24:571
1486799822,32cyclictest2962-21/usr/sbin/munin08:04:571
14862998258,15cyclictest2952-21systemd-journal07:44:230
14862998257,17cyclictest17414-21cpuspeed09:49:400
14862998257,17cyclictest17414-21cpuspeed09:49:400
1486299824,48cyclictest15-21ksoftirqd/010:05:010
1487199816,38cyclictest20121-21apt-get08:59:372
1487199816,38cyclictest20121-21apt-get08:59:372
14871998154,8cyclictest181rcu_preempt07:24:572
14871998153,19cyclictest32030-21sh09:19:572
14871998153,19cyclictest32030-21sh09:19:572
14871998133,13cyclictest181rcu_preempt11:07:472
1486799814,31cyclictest19177-21/usr/sbin/munin07:14:501
1486799814,30cyclictest31900-21/usr/sbin/munin07:54:451
1486799813,8cyclictest0-21swapper/109:09:351
1486799813,33cyclictest2194-21sh10:18:201
1486799812,34cyclictest31126-21apt-get11:59:341
1486799812,33cyclictest12872-21kernelversion10:35:011
1486799812,33cyclictest12872-21kernelversion10:35:011
1486799812,31cyclictest20650-21/usr/sbin/munin07:19:481
1487199806,42cyclictest12354-21apt-get10:34:452
1487199806,42cyclictest12354-21apt-get10:34:452
14871998059,14cyclictest3833-21apt-key08:09:262
14871998057,16cyclictest14853-21cyclictest11:11:482
14871998052,19cyclictest30829-21timerwakeupswit07:49:592
14871998045,11cyclictest181rcu_preempt09:31:242
14871998045,11cyclictest181rcu_preempt09:31:242
14871998039,13cyclictest181rcu_preempt10:30:522
1486799804,9cyclictest0-21swapper/108:19:381
1486799804,7cyclictest0-21swapper/109:04:381
1486799802,35cyclictest15908-21ssh10:39:501
1486799802,35cyclictest12023-21latency_hist08:34:261
1486799802,35cyclictest12023-21latency_hist08:34:261
1486799802,31cyclictest12480-21/usr/sbin/munin08:34:441
1486799802,31cyclictest12480-21/usr/sbin/munin08:34:441
1486299803,44cyclictest15-21ksoftirqd/007:59:400
14871997954,10cyclictest181rcu_preempt08:39:482
14871997951,19cyclictest10687-21cpu12:19:402
14871997944,10cyclictest181rcu_preempt09:18:332
1486799793,33cyclictest26145-21/usr/sbin/munin07:35:021
1486799793,33cyclictest26145-21/usr/sbin/munin07:35:021
1486799793,27cyclictest5847-21/usr/sbin/munin08:14:331
1486799792,38cyclictest4626-21/usr/sbin/munin12:09:511
14862997956,15cyclictest4372-21kworker/u19:2+ext4-rsv-conversion09:39:420
1486299794,64cyclictest20607-21/usr/sbin/munin09:01:060
1486299794,64cyclictest20607-21/usr/sbin/munin09:01:060
1486299792,27cyclictest15-21ksoftirqd/007:54:470
14871997835,11cyclictest0-21swapper/212:04:402
1487199782,40cyclictest39-21ksoftirqd/211:32:292
1487199782,40cyclictest39-21ksoftirqd/211:32:292
14871997815,20cyclictest494-21latency_hist07:59:262
1486799782,31cyclictest17314-21grep07:09:481
1486799782,30cyclictest10419-21sh11:24:441
1486799782,29cyclictest24896-21tr07:34:241
14862997859,14cyclictest19998-21timerandwakeup11:39:590
14871997748,11cyclictest181rcu_preempt11:25:512
14871997745,14cyclictest181rcu_preempt11:01:152
14871997736,13cyclictest181rcu_preempt08:10:482
14871997734,13cyclictest181rcu_preempt10:55:212
14871997734,13cyclictest181rcu_preempt10:55:212
1487199772,41cyclictest39-21ksoftirqd/212:17:122
14862997750,7cyclictest181rcu_preempt12:15:590
14862997744,26cyclictest0-21swapper/010:59:590
1486299773,50cyclictest15-21ksoftirqd/007:16:140
1486299772,44cyclictest15-21ksoftirqd/009:56:430
1486299772,28cyclictest15-21ksoftirqd/011:08:030
14871997655,12cyclictest0-21swapper/209:39:102
14871997645,9cyclictest181rcu_preempt08:59:282
14871997645,9cyclictest181rcu_preempt08:59:282
14871997630,9cyclictest181rcu_preempt12:09:512
14871997627,25cyclictest29430-21sort10:09:412
14871997627,25cyclictest29430-21sort10:09:412
1487199762,46cyclictest23720-21ssh11:46:232
1487199762,46cyclictest23720-21ssh11:46:232
1487199762,32cyclictest39-21ksoftirqd/210:49:402
1487199762,26cyclictest16901-21fschecks_time07:09:352
14871997619,12cyclictest0-21swapper/210:44:352
14871997615,14cyclictest0-21swapper/209:52:272
14871997615,14cyclictest0-21swapper/209:52:272
14862997647,23cyclictest2525-21ssh12:04:580
1486299764,29cyclictest15-21ksoftirqd/007:33:180
14862997635,29cyclictest0-21swapper/008:44:390
14862997612,44cyclictest15-21ksoftirqd/009:29:060
1487199752,34cyclictest39-21ksoftirqd/208:37:002
1487199752,34cyclictest39-21ksoftirqd/208:37:002
1486299753,60cyclictest10151-21ssh11:24:360
1486299753,56cyclictest25421-21cstates09:09:400
1486299753,41cyclictest15-21ksoftirqd/010:49:200
1486299752,37cyclictest15-21ksoftirqd/009:30:520
1486299752,37cyclictest15-21ksoftirqd/009:30:520
14871997451,16cyclictest25341-21ssh10:02:292
14871997451,16cyclictest25341-21ssh10:02:292
14871997437,13cyclictest181rcu_preempt07:19:462
14871997426,12cyclictest181rcu_preempt08:00:332
14871997425,11cyclictest181rcu_preempt12:25:012
14862997458,11cyclictest1-21systemd11:19:260
14862997457,13cyclictest14853-21cyclictest08:24:460
14862997452,9cyclictest181rcu_preempt08:17:050
14862997445,18cyclictest963-21ssh12:03:210
1486299743,41cyclictest30806-21ls11:59:220
1486299742,41cyclictest15-21ksoftirqd/012:13:120
14871997352,14cyclictest22268-21/usr/sbin/munin09:04:452
14871997339,16cyclictest181rcu_preempt08:14:452
14862997344,23cyclictest31312-21apt-get09:19:340
14862997344,23cyclictest31312-21apt-get09:19:340
1486299734,37cyclictest1328-21ssh11:09:480
1486299733,30cyclictest15-21ksoftirqd/011:44:440
1486299733,30cyclictest15-21ksoftirqd/011:44:440
14862997311,46cyclictest21342-21sort10:49:340
1487199726,31cyclictest7814-21irqstats08:19:472
14871997232,8cyclictest181rcu_preempt07:39:432
14862997255,12cyclictest15248-21fschecks_count07:04:450
14862997255,12cyclictest15248-21fschecks_count07:04:450
14862997254,12cyclictest13948-21switchtime11:29:590
14862997254,12cyclictest13948-21switchtime11:29:590
1486299724,47cyclictest15-21ksoftirqd/007:20:060
1486299724,32cyclictest15-21ksoftirqd/010:03:050
1486299724,32cyclictest15-21ksoftirqd/010:03:050
1486299722,43cyclictest15-21ksoftirqd/007:53:130
14871997143,9cyclictest181rcu_preempt07:19:152
14871997140,8cyclictest181rcu_preempt08:44:402
14871997137,9cyclictest181rcu_preempt07:07:102
14871997137,9cyclictest181rcu_preempt07:07:102
1486299714,46cyclictest15-21ksoftirqd/009:49:040
1486299713,47cyclictest12889-21wc08:34:550
1486299713,47cyclictest12889-21wc08:34:550
1486299713,39cyclictest32575-21fschecks_count10:14:450
1486299712,26cyclictest15-21ksoftirqd/012:23:560
14871997057,9cyclictest58-21kcompactd009:09:472
14871997032,13cyclictest181rcu_preempt08:24:492
1486299705,30cyclictest15-21ksoftirqd/010:19:470
14862997040,22cyclictest18409-21modprobe07:14:230
1486299703,36cyclictest15-21ksoftirqd/008:19:460
1486299703,33cyclictest15-21ksoftirqd/010:43:070
1486299702,47cyclictest15-21ksoftirqd/010:12:450
1486299702,47cyclictest15-21ksoftirqd/010:12:450
1487199692,35cyclictest39-21ksoftirqd/211:43:192
14871996920,9cyclictest29707-21sh07:49:232
14862996951,13cyclictest24671-21fschecks_time10:54:440
14862996951,13cyclictest24671-21fschecks_time10:54:440
1486299693,45cyclictest14396-21awk12:24:580
1486299692,38cyclictest11872-21munin-run10:34:240
1486299692,37cyclictest15-21ksoftirqd/009:14:390
14862996916,46cyclictest22287-21apt-get09:04:380
1487199684,44cyclictest27113-21mailstats10:04:582
14871996820,25cyclictest0-21swapper/211:56:102
1486299684,39cyclictest15-21ksoftirqd/011:49:560
1486299682,36cyclictest15-21ksoftirqd/007:24:350
1487999673,50cyclictest20632-21taskset08:59:363
1487999673,50cyclictest20632-21taskset08:59:363
1487999673,50cyclictest18602-21chrt08:54:263
14871996739,7cyclictest181rcu_preempt07:39:262
14871996739,7cyclictest181rcu_preempt07:39:262
1486299675,30cyclictest15-21ksoftirqd/011:38:240
14862996726,11cyclictest0-21swapper/008:44:120
1486299672,32cyclictest15-21ksoftirqd/007:34:570
1486299672,32cyclictest15-21ksoftirqd/007:34:570
1487999662,52cyclictest3635-21taskset11:14:243
1487999662,51cyclictest8931-21taskset12:15:263
1487999662,51cyclictest7675-21chrt09:34:263
1487999662,51cyclictest7675-21chrt09:34:263
1487999662,51cyclictest4220-21taskset08:09:343
1486299663,36cyclictest15-21ksoftirqd/007:44:570
14862996610,32cyclictest15-21ksoftirqd/008:10:490
1487999654,45cyclictest0-21swapper/311:04:353
1487999653,49cyclictest28622-21chrt09:14:443
1487999652,50cyclictest5964-21chrt10:24:273
1487999652,50cyclictest31314-21chrt11:59:423
1487999652,50cyclictest16934-21taskset12:29:453
1487999652,50cyclictest13715-21taskset10:35:423
1487999652,50cyclictest13715-21taskset10:35:423
1487999652,49cyclictest8509-21chrt11:20:443
1487999646,45cyclictest14386-21taskset09:44:443
1487999642,50cyclictest22065-21taskset10:49:573
1487999642,49cyclictest19321-21taskset08:54:543
1487999642,49cyclictest19321-21taskset08:54:543
1487999642,47cyclictest10841-21chrt08:29:433
1487999642,47cyclictest10841-21chrt08:29:433
1486299643,33cyclictest17915-21timerandwakeup08:49:590
1487999633,47cyclictest9459-21chrt10:29:473
1487999633,47cyclictest0-21swapper/309:24:373
1487999633,45cyclictest21581-21chrt09:55:223
1487999632,49cyclictest32384-21taskset10:14:393
1487999632,48cyclictest15481-21chrt07:04:513
1487999632,48cyclictest15481-21chrt07:04:513
1487999632,46cyclictest22925-21taskset07:25:123
1486299633,45cyclictest18820-21cpu08:54:400
1486299633,45cyclictest18820-21cpu08:54:400
1487999623,46cyclictest4147-21chrt12:08:543
1487999623,45cyclictest28124-21chrt07:44:233
1487999622,48cyclictest20957-21taskset10:49:123
1487999622,47cyclictest9760-21taskset08:24:583
1487999622,47cyclictest6320-21taskset08:14:493
1487999622,47cyclictest23983-21taskset09:06:373
1487999622,47cyclictest17080-21chrt07:09:413
1487999622,47cyclictest17069-21taskset10:41:423
1487999622,47cyclictest15197-21chrt11:32:443
1487999622,47cyclictest15197-21chrt11:32:443
1487999622,46cyclictest837-21chrt09:22:263
1487999622,46cyclictest837-21chrt09:22:263
1487999622,46cyclictest3666-21taskset08:08:583
1487999622,46cyclictest24605-21chrt07:31:113
1487999622,46cyclictest14267-21chrt12:24:553
1487999622,46cyclictest10518-21chrt09:39:213
1487999613,49cyclictest6666-21taskset10:25:413
1487999613,49cyclictest6666-21taskset10:25:413
1487999613,46cyclictest16011-21chrt08:44:503
1487999613,46cyclictest11569-21chrt11:25:553
1487999613,45cyclictest0-21swapper/310:54:333
1487999613,45cyclictest0-21swapper/310:54:333
1487999613,45cyclictest0-21swapper/310:04:353
1487999613,45cyclictest0-21swapper/307:59:383
1487999613,44cyclictest0-21swapper/307:49:393
1487999613,43cyclictest0-21swapper/309:49:393
1487999613,43cyclictest0-21swapper/309:49:393
1487999612,47cyclictest5210-21chrt12:09:513
1487999612,47cyclictest27684-21taskset10:59:453
1487999612,47cyclictest25810-21chrt09:09:503
1487999612,47cyclictest13640-21chrt09:44:033
1487999612,47cyclictest10664-21chrt12:19:363
1487999612,46cyclictest23123-21taskset11:44:593
1487999612,46cyclictest23123-21taskset11:44:593
1487999612,46cyclictest12596-21chrt08:34:463
1487999612,46cyclictest12596-21chrt08:34:463
1487999603,45cyclictest5592-21chrt11:16:353
1487999603,45cyclictest30592-21chrt10:10:253
1487999603,45cyclictest30592-21chrt10:10:253
1487999603,39cyclictest0-21swapper/308:39:373
1487999602,46cyclictest32600-21taskset07:55:013
1487999602,46cyclictest23358-21taskset09:59:353
1487999602,46cyclictest23358-21taskset09:59:353
1487999602,46cyclictest20772-21chrt11:41:313
1487999602,45cyclictest26302-21chrt11:50:143
1477026014,25sleep30-21swapper/307:04:273
1487999592,45cyclictest26314-21chrt07:37:113
1487999592,45cyclictest26314-21chrt07:37:113
1487999592,45cyclictest18415-21chrt11:38:193
1487999592,44cyclictest29608-21chrt07:48:163
1487999592,44cyclictest29463-21chrt11:55:373
1487999592,44cyclictest19811-21chrt07:16:293
1487999592,43cyclictest21315-21taskset07:20:103
1487999583,40cyclictest0-21swapper/308:19:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional