You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 18:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sat Apr 04, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2673210714,59sleep02702-21apt-config07:03:540
200852940,7sleep10-21swapper/107:54:091
2941999356,28cyclictest8292-21sh08:58:522
2930999167,8cyclictest181rcu_preempt10:43:541
2930999053,11cyclictest181rcu_preempt07:44:261
2930999037,11cyclictest181rcu_preempt11:20:091
161429012,52sleep11651-21/usr/sbin/munin06:59:231
2930998667,11cyclictest7380-21kworker/u17:1-rpciod10:14:241
2930998657,10cyclictest11415-21ssh10:54:091
2941998570,9cyclictest28300-21modprobe09:33:512
2941998570,9cyclictest28300-21modprobe09:33:512
2941998570,8cyclictest0-21swapper/210:53:532
2930998562,16cyclictest2895-21cyclictest12:29:261
2941998450,17cyclictest28217-21kworker/u17:2-ext4-rsv-conversion11:43:532
179628414,44sleep30-21swapper/306:59:293
2941998363,10cyclictest0-21swapper/210:14:212
2941998356,8cyclictest181rcu_preempt07:29:142
2941998354,7cyclictest181rcu_preempt11:18:542
2941998349,7cyclictest181rcu_preempt08:33:552
2941998333,19cyclictest21683-21cpu07:59:092
2930998354,19cyclictest17433-21idleruntime10:09:151
2930998354,19cyclictest17433-21idleruntime10:09:151
2930998349,8cyclictest181rcu_preempt11:54:421
2918998353,10cyclictest58-21kcompactd007:43:540
2918998345,11cyclictest2895-21cyclictest10:37:460
2918998344,19cyclictest2895-21cyclictest11:59:590
2918998344,19cyclictest2895-21cyclictest11:59:590
2941998257,12cyclictest0-21swapper/211:58:532
2941998253,20cyclictest23548-21sort12:09:092
2941998250,10cyclictest181rcu_preempt07:54:262
2918998259,16cyclictest5058-21sh09:48:540
2918998244,10cyclictest181rcu_preempt09:15:230
2941998164,12cyclictest352-21runrttasks10:00:422
2941998152,12cyclictest181rcu_preempt07:38:552
2941998130,32cyclictest0-21swapper/212:02:542
2941998130,32cyclictest0-21swapper/212:02:542
2930998153,7cyclictest31-21ksoftirqd/111:06:411
2930998153,7cyclictest31-21ksoftirqd/111:06:411
2930998143,8cyclictest181rcu_preempt12:22:141
2930998142,11cyclictest181rcu_preempt11:50:041
2930998142,11cyclictest181rcu_preempt11:50:041
2930998142,11cyclictest181rcu_preempt11:50:041
2930998142,11cyclictest181rcu_preempt11:50:041
2930998132,11cyclictest181rcu_preempt10:59:241
2941998064,9cyclictest0-21swapper/210:28:542
2941998055,15cyclictest0-21swapper/210:09:132
2941998055,15cyclictest0-21swapper/210:09:132
2941998050,8cyclictest181rcu_preempt12:04:082
2941998035,18cyclictest58-21kcompactd008:39:252
2941998035,18cyclictest58-21kcompactd008:39:252
2930998061,13cyclictest20610-21cstates12:04:081
2930998027,8cyclictest0-21swapper/112:09:171
2918998037,11cyclictest58-21kcompactd009:35:250
2941997960,9cyclictest0-21swapper/209:54:102
2941997960,14cyclictest300-21rs:main2
2941997954,10cyclictest181rcu_preempt09:23:082
2941997954,10cyclictest181rcu_preempt09:23:082
2930997964,10cyclictest2895-21cyclictest07:49:181
2930997964,10cyclictest2895-21cyclictest07:49:181
2930997940,7cyclictest181rcu_preempt11:34:131
2930997940,7cyclictest181rcu_preempt11:34:131
2930997931,10cyclictest181rcu_preempt11:59:061
2930997931,10cyclictest181rcu_preempt11:59:061
2930997929,17cyclictest0-21swapper/107:59:091
2941997862,9cyclictest0-21swapper/208:19:242
2941997860,9cyclictest0-21swapper/209:24:252
2941997829,8cyclictest181rcu_preempt11:09:082
2930997862,11cyclictest2895-21cyclictest08:19:191
2930997859,12cyclictest0-21swapper/107:18:541
2930997849,20cyclictest544-21cron08:28:521
2930997846,7cyclictest181rcu_preempt08:04:201
2930997846,13cyclictest7136-21kworker/u19:1-flush-179:010:47:121
2930997841,17cyclictest181rcu_preempt09:24:251
2930997830,12cyclictest181rcu_preempt09:53:371
2930997821,38cyclictest0-21swapper/109:11:001
2930997821,38cyclictest0-21swapper/109:11:001
291899785,32cyclictest15-21ksoftirqd/007:24:070
291899785,32cyclictest15-21ksoftirqd/007:24:070
2918997842,19cyclictest58-21kcompactd008:39:530
2918997842,19cyclictest58-21kcompactd008:39:530
2941997762,8cyclictest0-21swapper/212:24:232
2941997758,12cyclictest2879-21sh09:44:272
2941997748,7cyclictest181rcu_preempt08:44:292
2941997739,16cyclictest2895-21cyclictest07:28:542
2941997739,16cyclictest2895-21cyclictest07:28:542
2941997730,10cyclictest181rcu_preempt12:22:492
2930997757,13cyclictest2952-21systemd-journal10:28:071
2930997744,9cyclictest181rcu_preempt08:34:141
2930997744,9cyclictest181rcu_preempt08:34:141
2930997741,15cyclictest24560-21kworker/u18:0-rpciod10:21:381
2930997741,15cyclictest24560-21kworker/u18:0-rpciod10:21:381
2930997731,21cyclictest0-21swapper/111:32:361
2918997743,18cyclictest4557-21kworker/u19:2-writeback10:00:170
2918997741,15cyclictest2895-21cyclictest11:51:470
2918997741,15cyclictest2895-21cyclictest11:51:470
2918997741,15cyclictest2895-21cyclictest11:51:470
2918997741,15cyclictest2895-21cyclictest11:51:470
2941997656,11cyclictest0-21swapper/209:34:212
2941997641,7cyclictest181rcu_preempt09:07:542
2930997640,8cyclictest181rcu_preempt07:39:211
2918997655,15cyclictest544-21cron10:53:520
2918997649,20cyclictest5762-21kworker/u17:1+nfsiod09:08:000
2918997643,16cyclictest58-21kcompactd007:54:170
2918997640,8cyclictest181rcu_preempt09:30:210
2918997640,8cyclictest181rcu_preempt09:30:210
2918997639,11cyclictest58-21kcompactd010:56:270
2918997637,10cyclictest0-21swapper/010:32:410
261927612,41sleep22627-21modprobe07:03:522
2941997557,9cyclictest0-21swapper/211:34:082
2941997557,9cyclictest0-21swapper/211:34:082
2941997549,18cyclictest26877-21processes11:19:262
2941997536,19cyclictest23663-21latency08:04:182
2941997525,8cyclictest181rcu_preempt07:19:572
2930997554,8cyclictest31-21ksoftirqd/111:47:241
2930997554,8cyclictest31-21ksoftirqd/111:47:241
2930997553,15cyclictest2895-21cyclictest10:49:191
2930997540,11cyclictest181rcu_preempt09:19:111
2930997540,11cyclictest181rcu_preempt09:19:111
2930997538,8cyclictest181rcu_preempt09:31:091
2930997538,8cyclictest181rcu_preempt09:31:091
2930997538,7cyclictest181rcu_preempt07:34:251
2930997536,7cyclictest181rcu_preempt11:41:501
2930997535,7cyclictest181rcu_preempt11:15:411
2918997540,11cyclictest7470-21sh10:47:150
2918997538,10cyclictest24740-21latency_hist08:08:550
2918997533,8cyclictest181rcu_preempt11:37:150
2918997533,8cyclictest181rcu_preempt11:37:150
2941997460,9cyclictest26192-21modprobe08:13:522
2941997460,9cyclictest26192-21modprobe08:13:522
2941997457,9cyclictest29227-21ssh11:24:072
2941997457,9cyclictest29227-21ssh11:24:072
2941997454,7cyclictest181rcu_preempt10:08:532
2941997447,15cyclictest181rcu_preempt07:44:162
2941997441,17cyclictest2228-21kworker/u17:0-xprtiod12:32:482
2941997435,16cyclictest15867-21ssh09:12:312
2941997435,16cyclictest15867-21ssh09:12:312
2941997433,12cyclictest181rcu_preempt10:48:032
2941997432,17cyclictest0-21swapper/212:17:092
2941997429,19cyclictest13407-21ssh10:57:152
2930997450,15cyclictest2730-21ntp_kernel_pll_09:44:221
2930997447,9cyclictest181rcu_preempt12:15:491
2930997444,22cyclictest32502-21cstates12:24:091
2930997443,7cyclictest181rcu_preempt08:54:181
2930997443,10cyclictest181rcu_preempt08:49:111
2930997441,25cyclictest1-21systemd10:33:531
2930997441,12cyclictest13060-21ssh10:01:431
2930997433,8cyclictest181rcu_preempt10:04:131
2918997454,14cyclictest23514-21latency10:19:180
2918997454,14cyclictest23514-21latency10:19:180
2918997451,12cyclictest5598-21sshd09:49:490
2918997443,10cyclictest181rcu_preempt11:08:330
2918997443,10cyclictest181rcu_preempt11:08:330
2918997436,11cyclictest170-21jbd2/mmcblk2p2-807:49:080
2918997436,11cyclictest170-21jbd2/mmcblk2p2-807:49:080
2918997435,9cyclictest181rcu_preempt12:26:160
2941997348,7cyclictest181rcu_preempt09:49:202
2941997340,17cyclictest5594-21kworker/u18:2-rpciod11:08:172
2941997340,17cyclictest5594-21kworker/u18:2-rpciod11:08:172
2930997345,7cyclictest181rcu_preempt07:10:221
2930997345,7cyclictest181rcu_preempt07:10:221
293099733,25cyclictest8714-21apt-get07:19:071
2930997319,37cyclictest20204-21sort11:09:021
2918997342,10cyclictest24890-21kworker/u18:0-ext4-rsv-conversion08:23:560
2918997341,10cyclictest24865-21runrttasks09:27:360
2918997339,10cyclictest58-21kcompactd009:39:160
2918997339,10cyclictest58-21kcompactd009:39:160
2918997338,8cyclictest181rcu_preempt10:39:060
2941997244,7cyclictest181rcu_preempt09:43:542
2941997244,7cyclictest181rcu_preempt09:43:542
2941997240,7cyclictest181rcu_preempt10:33:582
2941997236,15cyclictest58-21kcompactd011:46:062
2941997236,15cyclictest58-21kcompactd011:46:062
2941997228,14cyclictest0-21swapper/209:03:312
2941997226,17cyclictest0-21swapper/210:59:272
2930997251,12cyclictest0-21swapper/109:14:291
2930997250,12cyclictest0-21swapper/109:03:561
2930997249,17cyclictest13387-21latency_hist07:33:541
2930997244,8cyclictest181rcu_preempt08:14:071
2930997242,9cyclictest181rcu_preempt08:45:581
2918997259,9cyclictest2895-21cyclictest12:04:070
2918997253,13cyclictest300-21rs:main0
2918997241,7cyclictest181rcu_preempt09:13:560
2918997241,7cyclictest181rcu_preempt09:13:560
2918997231,10cyclictest0-21swapper/008:34:200
2918997231,10cyclictest0-21swapper/008:34:200
2941997153,12cyclictest0-21swapper/207:08:592
2941997153,12cyclictest0-21swapper/207:08:592
2941997151,7cyclictest181rcu_preempt10:29:092
2941997151,7cyclictest181rcu_preempt09:14:142
2941997151,7cyclictest181rcu_preempt07:49:262
2941997151,7cyclictest181rcu_preempt07:49:262
2941997151,7cyclictest181rcu_preempt07:14:212
2941997139,9cyclictest181rcu_preempt11:50:062
2941997139,9cyclictest181rcu_preempt11:50:062
2941997139,9cyclictest181rcu_preempt11:50:062
2941997139,9cyclictest181rcu_preempt11:50:062
2941997135,8cyclictest181rcu_preempt08:18:542
2941997130,18cyclictest0-21swapper/207:43:532
2930997150,9cyclictest181rcu_preempt09:06:451
2930997148,7cyclictest181rcu_preempt10:37:491
2930997131,16cyclictest0-21swapper/111:28:181
2930997131,16cyclictest0-21swapper/111:28:181
2918997153,13cyclictest17805-21sh10:09:250
2918997153,13cyclictest17805-21sh10:09:250
2918997144,9cyclictest181rcu_preempt11:41:250
2918997142,8cyclictest181rcu_preempt07:44:270
2918997139,11cyclictest2895-21cyclictest12:21:560
2918997138,10cyclictest4846-21kworker/u18:1-rpciod10:15:000
2918997137,15cyclictest58-21kcompactd010:24:380
2918997137,10cyclictest22115-21sh11:11:430
2918997134,8cyclictest181rcu_preempt11:22:380
2941997051,7cyclictest181rcu_preempt07:05:052
2941997050,7cyclictest181rcu_preempt11:29:182
2941997048,8cyclictest181rcu_preempt08:25:282
2941997048,7cyclictest181rcu_preempt08:38:542
2941997048,7cyclictest181rcu_preempt08:38:542
2941997031,17cyclictest0-21swapper/208:49:262
2930997042,10cyclictest181rcu_preempt07:28:551
2930997042,10cyclictest181rcu_preempt07:28:551
2918997057,9cyclictest2895-21cyclictest11:32:210
2918997050,14cyclictest3850-21processes07:05:210
2918997049,8cyclictest181rcu_preempt07:12:090
2918997049,8cyclictest181rcu_preempt07:12:090
2918997037,8cyclictest181rcu_preempt11:57:480
2918997034,8cyclictest181rcu_preempt12:12:240
2941996949,9cyclictest0-21swapper/210:19:102
2941996949,9cyclictest0-21swapper/210:19:102
2930996951,12cyclictest32486-21sh09:39:271
2930996951,12cyclictest32486-21sh09:39:271
2930996948,8cyclictest181rcu_preempt08:39:171
2930996948,8cyclictest181rcu_preempt08:39:171
2930996942,7cyclictest181rcu_preempt09:58:521
2930996936,12cyclictest181rcu_preempt08:13:551
2930996936,12cyclictest181rcu_preempt08:13:551
2918996940,8cyclictest181rcu_preempt07:34:180
2918996926,20cyclictest181rcu_preempt12:15:010
2930996833,7cyclictest181rcu_preempt09:35:161
2930996829,14cyclictest0-21swapper/108:29:131
2918996854,10cyclictest2895-21cyclictest10:07:290
2918996854,10cyclictest2895-21cyclictest08:59:220
2918996849,13cyclictest29963-21cut08:25:150
2918996838,10cyclictest58-21kcompactd009:20:200
2918996838,10cyclictest58-21kcompactd009:20:200
2918996836,9cyclictest5123-21kworker/u18:3-flush-0:3211:00:310
2918996836,10cyclictest0-21swapper/011:47:320
2918996836,10cyclictest0-21swapper/011:47:320
2918996753,9cyclictest58-21kcompactd007:17:430
2918996749,12cyclictest352-21runrttasks11:24:120
2918996749,12cyclictest352-21runrttasks11:24:120
2918996737,10cyclictest58-21kcompactd008:51:080
2918996733,7cyclictest181rcu_preempt09:54:000
2918996732,8cyclictest181rcu_preempt12:33:320
48382660,7sleep30-21swapper/307:08:593
48382660,7sleep30-21swapper/307:08:593
2930996630,15cyclictest0-21swapper/107:08:091
2918996631,9cyclictest181rcu_preempt07:23:550
2918996549,11cyclictest58-21kcompactd007:33:300
2918996539,9cyclictest58-21kcompactd008:09:160
2918996539,9cyclictest58-21kcompactd008:09:160
2918996349,10cyclictest2895-21cyclictest11:15:330
2918996335,10cyclictest0-21swapper/008:30:350
2918996245,10cyclictest28307-21kworker/u19:0-events_unbound07:59:140
57182600,7sleep30-21swapper/309:50:123
2918995846,8cyclictest58-21kcompactd008:58:170
2918995642,8cyclictest0-21swapper/008:14:280
143252550,7sleep30-21swapper/307:34:273
2946995134,10cyclictest232232sleep311:14:053
2946995119,23cyclictest2068-1kworker/3:1H+kblockd11:49:493
2946995119,23cyclictest2068-1kworker/3:1H+kblockd11:49:493
2946995119,23cyclictest2068-1kworker/3:1H+kblockd11:49:493
2946995119,23cyclictest2068-1kworker/3:1H+kblockd11:49:493
294699504,36cyclictest9595-21chrt11:44:293
294699504,36cyclictest9595-21chrt11:44:293
294699504,34cyclictest19513-21taskset09:18:543
294699503,34cyclictest8221-21taskset07:18:513
294699493,35cyclictest5809-21taskset10:44:173
294699493,35cyclictest10586-21chrt09:04:223
294699493,34cyclictest1951-21taskset10:38:253
284082490,6sleep30-21swapper/310:28:153
294699484,34cyclictest2262-21taskset11:33:513
294699484,32cyclictest5290-21taskset11:38:533
294699484,32cyclictest5290-21taskset11:38:533
294699484,31cyclictest28890-21taskset10:28:563
294699484,30cyclictest2084-21chrt09:43:563
294699483,35cyclictest23747-21taskset12:09:153
294699483,35cyclictest10253-21taskset09:57:103
294699483,34cyclictest21132-21taskset12:04:243
294699483,34cyclictest16635-21taskset07:43:553
294699483,34cyclictest13566-21taskset10:57:423
294699483,33cyclictest2319-21taskset12:28:123
294699483,30cyclictest4705-21taskset07:08:553
238692480,3sleep30-21swapper/309:24:463
294699474,34cyclictest16384-21taskset09:13:523
294699474,34cyclictest16384-21taskset09:13:523
294699474,32cyclictest7240-21taskset08:54:143
294699474,32cyclictest19823-21chrt09:19:113
294699474,32cyclictest19823-21chrt09:19:113
294699474,31cyclictest18141-21chrt07:48:533
294699474,30cyclictest5324-21chrt08:49:073
294699474,29cyclictest29077-21taskset11:23:583
294699474,29cyclictest29077-21taskset11:23:583
294699473,34cyclictest20198-21taskset12:03:523
294699473,34cyclictest20198-21taskset12:03:523
294699473,34cyclictest13354-21taskset10:02:333
294699473,33cyclictest8717-21taskset07:19:043
294699473,33cyclictest32189-21taskset12:23:543
294699473,33cyclictest20283-21taskset10:14:123
294699473,33cyclictest17285-21taskset11:04:073
294699473,33cyclictest17285-21taskset11:04:073
294699473,33cyclictest16492-21taskset11:02:373
294699473,33cyclictest14621-21taskset11:54:073
294699472,35cyclictest18804-21taskset10:11:123
294699472,35cyclictest18804-21taskset10:11:123
294699465,31cyclictest27681-21taskset12:14:503
294699464,31cyclictest26352-21taskset11:19:113
294699463,33cyclictest9979-21chrt09:03:543
294699463,33cyclictest8855-21chrt10:49:193
294699463,33cyclictest31621-21taskset08:29:153
294699463,32cyclictest5093-21taskset09:48:543
294699463,32cyclictest3546-21taskset10:39:303
294699463,32cyclictest26177-21taskset09:29:203
294699463,32cyclictest26177-21taskset09:29:203
294699454,31cyclictest23578-21taskset08:04:163
294699454,30cyclictest26979-21taskset08:14:203
294699454,30cyclictest20514-21taskset11:09:143
294699454,30cyclictest1125-21chrt09:41:533
294699453,32cyclictest828-21taskset08:34:173
294699453,32cyclictest828-21taskset08:34:173
294699453,32cyclictest6952-21taskset11:40:193
294699453,32cyclictest4704-21taskset12:31:323
294699453,32cyclictest3868-21taskset08:44:133
294699453,32cyclictest30874-21chrt09:37:393
294699453,31cyclictest31138-21taskset08:28:543
294699453,31cyclictest2645-21chrt08:39:233
294699453,31cyclictest2645-21chrt08:39:233
294699453,31cyclictest19358-21chrt07:49:303
294699453,31cyclictest19358-21chrt07:49:303
294699453,31cyclictest15250-21taskset10:04:323
294699453,29cyclictest23186-21taskset08:03:553
294699453,29cyclictest11689-21taskset07:28:523
294699453,29cyclictest11689-21taskset07:28:523
294699443,31cyclictest20166-21chrt07:54:113
294699443,30cyclictest24343-21taskset10:20:043
294699443,30cyclictest24343-21taskset10:20:043
294699432,29cyclictest28067-21taskset08:18:583
294699423,30cyclictest25038-21chrt08:09:143
294699423,30cyclictest25038-21chrt08:09:143
294699423,29cyclictest11935-21taskset07:29:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional