You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 22:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack4slot1.osadl.org (updated Thu Aug 06, 2026 11:26:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1124499247241,4cyclictest32128-21find08:11:391
1124599218212,4cyclictest3928-21systemd-journal08:11:402
1670021420,3sleep3321rcuc/307:30:493
1670021420,3sleep3321rcuc/307:30:493
1985321290,3chrt0-21swapper/307:13:183
2513921270,2chrt25140-21benchlatencyplo08:00:130
2513921270,2chrt25140-21benchlatencyplo08:00:130
2513921270,2chrt25140-21benchlatencyplo08:00:130
1405221250,3sleep30-21swapper/308:06:083
1405221250,3sleep30-21swapper/308:06:083
2872921240,2sleep30-21swapper/308:11:193
2872921240,2sleep30-21swapper/308:11:193
1699821230,3sleep30-21swapper/311:18:183
1699821230,3sleep30-21swapper/311:18:183
1699821230,3sleep30-21swapper/311:18:183
596421160,4sleep3321rcuc/307:22:283
775821150,3sleep10-21swapper/110:36:241
775821150,3sleep10-21swapper/110:36:241
775821150,3sleep10-21swapper/110:36:241
1279721140,3sleep30-21swapper/307:33:553
1279721140,3sleep30-21swapper/307:33:553
1643921120,2chrt0-21swapper/110:45:121
1643921120,2chrt0-21swapper/110:45:121
1237421120,3sleep30-21swapper/307:19:383
1237421120,3sleep30-21swapper/307:19:383
617921100,1sleep10-21swapper/108:01:391
617921100,1sleep10-21swapper/108:01:391
734021090,4sleep07339-21benchlatencyplo07:54:410
734021090,4sleep07339-21benchlatencyplo07:54:410
1314821080,9sleep121-21ksoftirqd/111:14:511
1314821080,9sleep121-21ksoftirqd/111:14:511
39221050,2sleep30-21swapper/311:01:303
1132021050,3sleep30-21swapper/311:12:203
1132021050,3sleep30-21swapper/311:12:203
555921030,3sleep00-21swapper/007:26:040
2607621030,4sleep10-21swapper/107:24:441
952921000,2chrt0-21swapper/307:37:053
952921000,2chrt0-21swapper/307:37:053
952921000,2chrt0-21swapper/307:37:053
1289721000,9sleep012-21ksoftirqd/007:16:090
260292990,2sleep126028-21benchlatencyplo07:38:571
260292990,2sleep126028-21benchlatencyplo07:38:571
260292990,2sleep126028-21benchlatencyplo07:38:571
66782980,4sleep16674-21benchlatencyplo07:58:081
66782980,4sleep16674-21benchlatencyplo07:58:081
66782980,4sleep16674-21benchlatencyplo07:58:081
192702960,3sleep00-21swapper/009:01:370
198192950,3chrt0-21swapper/107:16:511
198192950,3chrt0-21swapper/107:16:511
293982920,6sleep30-21swapper/308:11:243
232322920,3sleep30-21swapper/307:45:473
232322920,3sleep30-21swapper/307:45:473
187712920,3sleep10-21swapper/108:10:131
187712920,3sleep10-21swapper/108:10:131
18572920,5sleep11856-21cut07:36:191
18572920,5sleep11856-21cut07:36:191
132172920,7chrt0-21swapper/307:51:423
132172920,7chrt0-21swapper/307:51:423
249562880,3chrt0-21swapper/310:53:263
283012860,3sleep30-21swapper/309:51:163
283012860,3sleep30-21swapper/309:51:163
170062830,3sleep117004-21benchlatencyplo07:30:521
170062830,3sleep117004-21benchlatencyplo07:30:521
310062820,3chrt31007-21benchlatencyplo07:18:070
310062820,3chrt31007-21benchlatencyplo07:18:070
80402770,3sleep08035-21benchlatencyplo08:01:500
80402770,3sleep08035-21benchlatencyplo08:01:500
24782770,4sleep1201rcuc/107:43:271
24782770,4sleep1201rcuc/107:43:271
7752750,3sleep30-21swapper/307:46:473
7752750,3sleep30-21swapper/307:46:473
134492720,3sleep00-21swapper/007:41:090
134492720,3sleep00-21swapper/007:41:090
134492720,3sleep00-21swapper/007:41:090
59132710,6sleep05912-21benchlatencyplo07:43:510
59132710,6sleep05912-21benchlatencyplo07:43:510
97082700,3sleep30-21swapper/310:05:153
97082700,3sleep30-21swapper/310:05:153
210192680,3sleep00-21swapper/008:06:500
210192680,3sleep00-21swapper/008:06:500
144772670,2chrt14471-21tr07:30:340
144772670,2chrt14471-21tr07:30:340
315982660,5chrt0-21swapper/308:00:563
315982660,5chrt0-21swapper/308:00:563
315982660,5chrt0-21swapper/308:00:563
75202640,3sleep30-21swapper/311:08:543
75202640,3sleep30-21swapper/311:08:543
106772640,2sleep30-21swapper/308:41:263
106772640,2sleep30-21swapper/308:41:263
165302590,2sleep216704-21ts2lt08:06:242
165302590,2sleep216704-21ts2lt08:06:242
155912580,4sleep10-21swapper/110:11:201
155912580,4sleep10-21swapper/110:11:201
315212570,2sleep131678-21ts2lt07:14:381
201972570,3sleep00-21swapper/007:48:580
201972570,3sleep00-21swapper/007:48:580
227142560,2sleep022723-21sh10:17:510
227142560,2sleep022723-21sh10:17:510
227142560,2sleep022723-21sh10:17:510
189982560,3chrt0-21swapper/007:34:370
189982560,3chrt0-21swapper/007:34:370
59532542,37sleep26070-21benchlatencyplo07:11:372
322632540,3sleep10-21swapper/110:27:311
322632540,3sleep10-21swapper/110:27:311
194542530,2sleep219595-21benchlatencyplo07:20:272
194542530,2sleep219595-21benchlatencyplo07:20:272
185772530,2sleep018617-21/usr/sbin/munin10:46:370
185772530,2sleep018617-21/usr/sbin/munin10:46:370
158472520,2sleep115860-21ssh11:16:411
158472520,2sleep115860-21ssh11:16:411
158472520,2sleep115860-21ssh11:16:411
147542520,2sleep114910-21benchlatencyplo07:51:541
147542520,2sleep114910-21benchlatencyplo07:51:541
265632510,2sleep226702-21ts2lt07:56:452
265632510,2sleep226702-21ts2lt07:56:452
265632510,2sleep226702-21ts2lt07:56:452
76272500,2sleep27774-21ts2lt07:54:442
76272500,2sleep27774-21ts2lt07:54:442
125082490,4sleep112503-21benchlatencyplo07:48:061
125082490,4sleep112503-21benchlatencyplo07:48:061
304562480,4chrt0-21swapper/309:52:243
304562480,4chrt0-21swapper/309:52:243
281122470,2sleep00-21swapper/009:51:050
281122470,2sleep00-21swapper/009:51:050
25742470,3sleep10-21swapper/109:24:251
25742470,3sleep10-21swapper/109:24:251
241912470,3sleep10-21swapper/110:19:561
241912470,3sleep10-21swapper/110:19:561
241912470,3sleep10-21swapper/110:19:561
174842460,3sleep20-21swapper/211:19:022
174842460,3sleep20-21swapper/211:19:022
174842460,3sleep20-21swapper/211:19:022
1124499451,5cyclictest5152-21find09:26:351
1124499451,5cyclictest5152-21find09:26:351
237862440,2sleep123781-21cpuspeed09:46:231
237862440,2sleep123781-21cpuspeed09:46:231
64982430,3sleep10-21swapper/110:34:591
64982430,3sleep10-21swapper/110:34:591
261952430,2sleep30-21swapper/309:15:553
118802430,3sleep20-21swapper/207:40:592
118802430,3sleep20-21swapper/207:40:592
118802430,3sleep20-21swapper/207:40:592
310502410,2sleep231047-21cat07:25:172
1124499402,34cyclictest18713-21awk09:01:301
1124099401,6cyclictest761-21find11:01:360
1124499391,4cyclictest22942-21find09:11:361
1124099393,3cyclictest2077-21find09:56:370
1124099393,3cyclictest2077-21find09:56:370
1124099393,3cyclictest2077-21find09:56:370
1124099391,5cyclictest1785-21find08:16:360
1124099391,5cyclictest1785-21find08:16:360
1124099391,4cyclictest31309-21sh10:26:370
1124099391,4cyclictest31309-21sh10:26:370
1124099391,4cyclictest13286-21find08:46:350
1124099391,4cyclictest13286-21find08:46:350
1124099391,34cyclictest30578-21memory08:11:290
1124499382,33cyclictest9413-21if_eth009:31:271
11240993810,25cyclictest20603-21seq09:06:310
1124499371,33cyclictest21702-21cat09:11:151
1124099371,5cyclictest27773-21find09:16:340
1124099371,5cyclictest27773-21find09:16:340
1124099371,5cyclictest27773-21find09:16:340
1124099371,5cyclictest15245-21grep08:51:360
1124099371,5cyclictest15245-21grep08:51:360
1124099371,4cyclictest15245-21ntp_states11:16:320
1124099371,4cyclictest15245-21ntp_states11:16:320
1124099371,4cyclictest15245-21ntp_states11:16:320
1124099371,33cyclictest0-21swapper/009:51:230
1124099371,33cyclictest0-21swapper/009:51:230
1124099371,32cyclictest5818-21/usr/sbin/munin10:01:280
1124099371,32cyclictest5818-21/usr/sbin/munin10:01:280
54122360,3chrt0-21swapper/009:26:370
54122360,3chrt0-21swapper/009:26:370
213612360,3sleep30-21swapper/310:16:323
213612360,3sleep30-21swapper/310:16:323
213612360,3sleep30-21swapper/310:16:323
139782360,6sleep04972-1kworker/0:0H10:41:380
139782360,6sleep04972-1kworker/0:0H10:41:380
1124499361,5cyclictest15092-21find09:36:361
1124499361,5cyclictest15092-21find09:36:361
1124499361,4cyclictest15240-21find08:51:351
1124499361,4cyclictest15240-21find08:51:351
1124099361,6cyclictest11315-21find08:41:360
1124099361,6cyclictest11315-21find08:41:360
1124099361,33cyclictest16514-21awk08:56:250
1124099361,33cyclictest16514-21awk08:56:250
58962350,4sleep30-21swapper/310:34:093
58962350,4sleep30-21swapper/310:34:093
290382350,3sleep00-21swapper/010:24:570
1124499351,32cyclictest29768-21/usr/sbin/munin09:51:361
1124499351,32cyclictest29768-21/usr/sbin/munin09:51:361
1124099350,6cyclictest9403-21find08:36:370
1124099350,6cyclictest9403-21find08:36:370
1124099350,6cyclictest9403-21find08:36:370
78972340,2sleep27895-21cut07:51:132
78972340,2sleep27895-21cut07:51:132
1124599342,6cyclictest27-21ksoftirqd/209:26:352
1124599342,6cyclictest27-21ksoftirqd/209:26:352
1124499342,29cyclictest6769-21fschecks_count08:31:241
1124499341,5cyclictest23417-21find10:51:361
1124099341,6cyclictest7501-21find08:31:340
1124099341,5cyclictest73-21kswapd009:31:370
1124099341,5cyclictest16732-21find10:11:350
1124099341,5cyclictest16732-21find10:11:350
1124099341,4cyclictest10262-21/usr/sbin/munin11:11:330
1124099341,4cyclictest10262-21/usr/sbin/munin11:11:330
1124099341,31cyclictest23113-21unixbench-2d09:11:370
1124099341,29cyclictest27172-21/usr/sbin/munin10:56:380
1124099341,29cyclictest27172-21/usr/sbin/munin10:56:380
1124099340,6cyclictest20859-21ssh11:21:550
1124099340,6cyclictest20859-21ssh11:21:550
100982340,3sleep10-21swapper/110:05:491
100982340,3sleep10-21swapper/110:05:491
1124499338,22cyclictest24123-21latency_hist11:26:211
1124499332,28cyclictest27368-21/usr/sbin/munin09:16:271
1124499332,28cyclictest27368-21/usr/sbin/munin09:16:271
1124499332,28cyclictest27368-21/usr/sbin/munin09:16:271
1124499330,6cyclictest5604-21find11:06:361
1124499330,6cyclictest5604-21find11:06:361
1124499330,5cyclictest16732-21find10:11:361
1124499330,5cyclictest16732-21find10:11:361
1124099331,7cyclictest7636-21acpi10:36:230
1124099331,7cyclictest7636-21acpi10:36:230
1124099331,7cyclictest7636-21acpi10:36:230
1124099331,7cyclictest32386-21ntpq09:21:300
1124099331,7cyclictest32386-21ntpq09:21:300
1124099331,7cyclictest22334-21/usr/sbin/munin10:51:350
1124099331,7cyclictest0-21swapper/010:31:360
1124099331,7cyclictest0-21swapper/010:31:360
1124099330,5cyclictest19944-21sh09:41:360
1124099330,5cyclictest19944-21sh09:41:360
1124599325,9cyclictest27-21ksoftirqd/207:45:002
1124599325,9cyclictest27-21ksoftirqd/207:45:002
1124499328,20cyclictest0-21swapper/108:16:281
1124499328,20cyclictest0-21swapper/108:16:281
1124499326,23cyclictest9660-21head08:36:381
1124499326,23cyclictest9660-21head08:36:381
1124499326,23cyclictest9660-21head08:36:381
1124499322,6cyclictest13573-21grep08:46:371
1124499322,6cyclictest13573-21grep08:46:371
1124499321,7cyclictest32664-21sed11:01:281
1124499321,6cyclictest30537-21ssh10:59:261
1124499321,6cyclictest30537-21ssh10:59:261
1124499321,6cyclictest22150-21sh09:44:281
1124499321,6cyclictest22150-21sh09:44:281
1124499321,5cyclictest3430-21ntp_states08:21:301
1124499321,5cyclictest3430-21ntp_states08:21:301
1124499321,5cyclictest26101-21awk10:21:311
1124499321,4cyclictest11093-21wc08:41:331
1124499321,4cyclictest11093-21wc08:41:331
1124099321,6cyclictest5604-21find11:06:370
1124099321,6cyclictest5604-21find11:06:370
1124099321,6cyclictest11806-21wc10:06:380
1124099321,6cyclictest11806-21wc10:06:380
197612310,2sleep30-21swapper/309:06:143
1124599314,5cyclictest27-21ksoftirqd/208:03:022
1124599314,5cyclictest27-21ksoftirqd/208:03:022
11245993110,4cyclictest131rcu_preempt09:31:372
1124499318,20cyclictest21610-21diskmemload10:01:001
1124499318,20cyclictest21610-21diskmemload10:01:001
1124499318,20cyclictest21610-21diskmemload10:01:001
1124499311,9cyclictest20426-21sed11:21:371
1124499311,7cyclictest16137-21/usr/sbin/munin08:56:231
1124499311,7cyclictest16137-21/usr/sbin/munin08:56:231
1124499311,6cyclictest5270-21ntp_kernel_pll_08:26:291
1124499311,11cyclictest18504-21switchtime10:46:351
1124499311,11cyclictest18504-21switchtime10:46:351
1124099312,6cyclictest5828-21head08:26:360
1124099310,9cyclictest3555-21rt-features08:21:330
1124099310,9cyclictest3555-21rt-features08:21:330
297782300,2sleep229785-21sh09:18:562
297782300,2sleep229785-21sh09:18:562
297782300,2sleep229785-21sh09:18:562
1125199301,25cyclictest13278-21taskset10:08:163
1125199301,25cyclictest13278-21taskset10:08:163
1124599305,5cyclictest27-21ksoftirqd/207:30:542
1124599305,5cyclictest27-21ksoftirqd/207:30:542
1124599304,8cyclictest27-21ksoftirqd/207:32:112
1124599304,8cyclictest27-21ksoftirqd/207:32:112
11245993017,10cyclictest22108-21ssh11:23:412
11245993017,10cyclictest22108-21ssh11:23:412
1124099301,10cyclictest14114-21df09:36:240
1124099301,10cyclictest14114-21df09:36:240
1125199291,24cyclictest15677-21chrt08:53:403
1125199291,24cyclictest15677-21chrt08:53:403
1125199290,25cyclictest2290-21chrt08:18:513
1125199290,25cyclictest2290-21chrt08:18:513
150662280,3sleep30-21swapper/310:43:093
150662280,3sleep30-21swapper/310:43:093
1125199271,22cyclictest9769-21taskset08:37:203
1125199271,22cyclictest9769-21taskset08:37:203
1125199271,22cyclictest9769-21taskset08:37:203
1125199271,22cyclictest21322-21chrt09:07:553
1125199271,22cyclictest17499-21chrt08:58:023
1125199271,22cyclictest17499-21chrt08:58:023
1125199271,22cyclictest17044-21taskset10:11:383
1125199271,22cyclictest17044-21taskset10:11:383
1125199271,22cyclictest13877-21chrt08:49:423
1125199271,22cyclictest13877-21chrt08:49:423
322472260,2sleep30-21swapper/310:27:293
322472260,2sleep30-21swapper/310:27:293
114832260,3chrt0-21swapper/310:40:083
114832260,3chrt0-21swapper/310:40:083
114832260,3chrt0-21swapper/310:40:083
1125199261,22cyclictest5919-21chrt08:26:553
1125199261,22cyclictest31398-21chrt09:21:133
1125199261,22cyclictest31398-21chrt09:21:133
1125199261,22cyclictest31398-21chrt09:21:133
1125199261,22cyclictest30053-21taskset10:26:173
1125199261,22cyclictest22900-21chrt11:24:543
1125199261,22cyclictest22900-21chrt11:24:543
1125199261,22cyclictest19243-21chrt10:47:113
1125199261,22cyclictest19243-21chrt10:47:113
1125199261,21cyclictest4077-21chrt08:22:373
1125199261,21cyclictest4077-21chrt08:22:373
1125199261,21cyclictest19311-21chrt09:41:273
1125199261,21cyclictest19311-21chrt09:41:273
1125199261,21cyclictest15466-21taskset09:36:453
1125199261,21cyclictest15466-21taskset09:36:453
1124599268,13cyclictest27-21ksoftirqd/209:56:372
1124599268,13cyclictest27-21ksoftirqd/209:56:372
1124599268,13cyclictest27-21ksoftirqd/209:56:372
11245992619,5cyclictest27-21ksoftirqd/210:01:362
11245992619,5cyclictest27-21ksoftirqd/210:01:362
11245992616,4cyclictest27-21ksoftirqd/209:39:022
11245992616,4cyclictest27-21ksoftirqd/209:39:022
117402250,2sleep20-21swapper/211:12:552
117402250,2sleep20-21swapper/211:12:552
1125199251,21cyclictest9016-21chrt09:31:223
1125199251,21cyclictest7839-21chrt08:32:143
1125199251,21cyclictest2977-21chrt09:57:313
1125199251,21cyclictest2977-21chrt09:57:313
1125199251,21cyclictest2977-21chrt09:57:313
1125199251,21cyclictest0-21swapper/309:28:093
1125199251,21cyclictest0-21swapper/309:28:093
1125199251,20cyclictest977-21taskset09:22:103
1125199251,20cyclictest977-21taskset09:22:103
1124599256,5cyclictest27-21ksoftirqd/208:31:342
1124599254,3cyclictest131rcu_preempt09:21:352
1124599254,3cyclictest131rcu_preempt09:21:352
11245992512,10cyclictest32314-21fschecks_count11:01:252
11245992511,6cyclictest27-21ksoftirqd/210:07:482
11245992511,6cyclictest27-21ksoftirqd/210:07:482
11245992510,8cyclictest27-21ksoftirqd/208:26:132
11245992510,8cyclictest27-21ksoftirqd/208:26:132
1124599248,8cyclictest27-21ksoftirqd/209:15:232
1124599246,10cyclictest27-21ksoftirqd/210:42:132
1124599246,10cyclictest27-21ksoftirqd/210:42:132
1124599245,11cyclictest27-21ksoftirqd/208:26:272
1124599243,11cyclictest27-21ksoftirqd/210:58:222
1124599243,11cyclictest27-21ksoftirqd/210:58:222
11245992417,5cyclictest27-21ksoftirqd/211:06:372
11245992417,5cyclictest27-21ksoftirqd/211:06:372
1125199231,18cyclictest0-21swapper/310:56:253
1125199231,18cyclictest0-21swapper/310:56:253
1124599239,8cyclictest27-21ksoftirqd/210:52:012
1124599239,7cyclictest27-21ksoftirqd/210:14:152
1124599239,7cyclictest27-21ksoftirqd/210:14:152
1124599239,7cyclictest27-21ksoftirqd/208:50:482
1124599239,7cyclictest27-21ksoftirqd/208:50:482
1124599238,4cyclictest27-21ksoftirqd/210:48:172
1124599238,4cyclictest27-21ksoftirqd/210:48:172
1124599233,5cyclictest27-21ksoftirqd/210:16:242
1124599233,5cyclictest27-21ksoftirqd/210:16:242
1124599233,5cyclictest27-21ksoftirqd/210:16:242
1124599232,7cyclictest27-21ksoftirqd/209:01:362
11245992316,5cyclictest7212-21ssh10:36:032
11245992316,5cyclictest7212-21ssh10:36:032
1124599228,7cyclictest27-21ksoftirqd/209:45:522
1124599228,7cyclictest27-21ksoftirqd/209:45:522
11245992212,4cyclictest27-21ksoftirqd/209:54:492
11245992212,4cyclictest27-21ksoftirqd/209:54:492
11245992212,4cyclictest27-21ksoftirqd/208:57:542
11245992212,4cyclictest27-21ksoftirqd/208:57:542
11245992210,4cyclictest131rcu_preempt09:46:352
11245992210,4cyclictest131rcu_preempt09:46:352
1124599216,2cyclictest131rcu_preempt08:36:392
1124599216,2cyclictest131rcu_preempt08:36:392
1124599216,2cyclictest131rcu_preempt08:36:392
1124599215,4cyclictest131rcu_preempt10:26:252
1124599215,4cyclictest131rcu_preempt10:26:252
11245992114,5cyclictest0-21swapper/210:21:262
1124599211,17cyclictest2026-21sed08:16:372
1124599211,17cyclictest2026-21sed08:16:372
1124599207,5cyclictest27-21ksoftirqd/208:41:282
1124599207,5cyclictest27-21ksoftirqd/208:41:282
1124599204,4cyclictest27-21ksoftirqd/208:51:362
1124599204,4cyclictest27-21ksoftirqd/208:51:362
1124599199,4cyclictest27-21ksoftirqd/210:38:132
1124599199,4cyclictest27-21ksoftirqd/210:38:132
1124599199,4cyclictest27-21ksoftirqd/210:38:132
1124599195,4cyclictest27-21ksoftirqd/209:06:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional