You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 15:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Apr 04, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1126624830,1sleep121-21ksoftirqd/107:12:101
1126624830,1sleep121-21ksoftirqd/107:12:101
1126823730,2sleep210072-21ls07:12:112
1126823730,2sleep210072-21ls07:12:112
230521500,2sleep10-21swapper/108:16:481
328421480,3sleep30-21swapper/309:57:003
328421480,3sleep30-21swapper/309:57:003
328421480,3sleep30-21swapper/309:57:003
1160521230,3sleep00-21swapper/009:32:050
1160521230,3sleep00-21swapper/009:32:050
2983521140,4sleep129823-21find09:17:111
2983521140,4sleep129823-21find09:17:111
3111221030,6sleep131110-21rm12:37:001
3111221030,6sleep131110-21rm12:37:001
2563021000,2sleep20-21swapper/210:52:102
2563021000,2sleep20-21swapper/210:52:102
266412990,4chrt0-21swapper/311:27:003
206232960,3sleep30-21swapper/309:02:093
208822890,1sleep012-21ksoftirqd/010:47:100
208822890,1sleep012-21ksoftirqd/010:47:100
291242870,1sleep227-21ksoftirqd/210:22:112
291242870,1sleep227-21ksoftirqd/210:22:112
291242870,1sleep227-21ksoftirqd/210:22:112
127402870,3chrt12739-21ssh11:12:082
127402870,3chrt12739-21ssh11:12:082
198072850,3sleep1201rcuc/111:52:111
198072850,3sleep1201rcuc/111:52:111
236252840,3sleep00-21swapper/009:11:580
236252840,3sleep00-21swapper/009:11:580
162772840,2sleep121-21ksoftirqd/111:49:131
162772840,2sleep121-21ksoftirqd/111:49:131
114572820,2sleep121-21ksoftirqd/109:32:021
114572820,2sleep121-21ksoftirqd/109:32:021
315412810,2sleep30-21swapper/312:37:063
315412810,2sleep30-21swapper/312:37:063
228842790,3sleep00-21swapper/009:42:460
228842790,3sleep00-21swapper/009:42:460
77992760,3sleep30-21swapper/311:07:073
77992760,3sleep30-21swapper/311:07:073
213172720,2sleep121320-21cron09:06:461
87052640,2sleep00-21swapper/011:41:370
87052640,2sleep00-21swapper/011:41:370
325122640,3sleep30-21swapper/309:20:183
325122640,3sleep30-21swapper/309:20:183
268952640,3sleep10-21swapper/111:27:021
269752590,4sleep30-21swapper/310:53:363
269752590,4sleep30-21swapper/310:53:363
287262580,10sleep333-21ksoftirqd/309:50:043
287262580,10sleep333-21ksoftirqd/309:50:043
149972580,4chrt0-21swapper/010:08:380
149972580,4chrt0-21swapper/010:08:380
10842580,2sleep00-21swapper/011:00:240
10842580,2sleep00-21swapper/011:00:240
10842580,2sleep00-21swapper/011:00:240
178252570,2sleep20-21swapper/207:31:522
178252570,2sleep20-21swapper/207:31:522
161422570,2sleep016303-21cut09:37:000
161422570,2sleep016303-21cut09:37:000
161422570,2sleep016303-21cut09:37:000
69932560,3chrt0-21swapper/010:33:060
69932560,3chrt0-21swapper/010:33:060
308162550,4sleep00-21swapper/011:31:440
165902550,4chrt0-21swapper/310:42:103
165902550,4chrt0-21swapper/310:42:103
100652550,3sleep29821-21latency_hist10:36:542
100652550,3sleep29821-21latency_hist10:36:542
48302540,3chrt0-21swapper/110:31:551
302722530,9sleep030274-21sh12:02:110
302722530,9sleep030274-21sh12:02:110
197812530,3chrt0-21swapper/107:36:531
303912520,2sleep030321-21/usr/sbin/munin09:51:590
303912520,2sleep030321-21/usr/sbin/munin09:51:590
36942500,3chrt0-21swapper/311:36:493
36942500,3chrt0-21swapper/311:36:493
279552500,2sleep127963-21ssh09:48:511
279552500,2sleep127963-21ssh09:48:511
204482490,3sleep30-21swapper/311:20:093
204482490,3sleep30-21swapper/311:20:093
55632480,3sleep10-21swapper/111:37:321
55632480,3sleep10-21swapper/111:37:321
98762470,3sleep00-21swapper/012:15:410
98762470,3sleep00-21swapper/012:15:410
80222470,2sleep2261rcuc/211:40:422
80222470,2sleep2261rcuc/211:40:422
81732460,3sleep10-21swapper/109:28:241
81732460,3sleep10-21swapper/109:28:241
236812460,3chrt0-21swapper/010:17:060
236812460,3chrt0-21swapper/010:17:060
203802460,3sleep10-21swapper/109:41:101
203802460,3sleep10-21swapper/109:41:101
203802460,3sleep10-21swapper/109:41:101
318792450,3sleep30-21swapper/312:04:473
318792450,3sleep30-21swapper/312:04:473
226942440,3sleep30-21swapper/311:22:023
226942440,3sleep30-21swapper/311:22:023
226942440,3sleep30-21swapper/311:22:023
131552430,3sleep00-21swapper/008:42:110
109792420,2sleep00-21swapper/007:12:060
109792420,2sleep00-21swapper/007:12:060
88892400,2sleep18917-21ntp_states08:32:041
88892400,2sleep18917-21ntp_states08:32:041
186752400,3sleep10-21swapper/108:57:071
186752400,3sleep10-21swapper/108:57:071
110112400,2chrt0-21swapper/112:16:541
110112400,2chrt0-21swapper/112:16:541
95752390,3sleep30-21swapper/310:02:103
95752390,3sleep30-21swapper/310:02:103
95752390,3sleep30-21swapper/310:02:103
315942390,2sleep30-21swapper/308:07:013
315942390,2sleep30-21swapper/308:07:013
285612390,4sleep128568-21unixbench_singl07:57:111
285612390,4sleep128568-21unixbench_singl07:57:111
7292380,3chrt0-21swapper/111:33:021
7292380,3chrt0-21swapper/111:33:021
24372370,2sleep00-21swapper/012:07:210
24372370,2sleep00-21swapper/012:07:210
24372370,2sleep00-21swapper/012:07:210
64352360,3sleep30-21swapper/311:38:383
64352360,3sleep30-21swapper/311:38:383
50932360,2sleep25138-21ntp_states08:22:052
50932360,2sleep25138-21ntp_states08:22:052
292402360,2sleep00-21swapper/012:35:190
292402360,2sleep00-21swapper/012:35:190
19102360,1sleep21912-21ssh10:27:592
19102360,1sleep21912-21ssh10:27:592
182662360,1sleep218279-21ssh09:38:232
182662360,1sleep218279-21ssh09:38:232
182662360,1sleep218279-21ssh09:38:232
26542350,2sleep22664-21rm12:07:442
26542350,2sleep22664-21rm12:07:442
26542350,2sleep22664-21rm12:07:442
143252340,2sleep214336-21ssh09:35:012
143252340,2sleep214336-21ssh09:35:012
1160899342,3cyclictest131rcu_preempt07:21:592
37652330,3sleep30-21swapper/310:30:443
37652330,3sleep30-21swapper/310:30:443
322812330,3chrt0-21swapper/011:32:080
322812330,3chrt0-21swapper/011:32:080
202292330,3sleep30-21swapper/312:26:213
202292330,3sleep30-21swapper/312:26:213
202292330,3sleep30-21swapper/312:26:213
12962330,4sleep30-21swapper/308:12:043
11608993320,7cyclictest7153-21find09:27:112
11608993320,7cyclictest7153-21find09:27:112
1160799336,3cyclictest131rcu_preempt10:52:101
1160799336,3cyclictest131rcu_preempt10:52:101
11607993312,5cyclictest21-21ksoftirqd/111:07:091
11607993312,5cyclictest21-21ksoftirqd/111:07:091
11606993320,11cyclictest73-21kswapd012:17:000
11606993320,11cyclictest73-21kswapd012:17:000
223982320,2sleep20-21swapper/209:07:062
223982320,2sleep20-21swapper/209:07:062
169772320,2sleep116987-21ssh10:42:371
169772320,2sleep116987-21ssh10:42:371
1160699326,3cyclictest131rcu_preempt11:47:080
1160699326,3cyclictest131rcu_preempt11:47:080
1160699324,9cyclictest12-21ksoftirqd/010:37:000
1160699324,9cyclictest12-21ksoftirqd/010:37:000
39242310,2sleep30-21swapper/312:09:413
39242310,2sleep30-21swapper/312:09:413
39242310,2sleep30-21swapper/312:09:413
233492310,2sleep30-21swapper/310:17:013
233492310,2sleep30-21swapper/310:17:013
23242310,2sleep22338-21ssh12:40:482
23242310,2sleep22338-21ssh12:40:482
1160699316,6cyclictest12-21ksoftirqd/011:02:100
1160699316,6cyclictest12-21ksoftirqd/011:02:100
1160699316,6cyclictest12-21ksoftirqd/011:02:100
1160699316,6cyclictest12-21ksoftirqd/011:02:100
44652300,3sleep00-21swapper/009:57:130
44652300,3sleep00-21swapper/009:57:130
44652300,3sleep00-21swapper/009:57:130
1160799308,3cyclictest131rcu_preempt12:22:091
1160799308,3cyclictest131rcu_preempt12:22:091
1160799308,3cyclictest131rcu_preempt12:22:091
11607993011,5cyclictest131rcu_preempt12:17:111
11607993011,5cyclictest131rcu_preempt12:17:111
1160699301,9cyclictest0-21swapper/009:17:100
1160699301,9cyclictest0-21swapper/009:17:100
78772290,4chrt0-21swapper/212:13:062
78772290,4chrt0-21swapper/212:13:062
57822290,2sleep00-21swapper/008:23:020
57822290,2sleep00-21swapper/008:23:020
11606992910,8cyclictest12-21ksoftirqd/008:01:590
11606992910,8cyclictest12-21ksoftirqd/008:01:590
284052280,3sleep10-21swapper/109:16:461
284052280,3sleep10-21swapper/109:16:461
182822280,2sleep227-21ksoftirqd/207:32:002
182822280,2sleep227-21ksoftirqd/207:32:002
11608992816,9cyclictest27500-21ssh11:27:102
11607992811,5cyclictest21-21ksoftirqd/111:21:461
11607992811,5cyclictest21-21ksoftirqd/111:21:461
11607992810,7cyclictest21-21ksoftirqd/108:08:251
11607992810,7cyclictest21-21ksoftirqd/108:08:251
1160699289,4cyclictest131rcu_preempt08:52:060
1160699286,7cyclictest12-21ksoftirqd/011:12:080
1160699286,7cyclictest12-21ksoftirqd/011:12:080
1160699281,8cyclictest12-21ksoftirqd/012:22:090
1160699281,8cyclictest12-21ksoftirqd/012:22:090
1160699281,8cyclictest12-21ksoftirqd/012:22:090
1160699281,7cyclictest131rcu_preempt11:57:080
1160699281,7cyclictest131rcu_preempt11:57:080
11606992814,11cyclictest8510-21sh11:07:340
11606992814,11cyclictest8510-21sh11:07:340
11606992811,8cyclictest12-21ksoftirqd/007:38:310
11606992811,8cyclictest12-21ksoftirqd/007:38:310
11606992810,3cyclictest131rcu_preempt11:52:090
11606992810,3cyclictest131rcu_preempt11:52:090
1160899272,8cyclictest14676-21find11:47:082
1160899272,8cyclictest14676-21find11:47:082
11608992718,7cyclictest73-21kswapd008:27:082
11608992718,7cyclictest73-21kswapd008:27:082
1160799279,4cyclictest131rcu_preempt12:07:101
1160799279,4cyclictest131rcu_preempt12:07:101
1160799279,4cyclictest131rcu_preempt12:07:101
1160799274,6cyclictest21-21ksoftirqd/110:57:111
1160799274,6cyclictest21-21ksoftirqd/110:57:111
1160799274,6cyclictest21-21ksoftirqd/110:57:111
1160799273,4cyclictest131rcu_preempt07:32:101
11607992712,8cyclictest0-21swapper/110:32:051
11607992712,8cyclictest0-21swapper/110:32:051
1160699278,8cyclictest12-21ksoftirqd/010:15:300
11606992722,3cyclictest31488-1kworker/0:0H09:27:060
11606992722,3cyclictest31488-1kworker/0:0H09:27:060
8692260,2sleep30-21swapper/309:54:183
8692260,2sleep30-21swapper/309:54:183
326202260,2sleep20-21swapper/209:20:252
326202260,2sleep20-21swapper/209:20:252
226962260,4sleep30-21swapper/312:28:023
226962260,4sleep30-21swapper/312:28:023
1160899268,9cyclictest0-21swapper/208:57:082
1160899268,9cyclictest0-21swapper/208:57:082
1160899268,5cyclictest131rcu_preempt08:42:102
1160899261,3cyclictest0-21swapper/209:12:092
1160899261,3cyclictest0-21swapper/209:12:092
1160799267,7cyclictest21-21ksoftirqd/107:41:591
1160799266,4cyclictest131rcu_preempt09:42:091
1160799266,4cyclictest131rcu_preempt09:42:091
11607992613,7cyclictest0-21swapper/112:02:361
11607992613,7cyclictest0-21swapper/112:02:361
11607992611,8cyclictest0-21swapper/111:16:121
11607992611,8cyclictest0-21swapper/111:16:121
1160699267,3cyclictest131rcu_preempt10:22:110
1160699267,3cyclictest131rcu_preempt10:22:110
1160699267,3cyclictest131rcu_preempt10:22:110
11606992614,10cyclictest25626-21sh10:52:100
11606992614,10cyclictest25626-21sh10:52:100
11606992610,6cyclictest12-21ksoftirqd/008:08:000
11606992610,6cyclictest12-21ksoftirqd/008:08:000
11606992610,5cyclictest12-21ksoftirqd/008:19:460
11606992610,5cyclictest12-21ksoftirqd/008:19:460
295632250,3sleep10-21swapper/112:35:431
295632250,3sleep10-21swapper/112:35:431
1160799257,7cyclictest21-21ksoftirqd/108:18:221
1160799257,7cyclictest21-21ksoftirqd/108:18:221
1160799257,11cyclictest0-21swapper/110:31:241
1160799256,4cyclictest131rcu_preempt10:17:101
1160799256,4cyclictest131rcu_preempt10:17:101
1160799254,5cyclictest21-21ksoftirqd/111:57:091
1160799254,5cyclictest21-21ksoftirqd/111:57:091
1160799252,3cyclictest131rcu_preempt10:22:101
1160799252,3cyclictest131rcu_preempt10:22:101
1160799252,3cyclictest131rcu_preempt10:22:101
11607992512,8cyclictest0-21swapper/112:31:511
11607992512,8cyclictest0-21swapper/112:31:511
11607992511,8cyclictest0-21swapper/111:03:291
11607992511,8cyclictest0-21swapper/111:03:291
11607992511,8cyclictest0-21swapper/111:03:291
11607992511,8cyclictest0-21swapper/111:03:291
11607992511,8cyclictest0-21swapper/110:15:191
1160699259,6cyclictest131rcu_preempt07:18:320
1160699259,6cyclictest131rcu_preempt07:18:320
1160699259,6cyclictest12-21ksoftirqd/009:49:520
1160699259,6cyclictest12-21ksoftirqd/009:49:520
1160699257,9cyclictest12-21ksoftirqd/012:39:290
1160699257,9cyclictest12-21ksoftirqd/012:39:290
1160699255,5cyclictest12-21ksoftirqd/007:47:090
1160699255,5cyclictest12-21ksoftirqd/007:47:090
1160699252,13cyclictest26143-21ntp_states07:52:050
11606992512,11cyclictest73-21kswapd009:02:070
111122252,16sleep30-21swapper/307:12:093
111122252,16sleep30-21swapper/307:12:093
292332240,4sleep3321rcuc/310:22:123
292332240,4sleep3321rcuc/310:22:123
292332240,4sleep3321rcuc/310:22:123
156972240,2sleep30-21swapper/312:21:233
156972240,2sleep30-21swapper/312:21:233
1160899241,5cyclictest261rcuc/211:57:092
1160899241,5cyclictest261rcuc/211:57:092
1160799247,5cyclictest131rcu_preempt10:47:091
1160799247,5cyclictest131rcu_preempt10:47:091
1160799246,8cyclictest131rcu_preempt10:40:081
1160799246,8cyclictest131rcu_preempt10:40:081
1160799245,3cyclictest131rcu_preempt09:52:101
1160799245,3cyclictest131rcu_preempt09:52:101
11607992411,8cyclictest0-21swapper/110:01:181
11607992411,8cyclictest0-21swapper/110:01:181
11607992411,8cyclictest0-21swapper/110:01:181
11607992410,12cyclictest131rcu_preempt09:07:081
11607992410,12cyclictest131rcu_preempt09:07:081
1160699248,5cyclictest12-21ksoftirqd/008:56:550
1160699248,5cyclictest12-21ksoftirqd/008:56:550
1160699248,4cyclictest12-21ksoftirqd/012:31:340
1160699248,4cyclictest12-21ksoftirqd/012:31:340
1160699248,4cyclictest12-21ksoftirqd/010:03:100
1160699248,4cyclictest12-21ksoftirqd/010:03:100
1160699248,4cyclictest12-21ksoftirqd/010:03:100
11606992410,6cyclictest12-21ksoftirqd/008:39:070
11606992410,6cyclictest12-21ksoftirqd/008:39:070
11606992410,5cyclictest12-21ksoftirqd/008:27:410
11606992410,5cyclictest12-21ksoftirqd/008:27:410
1160699240,5cyclictest17903-21find11:17:090
1160699240,5cyclictest17903-21find11:17:090
37042230,4chrt0-21swapper/209:57:032
37042230,4chrt0-21swapper/209:57:032
37042230,4chrt0-21swapper/209:57:032
11609992313,8cyclictest0-21swapper/310:47:093
11609992313,8cyclictest0-21swapper/310:47:093
1160899231,9cyclictest0-21swapper/208:37:082
1160899231,9cyclictest0-21swapper/208:37:082
11608992316,5cyclictest21740-21ssh10:48:062
11608992316,5cyclictest21740-21ssh10:48:062
1160799238,7cyclictest21-21ksoftirqd/107:52:421
1160799237,9cyclictest21-21ksoftirqd/107:28:381
1160799237,9cyclictest21-21ksoftirqd/107:28:381
1160799237,4cyclictest21-21ksoftirqd/108:30:581
1160799237,4cyclictest21-21ksoftirqd/108:30:581
1160799234,3cyclictest131rcu_preempt09:21:571
1160799234,3cyclictest131rcu_preempt09:21:571
1160799234,3cyclictest131rcu_preempt09:21:571
11607992310,7cyclictest0-21swapper/110:04:111
11607992310,7cyclictest0-21swapper/110:04:111
11607992310,7cyclictest0-21swapper/110:04:111
1160699239,3cyclictest12-21ksoftirqd/007:27:030
1160699239,3cyclictest12-21ksoftirqd/007:27:030
1160699238,3cyclictest131rcu_preempt10:42:090
1160699238,3cyclictest131rcu_preempt10:42:090
1160699237,8cyclictest12-21ksoftirqd/008:47:070
1160699237,8cyclictest12-21ksoftirqd/008:47:070
1160699237,5cyclictest12-21ksoftirqd/011:23:000
1160699237,5cyclictest12-21ksoftirqd/011:23:000
1160699237,5cyclictest12-21ksoftirqd/011:23:000
1160699237,5cyclictest12-21ksoftirqd/008:01:000
1160699237,5cyclictest12-21ksoftirqd/008:01:000
1160699231,5cyclictest12-21ksoftirqd/008:12:090
1160699231,12cyclictest22350-21cut07:42:030
225322220,4sleep30-21swapper/309:07:073
225322220,4sleep30-21swapper/309:07:073
143672220,3sleep30-21swapper/308:47:013
143672220,3sleep30-21swapper/308:47:013
1160899221,16cyclictest27909-21ls10:21:502
1160899221,16cyclictest27909-21ls10:21:502
1160899220,19cyclictest15575-21grep10:41:582
1160899220,19cyclictest15575-21grep10:41:582
1160799228,6cyclictest21-21ksoftirqd/107:49:001
1160799228,6cyclictest21-21ksoftirqd/107:49:001
1160799223,16cyclictest4964-21sshd08:22:021
1160799223,16cyclictest4964-21sshd08:22:021
1160699229,4cyclictest12-21ksoftirqd/011:44:380
1160699229,4cyclictest12-21ksoftirqd/011:44:380
1160699229,4cyclictest12-21ksoftirqd/011:44:380
1160699228,5cyclictest12-21ksoftirqd/009:10:520
1160699228,5cyclictest12-21ksoftirqd/009:10:520
1160699227,4cyclictest12-21ksoftirqd/009:22:330
1160699227,4cyclictest12-21ksoftirqd/009:22:330
1160699227,4cyclictest12-21ksoftirqd/009:22:330
11606992214,6cyclictest151rcuc/008:32:090
11606992214,6cyclictest151rcuc/008:32:090
11606992211,8cyclictest12-21ksoftirqd/007:34:170
11606992211,8cyclictest12-21ksoftirqd/007:34:170
11606992210,5cyclictest12-21ksoftirqd/010:27:000
11606992210,5cyclictest12-21ksoftirqd/010:27:000
83702210,4sleep30-21swapper/308:31:573
83702210,4sleep30-21swapper/308:31:573
1160899216,5cyclictest21684-21sh11:54:362
1160899216,5cyclictest21684-21sh11:54:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional