You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 11:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sun Dec 07, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
849421570,1sleep30-21swapper/300:35:083
849421570,1sleep30-21swapper/300:35:083
1804421410,3sleep30-21swapper/300:07:153
1804421410,3sleep30-21swapper/300:07:153
1804421410,3sleep30-21swapper/300:07:153
1586721360,4sleep333-21ksoftirqd/322:15:343
1586721360,4sleep333-21ksoftirqd/322:15:343
2555521190,3sleep30-21swapper/319:46:133
2555521190,3sleep30-21swapper/319:46:133
1376821070,4sleep30-21swapper/322:50:183
237102980,3chrt0-21swapper/300:14:103
237102980,3chrt0-21swapper/300:14:103
139322920,3sleep30-21swapper/323:26:153
139322920,3sleep30-21swapper/323:26:153
4162810,3chrt0-21swapper/223:11:152
4162810,3chrt0-21swapper/223:11:152
159262770,4sleep30-21swapper/321:37:203
159262770,4sleep30-21swapper/321:37:203
262602730,3sleep0151rcuc/000:16:200
195902730,3chrt0-21swapper/122:56:111
195902730,3chrt0-21swapper/122:56:111
130482720,6sleep111583-21ls19:11:231
130482720,6sleep111583-21ls19:11:231
187082710,4sleep218710-21fschecks_time21:41:092
187082710,4sleep218710-21fschecks_time21:41:092
105222710,3chrt0-21swapper/100:36:221
105222710,3chrt0-21swapper/100:36:221
174402700,3sleep30-21swapper/322:16:183
174402700,3sleep30-21swapper/322:16:183
165572640,2sleep10-21swapper/122:16:081
165572640,2sleep10-21swapper/122:16:081
13702620,3chrt0-21swapper/023:49:390
13702620,3chrt0-21swapper/023:49:390
25232610,3sleep30-21swapper/323:51:073
25232610,3sleep30-21swapper/323:51:073
99522590,4chrt0-21swapper/220:31:162
99522590,4chrt0-21swapper/220:31:162
188752580,3sleep00-21swapper/022:18:200
188752580,3sleep00-21swapper/022:18:200
67262570,3chrt0-21swapper/022:04:500
67262570,3chrt0-21swapper/022:04:500
142902570,3sleep214318-21needreboot19:16:112
142902570,3sleep214318-21needreboot19:16:112
95012560,3chrt0-21swapper/323:58:143
95012560,3chrt0-21swapper/323:58:143
32222560,3sleep00-21swapper/021:23:020
32222560,3sleep00-21swapper/021:23:020
23952560,3sleep30-21swapper/300:26:283
23952560,3sleep30-21swapper/300:26:283
170542550,3sleep20-21swapper/222:16:132
170542550,3sleep20-21swapper/222:16:132
302102540,4chrt0-21swapper/223:08:142
302102540,4chrt0-21swapper/223:08:142
260332540,3sleep20-21swapper/223:03:322
260332540,3sleep20-21swapper/223:03:322
264722530,3chrt0-21swapper/321:50:263
264722530,3chrt0-21swapper/321:50:263
213352510,3sleep30-21swapper/322:21:133
213352510,3sleep30-21swapper/322:21:133
305572480,3sleep30-21swapper/300:21:173
305572480,3sleep30-21swapper/300:21:173
268612460,4chrt0-21swapper/223:41:132
268612460,4chrt0-21swapper/223:41:132
268612460,4chrt0-21swapper/223:41:132
97702450,4sleep30-21swapper/321:31:093
97702450,4sleep30-21swapper/321:31:093
13100994517,11cyclictest26098-21ssh23:03:381
13100994517,11cyclictest26098-21ssh23:03:381
13100994516,12cyclictest13047-21ssh00:01:301
13100994516,11cyclictest8836-21ssh22:44:301
80952440,3chrt0-21swapper/123:20:431
71872440,3sleep30-21swapper/322:41:463
292632440,4sleep012-21ksoftirqd/023:44:210
292632440,4sleep012-21ksoftirqd/023:44:210
292632440,4sleep012-21ksoftirqd/023:44:210
291352440,2sleep30-21swapper/321:16:103
291352440,2sleep30-21swapper/321:16:103
13100994416,9cyclictest15604-21grep20:46:171
13100994416,9cyclictest15604-21grep20:46:171
13100994413,13cyclictest23368-21ssh00:13:371
13100994413,13cyclictest23368-21ssh00:13:371
13100994412,11cyclictest31835-21ssh22:33:191
13100994412,11cyclictest31835-21ssh22:33:191
66762430,2sleep2261rcuc/223:18:232
285522430,2sleep028650-21mailstats23:06:160
285522430,2sleep028650-21mailstats23:06:160
200082430,2sleep30-21swapper/323:33:353
200082430,2sleep30-21swapper/323:33:353
13100994316,11cyclictest9419-21ssh22:07:081
13100994316,11cyclictest9419-21ssh22:07:081
13100994316,11cyclictest5282-21ssh23:53:421
13100994316,11cyclictest5282-21ssh23:53:421
13100994315,12cyclictest12572-21ssh22:48:251
13100994217,11cyclictest11095-21ssh00:00:401
13100994217,11cyclictest11095-21ssh00:00:401
13100994216,12cyclictest4394-21ssh22:39:281
13100994216,12cyclictest4394-21ssh22:39:281
13100994216,11cyclictest7255-21ssh00:32:521
13100994216,11cyclictest7255-21ssh00:32:521
13100994216,11cyclictest3616-21ssh21:23:401
13100994216,11cyclictest3616-21ssh21:23:401
13100994216,11cyclictest16947-21ssh21:39:041
13100994216,11cyclictest16947-21ssh21:39:041
13100994216,11cyclictest13865-21ssh22:12:131
13100994216,11cyclictest13865-21ssh22:12:131
13100994215,9cyclictest30247-21cat23:45:551
13100994215,9cyclictest30247-21cat23:45:551
13100994215,9cyclictest30247-21cat23:45:551
13100994215,12cyclictest32484-21ssh00:24:091
13100994215,12cyclictest32484-21ssh00:24:091
13100994215,11cyclictest31825-21ssh21:19:101
13100994215,11cyclictest31825-21ssh21:19:101
13100994215,11cyclictest26513-21ssh21:50:331
13100994215,11cyclictest26513-21ssh21:50:331
13100994215,10cyclictest21268-21ssh21:43:551
13100994215,10cyclictest21268-21ssh21:43:551
13100994215,10cyclictest18564-21ssh00:08:011
13100994215,10cyclictest18564-21ssh00:08:011
13100994215,10cyclictest18564-21ssh00:08:011
13100994214,9cyclictest3588-21ssh23:15:381
13100994214,9cyclictest3588-21ssh23:15:381
13100994214,10cyclictest19879-21ssh23:33:231
13100994214,10cyclictest19879-21ssh23:33:231
116222420,3sleep20-21swapper/200:01:072
59792410,3sleep20-21swapper/223:54:482
59792410,3sleep20-21swapper/223:54:482
13100994118,13cyclictest20207-21seq21:00:361
13100994118,10cyclictest4108-21ssh00:29:321
13100994118,10cyclictest4108-21ssh00:29:321
13100994118,10cyclictest18430-21sh22:55:351
13100994118,10cyclictest18430-21sh22:55:351
13100994116,10cyclictest28375-21sh21:51:271
13100994116,10cyclictest28375-21sh21:51:271
13100994115,11cyclictest8235-21ssh21:29:071
13100994115,11cyclictest8235-21ssh21:29:071
13100994115,11cyclictest10691-21ssh23:22:391
13100994115,11cyclictest10691-21ssh23:22:391
13100994115,10cyclictest14651-21sh23:26:491
13100994115,10cyclictest14651-21sh23:26:491
13100994114,11cyclictest577-21ssh23:48:211
13100994114,11cyclictest577-21ssh23:48:211
13100994017,10cyclictest800-21ssh21:57:241
13100994017,10cyclictest800-21ssh21:57:241
33282390,3sleep20-21swapper/222:37:392
33282390,3sleep20-21swapper/222:37:392
304222390,2sleep20-21swapper/221:54:552
304222390,2sleep20-21swapper/221:54:552
13100993917,9cyclictest17519-21sendmail_mailqu20:51:171
13100993917,9cyclictest17519-21sendmail_mailqu20:51:171
13100993915,11cyclictest23838-21sh23:37:411
13100993915,11cyclictest23838-21sh23:37:411
13100993915,10cyclictest23577-21taskset22:23:591
13100993915,10cyclictest23577-21taskset22:23:591
13100993816,8cyclictest28856-21ssh00:20:151
13100993815,8cyclictest5438-21ssh22:02:381
13100993815,8cyclictest5438-21ssh22:02:381
13100993815,10cyclictest26580-21latency_hist19:50:551
13100993815,10cyclictest26580-21latency_hist19:50:551
13100993814,11cyclictest12915-21latency_hist20:41:011
13100993814,10cyclictest20965-21chrt19:35:501
13100993812,8cyclictest16284-21ntp_states19:21:131
13100993812,8cyclictest16284-21ntp_states19:21:131
13100993812,11cyclictest2291-21missed_timers20:11:141
13100993812,11cyclictest2291-21missed_timers20:11:141
112092380,2sleep211272-21fschecks_count20:36:082
151302370,2sleep00-21swapper/000:04:460
13100993715,9cyclictest24211-21rm21:11:051
125692370,2sleep212577-21ssh22:48:252
13100993616,8cyclictest11614-21ssh21:32:251
13100993616,8cyclictest11614-21ssh21:32:251
13100993614,9cyclictest27719-21ssh23:06:041
13100993614,9cyclictest27719-21ssh23:06:041
300352350,3sleep00-21swapper/000:21:100
300352350,3sleep00-21swapper/000:21:100
193582350,2sleep2261rcuc/220:56:162
117412350,4sleep00-21swapper/020:36:130
83202340,3sleep00-21swapper/021:29:130
83202340,3sleep00-21swapper/021:29:130
274082340,4sleep00-21swapper/021:14:180
171902340,4sleep217112-21ssh00:06:212
171902340,4sleep217112-21ssh00:06:212
171902340,4sleep217112-21ssh00:06:212
13100993411,8cyclictest21748-21taskset21:02:011
13100993410,8cyclictest0-21swapper/119:40:391
13100993410,8cyclictest0-21swapper/119:40:391
34452330,3sleep30-21swapper/323:15:273
34452330,3sleep30-21swapper/323:15:273
13100993312,8cyclictest1453-21taskset20:10:011
13100993312,8cyclictest1453-21taskset20:10:011
13100993312,7cyclictest0-21swapper/120:20:581
13100993312,7cyclictest0-21swapper/120:20:581
13100993218,11cyclictest9368-21/usr/sbin/munin20:31:091
13100993218,11cyclictest9368-21/usr/sbin/munin20:31:091
13100993217,10cyclictest18198-21open_inodes19:26:141
13100993217,10cyclictest18198-21open_inodes19:26:141
325632310,3chrt0-21swapper/221:20:232
325632310,3chrt0-21swapper/221:20:232
13100993119,9cyclictest14998-21sshd19:16:361
13100993119,9cyclictest14998-21sshd19:16:361
13100993118,10cyclictest6151-21/usr/sbin/munin20:21:121
13100993117,11cyclictest8568-21unixbench_singl20:26:181
13100993117,11cyclictest8568-21unixbench_singl20:26:181
13100993112,7cyclictest27258-21memory19:51:111
250852300,1sleep025191-21sh22:26:090
250852300,1sleep025191-21sh22:26:090
225042300,2sleep20-21swapper/222:22:132
225042300,2sleep20-21swapper/222:22:132
13100993018,10cyclictest27003-21seq22:27:291
13100993018,10cyclictest27003-21seq22:27:291
61762290,3chrt0-21swapper/320:21:133
253792290,2sleep225389-21ssh21:48:292
253792290,2sleep225389-21ssh21:48:292
13100992918,9cyclictest31742-21sshd20:01:361
13100992918,9cyclictest31742-21sshd20:01:361
13100992918,9cyclictest31742-21sshd20:01:361
13100992916,9cyclictest23451-21/usr/sbin/munin21:06:191
13100992916,9cyclictest23451-21/usr/sbin/munin21:06:191
13100992916,10cyclictest23725-21ntp_states19:41:151
13100992916,10cyclictest23725-21ntp_states19:41:151
103922290,2sleep010399-21sh22:08:410
103922290,2sleep010399-21sh22:08:410
50872280,2sleep05098-21ssh23:53:260
50872280,2sleep05098-21ssh23:53:260
48982280,3sleep30-21swapper/322:40:183
48982280,3sleep30-21swapper/322:40:183
272342280,2sleep30-21swapper/322:27:523
272342280,2sleep30-21swapper/322:27:523
246822280,2sleep024720-21latency_hist19:45:540
246822280,2sleep024720-21latency_hist19:45:540
215632280,2sleep221577-21ssh22:58:302
215632280,2sleep221577-21ssh22:58:302
13100992715,9cyclictest13631-21ntpq20:41:151
13100992715,9cyclictest13631-21ntpq20:41:151
13100992715,10cyclictest29177-21bingrep19:56:111
13100992715,10cyclictest29177-21bingrep19:56:111
13099992715,10cyclictest30464-21cat22:31:170
13099992715,10cyclictest30464-21cat22:31:170
118042272,18sleep30-21swapper/319:11:053
118042272,18sleep30-21swapper/319:11:053
6222260,3sleep30-21swapper/323:48:263
6222260,3sleep30-21swapper/323:48:263
281332260,2sleep228143-21rm22:29:242
281332260,2sleep228143-21rm22:29:242
171222260,3sleep20-21swapper/221:39:202
171222260,3sleep20-21swapper/221:39:202
13099992517,6cyclictest4241-21ssh00:29:500
13099992517,6cyclictest4241-21ssh00:29:500
16232240,2sleep012-21ksoftirqd/022:36:090
16232240,2sleep012-21ksoftirqd/022:36:090
1309999249,13cyclictest18769-21/usr/sbin/munin21:41:090
1309999249,13cyclictest18769-21/usr/sbin/munin21:41:090
13099992413,9cyclictest3658-21/usr/sbin/munin20:16:090
13099992413,9cyclictest3658-21/usr/sbin/munin20:16:090
13932230,5sleep012-21ksoftirqd/023:12:020
13932230,5sleep012-21ksoftirqd/023:12:020
13099992314,7cyclictest38850irq/55-eth023:31:080
13099992314,7cyclictest38850irq/55-eth023:31:080
13099992313,8cyclictest14732-21ssh23:26:590
13099992313,8cyclictest14732-21ssh23:26:590
1309999231,20cyclictest21760-21ls22:21:210
1309999231,20cyclictest21760-21ls22:21:210
1309999231,12cyclictest23968-21tail23:01:110
1309999231,12cyclictest23968-21tail23:01:110
290062220,3sleep30-21swapper/323:43:563
290062220,3sleep30-21swapper/323:43:563
290062220,3sleep30-21swapper/323:43:563
13101992215,5cyclictest4729-21ssh22:01:272
13101992215,5cyclictest4729-21ssh22:01:272
1309999222,13cyclictest6005-21sh00:31:180
1309999222,13cyclictest6005-21sh00:31:180
1309999221,16cyclictest14670-21cut22:51:070
1309999221,16cyclictest14670-21cut22:51:070
1309999221,15cyclictest9195-21find00:36:060
1309999221,15cyclictest9195-21find00:36:060
13101992114,5cyclictest21876-21fschecks_count23:36:092
13101992114,5cyclictest21876-21fschecks_count23:36:092
1310199211,17cyclictest19397-21find19:31:072
1310199211,14cyclictest30526-21acpi23:46:062
1310199211,14cyclictest30526-21acpi23:46:062
1309999212,12cyclictest22028-21sh22:59:160
1309999212,12cyclictest22028-21sh22:59:160
13099992114,5cyclictest11188-21awk22:46:200
1309999211,18cyclictest15954-21ls19:21:080
1309999211,18cyclictest15954-21ls19:21:080
1309999211,13cyclictest25968-21ls23:40:590
1309999211,13cyclictest25968-21ls23:40:590
1309999211,11cyclictest8231-21ls23:20:550
1309999210,10cyclictest26774-21latency_hist21:50:560
1309999210,10cyclictest26774-21latency_hist21:50:560
52872200,3sleep30-21swapper/321:26:073
52872200,3sleep30-21swapper/321:26:073
1310299201,14cyclictest0-21swapper/321:51:073
1310299201,14cyclictest0-21swapper/321:51:073
1310199204,7cyclictest27-21ksoftirqd/223:26:092
1310199204,7cyclictest27-21ksoftirqd/223:26:092
13101992013,5cyclictest8294-21sshd22:43:362
13101992013,5cyclictest23861-21ssh00:14:262
13101992013,5cyclictest23861-21ssh00:14:262
1310199201,14cyclictest7207-21fschecks_count23:56:072
1310199201,14cyclictest7207-21fschecks_count23:56:072
13101992010,8cyclictest25445-21memory19:46:112
13101992010,8cyclictest25445-21memory19:46:112
13101992010,8cyclictest11260-21ssh00:37:412
13101992010,8cyclictest11260-21ssh00:37:412
1309999201,9cyclictest5757-21fschecks_time20:21:080
13099992013,6cyclictest11643-21sh23:24:130
13099992013,6cyclictest11643-21sh23:24:130
13099992011,7cyclictest0-21swapper/020:31:200
13099992011,7cyclictest0-21swapper/020:31:200
1309999201,16cyclictest21940-21unixbench_singl00:11:200
1309999201,16cyclictest21940-21unixbench_singl00:11:200
1309999201,16cyclictest19622-21fschecks_time19:31:100
1309999201,14cyclictest18453-21ls20:55:560
1309999201,14cyclictest18453-21ls20:55:560
1309999201,10cyclictest6659-21timerandwakeup22:41:190
1309999201,10cyclictest13718-21/usr/sbin/munin19:16:060
1309999201,10cyclictest13718-21/usr/sbin/munin19:16:060
1309999201,10cyclictest12622-21grep22:11:140
1309999201,10cyclictest12622-21grep22:11:140
130512203,10sleep20-21swapper/219:11:252
130512203,10sleep20-21swapper/219:11:252
118072204,9sleep011583-21ls19:11:060
118072204,9sleep011583-21ls19:11:060
1310299191,14cyclictest0-21swapper/321:00:573
1310299191,14cyclictest0-21swapper/320:46:083
1310299191,14cyclictest0-21swapper/320:46:083
1310299191,13cyclictest0-21swapper/323:21:123
1310299191,13cyclictest0-21swapper/323:21:123
1310299191,13cyclictest0-21swapper/321:11:103
1310299191,12cyclictest0-21swapper/321:41:073
1310299191,12cyclictest0-21swapper/321:41:073
1310199197,3cyclictest131rcu_preempt22:00:572
1310199197,3cyclictest131rcu_preempt22:00:572
1310199197,10cyclictest29296-21ls00:20:552
1310199192,14cyclictest30521-21/usr/sbin/munin20:01:082
1310199192,14cyclictest30521-21/usr/sbin/munin20:01:082
1310199192,14cyclictest30521-21/usr/sbin/munin20:01:082
1310199192,14cyclictest1159-21cat22:36:022
1310199192,14cyclictest1159-21cat22:36:022
13101991911,6cyclictest23929-21diskmemload00:33:382
13101991911,6cyclictest23929-21diskmemload00:33:382
13101991911,6cyclictest135-21systemd-journal23:35:542
13101991911,6cyclictest135-21systemd-journal23:35:542
1310199191,15cyclictest1936-21ssh21:21:182
1310199191,15cyclictest1936-21ssh21:21:182
1309999196,11cyclictest7325-21basename23:56:080
1309999196,11cyclictest7325-21basename23:56:080
1309999191,9cyclictest18188-21ls21:40:560
1309999191,9cyclictest18188-21ls21:40:560
1309999191,8cyclictest16160-21/usr/sbin/munin00:06:230
1309999191,8cyclictest16160-21/usr/sbin/munin00:06:230
1309999191,8cyclictest16160-21/usr/sbin/munin00:06:230
13099991912,5cyclictest29298-21ssh21:16:120
13099991912,5cyclictest29298-21ssh21:16:120
13099991911,6cyclictest0-21swapper/020:50:590
13099991911,6cyclictest0-21swapper/020:50:590
13099991911,6cyclictest0-21swapper/019:40:360
13099991911,6cyclictest0-21swapper/019:40:360
1309999191,14cyclictest27057-21sh21:51:070
1309999191,14cyclictest27057-21sh21:51:070
1309999191,12cyclictest1604-21ls20:10:560
1309999191,12cyclictest1604-21ls20:10:560
1309999191,11cyclictest10185-21load21:31:120
1309999191,11cyclictest10185-21load21:31:120
1309999191,10cyclictest2605-21sh22:00:190
1309999191,10cyclictest2605-21sh22:00:190
11902190,4sleep30-21swapper/321:21:083
11902190,4sleep30-21swapper/321:21:083
56652180,2sleep20-21swapper/221:26:102
56652180,2sleep20-21swapper/221:26:102
245752181,3sleep20-21swapper/219:44:442
245752181,3sleep20-21swapper/219:44:442
204912180,1sleep220510-21/usr/sbin/munin21:01:072
1310299181,13cyclictest0-21swapper/320:00:553
1310299181,13cyclictest0-21swapper/320:00:553
1310299181,13cyclictest0-21swapper/319:36:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional