You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 20:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Mon May 25, 2026 12:45:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
284221110,3sleep00-21swapper/009:35:400
284221110,3sleep00-21swapper/009:35:400
284221110,3sleep00-21swapper/009:35:400
284221110,3sleep00-21swapper/009:35:400
2588921040,4sleep012-21ksoftirqd/011:20:250
2588921040,4sleep012-21ksoftirqd/011:20:250
23702860,4sleep30-21swapper/308:40:173
23702860,4sleep30-21swapper/308:40:173
69272820,3sleep10-21swapper/111:38:021
69272820,3sleep10-21swapper/111:38:021
69272820,3sleep10-21swapper/111:38:021
277762820,3chrt0-21swapper/008:20:210
277762820,3chrt0-21swapper/008:20:210
277762820,3chrt0-21swapper/008:20:210
44332760,2sleep30-21swapper/308:45:193
44332760,2sleep30-21swapper/308:45:193
44332760,2sleep30-21swapper/308:45:193
260262720,3sleep10-21swapper/111:20:261
260262720,3sleep10-21swapper/111:20:261
4622660,3sleep30-21swapper/308:35:183
4622660,3sleep30-21swapper/308:35:183
275842660,3sleep30-21swapper/311:23:013
275842660,3sleep30-21swapper/311:23:013
8122610,3sleep00-21swapper/011:30:180
8122610,3sleep00-21swapper/011:30:180
8122610,3sleep00-21swapper/011:30:180
176052600,2sleep30-21swapper/311:11:123
176052600,2sleep30-21swapper/311:11:123
241942590,8sleep012-21ksoftirqd/008:10:240
241942590,8sleep012-21ksoftirqd/008:10:240
28692560,4chrt0-21swapper/309:35:433
28692560,4chrt0-21swapper/309:35:433
28692560,4chrt0-21swapper/309:35:433
28692560,4chrt0-21swapper/309:35:433
54542550,5sleep012-21ksoftirqd/010:19:120
54542550,5sleep012-21ksoftirqd/010:19:120
322972550,3chrt0-21swapper/112:07:361
322972550,3chrt0-21swapper/112:07:361
24802550,3sleep01006-21ls07:10:460
24802550,3sleep01006-21ls07:10:460
24802550,3sleep01006-21ls07:10:460
24802550,3sleep01006-21ls07:10:460
140702550,2chrt0-21swapper/210:29:232
140702550,2chrt0-21swapper/210:29:232
109372550,4chrt10932-21sh11:05:060
109372550,4chrt10932-21sh11:05:060
261452540,2sleep126338-21grep12:00:181
261452540,2sleep126338-21grep12:00:181
261452540,2sleep126338-21grep12:00:181
261452540,2sleep126338-21grep12:00:181
74032530,4sleep30-21swapper/312:17:033
74032530,4sleep30-21swapper/312:17:033
74032530,4sleep30-21swapper/312:17:033
257832530,3chrt0-21swapper/310:03:363
257832530,3chrt0-21swapper/310:03:363
257832530,3chrt0-21swapper/310:03:363
259172520,3chrt0-21swapper/209:25:132
259172520,3chrt0-21swapper/209:25:132
259172520,3chrt0-21swapper/209:25:132
129682520,3sleep10-21swapper/111:06:071
129682520,3sleep10-21swapper/111:06:071
86252510,3chrt0-21swapper/007:30:140
86252510,3chrt0-21swapper/007:30:140
243772510,2sleep10-21swapper/111:19:381
243772510,2sleep10-21swapper/111:19:381
139722510,2sleep013991-21sed07:45:050
139722510,2sleep013991-21sed07:45:050
57552490,3sleep00-21swapper/009:40:180
57552490,3sleep00-21swapper/009:40:180
57552490,3sleep00-21swapper/009:40:180
109772490,3sleep30-21swapper/310:25:223
109772490,3sleep30-21swapper/310:25:223
201262470,3sleep30-21swapper/310:35:233
71162460,3chrt0-21swapper/311:38:243
71162460,3chrt0-21swapper/311:38:243
71162460,3chrt0-21swapper/311:38:243
49202460,3chrt0-21swapper/010:56:130
49202460,3chrt0-21swapper/010:56:130
49202460,3chrt0-21swapper/010:56:130
252599461,30cyclictest817-21runrttasks08:11:241
252599461,30cyclictest817-21runrttasks08:11:241
137742450,3sleep00-21swapper/012:25:190
137742450,3sleep00-21swapper/012:25:190
317362440,3sleep00-21swapper/008:30:250
317362440,3sleep00-21swapper/008:30:250
267502440,3chrt0-21swapper/309:25:223
267502440,3chrt0-21swapper/309:25:223
261332440,3sleep30-21swapper/310:42:143
261332440,3sleep30-21swapper/310:42:143
261332440,3sleep30-21swapper/310:42:143
252599441,27cyclictest29655-21ssh10:46:291
252599441,27cyclictest29655-21ssh10:46:291
252599441,27cyclictest29655-21ssh10:46:291
232852440,2sleep20-21swapper/211:56:202
232852440,2sleep20-21swapper/211:56:202
281272430,2sleep00-21swapper/012:02:060
281272430,2sleep00-21swapper/012:02:060
281272430,2sleep00-21swapper/012:02:060
281272430,2sleep00-21swapper/012:02:060
94962410,4sleep30-21swapper/307:30:253
252599411,28cyclictest817-21runrttasks08:03:211
252599411,28cyclictest817-21runrttasks08:03:211
24712415,24sleep20-21swapper/207:10:392
24712415,24sleep20-21swapper/207:10:392
24712415,24sleep20-21swapper/207:10:392
24712415,24sleep20-21swapper/207:10:392
125592410,2sleep012713-21if_eth011:45:180
125592410,2sleep012713-21if_eth011:45:180
252599390,9cyclictest23530-21ssh10:39:561
227662390,3chrt0-21swapper/111:55:301
227662390,3chrt0-21swapper/111:55:301
52752380,4sleep30-21swapper/310:18:513
52752380,4sleep30-21swapper/310:18:513
244752380,3chrt0-21swapper/208:10:262
244752380,3chrt0-21swapper/208:10:262
196572380,2sleep10-21swapper/112:31:111
196572380,2sleep10-21swapper/112:31:111
313672370,3sleep30-21swapper/312:05:453
313672370,3sleep30-21swapper/312:05:453
169012370,2sleep20-21swapper/212:29:042
169012370,2sleep20-21swapper/212:29:042
95312360,3sleep00-21swapper/010:24:270
95312360,3sleep00-21swapper/010:24:270
42112360,2sleep14219-21ssh12:13:281
42112360,2sleep14219-21ssh12:13:281
42112360,2sleep14219-21ssh12:13:281
304092360,2sleep130416-21ssh10:10:021
304092360,2sleep130416-21ssh10:10:021
304092360,2sleep130416-21ssh10:10:021
252599361,9cyclictest1706650ssh09:53:411
252599361,9cyclictest1706650ssh09:53:411
209092360,3sleep30-21swapper/309:57:293
116472360,3chrt0-21swapper/011:44:320
116472360,3chrt0-21swapper/011:44:320
116472360,3chrt0-21swapper/011:44:320
252599355,27cyclictest6921-21ntp_kernel_pll_10:20:231
252599355,27cyclictest6921-21ntp_kernel_pll_10:20:231
252599351,30cyclictest817-21runrttasks09:55:471
252599351,29cyclictest18547-21ntp_states07:55:201
19292356,18sleep30-21swapper/307:10:243
19292356,18sleep30-21swapper/307:10:243
19292356,18sleep30-21swapper/307:10:243
19292356,18sleep30-21swapper/307:10:243
191192350,2sleep219149-21ssh10:35:072
191192350,2sleep219149-21ssh10:35:072
158552350,3sleep00-21swapper/010:30:250
158552350,3sleep00-21swapper/010:30:250
76762340,3sleep30-21swapper/308:55:163
76762340,3sleep30-21swapper/308:55:163
252599341,9cyclictest9434-21grep11:40:261
252599341,9cyclictest9434-21grep11:40:261
252599341,9cyclictest9434-21grep11:40:261
252599341,9cyclictest24095-21grep10:00:261
252599341,9cyclictest24095-21grep10:00:261
252599341,9cyclictest24095-21grep10:00:261
252599341,9cyclictest18525-21ssh11:51:031
252599340,9cyclictest9972-21memory09:00:201
252599340,9cyclictest9972-21memory09:00:201
211932340,8sleep227-21ksoftirqd/210:36:142
252599334,26cyclictest3122-21awk10:15:231
252599334,26cyclictest3122-21awk10:15:231
252599331,9cyclictest6833-21ssh11:00:021
252599331,9cyclictest6833-21ssh11:00:021
252599331,9cyclictest6833-21ssh11:00:021
252599331,9cyclictest25678-21ssh12:38:271
252599331,9cyclictest25678-21ssh12:38:271
252599331,8cyclictest7674-21df_inode08:55:161
252599331,8cyclictest7674-21df_inode08:55:161
252599331,7cyclictest4335-21irqstats08:45:191
252599331,7cyclictest4335-21irqstats08:45:191
252599331,7cyclictest4335-21irqstats08:45:191
252599331,7cyclictest30572-21awk08:30:051
252599331,7cyclictest30572-21awk08:30:051
252599331,28cyclictest18026-21/usr/sbin/munin09:15:211
252599331,28cyclictest18026-21/usr/sbin/munin09:15:211
252599331,27cyclictest11576-21grep07:35:261
252599331,27cyclictest11576-21grep07:35:261
252599331,11cyclictest6048-21ntp_states12:15:231
252599331,11cyclictest6048-21ntp_states12:15:231
252599331,11cyclictest6048-21ntp_states12:15:231
252599330,29cyclictest817-21runrttasks09:08:391
252599330,29cyclictest817-21runrttasks09:08:391
252599329,21cyclictest7965-21unixbench_singl07:25:271
252599329,21cyclictest7965-21unixbench_singl07:25:271
252599321,9cyclictest16322-21ssh11:49:431
252599321,9cyclictest16322-21ssh11:49:431
252599321,9cyclictest13643-21ssh10:28:441
252599321,9cyclictest13643-21ssh10:28:441
252599321,8cyclictest32762-21ssh09:33:291
252599321,8cyclictest32762-21ssh09:33:291
252599321,8cyclictest32762-21ssh09:33:291
252599321,7cyclictest8192-21/usr/sbin/munin11:00:261
252599321,7cyclictest8192-21/usr/sbin/munin11:00:261
252599321,7cyclictest26965-21/usr/sbin/munin09:25:241
252599321,7cyclictest26965-21/usr/sbin/munin09:25:241
252599321,7cyclictest23781-21ssh09:21:131
252599321,7cyclictest23781-21ssh09:21:131
252599321,7cyclictest23781-21ssh09:21:131
252599321,4cyclictest32473-21ntp_states10:50:231
252599321,4cyclictest32473-21ntp_states10:50:231
252599321,4cyclictest32473-21ntp_states10:50:231
252599321,3cyclictest35742sleep109:37:091
252599321,3cyclictest35742sleep109:37:091
252599321,3cyclictest35742sleep109:37:091
252599321,3cyclictest35742sleep109:37:091
252599321,28cyclictest2309-21fschecks_time08:40:161
252599321,28cyclictest2309-21fschecks_time08:40:161
252599321,27cyclictest6844-21ssh09:40:521
252599321,27cyclictest6844-21ssh09:40:521
252599321,27cyclictest6844-21ssh09:40:521
252599321,27cyclictest1876-21latency_hist08:40:061
252599321,27cyclictest1876-21latency_hist08:40:061
252599321,25cyclictest31521-21proc_pri08:30:231
252599321,25cyclictest31521-21proc_pri08:30:231
252599321,21cyclictest0-21swapper/109:46:491
252599321,11cyclictest16529-21awk11:10:221
252599321,11cyclictest16529-21awk11:10:221
252599320,8cyclictest17014-21ssh09:14:471
252599320,8cyclictest17014-21ssh09:14:471
252599320,7cyclictest2068-21ssh11:31:101
252599320,7cyclictest2068-21ssh11:31:101
252599320,7cyclictest2068-21ssh11:31:101
203802320,2sleep00-21swapper/011:15:140
203802320,2sleep00-21swapper/011:15:140
132172320,2sleep113204-21sh12:25:121
132172320,2sleep113204-21sh12:25:121
96242310,2sleep20-21swapper/211:40:362
96242310,2sleep20-21swapper/211:40:362
96242310,2sleep20-21swapper/211:40:362
252599312,25cyclictest27289-21fschecks_time08:20:161
252599312,25cyclictest27289-21fschecks_time08:20:161
252599312,25cyclictest27289-21fschecks_time08:20:161
252599311,7cyclictest7271-21seq08:54:201
252599311,7cyclictest16312-21ssh10:30:451
252599311,7cyclictest16312-21ssh10:30:451
252599311,6cyclictest14609-21users12:25:281
252599311,6cyclictest14609-21users12:25:281
252599311,2cyclictest0-21swapper/107:15:121
252599311,2cyclictest0-21swapper/107:15:121
252599311,2cyclictest0-21swapper/107:15:121
252599311,2cyclictest0-21swapper/107:15:121
252599311,28cyclictest31069-21ssh11:27:111
252599311,28cyclictest31069-21ssh11:27:111
252599311,28cyclictest31069-21ssh11:27:111
252599311,27cyclictest817-21runrttasks07:46:451
252599311,27cyclictest817-21runrttasks07:46:451
252599310,9cyclictest24691-21ntp_states10:40:231
252599310,9cyclictest24691-21ntp_states10:40:231
252599310,9cyclictest24691-21ntp_states10:40:231
21822310,3sleep20-21swapper/208:40:162
21822310,3sleep20-21swapper/208:40:162
130772310,4sleep30-21swapper/311:06:173
130772310,4sleep30-21swapper/311:06:173
252599301,8cyclictest16011-21/usr/sbin/munin07:50:261
252599301,8cyclictest16011-21/usr/sbin/munin07:50:261
252599301,4cyclictest6206-21sshd07:20:331
252599301,4cyclictest6206-21sshd07:20:331
252599301,4cyclictest25919-21ntp_states08:15:241
252599301,4cyclictest25919-21ntp_states08:15:241
252599301,2cyclictest0-21swapper/107:30:181
252599301,27cyclictest4157-21timerwakeupswit07:15:261
252599301,27cyclictest4157-21timerwakeupswit07:15:261
252599301,27cyclictest4157-21timerwakeupswit07:15:261
252599301,26cyclictest22361-21gunzip08:05:241
252599301,26cyclictest22361-21gunzip08:05:241
38282290,3chrt0-21swapper/210:55:192
38282290,3chrt0-21swapper/210:55:192
38282290,3chrt0-21swapper/210:55:192
252599291,25cyclictest31057-21grep10:10:181
252599291,25cyclictest31057-21grep10:10:181
252599290,26cyclictest817-21runrttasks07:44:581
252599290,26cyclictest817-21runrttasks07:44:581
120262290,3sleep00-21swapper/010:26:110
120262290,3sleep00-21swapper/010:26:110
215402280,3sleep30-21swapper/311:15:263
215402280,3sleep30-21swapper/311:15:263
43082270,2sleep04317-21ssh12:13:390
43082270,2sleep04317-21ssh12:13:390
43082270,2sleep04317-21ssh12:13:390
101412270,3chrt0-21swapper/311:03:483
101412270,3chrt0-21swapper/311:03:483
2524992617,6cyclictest9186-21ssh12:20:150
2524992617,6cyclictest9186-21ssh12:20:150
2524992617,6cyclictest9186-21ssh12:20:150
245882260,4chrt0-21swapper/311:58:223
245882260,4chrt0-21swapper/311:58:223
8632250,3sleep30-21swapper/310:12:563
8632250,3sleep30-21swapper/310:12:563
255812240,7sleep012-21ksoftirqd/012:38:180
255812240,7sleep012-21ksoftirqd/012:38:180
2524992417,4cyclictest134-21systemd-journal09:20:280
2524992417,4cyclictest134-21systemd-journal09:20:280
2524992417,4cyclictest134-21systemd-journal09:20:280
252499241,20cyclictest5304-21ls11:35:240
252499241,20cyclictest5304-21ls11:35:240
252499241,20cyclictest5304-21ls11:35:240
252499241,19cyclictest14670-21switchtime09:50:260
252499241,19cyclictest14670-21switchtime09:50:260
252499241,11cyclictest26956-21grep09:25:240
252499241,11cyclictest26956-21grep09:25:240
2524992411,10cyclictest5797-21ls08:50:160
173702240,3chrt17367-21ssh11:50:190
67042231,18sleep26713-21ssh11:37:362
67042231,18sleep26713-21ssh11:37:362
67042231,18sleep26713-21ssh11:37:362
260942230,3sleep20-21swapper/210:42:092
260942230,3sleep20-21swapper/210:42:092
260942230,3sleep20-21swapper/210:42:092
252699231,19cyclictest14216-21ls09:10:262
252699231,19cyclictest14216-21ls09:10:262
252699231,18cyclictest628-21fschecks_time11:30:172
2524992315,6cyclictest22804-21ssh10:38:470
2524992314,5cyclictest12-21ksoftirqd/010:55:140
2524992314,5cyclictest12-21ksoftirqd/010:55:140
2524992314,5cyclictest12-21ksoftirqd/010:55:140
252499231,16cyclictest13298-21cut09:10:170
252499231,12cyclictest10538-21sed09:00:260
252499231,12cyclictest10538-21sed09:00:260
244632230,12sleep333-21ksoftirqd/312:36:323
244632230,12sleep333-21ksoftirqd/312:36:323
185312230,3chrt0-21swapper/312:30:213
185312230,3chrt0-21swapper/312:30:213
258552220,4sleep00-21swapper/010:03:450
258552220,4sleep00-21swapper/010:03:450
258552220,4sleep00-21swapper/010:03:450
2526992213,7cyclictest134-21systemd-journal12:20:052
2526992213,7cyclictest134-21systemd-journal12:20:052
2526992213,7cyclictest134-21systemd-journal12:20:052
252699221,18cyclictest9035-21ls09:45:082
252699221,18cyclictest9035-21ls09:45:082
252699221,18cyclictest9035-21ls09:45:082
252699221,18cyclictest10367-21ls09:00:252
252699221,18cyclictest10367-21ls09:00:252
252699221,14cyclictest7486-21ls08:55:092
252499226,13cyclictest17192-21unixbench_singl07:50:280
252499226,13cyclictest17192-21unixbench_singl07:50:280
252499223,10cyclictest18220-21gltestperf12:30:170
252499223,10cyclictest18220-21gltestperf12:30:170
252499222,11cyclictest9529-21tune2fs09:45:190
252499221,18cyclictest18710-21grep09:15:280
252499221,18cyclictest18710-21grep09:15:280
252499221,18cyclictest18011-21cut07:55:140
252499221,11cyclictest5098-21wc07:20:170
252499221,11cyclictest5098-21wc07:20:170
252499221,11cyclictest5098-21wc07:20:170
252499221,11cyclictest16049-21tune2fs11:10:170
252499221,11cyclictest16049-21tune2fs11:10:170
252499221,11cyclictest13528-21cut09:10:180
252499221,11cyclictest13528-21cut09:10:180
252499221,10cyclictest30587-21needreboot09:30:200
252499221,10cyclictest30587-21needreboot09:30:200
252499221,10cyclictest30587-21needreboot09:30:200
98112210,3sleep30-21swapper/309:00:183
98112210,3sleep30-21swapper/309:00:183
252699218,10cyclictest14243-21sort07:45:152
252699218,10cyclictest14243-21sort07:45:152
252699213,5cyclictest27-21ksoftirqd/208:31:332
252699213,5cyclictest27-21ksoftirqd/208:31:332
2526992114,4cyclictest9380-21ssh09:45:182
252699211,18cyclictest1217-21ls09:35:072
252699211,18cyclictest1217-21ls09:35:072
252699211,18cyclictest1217-21ls09:35:072
252699211,16cyclictest25739-21sh11:20:232
252699211,16cyclictest25739-21sh11:20:232
252699211,13cyclictest4271-21ls08:45:182
252699211,13cyclictest4271-21ls08:45:182
252699211,13cyclictest4271-21ls08:45:182
252699211,13cyclictest27462-21ls08:20:172
252699211,13cyclictest27462-21ls08:20:172
252699211,13cyclictest27462-21ls08:20:172
252699211,13cyclictest26267-21cut12:00:172
252699211,13cyclictest26267-21cut12:00:172
252699211,13cyclictest26267-21cut12:00:172
252699211,13cyclictest26267-21cut12:00:172
252699211,11cyclictest23582-21needreboot10:00:212
252699211,11cyclictest23582-21needreboot10:00:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional