You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 05:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Sat Jul 18, 2026 00:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
939221370,2sleep19390-21ssh22:01:161
939221370,2sleep19390-21ssh22:01:161
939221370,2sleep19390-21ssh22:01:161
2668121110,2sleep20-21swapper/219:36:002
2668121110,2sleep20-21swapper/219:36:002
3026821100,4sleep230255-21rm21:11:092
3026821100,4sleep230255-21rm21:11:092
3026821100,4sleep230255-21rm21:11:092
1609021080,4sleep015040-21/usr/sbin/munin20:31:160
1609021080,4sleep015040-21/usr/sbin/munin20:31:160
2069621000,3sleep00-21swapper/000:10:290
2069621000,3sleep00-21swapper/000:10:290
168512910,3chrt0-21swapper/221:33:282
168512910,3chrt0-21swapper/221:33:282
82812900,4sleep00-21swapper/022:00:550
82812900,4sleep00-21swapper/022:00:550
170552840,2sleep217060-21latency_hist22:11:062
170552840,2sleep217060-21latency_hist22:11:062
155352810,3sleep015522-21ssh22:46:170
155352810,3sleep015522-21ssh22:46:170
39012800,3sleep20-21swapper/223:50:052
39012800,3sleep20-21swapper/223:50:052
39012800,3sleep20-21swapper/223:50:052
245342770,3sleep00-21swapper/019:28:310
309992760,3sleep20-21swapper/222:26:412
309992760,3sleep20-21swapper/222:26:412
261252750,1sleep012-21ksoftirqd/000:16:160
261252750,1sleep012-21ksoftirqd/000:16:160
261252750,1sleep012-21ksoftirqd/000:16:160
284382730,2sleep20-21swapper/223:01:302
284382730,2sleep20-21swapper/223:01:302
284382730,2sleep20-21swapper/223:01:302
261052720,2sleep00-21swapper/022:59:550
261052720,2sleep00-21swapper/022:59:550
255792700,7sleep225583-21fschecks_count22:21:062
255792700,7sleep225583-21fschecks_count22:21:062
226662660,2sleep121-21ksoftirqd/122:16:391
226662660,2sleep121-21ksoftirqd/122:16:391
226662660,2sleep121-21ksoftirqd/122:16:391
298462650,3chrt0-21swapper/200:21:082
298462650,3chrt0-21swapper/200:21:082
23592650,3sleep00-21swapper/023:47:220
23592650,3sleep00-21swapper/023:47:220
23592650,3sleep00-21swapper/023:47:220
261392640,2sleep30-21swapper/321:42:493
261392640,2sleep30-21swapper/321:42:493
307902630,2sleep30-21swapper/322:26:183
307902630,2sleep30-21swapper/322:26:183
293622620,3chrt0-21swapper/300:21:013
293622620,3chrt0-21swapper/300:21:013
293622620,3chrt0-21swapper/300:21:013
144802620,2sleep20-21swapper/222:06:572
193982580,3chrt0-21swapper/223:30:362
193982580,3chrt0-21swapper/223:30:362
15612580,2sleep20-21swapper/223:08:492
15612580,2sleep20-21swapper/223:08:492
15612580,2sleep20-21swapper/223:08:492
22242560,4chrt0-21swapper/323:47:093
22242560,4chrt0-21swapper/323:47:093
22242560,4chrt0-21swapper/323:47:093
36022550,3chrt0-21swapper/022:33:060
36022550,3chrt0-21swapper/022:33:060
36022550,3chrt0-21swapper/022:33:060
321142550,2sleep132123-21sh23:45:111
321142550,2sleep132123-21sh23:45:111
321142550,2sleep132123-21sh23:45:111
264162540,3sleep20-21swapper/223:00:292
264162540,3sleep20-21swapper/223:00:292
117922540,3sleep00-21swapper/000:37:500
117922540,3sleep00-21swapper/000:37:500
80282530,2sleep30-21swapper/321:23:443
80282530,2sleep30-21swapper/321:23:443
80282530,2sleep30-21swapper/321:23:443
80282530,2sleep30-21swapper/321:23:443
306592530,3sleep30-21swapper/319:46:063
207112530,3sleep10-21swapper/123:31:151
207112530,3sleep10-21swapper/123:31:151
71222500,2sleep17130-21ssh21:59:001
71222500,2sleep17130-21ssh21:59:001
25192500,3chrt0-21swapper/321:53:183
25192500,3chrt0-21swapper/321:53:183
25192500,3chrt0-21swapper/321:53:183
88842490,3chrt0-21swapper/123:16:521
88842490,3chrt0-21swapper/123:16:521
88842490,3chrt0-21swapper/123:16:521
287302490,12sleep227-21ksoftirqd/200:20:082
287302490,12sleep227-21ksoftirqd/200:20:082
287302490,12sleep227-21ksoftirqd/200:20:082
275792490,4sleep30-21swapper/323:01:113
275792490,4sleep30-21swapper/323:01:113
275792490,4sleep30-21swapper/323:01:113
27352490,2sleep30-21swapper/300:26:403
27352490,2sleep30-21swapper/300:26:403
27352490,2sleep30-21swapper/300:26:403
169892490,3sleep00-21swapper/000:06:030
169892490,3sleep00-21swapper/000:06:030
169892490,3sleep00-21swapper/000:06:030
78592480,2sleep00-21swapper/023:54:410
78592480,2sleep00-21swapper/023:54:410
78592480,2sleep00-21swapper/023:54:410
207672480,2sleep20-21swapper/222:15:402
207672480,2sleep20-21swapper/222:15:402
207672480,2sleep20-21swapper/222:15:402
325342450,3sleep20-21swapper/223:45:512
325342450,3sleep20-21swapper/223:45:512
325342450,3sleep20-21swapper/223:45:512
248492450,2sleep024892-21ntp_kernel_err20:56:130
248492450,2sleep024892-21ntp_kernel_err20:56:130
206022450,3chrt0-21swapper/200:10:192
206022450,3chrt0-21swapper/200:10:192
199172450,4sleep019915-21ssh22:14:090
199172450,4sleep019915-21ssh22:14:090
199172450,4sleep019915-21ssh22:14:090
52462440,3sleep00-21swapper/023:12:570
52462440,3sleep00-21swapper/023:12:570
281852430,3sleep10-21swapper/121:46:051
281852430,3sleep10-21swapper/121:46:051
204152400,2sleep020490-21gzip23:31:110
204152400,2sleep020490-21gzip23:31:110
18794993817,16cyclictest1-21systemd00:00:591
18794993817,16cyclictest1-21systemd00:00:591
18794993817,16cyclictest1-21systemd00:00:591
18794993817,16cyclictest1-21systemd00:00:591
29982360,2sleep121-21ksoftirqd/100:27:101
29982360,2sleep121-21ksoftirqd/100:27:101
29982360,2sleep121-21ksoftirqd/100:27:101
216882360,4sleep30-21swapper/322:16:093
216882360,4sleep30-21swapper/322:16:093
216882360,4sleep30-21swapper/322:16:093
181282365,20sleep118166-21ntp_states19:11:121
181282365,20sleep118166-21ntp_states19:11:121
179402360,3sleep30-21swapper/323:28:003
179402360,3sleep30-21swapper/323:28:003
71312350,3sleep20-21swapper/221:59:002
71312350,3sleep20-21swapper/221:59:002
299422350,2sleep30-21swapper/300:21:093
299422350,2sleep30-21swapper/300:21:093
1879399342,27cyclictest12877-21ssh00:00:580
1879399342,27cyclictest12877-21ssh00:00:580
1879399342,27cyclictest12877-21ssh00:00:580
1879399342,27cyclictest12877-21ssh00:00:580
269192330,2sleep00-21swapper/021:44:110
269192330,2sleep00-21swapper/021:44:110
253212330,1sleep025316-21/usr/sbin/munin22:21:050
253212330,1sleep025316-21/usr/sbin/munin22:21:050
253212330,1sleep025316-21/usr/sbin/munin22:21:050
52552320,2sleep10-21swapper/123:12:581
52552320,2sleep10-21swapper/123:12:581
201382320,3sleep324661-21kworker/3:200:09:283
201382320,3sleep324661-21kworker/3:200:09:283
1879599325,24cyclictest12897-21rm00:00:592
1879599325,24cyclictest12897-21rm00:00:592
1879599325,24cyclictest12897-21rm00:00:592
1879599325,24cyclictest12897-21rm00:00:592
1879599323,26cyclictest14682-21ssh00:01:582
1879599323,26cyclictest14682-21ssh00:01:582
1879599323,26cyclictest14682-21ssh00:01:582
18793993219,4cyclictest38250irq/56-eth022:26:160
18793993219,4cyclictest38250irq/56-eth022:26:160
99872310,3sleep30-21swapper/320:16:123
99872310,3sleep30-21swapper/320:16:123
60932310,2sleep10-21swapper/123:51:291
60932310,2sleep10-21swapper/123:51:291
60932310,2sleep10-21swapper/123:51:291
56522310,3sleep30-21swapper/321:21:073
56522310,3sleep30-21swapper/321:21:073
56522310,3sleep30-21swapper/321:21:073
253922300,3sleep30-21swapper/320:56:193
253922300,3sleep30-21swapper/320:56:193
1879699306,17cyclictest0-21swapper/300:00:593
1879699306,17cyclictest0-21swapper/300:00:593
1879699306,17cyclictest0-21swapper/300:00:593
1879699306,17cyclictest0-21swapper/300:00:593
71282290,2sleep00-21swapper/020:09:140
71282290,2sleep00-21swapper/020:09:140
71282290,2sleep00-21swapper/020:09:140
196972290,2sleep119742-21pluginstate21:36:131
196972290,2sleep119742-21pluginstate21:36:131
203452280,4chrt73-21kswapd019:16:192
18793992810,14cyclictest12-21ksoftirqd/000:11:070
18793992810,14cyclictest12-21ksoftirqd/000:11:070
90392270,2sleep20-21swapper/221:25:362
90392270,2sleep20-21swapper/221:25:362
90392270,2sleep20-21swapper/221:25:362
90392270,2sleep20-21swapper/221:25:362
286462270,3sleep30-21swapper/323:41:063
1879699271,19cyclictest14667-21taskset00:01:563
1879699271,19cyclictest14667-21taskset00:01:563
1879699271,19cyclictest14667-21taskset00:01:563
73652260,2chrt0-21swapper/320:10:583
73652260,2chrt0-21swapper/320:10:583
73652260,2chrt0-21swapper/320:10:583
18793992619,4cyclictest9722-1kworker/0:0H21:06:080
18793992619,4cyclictest9722-1kworker/0:0H21:06:080
18793992619,4cyclictest9722-1kworker/0:0H21:06:080
184532263,14sleep30-21swapper/319:11:183
184532263,14sleep30-21swapper/319:11:183
1879599253,3cyclictest131rcu_preempt21:21:062
1879599253,3cyclictest131rcu_preempt21:21:062
1879599253,3cyclictest131rcu_preempt21:21:062
18793992520,3cyclictest9722-1kworker/0:0H21:26:110
18793992520,3cyclictest9722-1kworker/0:0H21:26:110
18793992515,7cyclictest38150irq/55-eth020:41:070
18793992515,7cyclictest38150irq/55-eth020:41:070
18793992514,8cyclictest5653-21fschecks_time21:21:070
18793992514,8cyclictest5653-21fschecks_time21:21:070
18793992514,8cyclictest5653-21fschecks_time21:21:070
187462254,12sleep20-21swapper/219:11:292
187462254,12sleep20-21swapper/219:11:292
134442250,3sleep00-21swapper/023:22:220
134442250,3sleep00-21swapper/023:22:220
134442250,3sleep00-21swapper/023:22:220
18795992412,9cyclictest7807-21grep20:11:062
18795992412,9cyclictest7807-21grep20:11:062
18795992412,9cyclictest7807-21grep20:11:062
18794992410,11cyclictest30040-21grep22:26:101
18794992410,11cyclictest30040-21grep22:26:101
18793992411,10cyclictest27837-21ssh23:40:160
18793992411,10cyclictest27837-21ssh23:40:160
187492245,11sleep00-21swapper/019:11:320
187492245,11sleep00-21swapper/019:11:320
308912230,4chrt0-21swapper/221:11:172
308912230,4chrt0-21swapper/221:11:172
308912230,4chrt0-21swapper/221:11:172
24642230,3sleep01142-21/usr/sbin/munin00:26:170
24642230,3sleep01142-21/usr/sbin/munin00:26:170
24642230,3sleep01142-21/usr/sbin/munin00:26:170
192292230,3sleep30-21swapper/322:12:563
192292230,3sleep30-21swapper/322:12:563
192292230,3sleep30-21swapper/322:12:563
1879699232,8cyclictest0-21swapper/322:36:163
1879599231,4cyclictest0-21swapper/222:31:162
1879599231,4cyclictest0-21swapper/222:31:162
1879599231,4cyclictest0-21swapper/222:31:162
18795992310,10cyclictest15596-21wc22:46:172
18795992310,10cyclictest15596-21wc22:46:172
1879499231,18cyclictest28959-21tune2fs19:41:061
1879499231,18cyclictest28959-21tune2fs19:41:061
1879399237,13cyclictest27039-21ssh22:22:000
1879399237,13cyclictest27039-21ssh22:22:000
1879399237,13cyclictest27039-21ssh22:22:000
18793992315,6cyclictest9259-21ntp_states22:01:140
18793992315,6cyclictest9259-21ntp_states22:01:140
18793992315,6cyclictest9259-21ntp_states22:01:140
1879399231,18cyclictest22589-21grep20:51:080
1879399231,18cyclictest22589-21grep20:51:080
1879399231,12cyclictest27067-21cat21:01:170
1879399231,12cyclictest27067-21cat21:01:170
1879399231,11cyclictest11162-21systemctl23:20:550
1879399231,11cyclictest11162-21systemctl23:20:550
1879399231,11cyclictest11162-21systemctl23:20:550
15242230,5sleep129631-21diskmemload21:16:061
15242230,5sleep129631-21diskmemload21:16:061
15242230,5sleep129631-21diskmemload21:16:061
121962230,5sleep121-21ksoftirqd/121:28:481
121962230,5sleep121-21ksoftirqd/121:28:481
213002220,3chrt0-21swapper/321:37:393
213002220,3chrt0-21swapper/321:37:393
1879599222,3cyclictest131rcu_preempt20:36:082
1879599222,3cyclictest131rcu_preempt20:36:082
1879599222,2cyclictest131rcu_preempt23:11:082
1879599222,2cyclictest131rcu_preempt23:11:082
1879599222,2cyclictest131rcu_preempt22:41:072
1879599222,2cyclictest131rcu_preempt22:41:072
1879599221,3cyclictest131rcu_preempt00:11:082
1879599221,3cyclictest131rcu_preempt00:11:082
18795992213,7cyclictest14073-21cron00:40:542
18795992213,7cyclictest14073-21cron00:40:542
18795992213,6cyclictest832-21systemd-journal19:40:542
18795992213,6cyclictest832-21systemd-journal19:40:542
18795992213,6cyclictest832-21systemd-journal19:40:542
1879599221,2cyclictest131rcu_preempt20:01:162
1879599221,2cyclictest131rcu_preempt20:01:162
18795992210,9cyclictest851-21grep21:51:162
18795992210,9cyclictest851-21grep21:51:162
18795992210,9cyclictest851-21grep21:51:162
1879599220,2cyclictest131rcu_preempt20:46:072
1879599220,2cyclictest131rcu_preempt20:46:072
1879599220,10cyclictest19868-21grep20:41:182
1879599220,10cyclictest19868-21grep20:41:182
1879499221,17cyclictest9470-21find00:36:051
1879499221,17cyclictest9470-21find00:36:051
1879499221,17cyclictest9470-21find00:36:051
1879499221,17cyclictest13736-21strings00:01:151
1879499221,17cyclictest13736-21strings00:01:151
1879499221,17cyclictest13736-21strings00:01:151
1879399224,8cyclictest7618-21sh00:33:010
1879399224,8cyclictest7618-21sh00:33:010
1879399224,8cyclictest7618-21sh00:33:010
18793992216,4cyclictest0-21swapper/020:01:140
18793992216,4cyclictest0-21swapper/020:01:140
18793992211,8cyclictest17059-21latency_hist22:11:060
18793992211,8cyclictest17059-21latency_hist22:11:060
18793992211,8cyclictest0-21swapper/021:33:450
18793992211,8cyclictest0-21swapper/021:33:450
1879399221,14cyclictest7387-21ssh22:37:250
18793992210,10cyclictest8741-21/usr/sbin/munin20:11:170
18793992210,10cyclictest8741-21/usr/sbin/munin20:11:170
18793992210,10cyclictest8741-21/usr/sbin/munin20:11:170
1879599213,5cyclictest27-21ksoftirqd/219:53:362
1879599213,5cyclictest27-21ksoftirqd/219:53:362
1879599212,3cyclictest131rcu_preempt21:46:072
1879599212,3cyclictest131rcu_preempt21:46:072
1879599212,2cyclictest131rcu_preempt20:56:082
1879599212,2cyclictest131rcu_preempt20:56:082
1879599211,6cyclictest10281-21wc21:26:152
1879599211,6cyclictest10281-21wc21:26:152
1879599211,4cyclictest131rcu_preempt23:51:202
1879599211,4cyclictest131rcu_preempt23:51:202
1879599211,4cyclictest131rcu_preempt23:51:202
1879599211,3cyclictest131rcu_preempt19:21:172
1879599211,3cyclictest131rcu_preempt19:21:172
1879599211,2cyclictest131rcu_preempt23:21:072
1879599211,2cyclictest131rcu_preempt23:21:072
1879599211,2cyclictest131rcu_preempt22:01:072
1879599211,2cyclictest131rcu_preempt22:01:072
1879599211,2cyclictest131rcu_preempt22:01:072
1879599211,2cyclictest131rcu_preempt21:01:072
1879599211,2cyclictest131rcu_preempt21:01:072
1879599211,2cyclictest131rcu_preempt20:21:072
1879599211,2cyclictest131rcu_preempt20:21:072
1879599211,2cyclictest131rcu_preempt00:31:062
1879599211,2cyclictest131rcu_preempt00:31:062
1879499219,9cyclictest25297-21ssh22:58:261
1879499219,9cyclictest25297-21ssh22:58:261
1879499215,4cyclictest141rcub/019:51:061
1879499215,4cyclictest141rcub/019:51:061
18794992113,5cyclictest21-21ksoftirqd/120:31:061
18794992113,5cyclictest21-21ksoftirqd/120:31:061
18794992113,5cyclictest0-21swapper/119:31:181
18794992113,5cyclictest0-21swapper/119:31:181
1879499211,17cyclictest21517-21ls20:46:161
1879499211,17cyclictest21517-21ls20:46:161
1879499211,16cyclictest13448-21cut20:26:081
1879499211,16cyclictest13448-21cut20:26:081
1879499211,15cyclictest5754-21ls21:21:071
1879499211,15cyclictest5754-21ls21:21:071
1879499211,15cyclictest5754-21ls21:21:071
1879499211,10cyclictest21364-21latency_hist22:16:071
1879499211,10cyclictest21364-21latency_hist22:16:071
1879399211,9cyclictest32249-21latency_hist21:50:590
1879399211,9cyclictest32249-21latency_hist21:50:590
1879399211,9cyclictest28841-21ssh23:41:080
1879399211,9cyclictest28841-21ssh23:41:080
1879399211,9cyclictest28841-21ssh23:41:080
1879399211,17cyclictest29820-21ls00:21:080
1879399211,17cyclictest29820-21ls00:21:080
1879399211,12cyclictest23583-21sh21:40:470
1879399211,12cyclictest23583-21sh21:40:470
18793992110,9cyclictest14817-21ssh22:07:320
280602201,3sleep10-21swapper/119:36:321
280602201,3sleep10-21swapper/119:36:321
280602201,3sleep10-21swapper/119:36:321
272492200,2sleep30-21swapper/322:22:243
272492200,2sleep30-21swapper/322:22:243
272492200,2sleep30-21swapper/322:22:243
1879699201,12cyclictest0-21swapper/321:56:093
1879699201,12cyclictest0-21swapper/321:56:093
1879699201,12cyclictest0-21swapper/320:31:043
1879699201,12cyclictest0-21swapper/320:31:043
1879699201,11cyclictest0-21swapper/320:41:073
1879699201,11cyclictest0-21swapper/320:41:073
1879599208,9cyclictest22537-21df_inode20:51:072
1879599208,9cyclictest22537-21df_inode20:51:072
1879599202,2cyclictest131rcu_preempt19:56:082
1879599202,2cyclictest131rcu_preempt19:56:082
1879599202,2cyclictest131rcu_preempt19:56:082
1879599202,14cyclictest7636-21ssh23:16:082
1879599201,6cyclictest16189-21grep20:31:172
1879599201,6cyclictest16189-21grep20:31:172
1879599201,5cyclictest6641-21grep22:36:172
1879599201,16cyclictest11953-21ls23:21:092
1879599201,16cyclictest11953-21ls23:21:092
1879599201,16cyclictest11953-21ls23:21:092
18795992010,8cyclictest24148-21sort21:41:062
18795992010,8cyclictest24148-21sort21:41:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional