You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Jan 07, 2026 00:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
271121390,3sleep00-21swapper/020:10:400
1410121320,5chrt0-21swapper/319:10:473
1410121320,5chrt0-21swapper/319:10:473
268621140,3sleep2261rcuc/200:05:432
268621140,3sleep2261rcuc/200:05:432
694621030,3chrt0-21swapper/221:58:522
694621030,3chrt0-21swapper/221:58:522
3229021030,1sleep10-21swapper/123:30:341
1405221020,3sleep20-21swapper/223:45:172
56322930,2sleep30-21swapper/323:35:423
56322930,2sleep30-21swapper/323:35:423
30052930,5sleep30-21swapper/300:40:243
30052930,5sleep30-21swapper/300:40:243
22352920,3sleep20-21swapper/220:10:342
134962900,5chrt0-21swapper/219:10:382
134962900,5chrt0-21swapper/219:10:382
214092860,3sleep30-21swapper/322:45:433
214092860,3sleep30-21swapper/322:45:433
11492740,3sleep30-21swapper/300:05:203
11492740,3sleep30-21swapper/300:05:203
259032680,3sleep20-21swapper/222:50:362
208192680,3sleep20-21swapper/219:30:392
208192680,3sleep20-21swapper/219:30:392
41492670,2sleep121-21ksoftirqd/121:55:411
41492670,2sleep121-21ksoftirqd/121:55:411
264982650,3sleep00-21swapper/021:45:350
264982650,3sleep00-21swapper/021:45:350
324682640,3sleep00-21swapper/021:51:140
316752620,2sleep00-21swapper/000:02:400
316752620,2sleep00-21swapper/000:02:400
223972610,3chrt0-21swapper/023:53:070
223972610,3chrt0-21swapper/023:53:070
213872610,3sleep20-21swapper/223:51:452
213872610,3sleep20-21swapper/223:51:452
189332610,3sleep10-21swapper/123:16:031
189332610,3sleep10-21swapper/123:16:031
189332610,3sleep10-21swapper/123:16:031
130222590,3sleep012697-21ls19:10:330
130222590,3sleep012697-21ls19:10:330
121902590,2sleep30-21swapper/322:36:223
121902590,2sleep30-21swapper/322:36:223
95282580,2chrt0-21swapper/221:28:372
189712570,2sleep10-21swapper/100:23:061
189712570,2sleep10-21swapper/100:23:061
299052560,3sleep30-21swapper/322:21:353
299052560,3sleep30-21swapper/322:21:353
299052560,3sleep30-21swapper/322:21:353
228852560,3chrt0-21swapper/123:53:481
228852560,3chrt0-21swapper/123:53:481
14332550,3sleep20-21swapper/222:58:562
14332550,3sleep20-21swapper/222:58:562
14332550,3sleep20-21swapper/222:58:562
99012540,3chrt0-21swapper/222:35:012
99012540,3chrt0-21swapper/222:35:012
107992540,4sleep10-21swapper/122:02:281
254182520,4sleep10-21swapper/122:17:071
254182520,4sleep10-21swapper/122:17:071
254182520,4sleep10-21swapper/122:17:071
307452510,3chrt0-21swapper/123:29:011
307452510,3chrt0-21swapper/123:29:011
198372510,3sleep20-21swapper/222:11:132
171502510,3chrt0-21swapper/222:09:212
171502510,3chrt0-21swapper/222:09:212
167372500,1sleep116880-21idleruntime19:20:351
167372500,1sleep116880-21idleruntime19:20:351
86462480,2sleep18659-21ssh22:33:201
86462480,2sleep18659-21ssh22:33:201
88012470,3chrt0-21swapper/123:05:421
293312470,2sleep00-21swapper/023:27:030
293312470,2sleep00-21swapper/023:27:030
136262470,2sleep112697-21ls19:10:421
136262470,2sleep112697-21ls19:10:421
31262460,3sleep317453-21kworker/3:120:10:433
273892450,3sleep00-21swapper/022:19:470
273892450,3sleep00-21swapper/022:19:470
273892450,3sleep00-21swapper/022:19:470
231042450,2sleep123197-21switchtime23:20:421
90372440,2sleep30-21swapper/300:12:433
90372440,2sleep30-21swapper/300:12:433
67732440,2sleep26769-21grep20:20:422
37722440,2sleep012-21ksoftirqd/021:22:330
37722440,2sleep012-21ksoftirqd/021:22:330
250612440,3sleep00-21swapper/023:22:570
176772440,3sleep30-21swapper/300:21:193
176772440,3sleep30-21swapper/300:21:193
206352430,3sleep30-21swapper/322:12:193
25462420,3sleep10-21swapper/121:20:451
25462420,3sleep10-21swapper/121:20:451
303222410,3sleep20-21swapper/221:50:042
303222410,3sleep20-21swapper/221:50:042
300352410,9sleep227-21ksoftirqd/200:34:532
300352410,9sleep227-21ksoftirqd/200:34:532
317072400,3sleep20-21swapper/221:18:052
317072400,3sleep20-21swapper/221:18:052
298952400,3chrt0-21swapper/222:21:342
298952400,3chrt0-21swapper/222:21:342
298952400,3chrt0-21swapper/222:21:342
298572400,3sleep30-21swapper/323:27:463
298572400,3sleep30-21swapper/323:27:463
1415099401,9cyclictest8048-21latency_hist22:00:200
1415099401,9cyclictest8048-21latency_hist22:00:200
53112390,3sleep10-21swapper/122:30:251
53112390,3sleep10-21swapper/122:30:251
296042390,3chrt0-21swapper/122:54:491
259852390,4sleep30-21swapper/319:45:353
16002390,4sleep30-21swapper/323:31:453
159872390,2sleep015996-21sh23:13:500
159872390,2sleep015996-21sh23:13:500
138552390,9sleep121-21ksoftirqd/120:40:421
138552390,9sleep121-21ksoftirqd/120:40:421
1415099379,26cyclictest32139-21seq20:01:400
1415099379,26cyclictest32139-21seq20:01:400
1415099376,4cyclictest0-21swapper/022:35:400
1415099376,4cyclictest0-21swapper/022:35:400
1415099371,7cyclictest11728-21cat00:15:370
1415099371,7cyclictest11728-21cat00:15:370
296932360,3sleep20-21swapper/223:27:332
296932360,3sleep20-21swapper/223:27:332
269752360,2sleep10-21swapper/121:13:291
269752360,2sleep10-21swapper/121:13:291
171242360,3sleep00-21swapper/022:09:190
171242360,3sleep00-21swapper/022:09:190
1415099361,9cyclictest6391-21tune2fs21:25:330
1415099361,8cyclictest30251-21users19:55:430
1415099361,8cyclictest30251-21users19:55:430
1415099361,8cyclictest30251-21users19:55:430
93052350,3sleep10-21swapper/123:40:221
93052350,3sleep10-21swapper/123:40:221
1415099358,25cyclictest731-21ssh00:37:250
1415099358,25cyclictest731-21ssh00:37:250
1415099352,8cyclictest18248-21cpuspeed20:55:320
1415099352,8cyclictest18248-21cpuspeed20:55:320
1415099352,8cyclictest18248-21cpuspeed20:55:320
1415099351,9cyclictest6808-21users20:20:430
1415099351,8cyclictest8083-21ntp_states20:25:410
1415099351,8cyclictest8083-21ntp_states20:25:410
1415099351,8cyclictest28915-21/usr/sbin/munin22:20:400
1415099351,8cyclictest28915-21/usr/sbin/munin22:20:400
1415099351,8cyclictest28915-21/usr/sbin/munin22:20:400
1415099351,8cyclictest26136-21ntp_states19:45:380
1415099351,8cyclictest24866-21head21:10:430
1415099351,8cyclictest24866-21head21:10:430
1415099351,7cyclictest22441-21ssh22:46:510
1415099351,7cyclictest22441-21ssh22:46:510
1415099351,10cyclictest5589-21df22:30:320
1415099351,10cyclictest5589-21df22:30:320
64412340,3sleep00-21swapper/023:04:080
64412340,3sleep00-21swapper/023:04:080
153972340,3sleep00-21swapper/019:15:390
153972340,3sleep00-21swapper/019:15:390
1415099341,9cyclictest22047-21df_inode19:35:320
1415099341,9cyclictest22047-21df_inode19:35:320
1415099341,8cyclictest17384-21/usr/sbin/munin23:15:340
1415099341,8cyclictest17384-21/usr/sbin/munin23:15:340
1415099341,8cyclictest17384-21/usr/sbin/munin23:15:340
1415099341,7cyclictest11218-21/usr/sbin/munin21:30:320
1415099341,12cyclictest10229-21ntp_states23:40:390
14150993410,21cyclictest12841-21kworker/u8:200:30:570
14150993410,21cyclictest12841-21kworker/u8:200:30:570
1415099340,9cyclictest14804-21irqstats23:45:350
1415099340,7cyclictest32576-21ssh22:57:110
1415099340,7cyclictest32576-21ssh22:57:110
1415099340,7cyclictest32576-21ssh22:57:110
76272330,2sleep20-21swapper/223:38:102
76272330,2sleep20-21swapper/223:38:102
252832330,2sleep20-21swapper/200:30:072
252832330,2sleep20-21swapper/200:30:072
1415099332,10cyclictest683-21grep23:30:420
1415099331,9cyclictest4111-21ssh00:07:370
1415099331,9cyclictest4111-21ssh00:07:370
1415099331,9cyclictest27786-21memory19:50:350
1415099331,9cyclictest27786-21memory19:50:350
1415099331,9cyclictest24320-21/usr/sbin/munin23:55:430
1415099331,9cyclictest24320-21/usr/sbin/munin23:55:430
1415099331,9cyclictest24320-21/usr/sbin/munin23:55:430
1415099331,9cyclictest21063-21/usr/sbin/munin21:40:400
1415099331,9cyclictest21063-21/usr/sbin/munin21:40:400
1415099331,9cyclictest18555-21fschecks_count19:25:350
1415099331,9cyclictest18555-21fschecks_count19:25:350
1415099331,9cyclictest18555-21fschecks_count19:25:350
1415099331,9cyclictest17291-21grep21:35:420
1415099331,9cyclictest17291-21grep21:35:420
1415099331,9cyclictest11767-21ssh22:03:490
1415099331,8cyclictest26257-21cat22:50:410
1415099331,8cyclictest21567-21latency_hist21:05:200
1415099331,8cyclictest10248-21ssh23:07:370
1415099331,7cyclictest19261-21ssh00:23:310
1415099331,7cyclictest19261-21ssh00:23:310
1415099331,6cyclictest16419-21switchtime22:40:400
1415099331,6cyclictest16419-21switchtime22:40:400
1415099331,30cyclictest9413-21ssh00:13:150
1415099331,30cyclictest9413-21ssh00:13:150
1415099331,10cyclictest23733-21/usr/sbin/munin19:40:400
1415099330,9cyclictest22026-21unixbench_multi00:25:420
1415099330,9cyclictest22026-21unixbench_multi00:25:420
1415099330,9cyclictest13450-21ntp_states20:40:380
1415099330,9cyclictest13450-21ntp_states20:40:380
90742320,3sleep10-21swapper/121:28:001
278102320,3sleep30-21swapper/322:52:223
241792320,2sleep30-21swapper/323:21:433
1415099323,6cyclictest309-21awk20:05:330
1415099323,6cyclictest309-21awk20:05:330
1415099321,9cyclictest29904-21unixbench_singl21:15:430
1415099321,9cyclictest29904-21unixbench_singl21:15:430
1415099321,9cyclictest18546-21taskset22:10:340
1415099321,9cyclictest1475-21switchtime22:25:420
1415099321,9cyclictest1475-21switchtime22:25:420
1415099321,9cyclictest10990-21/usr/sbin/munin20:35:310
1415099321,9cyclictest10990-21/usr/sbin/munin20:35:310
1415099321,8cyclictest21771-21/usr/sbin/munin21:05:380
1415099321,8cyclictest21771-21/usr/sbin/munin21:05:380
1415099321,3cyclictest4666-21/usr/sbin/munin23:35:320
1415099321,3cyclictest4666-21/usr/sbin/munin23:35:320
26842310,2sleep30-21swapper/321:20:593
26842310,2sleep30-21swapper/321:20:593
213722310,2sleep121465-21/usr/sbin/munin21:40:351
213722310,2sleep121465-21/usr/sbin/munin21:40:351
158482310,3sleep10-21swapper/122:07:351
158482310,3sleep10-21swapper/122:07:351
1415099311,8cyclictest17188-21ntpq19:20:390
1415099311,8cyclictest17188-21ntpq19:20:390
1415099311,7cyclictest15200-21taskset20:45:370
1415099311,7cyclictest15200-21taskset20:45:370
1415099311,6cyclictest3833-21/usr/sbin/munin20:15:400
1415099311,6cyclictest3833-21/usr/sbin/munin20:15:400
1415099301,9cyclictest9478-21fschecks_time20:30:330
1415099301,9cyclictest9478-21fschecks_time20:30:330
1415099301,6cyclictest20155-21find19:30:310
1415099301,6cyclictest20155-21find19:30:310
1415099301,6cyclictest16670-21gltestperf20:50:320
1415099301,6cyclictest16670-21gltestperf20:50:320
81792280,1sleep28190-21ssh00:11:312
81792280,1sleep28190-21ssh00:11:312
223942280,2sleep30-21swapper/321:40:523
223942280,2sleep30-21swapper/321:40:523
140372280,4sleep20-21swapper/223:11:052
140372280,4sleep20-21swapper/223:11:052
14152992714,10cyclictest11618-21ntp_states20:35:382
14152992714,10cyclictest11618-21ntp_states20:35:382
326102260,3sleep20-21swapper/200:03:582
326102260,3sleep20-21swapper/200:03:582
128932260,3sleep30-21swapper/322:05:203
14152992517,6cyclictest13427-21rm22:38:002
14152992517,6cyclictest13427-21rm22:38:002
14151992511,10cyclictest15588-21ssh23:45:431
77602240,3sleep30-21swapper/323:05:323
193662240,3chrt0-21swapper/321:38:273
193662240,3chrt0-21swapper/321:38:273
164922240,3chrt0-21swapper/323:14:323
164922240,3chrt0-21swapper/323:14:323
14152992416,6cyclictest11237-21forks21:30:322
18652230,3sleep214149-21cyclictest21:20:382
18652230,3sleep214149-21cyclictest21:20:382
1415299231,20cyclictest24054-21ls22:15:412
1415299231,20cyclictest24054-21ls22:15:412
1415299231,20cyclictest24054-21ls22:15:412
14151992316,5cyclictest22066-21ssh22:46:201
14151992316,5cyclictest22066-21ssh22:46:201
125232230,3sleep10-21swapper/122:36:481
125232230,3sleep10-21swapper/122:36:481
265872220,4sleep30-21swapper/321:12:593
265872220,4sleep30-21swapper/321:12:593
14152992214,6cyclictest32518-21ssh21:51:182
14151992215,5cyclictest2466-21latency_hist23:00:211
14151992215,5cyclictest2466-21latency_hist23:00:211
14151992215,5cyclictest2466-21latency_hist23:00:211
1415199221,18cyclictest30984-21ssh00:35:351
1415199221,18cyclictest30984-21ssh00:35:351
1415199221,17cyclictest27520-21cut19:50:331
1415199221,17cyclictest27520-21cut19:50:331
1415199221,17cyclictest18917-21ssh22:10:391
1415199221,17cyclictest14108-21ls23:45:211
1415299213,8cyclictest25433-21latency_hist19:45:272
14152992113,6cyclictest12786-21/usr/sbin/munin20:40:402
14152992113,6cyclictest12786-21/usr/sbin/munin20:40:402
14152992110,9cyclictest25550-21ssh21:45:182
14152992110,9cyclictest25550-21ssh21:45:182
14151992113,5cyclictest0-21swapper/121:15:371
14151992113,5cyclictest0-21swapper/121:15:371
1415199211,15cyclictest30252-21ls00:00:421
1415199211,15cyclictest30252-21ls00:00:421
1415199211,15cyclictest16150-21ssh22:40:381
1415199211,15cyclictest16150-21ssh22:40:381
14151992110,8cyclictest20102-21df_inode21:00:331
205332200,4chrt0-21swapper/221:40:032
205332200,4chrt0-21swapper/221:40:032
156672200,3sleep30-21swapper/322:07:213
156672200,3sleep30-21swapper/322:07:213
14152992013,5cyclictest28750-21ssh00:00:062
14152992013,5cyclictest28750-21ssh00:00:062
14152992013,5cyclictest28750-21ssh00:00:062
14152992012,6cyclictest6149-21ssh23:03:442
14152992012,6cyclictest6149-21ssh23:03:442
14152992011,6cyclictest4430-21latency_hist23:35:272
14152992011,6cyclictest24047-21irqstats21:10:352
14152992011,6cyclictest24047-21irqstats21:10:352
1415299201,10cyclictest23053-21sed19:35:422
1415299201,10cyclictest23053-21sed19:35:422
1415199202,15cyclictest24925-21cut23:55:381
1415199202,15cyclictest24925-21cut23:55:381
1415199202,15cyclictest24925-21cut23:55:381
14151992013,5cyclictest9915-21ssh00:13:561
14151992013,5cyclictest9915-21ssh00:13:561
1415199201,12cyclictest26556-21ntp_states21:45:371
1415199201,12cyclictest26556-21ntp_states21:45:371
88142191,3sleep10-21swapper/120:28:141
88142191,3sleep10-21swapper/120:28:141
1415399191,13cyclictest0-21swapper/320:00:423
1415399191,13cyclictest0-21swapper/320:00:423
1415399191,13cyclictest0-21swapper/319:50:333
1415399191,13cyclictest0-21swapper/319:50:333
1415399191,12cyclictest0-21swapper/321:15:423
1415399191,12cyclictest0-21swapper/321:15:423
1415399191,11cyclictest0-21swapper/323:45:313
1415299196,10cyclictest23556-21ssh21:10:282
1415299196,10cyclictest23556-21ssh21:10:282
1415299191,9cyclictest695-21runrttasks20:29:472
1415299191,9cyclictest695-21runrttasks20:29:472
1415299191,9cyclictest16831-21fschecks_time19:20:342
1415299191,9cyclictest16831-21fschecks_time19:20:342
1415299191,6cyclictest0-21swapper/220:45:412
1415299191,6cyclictest0-21swapper/220:45:412
1415299191,16cyclictest4698-21ls20:15:412
1415299191,16cyclictest4698-21ls20:15:412
1415299191,15cyclictest7968-21/usr/sbin/munin23:05:332
1415299191,15cyclictest20565-21latency_hist00:25:282
1415299191,15cyclictest20565-21latency_hist00:25:282
1415299191,13cyclictest20217-21cat22:45:272
1415299191,13cyclictest20217-21cat22:45:272
1415199198,9cyclictest31296-21seq20:00:351
1415199198,9cyclictest31296-21seq20:00:351
1415199196,10cyclictest9700-21cat20:30:361
1415199196,10cyclictest9700-21cat20:30:361
14151991911,6cyclictest11563-21/usr/sbin/munin00:15:351
14151991911,6cyclictest11563-21/usr/sbin/munin00:15:351
14151991911,6cyclictest0-21swapper/120:40:201
14151991911,6cyclictest0-21swapper/120:40:201
1415199191,15cyclictest22433-21ssh00:26:091
1415199191,15cyclictest22433-21ssh00:26:091
14153991812,4cyclictest0-21swapper/321:56:533
14153991812,4cyclictest0-21swapper/321:56:533
1415399181,13cyclictest0-21swapper/320:45:323
1415399181,13cyclictest0-21swapper/320:45:323
1415399181,13cyclictest0-21swapper/320:35:413
1415399181,13cyclictest0-21swapper/320:35:413
1415399181,13cyclictest0-21swapper/300:15:423
1415399181,13cyclictest0-21swapper/300:15:423
1415399181,12cyclictest0-21swapper/323:55:323
1415399181,12cyclictest0-21swapper/323:55:323
1415399181,12cyclictest0-21swapper/323:55:323
1415399181,12cyclictest0-21swapper/321:45:393
1415399181,12cyclictest0-21swapper/321:45:393
1415399181,11cyclictest0-21swapper/319:35:413
1415399181,11cyclictest0-21swapper/319:35:413
1415299187,9cyclictest4242-21ssh22:29:052
1415299187,9cyclictest4242-21ssh22:29:052
1415299181,8cyclictest19986-21/usr/sbin/munin21:00:342
1415299181,7cyclictest0-21swapper/200:16:522
1415299181,7cyclictest0-21swapper/200:16:522
14152991811,5cyclictest19324-21kworker/u8:323:21:512
14152991811,5cyclictest1434-21sshd20:05:572
14152991811,5cyclictest1434-21sshd20:05:572
14152991811,5cyclictest0-21swapper/223:15:362
14152991811,5cyclictest0-21swapper/223:15:362
14152991811,5cyclictest0-21swapper/223:15:362
1415299181,14cyclictest17466-21unixbench_multi20:50:412
1415299181,14cyclictest17466-21unixbench_multi20:50:412
14152991810,6cyclictest12892-21cat22:05:202
1415199189,7cyclictest1202-21ssh21:52:501
1415199189,5cyclictest20865-21sh21:40:231
1415199189,5cyclictest20865-21sh21:40:231
1415199181,6cyclictest0-21swapper/119:48:471
14151991812,4cyclictest0-21swapper/119:55:381
14151991812,4cyclictest0-21swapper/119:55:381
14151991812,4cyclictest0-21swapper/119:55:381
14151991812,4cyclictest0-21swapper/100:05:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional