You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 18:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Jun 17, 2026 12:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44582950,3sleep10-21swapper/112:31:501
44582950,3sleep10-21swapper/112:31:501
29120999083,5cyclictest16862-21sshd08:08:421
29120999083,5cyclictest16862-21sshd08:08:421
163112860,3chrt0-21swapper/209:22:052
163112860,3chrt0-21swapper/209:22:052
163112860,3chrt0-21swapper/209:22:052
179592810,3sleep20-21swapper/211:27:042
179592810,3sleep20-21swapper/211:27:042
12822810,2chrt0-21swapper/110:25:461
12822810,2chrt0-21swapper/110:25:461
12822810,2chrt0-21swapper/110:25:461
296532780,3sleep20-21swapper/211:01:242
296532780,3sleep20-21swapper/211:01:242
296532780,3sleep20-21swapper/211:01:242
121262740,2sleep20-21swapper/209:58:422
121262740,2sleep20-21swapper/209:58:422
151712720,8sleep012-21ksoftirqd/010:43:220
151712720,8sleep012-21ksoftirqd/010:43:220
36412700,3sleep10-21swapper/107:30:481
36412700,3sleep10-21swapper/107:30:481
59472690,3sleep20-21swapper/211:53:452
59472690,3sleep20-21swapper/211:53:452
212502690,2sleep221399-21fschecks_time10:10:372
212502690,2sleep221399-21fschecks_time10:10:372
212502690,2sleep221399-21fschecks_time10:10:372
89822680,4chrt8983-21rm10:35:471
153712660,2sleep30-21swapper/312:05:323
153712660,2sleep30-21swapper/312:05:323
192522640,3sleep30-21swapper/308:15:393
290642610,2sleep027625-21ls07:10:590
290642610,2sleep027625-21ls07:10:590
202932590,2sleep00-21swapper/010:09:130
202932590,2sleep00-21swapper/010:09:130
202932590,2sleep00-21swapper/010:09:130
35172580,3chrt0-21swapper/310:29:223
35172580,3chrt0-21swapper/310:29:223
35172580,3chrt0-21swapper/310:29:223
290932570,3sleep30-21swapper/311:00:503
290932570,3sleep30-21swapper/311:00:503
290932570,3sleep30-21swapper/311:00:503
174782570,3sleep10-21swapper/110:45:481
174782570,3sleep10-21swapper/110:45:481
174782570,3sleep10-21swapper/110:45:481
258912540,3chrt0-21swapper/312:18:263
258912540,3chrt0-21swapper/312:18:263
317662520,3chrt0-21swapper/312:25:413
317662520,3chrt0-21swapper/312:25:413
275682520,3sleep00-21swapper/012:20:400
275682520,3sleep00-21swapper/012:20:400
272032510,2sleep227212-21ssh10:17:402
272032510,2sleep227212-21ssh10:17:402
272032510,2sleep227212-21ssh10:17:402
306232500,3sleep30-21swapper/307:15:473
306232500,3sleep30-21swapper/307:15:473
221042500,4chrt0-21swapper/310:10:453
221042500,4chrt0-21swapper/310:10:453
188152500,3chrt0-21swapper/111:28:441
188152500,3chrt0-21swapper/111:28:441
97412490,2sleep09851-21ls09:55:400
97412490,2sleep09851-21ls09:55:400
185752490,3chrt0-21swapper/312:09:213
185752490,3chrt0-21swapper/312:09:213
36922480,3sleep00-21swapper/010:29:430
36922480,3sleep00-21swapper/010:29:430
36922480,3sleep00-21swapper/010:29:430
297992470,1sleep10-21swapper/112:23:221
297992470,1sleep10-21swapper/112:23:221
312532460,3sleep30-21swapper/309:40:473
312532460,3sleep30-21swapper/309:40:473
2912099461,28cyclictest0-21swapper/110:13:471
2912099461,28cyclictest0-21swapper/110:13:471
97982450,3sleep00-21swapper/011:58:130
97982450,3sleep00-21swapper/011:58:130
97982450,3sleep00-21swapper/011:58:130
274032450,1sleep3321rcuc/311:40:243
274032450,1sleep3321rcuc/311:40:243
274032450,1sleep3321rcuc/311:40:243
225672450,4sleep30-21swapper/310:52:493
225672450,4sleep30-21swapper/310:52:493
143692450,3sleep30-21swapper/310:41:443
143692450,3sleep30-21swapper/310:41:443
146862440,3chrt0-21swapper/212:04:222
146862440,3chrt0-21swapper/212:04:222
2912199430,6cyclictest31506-21runrttasks10:23:202
2912199430,6cyclictest31506-21runrttasks10:23:202
2912199430,6cyclictest31506-21runrttasks10:23:202
166002430,3chrt0-21swapper/308:05:503
166002430,3chrt0-21swapper/308:05:503
97092420,3chrt0-21swapper/210:36:162
2912199421,9cyclictest8293-21ssh09:53:542
2912199421,9cyclictest8293-21ssh09:53:542
2912099421,27cyclictest0-21swapper/107:42:081
2912099421,27cyclictest0-21swapper/107:42:081
73122410,3chrt0-21swapper/110:34:101
73122410,3chrt0-21swapper/110:34:101
51832410,2sleep20-21swapper/209:50:272
51832410,2sleep20-21swapper/209:50:272
51832410,2sleep20-21swapper/209:50:272
51832410,2sleep20-21swapper/209:50:272
2912099411,26cyclictest6074-21seq09:07:481
2912099411,26cyclictest6074-21seq09:07:481
2912099411,26cyclictest6074-21seq09:07:481
106342410,3sleep30-21swapper/307:50:433
106342410,3sleep30-21swapper/307:50:433
2912099401,25cyclictest817-21runrttasks08:53:131
2912099401,25cyclictest817-21runrttasks08:53:131
286262400,2sleep30-21swapper/308:40:423
286262400,2sleep30-21swapper/308:40:423
2912199391,26cyclictest0-21swapper/208:24:482
2912199391,26cyclictest0-21swapper/208:24:482
2912199391,26cyclictest0-21swapper/208:24:482
2912099391,26cyclictest817-21runrttasks07:28:101
248302390,3sleep30-21swapper/310:55:423
248302390,3sleep30-21swapper/310:55:423
248302390,3sleep30-21swapper/310:55:423
295562380,2sleep229563-21sh09:40:062
295562380,2sleep229563-21sh09:40:062
295562380,2sleep229563-21sh09:40:062
2912199380,7cyclictest9332-21sh11:57:312
2912199380,7cyclictest9332-21sh11:57:312
2912199380,7cyclictest9332-21sh11:57:312
2912099381,22cyclictest8026-21memory11:15:411
2912099381,22cyclictest8026-21memory11:15:411
2912099371,25cyclictest817-21runrttasks08:47:271
2912099371,25cyclictest817-21runrttasks08:47:271
2912099371,25cyclictest817-21runrttasks08:47:271
2912099371,25cyclictest0-21swapper/111:42:051
2912099371,25cyclictest0-21swapper/111:42:051
2912199363,30cyclictest4676-21grep11:10:492
2912199363,30cyclictest4676-21grep11:10:492
2912199363,30cyclictest4676-21grep11:10:492
29120993616,18cyclictest2608-21ssh11:09:091
29120993616,18cyclictest2608-21ssh11:09:091
2912099361,5cyclictest3962-21unixbench_multi09:00:491
2912099361,5cyclictest3962-21unixbench_multi09:00:491
2912099361,5cyclictest3962-21unixbench_multi09:00:491
165292360,2sleep016537-21ssh09:22:320
165292360,2sleep016537-21ssh09:22:320
165292360,2sleep016537-21ssh09:22:320
2912099351,30cyclictest13762-21df_inode08:00:371
2912099351,30cyclictest13762-21df_inode08:00:371
2912099351,23cyclictest7737-21sh09:52:481
2912099351,23cyclictest7737-21sh09:52:481
318352340,3sleep231803-21ssh11:45:372
318352340,3sleep231803-21ssh11:45:372
2912199342,28cyclictest6679-21seq09:10:372
2912199342,28cyclictest6679-21seq09:10:372
2912199342,28cyclictest26208-21/usr/sbin/munin08:35:392
2912199341,10cyclictest16104-21ssh11:25:362
2912199341,10cyclictest16104-21ssh11:25:362
2912099341,31cyclictest2296-21proc_pri09:45:451
2912099341,31cyclictest2296-21proc_pri09:45:451
2912099341,31cyclictest2296-21proc_pri09:45:451
2912099341,31cyclictest2296-21proc_pri09:45:451
2912099341,30cyclictest4636-21timerwakeupswit11:10:491
2912099341,30cyclictest4636-21timerwakeupswit11:10:491
2912099341,30cyclictest4636-21timerwakeupswit11:10:491
2912099341,30cyclictest26993-21/usr/sbin/munin08:35:451
2912099341,30cyclictest11949-21fschecks_count07:55:381
2912099341,30cyclictest11949-21fschecks_count07:55:381
2912099341,29cyclictest32376-21ntp_offset11:45:421
2912099341,29cyclictest32376-21ntp_offset11:45:421
2912099341,10cyclictest25594-21seq11:36:471
2912099341,10cyclictest25594-21seq11:36:471
2912099341,10cyclictest25594-21seq11:36:471
89242330,4sleep30-21swapper/309:12:573
89242330,4sleep30-21swapper/309:12:573
2912199331,9cyclictest27829-21sed11:40:372
2912199331,9cyclictest27829-21sed11:40:372
2912199331,9cyclictest27829-21sed11:40:372
2912199331,8cyclictest19143-21processes09:25:442
2912199331,8cyclictest19143-21processes09:25:442
2912199331,8cyclictest19143-21processes09:25:442
2912199331,29cyclictest817-21runrttasks11:19:552
2912199331,29cyclictest817-21runrttasks11:19:552
2912199331,27cyclictest9784-21ssh09:14:392
2912199331,27cyclictest9784-21ssh09:14:392
2912199331,11cyclictest15811-21irqstats08:05:422
2912199331,11cyclictest15811-21irqstats08:05:422
2912099332,21cyclictest212482kernelversion08:20:411
2912099332,21cyclictest212482kernelversion08:20:411
2912099332,21cyclictest212482kernelversion08:20:411
2912099331,9cyclictest8528-21irqstats07:45:401
2912099331,9cyclictest8528-21irqstats07:45:401
2912099331,9cyclictest8528-21irqstats07:45:401
2912099331,8cyclictest15632-21taskset10:44:181
2912099331,8cyclictest15632-21taskset10:44:181
2912099331,29cyclictest21941-21sh09:30:261
2912099331,29cyclictest21941-21sh09:30:261
2912099331,29cyclictest21941-21sh09:30:261
2912099331,29cyclictest14153-21ntp_states10:00:441
2912099331,29cyclictest14153-21ntp_states10:00:441
2912099331,29cyclictest0-21swapper/108:30:151
2912099331,29cyclictest0-21swapper/108:30:151
2912099331,29cyclictest0-21swapper/108:30:151
2912099331,10cyclictest17490-21perl08:10:401
2912099331,10cyclictest17490-21perl08:10:401
171972330,3chrt0-21swapper/309:23:513
171972330,3chrt0-21swapper/309:23:513
171972330,3chrt0-21swapper/309:23:513
2912199323,26cyclictest2508-21latency_hist07:30:262
2912199322,26cyclictest11293-21ssh09:15:442
2912199322,26cyclictest11293-21ssh09:15:442
2912199322,26cyclictest11293-21ssh09:15:442
2912199321,9cyclictest5571-21sed07:35:492
2912199321,9cyclictest5571-21sed07:35:492
2912199321,7cyclictest12698-21xargs07:55:472
2912199321,7cyclictest12698-21xargs07:55:472
2912199321,3cyclictest0-21swapper/210:13:412
2912199321,3cyclictest0-21swapper/210:13:412
2912199321,27cyclictest30331-21ntp_states07:15:442
2912199321,27cyclictest30331-21ntp_states07:15:442
2912199321,10cyclictest25242-21mailstats08:30:472
2912199321,10cyclictest25242-21mailstats08:30:472
2912099321,9cyclictest28403-21/usr/sbin/munin11:00:401
2912099321,9cyclictest28403-21/usr/sbin/munin11:00:401
2912099321,9cyclictest28403-21/usr/sbin/munin11:00:401
2912099321,6cyclictest9079-21ssh11:57:071
2912099321,6cyclictest9079-21ssh11:57:071
2912099321,6cyclictest9079-21ssh11:57:071
2912099321,6cyclictest18843-21diskmemload10:06:201
2912099321,6cyclictest18843-21diskmemload10:06:201
2912099321,6cyclictest18843-21diskmemload10:06:201
2912099321,2cyclictest0-21swapper/107:15:401
2912099321,2cyclictest0-21swapper/107:15:401
2912099321,29cyclictest23089-21ssh11:34:311
2912099321,29cyclictest23089-21ssh11:34:311
2912099321,29cyclictest23089-21ssh11:34:311
2912099321,28cyclictest9460-21ssh12:38:261
2912099321,28cyclictest9460-21ssh12:38:261
2912099321,28cyclictest23913-21awk10:55:261
2912099321,28cyclictest23913-21awk10:55:261
2912099321,27cyclictest30530-21memory09:40:391
2912099320,5cyclictest31875-21/usr/sbin/munin12:25:441
2912099320,5cyclictest31875-21/usr/sbin/munin12:25:441
232442320,2sleep20-21swapper/210:54:132
232442320,2sleep20-21swapper/210:54:132
218262320,2sleep30-21swapper/311:32:003
218262320,2sleep30-21swapper/311:32:003
218262320,2sleep30-21swapper/311:32:003
180582320,2sleep20-21swapper/210:46:252
180582320,2sleep20-21swapper/210:46:252
180582320,2sleep20-21swapper/210:46:252
67372310,2sleep20-21swapper/210:33:032
67372310,2sleep20-21swapper/210:33:032
2912199312,26cyclictest2612-21/usr/sbin/munin12:30:442
2912199312,26cyclictest2612-21/usr/sbin/munin12:30:442
2912199311,8cyclictest9812-21latency_hist07:50:282
2912199311,8cyclictest9812-21latency_hist07:50:282
2912199311,8cyclictest9812-21latency_hist07:50:282
2912199311,8cyclictest7279-21ntpq12:35:442
2912199311,8cyclictest7279-21ntpq12:35:442
2912199311,8cyclictest20788-21grep11:30:462
2912199311,8cyclictest20788-21grep11:30:462
2912199311,8cyclictest20788-21grep11:30:462
2912199311,7cyclictest2896-21/usr/sbin/munin09:00:442
2912199311,7cyclictest2896-21/usr/sbin/munin09:00:442
2912199311,7cyclictest2896-21/usr/sbin/munin09:00:442
2912199311,7cyclictest27833-21needreboot12:20:432
2912199311,7cyclictest27833-21needreboot12:20:432
2912199311,7cyclictest24708-21taskset09:33:162
2912199311,7cyclictest24708-21taskset09:33:162
2912199311,7cyclictest1596-21grep10:25:482
2912199311,7cyclictest1596-21grep10:25:482
2912199311,7cyclictest1596-21grep10:25:482
2912199311,6cyclictest25369-21grep10:55:472
2912199311,6cyclictest25369-21grep10:55:472
2912199311,6cyclictest25369-21grep10:55:472
2912199311,6cyclictest17870-21ntp_kernel_pll_08:10:442
2912199311,6cyclictest17870-21ntp_kernel_pll_08:10:442
2912199311,2cyclictest0-21swapper/211:45:462
2912199311,2cyclictest0-21swapper/211:45:462
2912199311,26cyclictest31837-21grep07:20:382
2912199311,26cyclictest31837-21grep07:20:382
2912199311,26cyclictest2967-21grep12:30:382
2912199311,26cyclictest13470-21/usr/sbin/munin10:00:362
2912199311,26cyclictest13470-21/usr/sbin/munin10:00:362
2912199311,25cyclictest11063-21unixbench_multi07:50:472
2912199311,25cyclictest11063-21unixbench_multi07:50:472
2912199311,14cyclictest32294-21netstat08:50:432
2912199311,14cyclictest32294-21netstat08:50:432
2912199311,10cyclictest23275-21ntpq08:25:452
2912199311,10cyclictest23275-21ntpq08:25:452
2912199311,10cyclictest23275-21ntpq08:25:452
2912199311,10cyclictest18355-21ssh12:08:552
2912199311,10cyclictest18355-21ssh12:08:552
2912099314,24cyclictest9883-21load09:55:401
2912099314,24cyclictest9883-21load09:55:401
2912099312,26cyclictest16082-21ssh12:05:421
2912099312,26cyclictest16082-21ssh12:05:421
2912099311,8cyclictest23800-21/usr/sbin/munin12:15:401
2912099311,8cyclictest23800-21/usr/sbin/munin12:15:401
2912099311,8cyclictest20655-21vmstat12:10:491
2912099311,8cyclictest20655-21vmstat12:10:491
2912099311,8cyclictest1544-21memory08:55:401
2912099311,8cyclictest1544-21memory08:55:401
2912099311,8cyclictest10271-21fw_packets07:50:381
2912099311,8cyclictest10271-21fw_packets07:50:381
2912099311,27cyclictest5116-21ssh11:52:101
2912099311,27cyclictest5116-21ssh11:52:101
2912099311,26cyclictest7265-21ntp_states09:10:451
2912099311,26cyclictest7265-21ntp_states09:10:451
2912099311,26cyclictest26609-21memory09:35:421
2912099311,26cyclictest26609-21memory09:35:421
2912099311,10cyclictest24562-21df_inode08:30:381
2912099311,10cyclictest24562-21df_inode08:30:381
2912099310,28cyclictest26602-21sh10:58:111
2912099310,28cyclictest26602-21sh10:58:111
2912099310,28cyclictest26602-21sh10:58:111
249342310,3sleep30-21swapper/309:33:433
249342310,3sleep30-21swapper/309:33:433
232422310,2sleep20-21swapper/212:15:362
232422310,2sleep20-21swapper/212:15:362
169622310,3sleep00-21swapper/011:25:460
169622310,3sleep00-21swapper/011:25:460
149532310,1sleep333-21ksoftirqd/310:01:163
149532310,1sleep333-21ksoftirqd/310:01:163
143622310,3chrt0-21swapper/012:03:440
143622310,3chrt0-21swapper/012:03:440
77472300,7sleep333-21ksoftirqd/310:35:013
77472300,7sleep333-21ksoftirqd/310:35:013
2912199302,25cyclictest29638-21latency_hist07:15:322
2912199302,25cyclictest29638-21latency_hist07:15:322
2912199301,8cyclictest32341-21grep12:25:482
2912199301,8cyclictest19910-21sed08:15:472
2912199301,7cyclictest7297-21sed07:40:472
2912199301,7cyclictest7297-21sed07:40:472
2912199301,7cyclictest3522-21cat11:10:362
2912199301,7cyclictest3522-21cat11:10:362
2912199301,6cyclictest28924-21mailstats08:41:222
2912199301,6cyclictest28924-21mailstats08:41:222
2912199301,6cyclictest13441-21ssh10:40:432
2912199301,6cyclictest13441-21ssh10:40:432
2912199301,6cyclictest1275-21fschecks_time08:55:372
2912199301,6cyclictest1275-21fschecks_time08:55:372
2912199301,24cyclictest13651-21/usr/sbin/munin08:00:402
2912199301,24cyclictest13651-21/usr/sbin/munin08:00:402
2912199300,7cyclictest30665-21/usr/sbin/munin09:40:412
2912199300,7cyclictest30665-21/usr/sbin/munin09:40:412
2912199300,7cyclictest25067-21sh12:16:492
2912199300,7cyclictest25067-21sh12:16:492
2912199300,4cyclictest31486-21awk08:50:272
2912199300,4cyclictest31486-21awk08:50:272
2912199300,4cyclictest31486-21awk08:50:272
2912099302,24cyclictest14683-21fschecks_time09:20:391
2912099302,24cyclictest14683-21fschecks_time09:20:391
2912099302,24cyclictest14683-21fschecks_time09:20:391
2912099301,7cyclictest31670-21forks07:20:381
2912099301,7cyclictest31670-21forks07:20:381
2912099301,6cyclictest4787-21grep07:35:401
2912099301,6cyclictest4787-21grep07:35:401
2912099301,2cyclictest0-21swapper/109:31:081
2912099301,2cyclictest0-21swapper/109:31:081
2912099301,27cyclictest31278-21ssh09:40:471
2912099301,27cyclictest31278-21ssh09:40:471
2912099301,26cyclictest30369-21ssh10:21:081
2912099301,26cyclictest30369-21ssh10:21:081
2912099301,26cyclictest30369-21ssh10:21:081
2912099301,26cyclictest28797-21/usr/sbin/munin08:41:211
2912099301,26cyclictest28797-21/usr/sbin/munin08:41:211
2912099301,26cyclictest0-21swapper/110:18:051
2912099301,26cyclictest0-21swapper/110:18:051
2912099301,26cyclictest0-21swapper/110:18:051
2912099301,25cyclictest13275-21grep11:20:471
2912099301,25cyclictest13275-21grep11:20:471
2912099301,25cyclictest11691-21df_inode12:00:381
2912099301,25cyclictest11691-21df_inode12:00:381
2912099301,25cyclictest11520-21cat09:15:451
2912099301,25cyclictest11520-21cat09:15:451
2912099301,25cyclictest11520-21cat09:15:451
63772290,2sleep06476-21awk07:40:360
63772290,2sleep06476-21awk07:40:360
2912199291,4cyclictest5303-21tr09:05:432
2912199291,24cyclictest3161-21latency07:30:412
2912199291,24cyclictest3161-21latency07:30:412
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional