You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 18:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Tue Jun 09, 2026 12:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1828521540,3sleep30-21swapper/312:05:243
1828521540,3sleep30-21swapper/312:05:243
1720321430,2sleep117204-21perl07:55:321
1720321430,2sleep117204-21perl07:55:321
266921380,3sleep30-21swapper/311:45:183
266921380,3sleep30-21swapper/311:45:183
426621220,3sleep30-21swapper/312:26:223
426621220,3sleep30-21swapper/312:26:223
3112121120,2sleep20-21swapper/210:15:312
853121110,3chrt0-21swapper/307:30:353
1071221090,2chrt0-21swapper/109:50:341
1071221090,2chrt0-21swapper/109:50:341
374821040,6sleep319525-21kworker/3:211:04:033
374821040,6sleep319525-21kworker/3:211:04:033
374821040,6sleep319525-21kworker/3:211:04:033
257721030,2sleep30-21swapper/309:40:313
2226421020,2chrt0-21swapper/310:45:223
2226421020,2chrt0-21swapper/310:45:223
514921010,2sleep30-21swapper/308:50:403
1617321000,2sleep10-21swapper/110:37:041
109392980,3sleep30-21swapper/310:30:393
179562970,1sleep121-21ksoftirqd/112:04:531
179562970,1sleep121-21ksoftirqd/112:04:531
129812930,4chrt0-21swapper/311:57:443
129812930,4chrt0-21swapper/311:57:443
121472880,3chrt0-21swapper/311:15:363
121472880,3chrt0-21swapper/311:15:363
121472880,3chrt0-21swapper/311:15:363
121472880,3chrt0-21swapper/311:15:363
47452860,3sleep10-21swapper/111:46:491
47452860,3sleep10-21swapper/111:46:491
34262820,2sleep30-21swapper/310:20:423
34262820,2sleep30-21swapper/310:20:423
24822770,3sleep10-21swapper/111:01:031
24822770,3sleep10-21swapper/111:01:031
24822770,3sleep10-21swapper/111:01:031
239252740,2sleep30-21swapper/312:11:313
239252740,2sleep30-21swapper/312:11:313
143292740,2sleep30-21swapper/309:55:223
143292740,2sleep30-21swapper/309:55:223
301802730,2sleep11969-21cyclictest10:14:411
301802730,2sleep11969-21cyclictest10:14:411
263282730,3sleep10-21swapper/110:50:301
263282730,3sleep10-21swapper/110:50:301
177252700,3sleep30-21swapper/310:39:273
165492690,5sleep30-21swapper/309:56:513
165492690,5sleep30-21swapper/309:56:513
19282680,4sleep1476-21ls07:11:001
298472670,3sleep30-21swapper/311:38:233
298472670,3sleep30-21swapper/311:38:233
108122620,1sleep210938-21cut10:30:392
192702590,3sleep119147-21/usr/sbin/munin10:00:311
192702590,3sleep119147-21/usr/sbin/munin10:00:311
192702590,3sleep119147-21/usr/sbin/munin10:00:311
50382570,2sleep25148-21sort08:50:402
246252550,3sleep20-21swapper/209:26:072
246252550,3sleep20-21swapper/209:26:072
268802530,2sleep30-21swapper/312:15:333
268802530,2sleep30-21swapper/312:15:333
239752520,3sleep10-21swapper/112:11:371
239752520,3sleep10-21swapper/112:11:371
82242510,3sleep10-21swapper/112:31:341
82242510,3sleep10-21swapper/112:31:341
259722500,3sleep30-21swapper/311:34:293
179692480,2sleep10-21swapper/111:24:381
179692480,2sleep10-21swapper/111:24:381
179692480,2sleep10-21swapper/111:24:381
250882470,3sleep10-21swapper/111:33:061
59132450,2sleep10-21swapper/110:25:181
59132450,2sleep10-21swapper/110:25:181
64502440,2sleep121-21ksoftirqd/109:45:321
53172440,2sleep00-21swapper/011:47:560
53172440,2sleep00-21swapper/011:47:560
308452440,1sleep227-21ksoftirqd/209:35:282
308452440,1sleep227-21ksoftirqd/209:35:282
291922440,3sleep10-21swapper/110:54:041
291922440,3sleep10-21swapper/110:54:041
291922440,3sleep10-21swapper/110:54:041
131842440,3chrt0-21swapper/312:38:393
131842440,3chrt0-21swapper/312:38:393
23862430,3sleep30-21swapper/308:45:253
23862430,3sleep30-21swapper/308:45:253
23862430,3sleep30-21swapper/308:45:253
127122430,2sleep10-21swapper/111:15:421
127122430,2sleep10-21swapper/111:15:421
127122430,2sleep10-21swapper/111:15:421
127122430,2sleep10-21swapper/111:15:421
140862420,3sleep00-21swapper/009:55:070
140862420,3sleep00-21swapper/009:55:070
113392410,3sleep20-21swapper/211:55:382
113392410,3sleep20-21swapper/211:55:382
116312400,4sleep20-21swapper/211:15:312
116312400,4sleep20-21swapper/211:15:312
116312400,4sleep20-21swapper/211:15:312
68432390,2sleep2261rcuc/207:25:352
68432390,2sleep2261rcuc/207:25:352
68432390,2sleep2261rcuc/207:25:352
283182390,3sleep30-21swapper/308:25:363
283182390,3sleep30-21swapper/308:25:363
283182390,3sleep30-21swapper/308:25:363
102442390,2chrt0-21swapper/310:30:313
102442390,2chrt0-21swapper/310:30:313
99482380,4chrt0-21swapper/311:54:223
99482380,4chrt0-21swapper/311:54:223
320092380,2sleep00-21swapper/010:57:290
320092380,2sleep00-21swapper/010:57:290
320092380,2sleep00-21swapper/010:57:290
76952370,2sleep07704-21sh10:26:150
76952370,2sleep07704-21sh10:26:150
76952370,2sleep07704-21sh10:26:150
197282370,3sleep10-21swapper/112:05:461
197282370,3sleep10-21swapper/112:05:461
316162360,2sleep030732-21/usr/sbin/munin10:15:380
316162360,2sleep030732-21/usr/sbin/munin10:15:380
316162360,2sleep030732-21/usr/sbin/munin10:15:380
301362360,4sleep20-21swapper/211:38:502
301362360,4sleep20-21swapper/211:38:502
265832360,3chrt0-21swapper/309:30:023
265832360,3chrt0-21swapper/309:30:023
262142360,3sleep10-21swapper/108:20:321
262142360,3sleep10-21swapper/108:20:321
299122330,2sleep229921-21ssh10:14:112
260242330,3sleep227-21ksoftirqd/210:50:192
260242330,3sleep227-21ksoftirqd/210:50:192
282942320,2sleep028304-21rm12:16:270
282942320,2sleep028304-21rm12:16:270
233482320,1sleep20-21swapper/210:05:342
233482320,1sleep20-21swapper/210:05:342
218972320,3sleep30-21swapper/311:30:113
218972320,3sleep30-21swapper/311:30:113
176512320,1sleep211217-21diskmemload09:58:322
176512320,1sleep211217-21diskmemload09:58:322
26582300,3sleep10-21swapper/107:15:301
26582300,3sleep10-21swapper/107:15:301
293492290,3chrt0-21swapper/109:32:501
293492290,3chrt0-21swapper/109:32:501
254832290,2sleep225495-21ssh11:33:452
158372290,3sleep10-21swapper/107:50:381
158372290,3sleep10-21swapper/107:50:381
1970992815,10cyclictest21589-21ssh10:44:080
1970992815,10cyclictest21589-21ssh10:44:080
92832270,2chrt0-21swapper/310:29:223
1970992716,5cyclictest12-21ksoftirqd/008:05:340
1970992716,5cyclictest12-21ksoftirqd/008:05:340
1970992716,5cyclictest12-21ksoftirqd/008:05:340
19132276,8sleep00-21swapper/007:10:510
150542260,2sleep30-21swapper/307:50:243
150542260,2sleep30-21swapper/307:50:243
77402250,3sleep10-21swapper/110:26:191
77402250,3sleep10-21swapper/110:26:191
77402250,3sleep10-21swapper/110:26:191
49202250,3chrt0-21swapper/108:50:381
286732250,2sleep00-21swapper/010:11:430
286732250,2sleep00-21swapper/010:11:430
225882250,2sleep00-21swapper/010:05:000
225882250,2sleep00-21swapper/010:05:000
225882250,2sleep00-21swapper/010:05:000
1972992516,7cyclictest1886-21gzip11:00:382
1972992516,7cyclictest1886-21gzip11:00:382
1972992516,7cyclictest1886-21gzip11:00:382
1970992514,5cyclictest12-21ksoftirqd/012:25:330
1970992514,5cyclictest12-21ksoftirqd/012:25:330
10952257,7sleep20-21swapper/207:10:332
17972244,12sleep30-21swapper/307:10:423
146202240,4sleep214612-21ssh10:35:362
82112231,17sleep20-21swapper/209:00:322
82112231,17sleep20-21swapper/209:00:322
315572230,4sleep10-21swapper/108:35:311
315572230,4sleep10-21swapper/108:35:311
257492230,2sleep10-21swapper/109:28:231
257492230,2sleep10-21swapper/109:28:231
1972992315,6cyclictest6620-21ssh12:30:292
1972992315,6cyclictest6620-21ssh12:30:292
1971992316,5cyclictest4993-21ssh12:27:501
1971992316,5cyclictest4993-21ssh12:27:501
197199231,19cyclictest27433-21ls12:15:391
197199231,19cyclictest27433-21ls12:15:391
197099231,12cyclictest4807-21fschecks_time11:05:320
197099231,12cyclictest4807-21fschecks_time11:05:320
197099231,12cyclictest4807-21fschecks_time11:05:320
1972992210,10cyclictest27783-21ssh10:51:132
1972992210,10cyclictest27783-21ssh10:51:132
1972992210,10cyclictest27783-21ssh10:51:132
197299220,19cyclictest11799-21ls09:10:332
197199221,4cyclictest0-21swapper/110:57:151
197199221,4cyclictest0-21swapper/110:57:151
197199221,4cyclictest0-21swapper/110:57:151
1971992211,8cyclictest10960-21memory12:35:361
1971992211,8cyclictest10960-21memory12:35:361
197099225,14cyclictest38250irq/56-eth011:30:390
1970992214,5cyclictest12-21ksoftirqd/009:20:100
1970992214,5cyclictest12-21ksoftirqd/009:20:100
1970992214,5cyclictest12-21ksoftirqd/009:20:100
213772210,3sleep10-21swapper/110:43:431
213772210,3sleep10-21swapper/110:43:431
205172210,3sleep20-21swapper/209:20:412
205172210,3sleep20-21swapper/209:20:412
1972992113,6cyclictest4905-21ssh11:47:082
1972992113,6cyclictest4905-21ssh11:47:082
1972992113,6cyclictest30656-21sshd08:30:462
197299211,17cyclictest18746-21cut10:40:322
197299211,17cyclictest18746-21cut10:40:322
1971992114,5cyclictest2067-21ssh12:24:381
1971992114,5cyclictest2067-21ssh12:24:381
1971992114,5cyclictest2067-21ssh12:24:381
1971992114,4cyclictest25639-21latency_hist08:20:181
1971992114,4cyclictest25639-21latency_hist08:20:181
197199211,3cyclictest0-21swapper/109:50:011
197199211,3cyclictest0-21swapper/109:50:011
1971992113,5cyclictest21-21ksoftirqd/109:40:291
1971992113,5cyclictest21-21ksoftirqd/109:40:291
1971992113,5cyclictest21-21ksoftirqd/109:40:291
197199211,15cyclictest11508-21date09:10:301
197199211,15cyclictest11508-21date09:10:301
197199211,15cyclictest11508-21date09:10:301
197199211,11cyclictest28367-21wc08:25:371
197199211,11cyclictest28367-21wc08:25:371
197199211,11cyclictest28367-21wc08:25:371
197199211,10cyclictest32342-21/usr/sbin/munin11:40:371
197199211,10cyclictest32342-21/usr/sbin/munin11:40:371
197099219,4cyclictest38250irq/56-eth011:10:400
197099219,4cyclictest38250irq/56-eth011:10:400
197099219,4cyclictest38250irq/56-eth011:10:400
197099218,4cyclictest38250irq/56-eth010:20:390
197099218,4cyclictest38250irq/56-eth010:20:390
197099218,4cyclictest38250irq/56-eth008:50:320
197099215,3cyclictest131rcu_preempt11:25:390
197099215,3cyclictest131rcu_preempt11:25:390
1970992113,5cyclictest22392-21df_inode12:10:320
1970992113,5cyclictest22392-21df_inode12:10:320
197099211,14cyclictest27644-21find08:25:280
197099211,14cyclictest27644-21find08:25:280
4752200,2sleep20-21swapper/210:17:202
4752200,2sleep20-21swapper/210:17:202
4752200,2sleep20-21swapper/210:17:202
197399201,11cyclictest0-21swapper/309:25:263
197399201,11cyclictest0-21swapper/309:25:263
1972992012,6cyclictest28482-21kworker/u8:711:42:442
1972992012,6cyclictest28482-21kworker/u8:711:42:442
197199208,9cyclictest19467-21fschecks_count09:20:311
197199208,9cyclictest19467-21fschecks_count09:20:311
1971992013,5cyclictest18109-21ssh09:18:421
1971992013,5cyclictest18109-21ssh09:18:421
1971992013,5cyclictest18109-21ssh09:18:421
1971992012,5cyclictest11217-21diskmemload09:56:161
1971992012,5cyclictest11217-21diskmemload09:56:161
197199201,17cyclictest8869-21ls07:30:391
1971992011,6cyclictest5719-21grep11:05:421
1971992011,6cyclictest5719-21grep11:05:421
1971992011,6cyclictest5719-21grep11:05:421
197199201,11cyclictest7877-21timerwakeupswit11:50:411
197199201,11cyclictest7877-21timerwakeupswit11:50:411
1971992010,3cyclictest21-21ksoftirqd/108:35:181
197099209,9cyclictest38250irq/56-eth010:45:470
197099209,9cyclictest38250irq/56-eth010:45:470
197099209,9cyclictest38150irq/55-eth011:39:480
197099209,9cyclictest38150irq/55-eth011:39:480
197099208,4cyclictest38250irq/56-eth010:33:330
197099208,4cyclictest38250irq/56-eth009:55:320
197099208,4cyclictest38250irq/56-eth009:55:320
197099208,10cyclictest38250irq/56-eth012:30:540
197099208,10cyclictest38250irq/56-eth012:30:540
197099208,10cyclictest38250irq/56-eth011:41:130
197099208,10cyclictest38250irq/56-eth011:41:130
197099207,10cyclictest38250irq/56-eth009:30:280
197099207,10cyclictest38250irq/56-eth009:30:280
197099206,3cyclictest131rcu_preempt11:25:340
197099206,3cyclictest131rcu_preempt11:25:340
197099206,3cyclictest131rcu_preempt11:25:340
197099204,4cyclictest131rcu_preempt09:20:320
197099204,4cyclictest131rcu_preempt09:20:320
197099201,7cyclictest2254-21latency_hist09:40:240
197099201,7cyclictest2254-21latency_hist09:40:240
197099201,7cyclictest2254-21latency_hist09:40:240
1970992012,6cyclictest674-21snmpd08:18:350
1970992012,6cyclictest674-21snmpd08:18:350
1970992012,6cyclictest14936-21cron07:50:180
1970992012,6cyclictest14936-21cron07:50:180
197099201,11cyclictest3338-21wc09:40:400
197099201,11cyclictest3338-21wc09:40:400
18162201,2sleep00-21swapper/012:24:110
18162201,2sleep00-21swapper/012:24:110
18162201,2sleep00-21swapper/012:24:110
271082190,3sleep10-21swapper/111:35:321
271082190,3sleep10-21swapper/111:35:321
220792190,3sleep30-21swapper/312:10:223
220792190,3sleep30-21swapper/312:10:223
206792190,2sleep30-21swapper/310:01:133
206792190,2sleep30-21swapper/310:01:133
206792190,2sleep30-21swapper/310:01:133
197299198,3cyclictest131rcu_preempt12:05:322
197299198,3cyclictest131rcu_preempt12:05:322
197299194,5cyclictest27-21ksoftirqd/209:05:392
197299194,5cyclictest27-21ksoftirqd/209:05:392
197299193,13cyclictest23069-21awk12:10:402
197299193,13cyclictest23069-21awk12:10:402
1972991911,6cyclictest6416-1kworker/u9:210:02:042
1972991911,6cyclictest6416-1kworker/u9:210:02:042
1972991911,6cyclictest6416-1kworker/u9:210:02:042
1972991911,6cyclictest28114-21kworker/u8:112:34:542
1972991911,6cyclictest28114-21kworker/u8:112:34:542
1972991911,6cyclictest15667-21sed12:00:422
1972991911,6cyclictest15667-21sed12:00:422
1972991910,7cyclictest3001-21ntp_states10:20:382
1972991910,7cyclictest3001-21ntp_states10:20:382
197199196,10cyclictest22687-21kernelversion08:10:301
197199196,10cyclictest22687-21kernelversion08:10:301
197199196,10cyclictest13621-21fschecks_time07:45:311
197199196,10cyclictest13621-21fschecks_time07:45:311
197199192,9cyclictest1184-21missed_timers08:40:341
197199192,9cyclictest1184-21missed_timers08:40:341
197199192,9cyclictest1184-21missed_timers08:40:341
197199191,9cyclictest6497-21latency08:55:341
197199191,9cyclictest6497-21latency08:55:341
197199191,9cyclictest13156-21cron07:45:181
197199191,9cyclictest13156-21cron07:45:181
1971991912,5cyclictest4792-21ssh09:43:011
1971991912,5cyclictest21140-21ntp_kernel_err08:05:361
1971991912,5cyclictest21140-21ntp_kernel_err08:05:361
1971991912,5cyclictest21140-21ntp_kernel_err08:05:361
1971991911,5cyclictest9680-21cpuspeed09:05:291
1971991911,5cyclictest9680-21cpuspeed09:05:291
197199191,15cyclictest134-21systemd-journal07:25:181
197199191,15cyclictest134-21systemd-journal07:25:181
197199191,14cyclictest18914-21grep08:00:301
197199191,14cyclictest18914-21grep08:00:301
197199191,13cyclictest12626-21grep09:10:411
197199191,13cyclictest12626-21grep09:10:411
197199191,13cyclictest12626-21grep09:10:411
197199191,12cyclictest26659-21ls10:10:211
197199191,12cyclictest26659-21ls10:10:211
197099198,9cyclictest38250irq/56-eth011:17:120
197099198,9cyclictest38250irq/56-eth011:17:120
197099198,9cyclictest38250irq/56-eth011:17:120
197099198,9cyclictest38250irq/56-eth011:17:120
197099198,9cyclictest38250irq/56-eth010:51:290
197099198,9cyclictest38250irq/56-eth010:51:290
197099198,9cyclictest38250irq/56-eth010:51:290
197099198,9cyclictest38150irq/55-eth009:32:000
197099198,9cyclictest38150irq/55-eth009:32:000
197099197,4cyclictest38250irq/56-eth012:05:380
197099197,4cyclictest38250irq/56-eth012:05:380
197099197,4cyclictest38250irq/56-eth009:46:290
197099197,4cyclictest38250irq/56-eth009:46:290
197099197,4cyclictest38250irq/56-eth009:12:270
197099197,4cyclictest38250irq/56-eth009:12:270
197099197,4cyclictest38250irq/56-eth009:12:270
197099197,10cyclictest38250irq/56-eth011:07:450
197099197,10cyclictest38250irq/56-eth011:07:450
197099197,10cyclictest38250irq/56-eth011:07:450
197099196,4cyclictest38250irq/56-eth012:00:350
197099196,4cyclictest38250irq/56-eth012:00:350
197099194,5cyclictest38250irq/56-eth010:39:320
197099194,3cyclictest131rcu_preempt11:57:320
197099194,3cyclictest131rcu_preempt11:57:320
197099194,11cyclictest17369-21ls07:55:340
197099194,11cyclictest17369-21ls07:55:340
197099192,5cyclictest12-21ksoftirqd/007:43:050
197099192,5cyclictest12-21ksoftirqd/007:43:050
197099191,9cyclictest6439-21fschecks_time07:25:300
197099191,9cyclictest6439-21fschecks_time07:25:300
197099191,9cyclictest6439-21fschecks_time07:25:300
197099191,2cyclictest131rcu_preempt12:37:500
197099191,2cyclictest131rcu_preempt12:37:500
197099191,10cyclictest7954-21df_inode09:00:290
197099191,10cyclictest7954-21df_inode09:00:290
197099191,10cyclictest23450-21irqstats10:05:350
197099191,10cyclictest23450-21irqstats10:05:350
180932191,4sleep20-21swapper/211:24:572
180932191,4sleep20-21swapper/211:24:572
180932191,4sleep20-21swapper/211:24:572
17002190,3chrt0-21swapper/309:39:353
17002190,3chrt0-21swapper/309:39:353
113122190,3sleep10-21swapper/111:15:181
113122190,3sleep10-21swapper/111:15:181
113122190,3sleep10-21swapper/111:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional