You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 08:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Apr 16, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3176223826,0sleep30-21swapper/318:53:353
565023624,0sleep00-21swapper/018:57:440
564623430,0sleep10-21swapper/118:57:411
540922723,0sleep20-21swapper/218:54:542
5778991313,0cyclictest11676-21sensors18:58:421
57789977,0cyclictest3514-21snmpd21:07:031
57789960,0cyclictest0-21swapper/121:48:301
57779960,0cyclictest0-21swapper/022:26:270
35160,0ktimersoftd/30-21swapper/323:58:303
339960,0migration/323831-21kthreadcore19:33:383
339960,0migration/318932-21sh22:25:213
29725060,0irq/27-eth0-tx-14735-21munin-node19:53:370
29715060,0irq/26-eth0-rx-13545-21ssh21:03:363
29715060,0irq/26-eth0-rx-12028-21ssh21:21:153
149960,0migration/09711-21sh00:20:590
149960,0migration/028808-21latency_hist21:13:210
149960,0migration/026737-21sh22:08:540
149960,0migration/018228-21sh00:06:500
57799955,0cyclictest0-21swapper/223:28:322
57799955,0cyclictest0-21swapper/200:07:012
57799954,0cyclictest28822-21munin-run21:33:212
57799954,0cyclictest21502-21awk22:08:352
57799950,0cyclictest0-21swapper/223:53:552
57799950,0cyclictest0-21swapper/223:04:062
57799950,0cyclictest0-21swapper/221:50:192
57799950,0cyclictest0-21swapper/221:11:512
57799950,0cyclictest0-21swapper/220:59:242
57799950,0cyclictest0-21swapper/200:14:062
57789955,0cyclictest0-21swapper/123:37:361
57789955,0cyclictest0-21swapper/123:25:181
57789955,0cyclictest0-21swapper/123:07:111
57789955,0cyclictest0-21swapper/121:39:221
57789955,0cyclictest0-21swapper/121:25:101
57789955,0cyclictest0-21swapper/120:59:281
57789950,0cyclictest0-21swapper/123:57:471
57789950,0cyclictest0-21swapper/121:11:561
57789950,0cyclictest0-21swapper/100:23:571
57779955,0cyclictest0-21swapper/023:36:560
57779955,0cyclictest0-21swapper/023:03:300
57779955,0cyclictest0-21swapper/021:53:020
57779955,0cyclictest0-21swapper/021:23:330
57779950,0cyclictest0-21swapper/022:55:000
339950,0migration/39634-21munin-node22:18:393
339950,0migration/35789-21munin-node19:18:393
339950,0migration/330554-21kthreadcore20:28:373
339950,0migration/327037-21runrttasks00:13:303
339950,0migration/322535-21kthreadcore23:08:373
339950,0migration/321674-21fschecks_time21:28:333
339950,0migration/319727-21ksmtuned22:06:533
339950,0migration/319719-21fschecks_time00:08:333
339950,0migration/318504-21rt-features21:43:423
339950,0migration/316113-21kthreadcore23:23:363
339950,0migration/314961-21kthreadcore00:23:383
339950,0migration/314684-21if_eth1.319:28:363
339950,0migration/311521-21fschecks_count00:03:323
339950,0migration/311366-21diskmemload21:01:153
29725050,0irq/27-eth0-tx-8044-21munin-node19:48:360
29725050,0irq/27-eth0-tx-4492-21munin-node21:58:382
29725050,0irq/27-eth0-tx-4189-21tr00:18:382
29725050,0irq/27-eth0-tx-4055-21diskmemload23:19:122
29725050,0irq/27-eth0-tx-27058-21munin-node19:38:400
29725050,0irq/27-eth0-tx-0-21swapper/222:14:392
29715050,0irq/26-eth0-rx-7824-21sshd19:23:353
29715050,0irq/26-eth0-rx-23981-21kthreadcore23:28:363
29715050,0irq/26-eth0-rx-23134-21cut21:48:373
29715050,0irq/26-eth0-rx-22786-21cut21:08:383
29715050,0irq/26-eth0-rx-22720-40yum-updatesd-he20:44:043
29715050,0irq/26-eth0-rx-0-21swapper/323:57:193
29715050,0irq/26-eth0-rx-0-21swapper/323:43:423
29715050,0irq/26-eth0-rx-0-21swapper/323:35:343
29715050,0irq/26-eth0-rx-0-21swapper/323:18:383
29715050,0irq/26-eth0-rx-0-21swapper/323:03:373
29715050,0irq/26-eth0-rx-0-21swapper/322:38:353
29715050,0irq/26-eth0-rx-0-21swapper/322:34:193
29715050,0irq/26-eth0-rx-0-21swapper/322:09:113
29715050,0irq/26-eth0-rx-0-21swapper/321:58:553
29715050,0irq/26-eth0-rx-0-21swapper/321:13:383
29715050,0irq/26-eth0-rx-0-21swapper/320:33:373
27150,0ktimersoftd/20-21swapper/223:58:302
27150,0ktimersoftd/20-21swapper/223:45:252
27150,0ktimersoftd/20-21swapper/222:08:182
249950,0watchdog/228623-21mdstat20:48:392
19150,0ktimersoftd/10-21swapper/123:58:301
19150,0ktimersoftd/10-21swapper/122:05:131
179950,0migration/129110-21idleruntime22:33:351
179950,0migration/12096-21unixbench-2d22:13:421
149950,0migration/08083-21irqcore19:23:370
149950,0migration/06667-21kthreadcore20:58:370
149950,0migration/06350-21kthreadcore22:18:380
149950,0migration/05547-21kthreadcore22:38:350
149950,0migration/04023-21sh21:37:120
149950,0migration/031843-21timerwakeupswit19:13:440
149950,0migration/026194-21timerandwakeup19:33:440
149950,0migration/025160-21kthreadcore19:58:380
149950,0migration/02367-21kthreadcore20:53:390
149950,0migration/02344-21timerandwakeup21:53:430
149950,0migration/021285-21kthreadcore23:08:370
149950,0migration/020001-21fschecks_time19:08:330
149950,0migration/019464-21kthreadcore20:43:380
149950,0migration/018527-21timerwakeupswit19:03:430
149950,0migration/017450-21kthreadcore19:28:380
149950,0migration/015444-21latency_hist20:18:210
149950,0migration/015089-21kthreadcore23:23:360
149950,0migration/015016-21kthreadcore22:43:380
149950,0migration/012539-21kthreadcore00:23:370
149950,0migration/01199-21kthreadcore20:28:380
149950,0migration/011875-21sh22:02:140
149950,0migration/010310-21sh23:00:090
149950,0migration/010085-21aten2.4-expect20:38:320
8215040,0irq/24-0000:00:9787-21crond20:43:162
8215040,0irq/24-0000:00:27998-21cat20:03:212
57799944,0cyclictest0-21swapper/219:23:322
57799943,0cyclictest9902-21awk20:13:362
57799943,0cyclictest8913-21awk19:48:362
57799943,0cyclictest5616-21awk21:38:332
57799943,0cyclictest4886-21awk22:38:342
57799943,0cyclictest3556-21lldpd23:14:062
57799943,0cyclictest3556-21lldpd20:58:052
57799943,0cyclictest3556-21lldpd20:38:052
57799943,0cyclictest3514-21snmpd19:45:362
57799943,0cyclictest3514-21snmpd19:16:512
57799943,0cyclictest3514-21snmpd18:59:362
57799943,0cyclictest3241-21irqbalance21:13:292
57799943,0cyclictest3105-21awk20:08:352
57799943,0cyclictest28710-21tune2fs22:53:342
57799943,0cyclictest22346-21awk19:58:362
57799943,0cyclictest20237-21awk19:08:352
57799943,0cyclictest13947-21awk21:23:342
57799943,0cyclictest13529-21awk19:03:352
57799943,0cyclictest13014-21tail22:23:342
57789943,0cyclictest3556-21lldpd20:28:351
57789943,0cyclictest3514-21snmpd23:45:371
57789943,0cyclictest3514-21snmpd23:21:371
57789943,0cyclictest3514-21snmpd22:48:361
57789943,0cyclictest3514-21snmpd22:24:361
57789943,0cyclictest3514-21snmpd20:48:211
57789943,0cyclictest3514-21snmpd20:45:361
57789943,0cyclictest3514-21snmpd20:05:361
57789943,0cyclictest3514-21snmpd19:59:361
57789943,0cyclictest3514-21snmpd19:24:361
57789943,0cyclictest3514-21snmpd19:14:361
57789943,0cyclictest3514-21snmpd00:06:371
57789943,0cyclictest3241-21irqbalance23:15:391
57789943,0cyclictest3241-21irqbalance22:10:091
57789943,0cyclictest28974-21awk22:53:361
57789943,0cyclictest27893-21awk00:13:341
57789943,0cyclictest2186-21awk19:43:351
57789943,0cyclictest21245-21awk22:28:341
57789943,0cyclictest20595-21awk23:08:351
57789943,0cyclictest20265-21awk23:48:331
57789943,0cyclictest13657-21awk19:03:361
57779944,0cyclictest0-21swapper/022:29:270
57779944,0cyclictest0-21swapper/022:14:470
57779944,0cyclictest0-21swapper/021:16:090
57779944,0cyclictest0-21swapper/000:15:050
57779943,0cyclictest6891-21awk18:58:350
57779943,0cyclictest4006-21kworker/0:100:10:100
57779943,0cyclictest4006-21kworker/0:100:02:340
57779943,0cyclictest3514-21snmpd21:45:210
57779943,0cyclictest3514-21snmpd21:42:210
57779943,0cyclictest3159-21awk20:08:360
57779943,0cyclictest24189-21awk20:48:360
57779943,0cyclictest19003-21sadc23:48:200
57779943,0cyclictest16632-21awk20:18:370
57779940,0cyclictest0-21swapper/023:18:200
57779940,0cyclictest0-21swapper/020:23:340
339940,0migration/331981-21kthreadcore21:33:363
339940,0migration/33093-21diskmemload00:18:353
339940,0migration/328350-21munin-node23:13:323
339940,0migration/322833-21kthreadcore22:48:383
339940,0migration/319123-21kthreadcore19:53:383
339940,0migration/314453-21kthreadcore22:43:373
339940,0migration/313862-21kthreadcore20:38:383
339940,0migration/311469-21sh21:40:263
339940,0migration/310232-21kthreadcore18:58:383
29725040,0irq/27-eth0-tx-4853-21ssh21:18:272
29725040,0irq/27-eth0-tx-4375-21sshd22:58:332
29725040,0irq/27-eth0-tx-4055-21diskmemload22:29:152
29725040,0irq/27-eth0-tx-27485-21ssh23:33:222
29725040,0irq/27-eth0-tx-26152-21ssh23:09:392
29725040,0irq/27-eth0-tx-20066-21ps00:08:362
29725040,0irq/27-eth0-tx-19938-21ssh22:48:252
29725040,0irq/27-eth0-tx-19265-21munin-node23:48:362
29725040,0irq/27-eth0-tx-11968-21ssh22:43:312
29725040,0irq/27-eth0-tx-0-21swapper/223:38:252
29725040,0irq/27-eth0-tx-0-21swapper/222:35:102
29725040,0irq/27-eth0-tx-0-21swapper/222:20:492
29725040,0irq/27-eth0-tx-0-21swapper/221:53:372
29725040,0irq/27-eth0-tx-0-21swapper/221:44:352
29725040,0irq/27-eth0-tx-0-21swapper/221:33:372
29725040,0irq/27-eth0-tx-0-21swapper/221:03:322
29725040,0irq/27-eth0-tx-0-21swapper/200:24:162
29725040,0irq/27-eth0-tx-0-21swapper/020:03:320
29725040,0irq/27-eth0-tx-0-21swapper/019:43:320
29725040,0irq/27-eth0-tx-0-21swapper/019:22:030
29715040,0irq/26-eth0-rx-16977-21kthreadcore21:23:373
29715040,0irq/26-eth0-rx-0-21swapper/323:48:363
29715040,0irq/26-eth0-rx-0-21swapper/323:38:353
29715040,0irq/26-eth0-rx-0-21swapper/322:58:353
29715040,0irq/26-eth0-rx-0-21swapper/322:53:543
29715040,0irq/26-eth0-rx-0-21swapper/322:28:283
29715040,0irq/26-eth0-rx-0-21swapper/322:14:023
29715040,0irq/26-eth0-rx-0-21swapper/321:54:143
29715040,0irq/26-eth0-rx-0-21swapper/320:18:383
259940,0migration/23611-21kthreadcore19:18:382
259940,0migration/229000-21aten_r1power_cu20:28:312
259940,0migration/228266-21munin-node20:23:442
259940,0migration/215406-21kthreadcore19:28:372
249940,0watchdog/227204-21basename19:38:312
249940,0watchdog/226075-21python19:33:432
249940,0watchdog/211808-21cpuspeed_turbos23:23:312
179940,0migration/15783-21kthreadcore23:38:371
179940,0migration/13666-21aten_r1power_en22:58:311
179940,0migration/131630-21kthreadcore20:53:381
179940,0migration/131322-21kthreadcore21:33:361
179940,0migration/129131-21taskset21:13:321
179940,0migration/124855-21kthreadcore20:23:381
179940,0migration/124270-21kthreadcore00:08:371
179940,0migration/121167-21munin-node19:33:351
179940,0migration/120840-21kthreadcore20:18:391
179940,0migration/114750-21aten_r1power_cu19:53:311
179940,0migration/11285-21kthreadcore21:53:381
179940,0migration/111655-21taskset22:01:361
169940,0watchdog/13071-21diskstats00:18:341
169940,0watchdog/1137362sleep119:48:431
169940,0watchdog/10-21swapper/123:28:351
169940,0watchdog/10-21swapper/122:44:071
169940,0watchdog/10-21swapper/122:38:351
169940,0watchdog/10-21swapper/121:28:231
169940,0watchdog/10-21swapper/119:38:311
149940,0migration/06452-21kthreadcore20:33:370
149940,0migration/03667-21cpuspeed_turbos23:18:320
149940,0migration/030400-21kthreadcore23:53:360
149940,0migration/018960-21sh22:04:380
149940,0migration/013453-21if_eth021:03:360
13170240,0sleep113547-21which21:43:341
57799933,0cyclictest3556-21lldpd19:53:332
57799932,0cyclictest17111-21grep20:43:342
57799932,0cyclictest16534-21awk20:18:362
57789933,0cyclictest0-21swapper/120:08:331
57789932,0cyclictest9985-21rt-features22:18:421
57789932,0cyclictest5894-21awk21:18:361
57789932,0cyclictest3514-21snmpd20:35:361
57789932,0cyclictest3514-21snmpd19:22:361
57789932,0cyclictest20309-21awk19:08:351
57779933,0cyclictest7827-21kworker/0:021:18:280
57779933,0cyclictest29602-21kworker/0:222:33:240
57779933,0cyclictest29081-21kworker/0:122:48:280
57779933,0cyclictest12474-21kworker/0:023:38:340
57779933,0cyclictest12474-21kworker/0:023:28:360
57779932,0cyclictest3514-21snmpd21:28:210
57779932,0cyclictest20165-21awk23:48:330
339930,0migration/314438-21kthreadcore19:03:373
29715030,0irq/26-eth0-rx-0-21swapper/320:53:333
29715030,0irq/26-eth0-rx-0-21swapper/320:23:333
29715030,0irq/26-eth0-rx-0-21swapper/320:13:323
29715030,0irq/26-eth0-rx-0-21swapper/320:08:393
29715030,0irq/26-eth0-rx-0-21swapper/319:58:323
29715030,0irq/26-eth0-rx-0-21swapper/319:46:333
29715030,0irq/26-eth0-rx-0-21swapper/319:38:313
29715030,0irq/26-eth0-rx-0-21swapper/319:13:323
29715030,0irq/26-eth0-rx-0-21swapper/319:08:323
169930,0watchdog/10-21swapper/120:38:431
169930,0watchdog/10-21swapper/120:13:351
169930,0watchdog/10-21swapper/119:28:311
29715020,0irq/26-eth0-rx-0-21swapper/320:48:213
29715020,0irq/26-eth0-rx-0-21swapper/320:03:513
29715020,0irq/26-eth0-rx-0-21swapper/319:48:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional