You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 23:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jul 13, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2055623826,0sleep20-21swapper/206:45:292
304450350,0irq/25-eth10-21swapper/306:45:313
2075723324,0sleep10-21swapper/106:47:521
2002123026,0sleep00-21swapper/006:45:190
21008992424,0cyclictest20672-21kworker/0:210:26:080
339960,0migration/326578-21sh09:51:493
339960,0migration/325878-21sh11:11:283
339960,0migration/322067-21kthreadcore09:30:123
339960,0migration/315153-21kthreadcore08:45:133
339960,0migration/31376-21sh08:56:123
29715060,0irq/26-eth0-rx-9820-21rm10:20:493
29715060,0irq/26-eth0-rx-9162-21munin-node09:40:163
29715060,0irq/26-eth0-rx-16904-21latency09:05:143
29715060,0irq/26-eth0-rx-11998-21cpu09:45:093
27160,0ktimersoftd/20-21swapper/211:15:202
210089966,0cyclictest19106-21diskmemload10:50:150
8215050,0irq/24-0000:00:19528-21grep09:09:562
339950,0migration/34059-21if_eth1.311:20:113
339950,0migration/331272-21fschecks_time08:10:103
339950,0migration/3308-21munin-node11:35:153
339950,0migration/330702-21kthreadcore06:55:163
339950,0migration/329324-21kthreadcore11:55:133
339950,0migration/327655-21kthreadcore08:05:143
339950,0migration/327528-21aten_r1power_vo11:15:063
339950,0migration/327501-21latency_hist10:34:563
339950,0migration/326471-21latency06:50:143
339950,0migration/326426-21kthreadcore08:30:133
339950,0migration/326189-21kthreadcore07:40:153
339950,0migration/326158-21kthreadcore07:15:143
339950,0migration/323743-21taskset08:03:433
339950,0migration/317665-21taskset11:46:353
339950,0migration/316614-21timerwakeupswit07:55:223
339950,0migration/316188-21kthreadcore11:25:153
339950,0migration/311787-21kthreadcore07:05:153
339950,0migration/310797-21munin-node08:15:193
29725050,0irq/27-eth0-tx-3272-21df11:40:062
29725050,0irq/27-eth0-tx-3162-21munin-node09:00:182
29725050,0irq/27-eth0-tx-28809-21munin-node07:20:100
29725050,0irq/27-eth0-tx-27898-21munin-node06:55:150
29725050,0irq/27-eth0-tx-22154-21munin-node07:15:070
29725050,0irq/27-eth0-tx-18351-21munin-node08:25:090
29725050,0irq/27-eth0-tx-18248-21ssh12:08:282
29725050,0irq/27-eth0-tx-11875-21munin-node09:25:082
29725050,0irq/27-eth0-tx-0-21swapper/212:17:382
29725050,0irq/27-eth0-tx-0-21swapper/211:30:552
29725050,0irq/27-eth0-tx-0-21swapper/211:08:552
29725050,0irq/27-eth0-tx-0-21swapper/210:57:092
29725050,0irq/27-eth0-tx-0-21swapper/210:57:092
29725050,0irq/27-eth0-tx-0-21swapper/210:26:502
29725050,0irq/27-eth0-tx-0-21swapper/210:21:402
29725050,0irq/27-eth0-tx-0-21swapper/209:40:592
29725050,0irq/27-eth0-tx-0-21swapper/209:31:022
29725050,0irq/27-eth0-tx-0-21swapper/008:45:150
29715050,0irq/26-eth0-rx-5826-21kthreadcore12:00:123
29715050,0irq/26-eth0-rx-29332-21kthreadcore09:35:133
29715050,0irq/26-eth0-rx-21531-21tr08:25:153
29715050,0irq/26-eth0-rx-20209-21diskstats09:10:093
29715050,0irq/26-eth0-rx-19651-21cut10:30:063
29715050,0irq/26-eth0-rx-18497-21ssh10:48:003
29715050,0irq/26-eth0-rx-1813-21ssh09:55:343
29715050,0irq/26-eth0-rx-0-21swapper/311:31:263
29715050,0irq/26-eth0-rx-0-21swapper/311:09:303
29715050,0irq/26-eth0-rx-0-21swapper/311:00:383
29715050,0irq/26-eth0-rx-0-21swapper/310:51:323
29715050,0irq/26-eth0-rx-0-21swapper/309:28:573
29715050,0irq/26-eth0-rx-0-21swapper/309:15:073
29715050,0irq/26-eth0-rx-0-21swapper/308:54:283
29715050,0irq/26-eth0-rx-0-21swapper/307:50:193
259950,0migration/28904-21timerwakeupswit12:00:182
259950,0migration/28829-21open_inodes11:00:172
259950,0migration/229804-21kthreadcore11:35:132
259950,0migration/227172-21latency_hist08:54:562
259950,0migration/225622-21kthreadcore08:05:142
259950,0migration/220738-21latency07:10:152
259950,0migration/218934-21latency_hist12:09:552
259950,0migration/211666-21latency_hist09:24:562
249950,0watchdog/224402-21kthreadcore07:40:142
249950,0watchdog/216757-21vmstat07:55:222
210109955,0cyclictest0-21swapper/209:53:022
210109955,0cyclictest0-21swapper/208:00:092
210109954,0cyclictest20747-21awk10:10:102
210109950,0cyclictest0-21swapper/209:59:022
210109950,0cyclictest0-21swapper/209:35:512
210099955,0cyclictest0-21swapper/111:20:051
210099950,0cyclictest0-21swapper/109:16:101
210089955,0cyclictest0-21swapper/012:05:460
210089955,0cyclictest0-21swapper/009:27:290
210089950,0cyclictest0-21swapper/011:57:250
210089950,0cyclictest0-21swapper/010:34:480
210089950,0cyclictest0-21swapper/009:59:200
210089950,0cyclictest0-21swapper/009:36:560
210089950,0cyclictest0-21swapper/008:49:580
179950,0migration/1912-21unixbench_multi11:35:201
179950,0migration/18356-21taskset07:01:461
179950,0migration/132674-21kthreadcore08:10:131
179950,0migration/122937-21latency_hist07:39:561
179950,0migration/114114-21kthreadcore10:25:151
179950,0migration/113382-21gltestperf08:45:091
179950,0migration/112048-21df_abs08:20:071
179950,0migration/111339-21aten_r1power_fr11:05:071
169950,0watchdog/127304-21sh09:13:421
149950,0migration/05647-21kthreadcore07:25:140
149950,0migration/028055-21munin-node12:15:110
149950,0migration/021820-21kthreadcore10:10:120
149950,0migration/018941-21sh09:08:310
149950,0migration/017376-21kthreadcore07:10:130
149950,0migration/016171-21kthreadcore10:45:130
149950,0migration/015273-21kthreadcore09:45:150
149950,0migration/01435-21sh11:16:160
149950,0migration/013859-21kthreadcore11:05:130
339940,0migration/37380-21kthreadcore07:00:143
339940,0migration/35097-21kthreadcore10:00:123
339940,0migration/3360-21rt-features12:15:173
339940,0migration/330936-21irqcore07:45:133
339940,0migration/325160-21missed_timers10:10:143
339940,0migration/320412-21kthreadcore07:10:143
339940,0migration/313375-21kthreadcore08:20:123
29725040,0irq/27-eth0-tx-0-21swapper/211:55:412
29725040,0irq/27-eth0-tx-0-21swapper/211:25:122
29725040,0irq/27-eth0-tx-0-21swapper/211:10:092
29725040,0irq/27-eth0-tx-0-21swapper/209:59:592
29725040,0irq/27-eth0-tx-0-21swapper/209:15:152
29725040,0irq/27-eth0-tx-0-21swapper/008:30:140
29725040,0irq/27-eth0-tx-0-21swapper/008:20:090
29725040,0irq/27-eth0-tx-0-21swapper/008:00:080
29715040,0irq/26-eth0-rx-0-21swapper/312:10:273
29715040,0irq/26-eth0-rx-0-21swapper/312:05:123
29715040,0irq/26-eth0-rx-0-21swapper/311:50:133
29715040,0irq/26-eth0-rx-0-21swapper/311:41:413
29715040,0irq/26-eth0-rx-0-21swapper/310:57:163
29715040,0irq/26-eth0-rx-0-21swapper/310:57:163
29715040,0irq/26-eth0-rx-0-21swapper/310:40:303
29715040,0irq/26-eth0-rx-0-21swapper/310:25:103
29715040,0irq/26-eth0-rx-0-21swapper/310:15:063
29715040,0irq/26-eth0-rx-0-21swapper/310:05:083
29715040,0irq/26-eth0-rx-0-21swapper/309:20:083
29715040,0irq/26-eth0-rx-0-21swapper/309:00:033
259940,0migration/29546-21fschecks_time07:05:112
259940,0migration/27092-21kthreadcore07:00:142
259940,0migration/24771-21gltestperf07:50:092
259940,0migration/231193-21munin-node08:10:102
259940,0migration/228482-21kthreadcore08:30:142
259940,0migration/225738-21kthreadcore06:50:142
259940,0migration/219786-21runrttasks09:10:052
259940,0migration/213457-21kthreadcore10:45:122
259940,0migration/210988-21unixbench_singl08:15:192
249940,0watchdog/25129-21kthreadcore11:20:142
249940,0watchdog/232726-21kthreadcore07:45:142
249940,0watchdog/222483-21kthreadcore08:50:142
249940,0watchdog/219837-21df_abs10:50:062
249940,0watchdog/21849-21cut08:35:142
249940,0watchdog/213105-21kthreadcore10:05:142
249940,0watchdog/212641-21kthreadcore11:45:172
249940,0watchdog/20-21swapper/210:40:102
210109944,0cyclictest0-21swapper/210:34:592
210109944,0cyclictest0-21swapper/207:19:572
210109943,0cyclictest3514-21snmpd11:50:072
210109943,0cyclictest3514-21snmpd10:30:072
210109943,0cyclictest3514-21snmpd08:25:222
210109943,0cyclictest3514-21snmpd07:27:522
210109943,0cyclictest28812-21awk06:55:142
210109943,0cyclictest28703-21awk10:15:102
210109943,0cyclictest12781-21awk09:45:132
210109943,0cyclictest12628-21awk08:20:102
210099943,0cyclictest9707-21awk07:05:121
210099943,0cyclictest4657-21awk09:20:121
210099943,0cyclictest365-21sed08:35:131
210099943,0cyclictest3556-21lldpd08:02:151
210099943,0cyclictest3514-21snmpd11:40:071
210099943,0cyclictest3514-21snmpd10:35:521
210099943,0cyclictest3514-21snmpd10:01:221
210099943,0cyclictest3241-21irqbalance10:48:541
210099943,0cyclictest28845-21awk09:55:131
210099943,0cyclictest24078-21awk07:40:131
210099943,0cyclictest22199-21awk06:50:121
210099943,0cyclictest12437-21awk09:05:111
210099943,0cyclictest12116-21awk11:45:161
210099943,0cyclictest11668-21awk07:55:131
210099943,0cyclictest1002-21ls10:15:161
210099942,0cyclictest23756-21grep07:15:131
210089944,0cyclictest0-21swapper/010:56:050
210089944,0cyclictest0-21swapper/010:56:050
210089944,0cyclictest0-21swapper/009:41:500
210089943,0cyclictest3556-21lldpd10:40:150
210089943,0cyclictest3556-21lldpd07:00:130
210089943,0cyclictest3514-21snmpd12:02:370
210089943,0cyclictest3514-21snmpd11:41:220
210089943,0cyclictest3514-21snmpd11:38:220
210089943,0cyclictest3514-21snmpd10:22:220
210089943,0cyclictest3241-21irqbalance11:25:140
210089943,0cyclictest3241-21irqbalance11:21:340
210089943,0cyclictest3241-21irqbalance10:00:040
210089943,0cyclictest3241-21irqbalance09:50:240
210089943,0cyclictest3241-21irqbalance08:35:040
210089943,0cyclictest3241-21irqbalance08:16:040
210089943,0cyclictest3241-21irqbalance08:10:050
210089943,0cyclictest3241-21irqbalance07:50:250
210089943,0cyclictest3241-21irqbalance07:47:350
210089943,0cyclictest3241-21irqbalance07:43:550
210089943,0cyclictest3241-21irqbalance06:52:250
210089943,0cyclictest17390-21awk07:35:130
210089943,0cyclictest12091-21awk11:45:160
210089943,0cyclictest10738-21awk07:30:130
179940,0migration/18703-21kthreadcore09:40:161
179940,0migration/13673-21fschecks_time07:25:111
179940,0migration/131096-21kthreadcore07:20:131
179940,0migration/13095-21cpuspeed_turbos12:00:071
179940,0migration/129855-21kthreadcore09:35:131
179940,0migration/127901-21fschecks_count11:15:071
179940,0migration/125609-21unixbench-2d10:30:191
179940,0migration/125033-21timerwakeupswit12:10:201
179940,0migration/121328-21kthreadcore10:10:121
179940,0migration/120294-21idleruntime10:50:081
179940,0migration/119397-21cpuspeed_turbos11:50:081
179940,0migration/11559-21kthreadcore07:45:151
169940,0watchdog/19088-21kthreadcore08:40:141
169940,0watchdog/16559-21runrttasks09:47:421
169940,0watchdog/14051-21gltestperf10:40:101
169940,0watchdog/130775-21kthreadcore12:15:131
169940,0watchdog/128124-21cut08:05:141
169940,0watchdog/125753-21hddtemp_smartct08:30:101
169940,0watchdog/123038-21kthreadcore09:50:141
169940,0watchdog/116459-21needreboot12:05:131
169940,0watchdog/113522-21kthreadcore10:05:141
169940,0watchdog/110632-21ssh11:03:581
169940,0watchdog/110353-21missed_timers08:15:141
169940,0watchdog/10-21swapper/111:25:141
169940,0watchdog/10-21swapper/110:55:141
169940,0watchdog/10-21swapper/110:55:141
149940,0migration/07045-21irqcore08:40:130
149940,0migration/04886-21kthreadcore09:00:130
149940,0migration/04806-21iostat09:20:130
149940,0migration/03368-21aten_r1power_vo11:00:080
149940,0migration/028393-21kthreadcore08:05:140
149940,0migration/024975-21munin-node11:10:160
149940,0migration/023892-21kthreadcore09:30:130
149940,0migration/023362-21kthreadcore11:50:130
149940,0migration/022857-21kthreadcore12:10:150
149940,0migration/021492-21kthreadcore11:30:140
149940,0migration/015451-21kthreadcore10:05:150
149940,0migration/013501-21kthreadcore07:55:150
149940,0migration/01018-21swap10:35:190
339930,0migration/310258-21kthreadcore08:40:143
29725030,0irq/27-eth0-tx-0-21swapper/007:05:200
29715030,0irq/26-eth0-rx-0-21swapper/308:35:193
29715030,0irq/26-eth0-rx-0-21swapper/307:36:243
29715030,0irq/26-eth0-rx-0-21swapper/307:32:173
29715030,0irq/26-eth0-rx-0-21swapper/307:27:523
29715030,0irq/26-eth0-rx-0-21swapper/307:23:383
259930,0migration/216985-21fschecks_count07:35:112
249930,0watchdog/218864-21seq08:47:182
249930,0watchdog/20-21swapper/208:40:102
249930,0watchdog/20-21swapper/207:15:192
210099933,0cyclictest3556-21lldpd07:50:151
210099932,0cyclictest20288-21awk11:10:111
210099932,0cyclictest20221-21awk08:50:111
210099932,0cyclictest19203-21awk08:25:121
210099930,0cyclictest0-21swapper/107:30:511
210089932,0cyclictest3556-21lldpd10:16:150
210089932,0cyclictest3556-21lldpd09:15:150
210089932,0cyclictest3241-21irqbalance08:55:040
210089932,0cyclictest23467-21tr09:10:130
179930,0migration/121167-21irqrtprio09:30:111
169930,0watchdog/119106-21diskmemload09:25:101
169930,0watchdog/10-21swapper/111:54:571
169930,0watchdog/10-21swapper/111:30:101
169930,0watchdog/10-21swapper/110:20:021
169930,0watchdog/10-21swapper/109:00:141
169930,0watchdog/10-21swapper/108:55:141
249920,0watchdog/20-21swapper/207:29:582
169920,0watchdog/10-21swapper/107:10:031
169920,0watchdog/10-21swapper/106:54:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional