You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 21:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 11, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1690723623,0sleep00-21swapper/006:49:040
304450350,0irq/25-eth10-21swapper/306:48:083
1716523526,0sleep20-21swapper/206:52:062
1696723329,0sleep10-21swapper/106:49:451
173269976,0cyclictest0-21swapper/210:18:182
339960,0migration/35263-21ntp_offset10:03:183
339960,0migration/33917-21sh12:03:203
339960,0migration/320776-21munin-node11:13:193
339960,0migration/314658-21sh10:10:323
339960,0migration/314063-21sh11:52:263
29725060,0irq/27-eth0-tx-7423-21munin-node10:48:142
29715060,0irq/26-eth0-rx-3800-21latency11:43:173
29715060,0irq/26-eth0-rx-24217-21diskstats10:18:123
29715060,0irq/26-eth0-rx-16204-21diskstats10:13:113
173269960,0cyclictest27493-21cut12:18:162
173269960,0cyclictest0-21swapper/211:56:212
173179966,0cyclictest15496-21diskmemload12:06:201
149960,0migration/031207-21sh10:22:010
149960,0migration/020759-21kthreadcore10:33:170
149960,0migration/017038-21irqcore09:53:150
149960,0migration/013480-21ntp_offset08:23:200
149960,0migration/012932-21sh11:49:090
149960,0migration/012739-21ntp_offset11:08:180
8215050,0irq/24-0000:00:22603-21munin-run11:37:592
35150,0ktimersoftd/30-21swapper/311:21:353
339950,0migration/37148-21taskset09:46:263
339950,0migration/33885-21munin-node07:03:173
339950,0migration/33885-21munin-node07:03:173
339950,0migration/332322-21taskset07:51:013
339950,0migration/331807-21runrttasks09:21:553
339950,0migration/331612-21aten_r1power_en11:03:093
339950,0migration/328349-21switchtime11:58:203
339950,0migration/327484-21kthreadcore12:18:163
339950,0migration/326186-21kthreadcore06:58:163
339950,0migration/326030-21sendmail_mailst08:08:203
339950,0migration/320364-21sendmail_mailtr08:28:203
339950,0migration/318996-21kthreadcore09:13:143
339950,0migration/318741-21df_abs07:18:123
339950,0migration/318575-21kthreadcore11:33:153
339950,0migration/318472-21kthreadcore08:53:163
339950,0migration/311939-21taskset07:13:113
29725050,0irq/27-eth0-tx-5392-21python09:03:202
29725050,0irq/27-eth0-tx-23997-21munin-node09:58:192
29725050,0irq/27-eth0-tx-16539-21entropy09:13:102
29725050,0irq/27-eth0-tx-11777-21munin-node07:13:190
29725050,0irq/27-eth0-tx-0-21swapper/212:11:462
29725050,0irq/27-eth0-tx-0-21swapper/212:01:192
29725050,0irq/27-eth0-tx-0-21swapper/008:51:190
29725050,0irq/27-eth0-tx-0-21swapper/007:43:150
29725050,0irq/27-eth0-tx-0-21swapper/007:00:330
29715050,0irq/26-eth0-rx-6523-21ssh10:25:553
29715050,0irq/26-eth0-rx-28978-21kthreadcore07:23:173
29715050,0irq/26-eth0-rx-26324-21kthreadcore09:38:153
29715050,0irq/26-eth0-rx-23875-21ssh09:37:523
29715050,0irq/26-eth0-rx-22831-21ssh09:55:273
29715050,0irq/26-eth0-rx-21303-21port_sshpriv10:33:203
29715050,0irq/26-eth0-rx-1916-21kthreadcore11:23:153
29715050,0irq/26-eth0-rx-17209-21kthreadcore10:53:153
29715050,0irq/26-eth0-rx-13581-21sh11:29:593
29715050,0irq/26-eth0-rx-13415-21timerwakeupswit10:48:233
29715050,0irq/26-eth0-rx-11590-21mdstat12:08:173
29715050,0irq/26-eth0-rx-0-21swapper/311:55:173
29715050,0irq/26-eth0-rx-0-21swapper/311:40:513
29715050,0irq/26-eth0-rx-0-21swapper/311:00:323
29715050,0irq/26-eth0-rx-0-21swapper/309:29:423
29715050,0irq/26-eth0-rx-0-21swapper/309:08:393
29715050,0irq/26-eth0-rx-0-21swapper/309:05:413
29715050,0irq/26-eth0-rx-0-21swapper/308:58:243
29715050,0irq/26-eth0-rx-0-21swapper/308:23:173
27150,0ktimersoftd/20-21swapper/211:22:092
259950,0migration/25735-21fschecks_time07:08:122
259950,0migration/25418-21latency09:23:172
259950,0migration/24988-21kthreadcore10:03:172
259950,0migration/215799-21latency_hist09:52:592
259950,0migration/214788-21kthreadcore07:38:162
249950,0watchdog/229729-21grep09:18:182
173269955,0cyclictest0-21swapper/210:11:022
173269955,0cyclictest0-21swapper/209:28:102
173269954,0cyclictest25086-21awk06:58:152
173269950,0cyclictest0-21swapper/211:04:102
173269950,0cyclictest0-21swapper/208:45:452
173179955,0cyclictest0-21swapper/109:24:351
173179955,0cyclictest0-21swapper/109:21:161
173179955,0cyclictest0-21swapper/108:58:061
173179950,0cyclictest0-21swapper/111:33:511
173179950,0cyclictest0-21swapper/110:28:541
173179950,0cyclictest0-21swapper/110:21:391
173179950,0cyclictest0-21swapper/108:53:411
173139955,0cyclictest0-21swapper/010:08:170
173139950,0cyclictest0-21swapper/010:00:150
179950,0migration/14037-21kthreadcore11:23:151
179950,0migration/128615-21unixbench_singl11:58:211
179950,0migration/124283-21kthreadcore12:18:151
179950,0migration/123926-21latency_hist09:57:591
179950,0migration/122833-21kthreadcore07:18:171
179950,0migration/121216-21munin-node08:08:131
179950,0migration/116597-21kthreadcore08:28:151
179950,0migration/113899-21aten_r1power_vo08:03:121
179950,0migration/113105-21taskset12:10:351
179950,0migration/110464-21kthreadcore09:48:161
169950,0watchdog/121782-21ssh11:56:291
149950,0migration/08894-21sh09:28:120
149950,0migration/08474-21kthreadcore07:58:150
149950,0migration/08319-21kthreadcore12:08:150
149950,0migration/06878-21taskset11:28:080
149950,0migration/05226-21taskset11:24:040
149950,0migration/031828-21sh10:23:090
149950,0migration/028953-21kthreadcore09:38:160
149950,0migration/027851-21idleruntime08:13:140
149950,0migration/02553-21irqrtprio08:18:170
149950,0migration/025168-21kthreadcore11:38:140
149950,0migration/024485-21kernelversion11:18:160
149950,0migration/023908-21kthreadcore08:08:160
149950,0migration/017787-21kthreadcore11:53:160
149950,0migration/017082-21irqrtprio10:13:140
149950,0migration/016249-21aten_r1power_po09:13:090
149950,0migration/01446-21kthreadcore10:03:160
149950,0migration/01404-21kthreadcore11:03:150
149950,0migration/010317-21kthreadcore10:28:160
8215040,0irq/24-0000:00:15525-21latency_hist10:12:592
339940,0migration/33022-21kthreadcore07:28:173
339940,0migration/326032-21kthreadcore10:38:163
339940,0migration/325756-21taskset07:47:003
339940,0migration/310958-21kthreadcore08:48:173
339940,0migration/310600-21kthreadcore09:48:163
29725040,0irq/27-eth0-tx-15623-21munin-node10:33:182
29725040,0irq/27-eth0-tx-15189-21munin-node11:13:232
29725040,0irq/27-eth0-tx-0-21swapper/212:03:462
29725040,0irq/27-eth0-tx-0-21swapper/211:48:072
29725040,0irq/27-eth0-tx-0-21swapper/211:28:062
29725040,0irq/27-eth0-tx-0-21swapper/210:28:382
29725040,0irq/27-eth0-tx-0-21swapper/209:54:022
29725040,0irq/27-eth0-tx-0-21swapper/209:33:112
29725040,0irq/27-eth0-tx-0-21swapper/209:08:182
29725040,0irq/27-eth0-tx-0-21swapper/208:58:022
29725040,0irq/27-eth0-tx-0-21swapper/007:53:100
29725040,0irq/27-eth0-tx-0-21swapper/007:38:120
29725040,0irq/27-eth0-tx-0-21swapper/007:03:100
29725040,0irq/27-eth0-tx-0-21swapper/007:03:100
29715040,0irq/26-eth0-rx-0-21swapper/312:14:523
29715040,0irq/26-eth0-rx-0-21swapper/311:08:083
29715040,0irq/26-eth0-rx-0-21swapper/310:43:083
29715040,0irq/26-eth0-rx-0-21swapper/310:28:333
29715040,0irq/26-eth0-rx-0-21swapper/309:58:023
29715040,0irq/26-eth0-rx-0-21swapper/309:24:033
29715040,0irq/26-eth0-rx-0-21swapper/307:08:163
259940,0migration/28475-21kthreadcore07:33:182
259940,0migration/232121-21latency_hist09:42:592
259940,0migration/230205-21kthreadcore07:48:162
259940,0migration/229582-21mdstat09:38:162
259940,0migration/224725-21kthreadcore08:08:162
259940,0migration/224110-21irqrtprio11:38:132
259940,0migration/223945-21cpuspeed_turbos10:38:112
259940,0migration/218124-21fschecks_time06:53:132
259940,0migration/212458-21fschecks_time07:13:122
259940,0migration/211299-21kthreadcore08:48:172
249940,0watchdog/27305-21aten_r1power_po11:08:092
249940,0watchdog/27048-21python08:18:222
249940,0watchdog/225989-21if_eth1.207:23:142
249940,0watchdog/20-21swapper/210:43:132
249940,0watchdog/20-21swapper/210:23:132
173269943,0cyclictest7978-21awk07:58:142
173269943,0cyclictest3556-21lldpd12:13:052
173269943,0cyclictest3556-21lldpd11:23:052
173269943,0cyclictest3556-21lldpd10:59:052
173269943,0cyclictest3556-21lldpd10:53:052
173269943,0cyclictest3514-21snmpd08:38:192
173269943,0cyclictest3514-21snmpd07:43:192
173269943,0cyclictest31754-21awk11:43:142
173269943,0cyclictest22303-21awk08:33:142
173269943,0cyclictest19317-21awk07:18:142
173269943,0cyclictest16631-21awk08:53:142
173179944,0cyclictest0-21swapper/111:13:031
173179944,0cyclictest0-21swapper/109:09:081
173179943,0cyclictest8944-21awk08:23:151
173179943,0cyclictest3556-21lldpd10:45:051
173179943,0cyclictest3514-21snmpd12:13:191
173179943,0cyclictest3514-21snmpd11:48:191
173179943,0cyclictest3514-21snmpd11:39:191
173179943,0cyclictest3514-21snmpd11:06:191
173179943,0cyclictest3514-21snmpd10:55:191
173179943,0cyclictest3514-21snmpd10:03:041
173179943,0cyclictest3514-21snmpd09:53:491
173179943,0cyclictest3514-21snmpd08:43:041
173179943,0cyclictest3514-21snmpd07:47:191
173179943,0cyclictest3514-21snmpd07:37:191
173179943,0cyclictest3514-21snmpd07:06:041
173179943,0cyclictest3514-21snmpd07:06:041
173179943,0cyclictest28916-21awk08:38:141
173179943,0cyclictest27997-21awk08:13:151
173179943,0cyclictest24435-21awk10:58:131
173179943,0cyclictest24138-21awk11:18:141
173179943,0cyclictest18362-21awk06:53:141
173179943,0cyclictest16654-21awk10:13:121
173179943,0cyclictest15493-21sadc08:52:591
173179943,0cyclictest1277-21awk07:53:141
173139943,0cyclictest3514-21snmpd07:52:340
173139943,0cyclictest18432-21awk06:53:150
173139943,0cyclictest15597-21awk08:28:140
173139940,0cyclictest0-21swapper/011:35:000
179940,0migration/18191-21kthreadcore07:08:151
179940,0migration/17665-21latency_hist10:07:591
179940,0migration/15019-21missed_timers09:03:171
179940,0migration/13689-21kthreadcore07:28:181
179940,0migration/129813-21munin-node09:38:191
179940,0migration/128371-21kthreadcore10:38:171
179940,0migration/126398-21kthreadcore06:58:171
179940,0migration/124869-21kthreadcore08:33:161
179940,0migration/123474-21sshd09:16:201
179940,0migration/11733-21kthreadcore10:23:181
179940,0migration/116321-21aten_r1power_vo09:33:111
179940,0migration/114977-21runrttasks09:30:241
179940,0migration/114976-21kthreadcore07:13:161
169940,0watchdog/18178-21if_eth1.311:08:131
169940,0watchdog/16861-21ssh11:28:051
169940,0watchdog/16062-21kthreadcore08:18:181
169940,0watchdog/127033-21if_eth1.207:48:141
169940,0watchdog/115643-21aten_r1power_cu10:33:091
169940,0watchdog/111687-21seq10:48:171
169940,0watchdog/10-21swapper/111:43:171
169940,0watchdog/10-21swapper/109:43:181
149940,0migration/05641-21fschecks_count07:08:120
149940,0migration/04070-21kthreadcore09:23:160
149940,0migration/032353-21fschecks_time07:28:130
149940,0migration/031631-21latency_hist10:42:590
149940,0migration/031579-21kthreadcore08:38:160
149940,0migration/027022-21kthreadcore07:23:160
149940,0migration/026076-21kthreadcore10:38:160
149940,0migration/023751-21aten_r1power_cu08:58:100
149940,0migration/022574-21runrttasks11:58:090
149940,0migration/019352-21kthreadcore10:53:160
149940,0migration/015284-21aten2.4-expect11:13:100
339930,0migration/324195-21kthreadcore08:33:163
29715030,0irq/26-eth0-rx-0-21swapper/308:38:103
29715030,0irq/26-eth0-rx-0-21swapper/308:21:223
29715030,0irq/26-eth0-rx-0-21swapper/308:13:103
29715030,0irq/26-eth0-rx-0-21swapper/308:03:113
29715030,0irq/26-eth0-rx-0-21swapper/307:58:103
29715030,0irq/26-eth0-rx-0-21swapper/307:56:573
29715030,0irq/26-eth0-rx-0-21swapper/307:42:103
29715030,0irq/26-eth0-rx-0-21swapper/307:33:133
29715030,0irq/26-eth0-rx-0-21swapper/306:54:103
249930,0watchdog/231812-21irqcore07:03:142
249930,0watchdog/231812-21irqcore07:03:142
249930,0watchdog/20-21swapper/207:53:222
173269933,0cyclictest3556-21lldpd08:03:342
173269932,0cyclictest8904-21awk08:23:152
173269932,0cyclictest3514-21snmpd08:14:342
173269932,0cyclictest15024-21sed08:28:112
173139933,0cyclictest7671-21kworker/0:012:13:080
173139933,0cyclictest7671-21kworker/0:012:03:180
173139933,0cyclictest7671-21kworker/0:011:43:020
173139933,0cyclictest31495-21kworker/0:208:03:030
173139933,0cyclictest27067-21kworker/0:110:58:130
173139933,0cyclictest27067-21kworker/0:109:48:110
173139933,0cyclictest27067-21kworker/0:109:43:030
173139933,0cyclictest27067-21kworker/0:109:33:030
173139933,0cyclictest27067-21kworker/0:109:08:110
173139933,0cyclictest27067-21kworker/0:109:03:130
173139933,0cyclictest27067-21kworker/0:108:53:130
173139932,0cyclictest8294-21awk10:48:140
173139932,0cyclictest7054-21awk07:33:160
173139932,0cyclictest24309-21wc09:17:590
173139932,0cyclictest23112-21awk12:18:130
173139932,0cyclictest19342-21awk07:18:140
173139930,0cyclictest3459-21irqcore08:43:160
173139930,0cyclictest0-21swapper/008:33:130
179930,0migration/113621-21if_err_eth1.207:38:141
169930,0watchdog/10-21swapper/107:58:021
169930,0watchdog/10-21swapper/107:23:141
35120,0ktimersoftd/32996-21fschecks_time08:43:133
249920,0watchdog/20-21swapper/207:28:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional