You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 20:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 03, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/306:41:323
1782923627,0sleep20-21swapper/206:42:282
1768723525,0sleep10-21swapper/106:40:511
1773323329,0sleep00-21swapper/006:41:220
339960,0migration/3946-21kthreadcore10:35:173
339960,0migration/328797-21sh10:52:163
339960,0migration/324096-21sh09:09:133
339960,0migration/319376-21kthreadcore09:25:193
29725060,0irq/27-eth0-tx-15682-21munin-node08:20:120
29715060,0irq/26-eth0-rx-23238-21aten2.4-expect10:10:103
29715060,0irq/26-eth0-rx-14163-21ssh10:45:093
29715060,0irq/26-eth0-rx-0-21swapper/310:07:063
29715060,0irq/26-eth0-rx-0-21swapper/308:50:113
181129960,0cyclictest0-21swapper/110:32:571
149960,0migration/032381-21sh08:54:470
149960,0migration/028882-21kthreadcore09:10:150
149960,0migration/020576-21munin-node10:05:200
149960,0migration/015922-21sh09:24:590
149960,0migration/015164-21sh09:01:280
149960,0migration/014249-21kthreadcore12:05:190
8215050,0irq/24-0000:00:20107-21latency_hist07:34:592
8215050,0irq/24-0000:00:15463-21perf08:19:592
339950,0migration/39954-21kthreadcore10:00:143
339950,0migration/39897-21kthreadcore07:00:173
339950,0migration/39244-21if_eth1.209:20:133
339950,0migration/38081-21munin-node09:40:103
339950,0migration/37265-21kthreadcore11:00:143
339950,0migration/36770-21aten_r1power_po10:20:103
339950,0migration/3447-21timerwakeupswit07:40:213
339950,0migration/330607-21kthreadcore08:05:153
339950,0migration/330130-21taskset10:55:093
339950,0migration/327389-21taskset11:31:333
339950,0migration/325487-21kernelversion09:30:153
339950,0migration/322680-21kthreadcore11:50:143
339950,0migration/317746-21kthreadcore09:45:203
339950,0migration/315157-21kthreadcore07:05:153
339950,0migration/313980-21kthreadcore08:15:173
339950,0migration/313921-21munin-node07:50:213
29725050,0irq/27-eth0-tx-9056-21munin-node08:15:220
29725050,0irq/27-eth0-tx-8276-21munin-node09:20:122
29725050,0irq/27-eth0-tx-26871-21kthreadcore09:10:152
29725050,0irq/27-eth0-tx-19121-21kthreadcore10:05:192
29725050,0irq/27-eth0-tx-18661-21ssh12:07:172
29725050,0irq/27-eth0-tx-18325-21munin-node06:45:190
29725050,0irq/27-eth0-tx-17245-21perl09:05:152
29725050,0irq/27-eth0-tx-15427-21kthreadcore10:45:142
29725050,0irq/27-eth0-tx-15078-21cat11:25:182
29725050,0irq/27-eth0-tx-0-21swapper/211:54:062
29725050,0irq/27-eth0-tx-0-21swapper/209:34:352
29725050,0irq/27-eth0-tx-0-21swapper/008:45:230
29725050,0irq/27-eth0-tx-0-21swapper/008:35:170
29725050,0irq/27-eth0-tx-0-21swapper/007:25:200
29715050,0irq/26-eth0-rx-4357-21kthreadcore08:55:163
29715050,0irq/26-eth0-rx-4357-21kthreadcore08:55:163
29715050,0irq/26-eth0-rx-369-21gltestperf09:35:113
29715050,0irq/26-eth0-rx-28688-21ssh10:30:203
29715050,0irq/26-eth0-rx-22371-21processes08:45:193
29715050,0irq/26-eth0-rx-20636-21cut06:45:163
29715050,0irq/26-eth0-rx-18065-21kthreadcore10:25:143
29715050,0irq/26-eth0-rx-1786-21kthreadcore09:55:153
29715050,0irq/26-eth0-rx-12918-21aten_r1power_cu11:25:123
29715050,0irq/26-eth0-rx-10540-21tr07:25:163
29715050,0irq/26-eth0-rx-10499-21grep08:40:133
29715050,0irq/26-eth0-rx-0-21swapper/311:45:243
29715050,0irq/26-eth0-rx-0-21swapper/311:41:423
29715050,0irq/26-eth0-rx-0-21swapper/311:39:013
29715050,0irq/26-eth0-rx-0-21swapper/311:20:383
29715050,0irq/26-eth0-rx-0-21swapper/311:15:153
29715050,0irq/26-eth0-rx-0-21swapper/311:13:503
29715050,0irq/26-eth0-rx-0-21swapper/311:04:583
29715050,0irq/26-eth0-rx-0-21swapper/310:40:363
29715050,0irq/26-eth0-rx-0-21swapper/310:15:093
29715050,0irq/26-eth0-rx-0-21swapper/309:03:143
29715050,0irq/26-eth0-rx-0-21swapper/308:20:143
259950,0migration/230891-21latency_hist10:14:582
19150,0ktimersoftd/10-21swapper/108:48:151
181169950,0cyclictest0-21swapper/208:56:592
181169950,0cyclictest0-21swapper/208:56:592
181169950,0cyclictest0-21swapper/208:52:252
181129955,0cyclictest0-21swapper/109:48:191
181129954,0cyclictest20005-21grep10:25:151
181129950,0cyclictest0-21swapper/111:58:331
181129950,0cyclictest0-21swapper/111:20:051
181129950,0cyclictest0-21swapper/110:15:271
181129950,0cyclictest0-21swapper/109:30:591
181129950,0cyclictest0-21swapper/109:20:541
181119955,0cyclictest0-21swapper/010:52:130
181119954,0cyclictest10884-21awk08:40:140
181119950,0cyclictest0-21swapper/009:09:540
179950,0migration/16258-21fschecks_time11:00:111
179950,0migration/131439-21sh09:12:221
179950,0migration/123317-21kthreadcore11:30:121
179950,0migration/12244-21munin-node08:30:201
179950,0migration/112474-21munin-run07:04:591
179950,0migration/11146-21hwlatdetect08:55:121
179950,0migration/11146-21hwlatdetect08:55:121
149950,0migration/06606-21kthreadcore08:10:150
149950,0migration/0631-21taskset07:40:350
149950,0migration/03330-21kthreadcore10:35:180
149950,0migration/032459-21latency_hist09:14:590
149950,0migration/031951-21kthreadcore11:55:140
149950,0migration/031702-21kthreadcore10:55:130
149950,0migration/031226-21cpu10:15:090
149950,0migration/030346-21kthreadcore08:30:150
149950,0migration/028706-21kthreadcore06:50:150
149950,0migration/025542-21kthreadcore09:30:150
149950,0migration/024528-21kthreadcore11:10:150
149950,0migration/023577-21sh09:50:000
149950,0migration/023253-21cpu10:10:100
149950,0migration/021895-21fschecks_count08:00:120
149950,0migration/02139-21kthreadcore11:15:150
149950,0migration/020234-21pmu-power07:55:200
149950,0migration/019931-21switchtime10:45:200
149950,0migration/018738-21runrttasks11:45:530
149950,0migration/018171-21kthreadcore09:45:200
149950,0migration/017735-21kthreadcore10:25:140
149950,0migration/016590-21kthreadcore11:05:190
149950,0migration/013029-21kthreadcore07:50:160
8215040,0irq/24-0000:00:0-21swapper/207:14:542
339940,0migration/37434-21kthreadcore08:10:153
339940,0migration/34588-21munin-node08:35:143
339940,0migration/328290-21diskmemload11:55:063
339940,0migration/326206-21kthreadcore08:25:163
339940,0migration/326071-21irqcore06:50:143
339940,0migration/325458-21taskset07:11:083
339940,0migration/322927-21kthreadcore12:10:173
339940,0migration/318321-21diskmemload12:06:163
339940,0migration/317418-21kthreadcore07:55:163
29725040,0irq/27-eth0-tx-4745-21netstat09:55:172
29725040,0irq/27-eth0-tx-32068-21ssh09:35:022
29725040,0irq/27-eth0-tx-21880-21ssh09:45:302
29725040,0irq/27-eth0-tx-21407-21ssh11:10:032
29725040,0irq/27-eth0-tx-16463-21diskmemload10:04:422
29725040,0irq/27-eth0-tx-0-21swapper/211:54:592
29725040,0irq/27-eth0-tx-0-21swapper/211:45:412
29725040,0irq/27-eth0-tx-0-21swapper/211:40:102
29725040,0irq/27-eth0-tx-0-21swapper/211:35:152
29725040,0irq/27-eth0-tx-0-21swapper/211:22:102
29725040,0irq/27-eth0-tx-0-21swapper/211:15:302
29725040,0irq/27-eth0-tx-0-21swapper/211:06:072
29725040,0irq/27-eth0-tx-0-21swapper/210:40:082
29725040,0irq/27-eth0-tx-0-21swapper/210:10:132
29725040,0irq/27-eth0-tx-0-21swapper/209:50:372
29725040,0irq/27-eth0-tx-0-21swapper/209:40:132
29725040,0irq/27-eth0-tx-0-21swapper/007:35:130
29725040,0irq/27-eth0-tx-0-21swapper/007:15:170
29715040,0irq/26-eth0-rx-0-21swapper/312:00:123
29715040,0irq/26-eth0-rx-0-21swapper/309:50:423
29715040,0irq/26-eth0-rx-0-21swapper/309:16:323
29715040,0irq/26-eth0-rx-0-21swapper/309:10:133
29715040,0irq/26-eth0-rx-0-21swapper/307:30:143
29715040,0irq/26-eth0-rx-0-21swapper/306:55:163
259940,0migration/29443-21runrttasks08:36:132
259940,0migration/29416-21kthreadcore07:25:162
259940,0migration/26590-21runrttasks10:19:592
259940,0migration/231984-21kthreadcore10:35:162
259940,0migration/230550-21kthreadcore07:40:152
259940,0migration/229855-21latency_hist10:54:582
259940,0migration/222593-21aten_r1power_en10:30:082
259940,0migration/222523-21fschecks_count10:50:102
259940,0migration/222436-21sh08:25:102
259940,0migration/221013-21sh10:26:122
259940,0migration/220929-21kthreadcore09:25:192
259940,0migration/216606-21kthreadcore07:05:162
259940,0migration/210661-21kthreadcore11:00:152
249940,0watchdog/25024-21tr09:15:172
249940,0watchdog/225399-21ntp_kernel_pll_12:10:202
249940,0watchdog/224996-21kthreadcore11:30:122
249940,0watchdog/215265-21kthreadcore07:30:132
249940,0watchdog/210007-21runrttasks08:40:092
249940,0watchdog/20-21swapper/207:00:172
181169943,0cyclictest9611-21awk09:00:142
181169943,0cyclictest3883-21munin-node12:00:152
181169943,0cyclictest3556-21lldpd08:00:232
181169943,0cyclictest3556-21lldpd07:51:232
181169943,0cyclictest3556-21lldpd07:20:232
181169943,0cyclictest3556-21lldpd06:57:532
181169943,0cyclictest3514-21snmpd08:23:262
181169943,0cyclictest3514-21snmpd08:13:412
181169943,0cyclictest3027-21sadc08:34:592
181169943,0cyclictest26906-21awk07:15:132
181169943,0cyclictest25845-21awk06:50:132
181169943,0cyclictest17566-21awk08:45:132
181129944,0cyclictest0-21swapper/112:06:071
181129944,0cyclictest0-21swapper/109:57:381
181129944,0cyclictest0-21swapper/109:42:111
181129944,0cyclictest0-21swapper/108:16:251
181129943,0cyclictest9472-21awk09:00:131
181129943,0cyclictest9057-21awk07:50:141
181129943,0cyclictest8158-21awk10:00:121
181129943,0cyclictest7959-21awk07:25:141
181129943,0cyclictest3556-21lldpd11:27:241
181129943,0cyclictest3514-21snmpd11:46:591
181129943,0cyclictest3514-21snmpd11:05:131
181129943,0cyclictest3514-21snmpd10:41:581
181129943,0cyclictest3514-21snmpd08:20:111
181129943,0cyclictest3514-21snmpd06:49:411
181129943,0cyclictest3241-21irqbalance09:08:171
181129943,0cyclictest22908-21awk10:50:121
181129943,0cyclictest17216-21awk09:25:171
181129943,0cyclictest16783-21tr07:30:141
181129943,0cyclictest1167-21awk07:20:131
181119944,0cyclictest0-21swapper/012:00:100
181119944,0cyclictest0-21swapper/010:31:060
181119944,0cyclictest0-21swapper/009:44:540
181119943,0cyclictest6812-21sadc07:24:590
181119943,0cyclictest6438-21awk11:00:120
181119943,0cyclictest3556-21lldpd08:55:220
181119943,0cyclictest3556-21lldpd08:55:220
181119943,0cyclictest3241-21irqbalance11:43:460
181119943,0cyclictest20289-21awk07:10:140
181119940,0cyclictest28777-21munin-run08:29:590
179940,0migration/19144-21kthreadcore11:40:151
179940,0migration/15257-21kthreadcore07:45:151
179940,0migration/14971-21kthreadcore09:35:151
179940,0migration/14734-21kthreadcore08:35:151
179940,0migration/131443-21kthreadcore08:05:151
179940,0migration/127751-21sh11:11:021
179940,0migration/123764-21kthreadcore07:35:171
179940,0migration/121157-21hwlatdetect11:50:111
179940,0migration/11388-21irqrtprio09:15:151
169940,0watchdog/131850-21kthreadcore10:35:161
169940,0watchdog/13150-21ssh11:15:241
169940,0watchdog/121587-21ssh10:06:171
169940,0watchdog/110591-21ssh12:02:001
169940,0watchdog/10-21swapper/112:10:201
169940,0watchdog/10-21swapper/110:20:201
169940,0watchdog/10-21swapper/107:55:171
149940,0migration/04784-21kthreadcore07:45:150
149940,0migration/023841-21kthreadcore11:50:140
149940,0migration/01686-21kthreadcore09:35:140
149940,0migration/011130-21sh11:20:270
149940,0migration/010138-21kthreadcore07:00:170
29715030,0irq/26-eth0-rx-0-21swapper/308:30:033
29715030,0irq/26-eth0-rx-0-21swapper/308:00:103
29715030,0irq/26-eth0-rx-0-21swapper/307:35:103
29715030,0irq/26-eth0-rx-0-21swapper/307:23:253
29715030,0irq/26-eth0-rx-0-21swapper/307:15:183
249930,0watchdog/20-21swapper/207:55:172
181169932,0cyclictest28879-21awk08:05:122
181169932,0cyclictest20033-21grep06:45:162
181169932,0cyclictest1399-21basename07:45:092
181129933,0cyclictest29661-21awk11:35:121
181129933,0cyclictest0-21swapper/107:10:211
181129932,0cyclictest3514-21snmpd10:54:581
181129932,0cyclictest30704-21sensors06:50:191
181129932,0cyclictest30334-21sensors08:50:191
181129932,0cyclictest24883-21sed09:50:141
181129932,0cyclictest23231-21awk08:25:141
181129932,0cyclictest13777-21sed07:05:151
181129930,0cyclictest2999-21perl08:10:111
181129930,0cyclictest0-21swapper/106:56:101
181119933,0cyclictest27811-21kworker/0:112:10:050
181119933,0cyclictest27811-21kworker/0:111:35:030
181119933,0cyclictest27811-21kworker/0:111:30:010
181119933,0cyclictest27811-21kworker/0:111:24:590
181119933,0cyclictest25782-21kworker/0:210:20:060
181119933,0cyclictest25782-21kworker/0:210:00:020
181119933,0cyclictest25782-21kworker/0:209:55:020
181119933,0cyclictest25782-21kworker/0:209:25:100
181119933,0cyclictest25782-21kworker/0:208:05:080
181119933,0cyclictest25782-21kworker/0:207:30:000
181119933,0cyclictest25782-21kworker/0:207:05:000
181119933,0cyclictest25782-21kworker/0:206:55:000
181119932,0cyclictest7320-21irqrtprio10:40:130
179930,0migration/126528-21kthreadcore08:00:161
179930,0migration/116983-21kthreadcore10:45:141
169930,0watchdog/116463-21diskmemload10:10:131
169930,0watchdog/10-21swapper/108:40:171
29715020,0irq/26-eth0-rx-0-21swapper/307:45:043
181129921,0cyclictest26829-21latency_hist07:39:591
181129920,0cyclictest25957-21latency_hist07:14:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional