You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 16:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Mar 19, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450540,0irq/25-eth10-21swapper/306:56:393
304450540,0irq/25-eth10-21swapper/306:56:393
2972023723,0sleep00-21swapper/006:57:020
2972023723,0sleep00-21swapper/006:57:020
2978123624,0sleep20-21swapper/206:57:442
2978123624,0sleep20-21swapper/206:57:442
2983823223,0sleep10-21swapper/106:58:231
2983823223,0sleep10-21swapper/106:58:231
339960,0migration/318832-21sh11:15:453
301259960,0cyclictest0-21swapper/010:07:070
29715060,0irq/26-eth0-rx-9418-21pmu-power10:26:153
29715060,0irq/26-eth0-rx-26658-21aten2.4-expect12:01:063
29715060,0irq/26-eth0-rx-24990-21cut10:16:123
29715060,0irq/26-eth0-rx-15310-21kthreadcore10:51:123
29715060,0irq/26-eth0-rx-0-21swapper/312:12:333
259960,0migration/224775-21munin-node11:36:182
19160,0ktimersoftd/13117-21perf10:45:561
149960,0migration/027695-21sh09:38:550
339950,0migration/39086-21diskmemload12:08:213
339950,0migration/36951-21kthreadcore12:26:113
339950,0migration/36669-21kthreadcore08:41:133
339950,0migration/33544-21irqcore11:46:113
339950,0migration/330330-21taskset07:01:023
339950,0migration/329461-21kthreadcore12:21:113
339950,0migration/328616-21latency_hist09:40:563
339950,0migration/327610-21aten_r1power_vo11:01:063
339950,0migration/327040-21kthreadcore07:21:113
339950,0migration/326866-21irqrtprio07:46:113
339950,0migration/324659-21kthreadcore08:06:133
339950,0migration/322640-21sh08:56:103
339950,0migration/320656-21sh09:36:063
339950,0migration/320349-21kthreadcore11:56:103
339950,0migration/319489-21cpuspeed_turbos11:16:073
339950,0migration/31943-21kthreadcore07:51:123
339950,0migration/318745-21hwlatdetect07:16:113
339950,0migration/318183-21smart_sda09:51:183
339950,0migration/317058-21kthreadcore08:01:133
339950,0migration/31521-21munin-node10:01:133
339950,0migration/312290-21kthreadcore08:21:133
339950,0migration/310958-21taskset07:09:383
339950,0migration/310572-21kthreadcore07:31:133
339950,0migration/310091-21switchtime09:06:183
301279955,0cyclictest0-21swapper/212:26:122
301279955,0cyclictest0-21swapper/209:56:072
301279954,0cyclictest3556-21lldpd08:22:082
301269950,0cyclictest0-21swapper/111:31:471
301259955,0cyclictest0-21swapper/011:11:360
301259955,0cyclictest0-21swapper/009:09:150
301259950,0cyclictest0-21swapper/012:05:590
301259950,0cyclictest0-21swapper/009:47:340
301259950,0cyclictest0-21swapper/008:15:580
301259950,0cyclictest0-21swapper/007:48:130
29725050,0irq/27-eth0-tx-9784-21ntp_offset09:06:152
29725050,0irq/27-eth0-tx-4568-21munin-node09:26:112
29725050,0irq/27-eth0-tx-24589-21munin-node07:21:140
29725050,0irq/27-eth0-tx-20098-21munin-node10:16:122
29725050,0irq/27-eth0-tx-19173-21munin-node11:16:072
29725050,0irq/27-eth0-tx-18602-21diskstats12:16:072
29725050,0irq/27-eth0-tx-17319-21ssh12:14:102
29725050,0irq/27-eth0-tx-0-21swapper/209:55:352
29725050,0irq/27-eth0-tx-0-21swapper/009:00:590
29725050,0irq/27-eth0-tx-0-21swapper/008:33:350
29725050,0irq/27-eth0-tx-0-21swapper/007:15:070
29715050,0irq/26-eth0-rx-28503-21gltestperf10:41:103
29715050,0irq/26-eth0-rx-19758-21tr10:56:063
29715050,0irq/26-eth0-rx-0-21swapper/312:16:123
29715050,0irq/26-eth0-rx-0-21swapper/311:51:153
29715050,0irq/26-eth0-rx-0-21swapper/311:38:353
29715050,0irq/26-eth0-rx-0-21swapper/311:26:053
29715050,0irq/26-eth0-rx-0-21swapper/310:49:353
29715050,0irq/26-eth0-rx-0-21swapper/310:37:293
29715050,0irq/26-eth0-rx-0-21swapper/310:31:093
29715050,0irq/26-eth0-rx-0-21swapper/309:59:013
29715050,0irq/26-eth0-rx-0-21swapper/309:46:053
29715050,0irq/26-eth0-rx-0-21swapper/309:31:133
29715050,0irq/26-eth0-rx-0-21swapper/309:01:123
259950,0migration/27626-21munin-node12:06:122
259950,0migration/230160-21kthreadcore12:01:122
259950,0migration/22382-21latency_hist11:45:562
259950,0migration/22350-21sh10:22:412
259950,0migration/22251-21timerwakeupswit09:41:182
259950,0migration/219985-21irqcore07:41:122
259950,0migration/216948-21sh11:52:012
259950,0migration/216755-21munin-node07:11:152
249950,0watchdog/28581-21sed11:06:142
249950,0watchdog/227814-21ssh09:19:102
249950,0watchdog/224047-21kthreadcore09:36:142
249950,0watchdog/218831-21cpuspeed_turbos11:56:062
179950,0migration/17721-21kthreadcore09:06:131
179950,0migration/17506-21kthreadcore12:06:121
179950,0migration/13541-21kthreadcore08:41:121
179950,0migration/129055-21kthreadcore11:21:111
179950,0migration/128870-21kthreadcore11:41:111
179950,0migration/124250-21munin-node07:41:151
179950,0migration/119748-21sh09:34:061
179950,0migration/117955-21munin-node09:51:161
149950,0migration/07041-21fschecks_count07:56:090
149950,0migration/0616-21kthreadcore07:01:140
149950,0migration/06034-21kthreadcore11:46:120
149950,0migration/05959-21kthreadcore11:26:110
149950,0migration/03960-21kthreadcore08:41:120
149950,0migration/031490-21kthreadcore09:21:110
149950,0migration/031481-21kthreadcore11:01:110
149950,0migration/030456-21kthreadcore12:01:120
149950,0migration/027512-21munin-node08:56:180
149950,0migration/025096-21latency10:36:130
149950,0migration/023746-21kthreadcore11:36:130
149950,0migration/023576-21kthreadcore09:56:120
149950,0migration/019471-21cpuspeed_turbos11:16:070
149950,0migration/01863-21munin-node12:26:050
149950,0migration/016721-21kthreadcore08:51:130
149950,0migration/015778-21kthreadcore08:26:130
149950,0migration/01393-21sh11:43:410
149950,0migration/013768-21fschecks_count08:01:090
149950,0migration/012768-21kernelversion10:51:110
149950,0migration/011648-21hwlatdetect11:31:070
8215040,0irq/24-0000:00:6359-21latency_hist07:55:562
339940,0migration/330675-21kthreadcore08:36:133
301279944,0cyclictest0-21swapper/209:11:112
301279943,0cyclictest9501-21awk08:46:132
301279943,0cyclictest3556-21lldpd10:31:392
301279943,0cyclictest3556-21lldpd08:53:082
301279943,0cyclictest3556-21lldpd08:45:082
301279943,0cyclictest3556-21lldpd08:34:082
301279943,0cyclictest3556-21lldpd08:26:082
301279943,0cyclictest3241-21irqbalance10:41:142
301279943,0cyclictest3241-21irqbalance10:13:042
301279943,0cyclictest32008-21latency_hist07:50:562
301279943,0cyclictest27751-21awk11:41:102
301269943,0cyclictest5234-21awk09:46:091
301269943,0cyclictest4054-21awk11:06:101
301269943,0cyclictest3556-21lldpd12:21:101
301269943,0cyclictest3556-21lldpd12:14:101
301269943,0cyclictest3556-21lldpd10:47:091
301269943,0cyclictest3556-21lldpd09:28:381
301269943,0cyclictest3514-21snmpd10:03:511
301269943,0cyclictest3514-21snmpd08:28:361
301269943,0cyclictest3241-21irqbalance10:40:541
301269943,0cyclictest3241-21irqbalance09:13:141
301269943,0cyclictest32186-21awk07:26:111
301269943,0cyclictest19875-21df10:56:071
301269943,0cyclictest19753-21awk11:36:101
301269943,0cyclictest13180-21awk07:36:121
301269943,0cyclictest12195-21awk07:11:101
301269943,0cyclictest11476-21awk11:51:101
301259944,0cyclictest24347-21kworker/0:109:45:210
301259944,0cyclictest0-21swapper/012:20:010
301259944,0cyclictest0-21swapper/012:12:370
301259944,0cyclictest0-21swapper/010:50:000
301259944,0cyclictest0-21swapper/010:31:330
301259943,0cyclictest3556-21lldpd10:41:090
301259943,0cyclictest3514-21snmpd09:51:210
301259943,0cyclictest3241-21irqbalance10:57:040
301259943,0cyclictest3241-21irqbalance09:26:440
301259943,0cyclictest3241-21irqbalance08:46:050
301259943,0cyclictest3241-21irqbalance08:36:050
301259943,0cyclictest3241-21irqbalance08:21:350
301259943,0cyclictest3241-21irqbalance07:52:150
301259943,0cyclictest3241-21irqbalance07:38:150
301259943,0cyclictest3241-21irqbalance07:31:050
301259943,0cyclictest27791-21sadc10:20:560
301259943,0cyclictest21656-21awk09:16:110
301259943,0cyclictest19741-21awk07:41:100
29725040,0irq/27-eth0-tx-8909-21cut10:26:122
29725040,0irq/27-eth0-tx-4647-21munin-node07:06:080
29725040,0irq/27-eth0-tx-4371-21munin-node09:46:172
29725040,0irq/27-eth0-tx-13645-21kthreadcore11:11:122
29725040,0irq/27-eth0-tx-0-21swapper/212:21:012
29725040,0irq/27-eth0-tx-0-21swapper/211:30:592
29725040,0irq/27-eth0-tx-0-21swapper/211:26:062
29725040,0irq/27-eth0-tx-0-21swapper/211:21:042
29725040,0irq/27-eth0-tx-0-21swapper/211:02:532
29725040,0irq/27-eth0-tx-0-21swapper/210:56:002
29725040,0irq/27-eth0-tx-0-21swapper/210:50:572
29725040,0irq/27-eth0-tx-0-21swapper/210:36:072
29725040,0irq/27-eth0-tx-0-21swapper/210:05:562
29725040,0irq/27-eth0-tx-0-21swapper/209:31:272
29725040,0irq/27-eth0-tx-0-21swapper/209:02:432
29725040,0irq/27-eth0-tx-0-21swapper/008:06:060
29725040,0irq/27-eth0-tx-0-21swapper/007:26:100
29715040,0irq/26-eth0-rx-15515-21kthreadcore08:26:133
29715040,0irq/26-eth0-rx-0-21swapper/311:41:113
29715040,0irq/26-eth0-rx-0-21swapper/311:31:193
29715040,0irq/26-eth0-rx-0-21swapper/311:21:123
29715040,0irq/26-eth0-rx-0-21swapper/311:05:573
29715040,0irq/26-eth0-rx-0-21swapper/310:20:593
29715040,0irq/26-eth0-rx-0-21swapper/310:11:553
29715040,0irq/26-eth0-rx-0-21swapper/309:27:513
29715040,0irq/26-eth0-rx-0-21swapper/309:21:243
29715040,0irq/26-eth0-rx-0-21swapper/309:16:073
29715040,0irq/26-eth0-rx-0-21swapper/309:11:243
29715040,0irq/26-eth0-rx-0-21swapper/307:41:073
259940,0migration/25011-21kthreadcore10:46:112
259940,0migration/232072-21kthreadcore09:21:122
259940,0migration/231788-21fschecks_count07:26:092
259940,0migration/230634-21kthreadcore08:36:132
259940,0migration/230624-21runrttasks07:21:272
259940,0migration/229949-21kthreadcore10:01:102
259940,0migration/222705-21munin-node08:56:112
259940,0migration/218548-21mdstat08:01:142
259940,0migration/21339-21fschecks_count08:16:092
259940,0migration/212242-21latency_hist07:35:562
249940,0watchdog/20-21swapper/208:06:102
249940,0watchdog/20-21swapper/207:01:152
179940,0migration/14332-21fschecks_count10:26:081
179940,0migration/13303-21kthreadcore07:51:121
179940,0migration/131377-21irqcore07:01:131
179940,0migration/129808-21kthreadcore11:01:111
179940,0migration/127866-21kthreadcore12:01:111
179940,0migration/116147-21kthreadcore10:11:131
179940,0migration/116134-21kthreadcore11:11:121
179940,0migration/115974-21runrttasks08:51:091
179940,0migration/112956-21irqcore10:31:101
169940,0watchdog/18944-21diskstats08:46:101
169940,0watchdog/17469-21munin-node07:56:111
169940,0watchdog/129808-21iostat_ios09:21:101
169940,0watchdog/126835-21kthreadcore08:56:141
169940,0watchdog/119224-21munin-node12:16:101
169940,0watchdog/118584-21ssh10:54:061
169940,0watchdog/111800-21taskset07:33:151
169940,0watchdog/110589-21ssh10:07:261
169940,0watchdog/10-21swapper/111:56:141
169940,0watchdog/10-21swapper/109:36:141
169940,0watchdog/10-21swapper/107:21:071
149940,0migration/032522-21runrttasks12:21:440
149940,0migration/03107-21sh10:04:110
149940,0migration/020184-21kthreadcore07:16:140
149940,0migration/018901-21sh10:13:150
149940,0migration/014385-21kthreadcore11:51:130
149940,0migration/01052-21kthreadcore10:21:130
8215030,0irq/24-0000:00:0-21swapper/207:30:572
339930,0migration/31825-21kthreadcore07:26:133
301279932,0cyclictest3556-21lldpd07:51:072
301279932,0cyclictest3556-21lldpd07:17:372
301279932,0cyclictest3556-21lldpd07:06:052
301269932,0cyclictest5267-21tune2fs07:06:101
301269932,0cyclictest4882-21kthreadcore12:26:101
301269932,0cyclictest3556-21lldpd08:21:081
301269932,0cyclictest3514-21snmpd11:29:071
301269932,0cyclictest29633-21awk09:41:101
301269932,0cyclictest27424-21awk08:11:091
301269932,0cyclictest26535-21awk07:46:101
301269932,0cyclictest21184-21fschecks_count09:16:091
301269932,0cyclictest18990-21sed07:16:131
301269932,0cyclictest1525-21sensors10:21:171
301269932,0cyclictest1053-21tr08:16:081
301269931,0cyclictest0-21swapper/111:46:121
301259933,0cyclictest8311-21kworker/0:011:56:010
301259933,0cyclictest24347-21kworker/0:111:20:570
301259933,0cyclictest24347-21kworker/0:111:05:590
301259933,0cyclictest24347-21kworker/0:110:25:590
301259933,0cyclictest24347-21kworker/0:109:30:570
301259933,0cyclictest24347-21kworker/0:109:10:570
301259933,0cyclictest24347-21kworker/0:108:10:580
29715030,0irq/26-eth0-rx-0-21swapper/310:06:063
29715030,0irq/26-eth0-rx-0-21swapper/308:51:073
29715030,0irq/26-eth0-rx-0-21swapper/308:13:223
29715030,0irq/26-eth0-rx-0-21swapper/307:56:073
29715030,0irq/26-eth0-rx-0-21swapper/307:39:343
29715030,0irq/26-eth0-rx-0-21swapper/307:11:063
249930,0watchdog/20-21swapper/208:11:062
169930,0watchdog/10-21swapper/111:17:541
169930,0watchdog/10-21swapper/109:56:061
169930,0watchdog/10-21swapper/109:01:101
169930,0watchdog/10-21swapper/108:06:101
301269921,0cyclictest16064-21kworker/1:108:35:561
29715020,0irq/26-eth0-rx-0-21swapper/308:46:213
29715020,0irq/26-eth0-rx-0-21swapper/308:30:593
29715020,0irq/26-eth0-rx-0-21swapper/308:16:003
169920,0watchdog/10-21swapper/110:15:581
169920,0watchdog/10-21swapper/108:31:021
169920,0watchdog/10-21swapper/108:00:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional