You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-23 - 13:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 23, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/306:43:563
509327170,0sleep20-21swapper/206:45:222
483323324,0sleep10-21swapper/106:42:211
475722824,0sleep00-21swapper/006:41:280
27170,0ktimersoftd/29579-21cut11:31:172
339960,0migration/39509-21sh10:10:103
339960,0migration/36020-21sh11:26:463
339960,0migration/332439-21sh10:44:233
339960,0migration/332036-21sh11:05:013
339960,0migration/327271-21runrttasks09:00:013
339960,0migration/322423-21sh11:16:373
339960,0migration/317644-21sh09:32:103
339960,0migration/314106-21sh11:53:573
29725060,0irq/27-eth0-tx-11274-21munin-node09:31:252
29715060,0irq/26-eth0-rx-9162-21tail08:01:133
29715060,0irq/26-eth0-rx-29703-21kthreadcore09:41:183
29715060,0irq/26-eth0-rx-20688-21if_eth1.207:21:193
29715060,0irq/26-eth0-rx-15686-21perl11:56:143
29715060,0irq/26-eth0-rx-153532sleep311:35:533
29715060,0irq/26-eth0-rx-12562-21perl09:11:153
149960,0migration/031540-21sh11:46:110
149960,0migration/025740-21sh09:37:350
149960,0migration/024257-21sh10:38:400
8215050,0irq/24-0000:00:31843-21sa107:06:022
52199955,0cyclictest0-21swapper/211:36:202
52199955,0cyclictest0-21swapper/210:17:112
52199955,0cyclictest0-21swapper/207:21:242
52199954,0cyclictest13863-21ssh11:53:122
52199950,0cyclictest0-21swapper/211:18:032
52199950,0cyclictest0-21swapper/210:49:312
52199950,0cyclictest0-21swapper/208:21:192
52179955,0cyclictest0-21swapper/011:14:560
52179955,0cyclictest0-21swapper/010:20:510
52179955,0cyclictest0-21swapper/009:05:580
52179954,0cyclictest24692-21cut11:41:180
52179950,0cyclictest0-21swapper/010:56:010
52179950,0cyclictest0-21swapper/010:11:330
52179950,0cyclictest0-21swapper/010:04:470
4150,0ktimersoftd/00-21swapper/011:01:410
339950,0migration/38564-21taskset10:29:123
339950,0migration/35349-21kthreadcore07:31:203
339950,0migration/327772-21munin-node07:51:153
339950,0migration/327772-21munin-node07:51:153
339950,0migration/32395-21needreboot08:41:213
339950,0migration/323335-21fschecks_time08:36:153
339950,0migration/316201-21munin-node10:11:253
339950,0migration/315451-21taskset10:52:433
339950,0migration/315191-21kthreadcore07:16:173
339950,0migration/315164-21munin-node08:06:143
339950,0migration/312631-21munin-node08:51:193
339950,0migration/311088-21kthreadcore08:26:183
29725050,0irq/27-eth0-tx-8892-21munin-node10:51:162
29725050,0irq/27-eth0-tx-409-21ssh10:02:082
29725050,0irq/27-eth0-tx-32328-21ssh11:05:512
29725050,0irq/27-eth0-tx-20794-21munin-node07:46:160
29725050,0irq/27-eth0-tx-17362-21munin-node10:36:172
29725050,0irq/27-eth0-tx-10596-21ssh09:08:162
29725050,0irq/27-eth0-tx-10102-21ssh08:47:130
29725050,0irq/27-eth0-tx-10012-21ssh09:28:032
29725050,0irq/27-eth0-tx-0-21swapper/212:06:102
29725050,0irq/27-eth0-tx-0-21swapper/211:44:442
29725050,0irq/27-eth0-tx-0-21swapper/210:56:192
29725050,0irq/27-eth0-tx-0-21swapper/210:00:472
29725050,0irq/27-eth0-tx-0-21swapper/209:45:292
29725050,0irq/27-eth0-tx-0-21swapper/208:53:082
29725050,0irq/27-eth0-tx-0-21swapper/008:28:140
29725050,0irq/27-eth0-tx-0-21swapper/008:16:210
29715050,0irq/26-eth0-rx-32710-21grep07:06:173
29715050,0irq/26-eth0-rx-30779-21ls12:06:013
29715050,0irq/26-eth0-rx-22767-21kthreadcore09:36:183
29715050,0irq/26-eth0-rx-18397-21taskset06:54:323
29715050,0irq/26-eth0-rx-10659-21basename09:51:123
29715050,0irq/26-eth0-rx-10579-21kthreadcore12:11:173
29715050,0irq/26-eth0-rx-10487-21irqcore10:31:183
29715050,0irq/26-eth0-rx-0-21swapper/311:46:173
29715050,0irq/26-eth0-rx-0-21swapper/311:12:323
29715050,0irq/26-eth0-rx-0-21swapper/310:56:553
29715050,0irq/26-eth0-rx-0-21swapper/310:36:153
29715050,0irq/26-eth0-rx-0-21swapper/310:04:303
29715050,0irq/26-eth0-rx-0-21swapper/309:46:173
29715050,0irq/26-eth0-rx-0-21swapper/309:26:183
29715050,0irq/26-eth0-rx-0-21swapper/309:24:403
29715050,0irq/26-eth0-rx-0-21swapper/309:18:093
29715050,0irq/26-eth0-rx-0-21swapper/308:46:163
29715050,0irq/26-eth0-rx-0-21swapper/306:56:203
259950,0migration/26300-21timerwakeupswit11:06:242
259950,0migration/25822-21munin-node11:26:232
259950,0migration/230702-21kthreadcore09:21:192
259950,0migration/226990-21kthreadcore11:21:202
259950,0migration/221055-21munin-node11:56:232
259950,0migration/220627-21idleruntime08:56:152
259950,0migration/216626-21sh10:34:392
259950,0migration/214210-21latency_hist12:16:012
259950,0migration/211788-21kthreadcore07:36:192
259950,0migration/210633-21kthreadcore11:11:182
169950,0watchdog/17032-21kthreadcore08:21:201
149950,0migration/08092-21runrttasks10:49:290
149950,0migration/07912-21taskset10:27:130
149950,0migration/07750-21fschecks_time11:51:150
149950,0migration/07279-21gltestperf12:11:130
149950,0migration/06565-21timerandwakeup07:31:260
149950,0migration/05186-21kthreadcore08:21:190
149950,0migration/04839-21kthreadcore07:06:210
149950,0migration/03536-21cpuspeed_turbos09:26:130
149950,0migration/030818-21kthreadcore09:21:190
149950,0migration/030189-21gltestperf08:41:160
149950,0migration/029134-21kthreadcore07:01:190
149950,0migration/028976-21kthreadcore07:51:200
149950,0migration/028976-21kthreadcore07:51:200
149950,0migration/027150-21kthreadcore12:01:180
149950,0migration/026948-21sh09:19:300
149950,0migration/024938-21kthreadcore08:56:190
149950,0migration/024176-21kthreadcore08:36:180
149950,0migration/023049-21kthreadcore09:56:190
149950,0migration/022433-21fschecks_time08:11:140
149950,0migration/020002-21kthreadcore11:56:180
149950,0migration/019224-21kthreadcore11:36:190
149950,0migration/016980-21kthreadcore06:51:210
149950,0migration/011843-21taskset06:50:200
149950,0migration/011781-21missed_timers07:11:200
149950,0migration/011035-21sh09:09:270
149950,0migration/010986-21kthreadcore10:31:190
52199944,0cyclictest0-21swapper/210:21:082
52199943,0cyclictest4624-21awk08:46:172
52199943,0cyclictest3514-21snmpd08:37:592
52199943,0cyclictest3514-21snmpd07:49:292
52199943,0cyclictest3514-21snmpd07:31:142
52199943,0cyclictest3514-21snmpd07:20:142
52199943,0cyclictest3514-21snmpd06:46:142
52199943,0cyclictest30392-21awk08:41:172
52199943,0cyclictest2300-21awk10:26:172
52199943,0cyclictest22321-21grep08:11:142
52199943,0cyclictest13052-21awk06:51:182
52199940,0cyclictest0-21swapper/211:46:142
52189943,0cyclictest8039-21awk11:51:161
52189943,0cyclictest4611-21awk09:06:151
52189943,0cyclictest3556-21lldpd12:13:521
52189943,0cyclictest3556-21lldpd11:14:221
52189943,0cyclictest3556-21lldpd10:43:221
52189943,0cyclictest3556-21lldpd10:12:221
52189943,0cyclictest3514-21snmpd11:49:151
52189943,0cyclictest3514-21snmpd11:42:151
52189943,0cyclictest3514-21snmpd11:03:151
52189943,0cyclictest3514-21snmpd10:53:301
52189943,0cyclictest3514-21snmpd09:46:151
52189943,0cyclictest3514-21snmpd08:11:441
52189943,0cyclictest3514-21snmpd08:01:141
52189943,0cyclictest3514-21snmpd07:36:291
52189943,0cyclictest3514-21snmpd07:23:141
52189943,0cyclictest3514-21snmpd07:11:441
52189943,0cyclictest3514-21snmpd06:49:441
52189943,0cyclictest3241-21irqbalance11:33:291
52189943,0cyclictest3241-21irqbalance10:01:101
52189943,0cyclictest3241-21irqbalance08:46:101
52189943,0cyclictest3241-21irqbalance08:26:401
52189943,0cyclictest3241-21irqbalance08:16:501
52189943,0cyclictest3241-21irqbalance07:01:101
52189943,0cyclictest3241-21irqbalance06:56:101
52189943,0cyclictest2905-21awk10:06:171
52189943,0cyclictest2603-21awk07:56:171
52189943,0cyclictest25063-21awk11:21:181
52189943,0cyclictest20045-21awk09:36:151
52189943,0cyclictest19481-21awk09:56:161
52189943,0cyclictest1792-21awk10:46:171
52189943,0cyclictest16547-21awk11:36:161
52189943,0cyclictest12778-21awk09:11:171
52179944,0cyclictest0-21swapper/010:42:080
52179943,0cyclictest7422-21munin-node07:36:150
52179943,0cyclictest3514-21snmpd07:18:440
52179943,0cyclictest3514-21snmpd07:00:140
52179943,0cyclictest3241-21irqbalance11:19:190
52179943,0cyclictest3241-21irqbalance10:25:300
52179943,0cyclictest3241-21irqbalance10:06:200
52179943,0cyclictest3241-21irqbalance09:31:200
52179943,0cyclictest2579-21awk07:56:170
52179943,0cyclictest25088-21awk11:21:180
52179943,0cyclictest19430-21kworker/0:008:52:110
339940,0migration/329660-21needreboot11:21:223
339940,0migration/325855-21diskmemload10:21:063
339940,0migration/324510-21timerandwakeup09:56:243
339940,0migration/321280-21kthreadcore10:16:183
339940,0migration/319806-21sensors_temp07:41:253
29725040,0irq/27-eth0-tx-3690-21ssh09:46:162
29725040,0irq/27-eth0-tx-17308-21ssh09:53:022
29725040,0irq/27-eth0-tx-15088-21munin-node08:06:150
29725040,0irq/27-eth0-tx-0-21swapper/212:01:072
29725040,0irq/27-eth0-tx-0-21swapper/210:41:072
29725040,0irq/27-eth0-tx-0-21swapper/209:01:042
29715040,0irq/26-eth0-rx-5861-21ntpdc11:06:203
29715040,0irq/26-eth0-rx-0-21swapper/312:01:173
29715040,0irq/26-eth0-rx-0-21swapper/311:41:193
29715040,0irq/26-eth0-rx-0-21swapper/311:36:233
29715040,0irq/26-eth0-rx-0-21swapper/310:46:133
29715040,0irq/26-eth0-rx-0-21swapper/309:06:043
29715040,0irq/26-eth0-rx-0-21swapper/309:01:213
29715040,0irq/26-eth0-rx-0-21swapper/307:11:133
29715040,0irq/26-eth0-rx-0-21swapper/307:05:093
259940,0migration/28941-21fschecks_count08:01:132
259940,0migration/226747-21cpuspeed_turbos07:26:142
259940,0migration/223286-21kthreadcore09:36:182
259940,0migration/220078-21kernelversion06:56:202
259940,0migration/212846-21kthreadcore10:11:192
259940,0migration/212631-21kthreadcore08:26:182
259940,0migration/210115-21kthreadcore07:11:192
249940,0watchdog/216322-21grep09:11:202
249940,0watchdog/21332-21memory08:16:202
249940,0watchdog/20-21swapper/210:06:192
249940,0watchdog/20-21swapper/209:16:122
249940,0watchdog/20-21swapper/207:56:202
249940,0watchdog/20-21swapper/207:51:202
249940,0watchdog/20-21swapper/207:51:202
249940,0watchdog/20-21swapper/207:41:162
249940,0watchdog/20-21swapper/207:06:202
179940,0migration/17321-21sh11:08:551
179940,0migration/131686-21kthreadcore09:01:191
179940,0migration/129202-21kthreadcore09:21:191
179940,0migration/124531-21taskset10:39:311
179940,0migration/123759-21kthreadcore08:56:191
179940,0migration/123753-21gltestperf12:01:141
179940,0migration/121135-21kthreadcore11:16:191
179940,0migration/120295-21kthreadcore10:16:181
179940,0migration/115599-21fschecks_count11:56:141
179940,0migration/11372-21kthreadcore07:06:201
179940,0migration/112984-21latency_hist07:16:021
169940,0watchdog/16320-21ssh11:27:391
169940,0watchdog/130202-21hddtemp_smartct08:41:161
169940,0watchdog/127450-21munin-node07:51:161
169940,0watchdog/127450-21munin-node07:51:161
169940,0watchdog/126776-21if_err_eth1.210:21:151
169940,0watchdog/120420-21cut08:31:201
169940,0watchdog/117238-21kthreadcore08:06:201
169940,0watchdog/116802-21ssh10:56:111
169940,0watchdog/115407-21kthreadcore09:51:191
169940,0watchdog/11489-21ssh09:43:271
169940,0watchdog/11119-21kthreadcore12:06:191
169940,0watchdog/110121-21fschecks_time10:31:151
169940,0watchdog/10-21swapper/108:36:241
169940,0watchdog/10-21swapper/107:41:201
169940,0watchdog/10-21swapper/107:31:161
169940,0watchdog/10-21swapper/106:51:161
149940,0migration/07467-21sh11:09:210
149940,0migration/030337-21kthreadcore07:26:190
149940,0migration/014830-21timerwakeupswit10:51:260
52199932,0cyclictest3514-21snmpd08:06:142
52189933,0cyclictest3556-21lldpd07:48:501
52189932,0cyclictest3514-21snmpd07:29:141
52189932,0cyclictest3158-21kthreadcore10:26:191
52189930,0cyclictest12343-21perl08:51:171
52179933,0cyclictest19430-21kworker/0:009:51:070
52179933,0cyclictest19430-21kworker/0:009:46:110
52179933,0cyclictest19430-21kworker/0:009:41:030
52179933,0cyclictest19430-21kworker/0:009:11:230
52179933,0cyclictest19430-21kworker/0:008:31:030
52179933,0cyclictest19430-21kworker/0:008:01:050
52179933,0cyclictest19430-21kworker/0:007:41:050
52179933,0cyclictest19430-21kworker/0:007:21:030
52179933,0cyclictest16447-21kworker/0:112:06:160
52179933,0cyclictest16447-21kworker/0:111:31:140
52179933,0cyclictest16447-21kworker/0:111:26:420
339930,0migration/38332-21munin-node07:36:173
339930,0migration/321267-21kthreadcore08:31:203
29715030,0irq/26-eth0-rx-0-21swapper/308:23:593
29715030,0irq/26-eth0-rx-0-21swapper/308:16:133
29715030,0irq/26-eth0-rx-0-21swapper/308:11:143
29715030,0irq/26-eth0-rx-0-21swapper/307:56:133
29715030,0irq/26-eth0-rx-0-21swapper/307:46:223
29715030,0irq/26-eth0-rx-0-21swapper/306:47:123
249930,0watchdog/20-21swapper/208:31:202
179930,0migration/116729-21needreboot09:31:201
169930,0watchdog/119785-21aten_r1power_cu09:16:121
169930,0watchdog/10-21swapper/109:30:081
29715020,0irq/26-eth0-rx-0-21swapper/307:26:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional