You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 23:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 10, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450670,0irq/25-eth10-21swapper/306:45:203
183725251,0sleep00-21swapper/006:45:320
527723424,0sleep20-21swapper/206:46:142
555323223,0sleep10-21swapper/106:49:291
56919976,0cyclictest13598-21sshd07:40:370
56939960,0cyclictest0-21swapper/208:57:372
56919960,0cyclictest3862-21diskmemload11:23:230
56919960,0cyclictest0-21swapper/011:40:340
339960,0migration/326106-21sh11:20:333
339960,0migration/320511-21sh10:00:063
339960,0migration/319472-21taskset12:00:033
339960,0migration/318438-21sh08:56:053
339960,0migration/312073-21sh09:13:543
339960,0migration/311765-21sh10:13:363
56939955,0cyclictest0-21swapper/212:11:412
56939955,0cyclictest0-21swapper/211:33:422
56939954,0cyclictest3514-21snmpd10:30:222
56939950,0cyclictest0-21swapper/210:40:052
56939950,0cyclictest0-21swapper/210:40:052
56939950,0cyclictest0-21swapper/209:03:462
56929955,0cyclictest0-21swapper/112:05:331
56929950,0cyclictest0-21swapper/109:52:391
56919955,0cyclictest3862-21diskmemload09:28:460
56919955,0cyclictest0-21swapper/011:45:180
56919955,0cyclictest0-21swapper/011:38:120
56919955,0cyclictest0-21swapper/011:13:560
56919955,0cyclictest0-21swapper/010:07:430
56919955,0cyclictest0-21swapper/009:59:400
56919955,0cyclictest0-21swapper/009:41:320
56919955,0cyclictest0-21swapper/009:20:150
56919950,0cyclictest0-21swapper/011:30:480
56919950,0cyclictest0-21swapper/009:31:360
56919950,0cyclictest0-21swapper/009:10:380
56919950,0cyclictest0-21swapper/008:05:410
339950,0migration/39214-21kthreadcore07:15:303
339950,0migration/37760-21kthreadcore09:50:303
339950,0migration/37177-21kthreadcore10:30:303
339950,0migration/34371-21idleruntime12:10:253
339950,0migration/33619-21taskset10:08:253
339950,0migration/33003-21munin-node08:45:353
339950,0migration/329832-21irqrtprio09:05:313
339950,0migration/329811-21kthreadcore11:25:293
339950,0migration/328891-21aten_r1power_po10:25:243
339950,0migration/328509-21sh10:05:023
339950,0migration/326499-21taskset07:28:263
339950,0migration/32464-21sh11:47:373
339950,0migration/322204-21kthreadcore11:00:283
339950,0migration/321856-21idleruntime09:20:273
339950,0migration/320900-21cpu10:20:243
339950,0migration/319350-21runrttasks11:38:593
339950,0migration/319294-21kthreadcore07:45:323
339950,0migration/317082-21kthreadcore08:10:323
339950,0migration/316016-21kthreadcore07:20:313
339950,0migration/314304-21kthreadcore09:35:293
339950,0migration/312820-21kthreadcore08:05:333
339950,0migration/312742-21aten_r1power_vo10:35:263
339950,0migration/312742-21aten_r1power_vo10:35:263
339950,0migration/311112-21taskset09:30:543
29725050,0irq/27-eth0-tx-18995-21users09:35:372
29725050,0irq/27-eth0-tx-18556-21ssh11:36:412
29715050,0irq/26-eth0-rx-9413-21port_sshpriv11:50:323
29715050,0irq/26-eth0-rx-639-21taskset07:33:033
29715050,0irq/26-eth0-rx-4734-21grep11:10:253
29715050,0irq/26-eth0-rx-3801-21sshd09:48:373
29715050,0irq/26-eth0-rx-3269-21latency_hist12:10:123
29715050,0irq/26-eth0-rx-320422sleep307:06:513
29715050,0irq/26-eth0-rx-30141-21kthreadcore11:05:283
29715050,0irq/26-eth0-rx-26528-21pmu-power09:40:323
29715050,0irq/26-eth0-rx-23166-21basename08:40:253
29715050,0irq/26-eth0-rx-19627-21ssh09:17:093
29715050,0irq/26-eth0-rx-0-21swapper/311:18:493
29715050,0irq/26-eth0-rx-0-21swapper/310:55:473
29715050,0irq/26-eth0-rx-0-21swapper/310:54:133
29715050,0irq/26-eth0-rx-0-21swapper/310:45:223
29715050,0irq/26-eth0-rx-0-21swapper/309:05:043
29715050,0irq/26-eth0-rx-0-21swapper/308:51:313
29715050,0irq/26-eth0-rx-0-21swapper/308:30:253
29715050,0irq/26-eth0-rx-0-21swapper/307:55:313
29715050,0irq/26-eth0-rx-0-21swapper/307:35:323
259950,0migration/228894-21df_abs11:05:242
249950,0watchdog/25570-21head09:30:272
249950,0watchdog/215436-21sensors08:30:352
249950,0watchdog/211945-21sh09:53:432
179950,0migration/14724-21aten_r1power_vo09:10:241
179950,0migration/14421-21sh10:30:171
179950,0migration/13462-21latency_hist11:50:121
179950,0migration/127995-21taskset11:24:471
179950,0migration/125772-21pmu-power07:25:361
179950,0migration/120579-21idleruntime-cro10:00:131
179950,0migration/120402-21aten_r1power_cu09:00:241
179950,0migration/120246-21munin-node07:00:291
179950,0migration/113979-21kthreadcore10:55:301
179950,0migration/111747-21timerandwakeup06:50:371
179950,0migration/110017-21missed_timers10:10:311
169950,0watchdog/116306-21cut06:55:321
169950,0watchdog/112360-21cut11:15:231
149950,0migration/09743-21timerwakeupswit11:50:340
149950,0migration/08055-21kthreadcore08:50:310
149950,0migration/031884-21kthreadcore10:25:300
149950,0migration/027878-21taskset09:03:580
149950,0migration/024813-21kthreadcore07:25:330
149950,0migration/021615-21irqcore11:00:280
149950,0migration/01786-21munin-node08:20:340
149950,0migration/013424-21idleruntime10:35:290
149950,0migration/013424-21idleruntime10:35:290
149950,0migration/011813-21sh09:53:220
56939944,0cyclictest0-21swapper/208:00:132
56939943,0cyclictest5452-21awk09:10:272
56939943,0cyclictest4602-21awk11:50:262
56939943,0cyclictest3556-21lldpd11:22:092
56939943,0cyclictest3556-21lldpd08:29:052
56939943,0cyclictest3514-21snmpd08:21:222
56939943,0cyclictest3514-21snmpd08:19:522
56939943,0cyclictest3514-21snmpd07:54:522
56939943,0cyclictest3514-21snmpd07:42:372
56939943,0cyclictest3514-21snmpd06:51:072
56939943,0cyclictest3241-21irqbalance12:05:312
56939943,0cyclictest3241-21irqbalance10:56:112
56939943,0cyclictest3241-21irqbalance08:40:222
56939943,0cyclictest3241-21irqbalance07:28:222
56939943,0cyclictest3241-21irqbalance07:15:222
56939943,0cyclictest3241-21irqbalance07:10:222
56939943,0cyclictest29801-21awk10:05:272
56939943,0cyclictest29666-21awk10:25:272
56939943,0cyclictest29101-21munin-node09:25:242
56939943,0cyclictest27748-21awk07:30:282
56939943,0cyclictest2289-21grep07:35:302
56939943,0cyclictest20174-21awk07:00:282
56939943,0cyclictest16407-21awk08:10:302
56939943,0cyclictest13482-21awk06:55:292
56929944,0cyclictest0-21swapper/112:17:511
56929944,0cyclictest0-21swapper/110:18:491
56929943,0cyclictest3764-21sadc11:30:121
56929943,0cyclictest3556-21lldpd07:40:331
56929943,0cyclictest3556-21lldpd07:32:331
56929943,0cyclictest3514-21snmpd10:05:371
56929943,0cyclictest3514-21snmpd09:22:371
56929943,0cyclictest3514-21snmpd09:05:221
56929943,0cyclictest29631-21awk10:45:271
56929943,0cyclictest23006-21awk08:15:291
56929943,0cyclictest22129-21awk07:50:311
56929943,0cyclictest21867-21awk09:40:261
56929943,0cyclictest21681-21awk10:20:271
56929943,0cyclictest1013-21awk07:10:301
56929940,0cyclictest0-21swapper/112:11:511
56929940,0cyclictest0-21swapper/110:37:061
56929940,0cyclictest0-21swapper/110:37:061
56919943,0cyclictest5185-21awk10:50:270
56919943,0cyclictest3556-21lldpd09:48:360
56919943,0cyclictest3514-21snmpd11:25:220
56919943,0cyclictest3514-21snmpd10:58:070
56919943,0cyclictest3514-21snmpd10:45:370
56919943,0cyclictest3514-21snmpd08:31:070
56919943,0cyclictest3514-21snmpd07:15:220
56919943,0cyclictest3241-21irqbalance12:00:310
56919943,0cyclictest3241-21irqbalance11:55:310
56919943,0cyclictest3241-21irqbalance10:22:010
56919943,0cyclictest3241-21irqbalance10:15:410
56919943,0cyclictest3241-21irqbalance07:56:020
56919943,0cyclictest29435-21awk11:05:270
56919943,0cyclictest23993-21awk08:40:290
56919943,0cyclictest21765-21awk10:00:280
56919943,0cyclictest16344-21awk08:10:300
56919943,0cyclictest13862-21awk09:15:290
56919943,0cyclictest12498-21awk12:15:260
56919941,0cyclictest3247-21munin-run12:10:120
56919940,0cyclictest13570-21munin-node07:20:310
339940,0migration/38632-21pmu-power08:25:353
339940,0migration/37818-21kthreadcore06:50:303
339940,0migration/328324-21runrttasks08:17:433
339940,0migration/317574-21kthreadcore10:15:293
29725040,0irq/27-eth0-tx-28656-21munin-node10:45:262
29725040,0irq/27-eth0-tx-28485-21ssh11:25:222
29725040,0irq/27-eth0-tx-28084-21munin-node11:45:362
29725040,0irq/27-eth0-tx-2689-21ssh09:06:212
29725040,0irq/27-eth0-tx-25325-21ssh10:00:302
29725040,0irq/27-eth0-tx-20916-21munin-node09:40:232
29725040,0irq/27-eth0-tx-13598-21kthreadcore11:55:292
29725040,0irq/27-eth0-tx-0-21swapper/211:40:322
29725040,0irq/27-eth0-tx-0-21swapper/211:11:102
29725040,0irq/27-eth0-tx-0-21swapper/211:00:292
29725040,0irq/27-eth0-tx-0-21swapper/210:50:472
29725040,0irq/27-eth0-tx-0-21swapper/209:55:482
29725040,0irq/27-eth0-tx-0-21swapper/209:45:252
29725040,0irq/27-eth0-tx-0-21swapper/209:21:202
29725040,0irq/27-eth0-tx-0-21swapper/008:15:240
29725040,0irq/27-eth0-tx-0-21swapper/007:50:300
29725040,0irq/27-eth0-tx-0-21swapper/007:45:310
29725040,0irq/27-eth0-tx-0-21swapper/007:05:310
29715040,0irq/26-eth0-rx-0-21swapper/312:17:033
29715040,0irq/26-eth0-rx-0-21swapper/312:04:523
29715040,0irq/26-eth0-rx-0-21swapper/311:40:143
29715040,0irq/26-eth0-rx-0-21swapper/311:30:153
29715040,0irq/26-eth0-rx-0-21swapper/310:40:233
29715040,0irq/26-eth0-rx-0-21swapper/309:25:403
29715040,0irq/26-eth0-rx-0-21swapper/307:10:383
29715040,0irq/26-eth0-rx-0-21swapper/307:00:253
259940,0migration/24451-21latency_hist10:10:132
259940,0migration/227208-21kernelversion07:05:322
259940,0migration/225439-21kthreadcore10:20:302
259940,0migration/222330-21kthreadcore12:00:282
259940,0migration/216392-21latency_hist08:35:132
259940,0migration/215900-21kthreadcore07:45:312
259940,0migration/214013-21fschecks_count07:20:272
259940,0migration/213703-21irqcore10:15:282
259940,0migration/212950-21aten_r1power_en09:15:252
259940,0migration/21270-21kthreadcore08:45:312
249940,0watchdog/221776-21irqrtprio10:40:272
249940,0watchdog/212359-21basename11:15:232
249940,0watchdog/20-21swapper/212:16:152
249940,0watchdog/20-21swapper/208:50:312
249940,0watchdog/20-21swapper/207:55:322
179940,0migration/18740-21rt-features08:25:351
179940,0migration/15814-21kthreadcore10:50:291
179940,0migration/15807-21kthreadcore11:50:281
179940,0migration/15151-21irqcore08:50:301
179940,0migration/14844-21fschecks_time11:10:251
179940,0migration/14467-21kthreadcore07:35:321
179940,0migration/129771-21fschecks_time09:25:251
179940,0migration/129147-21kthreadcore07:55:311
179940,0migration/128750-21cpuspeed_turbos11:05:241
179940,0migration/128557-21ntp_offset08:40:341
179940,0migration/128370-21kthreadcore07:05:331
179940,0migration/12826-21taskset10:26:331
179940,0migration/127417-21sh10:42:291
179940,0migration/127185-21taskset11:02:141
179940,0migration/12395-21switchtime09:45:351
179940,0migration/120285-21fschecks_count12:00:241
179940,0migration/118850-21kthreadcore08:10:331
179940,0migration/116031-21taskset08:33:251
179940,0migration/112757-21fschecks_time11:35:261
169940,0watchdog/19583-21netstat11:30:311
169940,0watchdog/13862-21diskmemload11:57:511
169940,0watchdog/121720-21if_err_eth1.210:00:271
169940,0watchdog/119038-21grep08:35:311
169940,0watchdog/11194-21kthreadcore08:20:311
169940,0watchdog/10-21swapper/109:30:271
169940,0watchdog/10-21swapper/109:15:191
169940,0watchdog/10-21swapper/108:55:271
149940,0migration/06669-21kthreadcore10:10:290
149940,0migration/06490-21kthreadcore12:10:280
149940,0migration/04663-21kthreadcore08:25:310
149940,0migration/030014-21cpuspeed_turbos08:45:250
149940,0migration/023943-21kthreadcore07:00:310
149940,0migration/019944-21sh11:19:510
149940,0migration/019081-21kthreadcore08:35:310
149940,0migration/018501-21sh08:56:160
149940,0migration/01786-21ntp_kernel_pll_09:05:350
149940,0migration/012327-21idleruntime-cro10:35:130
56929932,0cyclictest20966-21awk11:40:261
56929932,0cyclictest15387-21awk07:45:291
56929932,0cyclictest14483-21sensors08:05:381
56919932,0cyclictest6916-21awk06:50:290
56919932,0cyclictest4584-21kthreadcore08:00:310
56919932,0cyclictest21570-21awk10:40:260
56919932,0cyclictest13746-21awk09:35:270
56919932,0cyclictest13497-21awk06:55:290
56919932,0cyclictest1067-21awk07:10:300
56919930,0cyclictest27052-21telnet07:30:250
29725030,0irq/27-eth0-tx-0-21swapper/007:35:260
29715030,0irq/26-eth0-rx-0-21swapper/308:35:253
29715030,0irq/26-eth0-rx-0-21swapper/307:40:243
249930,0watchdog/20-21swapper/208:05:362
169930,0watchdog/17737-21if_err_eth007:15:281
169930,0watchdog/10-21swapper/109:35:271
169930,0watchdog/10-21swapper/108:45:311
169930,0watchdog/10-21swapper/108:00:281
56929920,0cyclictest0-21swapper/107:20:131
29715020,0irq/26-eth0-rx-0-21swapper/308:20:293
29715020,0irq/26-eth0-rx-0-21swapper/308:00:323
29715020,0irq/26-eth0-rx-0-21swapper/307:50:263
29715020,0irq/26-eth0-rx-0-21swapper/306:55:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional