You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 19:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 19, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/306:44:243
1396423622,0sleep00-21swapper/006:46:460
1411123525,0sleep20-21swapper/206:48:282
1414023223,0sleep10-21swapper/106:48:511
142659988,0cyclictest533-21kworker/0:108:29:410
339960,0migration/332652-21missed_timers10:34:403
339960,0migration/32447-21munin-node08:59:423
339960,0migration/32447-21munin-node08:59:423
339960,0migration/322496-21sh11:46:243
339960,0migration/322044-21sh09:14:333
339960,0migration/320214-21sh11:07:053
339960,0migration/319697-21sh10:48:543
339960,0migration/314190-21sh09:45:123
29715060,0irq/26-eth0-rx-27509-21ssh10:52:293
29715060,0irq/26-eth0-rx-20322-21mdstat09:29:383
29715060,0irq/26-eth0-rx-14619-21users11:59:443
29715060,0irq/26-eth0-rx-14229-21sort09:09:353
142669960,0cyclictest0-21swapper/110:54:441
149960,0migration/07614-21pmu-power07:04:420
149960,0migration/06502-21taskset09:41:560
149960,0migration/023776-21sh10:10:010
149960,0migration/022711-21sh09:50:290
149960,0migration/012823-21taskset09:08:050
149960,0migration/01142-21sh10:35:120
8215050,0irq/24-0000:00:25628-21munin-run10:14:212
8215050,0irq/24-0000:00:14446-21cat06:49:222
4150,0ktimersoftd/00-21swapper/011:43:270
339950,0migration/39752-21aten_r1power_en07:34:343
339950,0migration/37253-21kernelversion11:19:373
339950,0migration/3430-21munin-node08:39:383
339950,0migration/33844-21kthreadcore07:04:383
339950,0migration/33754-21munin-node08:14:413
339950,0migration/33048-21kthreadcore12:14:373
339950,0migration/32911-21kthreadcore09:59:383
339950,0migration/329011-21diskmemload10:54:333
339950,0migration/327922-21kthreadcore11:49:383
339950,0migration/327813-21kthreadcore12:09:393
339950,0migration/326364-21kthreadcore09:34:393
339950,0migration/325403-21hddtemp_smartct09:54:333
339950,0migration/324958-21taskset08:34:283
339950,0migration/324854-21kthreadcore08:54:403
339950,0migration/323535-21hwlatdetect11:29:363
339950,0migration/31695-21munin-node07:24:423
339950,0migration/315681-21taskset10:05:463
339950,0migration/315616-21kthreadcore07:59:393
339950,0migration/315296-21kthreadcore10:24:393
339950,0migration/314581-21cpu11:24:333
339950,0migration/310651-21munin-node08:19:453
29725050,0irq/27-eth0-tx-8371-21ssh12:16:542
29725050,0irq/27-eth0-tx-5737-21ssh11:54:422
29725050,0irq/27-eth0-tx-4939-21munin-node08:19:350
29725050,0irq/27-eth0-tx-4679-21munin-node10:59:442
29725050,0irq/27-eth0-tx-3504-21ssh10:57:202
29725050,0irq/27-eth0-tx-29813-21ssh09:35:342
29725050,0irq/27-eth0-tx-24966-21munin-node08:34:490
29725050,0irq/27-eth0-tx-18384-21ssh10:45:472
29725050,0irq/27-eth0-tx-1527-21kthreadcore11:14:372
29725050,0irq/27-eth0-tx-15213-21if_err_eth111:24:352
29725050,0irq/27-eth0-tx-0-21swapper/211:39:422
29725050,0irq/27-eth0-tx-0-21swapper/211:37:262
29725050,0irq/27-eth0-tx-0-21swapper/210:53:452
29725050,0irq/27-eth0-tx-0-21swapper/210:33:202
29725050,0irq/27-eth0-tx-0-21swapper/209:53:002
29725050,0irq/27-eth0-tx-0-21swapper/209:41:062
29725050,0irq/27-eth0-tx-0-21swapper/008:11:070
29725050,0irq/27-eth0-tx-0-21swapper/007:30:590
29715050,0irq/26-eth0-rx-3557-21unixbench_singl11:14:433
29715050,0irq/26-eth0-rx-32255-21ssh10:15:153
29715050,0irq/26-eth0-rx-3132-21kthreadcore09:39:393
29715050,0irq/26-eth0-rx-29868-21cpuspeed_turbos07:49:343
29715050,0irq/26-eth0-rx-18836-21kthreadcore10:09:393
29715050,0irq/26-eth0-rx-18811-21taskset10:29:313
29715050,0irq/26-eth0-rx-0-21swapper/312:04:433
29715050,0irq/26-eth0-rx-0-21swapper/311:59:183
29715050,0irq/26-eth0-rx-0-21swapper/311:43:203
29715050,0irq/26-eth0-rx-0-21swapper/311:09:353
29715050,0irq/26-eth0-rx-0-21swapper/310:59:293
29715050,0irq/26-eth0-rx-0-21swapper/310:19:393
29715050,0irq/26-eth0-rx-0-21swapper/309:49:383
29715050,0irq/26-eth0-rx-0-21swapper/309:19:443
29715050,0irq/26-eth0-rx-0-21swapper/308:51:113
259950,0migration/28861-21latency_hist10:04:212
259950,0migration/25909-21kthreadcore10:39:362
259950,0migration/228738-21munin-node07:44:462
259950,0migration/222111-21sh09:14:342
259950,0migration/218049-21gltestperf08:04:372
259950,0migration/214121-21kthreadcore10:24:392
259950,0migration/213622-21sh09:09:252
249950,0watchdog/226262-21cut11:09:392
249950,0watchdog/223264-21fschecks_count11:29:352
249950,0watchdog/216812-21ssh10:08:272
249950,0watchdog/213892-21ssh11:23:592
179950,0migration/121864-21irqcore08:54:381
179950,0migration/115573-21latency_hist11:44:211
179950,0migration/115534-21aten2.4-expect07:14:331
179950,0migration/115299-21munin-node09:29:321
169950,0watchdog/16074-21mdstat09:59:391
169950,0watchdog/13550-21expr10:39:311
169950,0watchdog/129207-21tune2fs07:24:361
169950,0watchdog/128400-21ssh09:15:121
169950,0watchdog/10-21swapper/108:04:401
142659955,0cyclictest0-21swapper/010:44:380
149950,0migration/05041-21kthreadcore09:59:390
149950,0migration/04304-21kthreadcore10:19:380
149950,0migration/031861-21munin-node10:14:440
149950,0migration/031191-21sh11:52:050
149950,0migration/030751-21sh11:34:100
149950,0migration/030401-21taskset09:19:260
149950,0migration/027786-21taskset10:53:090
149950,0migration/025427-21kthreadcore09:34:380
149950,0migration/024772-21kthreadcore08:54:400
149950,0migration/024407-21kthreadcore07:44:400
149950,0migration/022995-21kthreadcore11:09:380
149950,0migration/022649-21fschecks_time09:14:370
149950,0migration/020263-21runrttasks11:07:120
149950,0migration/019319-21fschecks_count10:29:340
149950,0migration/018790-21kthreadcore09:29:370
149950,0migration/018700-21kthreadcore12:04:380
149950,0migration/018675-21kthreadcore07:39:380
149950,0migration/018457-21kthreadcore09:09:390
149950,0migration/017098-21kthreadcore06:49:390
149950,0migration/01541-21kthreadcore08:14:380
149950,0migration/013376-21kthreadcore10:24:390
149950,0migration/011670-21kthreadcore10:04:390
149950,0migration/010314-21kthreadcore09:44:370
4140,0ktimersoftd/00-21swapper/011:17:450
339940,0migration/36392-21latency_hist09:24:223
339940,0migration/34734-21kthreadcore10:39:363
339940,0migration/325799-21kthreadcore06:54:403
339940,0migration/323729-21taskset08:09:033
339940,0migration/313521-21kthreadcore08:24:393
29725040,0irq/27-eth0-tx-31155-21grep09:19:342
29725040,0irq/27-eth0-tx-29221-21kthreadcore11:49:382
29725040,0irq/27-eth0-tx-21151-21tail06:54:340
29725040,0irq/27-eth0-tx-1893-21aten_r1power_cu10:19:322
29725040,0irq/27-eth0-tx-13068-21ssh11:04:302
29725040,0irq/27-eth0-tx-0-21swapper/212:10:072
29725040,0irq/27-eth0-tx-0-21swapper/211:59:322
29725040,0irq/27-eth0-tx-0-21swapper/211:44:222
29725040,0irq/27-eth0-tx-0-21swapper/210:14:302
29725040,0irq/27-eth0-tx-0-21swapper/209:30:062
29725040,0irq/27-eth0-tx-0-21swapper/209:24:592
29725040,0irq/27-eth0-tx-0-21swapper/209:04:372
29725040,0irq/27-eth0-tx-0-21swapper/209:01:112
29725040,0irq/27-eth0-tx-0-21swapper/209:01:112
29725040,0irq/27-eth0-tx-0-21swapper/208:55:242
29725040,0irq/27-eth0-tx-0-21swapper/008:44:570
29725040,0irq/27-eth0-tx-0-21swapper/008:24:340
29725040,0irq/27-eth0-tx-0-21swapper/007:37:420
29725040,0irq/27-eth0-tx-0-21swapper/007:19:340
29725040,0irq/27-eth0-tx-0-21swapper/007:14:340
29715040,0irq/26-eth0-rx-0-21swapper/311:34:423
29715040,0irq/26-eth0-rx-0-21swapper/309:05:593
29715040,0irq/26-eth0-rx-0-21swapper/308:48:303
29715040,0irq/26-eth0-rx-0-21swapper/308:09:343
29715040,0irq/26-eth0-rx-0-21swapper/307:30:593
259940,0migration/27749-21kthreadcore08:19:392
259940,0migration/27456-21kthreadcore08:44:382
259940,0migration/231704-21kthreadcore10:34:392
259940,0migration/225708-21irqcore09:54:362
259940,0migration/221159-21kthreadcore08:29:372
259940,0migration/213980-21kthreadcore08:24:392
249940,0watchdog/26559-21runrttasks08:03:522
249940,0watchdog/26559-21runrttasks07:08:442
249940,0watchdog/230909-21kthreadcore06:59:402
249940,0watchdog/228357-21tr08:09:402
249940,0watchdog/223301-21ssh12:05:232
249940,0watchdog/214308-21ssh09:45:272
249940,0watchdog/20-21swapper/208:34:442
249940,0watchdog/20-21swapper/207:24:362
249940,0watchdog/20-21swapper/207:19:402
249940,0watchdog/20-21swapper/207:09:362
249940,0watchdog/20-21swapper/206:54:362
19140,0ktimersoftd/10-21swapper/109:26:451
179940,0migration/17505-21kthreadcore09:04:391
179940,0migration/14902-21sendmail_mailqu08:39:421
179940,0migration/132601-21aten_r1power_vo11:54:331
179940,0migration/132285-21fschecks_time09:39:351
179940,0migration/13086-21sh07:29:341
179940,0migration/130227-21fschecks_time07:49:351
179940,0migration/127961-21kthreadcore12:09:391
179940,0migration/126636-21gltestperf10:14:341
179940,0migration/124385-21df_abs11:49:331
179940,0migration/122425-21kthreadcore10:09:401
179940,0migration/122087-21timerandwakeup07:39:441
179940,0migration/120883-21kthreadcore08:29:371
179940,0migration/119303-21kthreadcore06:49:401
179940,0migration/119182-21munin-node09:09:411
179940,0migration/112783-21ntp_kernel_err11:39:401
179940,0migration/11238-21munin-node12:14:311
179940,0migration/111687-21sh11:19:411
179940,0migration/110358-21kthreadcore09:44:371
169940,0watchdog/19129-21grep07:09:361
169940,0watchdog/12686-21ssh10:19:351
169940,0watchdog/126263-21tr11:09:391
169940,0watchdog/114981-21kthreadcore10:24:391
169940,0watchdog/114239-21tr10:04:391
169940,0watchdog/10-21swapper/111:34:271
169940,0watchdog/10-21swapper/107:44:401
169940,0watchdog/10-21swapper/107:19:401
142679943,0cyclictest3556-21lldpd07:50:112
142679943,0cyclictest3241-21irqbalance08:49:402
142679943,0cyclictest31512-21awk08:14:362
142679943,0cyclictest16292-21awk07:14:372
142679943,0cyclictest10643-21awk07:34:382
142669944,0cyclictest12411-21diskmemload11:16:101
142669943,0cyclictest6812-21awk08:44:361
142669943,0cyclictest5777-21awk08:19:371
142669943,0cyclictest3556-21lldpd12:04:131
142669943,0cyclictest3556-21lldpd08:16:121
142669943,0cyclictest3556-21lldpd08:11:111
142669943,0cyclictest3514-21snmpd10:49:251
142669943,0cyclictest3514-21snmpd09:36:251
142669943,0cyclictest28206-21awk10:34:371
142669943,0cyclictest25578-21awk09:54:351
142669943,0cyclictest23620-21awk11:29:371
142669943,0cyclictest17770-21awk12:04:361
142669943,0cyclictest17299-21irqcore09:49:371
142669943,0cyclictest15284-21awk11:24:361
142669943,0cyclictest13512-21awk08:49:351
142669943,0cyclictest10436-21sadc07:59:221
142659944,0cyclictest0-21swapper/008:50:110
142659943,0cyclictest4865-21awk07:54:350
142659943,0cyclictest3514-21snmpd10:58:250
142659943,0cyclictest3514-21snmpd08:07:090
142659943,0cyclictest3241-21irqbalance11:54:390
142659943,0cyclictest16625-21awk11:44:360
142659943,0cyclictest15306-21kworker/0:212:09:300
142659943,0cyclictest11504-21awk07:59:360
142659940,0cyclictest0-21swapper/009:55:360
149940,0migration/09103-21kthreadcore11:19:380
149940,0migration/07145-21kthreadcore10:59:400
149940,0migration/0549-21kthreadcore07:24:400
149940,0migration/014609-21cpuspeed_turbos11:24:330
149940,0migration/010886-21kthreadcore07:09:400
8487230,0sleep00-21swapper/011:59:310
339930,0migration/320663-21runrttasks06:51:513
29725030,0irq/27-eth0-tx-0-21swapper/008:39:330
29715030,0irq/26-eth0-rx-0-21swapper/308:29:373
29715030,0irq/26-eth0-rx-0-21swapper/307:56:023
29715030,0irq/26-eth0-rx-0-21swapper/307:46:383
29715030,0irq/26-eth0-rx-0-21swapper/307:19:343
29715030,0irq/26-eth0-rx-0-21swapper/307:10:213
27130,0ktimersoftd/20-21swapper/208:41:402
179930,0migration/115651-21kthreadcore11:04:391
169930,0watchdog/10-21swapper/110:59:231
169930,0watchdog/10-21swapper/110:45:311
169930,0watchdog/10-21swapper/110:29:431
169930,0watchdog/10-21swapper/108:34:441
169930,0watchdog/10-21swapper/107:34:361
169930,0watchdog/10-21swapper/106:59:401
169930,0watchdog/10-21swapper/106:54:361
142679933,0cyclictest0-21swapper/207:54:312
142679932,0cyclictest8683-21sensors07:29:432
142679932,0cyclictest17305-21awk07:39:372
142669932,0cyclictest3556-21lldpd08:03:111
142669932,0cyclictest32599-21kthreadcore08:59:381
142669932,0cyclictest32599-21kthreadcore08:59:381
142669932,0cyclictest31309-21awk09:19:351
142669932,0cyclictest2938-21awk07:04:371
142669932,0cyclictest17310-21sensors08:24:431
142659933,0cyclictest533-21kworker/0:110:39:320
142659933,0cyclictest533-21kworker/0:109:24:370
142659933,0cyclictest533-21kworker/0:108:59:330
142659933,0cyclictest533-21kworker/0:108:59:330
142659933,0cyclictest533-21kworker/0:106:59:250
142659933,0cyclictest15306-21kworker/0:212:14:280
142659932,0cyclictest31465-21cat07:49:380
142659930,0cyclictest31810-21perl11:34:340
35120,0ktimersoftd/319786-21kthreadcore07:14:393
339920,0migration/317351-21iostat_ios07:39:373
29715020,0irq/26-eth0-rx-0-21swapper/306:59:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional