You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 23:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jun 07, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:48:533
1974523222,0sleep20-21swapper/206:53:222
1952423228,0sleep10-21swapper/106:50:531
1956222925,0sleep00-21swapper/006:51:160
339970,0migration/310332-21sh09:08:243
8215060,0irq/24-0000:00:18255-21perf09:13:222
339960,0migration/31821-21turbostat09:03:223
339960,0migration/317230-21sh11:10:553
339960,0migration/316532-21sh10:30:333
339960,0migration/31256-21timerandwakeup12:18:443
339960,0migration/310840-21sh12:07:253
29725060,0irq/27-eth0-tx-20980-21munin-node07:18:370
29715060,0irq/26-eth0-rx-9687-21irqcore07:33:383
29715060,0irq/26-eth0-rx-7725-21ntp_states11:03:423
29715060,0irq/26-eth0-rx-28447-21if_eth1.311:58:373
198149960,0cyclictest0-21swapper/112:01:591
198149960,0cyclictest0-21swapper/111:41:481
198139960,0cyclictest0-21swapper/009:46:010
8215050,0irq/24-0000:00:2583-21perf07:53:232
339950,0migration/38921-21taskset10:26:393
339950,0migration/38889-21diskmemload09:45:243
339950,0migration/38244-21taskset07:31:503
339950,0migration/37404-21kthreadcore11:43:403
339950,0migration/37137-21taskset07:04:453
339950,0migration/3367-21taskset10:40:543
339950,0migration/33380-21taskset08:15:573
339950,0migration/327673-21munin-node11:18:373
339950,0migration/327579-21fschecks_time11:38:353
339950,0migration/326748-21cpuspeed_turbos09:38:343
339950,0migration/326259-21taskset12:15:033
339950,0migration/326082-21latency_hist09:58:223
339950,0migration/325156-21taskset11:15:083
339950,0migration/324400-21taskset10:14:213
339950,0migration/322979-21aten_r1power_fr08:08:333
339950,0migration/322246-21munin-node07:18:393
339950,0migration/318375-21cpu08:53:343
339950,0migration/316209-21munin-node07:38:383
339950,0migration/315781-21diskmemload10:08:443
339950,0migration/313518-21kthreadcore12:08:383
339950,0migration/313187-21kthreadcore08:48:393
339950,0migration/312701-21kthreadcore09:28:393
339950,0migration/310456-21kthreadcore07:08:393
29725050,0irq/27-eth0-tx-3023-21kthreadcore10:23:382
29725050,0irq/27-eth0-tx-24892-21ssh10:55:342
29725050,0irq/27-eth0-tx-18208-21munin-node08:53:430
29725050,0irq/27-eth0-tx-18049-21taskset11:32:002
29725050,0irq/27-eth0-tx-1527-21chrt09:42:432
29725050,0irq/27-eth0-tx-0-21swapper/212:18:422
29725050,0irq/27-eth0-tx-0-21swapper/210:37:292
29725050,0irq/27-eth0-tx-0-21swapper/209:32:502
29725050,0irq/27-eth0-tx-0-21swapper/209:02:162
29725050,0irq/27-eth0-tx-0-21swapper/008:28:430
29715050,0irq/26-eth0-rx-8316-21unixbench_singl09:03:443
29715050,0irq/26-eth0-rx-32322-21unixbench_multi09:58:453
29715050,0irq/26-eth0-rx-3137-21if_err_eth009:23:363
29715050,0irq/26-eth0-rx-26355-21ssh11:56:073
29715050,0irq/26-eth0-rx-23579-21grep06:53:403
29715050,0irq/26-eth0-rx-22533-21kthreadcore09:13:393
29715050,0irq/26-eth0-rx-14749-21kthreadcore11:48:403
29715050,0irq/26-eth0-rx-0-21swapper/311:33:263
29715050,0irq/26-eth0-rx-0-21swapper/311:23:333
29715050,0irq/26-eth0-rx-0-21swapper/310:58:403
29715050,0irq/26-eth0-rx-0-21swapper/310:56:243
29715050,0irq/26-eth0-rx-0-21swapper/310:43:373
29715050,0irq/26-eth0-rx-0-21swapper/310:35:183
29715050,0irq/26-eth0-rx-0-21swapper/310:03:333
29715050,0irq/26-eth0-rx-0-21swapper/309:49:123
29715050,0irq/26-eth0-rx-0-21swapper/309:36:123
29715050,0irq/26-eth0-rx-0-21swapper/308:38:393
29715050,0irq/26-eth0-rx-0-21swapper/307:58:413
27150,0ktimersoftd/20-21swapper/211:40:002
27150,0ktimersoftd/20-21swapper/211:19:502
259950,0migration/24452-21kthreadcore09:43:382
259950,0migration/24025-21kthreadcore09:03:372
259950,0migration/230254-21kthreadcore06:58:412
259950,0migration/226276-21sh11:37:102
259950,0migration/226043-21sh12:14:302
259950,0migration/225060-21sh09:35:102
259950,0migration/224339-21munin-node09:53:442
259950,0migration/223590-21sh10:13:402
259950,0migration/217128-21unixbench-2d11:48:462
259950,0migration/216196-21unixbench-2d09:48:452
259950,0migration/214381-21aten_r1power_en07:13:332
259950,0migration/212153-21fschecks_time08:48:362
198149955,0cyclictest0-21swapper/112:10:491
198149955,0cyclictest0-21swapper/110:26:551
198149955,0cyclictest0-21swapper/110:05:091
198149950,0cyclictest0-21swapper/112:18:321
198149950,0cyclictest0-21swapper/112:04:111
198149950,0cyclictest0-21swapper/111:09:101
198149950,0cyclictest0-21swapper/110:23:171
198149950,0cyclictest0-21swapper/109:25:351
198149950,0cyclictest0-21swapper/109:10:361
198149950,0cyclictest0-21swapper/109:04:461
198139955,0cyclictest0-21swapper/010:26:320
198139955,0cyclictest0-21swapper/009:22:410
198139955,0cyclictest0-21swapper/009:15:450
198139954,0cyclictest1772-21ssh11:41:250
198139950,0cyclictest0-21swapper/011:21:150
198139950,0cyclictest0-21swapper/010:19:170
198139950,0cyclictest0-21swapper/009:57:130
198139950,0cyclictest0-21swapper/009:48:320
198139950,0cyclictest0-21swapper/009:09:550
198139950,0cyclictest0-21swapper/008:43:260
198139950,0cyclictest0-21swapper/008:27:020
198139950,0cyclictest0-21swapper/008:27:020
198139950,0cyclictest0-21swapper/007:57:050
19150,0ktimersoftd/117963-21diskmemload11:19:501
19150,0ktimersoftd/10-21swapper/109:29:131
179950,0migration/19746-21timerwakeupswit08:18:451
179950,0migration/1787-21sh09:00:551
179950,0migration/17289-21taskset07:06:311
179950,0migration/16537-21kthreadcore11:23:381
179950,0migration/14061-21kthreadcore09:43:381
179950,0migration/129915-21taskset08:34:091
179950,0migration/128354-21turbostat07:48:231
179950,0migration/126434-21aten_r1power_vo09:58:331
179950,0migration/122753-21kthreadcore12:13:391
179950,0migration/116483-21sh10:49:491
179950,0migration/115481-21kthreadcore08:23:401
179950,0migration/115481-21kthreadcore08:23:401
179950,0migration/113729-21kthreadcore09:48:391
179950,0migration/111288-21kthreadcore07:33:391
179950,0migration/111282-21kthreadcore07:58:401
149950,0migration/031848-21ntp_offset10:58:420
149950,0migration/031132-21kthreadcore09:58:390
149950,0migration/022790-21kthreadcore10:13:380
149950,0migration/010948-21latency_hist11:48:220
339940,0migration/319642-21kthreadcore08:28:393
339940,0migration/314593-21kthreadcore08:23:393
339940,0migration/314593-21kthreadcore08:23:393
339940,0migration/312792-21kthreadcore11:28:393
29725040,0irq/27-eth0-tx-8550-21ssh09:23:492
29725040,0irq/27-eth0-tx-702-21processes11:58:432
29725040,0irq/27-eth0-tx-6688-21kthreadcore11:03:402
29725040,0irq/27-eth0-tx-5310-21kthreadcore10:03:402
29725040,0irq/27-eth0-tx-3252-21munin-node12:03:402
29725040,0irq/27-eth0-tx-19798-21kthreadcore11:13:382
29725040,0irq/27-eth0-tx-1659-21munin-node10:43:442
29725040,0irq/27-eth0-tx-0-21swapper/211:53:262
29725040,0irq/27-eth0-tx-0-21swapper/211:43:332
29725040,0irq/27-eth0-tx-0-21swapper/211:08:352
29725040,0irq/27-eth0-tx-0-21swapper/210:48:352
29725040,0irq/27-eth0-tx-0-21swapper/209:58:262
29725040,0irq/27-eth0-tx-0-21swapper/209:13:222
29725040,0irq/27-eth0-tx-0-21swapper/208:54:072
29725040,0irq/27-eth0-tx-0-21swapper/007:03:330
29715040,0irq/26-eth0-rx-19895-21kthreadcore08:03:403
29715040,0irq/26-eth0-rx-0-21swapper/310:49:463
29715040,0irq/26-eth0-rx-0-21swapper/310:18:303
29715040,0irq/26-eth0-rx-0-21swapper/309:21:513
29715040,0irq/26-eth0-rx-0-21swapper/308:43:333
259940,0migration/28218-21fschecks_count07:08:352
259940,0migration/227043-21sh10:58:362
259940,0migration/226515-21kthreadcore07:43:412
259940,0migration/223511-21fschecks_time08:08:352
259940,0migration/216254-21aten_r1power_cu08:03:342
259940,0migration/211404-21latency_hist08:48:232
259940,0migration/210820-21runrttasks10:28:382
249940,0watchdog/225303-21load06:53:412
249940,0watchdog/22511-21aten_r1power_fr11:23:322
249940,0watchdog/212705-21cut07:58:412
249940,0watchdog/20-21swapper/210:08:362
249940,0watchdog/20-21swapper/209:18:412
249940,0watchdog/20-21swapper/208:23:372
249940,0watchdog/20-21swapper/208:23:372
198159944,0cyclictest0-21swapper/212:08:362
198159944,0cyclictest0-21swapper/210:18:242
198159943,0cyclictest3556-21lldpd10:38:302
198159943,0cyclictest3556-21lldpd08:32:292
198159943,0cyclictest3556-21lldpd08:15:292
198159943,0cyclictest31398-21awk08:38:372
198159943,0cyclictest27400-21sadc07:23:232
198159943,0cyclictest2736-21awk07:28:372
198159943,0cyclictest24818-21awk08:33:382
198159940,0cyclictest21481-40yum-updatesd-he07:41:112
198149944,0cyclictest0-21swapper/109:35:501
198149944,0cyclictest0-21swapper/109:16:261
198149943,0cyclictest3819-21awk07:53:381
198149943,0cyclictest3514-21snmpd11:47:411
198149943,0cyclictest3514-21snmpd11:14:551
198149943,0cyclictest3514-21snmpd09:18:551
198149943,0cyclictest3514-21snmpd08:44:101
198149943,0cyclictest3514-21snmpd08:41:101
198149943,0cyclictest3514-21snmpd08:17:101
198149943,0cyclictest3514-21snmpd07:38:241
198149943,0cyclictest28485-21awk07:23:371
198149943,0cyclictest23774-21awk08:08:361
198149943,0cyclictest19764-21awk11:33:371
198149943,0cyclictest19148-21awk08:53:371
198149943,0cyclictest10915-21awk10:08:361
198139943,0cyclictest3556-21lldpd11:35:000
198139943,0cyclictest3556-21lldpd10:55:000
198139943,0cyclictest3556-21lldpd10:33:300
198139943,0cyclictest3556-21lldpd09:24:300
198139943,0cyclictest3514-21snmpd10:47:100
198139943,0cyclictest3514-21snmpd10:06:100
198139943,0cyclictest3514-21snmpd09:00:400
198139943,0cyclictest3241-21irqbalance11:59:200
198139943,0cyclictest3241-21irqbalance11:53:300
198139943,0cyclictest3241-21irqbalance11:48:300
198139943,0cyclictest3241-21irqbalance11:24:300
198139943,0cyclictest3241-21irqbalance10:38:300
198139943,0cyclictest3241-21irqbalance09:28:510
198139943,0cyclictest3241-21irqbalance08:49:210
198139943,0cyclictest3241-21irqbalance08:39:510
198139943,0cyclictest3241-21irqbalance08:34:010
198139943,0cyclictest3241-21irqbalance08:19:510
198139943,0cyclictest3241-21irqbalance07:43:310
198139943,0cyclictest3241-21irqbalance07:39:010
198139943,0cyclictest3241-21irqbalance07:28:310
198139943,0cyclictest3241-21irqbalance07:23:410
198139943,0cyclictest3241-21irqbalance07:09:010
198139943,0cyclictest29463-21awk07:48:380
198139943,0cyclictest28773-21awk12:18:370
198139943,0cyclictest27657-21awk06:58:390
198139943,0cyclictest23791-21awk08:08:360
198139943,0cyclictest20908-21awk06:53:380
198139943,0cyclictest17185-21awk08:03:380
198139943,0cyclictest15229-21awk07:13:370
198139943,0cyclictest10728-21awk10:28:380
198139941,0cyclictest0-21swapper/008:13:320
179940,0migration/127717-21irqrtprio09:38:381
179940,0migration/126997-21cpuspeed_turbos06:58:361
179940,0migration/120463-21kthreadcore10:53:391
179940,0migration/117976-21sh10:13:241
179940,0migration/117735-21kthreadcore07:13:391
179940,0migration/111009-21latency_hist11:48:221
169940,0watchdog/19556-21ssh11:07:041
169940,0watchdog/17267-21memory07:28:411
169940,0watchdog/10-21swapper/110:38:401
169940,0watchdog/10-21swapper/108:48:371
149940,0migration/06790-21kthreadcore12:03:380
149940,0migration/023533-21kthreadcore12:13:390
149940,0migration/016914-21ksmtuned11:10:020
149940,0migration/015021-21ntp_offset07:58:440
149940,0migration/014087-21kthreadcore10:08:390
149940,0migration/013186-21kthreadcore11:28:390
149940,0migration/010053-21kthreadcore07:33:390
29715030,0irq/26-eth0-rx-0-21swapper/308:38:163
29715030,0irq/26-eth0-rx-0-21swapper/307:57:513
29715030,0irq/26-eth0-rx-0-21swapper/307:48:343
29715030,0irq/26-eth0-rx-0-21swapper/307:23:343
198159933,0cyclictest3556-21lldpd07:37:292
198159932,0cyclictest3556-21lldpd08:20:592
198159932,0cyclictest3556-21lldpd07:03:282
198159932,0cyclictest28329-21perl07:23:362
198159930,0cyclictest3232-21munin-node07:53:352
198149933,0cyclictest10687-21awk10:28:371
198149932,0cyclictest7406-21grep10:43:411
198149932,0cyclictest3514-21snmpd07:48:251
198149932,0cyclictest20959-21grep10:33:391
198149932,0cyclictest19374-21cut08:28:391
198149932,0cyclictest10945-21grep11:28:341
198149930,0cyclictest20722-21perl06:53:371
198139932,0cyclictest3514-21snmpd09:06:540
198139932,0cyclictest24269-21sensors11:13:430
198139932,0cyclictest2043-21munin-node11:03:380
198139932,0cyclictest19334-21sadc12:13:220
198139932,0cyclictest19332-21awk09:33:370
198139930,0cyclictest0-21swapper/009:41:110
19130,0ktimersoftd/124456-21runrttasks09:54:001
179930,0migration/123036-21kthreadcore07:18:401
179930,0migration/113789-21runrttasks07:10:001
169930,0watchdog/117963-21diskmemload11:53:281
169930,0watchdog/10-21swapper/110:58:401
169930,0watchdog/10-21swapper/108:03:331
149930,0migration/016867-21sh10:50:500
35120,0ktimersoftd/314301-21latency_hist07:13:233
329920,0watchdog/332031-21missed_timers06:58:423
29715020,0irq/26-eth0-rx-0-21swapper/308:18:363
29715020,0irq/26-eth0-rx-0-21swapper/307:43:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional