You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Apr 05, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:54:273
2318323526,0sleep20-21swapper/206:55:212
2337023324,0sleep10-21swapper/106:57:321
2330023228,0sleep00-21swapper/006:56:430
235989970,0cyclictest0-21swapper/208:44:362
339960,0migration/38998-21munin-node08:49:333
339960,0migration/35709-21kthreadcore11:49:373
339960,0migration/3490-21kthreadcore09:04:353
339960,0migration/326623-21sh12:22:323
339960,0migration/319083-21sh11:37:123
339960,0migration/317961-21munin-node07:39:413
339960,0migration/31375-21munin-node11:24:403
339960,0migration/313579-21fschecks_time10:34:323
29715060,0irq/26-eth0-rx-7498-21ps08:44:413
29715060,0irq/26-eth0-rx-32172-21grep11:44:363
235989966,0cyclictest21697-21diskmemload10:40:102
235989960,0cyclictest21697-21diskmemload11:35:022
19160,0ktimersoftd/125878-21kthreadcore06:59:371
149960,0migration/05933-21cpuspeed_turbos07:34:320
149960,0migration/010568-21kthreadcore08:24:380
8215050,0irq/24-0000:00:5416-21latency_hist07:34:212
339950,0migration/39552-21kthreadcore07:09:383
339950,0migration/37103-21irqrtprio09:09:353
339950,0migration/36476-21kthreadcore10:49:363
339950,0migration/34422-21sh09:25:543
339950,0migration/33671-21kthreadcore08:19:363
339950,0migration/330721-21munin-node09:44:343
339950,0migration/329310-21sh09:22:283
339950,0migration/329161-21kthreadcore08:39:373
339950,0migration/32576-21kthreadcore07:04:383
339950,0migration/324559-21kthreadcore08:59:383
339950,0migration/322335-21munin-node09:39:333
339950,0migration/318225-21taskset11:55:323
339950,0migration/317914-21kthreadcore08:29:373
339950,0migration/317040-21kthreadcore09:34:373
339950,0migration/314233-21cpuspeed_turbos09:14:323
339950,0migration/313338-21runrttasks09:33:223
339950,0migration/312305-21munin-node07:59:433
29725050,0irq/27-eth0-tx-13326-21munin-node08:04:330
29725050,0irq/27-eth0-tx-0-21swapper/212:04:352
29725050,0irq/27-eth0-tx-0-21swapper/008:59:290
29715050,0irq/26-eth0-rx-9375-21cut11:09:363
29715050,0irq/26-eth0-rx-5223-21irqcore11:29:363
29715050,0irq/26-eth0-rx-3634-21kthreadcore07:29:393
29715050,0irq/26-eth0-rx-23127-21kthreadcore11:39:383
29715050,0irq/26-eth0-rx-14630-21kthreadcore12:14:383
29715050,0irq/26-eth0-rx-13005-21fschecks_time11:14:313
29715050,0irq/26-eth0-rx-1166-21python12:04:393
29715050,0irq/26-eth0-rx-0-21swapper/312:28:273
29715050,0irq/26-eth0-rx-0-21swapper/310:54:363
29715050,0irq/26-eth0-rx-0-21swapper/310:44:203
29715050,0irq/26-eth0-rx-0-21swapper/310:39:363
29715050,0irq/26-eth0-rx-0-21swapper/310:26:433
29715050,0irq/26-eth0-rx-0-21swapper/310:17:373
29715050,0irq/26-eth0-rx-0-21swapper/310:09:093
29715050,0irq/26-eth0-rx-0-21swapper/309:59:533
29715050,0irq/26-eth0-rx-0-21swapper/309:54:373
29715050,0irq/26-eth0-rx-0-21swapper/308:58:043
29715050,0irq/26-eth0-rx-0-21swapper/306:59:323
249950,0watchdog/212356-21munin-node11:14:422
235989955,0cyclictest0-21swapper/212:09:342
235989955,0cyclictest0-21swapper/210:54:412
235989955,0cyclictest0-21swapper/209:57:082
235989955,0cyclictest0-21swapper/209:28:452
235989955,0cyclictest0-21swapper/209:20:432
235989955,0cyclictest0-21swapper/209:13:282
235989950,0cyclictest0-21swapper/211:53:482
235989950,0cyclictest0-21swapper/210:49:282
235989950,0cyclictest0-21swapper/209:04:192
235979950,0cyclictest0-21swapper/110:04:521
235969950,0cyclictest0-21swapper/012:19:520
235969950,0cyclictest0-21swapper/012:17:590
235969950,0cyclictest0-21swapper/010:36:270
179950,0migration/15999-21gltestperf10:09:331
179950,0migration/15999-21gltestperf10:09:331
179950,0migration/115968-21kthreadcore08:29:361
179950,0migration/114286-21munin-node08:49:421
169950,0watchdog/126238-21memory08:34:391
149950,0migration/09661-21kthreadcore07:59:390
149950,0migration/07727-21kthreadcore10:29:380
149950,0migration/05676-21kthreadcore11:49:370
149950,0migration/05651-21smart_sda07:54:440
149950,0migration/05370-21kthreadcore12:09:360
149950,0migration/04796-21sh09:07:210
149950,0migration/030275-21df_abs09:44:320
149950,0migration/029390-21latency_hist10:04:200
149950,0migration/028988-21sh10:24:120
149950,0migration/027808-21munin-node08:39:320
149950,0migration/026583-21timerandwakeup10:59:420
149950,0migration/026454-21sh11:40:250
149950,0migration/02342-21kthreadcore09:24:370
149950,0migration/022089-21aten_r1power_vo09:39:320
149950,0migration/021949-21taskset07:19:380
149950,0migration/021000-21taskset09:37:280
149950,0migration/017498-21kthreadcore08:54:370
149950,0migration/01567-21timerandwakeup11:44:420
149950,0migration/014762-21kthreadcore10:14:380
149950,0migration/012888-21taskset09:32:030
149950,0migration/012469-21irqcore07:14:360
8215040,0irq/24-0000:00:30960-40yum-updatesd-he09:44:382
339940,0migration/327981-21kthreadcore07:24:383
339940,0migration/322077-21irqcore08:34:363
339940,0migration/312364-21kthreadcore08:24:383
29725040,0irq/27-eth0-tx-20086-21munin-node11:39:352
29725040,0irq/27-eth0-tx-18440-21ssh10:34:382
29725040,0irq/27-eth0-tx-11771-21ssh11:54:232
29725040,0irq/27-eth0-tx-11459-21ssh12:14:232
29725040,0irq/27-eth0-tx-0-21swapper/211:59:282
29725040,0irq/27-eth0-tx-0-21swapper/211:44:232
29725040,0irq/27-eth0-tx-0-21swapper/211:25:472
29725040,0irq/27-eth0-tx-0-21swapper/211:22:472
29725040,0irq/27-eth0-tx-0-21swapper/211:09:262
29725040,0irq/27-eth0-tx-0-21swapper/210:44:312
29725040,0irq/27-eth0-tx-0-21swapper/210:30:282
29725040,0irq/27-eth0-tx-0-21swapper/210:26:202
29725040,0irq/27-eth0-tx-0-21swapper/210:19:342
29725040,0irq/27-eth0-tx-0-21swapper/210:14:402
29725040,0irq/27-eth0-tx-0-21swapper/209:59:352
29725040,0irq/27-eth0-tx-0-21swapper/008:49:340
29715040,0irq/26-eth0-rx-6096-21irqcore10:29:373
29715040,0irq/26-eth0-rx-0-21swapper/312:10:533
29715040,0irq/26-eth0-rx-0-21swapper/311:59:323
29715040,0irq/26-eth0-rx-0-21swapper/311:23:413
29715040,0irq/26-eth0-rx-0-21swapper/311:05:203
29715040,0irq/26-eth0-rx-0-21swapper/311:00:433
29715040,0irq/26-eth0-rx-0-21swapper/310:19:323
29715040,0irq/26-eth0-rx-0-21swapper/310:09:323
29715040,0irq/26-eth0-rx-0-21swapper/310:09:323
29715040,0irq/26-eth0-rx-0-21swapper/309:49:313
29715040,0irq/26-eth0-rx-0-21swapper/308:14:313
259940,0migration/29602-21kthreadcore09:29:392
259940,0migration/26622-21kthreadcore07:09:372
259940,0migration/229863-21latency_hist09:04:212
259940,0migration/22362-21kthreadcore07:54:392
259940,0migration/222576-21kthreadcore10:59:362
259940,0migration/219736-21cpuspeed_turbos12:19:322
259940,0migration/215460-21kthreadcore09:14:372
249940,0watchdog/228534-21iostat_ios12:24:342
249940,0watchdog/217214-21timerwakeupswit07:14:432
249940,0watchdog/20-21swapper/211:04:342
249940,0watchdog/20-21swapper/210:04:262
235989943,0cyclictest8559-21awk08:24:362
235989943,0cyclictest6451-21awk09:49:352
235989943,0cyclictest6150-21awk10:09:342
235989943,0cyclictest6150-21awk10:09:342
235989943,0cyclictest3556-21lldpd08:49:372
235989943,0cyclictest3556-21lldpd08:04:362
235989943,0cyclictest3556-21lldpd07:39:352
235989943,0cyclictest3514-21snmpd08:00:342
235989943,0cyclictest3241-21irqbalance11:29:282
235989943,0cyclictest3241-21irqbalance09:34:392
235989943,0cyclictest3241-21irqbalance07:44:592
235989943,0cyclictest3241-21irqbalance07:34:492
235989943,0cyclictest3241-21irqbalance07:24:492
235989943,0cyclictest3241-21irqbalance07:19:392
235989943,0cyclictest3241-21irqbalance07:04:292
235989943,0cyclictest3241-21irqbalance06:59:292
235989943,0cyclictest26535-21awk07:49:352
235989943,0cyclictest22802-21awk09:39:352
235989943,0cyclictest20795-21awk08:09:352
235989943,0cyclictest15121-21awk08:29:342
235979944,0cyclictest0-21swapper/111:29:501
235979944,0cyclictest0-21swapper/109:09:411
235979943,0cyclictest5594-21awk07:09:351
235979943,0cyclictest3556-21lldpd10:50:381
235979943,0cyclictest3556-21lldpd10:20:081
235979943,0cyclictest3556-21lldpd09:25:071
235979943,0cyclictest3514-21snmpd09:55:201
235979943,0cyclictest3514-21snmpd08:54:351
235979943,0cyclictest3241-21irqbalance09:59:491
235979943,0cyclictest3241-21irqbalance08:09:391
235979943,0cyclictest13685-21awk10:54:351
235979940,0cyclictest0-21swapper/111:26:031
235979940,0cyclictest0-21swapper/111:02:151
235979940,0cyclictest0-21swapper/110:47:351
235969944,0cyclictest0-21swapper/012:03:380
235969944,0cyclictest0-21swapper/010:46:320
235969944,0cyclictest0-21swapper/010:10:360
235969944,0cyclictest0-21swapper/010:10:360
235969944,0cyclictest0-21swapper/009:16:310
235969943,0cyclictest4054-21sadc11:09:190
235969943,0cyclictest3556-21lldpd11:23:070
235969943,0cyclictest3556-21lldpd10:50:080
235969943,0cyclictest3556-21lldpd09:58:080
235969943,0cyclictest3556-21lldpd07:06:360
235969943,0cyclictest3556-21lldpd06:59:350
235969943,0cyclictest3514-21snmpd11:31:500
235969943,0cyclictest3514-21snmpd08:24:040
235969943,0cyclictest3514-21snmpd07:43:190
235969943,0cyclictest27527-21awk08:14:340
235969943,0cyclictest21866-21awk10:39:340
235969940,0cyclictest0-21swapper/007:51:230
235969940,0cyclictest0-21swapper/007:09:340
179940,0migration/19551-21kthreadcore08:24:371
179940,0migration/18024-21kthreadcore07:59:381
179940,0migration/17033-21irqcore09:29:381
179940,0migration/15576-21irqrtprio11:09:341
179940,0migration/14138-21fschecks_count11:49:331
179940,0migration/1328-21fschecks_count07:54:351
179940,0migration/130578-21aten_r1power_po07:04:321
179940,0migration/124567-21kthreadcore09:19:371
179940,0migration/12124-21kthreadcore07:29:381
179940,0migration/11104-21missed_timers11:44:381
169940,0watchdog/14660-21ssh09:47:301
169940,0watchdog/131339-21kthreadcore09:04:351
169940,0watchdog/128518-21ssh09:01:071
169940,0watchdog/127229-21rm12:24:181
169940,0watchdog/120849-21ssh09:37:021
169940,0watchdog/118487-21awk10:34:381
169940,0watchdog/113581-21kthreadcore11:54:381
169940,0watchdog/10-21swapper/112:14:421
169940,0watchdog/10-21swapper/112:11:101
169940,0watchdog/10-21swapper/112:06:341
169940,0watchdog/10-21swapper/111:39:381
149940,0migration/0968-21kthreadcore10:24:350
149940,0migration/08333-21kthreadcore09:49:370
149940,0migration/0831-21needreboot12:04:360
149940,0migration/07189-21kthreadcore11:09:350
149940,0migration/03462-21sh10:04:550
149940,0migration/026759-21timerwakeupswit08:34:430
149940,0migration/024922-21unixbench_multi07:44:440
149940,0migration/018807-21runrttasks10:54:450
149940,0migration/01356-21runrttasks12:25:060
8215030,0irq/24-0000:00:0-21swapper/208:19:212
29725030,0irq/27-eth0-tx-19945-21sshd08:09:230
29725030,0irq/27-eth0-tx-0-21swapper/008:29:310
29715030,0irq/26-eth0-rx-0-21swapper/308:09:323
29715030,0irq/26-eth0-rx-0-21swapper/308:04:303
29715030,0irq/26-eth0-rx-0-21swapper/307:54:333
29715030,0irq/26-eth0-rx-0-21swapper/307:49:323
29715030,0irq/26-eth0-rx-0-21swapper/307:48:493
29715030,0irq/26-eth0-rx-0-21swapper/307:19:323
235989932,0cyclictest3556-21lldpd08:56:082
235989932,0cyclictest22125-21irqrtprio08:34:372
235989931,0cyclictest31419-21kthreadcore08:14:372
235979933,0cyclictest0-21swapper/109:50:311
235979932,0cyclictest3514-21snmpd07:14:331
235979932,0cyclictest3241-21irqbalance08:47:291
235979932,0cyclictest31134-21sadc07:29:211
235979932,0cyclictest29275-21cut12:24:351
235979932,0cyclictest22881-21awk09:39:361
235979932,0cyclictest20681-21awk11:59:341
235979932,0cyclictest19013-21awk07:19:361
235979932,0cyclictest12832-21sed11:34:331
235969933,0cyclictest0-21swapper/008:44:380
235969932,0cyclictest6840-21awk09:09:340
235969932,0cyclictest3514-21snmpd11:19:050
235969932,0cyclictest32274-21awk07:29:360
235969932,0cyclictest29362-21awk11:24:370
235969932,0cyclictest25647-21if_eth1.207:24:360
235969932,0cyclictest24615-21kthreadcore09:19:370
235969932,0cyclictest17590-21sensors11:54:430
235969932,0cyclictest13045-21awk11:34:340
179930,0migration/125191-21runrttasks07:46:381
179930,0migration/113271-21if_eth107:39:361
169930,0watchdog/120363-21munin-node11:19:341
169930,0watchdog/114469-21irqcore08:04:351
169930,0watchdog/10-21swapper/111:14:341
169930,0watchdog/10-21swapper/111:04:341
169930,0watchdog/10-21swapper/110:40:421
169930,0watchdog/10-21swapper/110:29:381
169930,0watchdog/10-21swapper/110:25:421
169930,0watchdog/10-21swapper/110:14:261
169930,0watchdog/10-21swapper/109:15:151
169930,0watchdog/10-21swapper/108:14:311
169930,0watchdog/10-21swapper/107:49:351
169930,0watchdog/10-21swapper/107:34:311
29715020,0irq/26-eth0-rx-0-21swapper/307:34:383
29715020,0irq/26-eth0-rx-0-21swapper/307:14:223
249920,0watchdog/20-21swapper/208:39:232
235979921,0cyclictest27536-21latency_hist08:39:211
169920,0watchdog/10-21swapper/108:19:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional