You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 22:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu May 07, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
985123525,0sleep20-21swapper/206:54:022
304450350,0irq/25-eth10-21swapper/306:52:523
1000423523,0sleep00-21swapper/006:55:480
991523324,0sleep10-21swapper/106:54:451
339960,0migration/36996-21sh10:32:513
339960,0migration/332111-21sh10:30:043
339960,0migration/324195-21sh10:05:103
339960,0migration/323223-21sh10:43:213
339960,0migration/322957-21sh09:01:433
339960,0migration/316439-21runrttasks09:40:203
339960,0migration/315475-21sh11:20:303
339960,0migration/315381-21sh08:58:293
29725060,0irq/27-eth0-tx-0-21swapper/210:50:512
29715060,0irq/26-eth0-rx-5236-21sed12:11:413
29715060,0irq/26-eth0-rx-3914-21grep10:11:363
29715060,0irq/26-eth0-rx-23039-21taskset09:21:413
29715060,0irq/26-eth0-rx-22094-21python11:01:393
29715060,0irq/26-eth0-rx-16957-21sh09:21:173
259960,0migration/26369-21idleruntime-cro08:06:192
101219960,0cyclictest8341-21diskmemload11:49:261
101219960,0cyclictest0-21swapper/109:05:001
101209965,0cyclictest0-21swapper/010:51:360
101209960,0cyclictest0-21swapper/010:36:470
8215050,0irq/24-0000:00:17711-21dump-pmu-power07:26:202
339950,0migration/3867-21diskmemload09:31:233
339950,0migration/38228-21runrttasks09:14:453
339950,0migration/37756-21aten_r1power_en11:36:293
339950,0migration/37096-21kthreadcore07:41:363
339950,0migration/3494-21kthreadcore07:36:353
339950,0migration/33606-21smart_sdb07:11:413
339950,0migration/33527-21kthreadcore11:51:363
339950,0migration/330550-21missed_timers09:46:353
339950,0migration/329430-21kthreadcore10:46:363
339950,0migration/326657-21munin-node08:21:303
339950,0migration/32616-21kthreadcore08:26:353
339950,0migration/325912-21kernelversion07:31:343
339950,0migration/325134-21hwlatdetect11:06:333
339950,0migration/323658-21kthreadcore08:41:363
339950,0migration/323338-21diskmemload10:23:033
339950,0migration/322333-21kthreadcore08:16:353
339950,0migration/321562-21unixbench-2d12:01:413
339950,0migration/320640-21kthreadcore07:26:363
339950,0migration/316803-21gltestperf11:21:333
339950,0migration/31520-21hddtemp_smartct09:51:333
339950,0migration/313621-21taskset08:32:223
339950,0migration/313258-21taskset08:11:203
339950,0migration/312898-21ntp_offset12:16:373
339950,0migration/310420-21kthreadcore10:36:343
29725050,0irq/27-eth0-tx-8024-21munin-node11:16:302
29725050,0irq/27-eth0-tx-6595-21munin-node08:06:330
29725050,0irq/27-eth0-tx-466-21munin-node10:11:342
29725050,0irq/27-eth0-tx-377-21ssh12:11:352
29725050,0irq/27-eth0-tx-24618-21munin-node07:31:300
29725050,0irq/27-eth0-tx-24603-21if_err_eth011:46:322
29725050,0irq/27-eth0-tx-24278-21ssh09:44:502
29725050,0irq/27-eth0-tx-1834-21munin-node08:51:360
29725050,0irq/27-eth0-tx-0-21swapper/211:42:312
29725050,0irq/27-eth0-tx-0-21swapper/209:31:562
29725050,0irq/27-eth0-tx-0-21swapper/209:26:332
29715050,0irq/26-eth0-rx-5355-21memory11:11:353
29715050,0irq/26-eth0-rx-28923-21kthreadcore11:46:353
29715050,0irq/26-eth0-rx-21373-21grep07:01:363
29715050,0irq/26-eth0-rx-0-21swapper/312:22:403
29715050,0irq/26-eth0-rx-0-21swapper/312:06:343
29715050,0irq/26-eth0-rx-0-21swapper/311:43:563
29715050,0irq/26-eth0-rx-0-21swapper/311:27:313
29715050,0irq/26-eth0-rx-0-21swapper/310:17:443
29715050,0irq/26-eth0-rx-0-21swapper/310:07:303
29715050,0irq/26-eth0-rx-0-21swapper/309:57:263
29715050,0irq/26-eth0-rx-0-21swapper/309:41:363
29715050,0irq/26-eth0-rx-0-21swapper/309:26:333
29715050,0irq/26-eth0-rx-0-21swapper/309:06:343
29715050,0irq/26-eth0-rx-0-21swapper/307:47:493
259950,0migration/28967-21latency_hist09:36:192
259950,0migration/28306-21munin-node12:16:332
259950,0migration/27516-21latency_hist11:36:192
259950,0migration/225277-21irqrtprio11:26:342
259950,0migration/224921-21fschecks_time11:06:322
259950,0migration/222119-21munin-node10:21:362
259950,0migration/210292-21kthreadcore08:06:352
249950,0watchdog/226359-21cut09:06:332
249950,0watchdog/214232-21aten_r1power_en08:36:292
179950,0migration/132399-21munin-node12:11:321
179950,0migration/129926-21kthreadcore08:21:361
179950,0migration/12529-21kthreadcore11:31:341
179950,0migration/123813-21sh10:24:281
179950,0migration/123669-21switchtime07:26:421
179950,0migration/115718-21kthreadcore07:21:381
179950,0migration/115645-21latency_hist11:41:191
179950,0migration/111652-21kthreadcore09:36:371
169950,0watchdog/19318-21irqcore10:56:331
169950,0watchdog/119963-21kthreadcore12:21:361
169950,0watchdog/116754-21ssh09:20:451
149950,0migration/09943-21kthreadcore10:56:330
149950,0migration/09077-21kthreadcore07:41:370
149950,0migration/07064-21taskset09:51:540
149950,0migration/06503-21ntp_kernel_pll_09:11:380
149950,0migration/05589-21munin-node07:16:340
149950,0migration/03269-21kthreadcore11:11:340
149950,0migration/032097-21idleruntime-cro11:11:180
149950,0migration/031429-21latency_hist12:11:180
149950,0migration/031227-21sh09:06:430
149950,0migration/031116-21sh11:29:310
149950,0migration/030596-21cpuspeed_turbos07:11:310
149950,0migration/02999-21kthreadcore07:36:350
149950,0migration/026002-21taskset08:17:580
149950,0migration/023398-21sh11:46:040
149950,0migration/020451-21kthreadcore07:01:350
149950,0migration/020132-21irqrtprio07:51:370
149950,0migration/019294-21kthreadcore10:21:350
149950,0migration/018047-21kthreadcore08:36:350
149950,0migration/017350-21irqcore11:01:340
149950,0migration/01709-21sh10:31:340
149950,0migration/016875-21irqstats12:01:340
149950,0migration/016765-21sh09:01:220
149950,0migration/016622-21munin-node10:41:310
149950,0migration/016605-21taskset06:59:410
149950,0migration/010286-21kthreadcore08:56:350
101229955,0cyclictest8341-21diskmemload09:00:392
101229955,0cyclictest0-21swapper/210:28:282
101229955,0cyclictest0-21swapper/210:04:582
101229954,0cyclictest8217-21tr07:16:362
101229950,0cyclictest0-21swapper/210:31:462
101229950,0cyclictest0-21swapper/209:56:462
101229950,0cyclictest0-21swapper/209:48:532
101229950,0cyclictest0-21swapper/209:11:222
101219955,0cyclictest0-21swapper/112:16:521
101219955,0cyclictest0-21swapper/112:03:281
101219955,0cyclictest0-21swapper/111:04:111
101219955,0cyclictest0-21swapper/110:43:131
101219955,0cyclictest0-21swapper/109:56:041
101219955,0cyclictest0-21swapper/109:44:061
101219950,0cyclictest0-21swapper/111:15:321
101209950,0cyclictest0-21swapper/009:16:420
339940,0migration/31524-21taskset08:50:323
339940,0migration/314201-21kthreadcore06:56:373
29725040,0irq/27-eth0-tx-31819-21ssh11:51:292
29725040,0irq/27-eth0-tx-23571-21munin-node12:06:302
29725040,0irq/27-eth0-tx-22177-21ssh12:03:042
29725040,0irq/27-eth0-tx-16036-21munin-node11:21:322
29725040,0irq/27-eth0-tx-14475-21ssh10:56:512
29725040,0irq/27-eth0-tx-0-21swapper/212:21:192
29725040,0irq/27-eth0-tx-0-21swapper/211:56:202
29725040,0irq/27-eth0-tx-0-21swapper/211:36:192
29725040,0irq/27-eth0-tx-0-21swapper/210:51:512
29725040,0irq/27-eth0-tx-0-21swapper/210:36:242
29725040,0irq/27-eth0-tx-0-21swapper/210:06:252
29725040,0irq/27-eth0-tx-0-21swapper/209:18:202
29725040,0irq/27-eth0-tx-0-21swapper/007:56:370
29715040,0irq/26-eth0-rx-0-21swapper/311:56:383
29715040,0irq/26-eth0-rx-0-21swapper/311:31:243
29715040,0irq/26-eth0-rx-0-21swapper/310:58:033
29715040,0irq/26-eth0-rx-0-21swapper/310:51:443
29715040,0irq/26-eth0-rx-0-21swapper/308:06:383
259940,0migration/228072-21fschecks_count08:46:312
259940,0migration/219219-21kthreadcore09:01:352
259940,0migration/212535-21kthreadcore06:56:362
259940,0migration/211151-21kthreadcore08:31:352
249940,0watchdog/222649-21rm11:02:172
249940,0watchdog/222240-21kthreadcore07:51:382
249940,0watchdog/218196-21if_eth109:21:332
249940,0watchdog/21466-21grep09:51:332
249940,0watchdog/20-21swapper/207:11:382
179940,0migration/18810-21cpu08:56:301
179940,0migration/17778-21cpuspeed_turbos11:56:311
179940,0migration/15228-21kthreadcore10:31:351
179940,0migration/14356-21kthreadcore10:11:361
179940,0migration/130165-21kthreadcore07:56:371
179940,0migration/126941-21kthreadcore07:06:371
179940,0migration/12557-21kthreadcore08:26:351
179940,0migration/125205-21latency_hist09:26:191
179940,0migration/123270-21kthreadcore08:41:361
179940,0migration/120428-21taskset08:38:531
179940,0migration/113594-21df08:11:311
179940,0migration/112644-21kthreadcore06:56:361
179940,0migration/111578-21kthreadcore11:16:351
179940,0migration/110890-21kthreadcore10:36:341
179940,0migration/110588-21kthreadcore08:06:351
169940,0watchdog/15203-21kthreadcore08:51:371
169940,0watchdog/132708-21ssh09:10:411
169940,0watchdog/132246-21iostat07:36:341
169940,0watchdog/131180-21ssh11:08:411
169940,0watchdog/117227-21ssh09:21:251
169940,0watchdog/10-21swapper/110:01:371
169940,0watchdog/10-21swapper/107:51:381
169940,0watchdog/10-21swapper/107:11:381
149940,0migration/032348-21runrttasks09:29:190
149940,0migration/030691-21taskset11:48:530
149940,0migration/030254-21rt-features10:46:390
149940,0migration/022713-21sh11:23:210
149940,0migration/020210-21kthreadcore09:21:360
149940,0migration/017125-21cpuspeed_turbos10:01:310
149940,0migration/015770-21kthreadcore07:21:380
101229943,0cyclictest9565-21awk10:16:332
101229943,0cyclictest3556-21lldpd11:11:192
101229943,0cyclictest3556-21lldpd08:26:192
101229943,0cyclictest3556-21lldpd08:22:492
101229943,0cyclictest3556-21lldpd08:18:192
101229943,0cyclictest3556-21lldpd08:00:492
101229943,0cyclictest3556-21lldpd07:46:492
101229943,0cyclictest3514-21snmpd07:31:262
101229943,0cyclictest21742-21awk08:41:342
101229943,0cyclictest17961-21awk07:01:342
101229943,0cyclictest17525-21awk10:41:342
101229943,0cyclictest14152-21awk08:11:342
101219944,0cyclictest0-21swapper/110:53:561
101219944,0cyclictest0-21swapper/110:16:441
101219943,0cyclictest740-21awk08:01:331
101219943,0cyclictest3556-21lldpd11:38:481
101219943,0cyclictest3556-21lldpd11:22:181
101219943,0cyclictest3556-21lldpd10:26:491
101219943,0cyclictest3556-21lldpd09:46:191
101219943,0cyclictest3556-21lldpd09:11:491
101219943,0cyclictest3556-21lldpd07:43:191
101219943,0cyclictest3556-21lldpd07:16:491
101219943,0cyclictest3514-21snmpd07:03:561
101219943,0cyclictest32721-21awk11:51:331
101219943,0cyclictest3241-21irqbalance09:31:371
101219943,0cyclictest28532-21awk08:46:331
101219943,0cyclictest25889-21awk10:06:341
101219943,0cyclictest25408-21awk10:46:331
101219943,0cyclictest24975-21awk11:26:331
101219943,0cyclictest24522-21awk12:06:321
101219943,0cyclictest13089-21awk07:46:331
101209944,0cyclictest0-21swapper/009:58:480
101209943,0cyclictest636-21awk08:01:320
101209943,0cyclictest3556-21lldpd12:11:490
101209943,0cyclictest3556-21lldpd11:58:490
101209943,0cyclictest3556-21lldpd10:07:480
101209943,0cyclictest3556-21lldpd09:50:490
101209943,0cyclictest3556-21lldpd07:11:190
101209943,0cyclictest3514-21snmpd11:36:280
101209943,0cyclictest3514-21snmpd11:35:280
101209943,0cyclictest3514-21snmpd09:38:120
101209943,0cyclictest28361-21ls08:46:320
101209943,0cyclictest1837-21awk09:31:330
101209943,0cyclictest18040-21awk09:41:340
101209943,0cyclictest1722-21awk08:26:340
101209943,0cyclictest1499-21awk10:11:340
101209940,0cyclictest0-21swapper/012:25:150
101209940,0cyclictest0-21swapper/008:42:540
101209940,0cyclictest0-21swapper/007:26:330
29725030,0irq/27-eth0-tx-0-21swapper/008:11:310
29715030,0irq/26-eth0-rx-0-21swapper/308:51:313
29715030,0irq/26-eth0-rx-0-21swapper/308:38:193
29715030,0irq/26-eth0-rx-0-21swapper/308:01:293
29715030,0irq/26-eth0-rx-0-21swapper/307:51:333
29715030,0irq/26-eth0-rx-0-21swapper/307:16:413
29715030,0irq/26-eth0-rx-0-21swapper/307:06:343
249930,0watchdog/20-21swapper/207:36:302
169930,0watchdog/10-21swapper/109:59:531
101229932,0cyclictest3556-21lldpd07:42:192
101229932,0cyclictest3556-21lldpd07:08:492
101229932,0cyclictest2714-21awk08:51:352
101229932,0cyclictest17881-21cat07:26:202
101219932,0cyclictest8393-21awk08:31:321
101219932,0cyclictest3556-21lldpd08:16:191
101219932,0cyclictest25454-21awk07:31:321
101209933,0cyclictest3556-21lldpd10:28:180
101209932,0cyclictest8341-21diskmemload12:18:450
101209932,0cyclictest3556-21lldpd11:17:490
101209932,0cyclictest12252-21munin-node07:46:370
101209931,0cyclictest0-21swapper/008:24:190
101209930,0cyclictest7538-21munin-node08:31:300
101209930,0cyclictest32440-21perl11:51:320
329920,0watchdog/30-21swapper/307:56:223
29715020,0irq/26-eth0-rx-0-21swapper/307:21:403
101209921,0cyclictest0-21swapper/010:16:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional