You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 22:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 17, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450800,0irq/25-eth10-21swapper/306:42:133
2787128079,0sleep00-21swapper/006:39:400
2712823523,0sleep10-21swapper/106:38:571
2782323026,0sleep20-21swapper/206:39:102
8215060,0irq/24-0000:00:26572-21munin-plugin-st08:43:392
35160,0ktimersoftd/39405-21kthreadcore08:03:553
339960,0migration/38406-21sh09:30:003
339960,0migration/33498-21taskset12:08:583
339960,0migration/330553-21sh11:05:143
339960,0migration/314000-21sh11:15:003
29725060,0irq/27-eth0-tx-20141-21munin-node08:38:570
29715060,0irq/26-eth0-rx-21422-21awk12:01:393
29715060,0irq/26-eth0-rx-10573-21irqcore09:53:543
29715060,0irq/26-eth0-rx-10573-21irqcore09:53:543
282849966,0cyclictest0-21swapper/206:58:522
282819966,0cyclictest0-21swapper/010:31:070
149960,0migration/024799-21sh08:59:080
8215050,0irq/24-0000:00:24688-21cat07:53:392
339950,0migration/38983-21taskset06:50:043
339950,0migration/37558-21irqcore11:53:533
339950,0migration/35862-21kthreadcore07:13:533
339950,0migration/33267-21taskset07:10:383
339950,0migration/332099-21kthreadcore07:33:543
339950,0migration/328100-21munin-node12:03:593
339950,0migration/32760-21kthreadcore07:58:553
339950,0migration/327136-21kthreadcore10:43:553
339950,0migration/325531-21munin-node07:53:543
339950,0migration/323606-21fschecks_time11:43:513
339950,0migration/322658-21sh11:22:133
339950,0migration/320448-21cpuspeed_turbos08:38:513
339950,0migration/317271-21irqrtprio10:58:533
339950,0migration/316679-21kthreadcore08:08:573
339950,0migration/31585-21cpuspeed_turbos09:48:513
339950,0migration/315699-21taskset10:58:313
339950,0migration/315084-21kthreadcore09:13:563
339950,0migration/314371-21kthreadcore09:33:553
339950,0migration/313403-21diskmemload11:34:493
339950,0migration/313207-21kthreadcore08:53:543
339950,0migration/31060-21munin-node08:23:553
29725050,0irq/27-eth0-tx-8820-21irqrtprio11:13:532
29725050,0irq/27-eth0-tx-8530-21munin-node10:33:532
29725050,0irq/27-eth0-tx-7480-21if_eth1.311:53:532
29725050,0irq/27-eth0-tx-3514-21snmpd08:28:570
29725050,0irq/27-eth0-tx-32491-21ssh09:45:412
29725050,0irq/27-eth0-tx-32472-21munin-node08:23:540
29725050,0irq/27-eth0-tx-32366-21pmu-power09:03:582
29725050,0irq/27-eth0-tx-28493-21munin-node06:43:580
29725050,0irq/27-eth0-tx-2314-21munin-node09:08:562
29725050,0irq/27-eth0-tx-18611-21grep11:58:562
29725050,0irq/27-eth0-tx-1346-21munin-node09:48:542
29725050,0irq/27-eth0-tx-11551-21munin-node07:43:550
29725050,0irq/27-eth0-tx-0-21swapper/211:48:512
29725050,0irq/27-eth0-tx-0-21swapper/211:09:222
29725050,0irq/27-eth0-tx-0-21swapper/209:23:582
29725050,0irq/27-eth0-tx-0-21swapper/208:53:142
29725050,0irq/27-eth0-tx-0-21swapper/007:58:570
29715050,0irq/26-eth0-rx-3788-21kthreadcore10:48:553
29715050,0irq/26-eth0-rx-30810-21ssh11:48:433
29715050,0irq/26-eth0-rx-2911-21fschecks_time08:48:513
29715050,0irq/26-eth0-rx-28035-21kthreadcore09:23:553
29715050,0irq/26-eth0-rx-26814-21if_eth1.309:43:543
29715050,0irq/26-eth0-rx-21959-21kthreadcore07:48:563
29715050,0irq/26-eth0-rx-0-21swapper/311:38:403
29715050,0irq/26-eth0-rx-0-21swapper/311:23:533
29715050,0irq/26-eth0-rx-0-21swapper/311:09:223
29715050,0irq/26-eth0-rx-0-21swapper/310:43:083
29715050,0irq/26-eth0-rx-0-21swapper/310:28:553
29715050,0irq/26-eth0-rx-0-21swapper/310:08:583
29715050,0irq/26-eth0-rx-0-21swapper/310:02:563
29715050,0irq/26-eth0-rx-0-21swapper/309:41:013
29715050,0irq/26-eth0-rx-0-21swapper/309:23:363
29715050,0irq/26-eth0-rx-0-21swapper/309:08:543
29715050,0irq/26-eth0-rx-0-21swapper/308:46:213
282849955,0cyclictest26571-21diskmemload09:22:582
282849955,0cyclictest0-21swapper/210:28:052
282849950,0cyclictest0-21swapper/210:23:212
282819955,0cyclictest0-21swapper/012:05:050
282819955,0cyclictest0-21swapper/010:49:340
282819955,0cyclictest0-21swapper/010:26:240
282819955,0cyclictest0-21swapper/009:06:180
282819954,0cyclictest18078-21awk07:23:520
282819950,0cyclictest0-21swapper/011:26:180
27150,0ktimersoftd/20-21swapper/212:05:312
27150,0ktimersoftd/20-21swapper/211:01:392
27150,0ktimersoftd/20-21swapper/210:01:542
259950,0migration/27502-21kthreadcore07:13:542
259950,0migration/224691-21kthreadcore11:43:542
259950,0migration/222014-21sh11:41:502
259950,0migration/22142-21cpuspeed_turbos09:28:502
259950,0migration/212506-21munin-node07:43:542
249950,0watchdog/22956-21grep12:08:562
249950,0watchdog/227418-21kthreadcore07:53:572
249950,0watchdog/224651-21tail08:59:012
249950,0watchdog/20-21swapper/210:03:572
19150,0ktimersoftd/10-21swapper/109:28:511
179950,0migration/18518-21munin-node09:09:011
179950,0migration/17528-21unixbench_singl09:49:021
179950,0migration/15924-21timerwakeupswit08:24:021
179950,0migration/132733-21cpuspeed_turbos10:48:501
179950,0migration/131856-21taskset10:47:431
179950,0migration/127320-21kthreadcore12:03:551
179950,0migration/124399-21taskset07:51:311
179950,0migration/123736-21idleruntime-cro11:03:381
179950,0migration/122506-21kthreadcore09:58:551
179950,0migration/115614-21sh09:54:101
179950,0migration/115614-21sh09:54:101
179950,0migration/111246-21kthreadcore06:53:561
169950,0watchdog/1362-21kthreadcore11:28:521
169950,0watchdog/115315-21missed_timers09:33:571
169950,0watchdog/10-21swapper/111:18:561
149950,0migration/09730-21taskset09:12:370
149950,0migration/08824-21irqrtprio11:13:530
149950,0migration/08174-21sh09:29:190
149950,0migration/05670-21latency_hist12:13:380
149950,0migration/04848-21irqcore07:13:520
149950,0migration/04567-21kthreadcore08:48:550
149950,0migration/031777-21timerwakeupswit09:44:020
149950,0migration/028070-21kthreadcore10:43:560
149950,0migration/027757-21munin-node08:43:540
149950,0migration/024417-21taskset10:01:490
149950,0migration/022126-21munin-node10:39:000
149950,0migration/021899-21taskset11:41:290
149950,0migration/016719-21sh09:57:290
149950,0migration/016719-21sh09:57:290
149950,0migration/016629-21taskset10:18:270
149950,0migration/016050-21kthreadcore11:58:550
149950,0migration/013715-21sh11:57:170
339940,0migration/37980-21kthreadcore07:38:553
339940,0migration/332762-21kthreadcore06:43:563
339940,0migration/330071-21ksmtuned07:31:383
339940,0migration/326118-21hwlatdetect10:03:533
339940,0migration/320017-21kthreadcore10:18:563
339940,0migration/313587-21kthreadcore10:13:553
29725040,0irq/27-eth0-tx-3737-21cut10:08:582
29725040,0irq/27-eth0-tx-19162-21munin-node08:13:530
29725040,0irq/27-eth0-tx-15433-21ssh11:18:402
29725040,0irq/27-eth0-tx-13146-21ssh11:34:062
29725040,0irq/27-eth0-tx-0-21swapper/211:04:252
29725040,0irq/27-eth0-tx-0-21swapper/210:43:552
29725040,0irq/27-eth0-tx-0-21swapper/210:39:052
29725040,0irq/27-eth0-tx-0-21swapper/210:14:582
29725040,0irq/27-eth0-tx-0-21swapper/209:33:512
29725040,0irq/27-eth0-tx-0-21swapper/208:46:032
29725040,0irq/27-eth0-tx-0-21swapper/007:48:500
29725040,0irq/27-eth0-tx-0-21swapper/006:53:550
29715040,0irq/26-eth0-rx-7223-21fschecks_count08:28:513
29715040,0irq/26-eth0-rx-0-21swapper/311:30:003
29715040,0irq/26-eth0-rx-0-21swapper/310:33:513
29715040,0irq/26-eth0-rx-0-21swapper/310:25:093
29715040,0irq/26-eth0-rx-0-21swapper/309:04:023
29715040,0irq/26-eth0-rx-0-21swapper/308:59:383
29715040,0irq/26-eth0-rx-0-21swapper/308:18:593
282849943,0cyclictest9088-21awk10:53:532
282849943,0cyclictest887-21awk10:48:522
282849943,0cyclictest3514-21snmpd09:13:492
282849943,0cyclictest3514-21snmpd08:06:342
282849943,0cyclictest3514-21snmpd07:08:032
282849943,0cyclictest29333-21awk06:43:532
282849943,0cyclictest11422-21awk08:53:522
282849940,0cyclictest0-21swapper/207:37:392
282839943,0cyclictest7743-21awk08:28:531
282839943,0cyclictest5671-21awk07:38:521
282839943,0cyclictest3690-21awk06:48:531
282839943,0cyclictest3556-21lldpd11:04:551
282839943,0cyclictest3556-21lldpd10:13:551
282839943,0cyclictest3556-21lldpd09:22:541
282839943,0cyclictest3556-21lldpd09:16:251
282839943,0cyclictest3556-21lldpd09:04:251
282839943,0cyclictest3556-21lldpd08:49:241
282839943,0cyclictest3556-21lldpd08:46:251
282839943,0cyclictest3514-21snmpd11:59:061
282839943,0cyclictest3241-21irqbalance10:19:271
282839943,0cyclictest26767-21awk08:18:531
282839943,0cyclictest25806-21kthreadcore11:43:551
282839943,0cyclictest25796-21awk10:23:541
282839943,0cyclictest21072-21awk08:38:541
282839943,0cyclictest1844-21awk10:08:561
282839943,0cyclictest1349-21awk10:28:521
282819944,0cyclictest0-21swapper/011:48:130
282819944,0cyclictest0-21swapper/009:14:210
282819943,0cyclictest6185-21sadc11:53:380
282819943,0cyclictest5701-21awk07:38:530
282819943,0cyclictest3556-21lldpd08:05:550
282819943,0cyclictest3556-21lldpd07:10:540
282819943,0cyclictest3241-21irqbalance11:08:570
282819943,0cyclictest32240-21sadc08:23:390
282819943,0cyclictest31352-21awk07:33:510
282819943,0cyclictest25739-21awk07:53:550
282819943,0cyclictest19190-21awk09:18:530
282819943,0cyclictest17349-21kthreadcore10:58:540
282819943,0cyclictest16336-21awk11:18:520
282819943,0cyclictest11449-21awk07:18:540
282819940,0cyclictest0-21swapper/009:35:320
259940,0migration/29515-21aten_r1power_po09:53:492
259940,0migration/29515-21aten_r1power_po09:53:492
259940,0migration/25332-21latency08:23:572
259940,0migration/24108-21irqrtprio06:48:542
259940,0migration/23135-21kthreadcore10:28:552
259940,0migration/228155-21kthreadcore08:18:552
259940,0migration/222568-21kthreadcore09:38:572
259940,0migration/215377-21kthreadcore08:08:562
249940,0watchdog/224365-21kthreadcore08:13:572
249940,0watchdog/20-21swapper/211:28:522
249940,0watchdog/20-21swapper/211:24:002
249940,0watchdog/20-21swapper/208:29:012
179940,0migration/13285-21taskset07:10:521
179940,0migration/132707-21kthreadcore07:33:541
179940,0migration/131149-21kthreadcore06:43:551
179940,0migration/130643-21df_abs12:08:511
179940,0migration/128557-21kthreadcore09:43:561
179940,0migration/124430-21interrupts11:23:541
179940,0migration/121374-21kthreadcore09:38:561
179940,0migration/120011-21kthreadcore08:58:541
179940,0migration/118957-21kthreadcore11:38:561
179940,0migration/115586-21kthreadcore07:43:561
179940,0migration/113683-21kthreadcore07:18:561
179940,0migration/113621-40yum-updatesd11:35:301
179940,0migration/112895-21kthreadcore08:53:541
179940,0migration/111950-21kthreadcore10:33:541
179940,0migration/110768-21kthreadcore11:13:541
169940,0watchdog/16527-21aten_r1power_en11:53:481
169940,0watchdog/16318-21ssh11:10:481
169940,0watchdog/14200-21diskstats07:13:491
169940,0watchdog/131433-21perl11:48:521
169940,0watchdog/127419-21kthreadcore07:53:571
169940,0watchdog/127139-21if_err_eth109:23:531
169940,0watchdog/123849-21aten_r1power_cu07:28:491
169940,0watchdog/123029-21ssh10:40:081
169940,0watchdog/117563-21df_inode07:23:491
169940,0watchdog/10-21swapper/110:03:571
169940,0watchdog/10-21swapper/108:13:571
149940,0migration/03830-21kthreadcore10:08:580
149940,0migration/030413-21kthreadcore09:23:560
149940,0migration/027807-21kthreadcore11:03:560
149940,0migration/026964-21kthreadcore07:03:560
149940,0migration/017429-21fschecks_count10:18:520
149940,0migration/016724-21fschecks_count06:58:510
149940,0migration/016716-21kthreadcore08:33:550
149940,0migration/010556-21kthreadcore10:53:550
8215030,0irq/24-0000:00:0-21swapper/206:54:012
29715030,0irq/26-eth0-rx-0-21swapper/308:33:493
29715030,0irq/26-eth0-rx-0-21swapper/308:13:503
29715030,0irq/26-eth0-rx-0-21swapper/307:43:503
29715030,0irq/26-eth0-rx-0-21swapper/307:19:343
29715030,0irq/26-eth0-rx-0-21swapper/306:57:273
282849932,0cyclictest18126-21awk07:23:522
282849932,0cyclictest11425-21awk07:18:532
282849931,0cyclictest0-21swapper/207:08:522
282849930,0cyclictest0-21swapper/208:35:322
282839932,0cyclictest8126-21aten_r1power_en10:53:491
282839932,0cyclictest32337-21awk07:58:521
282839932,0cyclictest14151-21fschecks_time08:33:511
282839932,0cyclictest13394-21awk08:08:541
282839930,0cyclictest0-21swapper/108:05:521
282819932,0cyclictest7821-21awk11:33:520
282819932,0cyclictest3750-21awk06:48:530
282819932,0cyclictest3556-21lldpd09:48:550
282819932,0cyclictest3556-21lldpd09:41:540
282819932,0cyclictest3556-21lldpd08:53:540
282819932,0cyclictest3514-21snmpd07:30:180
282819932,0cyclictest13354-21awk08:08:540
282819932,0cyclictest10765-21cat10:33:540
249930,0watchdog/20-21swapper/207:39:212
249930,0watchdog/20-21swapper/207:28:492
29715020,0irq/26-eth0-rx-0-21swapper/307:23:463
29715020,0irq/26-eth0-rx-0-21swapper/307:03:523
29715020,0irq/26-eth0-rx-0-21swapper/306:58:463
282839921,0cyclictest22819-21latency_hist07:03:391
282839921,0cyclictest0-21swapper/106:58:391
282819921,0cyclictest6279-21avahi-daemon11:28:400
282819920,0cyclictest0-21swapper/010:03:410
249920,0watchdog/20-21swapper/207:58:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional