You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 20:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Aug 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2095826955,0sleep00-21swapper/006:46:000
191670,0ktimersoftd/114531-21perf06:47:411
1474324434,0sleep30-21swapper/306:42:553
2074023329,0sleep20-21swapper/206:43:262
339960,0migration/321093-21sh11:28:223
29725060,0irq/27-eth0-tx-25223-21munin-node08:28:050
29715060,0irq/26-eth0-rx-253282sleep310:12:483
211879960,0cyclictest0-21swapper/206:48:132
211869966,0cyclictest19338-21diskmemload09:09:281
211869960,0cyclictest19338-21diskmemload09:03:191
149960,0migration/025541-21sh09:29:410
149960,0migration/020543-21sh11:48:460
149960,0migration/016974-21sh10:06:250
8215050,0irq/24-0000:00:22554-21munin-run11:32:492
339950,0migration/37898-21munin-node11:23:033
339950,0migration/34455-21kthreadcore09:18:083
339950,0migration/33647-21kthreadcore09:58:063
339950,0migration/330592-21latency_hist11:37:493
339950,0migration/329936-21kthreadcore08:53:083
339950,0migration/327616-21kernelversion09:53:083
339950,0migration/325336-21aten_r1power_po08:28:023
339950,0migration/323308-21sendmail_mailtr07:58:123
339950,0migration/321422-21kthreadcore09:48:073
339950,0migration/321375-21munin-node12:13:013
339950,0migration/320855-21taskset11:49:443
339950,0migration/319399-21taskset09:07:503
339950,0migration/316912-21munin-node09:03:113
339950,0migration/316165-21kthreadcore07:53:093
339950,0migration/315983-21df_abs11:08:023
339950,0migration/31420-21runrttasks09:13:543
339950,0migration/313550-21fschecks_time08:43:063
339950,0migration/313455-21kthreadcore08:18:073
339950,0migration/312124-21munin-node07:03:093
339950,0migration/311444-21munin-node09:43:043
29725050,0irq/27-eth0-tx-4342-21munin-node07:48:120
29725050,0irq/27-eth0-tx-3306-21munin-node07:23:060
29725050,0irq/27-eth0-tx-19338-21diskmemload10:34:102
29725050,0irq/27-eth0-tx-16935-21ssh10:27:572
29725050,0irq/27-eth0-tx-0-21swapper/211:41:402
29725050,0irq/27-eth0-tx-0-21swapper/211:09:562
29725050,0irq/27-eth0-tx-0-21swapper/210:53:522
29725050,0irq/27-eth0-tx-0-21swapper/210:41:302
29725050,0irq/27-eth0-tx-0-21swapper/208:51:332
29725050,0irq/27-eth0-tx-0-21swapper/008:13:100
29725050,0irq/27-eth0-tx-0-21swapper/008:03:140
29715050,0irq/26-eth0-rx-4495-21cut10:18:093
29715050,0irq/26-eth0-rx-32159-21munin-node10:58:153
29715050,0irq/26-eth0-rx-24593-21ssh10:32:453
29715050,0irq/26-eth0-rx-0-21swapper/312:10:443
29715050,0irq/26-eth0-rx-0-21swapper/312:03:473
29715050,0irq/26-eth0-rx-0-21swapper/311:57:553
29715050,0irq/26-eth0-rx-0-21swapper/311:18:043
29715050,0irq/26-eth0-rx-0-21swapper/311:13:183
29715050,0irq/26-eth0-rx-0-21swapper/310:50:123
29715050,0irq/26-eth0-rx-0-21swapper/310:40:293
29715050,0irq/26-eth0-rx-0-21swapper/310:36:233
29715050,0irq/26-eth0-rx-0-21swapper/308:03:103
259950,0migration/24873-21kthreadcore09:38:092
259950,0migration/218212-21latency_hist09:47:492
249950,0watchdog/228330-21kthreadcore09:33:082
249950,0watchdog/20-21swapper/212:03:082
211879954,0cyclictest3514-21snmpd07:44:162
211879950,0cyclictest0-21swapper/212:16:282
211869955,0cyclictest0-21swapper/111:07:521
211869955,0cyclictest0-21swapper/110:21:411
211869955,0cyclictest0-21swapper/109:01:161
211869954,0cyclictest548-21awk10:58:061
211869950,0cyclictest0-21swapper/110:34:551
211869950,0cyclictest0-21swapper/109:43:221
211869950,0cyclictest0-21swapper/109:13:341
211869950,0cyclictest0-21swapper/108:10:021
211859955,0cyclictest0-21swapper/011:45:490
211859955,0cyclictest0-21swapper/010:28:250
211859955,0cyclictest0-21swapper/009:45:220
211859954,0cyclictest29724-21crond11:57:490
19150,0ktimersoftd/10-21swapper/112:04:001
179950,0migration/19297-21cpuspeed_turbos10:23:021
179950,0migration/127320-21munin-node06:48:131
179950,0migration/125350-21munin-run10:12:491
179950,0migration/12152-21kthreadcore10:38:071
179950,0migration/118258-21kthreadcore10:48:041
169950,0watchdog/1683-21kthreadcore11:58:081
169950,0watchdog/131321-21kthreadcore06:53:091
149950,0migration/06913-21sh11:01:100
149950,0migration/06616-21kthreadcore09:18:080
149950,0migration/04092-21kthreadcore06:58:080
149950,0migration/032565-21latency_hist10:37:490
149950,0migration/032396-21vmstat09:53:160
149950,0migration/029992-21sh11:57:580
149950,0migration/02775-21kthreadcore10:18:080
149950,0migration/02727-21munin-node09:58:050
149950,0migration/026883-21aten_r1power_cu09:33:020
149950,0migration/026606-21munin-node10:13:070
149950,0migration/024200-21kthreadcore12:13:070
149950,0migration/023628-21kthreadcore08:23:060
149950,0migration/023628-21kthreadcore08:23:060
149950,0migration/023626-21timerandwakeup10:08:120
149950,0migration/023278-21kthreadcore06:48:070
149950,0migration/022723-21latency_hist11:32:490
149950,0migration/022024-21kthreadcore07:58:080
149950,0migration/021504-21taskset11:29:350
149950,0migration/019952-21kthreadcore07:33:090
149950,0migration/019674-21aten_r1power_fr08:48:030
149950,0migration/01961-21kthreadcore08:33:080
149950,0migration/01948-21kthreadcore11:18:090
149950,0migration/016271-21fschecks_time07:08:040
149950,0migration/013301-21latency_hist12:07:490
149950,0migration/012253-21irqrtprio09:23:060
149950,0migration/012134-21gltestperf09:03:050
149950,0migration/011897-21munin-node07:53:060
149950,0migration/011581-21kthreadcore10:23:070
149950,0migration/010858-21kthreadcore10:43:080
149950,0migration/010655-21fschecks_time07:28:030
339940,0migration/33182-21latency_hist07:22:513
339940,0migration/330106-21timerandwakeup10:53:123
339940,0migration/32793-21diskmemload09:38:053
339940,0migration/32244-21latency_hist06:57:513
339940,0migration/322072-21taskset07:12:213
339940,0migration/321158-21kthreadcore08:23:063
339940,0migration/321158-21kthreadcore08:23:063
339940,0migration/312592-21taskset08:42:123
29725040,0irq/27-eth0-tx-7727-21munin-node11:03:062
29725040,0irq/27-eth0-tx-28757-21kthreadcore08:53:082
29725040,0irq/27-eth0-tx-27459-21munin-node09:13:042
29725040,0irq/27-eth0-tx-26400-21kthreadcore11:13:092
29725040,0irq/27-eth0-tx-11318-21ssh09:02:552
29725040,0irq/27-eth0-tx-0-21swapper/212:07:552
29725040,0irq/27-eth0-tx-0-21swapper/211:52:582
29725040,0irq/27-eth0-tx-0-21swapper/211:48:042
29725040,0irq/27-eth0-tx-0-21swapper/211:43:112
29725040,0irq/27-eth0-tx-0-21swapper/211:22:552
29725040,0irq/27-eth0-tx-0-21swapper/210:03:072
29725040,0irq/27-eth0-tx-0-21swapper/209:59:172
29725040,0irq/27-eth0-tx-0-21swapper/209:42:522
29725040,0irq/27-eth0-tx-0-21swapper/209:28:072
29725040,0irq/27-eth0-tx-0-21swapper/209:22:572
29725040,0irq/27-eth0-tx-0-21swapper/209:18:232
29725040,0irq/27-eth0-tx-0-21swapper/209:08:022
29725040,0irq/27-eth0-tx-0-21swapper/008:43:030
29715040,0irq/26-eth0-rx-0-21swapper/311:53:063
29715040,0irq/26-eth0-rx-0-21swapper/311:45:023
29715040,0irq/26-eth0-rx-0-21swapper/311:35:043
29715040,0irq/26-eth0-rx-0-21swapper/311:04:093
29715040,0irq/26-eth0-rx-0-21swapper/310:45:313
29715040,0irq/26-eth0-rx-0-21swapper/310:22:493
29715040,0irq/26-eth0-rx-0-21swapper/310:12:513
29715040,0irq/26-eth0-rx-0-21swapper/310:03:013
29715040,0irq/26-eth0-rx-0-21swapper/309:33:123
29715040,0irq/26-eth0-rx-0-21swapper/309:31:343
29715040,0irq/26-eth0-rx-0-21swapper/309:24:483
29715040,0irq/26-eth0-rx-0-21swapper/308:58:003
29715040,0irq/26-eth0-rx-0-21swapper/308:51:223
29715040,0irq/26-eth0-rx-0-21swapper/307:28:023
259940,0migration/26109-21kthreadcore07:48:082
259940,0migration/24830-21munin-node08:33:102
259940,0migration/23652-21kthreadcore10:58:092
259940,0migration/225694-21fschecks_count08:28:042
259940,0migration/225076-21kthreadcore07:13:082
259940,0migration/222767-21taskset11:32:502
259940,0migration/219123-21kthreadcore10:08:062
259940,0migration/218753-21kthreadcore07:33:082
259940,0migration/21442-21diskmemload10:18:042
259940,0migration/210443-21kthreadcore08:38:082
249940,0watchdog/20-21swapper/210:48:002
249940,0watchdog/20-21swapper/210:43:082
249940,0watchdog/20-21swapper/210:13:082
249940,0watchdog/20-21swapper/206:53:092
211879943,0cyclictest9910-21awk10:23:042
211879943,0cyclictest4297-21awk07:23:082
211879943,0cyclictest4148-21awk08:58:052
211879943,0cyclictest3556-21lldpd11:58:012
211879943,0cyclictest3556-21lldpd09:53:002
211879943,0cyclictest3556-21lldpd08:24:292
211879943,0cyclictest3556-21lldpd08:24:292
211879943,0cyclictest3556-21lldpd08:12:592
211879943,0cyclictest3556-21lldpd08:09:592
211879943,0cyclictest3556-21lldpd08:03:002
211879943,0cyclictest3556-21lldpd07:59:292
211879943,0cyclictest3556-21lldpd07:52:592
211879943,0cyclictest3556-21lldpd07:39:292
211879943,0cyclictest3241-21irqbalance08:43:192
211879943,0cyclictest3241-21irqbalance06:57:592
211879943,0cyclictest32376-21awk11:18:072
211879943,0cyclictest29923-21awk07:18:072
211879943,0cyclictest16548-21awk07:08:062
211879943,0cyclictest12798-21awk08:18:052
211869944,0cyclictest0-21swapper/111:56:161
211869944,0cyclictest0-21swapper/111:36:241
211869944,0cyclictest0-21swapper/110:04:201
211869944,0cyclictest0-21swapper/107:39:551
211869943,0cyclictest7266-21awk11:43:051
211869943,0cyclictest3241-21irqbalance10:14:581
211869943,0cyclictest27175-21awk09:53:061
211869943,0cyclictest20579-21awk08:48:071
211869943,0cyclictest14691-21fschecks_count11:48:021
211859944,0cyclictest0-21swapper/010:56:380
211859944,0cyclictest0-21swapper/008:53:020
211859943,0cyclictest9176-21kworker/0:210:49:050
211859943,0cyclictest862-21wc06:53:090
211859943,0cyclictest3241-21irqbalance11:07:280
211859943,0cyclictest31695-21awk11:38:050
211859943,0cyclictest16519-21awk11:08:040
211859943,0cyclictest12813-21awk08:18:050
211859943,0cyclictest12673-21kworker/0:108:58:290
211859940,0cyclictest0-21swapper/008:38:020
179940,0migration/18829-21kthreadcore07:48:091
179940,0migration/17629-21latency06:58:091
179940,0migration/130663-21taskset10:54:081
179940,0migration/129070-21kthreadcore08:28:081
179940,0migration/128010-21kthreadcore11:13:101
179940,0migration/125131-21idleruntime08:03:061
179940,0migration/122293-21kthreadcore07:58:081
179940,0migration/117042-21kthreadcore08:18:081
179940,0migration/11671-21kthreadcore07:43:071
179940,0migration/116338-21missed_timers07:53:091
179940,0migration/113492-21kthreadcore09:23:071
179940,0migration/111186-21unixbench-2d08:13:131
169940,0watchdog/19442-21cut11:03:081
169940,0watchdog/18805-21forks10:43:041
169940,0watchdog/14397-21kthreadcore09:18:081
169940,0watchdog/13596-21irqcore09:38:081
169940,0watchdog/130835-21kthreadcore08:53:081
169940,0watchdog/128331-21kthreadcore09:33:081
169940,0watchdog/127006-21kthreadcore07:13:091
169940,0watchdog/124139-21python09:48:121
169940,0watchdog/116552-21grep12:08:081
169940,0watchdog/111369-21cut07:03:091
169940,0watchdog/110383-21kthreadcore08:38:081
169940,0watchdog/10-21swapper/112:12:591
169940,0watchdog/10-21swapper/109:58:121
169940,0watchdog/10-21swapper/109:28:081
149940,0migration/05470-21kthreadcore10:38:080
149940,0migration/04616-21kthreadcore09:38:090
149940,0migration/04114-21open_files08:08:110
149940,0migration/02591-21kthreadcore07:43:080
149940,0migration/014040-21fschecks_time12:08:040
149940,0migration/012003-21kthreadcore11:23:060
339930,0migration/323015-21fschecks_time07:13:053
29715030,0irq/26-eth0-rx-0-21swapper/307:52:453
29715030,0irq/26-eth0-rx-0-21swapper/307:43:023
29715030,0irq/26-eth0-rx-0-21swapper/307:40:343
29715030,0irq/26-eth0-rx-0-21swapper/307:24:073
29715030,0irq/26-eth0-rx-0-21swapper/306:56:393
29715030,0irq/26-eth0-rx-0-21swapper/306:48:263
211879932,0cyclictest3241-21irqbalance07:02:592
211879931,0cyclictest11110-21irqcore07:28:062
211869932,0cyclictest19421-21awk08:23:031
211869932,0cyclictest19421-21awk08:23:031
211869932,0cyclictest13798-21awk08:43:071
211869930,0cyclictest991-21kthreadcore11:38:061
211869930,0cyclictest22090-21automount07:12:341
211859933,0cyclictest9176-21kworker/0:211:13:070
211859933,0cyclictest3556-21lldpd09:48:000
211859933,0cyclictest25420-21kworker/0:207:18:340
211859933,0cyclictest25420-21kworker/0:207:03:100
211859933,0cyclictest12673-21kworker/0:109:12:510
211859933,0cyclictest12673-21kworker/0:109:07:510
211859932,0cyclictest24056-21grep07:38:050
211859931,0cyclictest22450-21telnet07:13:020
169930,0watchdog/131424-21munin-node11:18:041
169930,0watchdog/10-21swapper/111:28:081
169930,0watchdog/10-21swapper/111:24:321
169930,0watchdog/10-21swapper/110:28:001
169930,0watchdog/10-21swapper/107:33:091
169930,0watchdog/10-21swapper/107:28:011
169930,0watchdog/10-21swapper/107:18:131
339920,0migration/331365-21diskstats08:08:033
329920,0watchdog/35193-21python08:33:133
29715020,0irq/26-eth0-rx-16704-21ps07:33:013
29715020,0irq/26-eth0-rx-0-21swapper/308:12:513
211869920,0cyclictest3213-21cut07:22:511
211869920,0cyclictest0-21swapper/108:32:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional