You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 04:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Sep 05, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450790,0irq/25-eth10-21swapper/318:42:333
1022727574,0sleep00-21swapper/018:42:270
1041623728,0sleep10-21swapper/118:44:361
1031023425,0sleep20-21swapper/218:43:252
105059970,0cyclictest18901-21smart_sdb23:30:100
339960,0migration/36681-21taskset21:20:443
339960,0migration/329925-21sh21:55:333
339960,0migration/329180-21fschecks_time00:00:033
339960,0migration/314329-21sh22:29:393
339960,0migration/311815-21sh23:26:443
29725060,0irq/27-eth0-tx-12702-21munin-node19:35:070
29715060,0irq/26-eth0-rx-26483-21kthreadcore22:55:073
29715060,0irq/26-eth0-rx-14393-21munin-run20:24:503
19160,0ktimersoftd/10-21swapper/121:18:271
149960,0migration/09295-21kthreadcore20:20:060
149960,0migration/016013-21idleruntime-cro21:29:500
105059966,0cyclictest0-21swapper/023:10:090
339950,0migration/39935-21kthreadcore22:05:093
339950,0migration/35938-21munin-node23:45:063
339950,0migration/3514-21kthreadcore22:40:063
339950,0migration/33923-21proc_pri19:00:103
339950,0migration/33523-21munin-node20:40:063
339950,0migration/329907-21taskset22:17:063
339950,0migration/325380-21df_abs19:20:023
339950,0migration/322160-21kthreadcore19:40:063
339950,0migration/320596-21aten_r1power_cu23:55:023
339950,0migration/31845-21kthreadcore23:20:063
339950,0migration/316953-21kthreadcore22:30:063
339950,0migration/316192-21latency_hist21:29:503
339950,0migration/31524-21kthreadcore22:20:063
339950,0migration/313713-21irqcore23:50:063
339950,0migration/311875-21munin-node18:45:043
339950,0migration/311710-21unixbench_multi23:05:113
339950,0migration/310652-21kthreadcore21:05:053
29725050,0irq/27-eth0-tx-25635-21kthreadcore22:55:072
29725050,0irq/27-eth0-tx-21065-21munin-node23:35:102
29725050,0irq/27-eth0-tx-19161-21ssh23:51:292
29725050,0irq/27-eth0-tx-0-21swapper/020:45:310
29715050,0irq/26-eth0-rx-7549-21taskset20:17:423
29715050,0irq/26-eth0-rx-30588-21fschecks_count23:00:043
29715050,0irq/26-eth0-rx-23927-21kernelversion22:35:053
29715050,0irq/26-eth0-rx-18371-21cut20:00:083
29715050,0irq/26-eth0-rx-13805-21fschecks_time23:30:023
29715050,0irq/26-eth0-rx-12115-21diskstats19:10:023
29715050,0irq/26-eth0-rx-0-21swapper/323:10:493
29715050,0irq/26-eth0-rx-0-21swapper/322:45:073
29715050,0irq/26-eth0-rx-0-21swapper/322:09:523
29715050,0irq/26-eth0-rx-0-21swapper/322:04:383
29715050,0irq/26-eth0-rx-0-21swapper/321:25:063
29715050,0irq/26-eth0-rx-0-21swapper/321:00:183
29715050,0irq/26-eth0-rx-0-21swapper/320:47:013
29715050,0irq/26-eth0-rx-0-21swapper/318:50:043
259950,0migration/23829-21kthreadcore21:20:062
249950,0watchdog/212138-21aten_r1power_fr00:09:592
179950,0migration/16938-21rt-features20:15:101
179950,0migration/128466-21latency_hist23:59:501
179950,0migration/126803-21kthreadcore18:55:071
179950,0migration/122231-21munin-node21:10:081
179950,0migration/119782-21idleruntime-cro00:14:491
179950,0migration/112017-21kthreadcore20:45:071
169950,0watchdog/118667-21users19:35:131
169950,0watchdog/114632-21iostat23:10:041
169950,0watchdog/111240-21ntp_states23:05:081
149950,0migration/06726-21aten_r1power_en22:24:580
149950,0migration/06254-21fschecks_time23:05:010
149950,0migration/06250-21timerandwakeup21:20:110
149950,0migration/031151-21aten_r1power_en22:20:000
149950,0migration/029989-21fschecks_count23:20:020
149950,0migration/028998-21kthreadcore20:10:060
149950,0migration/028799-21kthreadcore21:35:070
149950,0migration/02616-21kthreadcore19:25:070
149950,0migration/023880-21munin-node21:55:030
149950,0migration/02370-21kthreadcore21:00:070
149950,0migration/021811-21gltestperf23:35:020
149950,0migration/020526-21irqrtprio19:40:050
149950,0migration/019483-21munin-node20:00:130
149950,0migration/016141-21if_eth1.222:10:030
149950,0migration/01450-21unixbench_singl20:35:120
149950,0migration/014364-21kthreadcore23:50:070
105069955,0cyclictest0-21swapper/122:01:291
105069955,0cyclictest0-21swapper/121:28:231
105069955,0cyclictest0-21swapper/120:09:521
105069950,0cyclictest14404-21perf22:29:501
105069950,0cyclictest0-21swapper/123:59:351
105069950,0cyclictest0-21swapper/123:26:471
105069950,0cyclictest0-21swapper/123:03:371
105069950,0cyclictest0-21swapper/122:33:491
105069950,0cyclictest0-21swapper/122:07:291
105069950,0cyclictest0-21swapper/121:56:551
105069950,0cyclictest0-21swapper/121:41:471
105069950,0cyclictest0-21swapper/121:37:131
105059955,0cyclictest8694-21diskmemload22:15:270
105059955,0cyclictest0-21swapper/023:48:090
105059955,0cyclictest0-21swapper/022:37:120
105059950,0cyclictest0-21swapper/022:51:140
105059950,0cyclictest0-21swapper/021:14:070
8215040,0irq/24-0000:00:5942-21cat19:29:502
8215040,0irq/24-0000:00:0-21swapper/220:34:502
339940,0migration/38209-21kthreadcore00:05:053
339940,0migration/331409-21diskmemload20:55:563
339940,0migration/33037-21kthreadcore19:25:073
339940,0migration/326562-21kthreadcore23:15:073
339940,0migration/324672-21kthreadcore23:35:063
339940,0migration/320709-21kthreadcore19:15:063
339940,0migration/319801-21kthreadcore20:25:083
339940,0migration/314311-21aten_r1power_vo22:50:013
339940,0migration/313398-21fschecks_time19:35:033
29725040,0irq/27-eth0-tx-8694-21diskmemload21:19:492
29725040,0irq/27-eth0-tx-30490-21ssh21:35:352
29725040,0irq/27-eth0-tx-26029-21irqcore20:55:052
29725040,0irq/27-eth0-tx-16883-21munin-node20:50:022
29725040,0irq/27-eth0-tx-0-21swapper/223:20:202
29725040,0irq/27-eth0-tx-0-21swapper/223:10:062
29725040,0irq/27-eth0-tx-0-21swapper/222:45:212
29725040,0irq/27-eth0-tx-0-21swapper/222:35:162
29725040,0irq/27-eth0-tx-0-21swapper/222:25:002
29725040,0irq/27-eth0-tx-0-21swapper/222:20:182
29725040,0irq/27-eth0-tx-0-21swapper/222:00:002
29725040,0irq/27-eth0-tx-0-21swapper/221:54:522
29725040,0irq/27-eth0-tx-0-21swapper/221:30:432
29725040,0irq/27-eth0-tx-0-21swapper/221:26:172
29725040,0irq/27-eth0-tx-0-21swapper/221:00:082
29725040,0irq/27-eth0-tx-0-21swapper/200:02:112
29725040,0irq/27-eth0-tx-0-21swapper/020:15:100
29725040,0irq/27-eth0-tx-0-21swapper/019:10:480
29725040,0irq/27-eth0-tx-0-21swapper/019:05:020
29715040,0irq/26-eth0-rx-0-21swapper/323:39:583
29715040,0irq/26-eth0-rx-0-21swapper/321:50:063
29715040,0irq/26-eth0-rx-0-21swapper/321:48:033
29715040,0irq/26-eth0-rx-0-21swapper/321:42:463
29715040,0irq/26-eth0-rx-0-21swapper/321:37:013
29715040,0irq/26-eth0-rx-0-21swapper/321:15:013
29715040,0irq/26-eth0-rx-0-21swapper/321:10:503
29715040,0irq/26-eth0-rx-0-21swapper/320:49:573
29715040,0irq/26-eth0-rx-0-21swapper/300:11:283
259940,0migration/28323-21fschecks_time21:45:022
259940,0migration/24044-21kthreadcore20:15:062
259940,0migration/219515-21munin-node20:00:132
259940,0migration/211918-21kthreadcore20:45:072
259940,0migration/210051-21kthreadcore23:25:062
249940,0watchdog/227919-21kthreadcore19:45:092
249940,0watchdog/221265-21ntpq21:50:082
249940,0watchdog/210467-21python23:45:122
249940,0watchdog/20-21swapper/222:10:082
249940,0watchdog/20-21swapper/219:40:052
179940,0migration/1948-21kthreadcore23:20:061
179940,0migration/17161-21irqcore19:30:061
179940,0migration/16729-21kthreadcore23:45:071
179940,0migration/1513-21taskset20:59:521
179940,0migration/13737-21kthreadcore19:50:061
179940,0migration/132056-21kthreadcore19:00:061
179940,0migration/130796-21sh20:55:121
179940,0migration/126452-21kthreadcore22:55:071
179940,0migration/125128-21aten_r1power_po19:20:011
179940,0migration/124871-21kthreadcore22:35:061
179940,0migration/121471-21munin-node20:05:041
179940,0migration/118476-21kthreadcore20:25:071
179940,0migration/113241-21taskset19:57:301
179940,0migration/112057-21switchtime22:45:111
179940,0migration/111544-21kthreadcore21:45:061
169940,0watchdog/123769-21ssh20:52:201
169940,0watchdog/121519-21sh22:54:001
169940,0watchdog/115852-21cut21:50:001
169940,0watchdog/111101-21ssh00:07:471
169940,0watchdog/10-21swapper/122:15:041
169940,0watchdog/10-21swapper/122:10:081
169940,0watchdog/10-21swapper/121:23:161
169940,0watchdog/10-21swapper/118:50:091
149940,0migration/09684-21kthreadcore19:55:060
149940,0migration/07762-21fschecks_count22:05:050
149940,0migration/07704-21kthreadcore23:25:050
149940,0migration/07270-21kthreadcore00:05:050
149940,0migration/06291-21runrttasks21:41:200
149940,0migration/05674-21missed_timers19:50:070
149940,0migration/028039-21kthreadcore21:15:050
149940,0migration/024617-21taskset19:17:550
149940,0migration/023954-21sh20:52:460
149940,0migration/022278-21irqcore20:30:050
149940,0migration/021972-21latency_hist22:54:500
149940,0migration/016707-21kthreadcore22:30:060
149940,0migration/015304-21fschecks_time20:25:040
149940,0migration/014783-21kthreadcore18:45:050
149940,0migration/012901-21runrttasks22:46:510
149940,0migration/010032-21irqrtprio21:05:050
105089943,0cyclictest602-21awk21:40:052
105089943,0cyclictest3556-21lldpd22:05:062
105089943,0cyclictest3556-21lldpd21:11:062
105089943,0cyclictest3556-21lldpd21:06:352
105089943,0cyclictest3556-21lldpd19:20:352
105089943,0cyclictest3556-21lldpd19:16:042
105089943,0cyclictest3514-21snmpd19:07:172
105089943,0cyclictest3241-21irqbalance23:29:582
105089943,0cyclictest3241-21irqbalance23:14:582
105089943,0cyclictest3241-21irqbalance23:05:082
105089943,0cyclictest3241-21irqbalance22:49:582
105089943,0cyclictest3241-21irqbalance22:30:482
105089943,0cyclictest3241-21irqbalance20:40:082
105089943,0cyclictest3241-21irqbalance20:25:592
105089943,0cyclictest3241-21irqbalance20:19:592
105089943,0cyclictest3241-21irqbalance20:09:592
105089943,0cyclictest3241-21irqbalance20:05:092
105089943,0cyclictest3241-21irqbalance19:56:492
105089943,0cyclictest3241-21irqbalance19:49:592
105089943,0cyclictest3241-21irqbalance19:37:292
105089943,0cyclictest3241-21irqbalance00:04:582
105089943,0cyclictest31549-21awk22:40:042
105089943,0cyclictest30942-21awk23:00:062
105089943,0cyclictest29988-21awk23:40:042
105089943,0cyclictest23990-21awk22:15:032
105089943,0cyclictest22216-21awk20:30:052
105089943,0cyclictest18349-21awk18:50:072
105089943,0cyclictest12700-21awk19:10:052
105089941,0cyclictest0-21swapper/223:55:022
105069944,0cyclictest0-21swapper/122:44:411
105069943,0cyclictest5874-21awk19:05:031
105069943,0cyclictest4363-21sadc23:44:491
105069943,0cyclictest3556-21lldpd23:37:371
105069943,0cyclictest3556-21lldpd23:17:071
105069943,0cyclictest3556-21lldpd22:20:071
105069943,0cyclictest3514-21snmpd20:20:321
105069943,0cyclictest3241-21irqbalance23:52:181
105069943,0cyclictest3023-21awk20:40:041
105069943,0cyclictest19223-21awk19:15:041
105069943,0cyclictest17261-21awk21:30:051
105069943,0cyclictest14583-21awk20:00:051
105069943,0cyclictest14044-21awk23:30:041
105069943,0cyclictest11599-21awk18:45:031
105059944,0cyclictest0-21swapper/018:49:510
105059943,0cyclictest8734-21awk21:45:040
105059943,0cyclictest3556-21lldpd23:57:370
105059943,0cyclictest3556-21lldpd22:43:070
105059943,0cyclictest3514-21snmpd18:58:320
105059943,0cyclictest32477-21awk22:00:030
105059943,0cyclictest3241-21irqbalance00:01:180
105059943,0cyclictest31675-21awk19:00:050
105059943,0cyclictest30909-21awk23:00:050
105059943,0cyclictest16685-21awk21:50:040
29715030,0irq/26-eth0-rx-0-21swapper/320:30:013
29715030,0irq/26-eth0-rx-0-21swapper/320:11:523
29715030,0irq/26-eth0-rx-0-21swapper/320:05:003
29715030,0irq/26-eth0-rx-0-21swapper/319:56:023
29715030,0irq/26-eth0-rx-0-21swapper/319:50:093
29715030,0irq/26-eth0-rx-0-21swapper/319:30:023
29715030,0irq/26-eth0-rx-0-21swapper/318:55:103
249930,0watchdog/20-21swapper/218:55:052
249930,0watchdog/20-21swapper/218:45:012
169930,0watchdog/131701-21aten2.4-expect19:25:011
169930,0watchdog/10-21swapper/121:04:561
169930,0watchdog/10-21swapper/119:45:091
169930,0watchdog/10-21swapper/119:10:011
105089932,0cyclictest32559-21awk19:25:042
105089932,0cyclictest31140-21sort19:00:032
105069932,0cyclictest911-21netstat20:35:071
105069932,0cyclictest20324-21awk19:40:051
105059933,0cyclictest0-21swapper/020:55:210
105059932,0cyclictest6969-21awk19:30:050
105059932,0cyclictest3556-21lldpd21:30:060
105059932,0cyclictest3556-21lldpd20:05:050
105059932,0cyclictest3556-21lldpd00:10:380
105059932,0cyclictest29931-21awk23:40:030
105059932,0cyclictest26983-21awk19:45:070
105059930,0cyclictest22281-21perl23:15:030
105059930,0cyclictest0-21swapper/020:40:020
329920,0watchdog/37124-21cut19:05:063
329920,0watchdog/330617-21kthreadcore19:45:093
329920,0watchdog/30-21swapper/320:35:053
105069921,0cyclictest0-21swapper/120:29:501
105059920,0cyclictest0-21swapper/019:20:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional