You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 09:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Dec 15, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3202923727,0sleep30-21swapper/319:08:133
3211823627,0sleep20-21swapper/219:09:162
3179723524,0sleep10-21swapper/119:05:311
3202623329,0sleep00-21swapper/019:08:100
339970,0migration/324516-21sh22:36:273
322389976,0cyclictest1240-21kthreadcore21:10:052
29715070,0irq/26-eth0-rx-8033-21head20:00:113
339960,0migration/327610-21munin-node20:15:103
339960,0migration/311435-21kthreadcore21:15:073
322389960,0cyclictest0-21swapper/222:28:452
322379960,0cyclictest0-21swapper/122:54:481
322379960,0cyclictest0-21swapper/120:10:121
29725060,0irq/27-eth0-tx-30597-21munin-node21:10:040
29715060,0irq/26-eth0-rx-4520-21aten_r1power_cu21:50:023
29715060,0irq/26-eth0-rx-413-21cut23:00:073
29715060,0irq/26-eth0-rx-1828-21diskstats21:30:013
149960,0migration/028177-21kthreadcore22:40:060
149960,0migration/013201-21aten_r1power_en21:55:000
149960,0migration/013201-21aten_r1power_en21:55:000
339950,0migration/39622-21sh22:46:403
339950,0migration/38226-21kthreadcore23:05:053
339950,0migration/37822-21munin-node19:15:043
339950,0migration/37577-21gltestperf22:10:043
339950,0migration/34693-21kthreadcore23:40:053
339950,0migration/330020-21kthreadcore19:30:073
339950,0migration/329467-21kthreadcore23:55:073
339950,0migration/328971-21munin-node19:55:063
339950,0migration/328394-21latency_hist22:59:483
339950,0migration/327861-21kthreadcore22:40:063
339950,0migration/327256-21kthreadcore23:15:073
339950,0migration/325501-21kthreadcore22:20:073
339950,0migration/324871-21kthreadcore00:10:063
339950,0migration/323978-21aten_r1power_fr21:05:013
339950,0migration/321107-21kthreadcore23:50:063
339950,0migration/320493-21kthreadcore22:15:083
339950,0migration/32003-21kthreadcore21:10:053
339950,0migration/316261-21munin-node20:55:113
339950,0migration/315385-21munin-node20:10:023
339950,0migration/314873-21hwlatdetect00:25:023
339950,0migration/311280-21taskset00:04:113
339950,0migration/310696-21kthreadcore20:05:073
322389955,0cyclictest0-21swapper/223:44:542
322389955,0cyclictest0-21swapper/223:43:202
322389955,0cyclictest0-21swapper/220:35:052
322379955,0cyclictest0-21swapper/122:47:331
322379955,0cyclictest0-21swapper/119:15:011
322379950,0cyclictest0-21swapper/122:55:071
322369953,0cyclictest9499-21kworker/0:222:25:070
322369953,0cyclictest9499-21kworker/0:222:19:570
322369953,0cyclictest9499-21kworker/0:222:09:570
322369953,0cyclictest9499-21kworker/0:222:05:250
322369953,0cyclictest9499-21kworker/0:222:00:090
322369953,0cyclictest9499-21kworker/0:221:50:210
322369953,0cyclictest9499-21kworker/0:221:40:210
322369953,0cyclictest9499-21kworker/0:221:35:430
322369953,0cyclictest9499-21kworker/0:221:26:570
322369953,0cyclictest18538-21kworker/0:023:59:500
322369953,0cyclictest18538-21kworker/0:023:54:500
322369953,0cyclictest18538-21kworker/0:023:49:500
322369953,0cyclictest18538-21kworker/0:023:44:570
322369953,0cyclictest18538-21kworker/0:023:39:510
322369953,0cyclictest18538-21kworker/0:023:35:270
322369953,0cyclictest18538-21kworker/0:023:29:550
322369953,0cyclictest18538-21kworker/0:023:20:130
322369953,0cyclictest18538-21kworker/0:023:14:570
322369953,0cyclictest18538-21kworker/0:023:09:570
322369953,0cyclictest18538-21kworker/0:023:00:090
322369953,0cyclictest18538-21kworker/0:022:55:090
322369953,0cyclictest18538-21kworker/0:022:49:550
322369953,0cyclictest18538-21kworker/0:022:35:130
322369953,0cyclictest18538-21kworker/0:000:35:060
322369953,0cyclictest18538-21kworker/0:000:29:560
322369953,0cyclictest18538-21kworker/0:000:20:260
322369953,0cyclictest18538-21kworker/0:000:15:140
322369953,0cyclictest18538-21kworker/0:000:10:080
322369953,0cyclictest18538-21kworker/0:000:04:540
29725050,0irq/27-eth0-tx-3912-21munin-node20:50:030
29725050,0irq/27-eth0-tx-32445-21munin-node19:10:010
29725050,0irq/27-eth0-tx-27531-21ssh21:44:062
29725050,0irq/27-eth0-tx-24855-21munin-node21:25:092
29725050,0irq/27-eth0-tx-24853-21hddtemp_smartct22:20:042
29725050,0irq/27-eth0-tx-187142sleep019:20:100
29725050,0irq/27-eth0-tx-17250-21munin-node21:00:050
29725050,0irq/27-eth0-tx-16060-21perl22:15:042
29725050,0irq/27-eth0-tx-14468-21diskstats00:25:002
29725050,0irq/27-eth0-tx-0-21swapper/222:59:572
29725050,0irq/27-eth0-tx-0-21swapper/222:47:572
29725050,0irq/27-eth0-tx-0-21swapper/221:35:042
29725050,0irq/27-eth0-tx-0-21swapper/200:23:042
29725050,0irq/27-eth0-tx-0-21swapper/020:55:520
29725050,0irq/27-eth0-tx-0-21swapper/020:35:150
29725050,0irq/27-eth0-tx-0-21swapper/020:15:440
29725050,0irq/27-eth0-tx-0-21swapper/019:45:090
29715050,0irq/26-eth0-rx-31338-21kthreadcore20:20:073
29715050,0irq/26-eth0-rx-24206-21ssh21:24:133
29715050,0irq/26-eth0-rx-20262-21tr23:30:073
29715050,0irq/26-eth0-rx-17166-21sh21:36:183
29715050,0irq/26-eth0-rx-10409-21kthreadcore23:25:083
29715050,0irq/26-eth0-rx-0-21swapper/323:45:453
29715050,0irq/26-eth0-rx-0-21swapper/322:52:053
29715050,0irq/26-eth0-rx-0-21swapper/322:33:433
29715050,0irq/26-eth0-rx-0-21swapper/322:24:593
29715050,0irq/26-eth0-rx-0-21swapper/321:59:543
29715050,0irq/26-eth0-rx-0-21swapper/321:57:103
29715050,0irq/26-eth0-rx-0-21swapper/321:57:103
29715050,0irq/26-eth0-rx-0-21swapper/321:45:463
29715050,0irq/26-eth0-rx-0-21swapper/321:39:553
29715050,0irq/26-eth0-rx-0-21swapper/321:25:003
29715050,0irq/26-eth0-rx-0-21swapper/321:00:013
29715050,0irq/26-eth0-rx-0-21swapper/300:35:033
29715050,0irq/26-eth0-rx-0-21swapper/300:30:073
29715050,0irq/26-eth0-rx-0-21swapper/300:05:383
27150,0ktimersoftd/20-21swapper/221:18:192
259950,0migration/29207-21aten_r1power_vo22:30:022
259950,0migration/28773-21munin-node00:00:082
259950,0migration/27940-21unixbench-2d20:00:112
259950,0migration/232736-21switchtime23:55:122
259950,0migration/232066-21kthreadcore22:05:092
259950,0migration/229666-21kthreadcore22:40:062
259950,0migration/227527-21kthreadcore23:35:062
259950,0migration/221347-21kthreadcore21:00:072
259950,0migration/215296-21latency_hist20:09:502
249950,0watchdog/20-21swapper/222:10:082
19150,0ktimersoftd/10-21swapper/121:16:441
179950,0migration/17429-21taskset23:40:551
179950,0migration/15159-21kthreadcore00:00:051
179950,0migration/131616-21sh23:37:081
179950,0migration/12755-21sh23:59:421
179950,0migration/120923-21kthreadcore21:00:071
179950,0migration/113848-21kthreadcore21:35:071
179950,0migration/110330-21gltestperf23:45:041
169950,0watchdog/19443-21kthreadcore22:10:081
149950,0migration/08847-21kthreadcore21:15:060
149950,0migration/05941-21if_eth123:05:030
149950,0migration/05793-21kthreadcore22:45:060
149950,0migration/04537-21kthreadcore21:30:060
149950,0migration/030764-21irqcore20:45:040
149950,0migration/028315-21sh21:45:010
149950,0migration/026161-21taskset19:25:360
149950,0migration/018619-21kthreadcore00:25:050
149950,0migration/016006-21munin-node21:20:010
149950,0migration/015718-21cpuspeed_turbos22:15:030
149950,0migration/015602-21cpuspeed_turbos20:10:030
149950,0migration/012727-21kthreadcore20:30:060
149950,0migration/011050-21kthreadcore22:30:070
149950,0migration/010620-21kthreadcore23:25:080
339940,0migration/39204-21kthreadcore19:40:063
339940,0migration/330704-21irqcore20:45:043
339940,0migration/32326-21kthreadcore23:20:063
339940,0migration/318368-21kthreadcore20:35:093
339940,0migration/31758-21kthreadcore19:10:033
339940,0migration/310142-21taskset20:52:173
322389943,0cyclictest4764-21awk20:50:052
322389943,0cyclictest3556-21lldpd20:49:432
322389943,0cyclictest3556-21lldpd19:45:422
322389943,0cyclictest3514-21snmpd19:51:522
322389943,0cyclictest3514-21snmpd19:32:362
322389943,0cyclictest3514-21snmpd00:09:522
322389943,0cyclictest30117-21awk00:15:042
322389943,0cyclictest24799-21awk21:05:042
322389943,0cyclictest22927-21awk20:15:052
322389943,0cyclictest21075-21awk19:25:062
322389943,0cyclictest21008-21awk22:55:042
322389943,0cyclictest13241-21sadc19:19:502
322389943,0cyclictest0-21swapper/223:10:122
322379943,0cyclictest8656-21awk19:40:041
322379943,0cyclictest3556-21lldpd22:35:141
322379943,0cyclictest3514-21snmpd20:50:521
322379943,0cyclictest3514-21snmpd20:00:071
322379943,0cyclictest3514-21snmpd19:09:511
322379943,0cyclictest3514-21snmpd00:37:071
322379943,0cyclictest3514-21snmpd00:26:521
322379943,0cyclictest3514-21snmpd00:20:071
322379943,0cyclictest31485-21awk21:10:031
322379943,0cyclictest30324-21tail20:45:021
322379943,0cyclictest29147-21awk21:45:051
322379943,0cyclictest23212-21awk23:15:051
322379943,0cyclictest16816-21awk23:30:041
322369944,0cyclictest9499-21kworker/0:220:25:050
322369943,0cyclictest3514-21snmpd20:07:370
322369943,0cyclictest21939-21awk19:50:050
29725040,0irq/27-eth0-tx-17701-21ssh22:34:562
29725040,0irq/27-eth0-tx-15815-21ssh23:29:492
29725040,0irq/27-eth0-tx-11883-21ssh00:05:012
29725040,0irq/27-eth0-tx-0-21swapper/223:50:562
29725040,0irq/27-eth0-tx-0-21swapper/223:19:592
29725040,0irq/27-eth0-tx-0-21swapper/223:14:522
29725040,0irq/27-eth0-tx-0-21swapper/223:05:002
29725040,0irq/27-eth0-tx-0-21swapper/222:49:562
29725040,0irq/27-eth0-tx-0-21swapper/221:59:502
29725040,0irq/27-eth0-tx-0-21swapper/221:55:012
29725040,0irq/27-eth0-tx-0-21swapper/221:55:012
29725040,0irq/27-eth0-tx-0-21swapper/221:45:252
29725040,0irq/27-eth0-tx-0-21swapper/221:30:042
29725040,0irq/27-eth0-tx-0-21swapper/200:30:162
29725040,0irq/27-eth0-tx-0-21swapper/021:05:540
29725040,0irq/27-eth0-tx-0-21swapper/019:58:120
29725040,0irq/27-eth0-tx-0-21swapper/019:30:020
29715040,0irq/26-eth0-rx-22351-21munin-node19:50:063
29715040,0irq/26-eth0-rx-0-21swapper/323:34:503
29715040,0irq/26-eth0-rx-0-21swapper/323:10:013
29715040,0irq/26-eth0-rx-0-21swapper/322:04:563
29715040,0irq/26-eth0-rx-0-21swapper/320:32:413
29715040,0irq/26-eth0-rx-0-21swapper/300:20:003
29715040,0irq/26-eth0-rx-0-21swapper/300:16:493
259940,0migration/29174-21kthreadcore19:40:062
259940,0migration/27110-21kthreadcore21:50:072
259940,0migration/26163-21kthreadcore20:25:072
259940,0migration/231962-21fschecks_time00:35:052
259940,0migration/231037-21kthreadcore20:20:072
259940,0migration/216683-21sh21:20:032
259940,0migration/212418-21kthreadcore20:30:062
259940,0migration/211502-21kthreadcore23:25:082
249940,0watchdog/20-21swapper/220:05:082
249940,0watchdog/20-21swapper/219:20:082
249940,0watchdog/20-21swapper/219:10:082
179940,0migration/13427-21kthreadcore21:30:051
179940,0migration/130010-21kthreadcore22:40:071
179940,0migration/128925-21kthreadcore19:30:061
179940,0migration/126775-21switchtime19:50:121
179940,0migration/125781-21kthreadcore20:40:071
179940,0migration/125456-21kthreadcore22:20:071
179940,0migration/122741-21kthreadcore00:10:051
179940,0migration/120614-21irqrtprio21:40:051
179940,0migration/11953-21kthreadcore22:05:101
179940,0migration/118076-21latency_hist23:49:481
179940,0migration/117551-21kthreadcore23:10:071
179940,0migration/116740-21irqrtprio22:15:061
179940,0migration/115861-21kthreadcore21:55:061
179940,0migration/115861-21kthreadcore21:55:061
179940,0migration/11291-21kthreadcore23:00:071
169940,0watchdog/118350-21ssh00:05:511
169940,0watchdog/11331-21kthreadcore20:20:081
169940,0watchdog/111339-21ssh23:05:351
169940,0watchdog/10-21swapper/123:21:471
169940,0watchdog/10-21swapper/122:25:081
169940,0watchdog/10-21swapper/122:04:481
169940,0watchdog/10-21swapper/120:05:081
169940,0watchdog/10-21swapper/119:20:081
169940,0watchdog/10-21swapper/100:18:231
149940,0migration/08551-21kthreadcore19:15:050
149940,0migration/02735-21sh20:00:020
8215030,0irq/24-0000:00:0-21swapper/220:54:522
322379933,0cyclictest3241-21irqbalance20:34:591
322379933,0cyclictest3241-21irqbalance20:31:191
322379933,0cyclictest3241-21irqbalance19:55:091
322379933,0cyclictest24745-21awk21:05:041
322379932,0cyclictest8160-21awk23:25:061
322379932,0cyclictest6559-21runrttasks21:20:271
322379932,0cyclictest3869-21if_err_eth1.320:25:051
322379932,0cyclictest20981-21awk19:25:051
322379932,0cyclictest11534-21awk20:55:051
322379931,0cyclictest25999-21tr20:15:071
322379930,0cyclictest23130-21diskstats00:30:021
322369933,0cyclictest26576-21kworker/0:019:39:590
322369933,0cyclictest26576-21kworker/0:019:34:520
322369930,0cyclictest24100-21sed20:40:060
322369930,0cyclictest0-21swapper/020:20:020
29715030,0irq/26-eth0-rx-0-21swapper/320:40:013
29715030,0irq/26-eth0-rx-0-21swapper/320:25:023
29715030,0irq/26-eth0-rx-0-21swapper/319:45:223
29715030,0irq/26-eth0-rx-0-21swapper/319:38:213
29715030,0irq/26-eth0-rx-0-21swapper/319:25:023
29715030,0irq/26-eth0-rx-0-21swapper/319:20:033
259930,0migration/23544-21kthreadcore19:35:082
249930,0watchdog/20-21swapper/220:40:122
249930,0watchdog/20-21swapper/219:55:122
169930,0watchdog/10-21swapper/122:30:081
169930,0watchdog/10-21swapper/121:50:081
169930,0watchdog/10-21swapper/121:25:041
169930,0watchdog/10-21swapper/119:45:041
169930,0watchdog/10-21swapper/119:35:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional