You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 16, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1193427271,0sleep20-21swapper/218:45:342
304450580,0irq/25-eth10-21swapper/318:44:033
1173823523,0sleep00-21swapper/018:43:160
1170623221,0sleep10-21swapper/118:42:571
339960,0migration/3473-21sh21:19:273
339960,0migration/331136-21munin-node18:57:053
339960,0migration/330558-21sh22:17:383
339960,0migration/329481-21sh23:19:453
339960,0migration/328147-21sh23:37:213
339960,0migration/32604-21taskset20:16:433
339960,0migration/325550-21sh20:54:543
339960,0migration/323462-21latency_hist22:36:443
339960,0migration/318338-21taskset18:47:123
339960,0migration/312367-21sh23:49:263
29715060,0irq/26-eth0-rx-26863-21sed20:56:583
29715060,0irq/26-eth0-rx-0-21swapper/321:52:013
19160,0ktimersoftd/16392-21perf19:06:451
149960,0migration/031575-21taskset21:58:500
149960,0migration/029248-21sh22:57:100
149960,0migration/025435-21sh21:15:410
121069966,0cyclictest0-21swapper/221:38:292
121069966,0cyclictest0-21swapper/221:33:352
121069960,0cyclictest10320-21diskmemload23:28:122
121069960,0cyclictest0-21swapper/222:20:062
121059960,0cyclictest0-21swapper/123:50:011
8215050,0irq/24-0000:00:32065-21dump-pmu-power19:06:402
339950,0migration/38895-21cpuspeed_turbos19:56:553
339950,0migration/38231-21mdstat20:17:023
339950,0migration/34751-21kthreadcore19:27:033
339950,0migration/330591-21sh23:01:183
339950,0migration/329772-21munin-node20:36:573
339950,0migration/326705-21kernelversion21:37:043
339950,0migration/323885-21kthreadcore23:57:023
339950,0migration/318405-21cpuspeed_turbos21:11:583
339950,0migration/31641-21kthreadcore19:02:013
339950,0migration/315559-21munin-node19:37:033
339950,0migration/312988-21needreboot19:32:043
339950,0migration/312712-21kthreadcore21:27:013
339950,0migration/312704-21taskset00:11:473
339950,0migration/311883-21kthreadcore20:22:033
29725050,0irq/27-eth0-tx-2730-21tr23:02:022
29725050,0irq/27-eth0-tx-26747-21cpuspeed_turbos20:56:572
29725050,0irq/27-eth0-tx-17461-21perl21:51:572
29725050,0irq/27-eth0-tx-15530-21ssh22:10:082
29725050,0irq/27-eth0-tx-10304-21cut22:27:012
29725050,0irq/27-eth0-tx-0-21swapper/223:39:502
29725050,0irq/27-eth0-tx-0-21swapper/222:31:552
29725050,0irq/27-eth0-tx-0-21swapper/221:30:482
29725050,0irq/27-eth0-tx-0-21swapper/200:16:302
29725050,0irq/27-eth0-tx-0-21swapper/020:47:110
29725050,0irq/27-eth0-tx-0-21swapper/020:24:320
29725050,0irq/27-eth0-tx-0-21swapper/020:11:440
29715050,0irq/26-eth0-rx-7294-21irqrtprio23:27:013
29715050,0irq/26-eth0-rx-6559-21runrttasks22:52:483
29715050,0irq/26-eth0-rx-6113-21kthreadcore19:52:023
29715050,0irq/26-eth0-rx-3514-21snmpd21:36:403
29715050,0irq/26-eth0-rx-30404-21munin-node23:21:553
29715050,0irq/26-eth0-rx-27335-21kthreadcore20:32:003
29715050,0irq/26-eth0-rx-18465-21kthreadcore22:12:023
29715050,0irq/26-eth0-rx-16416-21kthreadcore23:32:023
29715050,0irq/26-eth0-rx-0-21swapper/323:52:003
29715050,0irq/26-eth0-rx-0-21swapper/323:09:013
29715050,0irq/26-eth0-rx-0-21swapper/323:09:013
29715050,0irq/26-eth0-rx-0-21swapper/322:41:433
29715050,0irq/26-eth0-rx-0-21swapper/321:57:023
29715050,0irq/26-eth0-rx-0-21swapper/321:08:383
29715050,0irq/26-eth0-rx-0-21swapper/300:08:313
29715050,0irq/26-eth0-rx-0-21swapper/300:01:553
27150,0ktimersoftd/20-21swapper/219:36:462
259950,0migration/29493-21kthreadcore22:47:012
259950,0migration/27673-21kthreadcore20:42:022
259950,0migration/232298-21kthreadcore23:22:002
259950,0migration/212369-21munin-node23:07:062
259950,0migration/212369-21munin-node23:07:062
259950,0migration/212355-21switchtime19:07:092
249950,0watchdog/229035-21tr21:57:022
249950,0watchdog/222908-21kthreadcore23:57:022
249950,0watchdog/217292-21kthreadcore22:52:022
249950,0watchdog/214721-21tune2fs23:31:582
249950,0watchdog/211724-21cat20:22:032
19150,0ktimersoftd/10-21swapper/119:21:031
179950,0migration/19415-21kthreadcore22:47:011
179950,0migration/18928-21fschecks_count22:06:561
179950,0migration/17551-21timerwakeupswit21:22:071
179950,0migration/17463-21latency_hist19:31:451
179950,0migration/14248-21kthreadcore22:02:001
179950,0migration/128488-21latency_hist20:11:451
179950,0migration/127250-21kthreadcore22:17:011
179950,0migration/123690-21sh21:54:031
179950,0migration/114351-21latency_hist23:11:441
179950,0migration/114351-21latency_hist23:11:441
179950,0migration/110652-21switchtime00:07:071
149950,0migration/08256-21runrttasks21:23:420
149950,0migration/08192-21latency_hist22:06:440
149950,0migration/06153-21kthreadcore19:52:020
149950,0migration/0544-21taskset19:26:440
149950,0migration/05318-21kthreadcore20:17:000
149950,0migration/05193-21kthreadcore21:02:010
149950,0migration/04069-21kthreadcore19:27:020
149950,0migration/032406-21kthreadcore23:22:000
149950,0migration/030742-21latency21:37:050
149950,0migration/02913-21timerandwakeup20:37:070
149950,0migration/028621-21sh00:00:500
149950,0migration/028126-40yum-updatesd23:37:180
149950,0migration/026324-21latency_hist20:56:440
149950,0migration/024453-21cpu22:16:560
149950,0migration/020750-21idleruntime-cro19:41:450
149950,0migration/017605-21kthreadcore22:32:030
149950,0migration/01583-21fschecks_time21:41:570
149950,0migration/015614-21kthreadcore23:32:020
149950,0migration/013615-21munin-node00:11:580
149950,0migration/013474-21kthreadcore22:07:010
149950,0migration/011201-21kthreadcore23:27:020
149950,0migration/010999-21hwlatdetect21:06:580
149950,0migration/010664-21kthreadcore23:47:040
149950,0migration/010194-21taskset20:45:300
121069955,0cyclictest0-21swapper/221:43:222
121069950,0cyclictest0-21swapper/223:16:232
121069950,0cyclictest0-21swapper/222:40:362
121069950,0cyclictest0-21swapper/222:25:182
121059955,0cyclictest13214-21sh23:30:091
121059955,0cyclictest0-21swapper/121:43:531
121059955,0cyclictest0-21swapper/120:52:491
121059954,0cyclictest3514-21snmpd23:58:571
121059950,0cyclictest0-21swapper/122:35:551
121059950,0cyclictest0-21swapper/122:15:441
121059950,0cyclictest0-21swapper/121:29:141
121059950,0cyclictest0-21swapper/100:15:521
4140,0ktimersoftd/06393-21munin-run19:06:450
339940,0migration/325971-21taskset19:17:153
339940,0migration/321190-21unixbench-2d20:02:113
339940,0migration/31850-21cpuspeed_turbos21:21:563
339940,0migration/312973-21kthreadcore20:47:023
339940,0migration/310230-21kernelversion21:47:013
29725040,0irq/27-eth0-tx-5572-21ssh23:46:582
29725040,0irq/27-eth0-tx-31600-21munin-node22:41:572
29725040,0irq/27-eth0-tx-29196-21munin-node00:02:062
29725040,0irq/27-eth0-tx-24518-21ssh21:12:542
29725040,0irq/27-eth0-tx-16372-21ssh21:07:162
29725040,0irq/27-eth0-tx-0-21swapper/223:41:582
29725040,0irq/27-eth0-tx-0-21swapper/222:59:022
29725040,0irq/27-eth0-tx-0-21swapper/222:11:542
29725040,0irq/27-eth0-tx-0-21swapper/221:47:212
29725040,0irq/27-eth0-tx-0-21swapper/220:52:062
29725040,0irq/27-eth0-tx-0-21swapper/019:17:010
29725040,0irq/27-eth0-tx-0-21swapper/019:07:070
29725040,0irq/27-eth0-tx-0-21swapper/018:46:570
29715040,0irq/26-eth0-rx-32344-21kthreadcore23:02:013
29715040,0irq/26-eth0-rx-27946-21df_abs19:46:573
29715040,0irq/26-eth0-rx-0-21swapper/323:42:033
29715040,0irq/26-eth0-rx-0-21swapper/323:11:513
29715040,0irq/26-eth0-rx-0-21swapper/322:48:573
29715040,0irq/26-eth0-rx-0-21swapper/322:42:083
29715040,0irq/26-eth0-rx-0-21swapper/322:27:323
29715040,0irq/26-eth0-rx-0-21swapper/322:22:013
29715040,0irq/26-eth0-rx-0-21swapper/322:06:543
29715040,0irq/26-eth0-rx-0-21swapper/322:04:443
29715040,0irq/26-eth0-rx-0-21swapper/321:42:293
29715040,0irq/26-eth0-rx-0-21swapper/321:01:563
29715040,0irq/26-eth0-rx-0-21swapper/319:42:023
259940,0migration/22715-21kthreadcore22:02:002
259940,0migration/225614-21munin-node19:17:072
259940,0migration/22298-21aten_r1power_vo21:01:562
259940,0migration/216181-21pmu-power20:47:052
259940,0migration/210591-21smart_sdb00:07:072
249940,0watchdog/222439-21chrt23:16:462
249940,0watchdog/219127-21python23:52:062
249940,0watchdog/20-21swapper/220:26:552
179940,0migration/18934-21munin-node20:17:071
179940,0migration/126813-21cpu19:21:571
179940,0migration/126791-21cpuspeed_turbos20:56:571
179940,0migration/125323-21latency_hist21:36:441
179940,0migration/120662-21needreboot20:02:071
179940,0migration/117496-21irqrtprio20:26:591
179940,0migration/11503-21kthreadcore20:37:021
179940,0migration/114109-21aten_r1power_fr23:31:561
179940,0migration/113076-21idleruntime-cro19:11:451
179940,0migration/11289-21runrttasks19:47:561
179940,0migration/112688-21munin-node20:22:031
169940,0watchdog/19532-21ssh21:05:311
169940,0watchdog/15416-21chrt23:25:461
169940,0watchdog/123076-21cut23:37:021
169940,0watchdog/116619-21ssh21:08:031
169940,0watchdog/10-21swapper/123:11:541
169940,0watchdog/10-21swapper/123:02:381
169940,0watchdog/10-21swapper/122:52:021
169940,0watchdog/10-21swapper/122:42:021
169940,0watchdog/10-21swapper/121:57:021
169940,0watchdog/10-21swapper/121:17:031
169940,0watchdog/10-21swapper/120:47:031
169940,0watchdog/10-21swapper/120:12:031
169940,0watchdog/10-21swapper/119:11:591
149940,0migration/030290-21sh22:38:370
149940,0migration/029967-21aten_r1power_fr23:41:580
149940,0migration/029775-21kthreadcore21:17:000
149940,0migration/028968-21sh23:18:110
149940,0migration/015530-21cpuspeed_turbos20:02:000
149940,0migration/014510-21sh23:11:480
149940,0migration/012612-21timerwakeupswit23:07:080
149940,0migration/012612-21timerwakeupswit23:07:080
121069943,0cyclictest3556-21lldpd20:37:332
121069943,0cyclictest3556-21lldpd20:10:332
121069943,0cyclictest3556-21lldpd19:58:332
121069943,0cyclictest3556-21lldpd19:50:322
121069943,0cyclictest3556-21lldpd19:35:022
121069943,0cyclictest3556-21lldpd19:27:032
121069943,0cyclictest3556-21lldpd19:24:032
121069943,0cyclictest2778-21awk19:52:002
121069943,0cyclictest26981-21awk21:16:582
121069943,0cyclictest26458-21awk18:56:592
121069943,0cyclictest2533-21awk21:22:002
121069943,0cyclictest19927-21awk18:52:012
121069943,0cyclictest14153-21awk19:12:002
121069943,0cyclictest13229-21awk18:47:012
121059944,0cyclictest6043-21ssh22:22:221
121059944,0cyclictest10320-21diskmemload00:06:251
121059943,0cyclictest3514-21snmpd23:53:571
121059943,0cyclictest3514-21snmpd23:42:261
121059943,0cyclictest3514-21snmpd19:33:551
121059943,0cyclictest3514-21snmpd18:47:241
121059943,0cyclictest23985-21awk22:56:591
121059943,0cyclictest19903-21awk18:52:011
121059943,0cyclictest15186-21awk19:37:011
121049943,0cyclictest8699-21awk22:26:590
121049943,0cyclictest8239-21awk22:46:590
121049943,0cyclictest5632-21awk00:06:590
121049943,0cyclictest3514-21snmpd22:25:410
121049943,0cyclictest3514-21snmpd19:01:100
121049943,0cyclictest32486-21awk22:42:000
121049943,0cyclictest3241-21irqbalance21:36:230
121049943,0cyclictest28550-21awk19:47:000
121049943,0cyclictest27445-21awk20:57:000
121049943,0cyclictest25390-21sadc18:56:450
4130,0ktimersoftd/00-21swapper/019:56:530
29715030,0irq/26-eth0-rx-0-21swapper/320:30:353
29715030,0irq/26-eth0-rx-0-21swapper/320:10:003
29715030,0irq/26-eth0-rx-0-21swapper/319:25:023
29715030,0irq/26-eth0-rx-0-21swapper/319:11:503
29715030,0irq/26-eth0-rx-0-21swapper/319:09:573
259930,0migration/26429-21kthreadcore20:17:012
249930,0watchdog/20-21swapper/220:11:592
249930,0watchdog/20-21swapper/220:02:032
179930,0migration/126553-21ksmtuned18:57:001
179930,0migration/126373-21runrttasks19:42:031
179930,0migration/110058-21runrttasks20:43:551
169930,0watchdog/10-21swapper/123:17:021
169930,0watchdog/10-21swapper/122:36:581
169930,0watchdog/10-21swapper/121:31:501
121069931,0cyclictest0-21swapper/220:31:572
121069930,0cyclictest0-21swapper/219:41:492
121059933,0cyclictest2739-21awk19:51:591
121059932,0cyclictest9552-21grep21:46:581
121059932,0cyclictest3514-21snmpd22:26:561
121059932,0cyclictest23614-21grep21:12:051
121059932,0cyclictest23468-21grep20:31:561
121049933,0cyclictest32138-21kworker/0:020:31:580
121049933,0cyclictest24187-21kworker/0:121:47:000
121049933,0cyclictest20948-21kworker/0:123:52:270
121049933,0cyclictest20948-21kworker/0:123:01:490
121049933,0cyclictest20948-21kworker/0:122:52:090
121049933,0cyclictest20948-21kworker/0:100:01:530
121049933,0cyclictest17662-21kworker/0:022:11:570
121049933,0cyclictest17662-21kworker/0:021:52:020
121049932,0cyclictest9535-21munin-node21:26:570
121049932,0cyclictest21678-21grep19:41:580
121049932,0cyclictest1843-21sensors20:12:080
121049932,0cyclictest175212kthreadcore19:12:030
121049932,0cyclictest17175-21awk20:26:580
121049931,0cyclictest0-21swapper/019:36:380
35120,0ktimersoftd/38686-21kthreadcore20:42:023
29715020,0irq/26-eth0-rx-0-21swapper/318:51:523
121059920,0cyclictest8544-21date19:56:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional