You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 03, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191760,0ktimersoftd/15829-21perf18:50:471
1230124435,0sleep30-21swapper/318:49:293
1237123329,0sleep00-21swapper/018:50:220
1225223324,0sleep20-21swapper/218:48:552
339960,0migration/331273-21latency19:01:153
339960,0migration/326895-21sh21:00:433
339960,0migration/326502-21sh21:59:113
339960,0migration/326331-21sh22:39:333
339960,0migration/32083-21pmu-power20:16:163
339960,0migration/316523-21sh00:12:283
339960,0migration/310030-21sh23:09:403
29715060,0irq/26-eth0-rx-8732-21ssh22:26:193
29715060,0irq/26-eth0-rx-2348-21munin-run23:05:553
149960,0migration/030024-21irqcore20:16:120
149960,0migration/01338-21sh22:01:530
4150,0ktimersoftd/00-21swapper/023:18:150
35150,0ktimersoftd/30-21swapper/323:18:153
339950,0migration/39326-21kthreadcore20:46:153
339950,0migration/33480-21munin-node23:26:133
339950,0migration/330877-21kthreadcore19:51:123
339950,0migration/321962-21kthreadcore21:36:133
339950,0migration/320352-21munin-node18:56:123
339950,0migration/317289-21taskset22:51:593
339950,0migration/313045-21taskset19:11:393
339950,0migration/312345-21kthreadcore20:51:123
339950,0migration/311583-21cpu21:31:073
29725050,0irq/27-eth0-tx-26983-21munin-node19:26:100
29725050,0irq/27-eth0-tx-24894-21sed20:56:212
29725050,0irq/27-eth0-tx-21165-21grep21:36:122
29725050,0irq/27-eth0-tx-1879-21munin-run23:45:552
29725050,0irq/27-eth0-tx-1222-21munin-node19:31:180
29725050,0irq/27-eth0-tx-11681-21cpuspeed_turbos21:31:082
29725050,0irq/27-eth0-tx-10915-21munin-node22:51:132
29725050,0irq/27-eth0-tx-0-21swapper/018:56:300
29715050,0irq/26-eth0-rx-9018-21yum22:46:203
29715050,0irq/26-eth0-rx-525-21rt-features21:01:193
29715050,0irq/26-eth0-rx-3280-21aten_r1power_po21:46:063
29715050,0irq/26-eth0-rx-24328-21munin-node22:56:153
29715050,0irq/26-eth0-rx-18366-21kthreadcore20:31:123
29715050,0irq/26-eth0-rx-17153-21rt-features21:11:193
29715050,0irq/26-eth0-rx-13698-21kthreadcore23:31:143
29715050,0irq/26-eth0-rx-1338-21ssh22:01:533
29715050,0irq/26-eth0-rx-12148-21idleruntime21:51:083
29715050,0irq/26-eth0-rx-11908-21kthreadcore19:36:133
29715050,0irq/26-eth0-rx-0-21swapper/323:48:053
29715050,0irq/26-eth0-rx-0-21swapper/323:43:173
29715050,0irq/26-eth0-rx-0-21swapper/323:20:563
29715050,0irq/26-eth0-rx-0-21swapper/323:11:093
29715050,0irq/26-eth0-rx-0-21swapper/322:17:083
29715050,0irq/26-eth0-rx-0-21swapper/321:43:033
29715050,0irq/26-eth0-rx-0-21swapper/321:21:023
29715050,0irq/26-eth0-rx-0-21swapper/321:19:433
29715050,0irq/26-eth0-rx-0-21swapper/321:09:073
29715050,0irq/26-eth0-rx-0-21swapper/319:20:573
29715050,0irq/26-eth0-rx-0-21swapper/300:19:373
29715050,0irq/26-eth0-rx-0-21swapper/300:07:133
29715050,0irq/26-eth0-rx-0-21swapper/300:01:163
27150,0ktimersoftd/20-21swapper/222:06:492
249950,0watchdog/212528-21kthreadcore23:31:142
19150,0ktimersoftd/10-21swapper/123:18:151
179950,0migration/18591-21sh00:07:441
179950,0migration/131342-21kthreadcore23:21:131
179950,0migration/126939-21fschecks_time00:01:101
179950,0migration/118738-21kthreadcore20:06:111
179950,0migration/117986-21taskset22:53:591
179950,0migration/114616-21kthreadcore22:11:131
169950,0watchdog/13262-21perl23:06:101
169950,0watchdog/110491-21ssh22:30:181
149950,0migration/09812-21munin-node20:01:120
149950,0migration/05906-21kthreadcore23:26:150
149950,0migration/05513-21kthreadcore19:56:110
149950,0migration/05013-21kthreadcore20:21:120
149950,0migration/032535-21latency22:41:190
149950,0migration/029753-21kthreadcore00:01:140
149950,0migration/027139-21irqcore19:01:130
149950,0migration/024804-21missed_timers21:56:160
149950,0migration/01823-21latency_hist00:05:550
149950,0migration/017713-21kthreadcore20:06:110
149950,0migration/016427-21kthreadcore19:16:130
149950,0migration/015974-21kthreadcore21:11:150
149950,0migration/013067-21kthreadcore22:31:130
149950,0migration/012663-21smart_sdb19:11:180
149950,0migration/012340-21kthreadcore20:26:130
149950,0migration/011603-21fschecks_time20:51:070
149950,0migration/011142-21kthreadcore19:36:130
124979955,0cyclictest0-21swapper/222:27:002
124979955,0cyclictest0-21swapper/200:08:412
124979950,0cyclictest0-21swapper/222:58:132
124979950,0cyclictest0-21swapper/222:40:432
124979950,0cyclictest0-21swapper/222:19:072
124979950,0cyclictest0-21swapper/222:01:182
124969954,0cyclictest26973-21crond21:00:561
124959954,0cyclictest3038-21dump-pmu-power21:25:550
339940,0migration/38607-21needreboot22:06:153
339940,0migration/34361-21kthreadcore19:56:113
339940,0migration/32591-21kthreadcore19:06:123
339940,0migration/313197-21kthreadcore20:01:153
29725040,0irq/27-eth0-tx-3331-21munin-node21:26:072
29725040,0irq/27-eth0-tx-28504-21if_err_eth1.321:21:102
29725040,0irq/27-eth0-tx-27688-21perl23:01:092
29725040,0irq/27-eth0-tx-23667-21cut21:56:142
29725040,0irq/27-eth0-tx-0-21swapper/223:21:042
29725040,0irq/27-eth0-tx-0-21swapper/223:11:112
29725040,0irq/27-eth0-tx-0-21swapper/223:06:082
29725040,0irq/27-eth0-tx-0-21swapper/222:41:022
29725040,0irq/27-eth0-tx-0-21swapper/222:30:582
29725040,0irq/27-eth0-tx-0-21swapper/221:41:582
29725040,0irq/27-eth0-tx-0-21swapper/221:11:222
29725040,0irq/27-eth0-tx-0-21swapper/221:01:062
29725040,0irq/27-eth0-tx-0-21swapper/200:16:042
29725040,0irq/27-eth0-tx-0-21swapper/200:11:152
29725040,0irq/27-eth0-tx-0-21swapper/200:01:362
29715040,0irq/26-eth0-rx-0-21swapper/323:56:273
29715040,0irq/26-eth0-rx-0-21swapper/323:51:533
29715040,0irq/26-eth0-rx-0-21swapper/323:36:363
29715040,0irq/26-eth0-rx-0-21swapper/322:41:123
29715040,0irq/26-eth0-rx-0-21swapper/322:32:473
29715040,0irq/26-eth0-rx-0-21swapper/322:23:173
29715040,0irq/26-eth0-rx-0-21swapper/322:11:183
29715040,0irq/26-eth0-rx-0-21swapper/321:26:473
29715040,0irq/26-eth0-rx-0-21swapper/320:11:103
259940,0migration/26934-21kthreadcore22:46:122
259940,0migration/25957-21kthreadcore23:46:142
259940,0migration/230354-21kthreadcore22:21:132
259940,0migration/219259-21fschecks_time23:36:102
259940,0migration/219169-21if_err_eth1.223:56:122
259940,0migration/21554-21kthreadcore20:16:142
259940,0migration/210303-21runrttasks21:08:552
249940,0watchdog/22436-21kthreadcore20:41:142
249940,0watchdog/22007-21sed19:31:112
249940,0watchdog/20-21swapper/223:25:582
249940,0watchdog/20-21swapper/221:16:142
179940,0migration/15110-21kthreadcore19:31:141
179940,0migration/14764-21kthreadcore19:56:111
179940,0migration/14520-21irqcore21:26:121
179940,0migration/14043-21irqrtprio22:46:111
179940,0migration/14004-21kthreadcore23:46:131
179940,0migration/132527-21kthreadcore21:01:151
179940,0migration/13129-21sh21:45:571
179940,0migration/130909-21kthreadcore19:26:141
179940,0migration/126197-21kthreadcore19:46:141
179940,0migration/125003-21kthreadcore20:36:131
179940,0migration/124164-21kthreadcore19:21:131
179940,0migration/123410-21kthreadcore21:36:131
179940,0migration/116760-21runrttasks23:31:301
179940,0migration/113104-21kthreadcore20:01:151
169940,0watchdog/16559-21runrttasks23:05:101
169940,0watchdog/13514-21snmpd23:51:341
169940,0watchdog/131263-21ls19:01:151
169940,0watchdog/127601-21latency20:11:141
169940,0watchdog/124334-21unixbench_singl23:56:221
169940,0watchdog/122818-21ssh23:36:141
169940,0watchdog/122664-21kthreadcore21:56:141
169940,0watchdog/121711-21tr21:16:141
169940,0watchdog/119587-21fschecks_time22:56:101
169940,0watchdog/118384-21ssh21:13:261
169940,0watchdog/112242-21idleruntime21:31:101
169940,0watchdog/11183-21if_eth119:06:111
169940,0watchdog/10-21swapper/123:25:581
169940,0watchdog/10-21swapper/122:01:141
169940,0watchdog/10-21swapper/121:06:141
149940,0migration/09977-21taskset23:50:510
149940,0migration/09687-21sh22:48:140
149940,0migration/08383-21kthreadcore21:06:140
149940,0migration/08061-21kthreadcore21:46:120
149940,0migration/07006-21kthreadcore22:26:140
149940,0migration/028629-21irqcore21:41:120
149940,0migration/028620-21kthreadcore21:01:140
149940,0migration/025632-21runrttasks21:36:250
149940,0migration/025142-21kthreadcore19:46:130
149940,0migration/022086-21kthreadcore00:16:120
149940,0migration/014936-21kthreadcore22:51:110
149940,0migration/014735-21kthreadcore21:51:110
149940,0migration/010638-21runrttasks22:10:130
124979944,0cyclictest0-21swapper/221:47:162
124979943,0cyclictest3514-21snmpd19:46:052
124979943,0cyclictest3241-21irqbalance23:51:042
124979943,0cyclictest3241-21irqbalance21:51:142
124979943,0cyclictest3241-21irqbalance20:51:042
124979943,0cyclictest3241-21irqbalance20:46:542
124979943,0cyclictest3241-21irqbalance20:36:052
124979943,0cyclictest3241-21irqbalance20:31:352
124979943,0cyclictest3241-21irqbalance20:26:052
124979943,0cyclictest3241-21irqbalance20:21:152
124979943,0cyclictest3241-21irqbalance20:11:552
124979943,0cyclictest3241-21irqbalance20:02:052
124979943,0cyclictest3241-21irqbalance19:51:152
124979943,0cyclictest3241-21irqbalance19:41:052
124979943,0cyclictest3241-21irqbalance19:36:452
124979943,0cyclictest3241-21irqbalance19:21:452
124979943,0cyclictest3241-21irqbalance19:11:352
124979943,0cyclictest3241-21irqbalance19:06:052
124979943,0cyclictest3241-21irqbalance18:56:052
124979943,0cyclictest3241-21irqbalance18:51:252
124979943,0cyclictest3124-21awk19:56:092
124979943,0cyclictest27851-21awk19:26:112
124979943,0cyclictest26944-21awk19:01:122
124979943,0cyclictest19752-21awk23:16:112
124979943,0cyclictest16559-21awk20:06:092
124979943,0cyclictest14581-21awk19:16:112
124979943,0cyclictest12157-21awk22:11:112
124969943,0cyclictest3556-21lldpd20:51:481
124969943,0cyclictest3514-21snmpd22:35:361
124969943,0cyclictest3241-21irqbalance22:41:041
124969943,0cyclictest3241-21irqbalance22:39:041
124969943,0cyclictest3241-21irqbalance22:07:141
124969943,0cyclictest3241-21irqbalance21:42:241
124969943,0cyclictest3241-21irqbalance21:23:241
124969943,0cyclictest30869-21awk20:41:111
124969943,0cyclictest29886-21awk20:16:111
124969943,0cyclictest28237-21awk22:21:111
124969943,0cyclictest27493-21awk23:41:101
124969943,0cyclictest14533-21awk19:16:111
124969943,0cyclictest11738-21awk23:11:111
124969943,0cyclictest10879-21awk00:11:111
124959943,0cyclictest3556-21lldpd20:57:480
124959943,0cyclictest3556-21lldpd00:11:190
124959943,0cyclictest3514-21snmpd23:39:520
124959943,0cyclictest3514-21snmpd23:32:370
124959943,0cyclictest3514-21snmpd22:24:360
124959943,0cyclictest3514-21snmpd21:26:060
124959943,0cyclictest28934-21awk19:51:100
124959943,0cyclictest24499-21cut20:36:120
124959943,0cyclictest15524-21awk19:41:110
124959943,0cyclictest1254-21awk19:06:110
124959943,0cyclictest11647-21awk23:11:100
339930,0migration/324994-21kthreadcore20:36:133
29715030,0irq/26-eth0-rx-0-21swapper/320:26:073
29715030,0irq/26-eth0-rx-0-21swapper/320:22:323
29715030,0irq/26-eth0-rx-0-21swapper/319:42:293
29715030,0irq/26-eth0-rx-0-21swapper/319:31:083
29715030,0irq/26-eth0-rx-0-21swapper/319:26:083
29715030,0irq/26-eth0-rx-0-21swapper/318:51:093
179930,0migration/17967-21runrttasks19:36:041
179930,0migration/129800-21kthreadcore19:51:121
179930,0migration/118530-21fschecks_count00:16:081
169930,0watchdog/10-21swapper/122:16:061
149930,0migration/017389-21sh22:11:290
124969933,0cyclictest13686-21awk18:51:131
124969933,0cyclictest12261-21awk21:51:091
124969933,0cyclictest0-21swapper/120:46:261
124969932,0cyclictest8431-21kthreadcore19:11:121
124969932,0cyclictest3556-21lldpd20:29:181
124969932,0cyclictest20338-21awk18:56:121
124969932,0cyclictest15494-21awk19:41:111
124959933,0cyclictest0-21swapper/022:17:240
124959932,0cyclictest5158-21awk20:46:110
124959932,0cyclictest3556-21lldpd23:02:180
124959932,0cyclictest3556-21lldpd00:00:490
124959932,0cyclictest3514-21snmpd23:22:370
124959932,0cyclictest30854-21awk20:41:110
124959932,0cyclictest27412-21awk23:41:100
124959932,0cyclictest2674-21basename23:06:070
124959932,0cyclictest23186-21awk20:11:110
124959932,0cyclictest20328-21munin-node19:21:180
124959932,0cyclictest19623-21fschecks_time22:36:080
124959932,0cyclictest17634-21awk20:31:110
124959932,0cyclictest17306-21sh23:53:550
124959931,0cyclictest0-21swapper/018:50:570
124959930,0cyclictest20041-21diskstats21:16:100
124959930,0cyclictest0-21swapper/022:56:300
339920,0migration/320724-21diskstats19:21:083
329920,0watchdog/327318-21users19:46:193
29715020,0irq/26-eth0-rx-0-21swapper/320:42:013
29715020,0irq/26-eth0-rx-0-21swapper/320:06:073
169920,0watchdog/10-21swapper/120:30:581
169920,0watchdog/10-21swapper/120:20:581
124959921,0cyclictest11416-21cut21:31:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional