You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 09:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Apr 29, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1516323624,0sleep00-21swapper/018:56:390
1500123625,0sleep30-21swapper/318:54:463
1507023523,0sleep20-21swapper/218:55:332
1498923323,0sleep10-21swapper/118:54:361
15280991111,0cyclictest0-21swapper/020:58:060
152829976,0cyclictest30487-21turbostat21:27:072
35160,0ktimersoftd/30-21swapper/321:08:453
339960,0migration/329505-21sh22:26:303
339960,0migration/327963-21sh23:23:593
339960,0migration/322719-21fschecks_time19:02:213
339960,0migration/320858-21sh22:19:453
339960,0migration/320785-21munin-node20:37:243
339960,0migration/319557-21sh00:19:483
339960,0migration/314602-21sh21:37:203
339960,0migration/313165-21sh22:36:223
29725060,0irq/27-eth0-tx-6153-21munin-node21:12:212
29715060,0irq/26-eth0-rx-20715-21cut19:47:243
19160,0ktimersoftd/10-21swapper/121:08:451
152829966,0cyclictest0-21swapper/220:58:082
152819960,0cyclictest13682-21diskmemload23:07:401
149960,0migration/05467-21kthreadcore19:12:260
149960,0migration/021392-21sh21:39:420
339950,0migration/38243-21kthreadcore22:52:243
339950,0migration/37572-21cpuspeed_turbos20:52:203
339950,0migration/35955-21kthreadcore00:12:233
339950,0migration/34128-21irqcore19:12:253
339950,0migration/33625-21kthreadcore20:22:243
339950,0migration/332104-21kthreadcore22:27:253
339950,0migration/331630-21kthreadcore19:32:233
339950,0migration/330232-21munin-node00:07:243
339950,0migration/328936-21taskset22:04:113
339950,0migration/326788-21kthreadcore21:22:243
339950,0migration/324620-21kthreadcore00:22:243
339950,0migration/31979-21munin-node19:07:283
339950,0migration/318198-21taskset20:10:313
339950,0migration/316928-21kthreadcore22:37:273
339950,0migration/313961-21irqcore20:32:243
29725050,0irq/27-eth0-tx-6200-21munin-node20:27:200
29725050,0irq/27-eth0-tx-5243-21cpu23:32:192
29725050,0irq/27-eth0-tx-29797-21munin-node22:47:202
29725050,0irq/27-eth0-tx-25234-21munin-node20:17:210
29725050,0irq/27-eth0-tx-16608-21telnet19:22:210
29725050,0irq/27-eth0-tx-15495-21munin-node18:57:220
29725050,0irq/27-eth0-tx-14487-21cut23:57:242
29725050,0irq/27-eth0-tx-0-21swapper/223:12:112
29725050,0irq/27-eth0-tx-0-21swapper/223:11:572
29725050,0irq/27-eth0-tx-0-21swapper/222:59:092
29725050,0irq/27-eth0-tx-0-21swapper/222:38:082
29725050,0irq/27-eth0-tx-0-21swapper/222:07:102
29725050,0irq/27-eth0-tx-0-21swapper/222:04:282
29725050,0irq/27-eth0-tx-0-21swapper/221:50:462
29725050,0irq/27-eth0-tx-0-21swapper/221:32:172
29725050,0irq/27-eth0-tx-0-21swapper/221:30:242
29725050,0irq/27-eth0-tx-0-21swapper/200:14:022
29725050,0irq/27-eth0-tx-0-21swapper/200:04:192
29725050,0irq/27-eth0-tx-0-21swapper/020:38:570
29725050,0irq/27-eth0-tx-0-21swapper/019:40:340
29725050,0irq/27-eth0-tx-0-21swapper/019:17:300
29715050,0irq/26-eth0-rx-9485-21tr23:32:243
29715050,0irq/26-eth0-rx-7094-21fschecks_time21:32:193
29715050,0irq/26-eth0-rx-6559-21runrttasks21:56:243
29715050,0irq/26-eth0-rx-5636-21idleruntime23:52:213
29715050,0irq/26-eth0-rx-3514-21snmpd23:40:153
29715050,0irq/26-eth0-rx-30970-21cut23:27:253
29715050,0irq/26-eth0-rx-23951-21grep21:42:243
29715050,0irq/26-eth0-rx-21840-21smartctl23:42:213
29715050,0irq/26-eth0-rx-19884-21kthreadcore20:12:253
29715050,0irq/26-eth0-rx-0-21swapper/323:47:143
29715050,0irq/26-eth0-rx-0-21swapper/323:17:243
29715050,0irq/26-eth0-rx-0-21swapper/323:03:153
29715050,0irq/26-eth0-rx-0-21swapper/322:12:253
29715050,0irq/26-eth0-rx-0-21swapper/321:57:253
29715050,0irq/26-eth0-rx-0-21swapper/321:47:243
29715050,0irq/26-eth0-rx-0-21swapper/321:27:253
29715050,0irq/26-eth0-rx-0-21swapper/321:12:253
29715050,0irq/26-eth0-rx-0-21swapper/321:06:543
29715050,0irq/26-eth0-rx-0-21swapper/320:27:253
29715050,0irq/26-eth0-rx-0-21swapper/319:40:343
27150,0ktimersoftd/20-21swapper/221:39:272
27150,0ktimersoftd/20-21swapper/221:08:452
259950,0migration/28210-21kthreadcore23:52:242
259950,0migration/230025-21munin-node23:47:222
259950,0migration/222586-21kthreadcore19:47:252
259950,0migration/214375-21irqcore23:17:232
259950,0migration/213408-21munin-node23:37:192
249950,0watchdog/22275-21sendmail_mailqu00:07:292
249950,0watchdog/20-21swapper/220:32:262
19150,0ktimersoftd/10-21swapper/121:31:301
179950,0migration/123623-21kthreadcore22:02:251
179950,0migration/123218-21fschecks_time21:42:211
179950,0migration/115402-21kthreadcore22:57:251
179950,0migration/114568-21irqrtprio23:17:231
179950,0migration/113484-21sh22:16:291
169950,0watchdog/132463-21kthreadcore22:27:251
169950,0watchdog/130902-21munin-node19:57:261
152829955,0cyclictest0-21swapper/222:53:332
152829950,0cyclictest0-21swapper/222:32:072
152829950,0cyclictest0-21swapper/222:23:552
152829950,0cyclictest0-21swapper/221:54:552
152819955,0cyclictest0-21swapper/119:47:271
152819954,0cyclictest0-21swapper/119:07:241
152819950,0cyclictest0-21swapper/122:53:191
152819950,0cyclictest0-21swapper/122:33:281
152819950,0cyclictest0-21swapper/122:08:521
152819950,0cyclictest0-21swapper/121:18:061
152819950,0cyclictest0-21swapper/121:15:441
152819950,0cyclictest0-21swapper/100:04:161
152809955,0cyclictest0-21swapper/023:33:290
152809950,0cyclictest0-21swapper/022:26:380
152809950,0cyclictest0-21swapper/022:18:270
149950,0migration/08504-21kthreadcore21:12:250
149950,0migration/07399-21kthreadcore22:32:230
149950,0migration/06855-21kthreadcore23:12:250
149950,0migration/0544-21kthreadcore21:47:230
149950,0migration/03650-21kthreadcore19:57:250
149950,0migration/031036-21hddtemp_smartct21:07:210
149950,0migration/030250-21aten_r1power_cu22:07:180
149950,0migration/03005-21kthreadcore20:47:240
149950,0migration/029210-21aten_r1power_fr23:47:190
149950,0migration/027848-21sh23:44:170
149950,0migration/02771-21kthreadcore21:27:250
149950,0migration/023877-21taskset19:50:560
149950,0migration/023679-21kthreadcore19:02:240
149950,0migration/022492-21irqcore23:22:230
149950,0migration/019669-21irqcore20:12:240
149950,0migration/019153-21switchtime23:17:290
149950,0migration/019111-21taskset23:57:500
149950,0migration/01809-21kthreadcore22:27:260
149950,0migration/016801-21kthreadcore00:17:250
149950,0migration/015198-21kthreadcore20:07:250
149950,0migration/015191-21fschecks_time21:17:220
149950,0migration/013586-21aten_r1power_en22:57:190
149950,0migration/013501-21fschecks_time20:32:220
149950,0migration/011742-21taskset23:54:450
149950,0migration/011626-21munin-node22:52:300
339940,0migration/324610-21df_abs19:52:203
339940,0migration/321570-21kthreadcore19:22:273
339940,0migration/321024-21aten_r1power_vo00:02:193
339940,0migration/320148-21diskmemload20:57:513
29725040,0irq/27-eth0-tx-0-21swapper/223:27:192
29725040,0irq/27-eth0-tx-0-21swapper/223:02:312
29725040,0irq/27-eth0-tx-0-21swapper/222:42:372
29725040,0irq/27-eth0-tx-0-21swapper/222:18:022
29725040,0irq/27-eth0-tx-0-21swapper/222:12:582
29725040,0irq/27-eth0-tx-0-21swapper/221:57:132
29725040,0irq/27-eth0-tx-0-21swapper/221:17:252
29725040,0irq/27-eth0-tx-0-21swapper/200:22:152
29725040,0irq/27-eth0-tx-0-21swapper/200:17:112
29715040,0irq/26-eth0-rx-0-21swapper/323:57:313
29715040,0irq/26-eth0-rx-0-21swapper/323:12:183
29715040,0irq/26-eth0-rx-0-21swapper/323:07:343
29715040,0irq/26-eth0-rx-0-21swapper/322:57:263
29715040,0irq/26-eth0-rx-0-21swapper/322:47:093
29715040,0irq/26-eth0-rx-0-21swapper/322:42:493
29715040,0irq/26-eth0-rx-0-21swapper/322:08:073
29715040,0irq/26-eth0-rx-0-21swapper/321:17:333
259940,0migration/28647-21kthreadcore19:37:262
259940,0migration/2479-21irqcore20:22:232
259940,0migration/24068-21kthreadcore20:47:242
259940,0migration/228118-21kthreadcore20:42:262
259940,0migration/227108-21kthreadcore19:02:252
259940,0migration/226140-21kthreadcore23:42:242
259940,0migration/222399-21cpuspeed_turbos21:02:212
259940,0migration/216704-21irqrtprio18:57:252
249940,0watchdog/225719-21cut23:22:252
249940,0watchdog/219122-21kthreadcore19:22:262
249940,0watchdog/20-21swapper/220:02:182
249940,0watchdog/20-21swapper/219:12:262
179940,0migration/18462-21kthreadcore00:12:241
179940,0migration/16229-21aten_r1power_en21:52:191
179940,0migration/132448-21kthreadcore19:32:231
179940,0migration/130380-21fschecks_time22:47:201
179940,0migration/128796-21latency_hist00:07:071
179940,0migration/127145-21diskmemload22:42:251
179940,0migration/121551-21runrttasks22:00:571
179940,0migration/121061-21sh22:20:201
179940,0migration/111829-21latency_hist20:07:081
169940,0watchdog/16182-21if_eth1.220:02:221
169940,0watchdog/131473-21cut23:47:251
169940,0watchdog/121403-21ssh21:01:051
169940,0watchdog/112296-21ssh23:14:571
169940,0watchdog/112032-21grep20:52:261
169940,0watchdog/10-21swapper/123:57:251
169940,0watchdog/10-21swapper/123:46:291
169940,0watchdog/10-21swapper/121:37:251
169940,0watchdog/10-21swapper/120:32:221
169940,0watchdog/10-21swapper/100:17:251
152829943,0cyclictest7178-21awk20:27:242
152829943,0cyclictest3556-21lldpd19:28:482
152829943,0cyclictest3514-21snmpd19:52:292
152829943,0cyclictest30909-21awk22:27:232
152829943,0cyclictest23511-21awk21:42:232
152829943,0cyclictest19418-21awk20:12:232
152829943,0cyclictest12880-21awk20:07:232
152819944,0cyclictest0-21swapper/119:57:041
152819943,0cyclictest393-21awk20:22:221
152819943,0cyclictest3556-21lldpd20:45:191
152819943,0cyclictest3514-21snmpd23:05:001
152819943,0cyclictest3514-21snmpd22:40:301
152819943,0cyclictest3514-21snmpd20:19:451
152819943,0cyclictest3514-21snmpd19:25:141
152819943,0cyclictest3241-21irqbalance23:28:151
152819943,0cyclictest3241-21irqbalance23:23:351
152819943,0cyclictest3241-21irqbalance22:23:351
152819943,0cyclictest3241-21irqbalance21:22:161
152819943,0cyclictest3241-21irqbalance21:06:461
152819943,0cyclictest31470-21awk21:47:221
152819943,0cyclictest21509-21awk00:22:211
152819943,0cyclictest19488-21awk20:12:231
152819943,0cyclictest1369-21awk20:47:221
152819943,0cyclictest11707-21awk19:42:221
152809944,0cyclictest0-21swapper/021:44:420
152809944,0cyclictest0-21swapper/021:23:250
152809944,0cyclictest0-21swapper/000:26:370
152809943,0cyclictest5530-21awk00:12:220
152809943,0cyclictest418-21awk20:22:220
152809943,0cyclictest3556-21lldpd22:13:500
152809943,0cyclictest3514-21snmpd23:28:000
152809943,0cyclictest3514-21snmpd00:05:000
152809943,0cyclictest29512-21sadc22:47:070
152809943,0cyclictest25077-21awk19:52:220
152809943,0cyclictest23150-21awk22:02:230
152809943,0cyclictest0-21swapper/020:02:200
149940,0migration/031131-21kernelversion19:32:230
149940,0migration/022600-21fschecks_count21:02:220
29715030,0irq/26-eth0-rx-0-21swapper/320:47:183
29715030,0irq/26-eth0-rx-0-21swapper/320:42:213
29715030,0irq/26-eth0-rx-0-21swapper/320:17:183
29715030,0irq/26-eth0-rx-0-21swapper/320:02:173
29715030,0irq/26-eth0-rx-0-21swapper/319:57:193
29715030,0irq/26-eth0-rx-0-21swapper/319:42:193
29715030,0irq/26-eth0-rx-0-21swapper/319:17:583
29715030,0irq/26-eth0-rx-0-21swapper/318:59:373
249930,0watchdog/20-21swapper/219:57:262
169930,0watchdog/10-21swapper/123:37:291
169930,0watchdog/10-21swapper/123:32:211
169930,0watchdog/10-21swapper/119:37:261
169930,0watchdog/10-21swapper/119:12:261
152829933,0cyclictest0-21swapper/220:37:112
152829932,0cyclictest8183-21awk20:52:232
152829932,0cyclictest29656-21awk19:07:222
152829932,0cyclictest11737-21awk19:42:222
152829930,0cyclictest15466-21python19:17:292
152829930,0cyclictest0-21swapper/220:17:572
152829930,0cyclictest0-21swapper/219:33:012
152819932,0cyclictest7106-21awk20:27:231
152819932,0cyclictest3556-21lldpd23:52:201
152819932,0cyclictest24824-21cut19:27:251
152819932,0cyclictest23026-21awk19:02:221
152819932,0cyclictest16449-21awk18:57:241
152819931,0cyclictest6519-21aten2.4-expect21:32:171
152819930,0cyclictest19914-21diskstats20:37:201
152809933,0cyclictest31942-21kworker/0:223:37:280
152809933,0cyclictest31942-21kworker/0:223:07:220
152809933,0cyclictest31942-21kworker/0:223:02:100
152809933,0cyclictest31942-21kworker/0:222:47:080
152809933,0cyclictest31942-21kworker/0:222:37:180
152809933,0cyclictest31942-21kworker/0:221:57:100
152809933,0cyclictest31942-21kworker/0:221:52:180
152809933,0cyclictest31942-21kworker/0:221:32:230
152809933,0cyclictest31942-21kworker/0:220:52:090
152809933,0cyclictest31942-21kworker/0:220:42:210
152809933,0cyclictest31942-21kworker/0:219:42:150
152809933,0cyclictest31942-21kworker/0:219:07:130
152809933,0cyclictest18655-21kworker/0:200:07:140
152809932,0cyclictest27598-21kthreadcore19:27:250
29715020,0irq/26-eth0-rx-0-21swapper/319:27:243
152819920,0cyclictest0-21swapper/119:17:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional