You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 14:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 21, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450660,0irq/25-eth10-21swapper/318:45:463
1028224536,0sleep10-21swapper/118:46:261
1015223423,0sleep00-21swapper/018:44:520
1031223324,0sleep20-21swapper/218:46:432
105969970,0cyclictest0-21swapper/100:10:211
339960,0migration/37938-21sh21:28:013
339960,0migration/34087-21sh23:27:463
339960,0migration/331983-21sh21:01:523
339960,0migration/328976-21sh22:40:093
339960,0migration/318860-21kthreadcore21:14:313
339960,0migration/312171-21sh23:54:213
29725060,0irq/27-eth0-tx-19530-21munin-node19:44:380
29715060,0irq/26-eth0-rx-8422-21df_inode21:49:263
149960,0migration/09205-21cpuspeed_turbos21:09:260
149960,0migration/05776-21sh22:05:120
149960,0migration/04782-21sh22:45:580
149960,0migration/04194-21aten_r1power_cu23:49:230
149960,0migration/029892-21sh22:21:090
105979960,0cyclictest0-21swapper/219:54:252
105969960,0cyclictest0-21swapper/122:01:141
105959960,0cyclictest0-21swapper/023:15:510
105959960,0cyclictest0-21swapper/022:29:210
105959960,0cyclictest0-21swapper/021:44:440
8215050,0irq/24-0000:00:13854-21idleruntime-cro22:54:122
4150,0ktimersoftd/00-21swapper/021:28:200
339950,0migration/38653-21fschecks_count20:24:253
339950,0migration/3842-21latency20:39:313
339950,0migration/37762-21idleruntime-cro21:49:133
339950,0migration/37102-21dump-pmu-power22:09:083
339950,0migration/36574-21latency_hist22:29:133
339950,0migration/35713-21kthreadcore23:49:293
339950,0migration/35693-21kthreadcore20:44:313
339950,0migration/330962-21kthreadcore20:14:323
339950,0migration/328161-21kthreadcore19:49:303
339950,0migration/325628-21fschecks_time21:19:283
339950,0migration/324696-21munin-node21:59:283
339950,0migration/324638-21kthreadcore23:59:313
339950,0migration/322977-21kthreadcore23:19:283
339950,0migration/322413-21diskmemload22:59:263
339950,0migration/322073-21taskset22:16:263
339950,0migration/321368-21munin-node20:09:273
339950,0migration/319201-21kthreadcore20:29:313
339950,0migration/316885-21cpuspeed_turbos21:34:263
339950,0migration/314907-21timerandwakeup21:09:363
339950,0migration/311550-21munin-node19:34:313
29725050,0irq/27-eth0-tx-4844-21munin-node23:29:362
29725050,0irq/27-eth0-tx-32111-21ssh21:22:192
29725050,0irq/27-eth0-tx-30671-21yum21:39:392
29725050,0irq/27-eth0-tx-28685-21taskset23:01:262
29725050,0irq/27-eth0-tx-17366-21smartctl21:34:282
29725050,0irq/27-eth0-tx-12700-21kthreadcore20:49:300
29725050,0irq/27-eth0-tx-12159-21cut00:14:252
29725050,0irq/27-eth0-tx-0-21swapper/223:34:332
29725050,0irq/27-eth0-tx-0-21swapper/223:27:182
29725050,0irq/27-eth0-tx-0-21swapper/222:18:252
29725050,0irq/27-eth0-tx-0-21swapper/222:04:332
29715050,0irq/26-eth0-rx-3145-21ssh23:47:033
29715050,0irq/26-eth0-rx-30421-21timerandwakeup21:39:373
29715050,0irq/26-eth0-rx-27601-21ssh23:41:533
29715050,0irq/26-eth0-rx-19869-21smartctl22:54:363
29715050,0irq/26-eth0-rx-15267-21kthreadcore19:39:293
29715050,0irq/26-eth0-rx-14828-21irqcore20:04:293
29715050,0irq/26-eth0-rx-12984-21runrttasks22:29:383
29715050,0irq/26-eth0-rx-11090-21pmu-power23:09:333
29715050,0irq/26-eth0-rx-0-21swapper/322:23:123
29715050,0irq/26-eth0-rx-0-21swapper/321:54:563
29715050,0irq/26-eth0-rx-0-21swapper/321:30:343
29715050,0irq/26-eth0-rx-0-21swapper/321:04:203
29715050,0irq/26-eth0-rx-0-21swapper/320:53:503
29715050,0irq/26-eth0-rx-0-21swapper/300:14:183
29715050,0irq/26-eth0-rx-0-21swapper/300:10:543
29715050,0irq/26-eth0-rx-0-21swapper/300:04:303
259950,0migration/223965-21latency_hist18:59:132
259950,0migration/213402-21latency20:24:302
249950,0watchdog/221506-21cut20:09:272
249950,0watchdog/20-21swapper/200:06:262
179950,0migration/17009-21munin-node20:19:331
169950,0watchdog/17128-21ssh21:25:311
169950,0watchdog/11737-21ntp_states23:44:301
169950,0watchdog/11192-21kthreadcore22:44:311
169950,0watchdog/10-21swapper/121:14:311
149950,0migration/08295-21cpuspeed_turbos21:49:260
149950,0migration/07644-21kthreadcore00:09:310
149950,0migration/06885-21kthreadcore23:09:290
149950,0migration/05324-21timerandwakeup19:29:380
149950,0migration/04731-21taskset19:07:310
149950,0migration/032355-21kthreadcore23:44:280
149950,0migration/031396-21sh21:41:520
149950,0migration/030468-21latency21:19:320
149950,0migration/030377-21taskset19:01:590
149950,0migration/028595-21kthreadcore19:24:310
149950,0migration/027678-21fschecks_time20:14:280
149950,0migration/027598-21kthreadcore20:59:320
149950,0migration/022678-21kthreadcore20:09:280
149950,0migration/021267-21latency_hist20:34:130
149950,0migration/020263-21aten_r1power_vo23:59:250
149950,0migration/019900-21kthreadcore22:14:300
149950,0migration/018729-21kthreadcore22:34:310
149950,0migration/015620-21kthreadcore22:54:300
149950,0migration/014951-21irqcore20:04:290
149950,0migration/014035-21latency21:29:320
149950,0migration/013891-21latency_hist22:54:120
149950,0migration/013086-21cpuspeed_turbos23:34:230
149950,0migration/011652-21kthreadcore19:59:320
149950,0migration/011494-21latency_hist00:14:120
149950,0migration/011031-21taskset23:29:400
149950,0migration/010758-21kthreadcore22:09:300
105979955,0cyclictest0-21swapper/223:08:202
105979950,0cyclictest0-21swapper/222:13:572
105979950,0cyclictest0-21swapper/221:07:342
105979950,0cyclictest0-21swapper/220:49:172
105969955,0cyclictest0-21swapper/123:41:391
105969955,0cyclictest0-21swapper/123:00:211
105969950,0cyclictest0-21swapper/122:54:031
105969950,0cyclictest0-21swapper/121:46:061
105969950,0cyclictest0-21swapper/121:36:291
105969950,0cyclictest0-21swapper/121:20:051
105969950,0cyclictest0-21swapper/100:03:061
105959955,0cyclictest0-21swapper/022:26:020
105959955,0cyclictest0-21swapper/000:04:250
105959950,0cyclictest0-21swapper/021:59:520
8215040,0irq/24-0000:00:7091-21cat19:59:132
8215040,0irq/24-0000:00:11600-21latency_hist19:14:132
339940,0migration/39130-21kthreadcore19:09:313
339940,0migration/332194-21df_abs19:29:273
339940,0migration/331691-21kthreadcore23:04:293
339940,0migration/331541-21runrttasks19:28:323
339940,0migration/320226-21runrttasks23:16:403
339940,0migration/319885-21kthreadcore20:54:303
339940,0migration/318278-21hddtemp_smartct18:54:293
339940,0migration/314678-21latency_hist22:34:133
29725040,0irq/27-eth0-tx-5073-21ssh22:25:012
29725040,0irq/27-eth0-tx-4962-21hwlatdetect23:49:272
29725040,0irq/27-eth0-tx-28585-21ssh23:44:152
29725040,0irq/27-eth0-tx-22690-21munin-node22:39:302
29725040,0irq/27-eth0-tx-19855-21ssh23:15:322
29725040,0irq/27-eth0-tx-0-21swapper/223:39:162
29725040,0irq/27-eth0-tx-0-21swapper/223:19:252
29725040,0irq/27-eth0-tx-0-21swapper/221:59:282
29725040,0irq/27-eth0-tx-0-21swapper/221:49:322
29725040,0irq/27-eth0-tx-0-21swapper/221:44:172
29725040,0irq/27-eth0-tx-0-21swapper/220:54:222
29725040,0irq/27-eth0-tx-0-21swapper/200:09:162
29725040,0irq/27-eth0-tx-0-21swapper/019:24:080
29715040,0irq/26-eth0-rx-6367-21cpu22:49:253
29715040,0irq/26-eth0-rx-0-21swapper/323:37:263
29715040,0irq/26-eth0-rx-0-21swapper/323:29:273
29715040,0irq/26-eth0-rx-0-21swapper/322:44:313
29715040,0irq/26-eth0-rx-0-21swapper/322:11:543
29715040,0irq/26-eth0-rx-0-21swapper/319:59:373
29715040,0irq/26-eth0-rx-0-21swapper/319:44:313
29715040,0irq/26-eth0-rx-0-21swapper/319:19:273
29715040,0irq/26-eth0-rx-0-21swapper/318:59:243
259940,0migration/25310-21latency_hist23:09:132
259940,0migration/24507-21kthreadcore21:24:302
259940,0migration/231099-21fschecks_count22:44:272
259940,0migration/229235-21kthreadcore19:24:312
259940,0migration/226114-21latency_hist19:49:132
259940,0migration/225417-21unixbench-2d19:44:372
259940,0migration/223767-21fschecks_count22:19:272
259940,0migration/223204-21kthreadcore23:59:312
259940,0migration/216295-21kthreadcore22:34:302
259940,0migration/215794-21kthreadcore18:49:312
259940,0migration/211964-21timerandwakeup19:34:362
249940,0watchdog/227754-21grep18:59:322
249940,0watchdog/225452-21cut20:59:272
249940,0watchdog/220217-21kthreadcore21:14:312
249940,0watchdog/214698-21fschecks_time22:54:272
249940,0watchdog/213820-21cut21:09:312
249940,0watchdog/20-21swapper/223:55:502
249940,0watchdog/20-21swapper/220:29:272
179940,0migration/14845-21munin-node23:29:241
179940,0migration/13565-21kthreadcore19:04:321
179940,0migration/119835-21taskset20:05:001
179940,0migration/119513-21iostat19:19:301
179940,0migration/117034-21aten_r1power_po20:54:241
179940,0migration/116154-21kthreadcore22:34:301
179940,0migration/111476-21kthreadcore19:59:311
179940,0migration/110474-21kthreadcore20:49:291
169940,0watchdog/17254-21ssh21:05:231
169940,0watchdog/130914-21kthreadcore23:24:311
169940,0watchdog/124372-21kthreadcore20:34:311
169940,0watchdog/113821-21tr21:09:311
169940,0watchdog/111611-21kthreadcore21:29:311
169940,0watchdog/10-21swapper/120:09:271
169940,0watchdog/10-21swapper/119:44:271
169940,0watchdog/10-21swapper/118:49:281
169940,0watchdog/10-21swapper/100:04:261
149940,0migration/04535-21kthreadcore19:54:320
149940,0migration/019600-21kthreadcore20:54:300
149940,0migration/018042-21kthreadcore21:54:290
149940,0migration/016835-21kthreadcore23:54:300
105979943,0cyclictest7965-21cut22:29:292
105979943,0cyclictest3556-21lldpd21:56:262
105979943,0cyclictest3556-21lldpd19:41:262
105979943,0cyclictest3514-21snmpd19:19:322
105979943,0cyclictest32722-21awk19:29:302
105979943,0cyclictest3241-21irqbalance21:29:212
105979943,0cyclictest3241-21irqbalance20:44:412
105979943,0cyclictest3241-21irqbalance20:34:512
105979943,0cyclictest3241-21irqbalance20:20:312
105979943,0cyclictest3241-21irqbalance19:10:222
105979943,0cyclictest31718-21awk19:04:302
105979943,0cyclictest28981-21awk20:39:282
105979943,0cyclictest28072-21awk20:14:302
105979943,0cyclictest14647-21awk20:04:272
105969944,0cyclictest8858-21diskmemload22:10:511
105969944,0cyclictest0-21swapper/123:36:461
105969944,0cyclictest0-21swapper/123:15:201
105969944,0cyclictest0-21swapper/122:19:401
105969944,0cyclictest0-21swapper/121:01:291
105969944,0cyclictest0-21swapper/120:39:151
105969944,0cyclictest0-21swapper/100:14:551
105969943,0cyclictest8977-21awk21:49:291
105969943,0cyclictest5499-21ps23:49:291
105969943,0cyclictest3556-21lldpd23:09:261
105969943,0cyclictest3556-21lldpd22:16:561
105969943,0cyclictest3556-21lldpd21:56:561
105969943,0cyclictest3514-21snmpd20:29:471
105969943,0cyclictest3514-21snmpd19:10:171
105969943,0cyclictest3514-21snmpd18:55:021
105969943,0cyclictest3316-21awk20:44:291
105969943,0cyclictest3241-21irqbalance23:55:111
105969943,0cyclictest3241-21irqbalance23:04:311
105969943,0cyclictest3241-21irqbalance22:30:211
105969943,0cyclictest3241-21irqbalance21:39:311
105969943,0cyclictest3241-21irqbalance19:40:021
105969943,0cyclictest3241-21irqbalance19:35:421
105969943,0cyclictest3241-21irqbalance19:32:121
105969943,0cyclictest3241-21irqbalance18:59:221
105969943,0cyclictest28096-21awk20:14:301
105969943,0cyclictest26023-21awk19:24:281
105969943,0cyclictest18278-21sadc19:19:131
105969943,0cyclictest15074-21awk22:54:291
105969943,0cyclictest1236-21awk19:54:291
105959944,0cyclictest0-21swapper/023:20:450
105959944,0cyclictest0-21swapper/023:07:110
105959943,0cyclictest3556-21lldpd19:35:560
105959943,0cyclictest3514-21snmpd20:49:020
105959943,0cyclictest3514-21snmpd20:39:470
105959943,0cyclictest3514-21snmpd20:36:170
105959943,0cyclictest3514-21snmpd19:50:020
105959943,0cyclictest3241-21irqbalance21:07:210
105959943,0cyclictest22896-21awk22:59:280
105959943,0cyclictest21553-21awk23:39:260
339930,0migration/316393-21munin-node18:49:343
29725030,0irq/27-eth0-tx-0-21swapper/019:39:230
29715030,0irq/26-eth0-rx-16493-21kthreadcore19:14:323
29715030,0irq/26-eth0-rx-0-21swapper/320:34:263
29715030,0irq/26-eth0-rx-0-21swapper/320:19:243
29715030,0irq/26-eth0-rx-0-21swapper/319:57:093
179930,0migration/126495-21kthreadcore23:19:291
105969932,0cyclictest8872-21grep20:24:261
105969932,0cyclictest29102-21grep19:49:301
105969932,0cyclictest23581-21awk22:39:291
105969932,0cyclictest1655-21tr22:24:301
105969930,0cyclictest2528-21kthreadcore22:04:301
105959933,0cyclictest5235-21kworker/0:223:24:180
105959933,0cyclictest5235-21kworker/0:222:39:140
105959933,0cyclictest31144-21kworker/0:121:34:160
105959933,0cyclictest31144-21kworker/0:121:14:220
105959933,0cyclictest31144-21kworker/0:120:24:260
105959933,0cyclictest31144-21kworker/0:120:19:140
105959933,0cyclictest31144-21kworker/0:119:14:250
105959933,0cyclictest31144-21kworker/0:119:09:150
105959933,0cyclictest31144-21kworker/0:118:54:330
105959933,0cyclictest31144-21kworker/0:118:49:150
29715020,0irq/26-eth0-rx-0-21swapper/319:04:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional