You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 15:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Mar 28, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
235524940,0sleep20-21swapper/206:56:082
238423928,0sleep30-21swapper/306:56:293
2873223526,0sleep10-21swapper/106:55:111
245923026,0sleep00-21swapper/006:57:220
339960,0migration/39093-21sh09:44:423
339960,0migration/332498-21sh09:36:563
339960,0migration/330773-21taskset12:00:063
339960,0migration/314414-21sh11:06:563
339960,0migration/313229-21sh12:07:263
29725060,0irq/27-eth0-tx-26919-21munin-node08:55:250
29715060,0irq/26-eth0-rx-28117-21rt-features12:15:253
29715060,0irq/26-eth0-rx-25288-21iostat_ios10:55:223
27779966,0cyclictest928-21diskmemload11:45:412
27759960,0cyclictest0-21swapper/110:15:181
149960,0migration/06717-21sh10:41:090
149960,0migration/014020-21sh12:09:470
8215050,0irq/24-0000:00:31913-21latency_hist11:00:052
8215050,0irq/24-0000:00:16157-21munin-run07:10:062
4150,0ktimersoftd/00-21swapper/010:35:560
35150,0ktimersoftd/30-21swapper/309:05:143
339950,0migration/38726-21kthreadcore11:25:213
339950,0migration/37641-21munin-node09:20:283
339950,0migration/36139-21diskmemload11:00:583
339950,0migration/3479-21munin-node10:40:173
339950,0migration/34309-21irqrtprio07:00:223
339950,0migration/327789-21kthreadcore09:15:193
339950,0migration/32731-21kthreadcore11:40:213
339950,0migration/326844-21latency_hist08:55:053
339950,0migration/326641-21kthreadcore10:15:213
339950,0migration/32351-21kthreadcore10:20:223
339950,0migration/322850-21taskset11:55:113
339950,0migration/315744-21kthreadcore08:20:243
339950,0migration/315228-21kthreadcore08:45:233
339950,0migration/313708-21kthreadcore10:05:223
29725050,0irq/27-eth0-tx-928-21diskmemload10:50:472
29725050,0irq/27-eth0-tx-25953-21tr11:35:222
29725050,0irq/27-eth0-tx-17803-21cut09:10:172
29725050,0irq/27-eth0-tx-12828-21ssh12:06:142
29725050,0irq/27-eth0-tx-12396-21ssh12:26:182
29725050,0irq/27-eth0-tx-1183-21munin-node09:00:282
29725050,0irq/27-eth0-tx-10543-21ssh09:05:232
29725050,0irq/27-eth0-tx-0-21swapper/212:02:382
29725050,0irq/27-eth0-tx-0-21swapper/211:55:202
29725050,0irq/27-eth0-tx-0-21swapper/210:27:582
29725050,0irq/27-eth0-tx-0-21swapper/007:22:400
29715050,0irq/26-eth0-rx-6275-21kthreadcore10:00:233
29715050,0irq/26-eth0-rx-24742-21ssh09:32:363
29715050,0irq/26-eth0-rx-24741-21kthreadcore08:50:243
29715050,0irq/26-eth0-rx-21643-21kthreadcore09:50:233
29715050,0irq/26-eth0-rx-19098-21cut10:50:223
29715050,0irq/26-eth0-rx-18488-21kthreadcore10:10:243
29715050,0irq/26-eth0-rx-16241-21munin-node11:10:183
29715050,0irq/26-eth0-rx-0-21swapper/312:27:573
29715050,0irq/26-eth0-rx-0-21swapper/312:21:123
29715050,0irq/26-eth0-rx-0-21swapper/312:10:233
29715050,0irq/26-eth0-rx-0-21swapper/311:35:223
29715050,0irq/26-eth0-rx-0-21swapper/311:30:203
29715050,0irq/26-eth0-rx-0-21swapper/311:20:103
29715050,0irq/26-eth0-rx-0-21swapper/311:17:233
29715050,0irq/26-eth0-rx-0-21swapper/310:28:213
29715050,0irq/26-eth0-rx-0-21swapper/309:45:183
29715050,0irq/26-eth0-rx-0-21swapper/309:25:113
27779955,0cyclictest928-21diskmemload10:42:082
27779955,0cyclictest0-21swapper/210:47:112
27779955,0cyclictest0-21swapper/209:55:282
27779955,0cyclictest0-21swapper/209:26:182
27779950,0cyclictest0-21swapper/210:37:532
27779950,0cyclictest0-21swapper/210:05:242
27759950,0cyclictest0-21swapper/110:23:111
27749955,0cyclictest0-21swapper/011:07:190
27749955,0cyclictest0-21swapper/010:45:050
27749955,0cyclictest0-21swapper/009:07:580
27749950,0cyclictest0-21swapper/012:25:500
27749950,0cyclictest0-21swapper/011:26:420
27749950,0cyclictest0-21swapper/009:50:040
259950,0migration/23936-21kthreadcore11:20:222
259950,0migration/23895-21kthreadcore11:00:232
259950,0migration/230251-21kthreadcore09:15:202
259950,0migration/223658-21irqrtprio12:15:202
259950,0migration/223507-21kthreadcore08:25:222
259950,0migration/223040-21kthreadcore08:00:262
249950,0watchdog/24815-21grep10:20:232
249950,0watchdog/232376-21kthreadcore07:20:242
249950,0watchdog/222051-21python07:10:282
179950,0migration/16832-21latency_hist11:45:051
179950,0migration/132275-21taskset08:34:111
179950,0migration/128779-21timerandwakeup11:55:271
179950,0migration/120018-21idleruntime-cro08:50:051
149950,0migration/09754-21munin-node10:25:200
149950,0migration/09404-21kthreadcore08:40:230
149950,0migration/08516-21sh09:22:180
149950,0migration/06210-21taskset11:43:470
149950,0migration/05519-21kthreadcore10:20:230
149950,0migration/03792-21pmu-power07:45:270
149950,0migration/0333-21taskset09:37:520
149950,0migration/032229-21taskset09:57:190
149950,0migration/027845-21missed_timers12:15:230
149950,0migration/026807-21kthreadcore11:35:220
149950,0migration/026154-21kthreadcore11:55:210
149950,0migration/024302-21aten_r1power_en10:55:170
149950,0migration/024014-21aten_r1power_cu07:40:170
149950,0migration/023393-21taskset07:35:540
149950,0migration/02009-21kthreadcore11:20:210
149950,0migration/017789-21taskset07:57:200
149950,0migration/017021-21taskset09:28:230
149950,0migration/016109-21kthreadcore08:45:230
149950,0migration/016073-21taskset10:07:440
149950,0migration/015634-21latency_hist11:10:050
149950,0migration/014822-21kthreadcore07:30:220
149950,0migration/01436-21kthreadcore11:00:220
35140,0ktimersoftd/30-21swapper/307:46:243
339940,0migration/39831-21kthreadcore10:45:213
339940,0migration/38684-21kthreadcore08:40:233
339940,0migration/33709-21kthreadcore08:35:223
339940,0migration/331477-21kthreadcore07:20:243
339940,0migration/327584-21kthreadcore09:55:213
339940,0migration/323423-21kthreadcore08:25:223
339940,0migration/321380-21kthreadcore07:10:243
339940,0migration/31610-21kthreadcore08:10:233
339940,0migration/31610-21kthreadcore08:10:233
339940,0migration/311623-21kthreadcore07:05:223
339940,0migration/310632-21swap07:50:293
29725040,0irq/27-eth0-tx-20535-21port_sshpriv11:50:232
29725040,0irq/27-eth0-tx-15022-21ssh09:45:222
29725040,0irq/27-eth0-tx-0-21swapper/212:20:122
29725040,0irq/27-eth0-tx-0-21swapper/211:30:222
29725040,0irq/27-eth0-tx-0-21swapper/211:25:372
29725040,0irq/27-eth0-tx-0-21swapper/211:15:282
29725040,0irq/27-eth0-tx-0-21swapper/211:10:112
29725040,0irq/27-eth0-tx-0-21swapper/210:15:262
29725040,0irq/27-eth0-tx-0-21swapper/210:14:292
29725040,0irq/27-eth0-tx-0-21swapper/210:01:592
29725040,0irq/27-eth0-tx-0-21swapper/209:50:152
29725040,0irq/27-eth0-tx-0-21swapper/209:40:072
29725040,0irq/27-eth0-tx-0-21swapper/209:30:482
29725040,0irq/27-eth0-tx-0-21swapper/008:05:180
29725040,0irq/27-eth0-tx-0-21swapper/008:00:280
29715040,0irq/26-eth0-rx-15706-21smartctl11:50:163
29715040,0irq/26-eth0-rx-0-21swapper/311:46:283
29715040,0irq/26-eth0-rx-0-21swapper/310:36:053
29715040,0irq/26-eth0-rx-0-21swapper/310:30:243
29715040,0irq/26-eth0-rx-0-21swapper/309:10:183
29715040,0irq/26-eth0-rx-0-21swapper/309:03:423
29715040,0irq/26-eth0-rx-0-21swapper/308:15:193
29715040,0irq/26-eth0-rx-0-21swapper/307:35:203
27779943,0cyclictest4925-21awk07:25:202
27779943,0cyclictest3556-21lldpd11:40:502
27779943,0cyclictest3556-21lldpd09:35:202
27779943,0cyclictest3556-21lldpd09:20:192
27779943,0cyclictest3556-21lldpd08:51:492
27779943,0cyclictest3514-21snmpd07:40:212
27779943,0cyclictest31481-21awk07:45:212
27759944,0cyclictest0-21swapper/112:29:561
27759944,0cyclictest0-21swapper/109:53:041
27759943,0cyclictest7393-21awk12:05:201
27759943,0cyclictest628-21awk11:00:201
27759943,0cyclictest3556-21lldpd09:28:201
27759943,0cyclictest3556-21lldpd08:00:191
27759943,0cyclictest3556-21lldpd07:32:491
27759943,0cyclictest3514-21snmpd10:45:211
27759943,0cyclictest3514-21snmpd09:38:211
27759943,0cyclictest3241-21irqbalance07:45:041
27759943,0cyclictest18031-21awk10:10:221
27759943,0cyclictest10014-21awk10:05:191
27759940,0cyclictest0-21swapper/112:23:281
27759940,0cyclictest0-21swapper/110:55:491
27749944,0cyclictest4478-21kworker/0:112:13:500
27749944,0cyclictest4478-21kworker/0:111:53:180
27749944,0cyclictest4478-21kworker/0:110:50:220
27749944,0cyclictest4478-21kworker/0:109:50:280
27749943,0cyclictest6884-21awk08:15:170
27749943,0cyclictest3995-21awk07:00:210
27749943,0cyclictest3556-21lldpd10:10:200
27749943,0cyclictest3556-21lldpd09:01:490
27749943,0cyclictest3556-21lldpd07:29:190
27749943,0cyclictest3556-21lldpd07:13:490
27749943,0cyclictest3556-21lldpd07:07:190
27749943,0cyclictest3514-21snmpd11:19:210
27749943,0cyclictest3514-21snmpd09:41:210
259940,0migration/29342-21kthreadcore08:15:202
259940,0migration/29249-21kthreadcore11:05:222
259940,0migration/27762-21kthreadcore07:00:232
259940,0migration/2431-21irqrtprio08:10:222
259940,0migration/2431-21irqrtprio08:10:222
259940,0migration/224977-21taskset08:05:062
259940,0migration/224128-21irqcore07:15:232
259940,0migration/22140-21kthreadcore08:35:212
259940,0migration/220445-21kthreadcore10:30:232
259940,0migration/214452-21aten_r1power_en12:10:172
259940,0migration/214315-21gltestperf08:45:202
259940,0migration/212139-21kthreadcore07:30:212
249940,0watchdog/231689-21timerandwakeup08:30:282
249940,0watchdog/210603-21munin-node07:50:282
249940,0watchdog/20-21swapper/208:40:242
179940,0migration/19263-21latency_hist09:45:051
179940,0migration/16391-21kthreadcore10:00:231
179940,0migration/12797-21kthreadcore10:40:221
179940,0migration/125898-21kthreadcore11:15:221
179940,0migration/124777-21kthreadcore11:35:221
179940,0migration/123416-21df_abs07:15:191
179940,0migration/122886-21kthreadcore09:30:231
179940,0migration/122095-21kthreadcore09:10:231
179940,0migration/119998-21kthreadcore10:50:221
179940,0migration/119308-21kthreadcore07:10:231
179940,0migration/118418-21kthreadcore11:10:221
179940,0migration/11758-21aten_r1power_vo09:20:171
179940,0migration/11739-21kthreadcore11:40:211
179940,0migration/115490-21fschecks_time11:50:161
179940,0migration/114921-21fschecks_count12:10:191
179940,0migration/111151-21kthreadcore09:05:231
169940,0watchdog/19573-21kthreadcore07:50:241
169940,0watchdog/19146-21ssh09:04:591
169940,0watchdog/16937-21ssh11:24:391
169940,0watchdog/132657-21ssh09:58:351
169940,0watchdog/131513-21ssh10:37:391
169940,0watchdog/13014-21cut07:45:241
169940,0watchdog/129279-21kthreadcore09:15:191
169940,0watchdog/117281-21python07:55:281
169940,0watchdog/115549-21sed07:05:281
169940,0watchdog/113960-21ssh11:26:431
169940,0watchdog/112658-21cut11:05:231
169940,0watchdog/10-21swapper/110:30:231
169940,0watchdog/10-21swapper/108:50:201
169940,0watchdog/10-21swapper/108:13:441
169940,0watchdog/10-21swapper/108:13:441
149940,0migration/06297-21latency_hist12:05:050
149940,0migration/029308-21kthreadcore10:15:220
149940,0migration/023929-21kthreadcore08:25:220
149940,0migration/023664-21python09:30:270
29715030,0irq/26-eth0-rx-0-21swapper/308:30:163
29715030,0irq/26-eth0-rx-0-21swapper/308:05:173
29715030,0irq/26-eth0-rx-0-21swapper/308:00:203
29715030,0irq/26-eth0-rx-0-21swapper/307:58:423
29715030,0irq/26-eth0-rx-0-21swapper/307:40:173
29715030,0irq/26-eth0-rx-0-21swapper/307:30:163
29715030,0irq/26-eth0-rx-0-21swapper/307:29:193
29715030,0irq/26-eth0-rx-0-21swapper/307:15:273
27779932,0cyclictest18290-21awk07:35:182
27779932,0cyclictest12642-21munin-node08:20:202
27759933,0cyclictest20271-21awk08:25:201
27759933,0cyclictest0-21swapper/108:05:231
27759932,0cyclictest9659-21awk10:25:191
27759932,0cyclictest7776-21awk08:40:211
27759932,0cyclictest5902-21sensors08:35:261
27759932,0cyclictest3514-21snmpd07:27:401
27759932,0cyclictest30599-21awk07:20:221
27759932,0cyclictest0-21swapper/107:35:161
27759930,0cyclictest23094-21perl12:15:181
27759930,0cyclictest0-21swapper/112:02:211
27749933,0cyclictest4478-21kworker/0:111:45:200
27749933,0cyclictest4478-21kworker/0:110:30:180
27749933,0cyclictest4478-21kworker/0:110:00:080
27749933,0cyclictest23176-21kworker/0:012:20:180
27749932,0cyclictest5768-21awk07:50:210
27749932,0cyclictest3556-21lldpd08:20:200
27749932,0cyclictest3241-21irqbalance11:30:130
27749932,0cyclictest26687-21awk09:15:170
27749932,0cyclictest25945-21munin-node08:30:190
27749932,0cyclictest25905-21sensors08:50:270
27749932,0cyclictest23888-21awk07:15:210
27749932,0cyclictest18658-21awk09:10:210
27749930,0cyclictest705-21perl08:35:180
27749930,0cyclictest31643-21munin-node08:10:180
27749930,0cyclictest31643-21munin-node08:10:180
249930,0watchdog/282150irq/24-0000:00:07:55:282
249930,0watchdog/20-21swapper/208:55:202
169930,0watchdog/19853-21df_abs09:45:151
169930,0watchdog/10-21swapper/111:34:311
169930,0watchdog/10-21swapper/108:55:201
169930,0watchdog/10-21swapper/108:20:241
169930,0watchdog/10-21swapper/108:15:201
169930,0watchdog/10-21swapper/107:00:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional