You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 14:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 31, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1266226160,0sleep00-21swapper/006:45:290
1282423725,0sleep30-21swapper/306:47:243
1276423725,0sleep20-21swapper/206:46:432
1286523624,0sleep10-21swapper/106:47:541
339960,0migration/324099-21munin-node09:33:343
339960,0migration/322002-21sh11:36:273
29715060,0irq/26-eth0-rx-3234-21cut09:03:243
29715060,0irq/26-eth0-rx-30850-21ssh11:43:243
29715060,0irq/26-eth0-rx-14218-21memory10:28:313
29715060,0irq/26-eth0-rx-13817-21sh11:08:473
129639961,0cyclictest20653-21idleruntime-cro07:18:140
8215050,0irq/24-0000:00:23950-21cat10:58:122
8215050,0irq/24-0000:00:0-21swapper/207:03:142
339950,0migration/39801-21df_abs07:58:263
339950,0migration/39112-21taskset07:57:013
339950,0migration/3719-21munin-node11:03:283
339950,0migration/35331-21kthreadcore08:18:303
339950,0migration/332594-21kthreadcore08:38:313
339950,0migration/332594-21kthreadcore08:38:313
339950,0migration/327410-21kthreadcore09:58:313
339950,0migration/327312-21munin-node06:58:283
339950,0migration/327159-21sh09:18:233
339950,0migration/319476-21munin-node12:13:363
339950,0migration/319389-21kthreadcore10:13:323
339950,0migration/318372-21munin-node08:28:303
339950,0migration/31834-21latency_hist09:43:123
339950,0migration/318330-21kthreadcore06:48:323
339950,0migration/317380-21irqrtprio10:53:303
339950,0migration/312633-21kthreadcore08:23:313
339950,0migration/310581-21ksmtuned09:28:203
29725050,0irq/27-eth0-tx-5635-21kthreadcore09:43:312
29725050,0irq/27-eth0-tx-422-21ssh10:23:042
29725050,0irq/27-eth0-tx-26399-21munin-node09:38:312
29725050,0irq/27-eth0-tx-22779-21kthreadcore09:53:302
29725050,0irq/27-eth0-tx-22087-21grep09:33:312
29725050,0irq/27-eth0-tx-19141-21munin-node09:13:272
29725050,0irq/27-eth0-tx-18100-21ssh09:10:552
29725050,0irq/27-eth0-tx-0-21swapper/212:05:312
29725050,0irq/27-eth0-tx-0-21swapper/211:29:062
29725050,0irq/27-eth0-tx-0-21swapper/209:58:322
29725050,0irq/27-eth0-tx-0-21swapper/209:48:262
29725050,0irq/27-eth0-tx-0-21swapper/007:18:280
29715050,0irq/26-eth0-rx-9718-21kthreadcore11:28:293
29715050,0irq/26-eth0-rx-8460-21sensors_volt09:23:353
29715050,0irq/26-eth0-rx-8282-21awk10:48:253
29715050,0irq/26-eth0-rx-7715-21ssh10:47:353
29715050,0irq/26-eth0-rx-30937-21sshd12:03:263
29715050,0irq/26-eth0-rx-29747-21processes10:58:343
29715050,0irq/26-eth0-rx-29539-21irqcore07:48:303
29715050,0irq/26-eth0-rx-29197-21ssh11:39:113
29715050,0irq/26-eth0-rx-25689-21diskstats10:18:253
29715050,0irq/26-eth0-rx-25070-21entropy10:38:273
29715050,0irq/26-eth0-rx-2431-21perl07:28:293
29715050,0irq/26-eth0-rx-22990-21gltestperf11:58:243
29715050,0irq/26-eth0-rx-21208-21sh11:55:523
29715050,0irq/26-eth0-rx-20589-21kthreadcore08:53:293
29715050,0irq/26-eth0-rx-19557-21entropy09:13:273
29715050,0irq/26-eth0-rx-13642-21kthreadcore09:08:323
29715050,0irq/26-eth0-rx-0-21swapper/312:08:203
29715050,0irq/26-eth0-rx-0-21swapper/311:48:273
29715050,0irq/26-eth0-rx-0-21swapper/311:23:273
29715050,0irq/26-eth0-rx-0-21swapper/311:22:113
29715050,0irq/26-eth0-rx-0-21swapper/311:14:193
29715050,0irq/26-eth0-rx-0-21swapper/310:33:273
29715050,0irq/26-eth0-rx-0-21swapper/310:12:573
29715050,0irq/26-eth0-rx-0-21swapper/310:03:303
29715050,0irq/26-eth0-rx-0-21swapper/309:55:013
29715050,0irq/26-eth0-rx-0-21swapper/309:48:283
29715050,0irq/26-eth0-rx-0-21swapper/308:48:313
29715050,0irq/26-eth0-rx-0-21swapper/307:08:283
259950,0migration/28921-21sh09:23:552
259950,0migration/26522-21taskset11:48:232
259950,0migration/26358-21munin-node10:23:312
259950,0migration/232514-21kthreadcore08:38:312
259950,0migration/232514-21kthreadcore08:38:312
259950,0migration/229002-21fschecks_count07:48:272
259950,0migration/228267-21gltestperf07:23:272
259950,0migration/224579-21sh10:16:572
259950,0migration/218710-21sh08:52:302
259950,0migration/217813-21kthreadcore08:03:302
259950,0migration/216886-21idleruntime-cro08:28:132
259950,0migration/214944-21kthreadcore06:48:312
259950,0migration/213336-21kthreadcore10:48:312
249950,0watchdog/226896-21grep10:38:312
249950,0watchdog/219481-21kthreadcore10:53:312
179950,0migration/13295-21df_abs09:03:251
179950,0migration/127016-21runrttasks09:18:161
179950,0migration/119475-21kthreadcore09:53:291
169950,0watchdog/132558-21tr07:48:311
169950,0watchdog/12218-21kthreadcore08:38:311
169950,0watchdog/12218-21kthreadcore08:38:311
149950,0migration/06748-21sh11:06:300
149950,0migration/05763-21sh11:25:240
149950,0migration/03688-21latency_hist08:18:140
149950,0migration/03515-21latency_hist08:18:130
149950,0migration/028861-21kthreadcore06:58:310
149950,0migration/024107-21sh10:37:230
149950,0migration/023137-21kthreadcore06:53:310
149950,0migration/021831-21taskset11:57:460
149950,0migration/021068-21sh12:17:270
149950,0migration/02071-21cpuspeed_turbos07:28:270
149950,0migration/019391-21kthreadcore08:28:310
149950,0migration/019339-21aten_r1power_fr08:53:230
149950,0migration/018185-21sh09:11:110
149950,0migration/017878-21sh09:32:060
149950,0migration/015904-21sh10:31:290
149950,0migration/013967-21sh11:52:530
149950,0migration/011453-21kthreadcore07:33:310
129789955,0cyclictest0-21swapper/211:42:422
129789955,0cyclictest0-21swapper/209:02:502
129789954,0cyclictest0-21swapper/211:08:312
129789950,0cyclictest0-21swapper/212:14:232
129789950,0cyclictest0-21swapper/212:09:392
129789950,0cyclictest0-21swapper/211:57:312
129789950,0cyclictest0-21swapper/211:14:192
129789950,0cyclictest0-21swapper/210:36:572
129789950,0cyclictest0-21swapper/210:30:292
129789950,0cyclictest0-21swapper/208:33:402
129729955,0cyclictest0-21swapper/107:38:111
129729953,0cyclictest21811-21awk07:18:291
4140,0ktimersoftd/00-21swapper/011:58:190
339940,0migration/329505-21kthreadcore08:58:313
339940,0migration/328249-21munin-plugin-st07:48:133
339940,0migration/326146-21taskset06:57:263
29725040,0irq/27-eth0-tx-5949-21ssh11:04:072
29725040,0irq/27-eth0-tx-32553-21ssh10:43:172
29725040,0irq/27-eth0-tx-23739-21cpuspeed_turbos11:18:292
29725040,0irq/27-eth0-tx-0-21swapper/211:58:332
29725040,0irq/27-eth0-tx-0-21swapper/211:43:342
29725040,0irq/27-eth0-tx-0-21swapper/211:23:382
29725040,0irq/27-eth0-tx-0-21swapper/210:03:282
29725040,0irq/27-eth0-tx-0-21swapper/209:18:592
29725040,0irq/27-eth0-tx-0-21swapper/208:53:412
29725040,0irq/27-eth0-tx-0-21swapper/008:43:370
29725040,0irq/27-eth0-tx-0-21swapper/007:58:360
29725040,0irq/27-eth0-tx-0-21swapper/006:48:350
29715040,0irq/26-eth0-rx-29692-21cpuspeed_turbos08:13:263
29715040,0irq/26-eth0-rx-0-21swapper/310:26:023
29715040,0irq/26-eth0-rx-0-21swapper/309:44:343
259940,0migration/25596-21munin-node08:43:292
259940,0migration/222051-21kthreadcore06:53:302
259940,0migration/220319-21missed_timers11:33:292
259940,0migration/213539-21kthreadcore10:08:302
249940,0watchdog/26130-21kthreadcore07:53:312
249940,0watchdog/214148-21kthreadcore07:58:312
249940,0watchdog/210013-21kthreadcore07:08:322
249940,0watchdog/20-21swapper/209:28:312
249940,0watchdog/20-21swapper/207:13:322
179940,0migration/19743-21unixbench_singl08:18:371
179940,0migration/19651-21idleruntime10:28:271
179940,0migration/16246-21fschecks_count12:08:251
179940,0migration/14595-21ntp_offset11:23:321
179940,0migration/13275-21irqrtprio09:43:301
179940,0migration/13261-21kthreadcore07:03:311
179940,0migration/128044-21kthreadcore10:18:301
179940,0migration/127415-21if_eth1.206:58:291
179940,0migration/126091-21taskset09:16:061
179940,0migration/124419-21fschecks_time08:33:271
179940,0migration/123772-21kthreadcore09:33:311
179940,0migration/123527-21aten_r1power_fr11:18:271
179940,0migration/115865-21gltestperf07:38:261
179940,0migration/11499-21fschecks_time10:23:261
179940,0migration/114349-21kthreadcore07:58:321
179940,0migration/111795-21fschecks_time09:08:281
179940,0migration/110066-21fschecks_time10:08:251
169940,0watchdog/19480-21kthreadcore08:43:311
169940,0watchdog/19228-21ssh09:24:511
169940,0watchdog/128340-21if_err_eth007:23:281
169940,0watchdog/128223-21cut09:58:311
169940,0watchdog/125025-21latency06:53:321
169940,0watchdog/120188-21kthreadcore08:28:311
169940,0watchdog/117208-21grep07:13:321
169940,0watchdog/116330-21ssh09:49:031
169940,0watchdog/115536-21kthreadcore12:13:301
169940,0watchdog/115284-21cut09:28:311
169940,0watchdog/113209-21ssh11:28:471
169940,0watchdog/10-21swapper/111:10:271
169940,0watchdog/10-21swapper/110:53:311
169940,0watchdog/10-21swapper/110:47:151
169940,0watchdog/10-21swapper/106:48:321
149940,0migration/0908-21kthreadcore11:43:300
149940,0migration/07878-21sh10:26:090
149940,0migration/03554-21pmu-power08:38:340
149940,0migration/03554-21pmu-power08:38:340
149940,0migration/030131-21ksmtuned12:03:210
149940,0migration/027950-21kthreadcore09:38:300
149940,0migration/025482-21idleruntime10:38:280
149940,0migration/024613-21sh09:55:120
149940,0migration/023192-21sh10:56:260
149940,0migration/022556-21idleruntime-cro08:08:130
149940,0migration/021710-21latency_hist07:43:140
149940,0migration/013528-21runrttasks11:29:450
149940,0migration/013476-21kthreadcore08:23:320
149940,0migration/012653-21sh12:10:540
129789944,0cyclictest0-21swapper/207:07:252
129789943,0cyclictest4003-21awk09:03:282
129789943,0cyclictest3556-21lldpd07:35:282
129729944,0cyclictest21305-21ssh11:34:211
129729944,0cyclictest0-21swapper/111:17:201
129729944,0cyclictest0-21swapper/108:58:261
129729943,0cyclictest3556-21lldpd07:53:281
129729943,0cyclictest3514-21snmpd07:46:081
129729943,0cyclictest3241-21irqbalance07:28:321
129729943,0cyclictest31721-21awk11:43:281
129729943,0cyclictest31073-21awk12:03:271
129729943,0cyclictest25520-21awk10:38:281
129729943,0cyclictest24943-21awk10:58:281
129729943,0cyclictest23702-21awk11:38:271
129729943,0cyclictest23258-21awk11:58:261
129729943,0cyclictest2264-21awk10:03:271
129729943,0cyclictest20233-21awk08:53:281
129729943,0cyclictest17704-21awk10:33:291
129729943,0cyclictest11312-21awk08:23:281
129729943,0cyclictest0-21swapper/111:48:141
129729940,0cyclictest0-21swapper/110:50:031
129639944,0cyclictest0-21swapper/011:38:360
129639944,0cyclictest0-21swapper/009:49:300
129639943,0cyclictest8597-21awk11:08:270
129639943,0cyclictest3556-21lldpd10:09:280
129639943,0cyclictest3556-21lldpd09:43:280
129639943,0cyclictest3556-21lldpd07:09:580
129639943,0cyclictest3514-21snmpd07:55:530
129639943,0cyclictest3241-21irqbalance11:15:110
129639943,0cyclictest3241-21irqbalance10:58:210
129639943,0cyclictest3241-21irqbalance10:48:210
129639943,0cyclictest3241-21irqbalance10:46:410
129639943,0cyclictest3241-21irqbalance09:25:110
129639943,0cyclictest3241-21irqbalance09:03:310
129639943,0cyclictest3241-21irqbalance08:59:410
129639943,0cyclictest3241-21irqbalance08:49:210
129639943,0cyclictest3241-21irqbalance08:33:520
129639943,0cyclictest3241-21irqbalance07:23:420
129639943,0cyclictest27916-21awk09:18:270
129639943,0cyclictest26766-21awk09:58:290
129639943,0cyclictest21553-21crond07:43:130
129639943,0cyclictest19997-21awk09:13:280
129639943,0cyclictest18227-21awk10:13:290
129639943,0cyclictest15856-21awk11:33:260
129639940,0cyclictest23174-21diskstats08:08:270
29715030,0irq/26-eth0-rx-5010-21cpuspeed_turbos08:43:263
29715030,0irq/26-eth0-rx-0-21swapper/308:33:253
29715030,0irq/26-eth0-rx-0-21swapper/308:05:373
29715030,0irq/26-eth0-rx-0-21swapper/307:38:243
29715030,0irq/26-eth0-rx-0-21swapper/307:27:383
29715030,0irq/26-eth0-rx-0-21swapper/307:19:113
29715030,0irq/26-eth0-rx-0-21swapper/307:13:153
29715030,0irq/26-eth0-rx-0-21swapper/307:03:303
259930,0migration/221885-21aten_r1power_fr07:43:272
249930,0watchdog/217871-21munin-node08:28:272
249930,0watchdog/20-21swapper/208:08:272
249930,0watchdog/20-21swapper/207:38:322
249930,0watchdog/20-21swapper/207:28:402
179930,0migration/122514-21kthreadcore10:13:331
179930,0migration/115469-21kthreadcore08:48:301
169930,0watchdog/10-21swapper/111:03:311
169930,0watchdog/10-21swapper/109:38:311
169930,0watchdog/10-21swapper/108:08:151
169930,0watchdog/10-21swapper/107:08:321
129789932,0cyclictest3556-21lldpd08:18:272
129789932,0cyclictest30321-21awk08:13:282
129789930,0cyclictest0-21swapper/207:18:312
129729932,0cyclictest3556-21lldpd08:13:271
129729932,0cyclictest19557-21kthreadcore11:53:301
129729932,0cyclictest17126-21awk08:03:281
129639932,0cyclictest29329-21awk07:48:290
129639932,0cyclictest25873-21fschecks_time10:18:260
129639932,0cyclictest2361-21awk10:03:280
129639932,0cyclictest1727-21awk07:03:290
129639930,0cyclictest24141-21perl11:18:300
129639930,0cyclictest24125-21munin-node09:33:350
29715020,0irq/26-eth0-rx-0-21swapper/308:08:253
29715020,0irq/26-eth0-rx-0-21swapper/307:33:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional