You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 20:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Sep 23, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3044501030,0irq/25-eth10-21swapper/306:40:363
3123626362,0sleep20-21swapper/206:42:252
3119224837,0sleep00-21swapper/006:41:510
3092523228,0sleep10-21swapper/106:38:431
35160,0ktimersoftd/30-21swapper/310:44:163
339960,0migration/38169-21sh11:09:573
339960,0migration/3682-21sh11:06:433
339960,0migration/328530-21idleruntime-cro08:18:053
339960,0migration/325315-21sh10:40:193
339960,0migration/310446-21sh09:49:133
313679966,0cyclictest0-21swapper/010:09:400
313679960,0cyclictest0-21swapper/012:08:230
29725060,0irq/27-eth0-tx-29715-21munin-node08:43:230
259960,0migration/26627-21sa107:13:052
19160,0ktimersoftd/129466-21diskmemload08:58:081
149960,0migration/027826-21sh08:59:200
149960,0migration/020664-21kthreadcore06:58:210
149960,0migration/017412-21irqrtprio11:58:200
8215050,0irq/24-0000:00:18473-21cat10:38:042
339950,0migration/39670-21munin-node10:08:303
339950,0migration/39575-21idleruntime08:03:203
339950,0migration/36689-21taskset06:48:183
339950,0migration/35171-21unixbench_multi06:43:273
339950,0migration/331128-21kthreadcore07:53:213
339950,0migration/329403-21latency_hist09:03:053
339950,0migration/329078-21kthreadcore07:03:233
339950,0migration/326571-21irqrtprio11:23:253
339950,0migration/324234-21munin-node12:03:203
339950,0migration/323558-21taskset11:18:313
339950,0migration/323464-21kthreadcore10:18:223
339950,0migration/322436-21irqcore08:58:203
339950,0migration/321289-21kthreadcore08:33:233
339950,0migration/321273-21irqcore07:23:203
339950,0migration/32050-21switchtime08:18:273
339950,0migration/319390-21taskset09:57:073
339950,0migration/316910-21aten_r1power_en11:38:143
339950,0migration/316585-21kthreadcore09:33:233
339950,0migration/315970-21taskset08:31:173
339950,0migration/311720-21kthreadcore07:13:223
339950,0migration/31016-21munin-node07:08:203
313699955,0cyclictest0-21swapper/207:38:202
313699950,0cyclictest0-21swapper/210:08:062
313699950,0cyclictest0-21swapper/209:28:232
313689955,0cyclictest0-21swapper/111:55:211
313689955,0cyclictest0-21swapper/111:09:471
313689955,0cyclictest0-21swapper/109:56:571
313689955,0cyclictest0-21swapper/108:49:561
313689954,0cyclictest5434-21awk09:28:191
313689950,0cyclictest29466-21diskmemload08:46:571
313689950,0cyclictest0-21swapper/109:35:491
313679955,0cyclictest0-21swapper/011:36:410
313679955,0cyclictest0-21swapper/008:08:160
313679950,0cyclictest0-21swapper/009:57:120
29725050,0irq/27-eth0-tx-5905-21munin-node06:48:250
29725050,0irq/27-eth0-tx-26361-21diskstats11:03:192
29725050,0irq/27-eth0-tx-23644-21grep10:58:242
29725050,0irq/27-eth0-tx-23644-21grep10:58:242
29725050,0irq/27-eth0-tx-22807-21missed_timers11:18:212
29725050,0irq/27-eth0-tx-21437-21ssh09:38:182
29725050,0irq/27-eth0-tx-2021-21munin-node10:48:292
29725050,0irq/27-eth0-tx-0-21swapper/212:07:302
29725050,0irq/27-eth0-tx-0-21swapper/210:47:022
29725050,0irq/27-eth0-tx-0-21swapper/210:29:192
29725050,0irq/27-eth0-tx-0-21swapper/210:23:032
29725050,0irq/27-eth0-tx-0-21swapper/210:16:212
29725050,0irq/27-eth0-tx-0-21swapper/007:58:280
29725050,0irq/27-eth0-tx-0-21swapper/007:38:230
29725050,0irq/27-eth0-tx-0-21swapper/007:08:200
29715050,0irq/26-eth0-rx-6376-21cut08:23:223
29715050,0irq/26-eth0-rx-22939-21kthreadcore09:38:193
29715050,0irq/26-eth0-rx-17515-21kthreadcore11:58:213
29715050,0irq/26-eth0-rx-16086-21unixbench-2d10:53:263
29715050,0irq/26-eth0-rx-15386-21ssh11:34:273
29715050,0irq/26-eth0-rx-13754-21kthreadcore10:33:223
29715050,0irq/26-eth0-rx-13570-21fschecks_count09:13:173
29715050,0irq/26-eth0-rx-1049-21cpuspeed_turbos11:28:163
29715050,0irq/26-eth0-rx-10233-21ssh10:32:423
29715050,0irq/26-eth0-rx-0-21swapper/311:13:223
29715050,0irq/26-eth0-rx-0-21swapper/311:01:583
29715050,0irq/26-eth0-rx-0-21swapper/311:01:583
29715050,0irq/26-eth0-rx-0-21swapper/310:49:553
29715050,0irq/26-eth0-rx-0-21swapper/310:04:353
29715050,0irq/26-eth0-rx-0-21swapper/310:02:243
29715050,0irq/26-eth0-rx-0-21swapper/309:46:283
29715050,0irq/26-eth0-rx-0-21swapper/309:31:253
29715050,0irq/26-eth0-rx-0-21swapper/309:26:183
29715050,0irq/26-eth0-rx-0-21swapper/309:18:213
29715050,0irq/26-eth0-rx-0-21swapper/308:49:543
259950,0migration/26381-21unixbench_multi11:48:282
259950,0migration/24082-21taskset08:45:332
259950,0migration/228434-21kthreadcore07:28:212
259950,0migration/22695-21sh09:44:592
259950,0migration/219995-21sh09:58:152
259950,0migration/218049-21unixbench-2d09:53:292
259950,0migration/21796-21sh10:03:592
259950,0migration/217863-21kthreadcore08:53:232
259950,0migration/212437-21kthreadcore11:13:222
259950,0migration/210135-21kthreadcore08:03:222
249950,0watchdog/230705-21timerandwakeup11:43:302
179950,0migration/15676-21turbostat06:48:051
179950,0migration/14295-21kthreadcore10:48:231
179950,0migration/129232-21cpuspeed_turbos09:23:201
179950,0migration/127164-21kernelversion07:03:221
179950,0migration/121039-21aten_r1power_cu09:18:141
179950,0migration/11999-21timerwakeupswit09:43:301
179950,0migration/118468-21latency_hist10:38:041
179950,0migration/112358-21kthreadcore10:33:211
179950,0migration/11129-21kthreadcore09:03:241
169950,0watchdog/129715-21tr11:23:261
169950,0watchdog/113486-21kthreadcore11:13:221
169950,0watchdog/112473-21iostat10:13:181
169950,0watchdog/10-21swapper/111:43:301
149950,0migration/06901-21kthreadcore10:28:220
149950,0migration/06799-21kthreadcore08:23:220
149950,0migration/06246-21kthreadcore09:28:210
149950,0migration/06122-21munin-node11:48:260
149950,0migration/03611-21taskset09:04:290
149950,0migration/032459-21kthreadcore09:23:250
149950,0migration/031447-21kthreadcore07:28:220
149950,0migration/030497-21kthreadcore09:43:240
149950,0migration/029330-21kthreadcore07:53:200
149950,0migration/028563-21irqrtprio10:23:230
149950,0migration/028114-21taskset08:13:380
149950,0migration/026958-21munin-node11:03:220
149950,0migration/026359-21kthreadcore12:03:250
149950,0migration/025349-21aten_r1power_cu11:23:190
149950,0migration/024267-21sh11:42:220
149950,0migration/023004-21kthreadcore09:58:210
149950,0migration/022232-21kthreadcore09:38:190
149950,0migration/021234-21aten_r1power_po07:48:170
149950,0migration/020935-21kthreadcore11:18:200
149950,0migration/020295-21munin-node10:18:190
149950,0migration/020012-21kthreadcore10:58:200
149950,0migration/020012-21kthreadcore10:58:200
149950,0migration/016907-21taskset10:33:590
149950,0migration/014944-21latency08:28:250
149950,0migration/013539-21taskset07:18:060
149950,0migration/013386-21latency_hist07:18:050
339940,0migration/332440-21diskmemload11:48:013
339940,0migration/329343-21kthreadcore10:23:243
339940,0migration/317512-21kthreadcore07:43:213
339940,0migration/313774-21irqrtprio06:53:213
339940,0migration/310392-21kthreadcore07:38:243
313699944,0cyclictest0-21swapper/211:53:352
313699943,0cyclictest3556-21lldpd10:34:012
313699943,0cyclictest3556-21lldpd07:51:492
313699943,0cyclictest3514-21snmpd07:15:562
313699943,0cyclictest3514-21snmpd06:53:112
313699943,0cyclictest32433-21awk06:43:192
313699943,0cyclictest3241-21irqbalance11:33:522
313699943,0cyclictest3241-21irqbalance08:35:132
313699943,0cyclictest21085-21awk07:23:192
313699943,0cyclictest15346-21awk07:43:192
313699943,0cyclictest0-21swapper/209:08:062
313699941,0cyclictest21836-21sh08:13:052
313699940,0cyclictest0-21swapper/210:23:142
313689944,0cyclictest0-21swapper/111:38:001
313689943,0cyclictest7755-21awk07:13:191
313689943,0cyclictest529-21awk12:08:181
313689943,0cyclictest4344-21awk10:08:191
313689943,0cyclictest3514-21snmpd08:30:411
313689943,0cyclictest3514-21snmpd07:55:411
313689943,0cyclictest3514-21snmpd06:53:561
313689943,0cyclictest3514-21snmpd06:48:261
313689943,0cyclictest2950-21awk07:58:191
313689943,0cyclictest27389-21awk10:43:231
313689943,0cyclictest1190-21awk11:48:191
313679944,0cyclictest0-21swapper/007:03:090
313679943,0cyclictest6076-21awk08:48:200
313679943,0cyclictest3514-21snmpd11:46:420
313679943,0cyclictest3017-21awk10:48:210
313679943,0cyclictest21157-21awk07:23:190
313679943,0cyclictest19471-21awk10:38:190
313679943,0cyclictest17205-21awk08:33:190
29725040,0irq/27-eth0-tx-23034-21ssh11:38:332
29725040,0irq/27-eth0-tx-21458-21tail08:58:162
29725040,0irq/27-eth0-tx-0-21swapper/212:08:062
29725040,0irq/27-eth0-tx-0-21swapper/211:30:422
29725040,0irq/27-eth0-tx-0-21swapper/211:09:442
29725040,0irq/27-eth0-tx-0-21swapper/210:53:062
29725040,0irq/27-eth0-tx-0-21swapper/209:24:492
29725040,0irq/27-eth0-tx-0-21swapper/209:18:342
29725040,0irq/27-eth0-tx-0-21swapper/209:13:182
29725040,0irq/27-eth0-tx-0-21swapper/006:54:430
29715040,0irq/26-eth0-rx-19190-21ssh08:53:283
29715040,0irq/26-eth0-rx-0-21swapper/312:08:113
29715040,0irq/26-eth0-rx-0-21swapper/311:53:203
29715040,0irq/26-eth0-rx-0-21swapper/311:49:183
29715040,0irq/26-eth0-rx-0-21swapper/310:13:103
29715040,0irq/26-eth0-rx-0-21swapper/309:08:413
29715040,0irq/26-eth0-rx-0-21swapper/308:43:303
29715040,0irq/26-eth0-rx-0-21swapper/307:58:223
29715040,0irq/26-eth0-rx-0-21swapper/307:52:523
259940,0migration/28484-21kthreadcore09:48:212
259940,0migration/27955-21kthreadcore08:48:222
259940,0migration/25643-21kthreadcore07:58:222
259940,0migration/231789-21kthreadcore09:03:232
259940,0migration/225992-21kthreadcore08:13:222
259940,0migration/224406-21kthreadcore08:38:222
259940,0migration/220489-21munin-node06:58:212
249940,0watchdog/28317-21latency08:23:232
249940,0watchdog/216191-21munin-node11:58:262
249940,0watchdog/20-21swapper/211:23:262
249940,0watchdog/20-21swapper/209:33:232
179940,0migration/16983-21kthreadcore09:48:211
179940,0migration/14202-21kthreadcore07:08:221
179940,0migration/131992-21kthreadcore10:03:261
179940,0migration/128159-21kthreadcore11:03:241
179940,0migration/127144-21runrttasks09:40:041
179940,0migration/126607-21pmu-power07:48:251
179940,0migration/12625-21kthreadcore07:33:191
179940,0migration/125936-21kthreadcore08:13:221
179940,0migration/124834-21sh11:00:331
179940,0migration/124834-21sh11:00:331
179940,0migration/122603-21sshd08:35:511
179940,0migration/122473-21sh11:58:521
179940,0migration/122008-21kthreadcore11:18:211
179940,0migration/115861-21fschecks_count08:08:181
179940,0migration/114011-21fschecks_count07:18:181
179940,0migration/112258-21kthreadcore08:03:231
169940,0watchdog/19404-21ssh10:30:101
169940,0watchdog/18318-21latency08:23:231
169940,0watchdog/16559-21runrttasks07:45:431
169940,0watchdog/15030-21ssh09:08:071
169940,0watchdog/128020-21cut08:38:231
169940,0watchdog/116360-21ssh10:53:501
169940,0watchdog/10-21swapper/112:03:261
169940,0watchdog/10-21swapper/110:02:581
169940,0watchdog/10-21swapper/108:53:231
169940,0watchdog/10-21swapper/106:58:231
149940,0migration/03561-21kthreadcore11:08:230
149940,0migration/031107-21kthreadcore08:18:200
149940,0migration/014048-21kthreadcore09:33:220
313699932,0cyclictest29605-21awk08:18:182
313689933,0cyclictest0-21swapper/110:18:521
313689933,0cyclictest0-21swapper/107:28:261
313689932,0cyclictest8732-21awk07:38:221
313689932,0cyclictest20061-21ssh09:15:581
313689931,0cyclictest0-21swapper/111:28:211
313689930,0cyclictest0-21swapper/108:18:211
313679933,0cyclictest3556-21lldpd08:38:180
313679933,0cyclictest30294-21kworker/0:210:43:090
313679933,0cyclictest30294-21kworker/0:210:14:320
313679933,0cyclictest30294-21kworker/0:209:48:160
313679933,0cyclictest30294-21kworker/0:209:18:060
313679933,0cyclictest27309-21kworker/0:111:28:150
313679933,0cyclictest10713-21kworker/0:107:45:520
313679933,0cyclictest10713-21kworker/0:106:43:140
313679932,0cyclictest8414-21aten2.4-expect11:53:150
313679932,0cyclictest3241-21irqbalance09:08:230
313679932,0cyclictest13993-21awk09:13:190
313679932,0cyclictest13373-21munin-node08:53:240
313679932,0cyclictest1266-21sensors10:03:300
313679932,0cyclictest10928-21awk10:53:180
313679932,0cyclictest1084-21basename07:33:130
313679932,0cyclictest10229-21gltestperf11:13:180
29725030,0irq/27-eth0-tx-0-21swapper/008:03:170
29715030,0irq/26-eth0-rx-0-21swapper/307:35:033
29715030,0irq/26-eth0-rx-0-21swapper/307:28:163
29715030,0irq/26-eth0-rx-0-21swapper/307:18:173
29715030,0irq/26-eth0-rx-0-21swapper/306:58:163
259930,0migration/27778-21kthreadcore06:48:212
249930,0watchdog/20-21swapper/207:33:192
249930,0watchdog/20-21swapper/207:18:192
249930,0watchdog/20-21swapper/207:03:592
169930,0watchdog/10-21swapper/111:40:221
169930,0watchdog/10-21swapper/110:23:181
35120,0ktimersoftd/323429-21munin-node08:38:183
313699921,0cyclictest9671-21date08:28:052
313699920,0cyclictest27708-21cat07:53:052
313689921,0cyclictest20126-21date07:23:051
29715020,0irq/26-eth0-rx-0-21swapper/308:08:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional