You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 12:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Dec 10, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2913501070,0irq/25-eth10-21swapper/318:37:543
1829229186,0sleep20-21swapper/218:36:152
1852124534,0sleep00-21swapper/018:38:530
1819923826,0sleep10-21swapper/118:35:101
185989988,0cyclictest6445-21snmpd23:19:001
169970,0watchdog/10-21swapper/123:09:121
149970,0migration/0500-21idleruntime-cro21:48:570
339960,0migration/38997-21dump-pmu-power20:53:583
339960,0migration/314744-21munin-node21:34:183
28415060,0irq/27-eth0-tx-31441-21ssh23:05:482
28415060,0irq/27-eth0-tx-0-21swapper/223:45:512
28415060,0irq/27-eth0-tx-0-21swapper/223:20:232
28415060,0irq/27-eth0-tx-0-21swapper/223:14:002
28415060,0irq/27-eth0-tx-0-21swapper/223:09:262
28415060,0irq/27-eth0-tx-0-21swapper/222:50:262
28415060,0irq/27-eth0-tx-0-21swapper/222:28:292
28415060,0irq/27-eth0-tx-0-21swapper/222:19:422
28415060,0irq/27-eth0-tx-0-21swapper/222:02:032
28415060,0irq/27-eth0-tx-0-21swapper/221:17:052
28415060,0irq/27-eth0-tx-0-21swapper/221:05:482
28415060,0irq/27-eth0-tx-0-21swapper/220:56:062
28415060,0irq/27-eth0-tx-0-21swapper/220:56:062
28415060,0irq/27-eth0-tx-0-21swapper/220:44:392
28405060,0irq/26-eth0-rx-5319-21kthreadcore22:29:163
28405060,0irq/26-eth0-rx-0-21swapper/321:57:213
249960,0watchdog/230575-21ssh00:06:402
185989960,0cyclictest0-21swapper/123:54:151
185989960,0cyclictest0-21swapper/122:01:131
149960,0migration/07458-21sh20:50:030
149960,0migration/031322-21sh23:46:460
149960,0migration/014298-21pmu-power23:14:180
339950,0migration/39722-21munin-node21:14:103
339950,0migration/39472-21idleruntime22:14:123
339950,0migration/39407-21kthreadcore18:54:153
339950,0migration/37270-21diskmemload23:30:573
339950,0migration/33605-21kthreadcore21:09:133
339950,0migration/330908-21munin-node20:44:203
339950,0migration/327885-21kthreadcore00:04:163
339950,0migration/326335-21munin-node18:44:143
339950,0migration/325742-21munin-node23:24:153
339950,0migration/325348-21munin-node22:44:123
339950,0migration/325126-21kthreadcore20:19:173
339950,0migration/325035-21latency_hist21:43:573
339950,0migration/323478-21sh23:20:553
339950,0migration/321305-21fschecks_count19:29:133
339950,0migration/321010-21kthreadcore20:14:173
339950,0migration/31945-21kthreadcore23:49:163
339950,0migration/317323-21latency_hist21:18:583
339950,0migration/316953-21cpuspeed_turbos22:19:103
339950,0migration/316102-21taskset22:38:193
339950,0migration/310664-21kthreadcore20:54:183
339950,0migration/310664-21kthreadcore20:54:183
339950,0migration/310253-21kthreadcore19:19:153
28415050,0irq/27-eth0-tx-7565-21ssh21:09:252
28415050,0irq/27-eth0-tx-6549-21ssh23:50:242
28415050,0irq/27-eth0-tx-6472-21munin-node18:54:190
28415050,0irq/27-eth0-tx-22380-21ssh22:39:212
28415050,0irq/27-eth0-tx-21777-21munin-node19:54:160
28415050,0irq/27-eth0-tx-0-21swapper/223:54:412
28415050,0irq/27-eth0-tx-0-21swapper/223:40:312
28415050,0irq/27-eth0-tx-0-21swapper/223:29:132
28415050,0irq/27-eth0-tx-0-21swapper/222:55:542
28415050,0irq/27-eth0-tx-0-21swapper/222:36:452
28415050,0irq/27-eth0-tx-0-21swapper/222:33:152
28415050,0irq/27-eth0-tx-0-21swapper/222:16:432
28415050,0irq/27-eth0-tx-0-21swapper/222:12:432
28415050,0irq/27-eth0-tx-0-21swapper/222:05:392
28415050,0irq/27-eth0-tx-0-21swapper/221:51:332
28415050,0irq/27-eth0-tx-0-21swapper/221:46:442
28415050,0irq/27-eth0-tx-0-21swapper/221:42:512
28415050,0irq/27-eth0-tx-0-21swapper/221:25:282
28415050,0irq/27-eth0-tx-0-21swapper/221:19:392
28415050,0irq/27-eth0-tx-0-21swapper/220:49:042
28415050,0irq/27-eth0-tx-0-21swapper/220:41:282
28415050,0irq/27-eth0-tx-0-21swapper/200:00:332
28415050,0irq/27-eth0-tx-0-21swapper/020:23:270
28405050,0irq/26-eth0-rx-7425-21ssh22:11:183
28405050,0irq/26-eth0-rx-6547-21runrttasks22:55:203
28405050,0irq/26-eth0-rx-4710-21kthreadcore21:49:163
28405050,0irq/26-eth0-rx-32157-21kthreadcore19:59:143
28405050,0irq/26-eth0-rx-30618-21ssh23:44:453
28405050,0irq/26-eth0-rx-28954-21kthreadcore23:04:163
28405050,0irq/26-eth0-rx-24719-21ssh20:43:373
28405050,0irq/26-eth0-rx-0-21swapper/323:59:513
28405050,0irq/26-eth0-rx-0-21swapper/323:40:043
28405050,0irq/26-eth0-rx-0-21swapper/323:34:193
28405050,0irq/26-eth0-rx-0-21swapper/323:17:113
28405050,0irq/26-eth0-rx-0-21swapper/323:13:433
28405050,0irq/26-eth0-rx-0-21swapper/322:49:143
28405050,0irq/26-eth0-rx-0-21swapper/322:24:313
28405050,0irq/26-eth0-rx-0-21swapper/322:07:073
28405050,0irq/26-eth0-rx-0-21swapper/321:59:353
28405050,0irq/26-eth0-rx-0-21swapper/321:24:023
28405050,0irq/26-eth0-rx-0-21swapper/320:58:583
27150,0ktimersoftd/20-21swapper/221:32:192
259950,0migration/224541-21kthreadcore19:54:172
259950,0migration/21244-21fschecks_count19:14:122
249950,0watchdog/230377-21ssh23:24:202
249950,0watchdog/229828-21kthreadcore22:44:162
249950,0watchdog/227556-21irqcore19:09:122
249950,0watchdog/210846-21cut21:54:162
186009950,0cyclictest0-21swapper/223:02:202
186009950,0cyclictest0-21swapper/221:35:472
185989955,0cyclictest16803-21diskmemload22:48:301
185989955,0cyclictest14979-21ssh22:35:061
185989955,0cyclictest0-21swapper/123:17:221
185989955,0cyclictest0-21swapper/122:43:091
185989955,0cyclictest0-21swapper/122:29:451
185989955,0cyclictest0-21swapper/122:06:151
185989955,0cyclictest0-21swapper/121:18:201
185989954,0cyclictest30861-21unixbench_singl22:24:231
185989950,0cyclictest0-21swapper/120:52:091
185979955,0cyclictest0-21swapper/023:13:170
185979955,0cyclictest0-21swapper/021:02:540
185979955,0cyclictest0-21swapper/020:48:050
185979950,0cyclictest0-21swapper/023:50:110
179950,0migration/13686-21kthreadcore18:49:151
179950,0migration/131292-21taskset00:08:531
179950,0migration/129433-21kthreadcore19:09:131
179950,0migration/126105-21sh20:44:141
179950,0migration/121411-21kthreadcore20:59:161
179950,0migration/115269-21irqcore19:24:131
179950,0migration/114056-21munin-node22:54:181
179950,0migration/11195-21munin-node23:29:111
179950,0migration/110076-21kthreadcore18:54:151
169950,0watchdog/13411-21lldpd23:49:161
169950,0watchdog/1229152sleep123:40:201
169950,0watchdog/10-21swapper/121:34:161
169950,0watchdog/10-21swapper/121:28:321
169950,0watchdog/10-21swapper/119:20:361
149950,0migration/08616-21aten_r1power_fr22:54:110
149950,0migration/08223-21sh21:11:240
149950,0migration/07609-21taskset22:52:140
149950,0migration/06973-21taskset19:15:490
149950,0migration/030349-21kthreadcore19:59:140
149950,0migration/030327-21kthreadcore21:24:170
149950,0migration/030235-21kthreadcore19:09:140
149950,0migration/028013-21kthreadcore22:04:180
149950,0migration/024372-21sh23:23:250
149950,0migration/022437-21sh22:59:190
149950,0migration/022407-21kthreadcore19:04:150
149950,0migration/021987-21kthreadcore20:39:170
149950,0migration/019527-21kthreadcore22:39:170
149950,0migration/017421-21aten_r1power_cu21:19:090
149950,0migration/01655-21latency_hist19:38:580
149950,0migration/010288-21if_eth1.320:54:160
149950,0migration/010288-21if_eth1.320:54:160
149950,0migration/010010-21kthreadcore22:14:140
8225040,0irq/24-0000:00:0-21swapper/220:29:032
339940,0migration/35330-21kthreadcore19:14:163
339940,0migration/34477-21kthreadcore20:04:143
339940,0migration/330087-21kthreadcore19:34:163
339940,0migration/32416-21ntp_states20:24:203
339940,0migration/322849-21kthreadcore19:04:153
339940,0migration/321322-21kthreadcore22:59:163
339940,0migration/318836-21kthreadcore19:24:153
339940,0migration/316210-21irqcore19:49:143
339940,0migration/314891-21idleruntime-cro19:48:583
28415040,0irq/27-eth0-tx-0-21swapper/223:34:422
28415040,0irq/27-eth0-tx-0-21swapper/020:24:160
28415040,0irq/27-eth0-tx-0-21swapper/018:49:200
28405040,0irq/26-eth0-rx-6547-21runrttasks21:45:433
28405040,0irq/26-eth0-rx-32683-21fschecks_count18:49:113
28405040,0irq/26-eth0-rx-0-21swapper/323:55:153
28405040,0irq/26-eth0-rx-0-21swapper/322:39:493
28405040,0irq/26-eth0-rx-0-21swapper/321:29:003
28405040,0irq/26-eth0-rx-0-21swapper/321:04:163
259940,0migration/29367-21kthreadcore18:54:152
259940,0migration/228922-21kthreadcore19:34:162
259940,0migration/228577-21timerwakeupswit20:19:232
249940,0watchdog/226779-21kthreadcore18:44:162
249940,0watchdog/225457-21munin-node19:04:202
249940,0watchdog/218250-21kthreadcore20:14:162
249940,0watchdog/210010-21perl20:09:122
249940,0watchdog/20-21swapper/219:59:082
186009943,0cyclictest6445-21snmpd19:32:542
186009943,0cyclictest6445-21snmpd19:22:392
186009943,0cyclictest6445-21snmpd18:39:092
186009943,0cyclictest3425-21lldpd20:59:362
186009943,0cyclictest3425-21lldpd20:05:052
186009943,0cyclictest3425-21lldpd19:52:362
186009943,0cyclictest3425-21lldpd19:03:062
186009943,0cyclictest3425-21lldpd18:53:362
186009943,0cyclictest30086-21tail20:24:142
186009943,0cyclictest2672-21awk19:39:162
186009943,0cyclictest11229-21awk20:34:132
185989944,0cyclictest0-21swapper/122:51:111
185989943,0cyclictest6445-21snmpd23:05:541
185989943,0cyclictest6445-21snmpd19:29:391
185989943,0cyclictest3425-21lldpd20:07:351
185989943,0cyclictest30216-21awk20:24:151
185989943,0cyclictest15845-21crond20:13:581
185989943,0cyclictest1488-21sadc19:38:581
185989943,0cyclictest11148-21kworker/1:223:33:591
185989943,0cyclictest11148-21kworker/1:222:20:211
185989943,0cyclictest11148-21kworker/1:222:14:111
185989943,0cyclictest11148-21kworker/1:221:44:371
185979944,0cyclictest0-21swapper/022:20:190
185979943,0cyclictest9387-21awk19:44:170
185979943,0cyclictest8920-21awk23:54:150
185979943,0cyclictest6445-21snmpd21:29:090
185979943,0cyclictest6445-21snmpd20:09:390
185979943,0cyclictest6445-21snmpd18:44:090
185979943,0cyclictest6445-21snmpd18:41:390
185979943,0cyclictest4548-21awk20:29:140
185979943,0cyclictest3425-21lldpd22:29:130
185979943,0cyclictest31314-21sadc00:08:570
185979943,0cyclictest3110-21irqbalance23:24:320
185979943,0cyclictest3110-21irqbalance22:44:120
185979943,0cyclictest3110-21irqbalance22:34:520
185979943,0cyclictest3110-21irqbalance22:24:120
185979943,0cyclictest3110-21irqbalance21:49:420
185979943,0cyclictest3110-21irqbalance21:04:220
185979943,0cyclictest3110-21irqbalance20:34:020
185979943,0cyclictest3110-21irqbalance20:14:020
185979943,0cyclictest3110-21irqbalance20:05:020
185979943,0cyclictest3110-21irqbalance19:49:120
185979943,0cyclictest3110-21irqbalance19:34:120
185979943,0cyclictest3110-21irqbalance19:24:020
185979943,0cyclictest3110-21irqbalance19:19:520
185979943,0cyclictest25691-21awk23:04:140
185979943,0cyclictest21678-21awk19:29:150
185979943,0cyclictest14102-21awk18:59:130
185979940,0cyclictest0-21swapper/022:03:570
179940,0migration/14312-21kthreadcore21:29:161
179940,0migration/12911-21kthreadcore21:49:151
179940,0migration/12784-21kthreadcore22:09:141
179940,0migration/127079-21kthreadcore23:24:171
179940,0migration/122793-21aten_r1power_fr20:19:121
179940,0migration/119105-21kthreadcore20:39:161
179940,0migration/118655-21irqrtprio21:19:141
179940,0migration/11826-21irqcore19:14:141
179940,0migration/11615-21munin-node21:09:091
179940,0migration/114578-21taskset19:45:401
179940,0migration/112337-21kthreadcore20:34:151
179940,0migration/11084-21kthreadcore19:59:151
169940,0watchdog/18941-21ssh21:54:041
169940,0watchdog/124393-21aten_r1power_cu23:44:081
169940,0watchdog/124048-21ssh21:41:241
169940,0watchdog/113121-21munin-node18:59:121
169940,0watchdog/10-21swapper/122:59:561
169940,0watchdog/10-21swapper/121:04:321
169940,0watchdog/10-21swapper/120:54:161
169940,0watchdog/10-21swapper/120:54:161
169940,0watchdog/10-21swapper/120:29:121
169940,0watchdog/10-21swapper/120:14:121
169940,0watchdog/10-21swapper/119:54:121
149940,0migration/023675-21sh21:40:190
149940,0migration/02234-21kthreadcore22:09:140
8225030,0irq/24-0000:00:0-21swapper/219:43:582
28405030,0irq/26-eth0-rx-0-21swapper/320:29:113
28405030,0irq/26-eth0-rx-0-21swapper/320:10:243
28405030,0irq/26-eth0-rx-0-21swapper/319:54:113
28405030,0irq/26-eth0-rx-0-21swapper/319:11:363
28405030,0irq/26-eth0-rx-0-21swapper/318:39:193
186009933,0cyclictest3425-21lldpd19:25:352
185989933,0cyclictest11148-21kworker/1:219:49:111
185989933,0cyclictest11148-21kworker/1:218:39:091
185989932,0cyclictest2602-21awk19:39:161
185989932,0cyclictest20877-21cut19:04:141
185979933,0cyclictest0-21swapper/023:29:030
185979932,0cyclictest16922-21sadc21:38:570
185979932,0cyclictest10319-21awk21:14:130
185979932,0cyclictest0-21swapper/023:34:230
185979931,0cyclictest18596-21cyclictest23:59:150
185979931,0cyclictest17785-21kthreadcore23:39:150
185979930,0cyclictest9380-21diskstats21:54:120
169930,0watchdog/10-21swapper/123:59:121
169930,0watchdog/10-21swapper/118:44:041
28405020,0irq/26-eth0-rx-0-21swapper/320:34:083
28405020,0irq/26-eth0-rx-0-21swapper/319:39:123
28405020,0irq/26-eth0-rx-0-21swapper/318:59:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional