You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 12:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon Aug 24, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
738224839,0sleep10-21swapper/119:29:221
751123928,0sleep00-21swapper/019:30:490
712723526,0sleep20-21swapper/219:26:312
748523120,0sleep30-21swapper/319:30:363
329970,0watchdog/34469-21sh23:15:143
75949965,0cyclictest5475-21grep19:51:152
75949960,0cyclictest0-21swapper/200:19:572
75929960,0cyclictest0-21swapper/022:50:540
339960,0migration/37413-21unixbench-2d20:56:243
339960,0migration/34623-21sh00:48:423
339960,0migration/33879-21sh00:31:043
339960,0migration/331572-21sh22:31:223
339960,0migration/320545-21sh23:22:013
329960,0watchdog/316211-21rm23:58:343
329960,0watchdog/310547-21kthreadcore00:51:183
29805060,0irq/28-eth0-rx-31080-21sed21:56:143
179960,0migration/16094-21sh23:34:251
149960,0migration/04172-21sh00:47:210
149960,0migration/021193-21cpuspeed_turbos00:41:120
149960,0migration/020678-21sh00:40:590
149960,0migration/012861-21sh23:19:460
8305050,0irq/26-0000:00:5270-21grep23:16:132
75949955,0cyclictest0-21swapper/222:45:592
75949955,0cyclictest0-21swapper/222:39:032
75949955,0cyclictest0-21swapper/222:10:592
75949955,0cyclictest0-21swapper/221:50:012
75949955,0cyclictest0-21swapper/220:59:532
75949955,0cyclictest0-21swapper/200:53:412
75949955,0cyclictest0-21swapper/200:35:052
75949950,0cyclictest29347-21kthreadcore00:06:162
75949950,0cyclictest0-21swapper/222:57:112
75949950,0cyclictest0-21swapper/222:22:302
75949950,0cyclictest0-21swapper/222:06:252
75949950,0cyclictest0-21swapper/221:26:032
75929950,0cyclictest0-21swapper/000:22:590
4150,0ktimersoftd/00-21swapper/023:54:460
339950,0migration/39572-21kthreadcore19:31:143
339950,0migration/38197-21aten_r1power_cu21:01:093
339950,0migration/36234-21kthreadcore21:41:173
339950,0migration/332739-21taskset00:07:043
339950,0migration/329851-21kthreadcore21:36:173
339950,0migration/329397-21taskset21:13:323
339950,0migration/328628-21timerandwakeup20:26:243
339950,0migration/327130-21aten_r1power_fr22:51:093
339950,0migration/324466-21kthreadcore23:06:183
339950,0migration/321856-21kthreadcore00:01:153
339950,0migration/321508-21pmu-power21:06:193
339950,0migration/319519-21munin-node20:46:123
339950,0migration/318747-21taskset00:36:233
339950,0migration/318714-21taskset21:28:093
339950,0migration/318449-21kthreadcore23:41:173
339950,0migration/317876-21kthreadcore00:56:183
339950,0migration/317245-21latency19:56:173
339950,0migration/31303-21fschecks_time20:11:123
339950,0migration/311985-21irqcore00:16:163
339950,0migration/311672-21taskset20:41:013
339950,0migration/311054-21needreboot23:16:203
339950,0migration/310497-21runrttasks19:51:223
329950,0watchdog/39661-21tr20:16:173
329950,0watchdog/321944-21rm00:41:143
329950,0watchdog/30-21swapper/300:15:103
29815050,0irq/29-eth0-tx-9449-21cat23:36:162
29815050,0irq/29-eth0-tx-8901-21ssh00:11:522
29815050,0irq/29-eth0-tx-840-21munin-node20:56:240
29815050,0irq/29-eth0-tx-3524-21snmpd20:41:120
29815050,0irq/29-eth0-tx-29851-21munin-node21:16:140
29815050,0irq/29-eth0-tx-29490-21munin-node00:46:212
29815050,0irq/29-eth0-tx-28684-21ssh00:44:292
29815050,0irq/29-eth0-tx-27746-21munin-node21:36:182
29815050,0irq/29-eth0-tx-21472-21munin-node21:51:212
29815050,0irq/29-eth0-tx-16756-21irqcore23:41:162
29815050,0irq/29-eth0-tx-0-21swapper/223:33:252
29815050,0irq/29-eth0-tx-0-21swapper/223:06:122
29815050,0irq/29-eth0-tx-0-21swapper/222:51:222
29815050,0irq/29-eth0-tx-0-21swapper/222:19:462
29815050,0irq/29-eth0-tx-0-21swapper/200:58:052
29815050,0irq/29-eth0-tx-0-21swapper/020:30:190
29815050,0irq/29-eth0-tx-0-21swapper/020:21:170
29815050,0irq/29-eth0-tx-0-21swapper/020:13:390
29805050,0irq/28-eth0-rx-8482-21ssh22:37:163
29805050,0irq/28-eth0-rx-8095-21ssh22:20:583
29805050,0irq/28-eth0-rx-6577-21python23:51:253
29805050,0irq/28-eth0-rx-27749-21ps21:51:213
29805050,0irq/28-eth0-rx-24423-21kthreadcore21:31:163
29805050,0irq/28-eth0-rx-13091-21df_abs21:46:123
29805050,0irq/28-eth0-rx-0-21swapper/323:36:103
29805050,0irq/28-eth0-rx-0-21swapper/322:27:423
29805050,0irq/28-eth0-rx-0-21swapper/322:16:173
29805050,0irq/28-eth0-rx-0-21swapper/322:03:293
29805050,0irq/28-eth0-rx-0-21swapper/320:36:123
29805050,0irq/28-eth0-rx-0-21swapper/300:28:303
259950,0migration/232312-21unixbench_multi20:06:252
259950,0migration/232280-21kthreadcore23:11:142
259950,0migration/231895-21kthreadcore19:46:172
259950,0migration/230224-21kthreadcore22:31:172
259950,0migration/228848-21sendmail_mailtr21:11:222
259950,0migration/223743-21kernelversion23:26:162
259950,0migration/220376-21if_eth1.300:21:172
259950,0migration/214293-21pmu-power21:01:192
249950,0watchdog/29737-21gltestperf23:56:142
249950,0watchdog/210560-21port_sshpriv20:36:212
179950,0migration/19829-21munin-node23:56:151
179950,0migration/13841-21latency_hist00:30:591
179950,0migration/131705-21sh21:36:181
179950,0migration/119497-21fschecks_time20:01:131
179950,0migration/11831-21latency_hist00:10:591
179950,0migration/110410-21kthreadcore22:21:151
169950,0watchdog/130712-21kthreadcore00:26:181
169950,0watchdog/125604-21kthreadcore21:51:171
149950,0migration/09949-21kthreadcore00:51:180
149950,0migration/09101-21gltestperf21:01:120
149950,0migration/07097-21kthreadcore20:36:180
149950,0migration/07063-21sh23:36:100
149950,0migration/04937-21kthreadcore22:56:160
149950,0migration/03507-21kthreadcore22:16:170
149950,0migration/031356-21kthreadcore20:31:140
149950,0migration/031185-21sh23:47:520
149950,0migration/029435-21kthreadcore20:51:160
149950,0migration/028979-21munin-node21:36:160
149950,0migration/027804-21sh23:08:510
149950,0migration/02487-21kthreadcore19:46:180
149950,0migration/023057-21kthreadcore20:01:170
149950,0migration/022185-21taskset21:08:210
149950,0migration/022057-21kthreadcore21:31:160
149950,0migration/020002-21switchtime23:21:240
149950,0migration/01957-21taskset22:53:190
149950,0migration/019438-21runrttasks21:46:280
149950,0migration/018427-21kthreadcore19:36:150
149950,0migration/016346-21fschecks_time23:41:130
149950,0migration/015609-21kthreadcore23:01:160
149950,0migration/015480-21irqcore00:56:170
149950,0migration/015429-21kthreadcore22:41:180
149950,0migration/014519-21taskset19:33:260
149950,0migration/013897-21taskset22:04:020
149950,0migration/011318-21kthreadcore22:21:160
149950,0migration/011232-21sh00:33:180
8305040,0irq/26-0000:00:16445-21latency_hist22:25:582
8305040,0irq/26-0000:00:0-21swapper/320:30:583
75949944,0cyclictest0-21swapper/220:01:142
75949943,0cyclictest3524-21snmpd23:03:292
75949943,0cyclictest3524-21snmpd21:07:132
75949943,0cyclictest3524-21snmpd20:32:432
75949943,0cyclictest3524-21snmpd20:11:132
75949943,0cyclictest20338-21awk21:31:142
75949941,0cyclictest0-21swapper/222:41:112
75939943,0cyclictest9094-21awk20:16:161
75939943,0cyclictest5316-21awk19:51:141
75939943,0cyclictest482-21awk22:16:141
75939943,0cyclictest3571-21lldpd23:39:251
75939943,0cyclictest3571-21lldpd23:29:551
75939943,0cyclictest3571-21lldpd22:33:541
75939943,0cyclictest31170-21awk21:56:151
75939943,0cyclictest30541-21awk00:46:171
75939943,0cyclictest28171-21awk22:51:141
75939943,0cyclictest26997-21awk00:06:151
75939943,0cyclictest24471-21awk22:11:171
75939943,0cyclictest21416-21awk23:06:161
75939943,0cyclictest1718-21awk20:11:141
75939943,0cyclictest15428-21awk00:56:161
75939943,0cyclictest13797-21awk21:46:141
75939943,0cyclictest1261-21awk23:51:171
75929944,0cyclictest0-21swapper/023:12:490
75929944,0cyclictest0-21swapper/022:39:240
75929943,0cyclictest3524-21snmpd22:30:290
75929943,0cyclictest3524-21snmpd19:51:280
75929943,0cyclictest28812-21awk00:26:160
75929943,0cyclictest26391-21awk22:31:140
75929943,0cyclictest25848-21sadc20:50:580
75929943,0cyclictest1667-21sadc00:10:590
339940,0migration/317175-21kthreadcore19:36:153
339940,0migration/317158-21kthreadcore20:21:143
329940,0watchdog/3319112chrt20:51:173
329940,0watchdog/30-21swapper/322:46:423
329940,0watchdog/30-21swapper/322:41:183
329940,0watchdog/30-21swapper/320:01:173
329940,0watchdog/30-21swapper/319:46:173
29815040,0irq/29-eth0-tx-11482-21munin-node19:56:100
29815040,0irq/29-eth0-tx-0-21swapper/223:51:172
29815040,0irq/29-eth0-tx-0-21swapper/223:46:262
29815040,0irq/29-eth0-tx-0-21swapper/223:21:062
29815040,0irq/29-eth0-tx-0-21swapper/222:01:102
29815040,0irq/29-eth0-tx-0-21swapper/221:56:012
29815040,0irq/29-eth0-tx-0-21swapper/221:41:142
29815040,0irq/29-eth0-tx-0-21swapper/200:36:102
29815040,0irq/29-eth0-tx-0-21swapper/200:01:232
29805040,0irq/28-eth0-rx-0-21swapper/323:46:083
29805040,0irq/28-eth0-rx-0-21swapper/323:31:003
29805040,0irq/28-eth0-rx-0-21swapper/323:26:103
29805040,0irq/28-eth0-rx-0-21swapper/323:01:163
29805040,0irq/28-eth0-rx-0-21swapper/322:56:063
29805040,0irq/28-eth0-rx-0-21swapper/322:12:393
29805040,0irq/28-eth0-rx-0-21swapper/322:06:403
29805040,0irq/28-eth0-rx-0-21swapper/300:21:273
259940,0migration/28583-21fschecks_time19:31:102
259940,0migration/27440-21kthreadcore21:21:152
259940,0migration/230345-21fschecks_count21:16:122
259940,0migration/226118-21aten_r1power_en20:51:092
259940,0migration/223979-21kthreadcore20:26:162
259940,0migration/220565-21kthreadcore20:21:162
259940,0migration/215138-21kthreadcore19:56:162
249940,0watchdog/230713-21kthreadcore00:26:182
19140,0ktimersoftd/10-21swapper/122:43:391
179940,0migration/17884-21kthreadcore22:01:151
179940,0migration/17469-21kthreadcore21:21:151
179940,0migration/17436-21mdstat22:36:171
179940,0migration/15984-21gltestperf23:16:151
179940,0migration/13945-21kthreadcore20:56:161
179940,0migration/132632-21kthreadcore21:16:161
179940,0migration/132167-21kthreadcore20:31:151
179940,0migration/129771-21runrttasks23:11:101
179940,0migration/128965-21sshd20:27:161
179940,0migration/126491-21kthreadcore23:46:151
179940,0migration/123377-21kthreadcore00:41:171
179940,0migration/119937-21kthreadcore21:06:171
179940,0migration/118858-21kthreadcore20:21:151
179940,0migration/118656-21kthreadcore19:36:151
179940,0migration/118282-21kthreadcore22:06:161
179940,0migration/117499-21fschecks_time22:26:141
179940,0migration/116886-21kthreadcore00:36:171
179940,0migration/114860-21kthreadcore00:16:181
169940,0watchdog/126761-21ssh21:34:091
169940,0watchdog/126737-21sh00:23:501
169940,0watchdog/125173-21kthreadcore21:11:171
169940,0watchdog/121113-21kthreadcore23:41:181
169940,0watchdog/119748-21ssh23:05:141
169940,0watchdog/118458-21kthreadcore23:21:181
169940,0watchdog/110548-21kthreadcore00:51:181
169940,0watchdog/10-21swapper/120:06:171
169940,0watchdog/10-21swapper/119:46:171
149940,0migration/032602-21kthreadcore23:31:160
149940,0migration/025839-21kthreadcore23:26:160
149940,0migration/025748-21kthreadcore22:11:190
149940,0migration/017164-21timerwakeupswit00:16:250
149940,0migration/011910-21runrttasks21:44:260
75949932,0cyclictest23002-21grep20:46:162
75949932,0cyclictest16609-21cut19:36:152
75949932,0cyclictest12836-21awk20:41:142
75949930,0cyclictest0-21swapper/219:41:162
75939932,0cyclictest4324-21awk22:56:141
75939932,0cyclictest21362-21grep20:46:161
75939932,0cyclictest18971-21diskmemload00:01:331
75939932,0cyclictest16075-21cut21:26:161
75939932,0cyclictest16034-21grep20:41:161
75939932,0cyclictest12611-21awk19:56:141
75939930,0cyclictest8893-21perl21:01:121
75939930,0cyclictest4792-21perl21:41:131
75929932,0cyclictest3524-21snmpd20:10:580
75929932,0cyclictest3524-21snmpd00:00:590
75929932,0cyclictest23658-21basename21:11:150
75929930,0cyclictest9519-21perl23:56:130
75929930,0cyclictest32070-21cut21:56:170
75929930,0cyclictest23000-21perl19:41:120
75929930,0cyclictest15695-21perl22:06:120
75929930,0cyclictest12794-21perl21:26:110
75929930,0cyclictest10295-21kthreadcore20:16:170
329930,0watchdog/30-21swapper/321:21:133
329930,0watchdog/30-21swapper/321:16:093
29805030,0irq/28-eth0-rx-0-21swapper/320:06:103
249930,0watchdog/20-21swapper/220:16:172
179930,0migration/128385-21kthreadcore20:51:161
179930,0migration/127799-21kthreadcore19:41:171
179930,0migration/112511-21kthreadcore19:31:151
169930,0watchdog/10-21swapper/122:46:021
169930,0watchdog/10-21swapper/120:37:051
75929921,0cyclictest0-21swapper/021:51:010
75929921,0cyclictest0-21swapper/021:20:590
75929920,0cyclictest0-21swapper/000:10:590
329920,0watchdog/30-21swapper/319:41:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional