You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 04:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Apr 25, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2106624027,0sleep20-21swapper/219:19:002
2090723725,0sleep00-21swapper/019:17:100
2122023424,0sleep10-21swapper/119:20:471
2105723127,0sleep30-21swapper/319:18:533
35160,0ktimersoftd/30-21swapper/323:44:273
339960,0migration/332495-21sh23:46:433
339960,0migration/330113-21munin-node19:26:203
339960,0migration/316276-21sh23:39:323
29815060,0irq/29-eth0-tx-11364-21munin-node21:06:240
29805060,0irq/28-eth0-rx-29757-21python22:11:283
29805060,0irq/28-eth0-rx-21754-21sh23:21:573
213139966,0cyclictest0-21swapper/200:49:092
213139965,0cyclictest24649-21ps22:11:212
213139960,0cyclictest0-21swapper/223:29:232
213139960,0cyclictest0-21swapper/222:41:552
213139960,0cyclictest0-21swapper/221:54:192
149960,0migration/07190-21kthreadcore23:51:230
149960,0migration/05525-21sh00:29:090
149960,0migration/027159-21kthreadcore20:31:190
149960,0migration/012567-21switchtime22:01:290
8305050,0irq/26-0000:00:6808-21pmu-power21:21:232
8305050,0irq/26-0000:00:1547-21awk22:36:042
339950,0migration/34150-21kthreadcore19:51:213
339950,0migration/34091-21cpuspeed_turbos20:16:163
339950,0migration/332562-21df_abs23:31:173
339950,0migration/328399-21taskset20:07:413
339950,0migration/324892-21kthreadcore00:21:213
339950,0migration/324863-21kthreadcore23:06:213
339950,0migration/32456-21kthreadcore21:21:203
339950,0migration/324442-21kthreadcore19:21:193
339950,0migration/322235-21munin-node21:51:203
339950,0migration/321818-21kthreadcore00:01:213
339950,0migration/32171-21taskset21:38:293
339950,0migration/318201-21diskmemload22:26:203
339950,0migration/315289-21fschecks_time20:01:163
339950,0migration/314548-21sh23:20:513
339950,0migration/313759-21idleruntime23:01:183
339950,0migration/311729-21kthreadcore21:26:213
339950,0migration/310792-21latency_hist19:36:033
329950,0watchdog/332140-21grep21:56:223
329950,0watchdog/322023-21ssh00:36:473
329950,0watchdog/321001-21smartctl20:46:263
329950,0watchdog/320869-21tr21:31:183
329950,0watchdog/31689-21sensors22:51:273
329950,0watchdog/311647-21hddtemp_smartct23:56:193
329950,0watchdog/30-21swapper/322:36:233
329950,0watchdog/30-21swapper/300:34:193
29815050,0irq/29-eth0-tx-4113-21sed23:11:292
29815050,0irq/29-eth0-tx-4110-21munin-node21:01:240
29815050,0irq/29-eth0-tx-32717-21munin-node20:36:250
29815050,0irq/29-eth0-tx-21991-21munin-node20:51:230
29815050,0irq/29-eth0-tx-17751-21perl22:26:182
29815050,0irq/29-eth0-tx-0-21swapper/021:21:230
29815050,0irq/29-eth0-tx-0-21swapper/020:46:270
29815050,0irq/29-eth0-tx-0-21swapper/019:46:150
29805050,0irq/28-eth0-rx-8487-21cut22:56:243
29805050,0irq/28-eth0-rx-8267-21perl20:41:173
29805050,0irq/28-eth0-rx-26674-21munin-node22:31:183
29805050,0irq/28-eth0-rx-25449-21kthreadcore00:41:223
29805050,0irq/28-eth0-rx-2335-21kthreadcore22:16:213
29805050,0irq/28-eth0-rx-20834-21cut21:11:203
29805050,0irq/28-eth0-rx-1915-21kthreadcore00:26:243
29805050,0irq/28-eth0-rx-13219-21ssh22:02:313
29805050,0irq/28-eth0-rx-1098-21fschecks_time20:36:183
29805050,0irq/28-eth0-rx-0-21swapper/323:26:233
29805050,0irq/28-eth0-rx-0-21swapper/323:11:223
29805050,0irq/28-eth0-rx-0-21swapper/322:42:563
29805050,0irq/28-eth0-rx-0-21swapper/322:07:263
29805050,0irq/28-eth0-rx-0-21swapper/321:41:213
29805050,0irq/28-eth0-rx-0-21swapper/300:46:203
29805050,0irq/28-eth0-rx-0-21swapper/300:13:433
259950,0migration/227799-21munin-node20:06:242
249950,0watchdog/29410-21ssh23:53:232
249950,0watchdog/213005-21kthreadcore19:56:222
213139955,0cyclictest0-21swapper/223:36:092
213139955,0cyclictest0-21swapper/223:21:302
213139955,0cyclictest0-21swapper/222:57:132
213139955,0cyclictest0-21swapper/222:21:352
213139955,0cyclictest0-21swapper/222:21:352
213139955,0cyclictest0-21swapper/222:05:212
213139955,0cyclictest0-21swapper/200:35:072
213139950,0cyclictest0-21swapper/200:07:222
213129955,0cyclictest0-21swapper/122:01:151
213129954,0cyclictest3524-21snmpd21:32:281
213119950,0cyclictest0-21swapper/000:08:160
213119950,0cyclictest0-21swapper/000:05:160
179950,0migration/15150-21taskset00:28:061
179950,0migration/131347-21taskset00:43:481
179950,0migration/130791-21kthreadcore21:16:211
179950,0migration/129347-21munin-node20:11:161
179950,0migration/127998-21switchtime20:06:271
179950,0migration/124956-21kthreadcore20:51:201
179950,0migration/123953-21sh22:27:211
179950,0migration/122995-21sh00:39:301
179950,0migration/120168-21fschecks_time00:01:171
179950,0migration/119711-21taskset21:47:521
179950,0migration/119101-21latency_hist00:01:041
179950,0migration/117904-21kthreadcore00:16:221
179950,0migration/114247-21latency22:21:211
179950,0migration/114247-21latency22:21:211
179950,0migration/111032-21taskset20:21:041
169950,0watchdog/132155-21kthreadcore20:56:221
169950,0watchdog/112137-21chrt00:14:511
149950,0migration/09146-21kernelversion20:41:210
149950,0migration/08824-21sh22:37:090
149950,0migration/08792-21cpuspeed_turbos23:36:170
149950,0migration/08734-21kthreadcore00:11:210
149950,0migration/07132-21taskset22:18:260
149950,0migration/05700-21kthreadcore00:46:220
149950,0migration/05470-21kthreadcore19:31:200
149950,0migration/03465-21taskset20:14:470
149950,0migration/031099-21kthreadcore22:31:210
149950,0migration/028272-21sh00:21:320
149950,0migration/026592-21kthreadcore23:26:220
149950,0migration/025054-21kthreadcore21:51:220
149950,0migration/024676-21kthreadcore23:06:210
149950,0migration/024379-21kthreadcore19:21:190
149950,0migration/020905-21kthreadcore21:11:200
149950,0migration/018443-21kthreadcore20:01:210
149950,0migration/018138-21latency_hist21:31:040
149950,0migration/016788-21kthreadcore00:16:210
149950,0migration/016370-21irqrtprio23:21:190
149950,0migration/013148-21kthreadcore22:41:220
149950,0migration/013016-21sh23:16:360
149950,0migration/012976-21kthreadcore19:56:220
149950,0migration/012247-21kernelversion23:56:220
149950,0migration/011827-21taskset21:45:140
8305040,0irq/26-0000:00:0-21swapper/221:11:042
339940,0migration/332143-21taskset20:32:103
339940,0migration/326798-21taskset21:16:183
339940,0migration/320683-21irqrtprio22:46:213
339940,0migration/314844-21kthreadcore20:21:213
329940,0watchdog/38365-21python23:51:273
329940,0watchdog/30-21swapper/320:56:223
329940,0watchdog/30-21swapper/319:56:223
329940,0watchdog/30-21swapper/319:46:143
29815040,0irq/29-eth0-tx-27078-21munin-node21:36:192
29815040,0irq/29-eth0-tx-12982-21ssh23:16:312
29815040,0irq/29-eth0-tx-0-21swapper/223:56:192
29815040,0irq/29-eth0-tx-0-21swapper/223:46:162
29815040,0irq/29-eth0-tx-0-21swapper/223:41:172
29815040,0irq/29-eth0-tx-0-21swapper/223:31:132
29815040,0irq/29-eth0-tx-0-21swapper/222:51:372
29815040,0irq/29-eth0-tx-0-21swapper/222:46:282
29815040,0irq/29-eth0-tx-0-21swapper/222:16:092
29815040,0irq/29-eth0-tx-0-21swapper/221:31:532
29815040,0irq/29-eth0-tx-0-21swapper/221:26:062
29815040,0irq/29-eth0-tx-0-21swapper/200:41:132
29815040,0irq/29-eth0-tx-0-21swapper/200:36:092
29815040,0irq/29-eth0-tx-0-21swapper/200:21:052
29815040,0irq/29-eth0-tx-0-21swapper/200:17:222
29815040,0irq/29-eth0-tx-0-21swapper/019:51:280
29815040,0irq/29-eth0-tx-0-21swapper/019:41:210
29805040,0irq/28-eth0-rx-19300-21if_err_eth120:26:193
29805040,0irq/28-eth0-rx-0-21swapper/322:21:323
29805040,0irq/28-eth0-rx-0-21swapper/322:21:323
29805040,0irq/28-eth0-rx-0-21swapper/321:46:203
29805040,0irq/28-eth0-rx-0-21swapper/319:41:143
29805040,0irq/28-eth0-rx-0-21swapper/300:16:173
29805040,0irq/28-eth0-rx-0-21swapper/300:06:163
259940,0migration/29811-21munin-node20:16:232
259940,0migration/28766-21kthreadcore21:41:222
259940,0migration/26859-21kthreadcore00:11:202
259940,0migration/231729-21smart_sdb20:31:252
259940,0migration/227772-21kthreadcore19:46:192
259940,0migration/226761-21munin-node21:16:172
259940,0migration/219743-21fschecks_count00:01:172
259940,0migration/218611-21df_abs20:26:172
259940,0migration/214314-21kthreadcore19:36:212
259940,0migration/21063-21fschecks_time20:36:172
249940,0watchdog/27399-21tr22:36:232
213139944,0cyclictest0-21swapper/223:01:192
213139943,0cyclictest3571-21lldpd20:43:512
213139943,0cyclictest3571-21lldpd20:25:212
213139943,0cyclictest3571-21lldpd19:31:192
213139943,0cyclictest3571-21lldpd19:23:492
213139943,0cyclictest3571-21lldpd00:26:222
213139943,0cyclictest3250-21irqbalance21:46:202
213139943,0cyclictest3250-21irqbalance21:06:202
213139943,0cyclictest3250-21irqbalance21:02:102
213139943,0cyclictest30910-21awk21:56:202
213139943,0cyclictest30283-21awk20:56:202
213139943,0cyclictest22493-21awk23:06:182
213139943,0cyclictest15902-21awk22:06:192
213139943,0cyclictest1186-21awk19:51:192
213129943,0cyclictest9568-21awk23:36:201
213129943,0cyclictest4723-21awk19:31:191
213129943,0cyclictest3524-21snmpd19:51:121
213129943,0cyclictest3524-21snmpd00:34:151
213129943,0cyclictest29073-21awk00:06:211
213129943,0cyclictest26533-21awk20:31:171
213129943,0cyclictest22325-21awk21:51:201
213129943,0cyclictest20338-21awk22:46:201
213129943,0cyclictest15952-21awk22:06:191
213129942,0cyclictest19107-21awk19:41:181
213119944,0cyclictest21325-21kworker/0:020:09:020
213119944,0cyclictest21325-21kworker/0:019:38:500
213119944,0cyclictest0-21swapper/023:42:530
213119944,0cyclictest0-21swapper/023:13:240
213119944,0cyclictest0-21swapper/000:31:170
213119943,0cyclictest4965-21awk20:16:190
213119943,0cyclictest3571-21lldpd21:47:510
213119943,0cyclictest3571-21lldpd21:26:210
213119943,0cyclictest3571-21lldpd20:29:210
213119943,0cyclictest3524-21snmpd00:41:450
213119943,0cyclictest3193-21sadc21:41:040
213119943,0cyclictest30298-21awk20:56:200
213119943,0cyclictest15846-21awk22:06:190
213119943,0cyclictest13800-21awk23:01:190
213119940,0cyclictest0-21swapper/022:14:260
179940,0migration/16303-21aten_r1power_en23:16:141
179940,0migration/130689-21taskset23:27:471
179940,0migration/12413-21kthreadcore20:36:211
179940,0migration/12345-21kthreadcore22:16:211
179940,0migration/12178-21kthreadcore23:31:221
179940,0migration/119816-21kthreadcore20:46:211
179940,0migration/119261-21fschecks_time21:11:161
179940,0migration/117126-21aten_r1power_cu23:41:141
179940,0migration/114845-21kthreadcore23:01:211
179940,0migration/11424-21fschecks_time21:21:161
179940,0migration/114018-21kthreadcore22:41:221
179940,0migration/112432-21kthreadcore21:26:211
179940,0migration/112290-21gltestperf21:06:181
179940,0migration/111395-21kthreadcore20:41:221
179940,0migration/11126-21kthreadcore21:56:231
179940,0migration/110697-21taskset20:19:481
179940,0migration/110145-21ntp_kernel_pll_21:01:221
169940,0watchdog/17398-21cut22:36:231
169940,0watchdog/132251-21kthreadcore22:51:231
169940,0watchdog/125374-21stty19:46:141
169940,0watchdog/122743-21tr20:26:221
169940,0watchdog/115072-21cpu23:21:151
169940,0watchdog/11046-21ssh23:49:231
169940,0watchdog/10-21swapper/121:41:221
169940,0watchdog/10-21swapper/121:36:221
169940,0watchdog/10-21swapper/119:56:221
149940,0migration/02241-21kthreadcore23:31:220
329930,0watchdog/30-21swapper/321:04:223
329930,0watchdog/30-21swapper/320:51:143
329930,0watchdog/30-21swapper/319:31:183
29805030,0irq/28-eth0-rx-0-21swapper/321:06:153
29805030,0irq/28-eth0-rx-0-21swapper/320:11:083
259930,0migration/230484-21kernelversion20:11:202
213139932,0cyclictest19194-21awk19:41:182
213139932,0cyclictest15624-21awk20:01:182
213139932,0cyclictest0-21swapper/220:51:162
213139930,0cyclictest15232-21diskstats20:46:162
213129932,0cyclictest3571-21lldpd22:31:211
213129932,0cyclictest27291-21cat19:21:201
213129932,0cyclictest2515-21grep23:51:181
213129932,0cyclictest17040-21sensors19:36:251
213129931,0cyclictest30734-21tune2fs23:11:181
213129930,0cyclictest0-21swapper/123:06:161
213129930,0cyclictest0-21swapper/119:29:071
213119933,0cyclictest26441-21kworker/0:221:16:130
213119933,0cyclictest21325-21kworker/0:020:21:060
213119933,0cyclictest21325-21kworker/0:019:26:080
213119932,0cyclictest3524-21snmpd22:57:140
213119932,0cyclictest3524-21snmpd22:27:580
213119932,0cyclictest28516-21grep23:46:210
213119932,0cyclictest15308-21aten_r1power_vo00:36:170
213119931,0cyclictest0-21swapper/022:21:210
213119931,0cyclictest0-21swapper/022:21:210
213119930,0cyclictest30568-21perl21:56:190
179930,0migration/115696-21if_eth1.220:01:191
169930,0watchdog/123372-21ssh22:11:061
169930,0watchdog/121536-21munin-node00:21:311
169930,0watchdog/10-21swapper/122:57:231
169930,0watchdog/10-21swapper/100:46:191
213139921,0cyclictest0-21swapper/219:26:152
213119921,0cyclictest2061-21jbd2/md0-822:51:040
213119921,0cyclictest19051-21latency_hist22:46:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional