You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 08:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Aug 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2678227772,0sleep00-21swapper/019:27:150
2711127473,0sleep30-21swapper/319:31:063
2676123725,0sleep10-21swapper/119:26:591
2693823329,0sleep20-21swapper/219:29:052
8305060,0irq/26-0000:00:4757-21hwlatdetect21:11:283
339960,0migration/330505-21sh23:45:333
339960,0migration/329118-21kthreadcore00:21:283
339960,0migration/324534-21sh00:17:093
339960,0migration/322143-21sh23:56:333
339960,0migration/316166-21sh00:12:403
29805060,0irq/28-eth0-rx-975-40yum-updatesd-he21:33:103
29805060,0irq/28-eth0-rx-5323-21diskstats21:56:213
29805060,0irq/28-eth0-rx-4766-21iostat_ios23:11:263
271869960,0cyclictest0-21swapper/221:44:332
271849960,0cyclictest0-21swapper/020:22:080
27160,0ktimersoftd/20-21swapper/200:50:352
149960,0migration/026266-21sh00:36:510
149960,0migration/020803-21sh00:55:310
149960,0migration/019014-21sh23:17:150
149960,0migration/017188-21sh22:57:140
339950,0migration/37815-21kthreadcore21:36:293
339950,0migration/36567-21sh23:50:043
339950,0migration/3505-21kthreadcore19:56:263
339950,0migration/33462-21munin-node20:21:223
339950,0migration/329598-21idleruntime21:51:243
339950,0migration/328308-21taskset21:01:403
339950,0migration/327397-21munin-node00:56:303
339950,0migration/326037-21kthreadcore00:01:263
339950,0migration/324416-21sendmail_mailtr21:21:303
339950,0migration/320251-21taskset00:53:543
339950,0migration/32018-21kthreadcore22:11:263
339950,0migration/319788-21kthreadcore20:31:273
339950,0migration/317999-21diskmemload00:32:383
339950,0migration/31463-21kthreadcore22:31:273
339950,0migration/314588-21kthreadcore21:41:283
339950,0migration/310832-21munin-node20:26:243
329950,0watchdog/38399-21tr00:46:283
329950,0watchdog/36451-21latency00:06:283
329950,0watchdog/326250-21ssh00:36:483
329950,0watchdog/32488-21ssh00:42:043
329950,0watchdog/314530-21taskset23:53:203
329950,0watchdog/30-21swapper/322:26:273
329950,0watchdog/30-21swapper/320:41:233
329950,0watchdog/30-21swapper/300:26:283
29815050,0irq/29-eth0-tx-6723-21munin-node22:16:262
29815050,0irq/29-eth0-tx-30525-21munin-node22:11:282
29815050,0irq/29-eth0-tx-28742-21ssh23:25:422
29815050,0irq/29-eth0-tx-18916-21kthreadcore23:56:262
29815050,0irq/29-eth0-tx-14534-21munin-node20:56:210
29815050,0irq/29-eth0-tx-12130-21munin-node23:16:302
29815050,0irq/29-eth0-tx-0-21swapper/223:06:252
29815050,0irq/29-eth0-tx-0-21swapper/223:02:432
29815050,0irq/29-eth0-tx-0-21swapper/222:45:322
29815050,0irq/29-eth0-tx-0-21swapper/222:36:302
29815050,0irq/29-eth0-tx-0-21swapper/222:06:202
29815050,0irq/29-eth0-tx-0-21swapper/222:00:022
29815050,0irq/29-eth0-tx-0-21swapper/221:46:112
29815050,0irq/29-eth0-tx-0-21swapper/200:56:302
29815050,0irq/29-eth0-tx-0-21swapper/200:53:032
29815050,0irq/29-eth0-tx-0-21swapper/200:45:282
29815050,0irq/29-eth0-tx-0-21swapper/200:32:332
29815050,0irq/29-eth0-tx-0-21swapper/200:11:402
29815050,0irq/29-eth0-tx-0-21swapper/021:20:340
29815050,0irq/29-eth0-tx-0-21swapper/020:01:300
29815050,0irq/29-eth0-tx-0-21swapper/019:41:270
29805050,0irq/28-eth0-rx-8141-21cat23:31:263
29805050,0irq/28-eth0-rx-7793-21fschecks_count20:51:223
29805050,0irq/28-eth0-rx-29582-21cut20:16:253
29805050,0irq/28-eth0-rx-2899-21iostat_ios22:51:263
29805050,0irq/28-eth0-rx-25638-21kthreadcore19:51:273
29805050,0irq/28-eth0-rx-24923-21kthreadcore21:46:273
29805050,0irq/28-eth0-rx-15506-21tr22:21:223
29805050,0irq/28-eth0-rx-1044-21ntpq23:06:293
29805050,0irq/28-eth0-rx-0-21swapper/323:38:103
29805050,0irq/28-eth0-rx-0-21swapper/323:26:273
29805050,0irq/28-eth0-rx-0-21swapper/323:21:273
29805050,0irq/28-eth0-rx-0-21swapper/323:16:273
29805050,0irq/28-eth0-rx-0-21swapper/323:03:013
29805050,0irq/28-eth0-rx-0-21swapper/322:42:253
29805050,0irq/28-eth0-rx-0-21swapper/322:20:403
271869955,0cyclictest0-21swapper/223:29:232
271869954,0cyclictest9671-21kthreadcore23:31:262
271869954,0cyclictest2216-21sh20:21:082
271869950,0cyclictest0-21swapper/200:28:112
271859954,0cyclictest0-21swapper/119:56:271
271859950,0cyclictest0-21swapper/100:22:061
271849952,0cyclictest617-21kworker/0:023:21:220
271849952,0cyclictest27237-21kworker/0:122:21:280
271849952,0cyclictest27237-21kworker/0:121:41:230
271849950,0cyclictest0-21swapper/022:33:560
27150,0ktimersoftd/20-21swapper/221:11:452
259950,0migration/27687-21latency22:51:282
259950,0migration/27247-21munin-node00:06:352
259950,0migration/25554-21sh23:47:062
259950,0migration/23690-21aten_r1power_vo23:11:212
259950,0migration/23344-21fschecks_time20:21:222
259950,0migration/231337-21kthreadcore21:51:262
249950,0watchdog/232348-21idleruntime20:41:232
249950,0watchdog/231084-21kthreadcore21:06:272
249950,0watchdog/230424-21awk22:26:352
249950,0watchdog/223016-21ssh22:24:512
19150,0ktimersoftd/10-21swapper/121:47:071
179950,0migration/17245-21latency_hist20:51:081
179950,0migration/126125-21kthreadcore23:21:271
179950,0migration/116940-21if_eth1.223:56:241
169950,0watchdog/15114-21kthreadcore22:51:271
169950,0watchdog/114110-21grep20:06:231
149950,0migration/05511-21kthreadcore19:36:260
149950,0migration/04679-21latency_hist21:56:080
149950,0migration/04445-21kthreadcore21:36:280
149950,0migration/03561-21latency_hist21:11:080
149950,0migration/031955-21fschecks_count20:41:210
149950,0migration/031953-21sh00:04:160
149950,0migration/030594-21taskset19:53:170
149950,0migration/02846-21if_eth1.222:51:260
149950,0migration/027987-21df_abs20:16:210
149950,0migration/027711-21munin-node21:01:310
149950,0migration/027293-21kthreadcore22:46:270
149950,0migration/027153-21fschecks_time21:31:230
149950,0migration/025232-21irqrtprio22:26:270
149950,0migration/025192-21kthreadcore22:06:260
149950,0migration/02483-21kthreadcore22:11:270
149950,0migration/024656-21sh22:44:270
149950,0migration/023834-21kthreadcore20:11:260
149950,0migration/021444-21kthreadcore23:01:260
149950,0migration/019243-21kthreadcore19:46:250
149950,0migration/017936-21idleruntime20:31:240
149950,0migration/016729-21kthreadcore22:01:260
149950,0migration/016627-21taskset00:14:020
149950,0migration/014487-21taskset23:53:130
149950,0migration/014352-21latency22:36:290
149950,0migration/013719-21kthreadcore00:31:260
339940,0migration/325558-21sh22:46:213
339940,0migration/321877-21latency_hist22:06:083
339940,0migration/319267-21kthreadcore22:01:273
339940,0migration/315784-21irqcore20:56:253
329940,0watchdog/39479-21kthreadcore20:01:273
329940,0watchdog/326981-21kthreadcore20:36:273
329940,0watchdog/310629-21if_eth1.319:41:233
329940,0watchdog/30-21swapper/322:56:113
329940,0watchdog/30-21swapper/322:36:273
29815040,0irq/29-eth0-tx-7248-21munin-node23:51:232
29815040,0irq/29-eth0-tx-28541-21ssh23:41:292
29815040,0irq/29-eth0-tx-0-21swapper/222:46:102
29815040,0irq/29-eth0-tx-0-21swapper/222:01:262
29815040,0irq/29-eth0-tx-0-21swapper/200:01:122
29815040,0irq/29-eth0-tx-0-21swapper/020:36:300
271869944,0cyclictest0-21swapper/222:57:132
271869944,0cyclictest0-21swapper/220:37:322
271869943,0cyclictest3571-21lldpd21:22:012
271869943,0cyclictest32114-21awk19:56:242
271869943,0cyclictest15035-21awk23:36:242
271869940,0cyclictest0-21swapper/220:11:132
271859944,0cyclictest0-21swapper/122:36:191
271859943,0cyclictest4889-21awk21:11:291
271859943,0cyclictest3571-21lldpd22:43:011
271859943,0cyclictest3571-21lldpd22:17:311
271859943,0cyclictest3524-21snmpd00:07:041
271859943,0cyclictest3250-21irqbalance23:51:151
271859943,0cyclictest3250-21irqbalance23:31:251
271859943,0cyclictest3250-21irqbalance23:17:051
271859943,0cyclictest3250-21irqbalance23:11:151
271859943,0cyclictest3250-21irqbalance23:06:351
271859943,0cyclictest3250-21irqbalance22:46:251
271859943,0cyclictest3250-21irqbalance22:07:151
271859943,0cyclictest3250-21irqbalance21:52:151
271859943,0cyclictest3250-21irqbalance21:36:151
271859943,0cyclictest3250-21irqbalance21:28:151
271859943,0cyclictest3250-21irqbalance21:21:351
271859943,0cyclictest3250-21irqbalance21:16:351
271859943,0cyclictest3250-21irqbalance21:06:541
271859943,0cyclictest3250-21irqbalance20:56:141
271859943,0cyclictest3250-21irqbalance20:46:141
271859943,0cyclictest3250-21irqbalance20:41:441
271859943,0cyclictest3250-21irqbalance20:18:041
271859943,0cyclictest3250-21irqbalance20:11:541
271859943,0cyclictest3250-21irqbalance19:52:241
271859943,0cyclictest3250-21irqbalance19:46:241
271859943,0cyclictest3250-21irqbalance19:32:041
271859943,0cyclictest3250-21irqbalance00:56:151
271859943,0cyclictest3250-21irqbalance00:41:151
271859943,0cyclictest3250-21irqbalance00:31:351
271859943,0cyclictest3250-21irqbalance00:16:251
271859943,0cyclictest31578-21awk22:11:241
271859943,0cyclictest30328-21awk23:26:241
271859943,0cyclictest25178-21awk20:36:241
271859943,0cyclictest22841-21awk21:01:271
271859943,0cyclictest19938-21awk23:01:241
271859943,0cyclictest10628-21awk19:41:231
271859943,0cyclictest0-21swapper/120:31:271
271849944,0cyclictest28626-21kworker/0:020:26:090
271849944,0cyclictest26984-21kworker/0:123:46:260
271849944,0cyclictest17898-21kworker/0:221:13:370
271849944,0cyclictest17898-21kworker/0:220:52:090
271849944,0cyclictest0-21swapper/023:33:030
271849943,0cyclictest3571-21lldpd20:48:310
271849943,0cyclictest3250-21irqbalance23:09:550
271849943,0cyclictest32185-21awk19:56:240
271849943,0cyclictest28433-21awk19:31:230
271849943,0cyclictest16836-21awk23:56:240
271849942,0cyclictest617-21kworker/0:023:12:580
271849942,0cyclictest26984-21kworker/0:100:21:260
271849940,0cyclictest6192-21cut00:46:270
259940,0migration/28304-21hddtemp_smartct20:51:232
259940,0migration/226769-21fschecks_count00:21:232
259940,0migration/225568-21kthreadcore19:51:272
259940,0migration/221674-21latency_hist21:01:082
259940,0migration/220918-21kthreadcore00:16:272
259940,0migration/220059-21kthreadcore20:31:272
259940,0migration/218086-21kthreadcore20:06:272
259940,0migration/216859-21aten_r1power_vo19:46:202
259940,0migration/215886-21kthreadcore21:16:302
249940,0watchdog/27830-21kthreadcore19:36:272
249940,0watchdog/216682-21sshd20:31:072
249940,0watchdog/20-21swapper/222:31:232
249940,0watchdog/20-21swapper/221:36:232
249940,0watchdog/20-21swapper/221:31:272
249940,0watchdog/20-21swapper/200:36:242
179940,0migration/19036-21sh00:11:101
179940,0migration/18048-21kthreadcore20:01:261
179940,0migration/17867-21kthreadcore21:56:261
179940,0migration/15807-21kthreadcore20:21:261
179940,0migration/13878-21kthreadcore19:36:261
179940,0migration/131873-21taskset00:04:031
179940,0migration/12581-21kthreadcore22:31:271
179940,0migration/117255-21kthreadcore22:21:271
179940,0migration/115849-21kthreadcore22:01:261
179940,0migration/115014-21kthreadcore00:51:281
179940,0migration/112592-21kthreadcore22:56:251
169940,0watchdog/18398-21cut00:46:281
169940,0watchdog/15862-21ssh23:48:001
169940,0watchdog/14207-21kthreadcore00:26:281
169940,0watchdog/128800-21python23:41:321
169940,0watchdog/125331-21kthreadcore22:26:271
169940,0watchdog/111793-21fschecks_count21:41:231
169940,0watchdog/10-21swapper/121:31:271
169940,0watchdog/10-21swapper/120:26:271
169940,0watchdog/10-21swapper/100:36:241
149940,0migration/06714-21pmu-power00:06:300
149940,0migration/031448-21kthreadcore00:41:270
149940,0migration/026086-21open_files21:46:300
149940,0migration/024615-21kthreadcore23:41:260
149940,0migration/015460-21irqrtprio23:36:250
8305030,0irq/26-0000:00:0-21swapper/320:11:133
339930,0migration/36715-21runrttasks20:46:533
329930,0watchdog/30-21swapper/321:06:273
329930,0watchdog/30-21swapper/320:06:233
329930,0watchdog/30-21swapper/319:36:273
29805030,0irq/28-eth0-rx-0-21swapper/321:26:223
29805030,0irq/28-eth0-rx-0-21swapper/321:20:343
29805030,0irq/28-eth0-rx-0-21swapper/319:46:203
29805030,0irq/28-eth0-rx-0-21swapper/319:31:203
271869932,0cyclictest28575-21awk19:31:242
271869932,0cyclictest10333-21fschecks_time19:41:212
271869930,0cyclictest17066-21cat20:56:262
271859932,0cyclictest15767-21kthreadcore23:36:261
271849933,0cyclictest27237-21kworker/0:122:16:140
271849933,0cyclictest27237-21kworker/0:121:56:120
271849933,0cyclictest26984-21kworker/0:123:26:140
271849933,0cyclictest26984-21kworker/0:100:26:100
271849933,0cyclictest17898-21kworker/0:221:26:130
271849933,0cyclictest17898-21kworker/0:221:21:170
271849933,0cyclictest13743-21kworker/0:200:56:200
271849932,0cyclictest17795-21aten2.4-expect00:16:210
271849930,0cyclictest13885-21perl20:06:230
249930,0watchdog/20-21swapper/220:48:272
249930,0watchdog/20-21swapper/220:01:272
271869921,0cyclictest25207-21latency_hist21:26:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional