You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 12:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun Apr 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2883324634,0sleep10-21swapper/119:17:181
2889623927,0sleep20-21swapper/219:18:032
2877023526,0sleep30-21swapper/319:16:363
2221823524,0sleep00-21swapper/019:16:130
339960,0migration/331589-21kthreadcore21:51:263
339960,0migration/327346-21irqrtprio19:41:253
339960,0migration/324598-21sh21:28:193
339960,0migration/323620-21munin-node00:36:243
339960,0migration/31396-21munin-node22:31:233
339960,0migration/311610-21switchtime00:26:353
29805060,0irq/28-eth0-rx-28116-21iostat_ios22:46:263
29805060,0irq/28-eth0-rx-23411-21ssh22:23:303
292319965,0cyclictest5451-21cat23:26:340
179960,0migration/132253-21munin-node22:11:271
8305050,0irq/26-0000:00:29879-21latency_hist20:51:082
8305050,0irq/26-0000:00:25670-21crond21:31:082
8305050,0irq/26-0000:00:17892-21dump-pmu-power23:56:092
4150,0ktimersoftd/00-21swapper/022:17:020
339950,0migration/39683-21switchtime22:51:353
339950,0migration/37115-21latency_hist00:46:093
339950,0migration/34603-21latency22:11:293
339950,0migration/332764-21kthreadcore20:06:253
339950,0migration/33001-21timerandwakeup00:21:363
339950,0migration/327369-21munin-node21:11:243
339950,0migration/326259-21cpuspeed_turbos21:31:213
339950,0migration/32475-21sh21:36:203
339950,0migration/321193-21taskset22:03:303
339950,0migration/321065-21latency19:56:273
339950,0migration/320384-21cpu21:46:213
339950,0migration/319220-21kthreadcore23:36:273
339950,0migration/315822-21kthreadcore22:56:283
339950,0migration/315537-21latency_hist20:41:083
339950,0migration/312233-21kthreadcore21:21:273
339950,0migration/311726-21aten_r1power_fr00:11:213
329950,0watchdog/38188-21perl00:46:243
329950,0watchdog/37073-21ssh23:46:283
329950,0watchdog/35630-21perl20:56:233
329950,0watchdog/323466-21if_err_eth122:06:233
329950,0watchdog/320255-21sh00:16:203
329950,0watchdog/317398-21sort19:31:273
329950,0watchdog/314575-21perl00:31:243
329950,0watchdog/313577-21cut21:41:273
329950,0watchdog/310082-21cut22:16:273
329950,0watchdog/30-21swapper/322:27:523
329950,0watchdog/30-21swapper/320:11:273
29815050,0irq/29-eth0-tx-4319-21munin-node19:26:250
29815050,0irq/29-eth0-tx-29363-21sort21:51:212
29815050,0irq/29-eth0-tx-22654-21munin-node23:21:342
29815050,0irq/29-eth0-tx-18743-21munin-node19:36:290
29815050,0irq/29-eth0-tx-10821-21ssh22:53:552
29815050,0irq/29-eth0-tx-0-21swapper/223:31:472
29805050,0irq/28-eth0-rx-9804-21aten_r1power_po22:36:213
29805050,0irq/28-eth0-rx-9779-21grep19:26:273
29805050,0irq/28-eth0-rx-6179-21kthreadcore00:06:263
29805050,0irq/28-eth0-rx-314-21kthreadcore23:06:273
29805050,0irq/28-eth0-rx-29166-21kthreadcore23:41:283
29805050,0irq/28-eth0-rx-22974-21cut21:06:263
29805050,0irq/28-eth0-rx-0-21swapper/323:56:273
29805050,0irq/28-eth0-rx-0-21swapper/323:32:553
29805050,0irq/28-eth0-rx-0-21swapper/323:28:043
29805050,0irq/28-eth0-rx-0-21swapper/323:18:023
29805050,0irq/28-eth0-rx-0-21swapper/323:14:133
29805050,0irq/28-eth0-rx-0-21swapper/323:01:273
29805050,0irq/28-eth0-rx-0-21swapper/300:02:003
292339955,0cyclictest0-21swapper/223:56:222
292339955,0cyclictest0-21swapper/222:21:082
292329950,0cyclictest0-21swapper/123:53:541
292329950,0cyclictest0-21swapper/122:49:441
292329950,0cyclictest0-21swapper/121:56:171
292329950,0cyclictest0-21swapper/119:31:331
292319955,0cyclictest25376-21kworker/0:021:21:090
292319955,0cyclictest25376-21kworker/0:021:16:090
292319955,0cyclictest25376-21kworker/0:021:06:350
292319955,0cyclictest21231-21kworker/0:220:56:210
292319955,0cyclictest21231-21kworker/0:220:51:190
292319955,0cyclictest21231-21kworker/0:220:47:030
292319955,0cyclictest21231-21kworker/0:220:41:230
292319955,0cyclictest21231-21kworker/0:220:36:290
292319955,0cyclictest21231-21kworker/0:220:31:190
292319955,0cyclictest21231-21kworker/0:220:26:270
292319955,0cyclictest21231-21kworker/0:220:21:250
292319955,0cyclictest21231-21kworker/0:220:16:290
292319955,0cyclictest21231-21kworker/0:220:06:210
292319955,0cyclictest21231-21kworker/0:220:01:090
292319955,0cyclictest21231-21kworker/0:219:56:090
292319955,0cyclictest21231-21kworker/0:219:51:090
292319955,0cyclictest21231-21kworker/0:219:41:090
292319955,0cyclictest21231-21kworker/0:219:31:310
292319955,0cyclictest21231-21kworker/0:219:21:210
292319955,0cyclictest0-21swapper/023:02:070
292319955,0cyclictest0-21swapper/022:37:030
292319955,0cyclictest0-21swapper/022:33:260
292319955,0cyclictest0-21swapper/022:26:110
292319950,0cyclictest0-21swapper/023:40:170
292319950,0cyclictest0-21swapper/022:56:170
292319950,0cyclictest0-21swapper/022:23:390
292319950,0cyclictest0-21swapper/000:33:430
259950,0migration/25626-21sh00:42:182
259950,0migration/221473-21sh23:18:372
259950,0migration/220637-21runrttasks22:01:582
259950,0migration/218899-21sh00:13:062
179950,0migration/18047-21fschecks_time00:46:241
179950,0migration/16277-21sh00:26:251
179950,0migration/130444-21idleruntime19:21:241
179950,0migration/129202-21kthreadcore21:11:271
179950,0migration/124979-21munin-node22:26:201
179950,0migration/124373-21kthreadcore20:21:261
179950,0migration/123013-21kthreadcore19:36:271
179950,0migration/117845-21ntp_offset20:16:291
179950,0migration/116264-21fschecks_time20:41:221
179950,0migration/110508-21kthreadcore20:56:281
179950,0migration/110220-21missed_timers19:26:281
169950,0watchdog/10-21swapper/122:51:241
149950,0migration/09706-21taskset21:37:410
149950,0migration/09339-21sendmail_mailst00:06:300
149950,0migration/07313-21sendmail_mailst23:46:300
149950,0migration/06601-21kthreadcore22:51:280
149950,0migration/06553-21kthreadcore19:46:280
149950,0migration/06053-21taskset22:13:240
149950,0migration/04814-21cpu20:11:230
149950,0migration/032069-21kthreadcore23:06:260
149950,0migration/030312-21runrttasks22:09:590
149950,0migration/026896-21kthreadcore23:21:270
149950,0migration/026521-21aten2.4-expect21:11:210
149950,0migration/025685-21kthreadcore00:16:280
149950,0migration/022713-21cpuspeed_turbos00:36:200
149950,0migration/021673-21kthreadcore21:26:270
149950,0migration/02146-21sh22:49:100
149950,0migration/020022-21latency_hist21:46:080
149950,0migration/017236-21kthreadcore23:16:270
149950,0migration/014838-21taskset00:48:590
149950,0migration/013929-21switchtime23:31:340
149950,0migration/013527-21idleruntime-cro22:01:080
149950,0migration/013023-21idleruntime21:01:230
149950,0migration/01092-21taskset00:01:380
149950,0migration/010082-21fschecks_count23:51:220
339940,0migration/38338-21taskset20:36:193
339940,0migration/34344-21taskset20:53:513
339940,0migration/329722-21kthreadcore20:26:263
339940,0migration/328022-21kthreadcore20:46:253
339940,0migration/313683-21kthreadcore21:01:263
329940,0watchdog/34402-21kthreadcore19:46:273
329940,0watchdog/30-21swapper/322:41:283
329940,0watchdog/30-21swapper/321:56:273
329940,0watchdog/30-21swapper/319:21:273
29815040,0irq/29-eth0-tx-5098-21ssh00:06:262
29815040,0irq/29-eth0-tx-31310-21telnet23:26:202
29815040,0irq/29-eth0-tx-29761-21fschecks_count23:06:222
29815040,0irq/29-eth0-tx-24662-21ssh23:41:102
29815040,0irq/29-eth0-tx-2381-21ssh21:36:152
29815040,0irq/29-eth0-tx-0-21swapper/223:36:402
29815040,0irq/29-eth0-tx-0-21swapper/223:11:202
29815040,0irq/29-eth0-tx-0-21swapper/223:01:322
29815040,0irq/29-eth0-tx-0-21swapper/222:56:162
29815040,0irq/29-eth0-tx-0-21swapper/222:36:112
29815040,0irq/29-eth0-tx-0-21swapper/222:06:252
29815040,0irq/29-eth0-tx-0-21swapper/221:56:102
29815040,0irq/29-eth0-tx-0-21swapper/221:31:402
29815040,0irq/29-eth0-tx-0-21swapper/200:36:142
29815040,0irq/29-eth0-tx-0-21swapper/200:16:282
29805040,0irq/28-eth0-rx-19557-21tune2fs19:36:233
29805040,0irq/28-eth0-rx-0-21swapper/323:51:203
29805040,0irq/28-eth0-rx-0-21swapper/323:22:263
29805040,0irq/28-eth0-rx-0-21swapper/320:16:273
292339944,0cyclictest0-21swapper/221:21:232
292339943,0cyclictest3571-21lldpd22:16:252
292339943,0cyclictest3571-21lldpd21:46:252
292339943,0cyclictest3571-21lldpd21:17:252
292339943,0cyclictest3571-21lldpd21:09:252
292339943,0cyclictest3571-21lldpd20:00:232
292339943,0cyclictest3571-21lldpd19:46:232
292339943,0cyclictest3571-21lldpd19:41:522
292339943,0cyclictest3571-21lldpd00:46:262
292339943,0cyclictest3250-21irqbalance22:46:152
292339943,0cyclictest2097-21awk20:31:242
292339943,0cyclictest12917-21awk20:16:252
292339940,0cyclictest19180-21tune2fs22:41:232
292329944,0cyclictest0-21swapper/121:47:461
292329943,0cyclictest9617-21awk21:21:251
292329943,0cyclictest9374-21awk20:36:231
292329943,0cyclictest5650-21awk20:11:261
292329943,0cyclictest3571-21lldpd23:02:261
292329943,0cyclictest3571-21lldpd22:43:561
292329943,0cyclictest3568-21awk21:36:241
292329943,0cyclictest23803-21awk23:21:241
292329943,0cyclictest2269-21awk21:16:241
292329943,0cyclictest1798-21awk19:46:241
292329943,0cyclictest13064-21awk21:01:241
292329943,0cyclictest13014-21awk22:56:251
292319944,0cyclictest0-21swapper/022:02:510
292319944,0cyclictest0-21swapper/000:30:440
292319943,0cyclictest3571-21lldpd23:11:550
292319943,0cyclictest3250-21irqbalance23:56:150
292319943,0cyclictest3250-21irqbalance21:52:450
292319943,0cyclictest25779-21awk23:41:250
292319943,0cyclictest12582-21awk21:41:260
259940,0migration/29466-21munin-node20:36:242
259940,0migration/2873-21kthreadcore00:21:282
259940,0migration/27031-21kthreadcore00:26:262
259940,0migration/24653-21taskset23:46:262
259940,0migration/24477-21latency_hist20:11:082
259940,0migration/24355-21kthreadcore22:31:272
259940,0migration/232251-21kthreadcore19:21:262
259940,0migration/231678-21taskset22:27:162
259940,0migration/229951-21kthreadcore20:26:262
259940,0migration/226829-21fschecks_count21:11:232
259940,0migration/220059-21idleruntime20:21:232
259940,0migration/219475-21kthreadcore20:41:262
259940,0migration/218924-21runrttasks21:05:562
259940,0migration/215118-21kthreadcore19:31:262
259940,0migration/213837-21kthreadcore21:41:272
249940,0watchdog/25957-21irqcore20:11:272
249940,0watchdog/21352-21ssh00:02:242
249940,0watchdog/20-21swapper/222:11:232
249940,0watchdog/20-21swapper/219:26:272
249940,0watchdog/20-21swapper/200:31:282
179940,0migration/19000-21irqrtprio23:31:261
179940,0migration/16963-21mdstat20:31:271
179940,0migration/15526-21aten_r1power_en23:11:221
179940,0migration/15421-21timerwakeupswit23:26:341
179940,0migration/1471-21runrttasks21:32:151
179940,0migration/130824-21kthreadcore20:26:261
179940,0migration/130620-21sh22:10:511
179940,0migration/130073-21fschecks_time23:06:231
179940,0migration/125788-21sshd21:07:171
179940,0migration/125323-21fschecks_count23:41:241
179940,0migration/12480-21taskset00:05:341
179940,0migration/123323-21fschecks_time20:01:221
179940,0migration/116105-21runrttasks23:36:171
179940,0migration/115552-21kthreadcore22:01:271
179940,0migration/114466-21fschecks_time00:31:241
179940,0migration/11053-21aten_r1power_po22:31:211
179940,0migration/110226-21kthreadcore22:16:281
169940,0watchdog/19076-21uname00:06:281
169940,0watchdog/13593-21kthreadcore00:41:281
169940,0watchdog/131282-21cut19:41:271
169940,0watchdog/122355-21python22:21:311
169940,0watchdog/121890-21kthreadcore21:26:271
169940,0watchdog/118746-21tr23:16:281
169940,0watchdog/111586-21ssh00:11:121
169940,0watchdog/10-21swapper/123:56:281
169940,0watchdog/10-21swapper/122:38:121
169940,0watchdog/10-21swapper/100:36:281
149940,0migration/031543-21fschecks_count00:41:230
329930,0watchdog/38020-40yum-updatesd-he21:18:193
329930,0watchdog/30-21swapper/320:02:313
29805030,0irq/28-eth0-rx-0-21swapper/320:31:203
292339932,0cyclictest7336-21kthreadcore20:56:272
292339932,0cyclictest14269-21sensors19:51:302
292329932,0cyclictest3524-21snmpd21:41:091
292329932,0cyclictest31065-21awk20:51:231
292329932,0cyclictest29089-21tr00:21:221
292329932,0cyclictest1935-21awk23:46:231
292329932,0cyclictest15564-21cut19:56:211
292329931,0cyclictest0-21swapper/121:51:251
292319933,0cyclictest25376-21kworker/0:022:41:140
292319933,0cyclictest25376-21kworker/0:021:31:160
292319933,0cyclictest25376-21kworker/0:000:11:140
292319932,0cyclictest3066-21sort00:21:360
259930,0migration/224631-21kthreadcore20:01:262
249930,0watchdog/223139-21kthreadcore19:36:272
249930,0watchdog/20-21swapper/220:46:192
169930,0watchdog/10-21swapper/120:09:431
169930,0watchdog/10-21swapper/119:51:271
169930,0watchdog/10-21swapper/100:16:241
329920,0watchdog/30-21swapper/320:21:153
329920,0watchdog/30-21swapper/319:51:233
169920,0watchdog/10-21swapper/120:46:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional