You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 10:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri May 01, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2455424332,0sleep20-21swapper/219:17:482
2459423425,0sleep10-21swapper/119:18:151
2483122928,0sleep00-21swapper/019:20:580
2449122723,0sleep30-21swapper/319:17:013
24948991010,0cyclictest26208-21awk19:21:480
249529976,0cyclictest0-21swapper/222:56:522
8305060,0irq/26-0000:00:22723-21if_eth1.219:41:483
8305060,0irq/26-0000:00:21577-21crond21:11:333
35160,0ktimersoftd/30-21swapper/300:05:043
339960,0migration/35440-21idleruntime-cro00:51:333
339960,0migration/34878-21sh22:35:443
339960,0migration/332756-21munin-node20:11:463
339960,0migration/328991-21aten_r1power_fr20:31:443
339960,0migration/326225-21fschecks_time20:51:453
339960,0migration/313812-21timerwakeupswit21:01:593
339960,0migration/313357-21sh23:54:353
339960,0migration/312051-21sh23:36:363
329960,0watchdog/321740-21fschecks_time00:41:493
29805060,0irq/28-eth0-rx-3915-21sed00:31:463
29805060,0irq/28-eth0-rx-28992-21ssh23:46:243
29805060,0irq/28-eth0-rx-17245-21cut23:56:533
29805060,0irq/28-eth0-rx-17245-21cut23:56:533
29805060,0irq/28-eth0-rx-0-21swapper/323:12:473
249489960,0cyclictest0-21swapper/023:30:510
19160,0ktimersoftd/10-21swapper/100:05:041
149960,0migration/05092-21sh22:36:200
149960,0migration/027284-21sh22:27:050
149960,0migration/023430-21fschecks_time22:46:470
4150,0ktimersoftd/00-21swapper/022:54:260
339950,0migration/38830-21munin-node20:16:493
339950,0migration/38724-21taskset21:59:403
339950,0migration/331967-21fschecks_count22:51:473
339950,0migration/331261-21kthreadcore22:11:513
339950,0migration/330139-21kthreadcore19:21:513
339950,0migration/329399-21kthreadcore21:51:523
339950,0migration/329040-21munin-node22:46:553
339950,0migration/325688-21fschecks_time23:06:483
339950,0migration/32510-21taskset00:29:373
339950,0migration/323721-21kthreadcore21:31:513
339950,0migration/322377-21kthreadcore22:26:523
339950,0migration/321197-21sshd20:23:383
339950,0migration/318574-21aten_r1power_cu23:21:453
339950,0migration/316939-21sh23:17:523
339950,0migration/316886-21fschecks_count23:01:463
339950,0migration/316412-21munin-node21:46:453
339950,0migration/310876-21latency_hist20:41:333
329950,0watchdog/33568-21kthreadcore21:36:523
329950,0watchdog/330036-21irqcore19:46:483
329950,0watchdog/30-21swapper/322:41:523
329950,0watchdog/30-21swapper/321:26:483
329950,0watchdog/30-21swapper/321:16:563
29815050,0irq/29-eth0-tx-9931-21munin-node23:16:582
29815050,0irq/29-eth0-tx-3922-21perl22:16:462
29815050,0irq/29-eth0-tx-26138-21ssh23:24:282
29815050,0irq/29-eth0-tx-20599-21latency_hist23:41:342
29815050,0irq/29-eth0-tx-18320-21crond00:21:342
29815050,0irq/29-eth0-tx-0-21swapper/223:51:112
29815050,0irq/29-eth0-tx-0-21swapper/222:49:122
29815050,0irq/29-eth0-tx-0-21swapper/222:41:272
29815050,0irq/29-eth0-tx-0-21swapper/200:26:522
29815050,0irq/29-eth0-tx-0-21swapper/020:21:560
29805050,0irq/28-eth0-rx-9639-21ssh22:01:353
29805050,0irq/28-eth0-rx-123032sleep322:37:223
29805050,0irq/28-eth0-rx-10856-21ssh23:33:523
29805050,0irq/28-eth0-rx-0-21swapper/323:51:223
29805050,0irq/28-eth0-rx-0-21swapper/322:58:223
29805050,0irq/28-eth0-rx-0-21swapper/322:25:153
29805050,0irq/28-eth0-rx-0-21swapper/321:26:303
29805050,0irq/28-eth0-rx-0-21swapper/300:41:293
29805050,0irq/28-eth0-rx-0-21swapper/300:22:193
27150,0ktimersoftd/20-21swapper/200:05:042
259950,0migration/227547-21fschecks_count22:11:462
259950,0migration/224673-21turbostat23:06:342
259950,0migration/223102-21kthreadcore22:06:522
259950,0migration/21916-21sh23:28:172
259950,0migration/217321-21sh22:04:342
259950,0migration/216972-21sendmail_mailqu19:56:552
259950,0migration/21472-21fschecks_count21:56:462
259950,0migration/213403-21munin-node00:36:532
249529950,0cyclictest0-21swapper/223:52:032
249499950,0cyclictest0-21swapper/122:36:381
249499950,0cyclictest0-21swapper/121:43:211
249499950,0cyclictest0-21swapper/121:33:351
249499950,0cyclictest0-21swapper/100:35:591
249489955,0cyclictest0-21swapper/022:16:450
249489955,0cyclictest0-21swapper/000:36:550
249489950,0cyclictest2920-21munin-run22:16:330
249489950,0cyclictest0-21swapper/023:12:150
249489950,0cyclictest0-21swapper/000:32:490
249950,0watchdog/229484-21aten_r1power_en00:46:452
19150,0ktimersoftd/10-21swapper/100:43:141
179950,0migration/17464-21switchtime21:56:581
179950,0migration/16562-21munin-node19:26:591
179950,0migration/1452-21sh23:10:301
179950,0migration/123026-21kthreadcore23:41:521
179950,0migration/119263-21fschecks_time23:21:471
179950,0migration/119204-21sh22:23:301
179950,0migration/117175-21fschecks_time23:01:461
179950,0migration/114256-21kthreadcore00:36:541
169950,0watchdog/15096-21munin-node21:21:481
169950,0watchdog/13569-21sh21:36:521
169950,0watchdog/12317-21chrt00:29:051
169950,0watchdog/111842-21ntp_offset23:51:571
149950,0migration/09445-21kthreadcore21:41:510
149950,0migration/08860-21kthreadcore20:16:490
149950,0migration/0601-21fschecks_time20:11:470
149950,0migration/028640-21kthreadcore20:51:490
149950,0migration/02731-21kthreadcore20:56:500
149950,0migration/026861-21kthreadcore20:06:500
149950,0migration/026646-21kthreadcore21:51:510
149950,0migration/025814-21kthreadcore21:31:520
149950,0migration/025668-21kthreadcore00:41:540
149950,0migration/023038-21taskset23:02:040
149950,0migration/020712-21kthreadcore21:46:510
149950,0migration/020322-21sh21:29:000
149950,0migration/019360-21fschecks_time23:21:470
149950,0migration/016931-21ksmtuned23:17:520
149950,0migration/01634-21kthreadcore23:46:520
149950,0migration/014095-21sh22:41:420
149950,0migration/013419-21sh23:54:470
149950,0migration/011836-21munin-node19:56:480
149950,0migration/011415-21sh23:35:260
149950,0migration/011395-21kthreadcore21:01:520
149950,0migration/010995-21latency_hist20:41:330
149950,0migration/01086-21aten2.4-expect21:56:440
149950,0migration/010285-21switchtime21:21:570
8305040,0irq/26-0000:00:17158-21if_eth1.321:46:482
8305040,0irq/26-0000:00:0-21swapper/222:31:332
339940,0migration/34360-21kthreadcore20:56:503
339940,0migration/323244-21kthreadcore20:46:493
329940,0watchdog/39529-21munin-node19:51:523
329940,0watchdog/30-21swapper/321:11:523
329940,0watchdog/30-21swapper/320:41:523
329940,0watchdog/30-21swapper/320:26:443
329940,0watchdog/30-21swapper/320:06:443
329940,0watchdog/30-21swapper/300:06:493
29815040,0irq/29-eth0-tx-7117-21cut00:31:512
29815040,0irq/29-eth0-tx-12702-21ssh21:26:352
29815040,0irq/29-eth0-tx-0-21swapper/223:36:382
29815040,0irq/29-eth0-tx-0-21swapper/223:11:502
29815040,0irq/29-eth0-tx-0-21swapper/222:26:482
29815040,0irq/29-eth0-tx-0-21swapper/221:51:372
29815040,0irq/29-eth0-tx-0-21swapper/221:23:412
29815040,0irq/29-eth0-tx-0-21swapper/200:41:412
29815040,0irq/29-eth0-tx-0-21swapper/021:11:500
29815040,0irq/29-eth0-tx-0-21swapper/020:36:490
29815040,0irq/29-eth0-tx-0-21swapper/020:26:490
29815040,0irq/29-eth0-tx-0-21swapper/019:36:480
29815040,0irq/29-eth0-tx-0-21swapper/019:32:110
29805040,0irq/28-eth0-rx-0-21swapper/323:26:563
29805040,0irq/28-eth0-rx-0-21swapper/322:16:383
29805040,0irq/28-eth0-rx-0-21swapper/322:07:153
29805040,0irq/28-eth0-rx-0-21swapper/321:41:453
29805040,0irq/28-eth0-rx-0-21swapper/300:16:343
29805040,0irq/28-eth0-rx-0-21swapper/300:11:463
259940,0migration/232378-21hwlatdetect22:51:492
259940,0migration/228163-21kthreadcore19:21:502
259940,0migration/225559-21kthreadcore20:26:502
259940,0migration/224992-21taskset23:06:452
259940,0migration/222174-21fschecks_count21:31:472
259940,0migration/220306-21latency20:21:552
259940,0migration/219887-21kthreadcore19:36:512
259940,0migration/218260-21aten_r1power_fr20:46:422
259940,0migration/214265-21kthreadcore20:41:522
259940,0migration/212772-21fschecks_time22:21:472
259940,0migration/211366-21kthreadcore00:11:532
259940,0migration/211359-21kthreadcore21:01:522
249529943,0cyclictest8359-21awk19:31:482
249529943,0cyclictest4600-21awk23:31:492
249529943,0cyclictest3571-21lldpd20:16:432
249529943,0cyclictest3571-21lldpd19:27:122
249529943,0cyclictest3524-21snmpd20:58:122
249529943,0cyclictest3524-21snmpd20:52:422
249529943,0cyclictest3524-21snmpd20:41:262
249529943,0cyclictest3524-21snmpd20:02:112
249529943,0cyclictest3524-21snmpd19:53:412
249529943,0cyclictest3524-21snmpd00:21:592
249529943,0cyclictest3524-21snmpd00:06:432
249529943,0cyclictest3250-21irqbalance23:56:502
249529943,0cyclictest3250-21irqbalance23:56:502
249529943,0cyclictest3250-21irqbalance21:41:502
249529943,0cyclictest3250-21irqbalance21:36:402
249529943,0cyclictest3250-21irqbalance20:07:592
249529943,0cyclictest22633-21awk19:41:482
249529943,0cyclictest15646-21awk21:06:492
249529943,0cyclictest1031-21awk20:11:492
249499943,0cyclictest8473-21awk21:01:491
249499943,0cyclictest4761-21awk19:51:491
249499943,0cyclictest4625-21awk23:31:491
249499943,0cyclictest3571-21lldpd20:45:431
249499943,0cyclictest3571-21lldpd20:30:131
249499943,0cyclictest3571-21lldpd20:23:431
249499943,0cyclictest3571-21lldpd20:08:121
249499943,0cyclictest3571-21lldpd19:31:411
249499943,0cyclictest3571-21lldpd00:19:151
249499943,0cyclictest3571-21lldpd00:11:461
249499943,0cyclictest3571-21lldpd00:09:451
249499943,0cyclictest3524-21snmpd20:46:561
249499943,0cyclictest3250-21irqbalance23:46:401
249499943,0cyclictest25918-21awk21:51:501
249499943,0cyclictest24962-21python00:21:571
249499943,0cyclictest22753-21munin-plugin-st00:01:341
249499943,0cyclictest22753-21munin-plugin-st00:01:341
249499943,0cyclictest22712-21awk19:41:481
249499943,0cyclictest19437-21awk22:06:491
249499943,0cyclictest15741-21awk21:06:491
249499943,0cyclictest13923-21awk21:26:511
249499943,0cyclictest11880-21awk19:56:481
249489944,0cyclictest0-21swapper/022:06:490
249489944,0cyclictest0-21swapper/000:26:300
249489943,0cyclictest3571-21lldpd23:56:450
249489943,0cyclictest3571-21lldpd23:56:450
249489943,0cyclictest3524-21snmpd00:09:140
249489943,0cyclictest25133-21sadc20:51:330
249489943,0cyclictest10796-21awk22:01:500
249489943,0cyclictest1019-21awk19:26:480
249940,0watchdog/230035-21irqcore19:46:482
249940,0watchdog/229926-21perl21:16:482
249940,0watchdog/226084-21cut21:11:522
249940,0watchdog/20-21swapper/222:41:522
179940,0migration/19475-21proc_pri22:16:541
179940,0migration/17086-21kthreadcore20:36:501
179940,0migration/16091-21taskset22:52:521
179940,0migration/13487-21taskset21:19:571
179940,0migration/132680-21kthreadcore22:11:521
179940,0migration/129979-21kthreadcore19:21:511
179940,0migration/128735-21kthreadcore20:51:491
179940,0migration/122564-21fschecks_time21:11:481
179940,0migration/121463-21kthreadcore20:01:501
179940,0migration/117882-21taskset22:06:061
179940,0migration/116492-21kthreadcore23:36:511
179940,0migration/114941-21fschecks_time22:41:481
179940,0migration/110698-21kthreadcore20:16:491
179940,0migration/11039-21latency_hist23:11:341
169940,0watchdog/12784-21ssh22:31:521
169940,0watchdog/122674-21kthreadcore22:26:521
169940,0watchdog/11794-21ssh23:27:571
169940,0watchdog/116148-21ssh21:46:441
169940,0watchdog/111157-21munin-node23:16:531
169940,0watchdog/10-21swapper/122:46:441
169940,0watchdog/10-21swapper/119:46:481
169940,0watchdog/10-21swapper/100:46:451
149940,0migration/05311-21kthreadcore19:51:500
149940,0migration/030354-21irqrtprio20:31:490
149940,0migration/027861-21fschecks_count00:26:480
149940,0migration/024389-21irqcore00:01:520
149940,0migration/020010-21kthreadcore21:06:520
149940,0migration/019013-21diskmemload23:37:390
149940,0migration/01584-21kthreadcore21:16:520
149940,0migration/012316-21kthreadcore00:11:530
149940,0migration/011362-21kthreadcore22:56:520
339930,0migration/31177-21irqcore19:26:493
329930,0watchdog/30-21swapper/320:01:443
329930,0watchdog/30-21swapper/319:56:483
329930,0watchdog/30-21swapper/319:38:243
29805030,0irq/28-eth0-rx-0-21swapper/319:31:443
249499932,0cyclictest3014-21grep20:11:511
249499930,0cyclictest14803-21diskstats19:36:461
249489933,0cyclictest0-21swapper/000:18:000
249489932,0cyclictest3386-21sensors00:46:560
249489932,0cyclictest31282-21sensors23:06:560
249489932,0cyclictest18361-21sort22:21:590
249489932,0cyclictest0-21swapper/020:01:480
249489930,0cyclictest21585-21munin-node19:41:530
249489930,0cyclictest11777-21munin-node22:36:550
249489930,0cyclictest0-21swapper/021:36:380
249930,0watchdog/20-21swapper/220:31:442
179930,0migration/15634-21kthreadcore20:56:511
169930,0watchdog/112009-21cut22:56:521
169930,0watchdog/10-21swapper/120:31:441
149930,0migration/03144-21runrttasks19:49:310
249489920,0cyclictest20564-21latency_hist23:41:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional