You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 01:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon May 04, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2610425251,0sleep00-21swapper/019:20:040
2606723930,0sleep20-21swapper/219:19:422
2589823525,0sleep10-21swapper/119:17:451
2604323430,0sleep30-21swapper/319:19:233
26317991616,0cyclictest3524-21snmpd00:33:031
4160,0ktimersoftd/00-21swapper/020:27:100
339960,0migration/35265-21sh00:46:363
339960,0migration/330441-21sh21:33:253
339960,0migration/311011-21munin-node22:57:063
329960,0watchdog/32097-21hwlatdetect00:07:043
29815060,0irq/29-eth0-tx-16218-21munin-node21:07:060
29805060,0irq/28-eth0-rx-3255-21yum23:27:163
29805060,0irq/28-eth0-rx-0-21swapper/323:17:073
29805060,0irq/28-eth0-rx-0-21swapper/319:47:063
263189960,0cyclictest0-21swapper/223:42:452
263189960,0cyclictest0-21swapper/222:11:282
263179960,0cyclictest0-21swapper/121:33:221
259960,0migration/2713-21taskset21:53:152
149960,0migration/05000-21sh00:45:520
149960,0migration/02797-21munin-node20:57:040
149960,0migration/024593-21unixbench-2d23:02:140
149960,0migration/015068-21kthreadcore23:17:070
149960,0migration/01234-21sh21:54:330
339950,0migration/39065-21munin-node19:32:003
339950,0migration/38747-21latency_hist20:16:483
339950,0migration/37097-21irqrtprio00:47:063
339950,0migration/36643-21sh23:50:103
339950,0migration/35646-21kthreadcore20:12:063
339950,0migration/35384-21aten2.4-expect20:36:593
339950,0migration/34009-21fschecks_count00:27:023
339950,0migration/329884-21kthreadcore22:47:093
339950,0migration/329845-21taskset19:45:143
339950,0migration/329510-21switchtime20:27:143
339950,0migration/328853-21taskset22:27:293
339950,0migration/326954-21aten_r1power_fr20:51:583
339950,0migration/325672-21fschecks_time00:02:023
339950,0migration/325672-21fschecks_time00:02:023
339950,0migration/324594-21kthreadcore23:42:053
339950,0migration/323248-21kthreadcore21:47:093
339950,0migration/322820-21taskset20:25:003
339950,0migration/319965-21kthreadcore23:02:053
339950,0migration/318727-21munin-node00:32:153
339950,0migration/315492-21kthreadcore23:37:053
339950,0migration/314124-21sh22:38:113
339950,0migration/311074-21ntp_kernel_err19:52:083
339950,0migration/31032-21munin-node00:22:133
339950,0migration/31032-21kthreadcore20:32:063
329950,0watchdog/324834-21kthreadcore20:47:073
329950,0watchdog/30-21swapper/321:29:473
29815050,0irq/29-eth0-tx-8608-21ssh21:41:502
29815050,0irq/29-eth0-tx-7089-21munin-node22:37:052
29815050,0irq/29-eth0-tx-5201-21python23:47:122
29815050,0irq/29-eth0-tx-3165-21grep22:52:072
29815050,0irq/29-eth0-tx-28394-21munin-node22:12:032
29815050,0irq/29-eth0-tx-26670-21munin-node23:07:052
29815050,0irq/29-eth0-tx-15999-21munin-node20:22:060
29815050,0irq/29-eth0-tx-15833-21munin-node19:37:010
29815050,0irq/29-eth0-tx-14818-21irqcore22:22:042
29815050,0irq/29-eth0-tx-11523-21sendmail_mailqu23:32:102
29815050,0irq/29-eth0-tx-0-21swapper/223:17:022
29815050,0irq/29-eth0-tx-0-21swapper/223:13:292
29815050,0irq/29-eth0-tx-0-21swapper/221:57:442
29815050,0irq/29-eth0-tx-0-21swapper/020:12:010
29805050,0irq/28-eth0-rx-6523-21sed21:22:033
29805050,0irq/28-eth0-rx-28736-21kthreadcore23:07:053
29805050,0irq/28-eth0-rx-25713-21seq00:18:443
29805050,0irq/28-eth0-rx-25536-21kthreadcore23:22:063
29805050,0irq/28-eth0-rx-1441-21ssh21:55:073
29805050,0irq/28-eth0-rx-13480-21kthreadcore21:42:073
29805050,0irq/28-eth0-rx-10283-21ssh22:00:243
29805050,0irq/28-eth0-rx-0-21swapper/323:56:523
29805050,0irq/28-eth0-rx-0-21swapper/323:52:073
29805050,0irq/28-eth0-rx-0-21swapper/323:33:143
29805050,0irq/28-eth0-rx-0-21swapper/322:54:033
29805050,0irq/28-eth0-rx-0-21swapper/322:42:063
29805050,0irq/28-eth0-rx-0-21swapper/322:26:003
29805050,0irq/28-eth0-rx-0-21swapper/322:21:103
29805050,0irq/28-eth0-rx-0-21swapper/322:12:053
29805050,0irq/28-eth0-rx-0-21swapper/322:07:023
29805050,0irq/28-eth0-rx-0-21swapper/321:36:553
27150,0ktimersoftd/20-21swapper/222:50:062
263189955,0cyclictest0-21swapper/223:54:442
263189955,0cyclictest0-21swapper/223:04:462
263189955,0cyclictest0-21swapper/222:18:432
263189950,0cyclictest0-21swapper/221:50:592
263189950,0cyclictest0-21swapper/221:25:172
263189950,0cyclictest0-21swapper/200:26:542
263189950,0cyclictest0-21swapper/200:11:552
263179955,0cyclictest0-21swapper/122:49:501
263179955,0cyclictest0-21swapper/100:41:271
263179950,0cyclictest0-21swapper/123:16:381
263179950,0cyclictest0-21swapper/122:28:231
263179950,0cyclictest0-21swapper/122:19:241
263179950,0cyclictest0-21swapper/122:14:501
263169955,0cyclictest3571-21lldpd00:39:130
259950,0migration/2526-21kthreadcore21:17:092
259950,0migration/24402-21sh00:44:122
259950,0migration/232227-21kthreadcore00:22:082
259950,0migration/220657-21kthreadcore20:22:072
259950,0migration/219608-21aten_r1power_po20:01:592
259950,0migration/216705-21munin-node22:42:032
259950,0migration/21231-21kernelversion21:37:052
249950,0watchdog/229865-21ssh22:30:192
249950,0watchdog/21608-21cut23:27:072
179950,0migration/1693-21timerwakeupswit23:07:121
179950,0migration/15483-21kthreadcore00:27:061
179950,0migration/122066-21kthreadcore23:22:051
179950,0migration/115996-21kthreadcore22:22:051
179950,0migration/112521-21kthreadcore22:37:061
179950,0migration/111494-21df_abs22:02:011
179950,0migration/111312-21ntp_offset20:37:071
169950,0watchdog/131409-21cut20:32:031
149950,0migration/08698-21runrttasks23:52:050
149950,0migration/08399-21kthreadcore23:32:060
149950,0migration/07414-21kthreadcore21:57:070
149950,0migration/05903-21kthreadcore00:07:070
149950,0migration/04644-21latency_hist22:16:480
149950,0migration/031468-21cpuspeed_turbos23:47:020
149950,0migration/030818-21kthreadcore23:27:060
149950,0migration/030488-21latency_hist22:31:480
149950,0migration/029863-21kthreadcore22:47:090
149950,0migration/029553-21munin-node21:12:080
149950,0migration/026727-21latency_hist20:51:480
149950,0migration/025046-21taskset21:49:410
149950,0migration/022120-21kthreadcore20:02:050
149950,0migration/02045-21fschecks_time19:27:010
149950,0migration/019697-21taskset00:17:060
149950,0migration/019110-21kthreadcore21:27:050
149950,0migration/019091-21kthreadcore23:37:060
149950,0migration/01902-21latency22:12:060
149950,0migration/018940-21sh22:05:270
149950,0migration/015703-21sh22:41:560
149950,0migration/015349-21latency22:57:080
149950,0migration/013802-21taskset00:51:140
149950,0migration/01315-21kthreadcore22:32:050
149950,0migration/012340-21kthreadcore22:37:060
149950,0migration/012065-21taskset00:31:590
149950,0migration/011881-21latency_hist00:31:490
149950,0migration/011211-21kthreadcore20:17:030
149950,0migration/010838-21kthreadcore19:52:060
8305040,0irq/26-0000:00:0-21swapper/220:56:482
8305040,0irq/26-0000:00:0-21swapper/220:17:012
339940,0migration/328789-21kthreadcore19:22:043
339940,0migration/32864-21irqrtprio19:27:043
339940,0migration/325266-21latency20:02:063
339940,0migration/313291-21kthreadcore22:02:053
339940,0migration/313017-21kthreadcore00:12:073
329940,0watchdog/322167-21ntp_kernel_pll_21:07:073
329940,0watchdog/30-21swapper/320:42:073
29815040,0irq/29-eth0-tx-13484-21ps00:32:062
29815040,0irq/29-eth0-tx-0-21swapper/223:57:552
29815040,0irq/29-eth0-tx-0-21swapper/223:36:582
29815040,0irq/29-eth0-tx-0-21swapper/221:26:582
29815040,0irq/29-eth0-tx-0-21swapper/021:22:030
29815040,0irq/29-eth0-tx-0-21swapper/020:52:060
29815040,0irq/29-eth0-tx-0-21swapper/020:32:110
29815040,0irq/29-eth0-tx-0-21swapper/020:07:030
29805040,0irq/28-eth0-rx-0-21swapper/323:12:023
29805040,0irq/28-eth0-rx-0-21swapper/322:31:543
29805040,0irq/28-eth0-rx-0-21swapper/321:01:593
29805040,0irq/28-eth0-rx-0-21swapper/300:36:493
263189944,0cyclictest0-21swapper/219:36:492
263189944,0cyclictest0-21swapper/200:01:502
263189944,0cyclictest0-21swapper/200:01:502
263189943,0cyclictest9667-21awk19:32:022
263189943,0cyclictest3571-21lldpd19:57:392
263189943,0cyclictest3524-21snmpd20:47:022
263189943,0cyclictest3524-21snmpd20:43:022
263189943,0cyclictest3524-21snmpd19:54:022
263189943,0cyclictest3524-21snmpd19:43:022
263189943,0cyclictest3524-21snmpd00:47:072
263189943,0cyclictest27597-21awk19:22:022
263189943,0cyclictest24544-21awk21:12:032
263189943,0cyclictest24380-21awk21:32:022
263179943,0cyclictest3571-21lldpd21:53:411
263179943,0cyclictest3571-21lldpd21:31:411
263179943,0cyclictest3524-21snmpd23:52:511
263179943,0cyclictest3524-21snmpd23:33:051
263179943,0cyclictest3524-21snmpd23:29:051
263179943,0cyclictest3524-21snmpd22:58:051
263179943,0cyclictest3524-21snmpd21:40:031
263179943,0cyclictest3524-21snmpd20:42:321
263179943,0cyclictest3524-21snmpd19:24:471
263179943,0cyclictest32296-21awk23:47:051
263179943,0cyclictest31873-21awk22:32:041
263179943,0cyclictest30508-21awk00:42:051
263179943,0cyclictest2545-21awk20:12:031
263179943,0cyclictest2457-21awk19:27:031
263179943,0cyclictest24188-21grep21:12:001
263179943,0cyclictest1694-21awk22:52:051
263179943,0cyclictest12701-21awk23:17:051
263169943,0cyclictest6384-21awk20:37:030
263169943,0cyclictest3571-21lldpd22:22:120
263169943,0cyclictest3571-21lldpd00:03:130
263169943,0cyclictest3571-21lldpd00:03:130
263169943,0cyclictest3524-21snmpd23:12:200
263169943,0cyclictest27797-21awk23:07:030
263169943,0cyclictest21449-21awk23:22:040
259940,0migration/25973-21kthreadcore19:27:052
259940,0migration/23270-21kthreadcore22:32:062
259940,0migration/230657-21cpuspeed_turbos20:32:002
259940,0migration/222195-21kthreadcore23:22:052
259940,0migration/220765-21aten_r1power_fr00:36:592
259940,0migration/218829-21kthreadcore21:07:052
259940,0migration/217187-21runrttasks23:00:072
259940,0migration/216081-21kthreadcore22:02:062
259940,0migration/210747-21kthreadcore21:02:052
249940,0watchdog/26431-21munin-node20:37:032
249940,0watchdog/222021-21kthreadcore00:17:082
249940,0watchdog/22083-21sh00:07:042
249940,0watchdog/20-21swapper/220:27:072
249940,0watchdog/20-21swapper/219:47:072
179940,0migration/17367-21kthreadcore21:22:061
179940,0migration/15855-21kthreadcore20:57:071
179940,0migration/13185-21kthreadcore00:07:061
179940,0migration/127357-21cpu00:22:021
179940,0migration/127261-21taskset22:09:281
179940,0migration/118339-21kthreadcore20:22:061
179940,0migration/118186-21kthreadcore22:42:071
179940,0migration/116263-21entropy19:37:011
179940,0migration/115670-21ksmtuned20:20:531
179940,0migration/114259-21df_abs23:37:011
179940,0migration/111361-21switchtime19:52:131
179940,0migration/110502-21fschecks_time00:12:031
169940,0watchdog/127021-21aten_r1power_vo20:51:591
169940,0watchdog/125800-21hwlatdetect00:02:041
169940,0watchdog/125800-21hwlatdetect00:02:041
169940,0watchdog/124042-21sed23:02:071
169940,0watchdog/124014-21ssh00:00:281
169940,0watchdog/117896-21ssh21:47:031
169940,0watchdog/113938-21ssh00:51:361
169940,0watchdog/113427-21kthreadcore21:42:071
169940,0watchdog/110007-21basename21:02:031
169940,0watchdog/10-21swapper/121:57:031
169940,0watchdog/10-21swapper/119:47:071
169940,0watchdog/10-21swapper/100:17:161
149940,0migration/0709-21aten_r1power_po22:52:020
149940,0migration/030002-21idleruntime-cro19:46:470
149940,0migration/023096-21sh23:57:560
149940,0migration/017816-21kthreadcore20:42:060
149940,0migration/01666-21kthreadcore21:17:090
149940,0migration/013666-21irqcore19:57:040
149940,0migration/013405-21kthreadcore00:12:070
149940,0migration/012006-21kthreadcore21:42:070
4130,0ktimersoftd/00-21swapper/019:48:510
329930,0watchdog/30-21swapper/319:58:113
29805030,0irq/28-eth0-rx-0-21swapper/321:17:033
29805030,0irq/28-eth0-rx-0-21swapper/320:57:003
29805030,0irq/28-eth0-rx-0-21swapper/319:36:593
263189932,0cyclictest7369-21cat20:12:062
263179933,0cyclictest23635-21awk23:42:031
263179933,0cyclictest20741-21awk20:47:041
263179932,0cyclictest31698-21awk21:17:061
263169932,0cyclictest413-21fschecks_time21:37:010
263169932,0cyclictest3571-21lldpd21:33:410
263169932,0cyclictest28855-21sensors23:42:090
263169932,0cyclictest27544-21basename19:22:010
263169932,0cyclictest26065-21sensors22:07:100
263169931,0cyclictest0-21swapper/019:35:530
263169930,0cyclictest0-21swapper/021:02:000
259930,0migration/2918-21runrttasks20:08:192
249930,0watchdog/20-21swapper/220:51:592
169930,0watchdog/10-21swapper/121:07:071
169930,0watchdog/10-21swapper/120:27:071
169930,0watchdog/10-21swapper/119:58:231
169930,0watchdog/10-21swapper/119:41:591
169930,0watchdog/10-21swapper/119:31:591
149930,0migration/02694-21sh00:25:490
339920,0migration/327877-21iostat_ios20:07:043
329920,0watchdog/30-21swapper/321:11:593
169920,0watchdog/10-21swapper/120:06:551
169920,0watchdog/10-21swapper/120:01:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional