You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 07:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Mon Apr 20, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2628228479,0sleep10-21swapper/119:19:171
2628624328,0sleep00-21swapper/019:19:200
2631823728,0sleep30-21swapper/319:19:433
2632223425,0sleep20-21swapper/219:19:462
339960,0migration/320707-21sh22:22:443
329960,0watchdog/36874-21grep20:55:573
29815060,0irq/29-eth0-tx-5351-21munin-node19:50:510
29805060,0irq/28-eth0-rx-966-21kthreadcore00:40:593
29805060,0irq/28-eth0-rx-9290-21users00:26:063
29805060,0irq/28-eth0-rx-14413-21kthreadcore00:10:593
264709966,0cyclictest5513-21diskmemload00:41:182
149960,0migration/07719-21sh21:38:590
149960,0migration/05522-21sh22:15:520
149960,0migration/029350-21sh23:42:420
149960,0migration/021157-21sh21:45:570
149960,0migration/016969-21sh22:59:090
339950,0migration/35897-21kthreadcore00:05:583
339950,0migration/34015-21taskset23:29:123
339950,0migration/332298-21kthreadcore20:30:573
339950,0migration/330014-21taskset19:43:343
339950,0migration/327538-21munin-node20:50:523
339950,0migration/326872-21fschecks_count00:20:533
339950,0migration/32590-21taskset23:10:503
339950,0migration/321290-21kernelversion22:05:573
339950,0migration/317959-21irqrtprio21:05:573
339950,0migration/316277-21fschecks_time23:55:533
339950,0migration/316277-21fschecks_time23:55:533
339950,0migration/315690-21kthreadcore00:30:583
339950,0migration/315649-21sh21:41:363
339950,0migration/315380-21munin-node19:31:053
329950,0watchdog/36316-21perl20:35:533
329950,0watchdog/3402-21grep21:35:543
329950,0watchdog/329023-21ssh23:41:463
329950,0watchdog/327960-21ssh23:24:503
329950,0watchdog/325507-21cat20:25:573
329950,0watchdog/321489-21kthreadcore20:45:573
329950,0watchdog/3193472sleep319:58:453
329950,0watchdog/31932-21memory22:10:583
329950,0watchdog/316380-21kthreadcore20:40:573
329950,0watchdog/315889-21grep23:15:583
329950,0watchdog/30-21swapper/323:45:543
329950,0watchdog/30-21swapper/322:51:463
329950,0watchdog/30-21swapper/320:16:013
329950,0watchdog/30-21swapper/300:15:583
29815050,0irq/29-eth0-tx-9077-21kthreadcore23:50:582
29815050,0irq/29-eth0-tx-6038-21ssh22:33:362
29815050,0irq/29-eth0-tx-4902-21grep00:25:572
29815050,0irq/29-eth0-tx-26379-21munin-node23:05:522
29815050,0irq/29-eth0-tx-24153-21munin-node00:00:502
29815050,0irq/29-eth0-tx-1488-21munin-node19:25:530
29815050,0irq/29-eth0-tx-0-21swapper/223:56:022
29815050,0irq/29-eth0-tx-0-21swapper/223:56:022
29815050,0irq/29-eth0-tx-0-21swapper/223:47:102
29815050,0irq/29-eth0-tx-0-21swapper/222:47:372
29815050,0irq/29-eth0-tx-0-21swapper/221:52:222
29815050,0irq/29-eth0-tx-0-21swapper/200:34:152
29815050,0irq/29-eth0-tx-0-21swapper/200:21:432
29815050,0irq/29-eth0-tx-0-21swapper/021:21:020
29805050,0irq/28-eth0-rx-25735-21cat00:36:013
29805050,0irq/28-eth0-rx-16306-21fschecks_time22:40:543
29805050,0irq/28-eth0-rx-11593-21ssh23:31:153
29805050,0irq/28-eth0-rx-0-21swapper/323:35:503
29805050,0irq/28-eth0-rx-0-21swapper/323:09:383
29805050,0irq/28-eth0-rx-0-21swapper/323:00:583
29805050,0irq/28-eth0-rx-0-21swapper/322:56:003
29805050,0irq/28-eth0-rx-0-21swapper/322:40:203
29805050,0irq/28-eth0-rx-0-21swapper/322:17:023
29805050,0irq/28-eth0-rx-0-21swapper/322:00:573
29805050,0irq/28-eth0-rx-0-21swapper/321:58:553
29805050,0irq/28-eth0-rx-0-21swapper/321:51:433
29805050,0irq/28-eth0-rx-0-21swapper/321:30:533
29805050,0irq/28-eth0-rx-0-21swapper/321:28:353
29805050,0irq/28-eth0-rx-0-21swapper/319:25:503
29805050,0irq/28-eth0-rx-0-21swapper/300:00:473
264709955,0cyclictest22644-21sensors21:06:022
264709955,0cyclictest0-21swapper/200:48:142
264699955,0cyclictest21445-21sort00:36:001
264699955,0cyclictest0-21swapper/121:40:521
264689954,0cyclictest1588-21awk22:50:560
259950,0migration/28857-21kthreadcore19:50:562
259950,0migration/28087-21idleruntime22:35:542
259950,0migration/28039-21sh22:53:192
259950,0migration/27862-21kthreadcore22:15:562
259950,0migration/25896-21aten2.4-expect21:20:512
259950,0migration/23358-21sh23:27:262
259950,0migration/229551-21needreboot21:11:002
259950,0migration/222990-21sh22:42:542
259950,0migration/221365-21kthreadcore23:00:582
259950,0migration/221152-21irqcore00:35:592
259950,0migration/215103-21kthreadcore19:55:552
249950,0watchdog/232217-21kernelversion20:30:572
249950,0watchdog/214279-21kthreadcore21:00:572
179950,0migration/18911-21kthreadcore22:15:561
179950,0migration/130050-21kthreadcore20:05:581
179950,0migration/130047-21latency00:00:581
179950,0migration/127519-21kthreadcore21:10:591
179950,0migration/125579-21kthreadcore20:25:571
179950,0migration/124380-21unixbench_singl00:16:061
179950,0migration/122976-21gltestperf22:25:531
179950,0migration/120960-21sh22:23:261
179950,0migration/120370-21fschecks_count20:00:521
179950,0migration/117389-21latency_hist21:45:391
179950,0migration/116446-21sh22:57:411
169950,0watchdog/17554-21strings19:25:571
169950,0watchdog/17129-21kthreadcore20:10:571
169950,0watchdog/131663-21diskmemload23:45:541
149950,0migration/09889-21taskset23:12:230
149950,0migration/08653-21latency_hist21:40:390
149950,0migration/08091-21idleruntime22:35:540
149950,0migration/07429-21kthreadcore00:45:590
149950,0migration/05788-21taskset23:48:110
149950,0migration/05618-21fschecks_time23:30:540
149950,0migration/04402-21kthreadcore20:55:570
149950,0migration/028527-21kthreadcore20:25:580
149950,0migration/02599-21aten_r1power_po00:25:510
149950,0migration/025787-21kthreadcore19:40:560
149950,0migration/023790-21kthreadcore23:20:570
149950,0migration/022787-21kthreadcore20:00:560
149950,0migration/015525-21kthreadcore00:30:580
149950,0migration/015230-21pmu-power00:11:020
149950,0migration/014987-21kthreadcore20:40:570
149950,0migration/01187-21fschecks_time00:05:530
149950,0migration/01132-21taskset19:24:180
8305040,0irq/26-0000:00:0-21swapper/222:10:392
339940,0migration/36973-21kthreadcore19:50:553
339940,0migration/36284-21fschecks_count21:20:533
339940,0migration/34389-21sh22:31:003
339940,0migration/34148-21ntp_offset19:45:573
329940,0watchdog/323882-21sensors21:46:023
329940,0watchdog/30-21swapper/322:45:463
329940,0watchdog/30-21swapper/321:00:573
329940,0watchdog/30-21swapper/300:45:583
29815040,0irq/29-eth0-tx-14517-21munin-node21:25:582
29815040,0irq/29-eth0-tx-13345-21ssh22:20:462
29815040,0irq/29-eth0-tx-0-21swapper/223:20:462
29815040,0irq/29-eth0-tx-0-21swapper/223:15:402
29815040,0irq/29-eth0-tx-0-21swapper/223:10:582
29815040,0irq/29-eth0-tx-0-21swapper/222:55:562
29815040,0irq/29-eth0-tx-0-21swapper/222:25:532
29815040,0irq/29-eth0-tx-0-21swapper/222:05:502
29815040,0irq/29-eth0-tx-0-21swapper/222:00:572
29815040,0irq/29-eth0-tx-0-21swapper/221:40:512
29815040,0irq/29-eth0-tx-0-21swapper/221:35:572
29815040,0irq/29-eth0-tx-0-21swapper/200:15:432
29815040,0irq/29-eth0-tx-0-21swapper/200:10:422
29815040,0irq/29-eth0-tx-0-21swapper/200:05:592
29815040,0irq/29-eth0-tx-0-21swapper/020:30:550
29815040,0irq/29-eth0-tx-0-21swapper/020:20:500
29815040,0irq/29-eth0-tx-0-21swapper/019:31:040
29805040,0irq/28-eth0-rx-0-21swapper/323:50:443
29805040,0irq/28-eth0-rx-0-21swapper/322:25:463
264709943,0cyclictest31515-21awk19:45:532
264709943,0cyclictest24613-21awk20:25:562
264709943,0cyclictest18601-21awk21:45:542
264709943,0cyclictest13889-21cut23:35:532
264709940,0cyclictest22052-21munin-node23:40:512
264699943,0cyclictest3524-21snmpd23:57:261
264699943,0cyclictest3524-21snmpd23:57:261
264699943,0cyclictest3524-21snmpd23:30:561
264699943,0cyclictest3524-21snmpd00:22:411
264699943,0cyclictest28201-21awk20:50:541
264699943,0cyclictest10405-21awk21:00:551
264699940,0cyclictest0-21swapper/122:10:491
264699940,0cyclictest0-21swapper/121:58:411
264689944,0cyclictest0-21swapper/023:06:000
264689944,0cyclictest0-21swapper/021:25:440
264689943,0cyclictest3571-21lldpd23:50:520
264689943,0cyclictest3571-21lldpd22:32:220
264689943,0cyclictest31587-21awk19:45:530
264689943,0cyclictest27380-21awk21:50:550
264689943,0cyclictest26893-21munin-plugin-st20:50:380
264689943,0cyclictest25219-21awk00:00:550
264689943,0cyclictest24754-21awk21:10:570
264689943,0cyclictest16693-21awk23:55:550
264689943,0cyclictest16693-21awk23:55:550
264689943,0cyclictest10277-21awk21:00:550
264689940,0cyclictest0-21swapper/022:49:550
259940,0migration/26956-21kthreadcore23:30:582
259940,0migration/25913-21kthreadcore20:55:572
259940,0migration/23797-21irqcore21:55:562
259940,0migration/23729-21kthreadcore19:25:552
259940,0migration/230474-21kthreadcore20:50:562
259940,0migration/226519-21kthreadcore21:30:572
259940,0migration/216423-21cpu20:20:512
259940,0migration/212905-21kthreadcore19:30:572
259940,0migration/21165-21kthreadcore21:15:572
249940,0watchdog/27704-21cat20:35:572
249940,0watchdog/219929-21kthreadcore19:35:572
249940,0watchdog/213599-21perl20:40:532
249940,0watchdog/20-21swapper/220:45:572
249940,0watchdog/20-21swapper/220:16:012
179940,0migration/18489-21irqrtprio23:50:571
179940,0migration/14936-21taskset19:48:361
179940,0migration/1385-21kthreadcore20:30:581
179940,0migration/13516-21kthreadcore22:50:581
179940,0migration/130572-21kthreadcore00:40:581
179940,0migration/126208-21aten_r1power_en21:50:501
179940,0migration/123723-21kthreadcore23:20:571
179940,0migration/123653-21cpuspeed_turbos21:30:521
179940,0migration/119053-21kthreadcore22:40:581
179940,0migration/117863-21aten_r1power_en23:00:511
179940,0migration/116711-21kthreadcore19:55:551
179940,0migration/111491-21cpuspeed_turbos00:30:521
179940,0migration/110807-21kthreadcore20:15:561
169940,0watchdog/19331-21kthreadcore21:20:581
169940,0watchdog/16228-21kthreadcore23:10:581
169940,0watchdog/16152-21irqrtprio00:45:581
169940,0watchdog/14639-21port_sshpriv22:31:021
169940,0watchdog/13913-21cut21:15:581
169940,0watchdog/123934-21kthreadcore22:05:581
169940,0watchdog/120169-21ssh23:36:061
169940,0watchdog/119819-21tr21:05:571
169940,0watchdog/110965-21grep00:10:581
169940,0watchdog/10-21swapper/123:18:181
169940,0watchdog/10-21swapper/122:45:461
169940,0watchdog/10-21swapper/122:35:581
169940,0watchdog/10-21swapper/122:00:421
169940,0watchdog/10-21swapper/121:35:541
169940,0watchdog/10-21swapper/121:28:221
169940,0watchdog/10-21swapper/120:45:571
169940,0watchdog/10-21swapper/120:35:571
169940,0watchdog/10-21swapper/119:30:571
149940,0migration/08390-21users20:11:050
149940,0migration/029598-21sh22:28:160
149940,0migration/018188-21sh23:16:290
149940,0migration/01815-21kthreadcore22:10:570
149940,0migration/014196-21fschecks_time23:35:530
149940,0migration/013664-21kthreadcore20:15:570
329930,0watchdog/30-21swapper/321:10:533
329930,0watchdog/30-21swapper/320:10:533
329930,0watchdog/30-21swapper/320:01:013
329930,0watchdog/30-21swapper/319:20:533
29805030,0irq/28-eth0-rx-0-21swapper/321:15:503
29805030,0irq/28-eth0-rx-0-21swapper/319:35:513
264709932,0cyclictest29008-21latency19:40:572
264709930,0cyclictest0-21swapper/220:09:212
264709930,0cyclictest0-21swapper/220:00:532
264699933,0cyclictest24314-21awk19:40:541
264699932,0cyclictest7872-21cut19:50:561
264699932,0cyclictest27765-21awk19:20:531
264699932,0cyclictest25611-21kthreadcore23:40:561
264699932,0cyclictest1904-21munin-node20:55:511
264699932,0cyclictest16992-21grep20:20:521
264689933,0cyclictest3571-21lldpd23:25:520
264689933,0cyclictest15505-21kworker/0:022:05:520
264689932,0cyclictest3571-21lldpd22:04:510
264689932,0cyclictest3571-21lldpd19:55:500
264689932,0cyclictest29479-21awk00:40:560
264689932,0cyclictest28071-21awk20:05:560
264689932,0cyclictest24581-21awk21:30:560
264689932,0cyclictest18858-21awk23:00:550
264689932,0cyclictest18749-21awk00:15:550
264689932,0cyclictest17913-21cut22:20:580
264689930,0cyclictest322-21munin-node00:21:050
264689930,0cyclictest30841-21munin-node21:16:000
264689930,0cyclictest22763-21timerandwakeup21:06:050
249930,0watchdog/20-21swapper/220:10:572
179930,0migration/129582-21kthreadcore23:05:571
169930,0watchdog/15513-21diskmemload23:25:581
169930,0watchdog/15513-21diskmemload00:25:541
169930,0watchdog/15513-21diskmemload00:05:581
169930,0watchdog/113583-21ps20:40:531
169930,0watchdog/10-21swapper/119:35:571
149930,0migration/019891-21kthreadcore22:40:580
329920,0watchdog/30-21swapper/320:20:413
329920,0watchdog/30-21swapper/320:05:493
264709921,0cyclictest26613-21latency_hist19:20:382
264689921,0cyclictest27045-21latency_hist20:50:380
264689921,0cyclictest2087-21latency_hist21:55:390
264689921,0cyclictest19776-21rm00:35:430
264689920,0cyclictest16056-21sh19:35:500
264689920,0cyclictest0-21swapper/020:35:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional