You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 20:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Fri May 29, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81823725,0sleep10-21swapper/107:22:441
66223728,0sleep30-21swapper/307:21:143
51023726,0sleep00-21swapper/007:19:270
72223624,0sleep20-21swapper/207:21:572
339980,0migration/327444-21runrttasks10:22:343
10199970,0cyclictest0-21swapper/209:50:422
10109977,0cyclictest0-21swapper/009:24:300
35160,0ktimersoftd/30-21swapper/312:16:383
339960,0migration/37913-21sh11:07:163
339960,0migration/34033-21kthreadcore12:19:113
339960,0migration/330211-21sh10:59:183
339960,0migration/328777-21munin-node10:24:083
339960,0migration/321432-21pmu-power10:54:153
339960,0migration/310074-21sh12:41:413
29815060,0irq/29-eth0-tx-8362-21munin-node08:14:150
29815060,0irq/29-eth0-tx-18097-21crond09:23:540
29805060,0irq/28-eth0-rx-30134-21ssh09:47:243
29805060,0irq/28-eth0-rx-2646-21diskstats11:24:053
29805060,0irq/28-eth0-rx-18822-21sed12:29:103
29805060,0irq/28-eth0-rx-17493-21users10:14:193
149960,0migration/026941-21taskset12:50:290
149960,0migration/023386-21sh12:13:140
149960,0migration/019123-21sh10:18:430
10119960,0cyclictest0-21swapper/107:34:071
339950,0migration/37461-21fschecks_time12:04:083
339950,0migration/3641-21missed_timers09:29:123
339950,0migration/3448-21aten_r1power_vo08:04:013
339950,0migration/332562-21munin-node12:34:163
339950,0migration/332101-21sh09:48:583
339950,0migration/330365-21kthreadcore11:39:113
339950,0migration/32940-21kthreadcore11:59:113
339950,0migration/329321-21cpuspeed_turbos09:09:063
339950,0migration/32793-21munin-node07:24:093
339950,0migration/327815-21runrttasks09:04:143
339950,0migration/327775-21munin-node11:54:133
339950,0migration/326663-21munin-node11:19:073
339950,0migration/322887-21taskset08:25:483
339950,0migration/320631-21kthreadcore12:09:123
339950,0migration/320474-21kthreadcore09:24:123
339950,0migration/315400-21latency_hist08:18:533
339950,0migration/311658-21kthreadcore11:09:123
339950,0migration/310538-21run-parts09:14:543
329950,0watchdog/35370-21fschecks_time11:44:093
329950,0watchdog/331599-21sed10:44:093
329950,0watchdog/315631-21sh09:55:293
329950,0watchdog/30-21swapper/312:44:053
329950,0watchdog/30-21swapper/310:39:213
29815050,0irq/29-eth0-tx-3534-21sshd08:13:140
29815050,0irq/29-eth0-tx-31249-21munin-node08:39:080
29815050,0irq/29-eth0-tx-0-21swapper/212:24:102
29815050,0irq/29-eth0-tx-0-21swapper/009:18:150
29815050,0irq/29-eth0-tx-0-21swapper/008:30:510
29805050,0irq/28-eth0-rx-27148-21cat07:54:113
29805050,0irq/28-eth0-rx-20808-21cut11:34:113
29805050,0irq/28-eth0-rx-17702-21grep09:59:113
29805050,0irq/28-eth0-rx-17617-21vmstat11:29:193
29805050,0irq/28-eth0-rx-16865-21kthreadcore09:39:123
29805050,0irq/28-eth0-rx-13837-21perl10:34:073
29805050,0irq/28-eth0-rx-0-21swapper/311:49:123
29805050,0irq/28-eth0-rx-0-21swapper/310:49:443
29805050,0irq/28-eth0-rx-0-21swapper/310:29:103
29805050,0irq/28-eth0-rx-0-21swapper/310:09:063
29805050,0irq/28-eth0-rx-0-21swapper/310:05:103
29805050,0irq/28-eth0-rx-0-21swapper/309:34:113
29805050,0irq/28-eth0-rx-0-21swapper/308:39:233
179950,0migration/17723-21taskset08:09:171
179950,0migration/17359-21munin-node07:24:121
179950,0migration/1564-21fschecks_time09:49:071
179950,0migration/127706-21missed_timers10:39:151
179950,0migration/12743-21cpuspeed_turbos12:39:061
179950,0migration/125049-21munin-node10:59:101
179950,0migration/123968-21fschecks_count08:29:051
179950,0migration/122324-21sh12:10:151
179950,0migration/112442-21sh10:32:431
179950,0migration/110787-21latency_hist11:28:541
169950,0watchdog/117038-21ntp_states11:29:131
149950,0migration/08933-21kthreadcore09:34:110
149950,0migration/04724-21kthreadcore11:04:120
149950,0migration/032318-21kthreadcore11:39:110
149950,0migration/029515-21irqcore10:24:110
149950,0migration/029252-21cpuspeed_turbos09:09:060
149950,0migration/029119-21kthreadcore12:34:110
149950,0migration/025910-21kthreadcore12:14:110
149950,0migration/022771-21taskset08:24:240
149950,0migration/022445-21fschecks_count09:04:070
149950,0migration/019850-21kthreadcore12:29:100
149950,0migration/019448-21sh10:18:590
149950,0migration/014642-21sh12:07:590
149950,0migration/014638-21aten_r1power_cu08:59:000
149950,0migration/01167-21kthreadcore11:59:110
149950,0migration/010484-21sh12:42:510
10199955,0cyclictest18104-21diskmemload10:00:292
10199955,0cyclictest0-21swapper/211:36:492
10199955,0cyclictest0-21swapper/211:04:012
10199955,0cyclictest0-21swapper/210:17:212
10199954,0cyclictest0-21swapper/212:20:192
10199950,0cyclictest0-21swapper/209:39:212
10199950,0cyclictest0-21swapper/209:32:252
8305040,0irq/26-0000:00:8407-21latency_hist07:28:532
339940,0migration/39432-21cpuspeed_turbos07:34:063
339940,0migration/320233-21kthreadcore11:14:123
339940,0migration/315959-21irqcore08:59:063
339940,0migration/313465-21kthreadcore09:19:123
339940,0migration/310374-21kthreadcore08:49:103
329940,0watchdog/30-21swapper/312:24:173
29815040,0irq/29-eth0-tx-23800-21sshd07:46:150
29815040,0irq/29-eth0-tx-18104-21diskmemload10:31:442
29815040,0irq/29-eth0-tx-0-21swapper/211:25:482
29815040,0irq/29-eth0-tx-0-21swapper/210:59:122
29815040,0irq/29-eth0-tx-0-21swapper/210:53:432
29815040,0irq/29-eth0-tx-0-21swapper/210:40:502
29815040,0irq/29-eth0-tx-0-21swapper/209:47:312
29815040,0irq/29-eth0-tx-0-21swapper/008:00:460
29805040,0irq/28-eth0-rx-0-21swapper/312:48:593
29805040,0irq/28-eth0-rx-0-21swapper/308:29:093
249940,0watchdog/28093-21mdstat10:09:132
249940,0watchdog/22652-21ssh10:24:412
249940,0watchdog/214279-21ssh12:06:572
179940,0migration/16613-21sh10:49:021
179940,0migration/13918-21latency11:59:121
179940,0migration/132713-21taskset11:19:231
179940,0migration/131215-21kthreadcore12:34:111
179940,0migration/129261-21cpuspeed_turbos09:09:061
179940,0migration/127546-21kthreadcore12:14:111
179940,0migration/122837-21kthreadcore11:14:131
179940,0migration/121787-21latency_hist09:03:541
179940,0migration/119509-21kthreadcore07:44:101
179940,0migration/118843-21irqcore12:29:101
179940,0migration/118645-21ntp_kernel_pll_09:39:141
179940,0migration/118433-21kthreadcore11:49:121
179940,0migration/115306-21kthreadcore10:34:111
179940,0migration/111843-21kthreadcore12:24:101
179940,0migration/111442-21kthreadcore11:09:121
169940,0watchdog/18047-21kthreadcore11:44:131
169940,0watchdog/16682-21aten_r1power_cu12:04:051
169940,0watchdog/12560-21ssh10:24:251
169940,0watchdog/125385-21grep10:19:131
169940,0watchdog/121853-21aten_r1power_fr11:54:051
169940,0watchdog/119954-21kthreadcore09:24:131
169940,0watchdog/112786-21ntp_states08:49:131
169940,0watchdog/111206-21ssh12:44:051
169940,0watchdog/10-21swapper/110:44:091
169940,0watchdog/10-21swapper/110:12:411
149940,0migration/08335-21irqrtprio08:49:090
149940,0migration/023800-21kthreadcore11:54:110
149940,0migration/020587-21idleruntime11:34:090
149940,0migration/014138-21irqrtprio09:39:110
149940,0migration/012925-21kthreadcore12:24:100
10199943,0cyclictest3571-21lldpd12:49:132
10199943,0cyclictest3571-21lldpd12:40:132
10199943,0cyclictest3571-21lldpd12:38:132
10199943,0cyclictest3571-21lldpd11:50:432
10199943,0cyclictest3524-21snmpd11:44:342
10199943,0cyclictest3524-21snmpd10:44:182
10199943,0cyclictest3524-21snmpd09:34:172
10199943,0cyclictest3524-21snmpd09:27:322
10199943,0cyclictest3524-21snmpd09:19:172
10199943,0cyclictest3524-21snmpd09:14:172
10199943,0cyclictest3524-21snmpd09:09:172
10199943,0cyclictest3524-21snmpd08:57:462
10199943,0cyclictest3524-21snmpd08:51:012
10199943,0cyclictest3524-21snmpd08:46:162
10199943,0cyclictest3524-21snmpd08:41:162
10199943,0cyclictest3524-21snmpd08:30:312
10199943,0cyclictest3524-21snmpd08:24:162
10199943,0cyclictest3524-21snmpd08:18:162
10199943,0cyclictest3524-21snmpd08:13:162
10199943,0cyclictest3524-21snmpd08:02:152
10199943,0cyclictest3524-21snmpd07:44:152
10199943,0cyclictest3524-21snmpd07:30:152
10199943,0cyclictest31428-21awk11:59:092
10199943,0cyclictest22815-21awk11:54:092
10199943,0cyclictest18458-21awk11:14:092
10199943,0cyclictest16439-21awk12:09:092
10199943,0cyclictest16354-21awk10:54:102
10199943,0cyclictest14180-21awk10:34:092
10199943,0cyclictest1398-21awk08:04:042
10199943,0cyclictest12274-21awk12:44:102
10119943,0cyclictest9612-21awk09:54:101
10119943,0cyclictest9490-21awk08:14:101
10119943,0cyclictest3524-21snmpd09:59:181
10119943,0cyclictest3524-21snmpd09:18:321
10119943,0cyclictest28207-21sadc12:53:541
10119943,0cyclictest26857-21awk10:04:081
10119943,0cyclictest22452-21awk09:44:081
10119943,0cyclictest1251-21awk12:19:091
10119943,0cyclictest12315-21awk09:19:111
10119943,0cyclictest11840-21awk10:14:081
10109943,0cyclictest5646-21awk10:29:090
10109943,0cyclictest3571-21lldpd12:44:130
10109943,0cyclictest3524-21snmpd08:05:450
10109943,0cyclictest3143-21awk10:09:090
10109943,0cyclictest27116-21awk11:19:090
10109943,0cyclictest26053-21awk07:54:090
10109943,0cyclictest2301-21awk07:24:070
10109943,0cyclictest22420-21awk09:44:080
10109943,0cyclictest14300-21awk10:34:090
10109943,0cyclictest10304-21awk07:34:090
10109940,0cyclictest3313-21munin-run09:33:540
10109940,0cyclictest0-21swapper/011:50:570
10109940,0cyclictest0-21swapper/010:01:320
10109940,0cyclictest0-21swapper/009:51:270
8305030,0irq/26-0000:00:0-21swapper/210:03:552
8305030,0irq/26-0000:00:0-21swapper/209:53:542
339930,0migration/324423-21taskset07:50:563
329930,0watchdog/30-21swapper/308:19:043
329930,0watchdog/30-21swapper/307:44:083
29815030,0irq/29-eth0-tx-0-21swapper/212:28:592
29805030,0irq/28-eth0-rx-0-21swapper/308:45:533
29805030,0irq/28-eth0-rx-0-21swapper/308:36:143
29805030,0irq/28-eth0-rx-0-21swapper/308:10:563
29805030,0irq/28-eth0-rx-0-21swapper/307:59:283
29805030,0irq/28-eth0-rx-0-21swapper/307:29:083
249930,0watchdog/212170-21ps11:29:092
249930,0watchdog/20-21swapper/212:14:052
249930,0watchdog/20-21swapper/210:19:052
249930,0watchdog/20-21swapper/209:05:012
249930,0watchdog/20-21swapper/208:19:082
19130,0ktimersoftd/10-21swapper/107:32:421
179930,0migration/132224-21kthreadcore09:29:111
169930,0watchdog/10-21swapper/111:36:251
169930,0watchdog/10-21swapper/110:54:211
169930,0watchdog/10-21swapper/107:54:041
149930,0migration/04448-21sh11:43:590
149930,0migration/021960-21sh10:54:220
10199933,0cyclictest3571-21lldpd07:54:382
10199932,0cyclictest3571-21lldpd08:59:092
10199932,0cyclictest3524-21snmpd07:50:452
10199932,0cyclictest3524-21snmpd07:39:002
10199932,0cyclictest28772-21grep11:39:062
10199932,0cyclictest10249-21awk07:34:092
10199930,0cyclictest26014-21munin-node11:19:082
10199930,0cyclictest11127-21kthreadcore11:09:122
10119933,0cyclictest0-21swapper/109:36:091
10119932,0cyclictest3524-21snmpd07:40:451
10119932,0cyclictest15370-21perl08:59:031
10119932,0cyclictest1231-21cut11:39:121
10119932,0cyclictest1147-21awk11:04:091
10119930,0cyclictest32665-21latency_hist08:03:531
10119930,0cyclictest18685-21grep08:19:101
10109933,0cyclictest18104-21diskmemload11:30:370
10109932,0cyclictest9565-21awk09:54:090
10109932,0cyclictest3524-21snmpd08:20:310
10109932,0cyclictest32143-21sensors10:04:150
10109932,0cyclictest31493-21awk10:44:080
10109932,0cyclictest2871-21grep11:24:060
10109932,0cyclictest24925-21awk10:59:100
10109932,0cyclictest12602-21memory10:49:140
10109931,0cyclictest0-21swapper/008:47:160
10109930,0cyclictest0-21swapper/007:30:210
329920,0watchdog/30-21swapper/308:53:573
29805020,0irq/28-eth0-rx-0-21swapper/307:39:013
169920,0watchdog/10-21swapper/108:54:011
169920,0watchdog/10-21swapper/108:39:011
169920,0watchdog/10-21swapper/108:34:011
169920,0watchdog/10-21swapper/108:24:091
169920,0watchdog/10-21swapper/107:49:001
10199920,0cyclictest0-21swapper/208:33:542
10119920,0cyclictest0-21swapper/108:43:541
10119920,0cyclictest0-21swapper/108:03:551
10109921,0cyclictest8696-21latency_hist11:08:540
10109921,0cyclictest32409-21kworker/0:012:19:050
10109921,0cyclictest30551-21cut08:33:540
10109921,0cyclictest21455-21sh10:38:540
10109921,0cyclictest16346-21latency_hist07:38:530
10109921,0cyclictest0-21swapper/007:49:040
10109920,0cyclictest17323-21cat11:13:540
10109920,0cyclictest0-21swapper/008:54:540
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional