You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 04:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Tue Dec 23, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2209323927,0sleep30-21swapper/319:10:043
2193523625,0sleep10-21swapper/119:08:131
2190923626,0sleep20-21swapper/219:07:582
1620523625,0sleep00-21swapper/019:06:080
222299976,0cyclictest9381-21date21:50:522
222289977,0cyclictest3571-21lldpd23:10:301
339960,0migration/38351-21kthreadcore20:51:113
339960,0migration/37097-21sh22:24:363
339960,0migration/34166-21sh22:57:053
339960,0migration/326668-21sh21:59:283
339960,0migration/325131-21timerandwakeup23:26:163
339960,0migration/323046-21sh00:38:523
29805060,0irq/28-eth0-rx-8157-21kthreadcore00:31:103
29805060,0irq/28-eth0-rx-23157-21kthreadcore21:21:093
29805060,0irq/28-eth0-rx-22365-21grep00:01:133
222299960,0cyclictest0-21swapper/221:39:022
222279965,0cyclictest7650-21ls23:55:510
222279965,0cyclictest1649-21if_err_eth023:16:100
179960,0migration/14877-21latency22:21:131
149960,0migration/0339-21switchtime21:06:160
149960,0migration/022294-21taskset21:37:380
149960,0migration/016330-21sh22:30:190
8305050,0irq/26-0000:00:4003-21munin-run23:35:512
339950,0migration/37508-21switchtime20:26:153
339950,0migration/34876-21latency23:51:133
339950,0migration/34670-21taskset20:50:363
339950,0migration/331547-21kthreadcore19:36:113
339950,0migration/329632-21munin-node19:16:023
339950,0migration/329422-21kthreadcore21:41:083
339950,0migration/323856-21sh20:41:063
339950,0migration/323391-21fschecks_time19:56:073
339950,0migration/317368-21munin-node22:46:153
339950,0migration/314578-21irqcore22:11:083
339950,0migration/314414-21if_eth023:41:103
329950,0watchdog/39262-21cut23:01:113
329950,0watchdog/36355-1kworker/3:1H21:50:583
329950,0watchdog/330521-21perl20:01:063
329950,0watchdog/326105-40yum-updatesd-he21:03:023
329950,0watchdog/314326-21kthreadcore20:56:103
329950,0watchdog/30-21swapper/321:06:103
29815050,0irq/29-eth0-tx-20215-21kthreadcore00:01:122
29815050,0irq/29-eth0-tx-13128-21ssh00:31:442
29815050,0irq/29-eth0-tx-0-21swapper/223:56:132
29815050,0irq/29-eth0-tx-0-21swapper/021:11:040
29815050,0irq/29-eth0-tx-0-21swapper/020:16:150
29815050,0irq/29-eth0-tx-0-21swapper/019:52:120
29805050,0irq/28-eth0-rx-8295-21df22:26:063
29805050,0irq/28-eth0-rx-8247-21ssh21:11:313
29805050,0irq/28-eth0-rx-7081-21python23:16:183
29805050,0irq/28-eth0-rx-6627-21basename21:31:063
29805050,0irq/28-eth0-rx-5224-21tr00:11:103
29805050,0irq/28-eth0-rx-31399-21kthreadcore21:26:103
29805050,0irq/28-eth0-rx-28661-21munin-node23:31:083
29805050,0irq/28-eth0-rx-27477-21ssh22:52:003
29805050,0irq/28-eth0-rx-22822-21tune2fs22:16:053
29805050,0irq/28-eth0-rx-17290-21kthreadcore19:51:093
29805050,0irq/28-eth0-rx-16660-21uname21:16:133
29805050,0irq/28-eth0-rx-0-21swapper/323:56:583
29805050,0irq/28-eth0-rx-0-21swapper/323:21:403
29805050,0irq/28-eth0-rx-0-21swapper/323:09:303
29805050,0irq/28-eth0-rx-0-21swapper/322:31:043
29805050,0irq/28-eth0-rx-0-21swapper/322:06:053
29805050,0irq/28-eth0-rx-0-21swapper/322:01:193
29805050,0irq/28-eth0-rx-0-21swapper/321:46:283
29805050,0irq/28-eth0-rx-0-21swapper/319:46:013
29805050,0irq/28-eth0-rx-0-21swapper/300:28:043
29805050,0irq/28-eth0-rx-0-21swapper/300:21:133
259950,0migration/229340-21unixbench_multi20:41:172
249950,0watchdog/28900-21kthreadcore22:06:102
222299955,0cyclictest0-21swapper/222:56:552
222299955,0cyclictest0-21swapper/221:13:302
222299955,0cyclictest0-21swapper/200:22:032
222299954,0cyclictest3524-21snmpd23:14:572
222299950,0cyclictest0-21swapper/223:05:262
222299950,0cyclictest0-21swapper/200:26:282
222289955,0cyclictest18-21rcuc/121:28:361
222289955,0cyclictest0-21swapper/123:56:291
222289955,0cyclictest0-21swapper/123:46:051
222289955,0cyclictest0-21swapper/123:11:141
222289955,0cyclictest0-21swapper/122:45:421
222289955,0cyclictest0-21swapper/122:39:241
222289955,0cyclictest0-21swapper/122:32:271
222289955,0cyclictest0-21swapper/122:17:571
222289955,0cyclictest0-21swapper/121:52:531
222289955,0cyclictest0-21swapper/121:46:441
222279950,0cyclictest9663-21ssh22:42:160
222279950,0cyclictest1119-21diskmemload00:17:490
222279950,0cyclictest0-21swapper/022:59:370
222279950,0cyclictest0-21swapper/021:58:460
222279950,0cyclictest0-21swapper/019:56:160
179950,0migration/16208-21aten2.4-expect00:31:041
179950,0migration/13608-21taskset23:35:001
179950,0migration/128120-21kthreadcore19:36:101
179950,0migration/122006-21latency_hist23:45:511
179950,0migration/121086-21kthreadcore23:26:091
179950,0migration/120590-21sh21:21:061
179950,0migration/120059-21sh00:20:161
179950,0migration/119798-21munin-node21:01:051
179950,0migration/117897-21gltestperf00:01:091
169950,0watchdog/119212-21aten2.4-expect20:16:021
149950,0migration/09701-21kthreadcore23:01:110
149950,0migration/07255-21kthreadcore20:51:110
149950,0migration/0713-21sh22:37:440
149950,0migration/05827-21irqcore19:21:090
149950,0migration/04426-21taskset20:47:490
149950,0migration/03466-21fschecks_time00:11:060
149950,0migration/032583-21kthreadcore21:26:110
149950,0migration/031845-21taskset23:13:520
149950,0migration/030488-21kthreadcore19:36:110
149950,0migration/029652-21sh00:26:050
149950,0migration/029424-21kthreadcore00:06:100
149950,0migration/026808-21kthreadcore21:41:070
149950,0migration/023574-21irqcore23:46:080
149950,0migration/022615-21sh00:37:530
149950,0migration/021308-21fschecks_time00:21:080
149950,0migration/019869-21unixbench_multi23:41:200
149950,0migration/018058-21runrttasks23:25:090
149950,0migration/016968-21kthreadcore20:11:110
149950,0migration/016525-21irqrtprio23:06:100
149950,0migration/015310-21kthreadcore19:26:090
149950,0migration/012142-21taskset23:38:510
149950,0migration/011282-21kthreadcore21:51:110
8305040,0irq/26-0000:00:30749-21if_eth1.219:16:072
339940,0migration/38410-21kthreadcore20:06:103
339940,0migration/330371-21kthreadcore20:21:093
339940,0migration/328143-21kthreadcore22:36:083
339940,0migration/32608-21sh22:41:053
339940,0migration/325275-21kthreadcore19:11:093
339940,0migration/318612-21ksmtuned20:12:003
329940,0watchdog/37774-21taskset19:43:103
329940,0watchdog/315973-21if_err_eth121:36:063
329940,0watchdog/30-21swapper/319:31:103
329940,0watchdog/30-21swapper/300:16:073
29815040,0irq/29-eth0-tx-462-21ssh23:15:542
29815040,0irq/29-eth0-tx-28590-21python23:46:142
29815040,0irq/29-eth0-tx-24525-21munin-node21:41:032
29815040,0irq/29-eth0-tx-22886-21ssh23:08:532
29815040,0irq/29-eth0-tx-20020-21ssh22:11:262
29815040,0irq/29-eth0-tx-12530-21ssh21:31:382
29815040,0irq/29-eth0-tx-0-21swapper/223:26:092
29815040,0irq/29-eth0-tx-0-21swapper/223:21:052
29815040,0irq/29-eth0-tx-0-21swapper/222:36:022
29815040,0irq/29-eth0-tx-0-21swapper/222:33:592
29815040,0irq/29-eth0-tx-0-21swapper/221:21:532
29815040,0irq/29-eth0-tx-0-21swapper/200:16:122
29815040,0irq/29-eth0-tx-0-21swapper/200:11:042
29815040,0irq/29-eth0-tx-0-21swapper/200:08:272
29815040,0irq/29-eth0-tx-0-21swapper/020:36:070
29805040,0irq/28-eth0-rx-26070-21aten2.4-expect00:06:043
29805040,0irq/28-eth0-rx-0-21swapper/323:45:533
29805040,0irq/28-eth0-rx-0-21swapper/323:35:553
29805040,0irq/28-eth0-rx-0-21swapper/323:10:553
29805040,0irq/28-eth0-rx-0-21swapper/320:36:103
259940,0migration/29872-21irqrtprio20:31:082
259940,0migration/27341-21munin-node20:26:112
259940,0migration/229373-21kthreadcore19:36:102
259940,0migration/227892-21irqcore21:06:082
259940,0migration/212779-21kthreadcore21:51:122
259940,0migration/210736-21kthreadcore20:51:122
249940,0watchdog/23454-21ssh22:41:072
249940,0watchdog/2341-21irqstats23:51:112
249940,0watchdog/231400-21cpu22:21:072
249940,0watchdog/224530-21latency21:56:102
249940,0watchdog/210274-21load23:36:112
249940,0watchdog/20-21swapper/221:18:262
249940,0watchdog/20-21swapper/220:56:102
249940,0watchdog/20-21swapper/220:01:102
249940,0watchdog/20-21swapper/219:51:102
222299944,0cyclictest14163-21strings19:46:092
222299943,0cyclictest5945-21awk20:06:092
222299943,0cyclictest3571-21lldpd22:46:302
222299943,0cyclictest3524-21snmpd23:43:122
222299943,0cyclictest3524-21snmpd22:25:562
222299943,0cyclictest3524-21snmpd22:15:562
222299943,0cyclictest3524-21snmpd22:00:562
222299943,0cyclictest3524-21snmpd21:26:552
222299943,0cyclictest3524-21snmpd20:47:242
222299943,0cyclictest3524-21snmpd20:00:392
222299943,0cyclictest3524-21snmpd00:37:132
222299943,0cyclictest27403-21awk20:21:062
222299943,0cyclictest23510-21awk19:11:072
222299943,0cyclictest21595-21awk22:51:082
222299943,0cyclictest20402-21awk21:01:072
222299943,0cyclictest20339-21awk20:16:072
222299943,0cyclictest20048-21awk19:31:082
222289944,0cyclictest0-21swapper/121:31:271
222289943,0cyclictest3571-21lldpd22:53:591
222289943,0cyclictest3571-21lldpd00:11:011
222289943,0cyclictest3571-21lldpd00:09:011
222289943,0cyclictest3524-21snmpd21:08:551
222289943,0cyclictest3524-21snmpd20:51:551
222289943,0cyclictest3524-21snmpd20:13:541
222289943,0cyclictest3524-21snmpd20:05:541
222289943,0cyclictest31133-21awk20:46:071
222289943,0cyclictest20139-21sadc22:50:521
222279944,0cyclictest0-21swapper/000:04:340
222279943,0cyclictest3571-21lldpd20:58:290
222279943,0cyclictest3524-21snmpd22:46:110
222279943,0cyclictest3524-21snmpd20:10:240
222279943,0cyclictest30700-21awk19:16:060
222279943,0cyclictest23495-21awk19:11:060
222279943,0cyclictest20432-21awk21:01:070
222279943,0cyclictest19711-21awk23:26:060
222279943,0cyclictest11798-21ls21:31:120
179940,0migration/17620-21kthreadcore19:21:101
179940,0migration/1690-21kthreadcore22:56:111
179940,0migration/13572-21kthreadcore20:26:081
179940,0migration/129525-21kthreadcore21:41:081
179940,0migration/129121-21taskset19:12:551
179940,0migration/127223-21turbostat.cron22:00:471
179940,0migration/125588-21kthreadcore20:41:091
179940,0migration/119550-21fschecks_count19:31:061
179940,0migration/118913-21kthreadcore19:51:091
179940,0migration/116472-21kthreadcore22:11:091
179940,0migration/113059-21irqcore19:26:081
179940,0migration/111727-21sh23:37:541
179940,0migration/111156-21fschecks_time21:16:061
169940,0watchdog/18403-21entropy22:26:071
169940,0watchdog/16052-21ssh23:00:591
169940,0watchdog/1564-21tr20:01:101
169940,0watchdog/130276-21fschecks_time00:26:071
169940,0watchdog/127371-21idleruntime20:21:061
169940,0watchdog/12678-21ssh22:03:061
169940,0watchdog/121532-21memory20:36:101
169940,0watchdog/114327-21kthreadcore20:56:101
169940,0watchdog/10-21swapper/122:06:101
169940,0watchdog/10-21swapper/100:39:511
169940,0watchdog/10-21swapper/100:21:111
149940,0migration/06967-21sh22:24:180
149940,0migration/029439-21kthreadcore23:31:100
149940,0migration/024919-21kthreadcore21:21:090
149940,0migration/017643-21sh21:17:290
149940,0migration/014650-21timerwakeupswit19:46:150
8305030,0irq/26-0000:00:0-21swapper/219:20:512
29815030,0irq/29-eth0-tx-0-21swapper/020:01:040
29805030,0irq/28-eth0-rx-0-21swapper/320:31:043
29805030,0irq/28-eth0-rx-0-21swapper/320:16:033
29805030,0irq/28-eth0-rx-0-21swapper/319:27:203
29805030,0irq/28-eth0-rx-0-21swapper/319:25:413
249930,0watchdog/27704-21sshd19:42:222
249930,0watchdog/20-21swapper/220:11:462
222299932,0cyclictest16718-21awk20:36:072
222299930,0cyclictest0-21swapper/219:25:582
222289933,0cyclictest3571-21lldpd19:40:571
222289932,0cyclictest3524-21snmpd19:46:541
222289932,0cyclictest23802-21awk19:56:091
222289932,0cyclictest10006-21irqstats20:31:081
222279933,0cyclictest3605-21kworker/0:000:31:030
222279933,0cyclictest28868-21kworker/0:122:15:570
222279933,0cyclictest28868-21kworker/0:122:11:290
222279933,0cyclictest28868-21kworker/0:122:06:550
222279933,0cyclictest28868-21kworker/0:122:01:050
222279933,0cyclictest28868-21kworker/0:120:41:540
222279933,0cyclictest28868-21kworker/0:120:31:000
222279933,0cyclictest28868-21kworker/0:120:25:520
222279933,0cyclictest28868-21kworker/0:120:21:340
222279933,0cyclictest28636-21kworker/0:019:41:000
222279933,0cyclictest26823-21kworker/0:222:51:250
222279932,0cyclictest9173-21awk23:56:100
222279932,0cyclictest6991-21sensors21:46:150
222279932,0cyclictest17147-21grep22:31:050
222279930,0cyclictest0-21swapper/019:30:530
179930,0migration/131262-21kthreadcore19:16:081
169930,0watchdog/15963-21sh23:51:591
169930,0watchdog/10-21swapper/123:21:351
169930,0watchdog/10-21swapper/121:36:061
169930,0watchdog/10-21swapper/121:11:021
222289921,0cyclictest0-21swapper/123:15:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional