You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 06:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Mon Dec 08, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1435124435,0sleep30-21swapper/318:17:093
1429323929,0sleep20-21swapper/218:16:282
1428223525,0sleep10-21swapper/118:16:191
1376823026,0sleep00-21swapper/018:14:220
329970,0watchdog/313013-21kthreadcore18:39:173
329970,0watchdog/30-21swapper/321:09:173
29925070,0irq/32-eth0-rx-0-21swapper/322:44:153
29925070,0irq/32-eth0-rx-0-21swapper/321:28:563
35160,0ktimersoftd/30-21swapper/321:21:513
339960,0migration/327906-21sh20:37:123
339960,0migration/32756-21idleruntime22:34:143
339960,0migration/32001-21sh21:35:193
329960,0watchdog/38824-21perl19:44:133
329960,0watchdog/31681-21python22:49:203
329960,0watchdog/30-21swapper/323:04:003
29935060,0irq/33-eth0-tx-18609-21munin-node19:29:220
29935060,0irq/33-eth0-tx-0-21swapper/020:04:190
29935060,0irq/33-eth0-tx-0-21swapper/018:54:100
29925060,0irq/32-eth0-rx-26220-21tune2fs22:29:103
29925060,0irq/32-eth0-rx-13685-21ntp_states18:59:193
29925060,0irq/32-eth0-rx-0-21swapper/323:39:143
29925060,0irq/32-eth0-rx-0-21swapper/323:29:053
29925060,0irq/32-eth0-rx-0-21swapper/323:14:453
29925060,0irq/32-eth0-rx-0-21swapper/323:12:533
29925060,0irq/32-eth0-rx-0-21swapper/322:55:153
29925060,0irq/32-eth0-rx-0-21swapper/322:38:593
29925060,0irq/32-eth0-rx-0-21swapper/322:24:433
29925060,0irq/32-eth0-rx-0-21swapper/322:09:083
29925060,0irq/32-eth0-rx-0-21swapper/322:08:023
29925060,0irq/32-eth0-rx-0-21swapper/321:55:493
29925060,0irq/32-eth0-rx-0-21swapper/321:44:313
29925060,0irq/32-eth0-rx-0-21swapper/321:07:303
29925060,0irq/32-eth0-rx-0-21swapper/320:55:533
29925060,0irq/32-eth0-rx-0-21swapper/320:50:523
29925060,0irq/32-eth0-rx-0-21swapper/320:43:163
29925060,0irq/32-eth0-rx-0-21swapper/320:24:413
29925060,0irq/32-eth0-rx-0-21swapper/320:23:523
29925060,0irq/32-eth0-rx-0-21swapper/318:34:213
169960,0watchdog/14575-21kthreadcore20:59:171
169960,0watchdog/10-21swapper/122:29:161
149960,0migration/09513-21kthreadcore23:34:170
149960,0migration/04105-21kthreadcore22:34:160
149960,0migration/025166-21sh22:28:550
8315050,0irq/26-0000:00:5988-21chrt20:59:432
339950,0migration/37862-21taskset22:18:503
339950,0migration/36293-21munin-node18:54:153
339950,0migration/331595-21kthreadcore19:59:153
339950,0migration/331367-21taskset23:45:133
339950,0migration/330295-21munin-node18:29:143
339950,0migration/326389-21kthreadcore19:09:153
339950,0migration/325161-21munin-node21:14:103
339950,0migration/320840-21ntp_kernel_pll_23:19:153
339950,0migration/315258-21taskset22:20:183
329950,0watchdog/30-21swapper/320:14:133
329950,0watchdog/30-21swapper/319:14:173
329950,0watchdog/30-21swapper/318:20:093
29935050,0irq/33-eth0-tx-3368-21if_err_eth1.220:24:132
29935050,0irq/33-eth0-tx-30062-21munin-node23:09:212
29935050,0irq/33-eth0-tx-29165-21sshd21:53:282
29935050,0irq/33-eth0-tx-25856-21munin-node19:34:170
29935050,0irq/33-eth0-tx-25731-21diskmemload20:34:532
29935050,0irq/33-eth0-tx-22461-21munin-node23:39:192
29935050,0irq/33-eth0-tx-18783-21munin-node20:14:180
29935050,0irq/33-eth0-tx-15114-21munin-node19:49:130
29935050,0irq/33-eth0-tx-0-21swapper/223:48:422
29935050,0irq/33-eth0-tx-0-21swapper/223:38:052
29935050,0irq/33-eth0-tx-0-21swapper/223:32:542
29935050,0irq/33-eth0-tx-0-21swapper/223:23:432
29935050,0irq/33-eth0-tx-0-21swapper/221:36:092
29935050,0irq/33-eth0-tx-0-21swapper/220:45:312
29935050,0irq/33-eth0-tx-0-21swapper/020:19:170
29935050,0irq/33-eth0-tx-0-21swapper/019:48:330
29935050,0irq/33-eth0-tx-0-21swapper/019:14:090
29925050,0irq/32-eth0-rx-5933-21forks20:44:113
29925050,0irq/32-eth0-rx-14252-21cut20:29:163
29925050,0irq/32-eth0-rx-14252-21cut20:29:163
29925050,0irq/32-eth0-rx-0-21swapper/323:34:223
29925050,0irq/32-eth0-rx-0-21swapper/323:25:023
29925050,0irq/32-eth0-rx-0-21swapper/322:59:143
29925050,0irq/32-eth0-rx-0-21swapper/322:02:383
29925050,0irq/32-eth0-rx-0-21swapper/321:49:093
29925050,0irq/32-eth0-rx-0-21swapper/321:39:093
29925050,0irq/32-eth0-rx-0-21swapper/321:29:083
29925050,0irq/32-eth0-rx-0-21swapper/320:59:003
29925050,0irq/32-eth0-rx-0-21swapper/319:24:163
29925050,0irq/32-eth0-rx-0-21swapper/318:43:563
29925050,0irq/32-eth0-rx-0-21swapper/318:27:063
259950,0migration/25141-21sh21:57:352
259950,0migration/231874-21munin-node18:49:232
259950,0migration/229688-21kthreadcore21:14:162
259950,0migration/226719-21sh21:33:052
259950,0migration/225717-21kthreadcore19:09:152
259950,0migration/220480-21kthreadcore18:19:242
259950,0migration/21488-21cpuspeed_turbos21:19:092
259950,0migration/214569-21kthreadcore22:59:152
259950,0migration/214411-21munin-node22:19:172
259950,0migration/212022-21sh21:43:472
19150,0ktimersoftd/10-21swapper/122:11:541
19150,0ktimersoftd/10-21swapper/121:48:461
179950,0migration/19762-21kthreadcore21:59:151
179950,0migration/17722-21kthreadcore18:34:191
179950,0migration/15446-21kthreadcore18:54:151
179950,0migration/13727-21taskset18:33:371
179950,0migration/124740-21irqrtprio23:24:151
179950,0migration/118893-21kthreadcore23:39:131
169950,0watchdog/138062chrt20:00:291
169950,0watchdog/132340-21ssh21:16:051
169950,0watchdog/122848-21ssh23:23:401
169950,0watchdog/114637-21runrttasks19:46:171
169950,0watchdog/112177-21fschecks_time19:24:131
145789955,0cyclictest0-21swapper/222:52:372
145789955,0cyclictest0-21swapper/222:11:382
145789954,0cyclictest23871-21snmpd19:21:292
145789950,0cyclictest0-21swapper/223:28:242
145789950,0cyclictest0-21swapper/221:28:072
145789950,0cyclictest0-21swapper/220:19:412
145789950,0cyclictest0-21swapper/220:09:262
145779955,0cyclictest0-21swapper/122:48:571
145779955,0cyclictest0-21swapper/120:41:251
145779950,0cyclictest0-21swapper/123:09:271
145779950,0cyclictest0-21swapper/122:59:121
145779950,0cyclictest0-21swapper/121:32:301
145769955,0cyclictest0-21swapper/023:19:130
145769955,0cyclictest0-21swapper/023:02:400
145769955,0cyclictest0-21swapper/021:25:520
145769950,0cyclictest0-21swapper/022:53:030
145769950,0cyclictest0-21swapper/021:05:030
149950,0migration/09828-21kthreadcore21:59:150
149950,0migration/09574-21taskset21:23:340
149950,0migration/09032-21fschecks_time22:19:090
149950,0migration/08471-21fschecks_time18:59:120
149950,0migration/06216-21kthreadcore22:54:140
149950,0migration/06165-21latency_hist23:13:560
149950,0migration/05691-21irqrtprio19:19:170
149950,0migration/0480-21taskset21:17:450
149950,0migration/031590-21aten_r1power_fr20:59:100
149950,0migration/031587-21kthreadcore21:34:150
149950,0migration/031321-21latency_hist23:28:560
149950,0migration/029238-21cpuspeed_turbos20:39:110
149950,0migration/026225-21taskset21:31:420
149950,0migration/026093-21kthreadcore19:54:160
149950,0migration/022134-21taskset20:52:390
149950,0migration/021049-21aten_r1power_cu21:49:080
149950,0migration/020727-21fschecks_time20:34:100
149950,0migration/020443-21irqcore22:44:140
149950,0migration/018447-21runrttasks22:42:530
149950,0migration/017094-21idleruntime23:39:100
149950,0migration/011537-21latency_hist20:08:570
149950,0migration/011045-21latency_hist20:28:570
149950,0migration/011045-21latency_hist20:28:570
149950,0migration/011014-21idleruntime-cro18:38:560
8315040,0irq/26-0000:00:29445-21date19:58:572
329940,0watchdog/30-21swapper/320:08:573
329940,0watchdog/30-21swapper/319:49:133
329940,0watchdog/30-21swapper/319:29:173
329940,0watchdog/30-21swapper/318:49:173
29935040,0irq/33-eth0-tx-5912-21ssh21:59:042
29935040,0irq/33-eth0-tx-24078-21ssh20:54:152
29935040,0irq/33-eth0-tx-1858-21ssh22:34:112
29935040,0irq/33-eth0-tx-0-21swapper/223:14:062
29935040,0irq/33-eth0-tx-0-21swapper/222:53:562
29935040,0irq/33-eth0-tx-0-21swapper/222:44:132
29935040,0irq/33-eth0-tx-0-21swapper/222:24:062
29935040,0irq/33-eth0-tx-0-21swapper/222:13:592
29935040,0irq/33-eth0-tx-0-21swapper/222:04:082
29935040,0irq/33-eth0-tx-0-21swapper/221:44:102
29935040,0irq/33-eth0-tx-0-21swapper/221:08:572
29935040,0irq/33-eth0-tx-0-21swapper/221:03:592
29935040,0irq/33-eth0-tx-0-21swapper/220:29:212
29935040,0irq/33-eth0-tx-0-21swapper/220:29:212
29935040,0irq/33-eth0-tx-0-21swapper/018:24:100
29925040,0irq/32-eth0-rx-0-21swapper/319:54:093
29925040,0irq/32-eth0-rx-0-21swapper/319:19:113
29925040,0irq/32-eth0-rx-0-21swapper/319:04:103
259940,0migration/232127-21switchtime19:34:232
259940,0migration/229383-21kthreadcore22:29:152
259940,0migration/225092-21kthreadcore23:04:162
259940,0migration/223619-21kthreadcore18:44:162
259940,0migration/221304-21kthreadcore19:29:172
259940,0migration/214874-21fschecks_count20:49:112
259940,0migration/21209-21kthreadcore18:29:192
249940,0watchdog/229899-21hddtemp_smartct20:39:132
249940,0watchdog/216222-21kthreadcore22:39:162
249940,0watchdog/212289-21cut18:59:172
249940,0watchdog/20-21swapper/218:39:172
179940,0migration/19935-21kthreadcore22:54:151
179940,0migration/15049-21fschecks_time19:19:141
179940,0migration/131526-21aten_r1power_en23:29:081
179940,0migration/128268-21gltestperf21:34:111
179940,0migration/127415-21taskset22:48:441
179940,0migration/125830-21kthreadcore21:49:151
179940,0migration/122194-21aten_r1power_po19:09:091
179940,0migration/122176-21kthreadcore21:09:161
179940,0migration/120632-21kthreadcore19:04:171
179940,0migration/116514-21irqrtprio19:49:171
179940,0migration/112891-21kthreadcore21:04:151
179940,0migration/110648-21cpuspeed_turbos22:39:101
169940,0watchdog/18173-21ssh22:19:041
169940,0watchdog/132692-21fschecks_time22:14:161
169940,0watchdog/129586-21ssh23:08:281
169940,0watchdog/120183-21kthreadcore19:29:171
169940,0watchdog/119176-21sed20:14:131
169940,0watchdog/115216-21ssh23:37:081
169940,0watchdog/10-21swapper/123:16:121
169940,0watchdog/10-21swapper/121:55:041
169940,0watchdog/10-21swapper/121:23:571
169940,0watchdog/10-21swapper/120:54:171
169940,0watchdog/10-21swapper/120:29:091
169940,0watchdog/10-21swapper/120:29:091
169940,0watchdog/10-21swapper/118:49:251
169940,0watchdog/10-21swapper/118:44:171
145789943,0cyclictest3599-21lldpd19:25:192
145789943,0cyclictest3599-21lldpd18:36:182
145789943,0cyclictest3599-21lldpd18:26:182
145789943,0cyclictest30436-21awk19:14:142
145789943,0cyclictest23433-21awk19:54:142
145779944,0cyclictest0-21swapper/120:49:461
145779943,0cyclictest5481-21awk20:04:161
145779943,0cyclictest3599-21lldpd19:34:191
145779943,0cyclictest3403-21sed19:14:231
145779943,0cyclictest3369-21awk20:24:131
145779943,0cyclictest25630-21awk23:44:131
145779943,0cyclictest23871-21snmpd21:39:151
145779943,0cyclictest23871-21snmpd20:13:291
145779943,0cyclictest23871-21snmpd19:55:441
145779943,0cyclictest23871-21snmpd19:42:141
145779943,0cyclictest23871-21snmpd18:24:591
145779943,0cyclictest21134-21awk20:34:121
145779943,0cyclictest0-21swapper/122:05:551
145769944,0cyclictest0-21swapper/020:58:260
145769944,0cyclictest0-21swapper/019:09:100
145769943,0cyclictest3599-21lldpd18:44:180
145769943,0cyclictest32641-21awk23:29:130
145769943,0cyclictest29883-21kworker/0:118:20:030
145769943,0cyclictest26717-21awk18:49:130
145769943,0cyclictest26559-21awk22:29:120
145769943,0cyclictest23871-21snmpd21:54:150
145769943,0cyclictest1718-21awk19:39:120
145769943,0cyclictest15958-21awk19:04:140
149940,0migration/06704-21kthreadcore20:24:150
149940,0migration/05408-21kthreadcore21:39:150
149940,0migration/032442-21sh23:48:500
149940,0migration/012284-21sh20:44:310
29925030,0irq/32-eth0-rx-0-21swapper/320:04:103
29925030,0irq/32-eth0-rx-0-21swapper/319:40:443
29925030,0irq/32-eth0-rx-0-21swapper/319:38:563
259930,0migration/29661-21kthreadcore20:04:182
259930,0migration/2630-21aten_r1power_en19:39:082
249930,0watchdog/20-21swapper/220:14:132
249930,0watchdog/20-21swapper/219:44:172
179930,0migration/19944-21kthreadcore18:59:161
169930,0watchdog/125731-21diskmemload20:44:091
169930,0watchdog/10-21swapper/122:34:081
169930,0watchdog/10-21swapper/122:24:201
169930,0watchdog/10-21swapper/121:19:051
169930,0watchdog/10-21swapper/120:19:171
169930,0watchdog/10-21swapper/118:39:171
145789933,0cyclictest16046-21awk19:04:142
145789932,0cyclictest3599-21lldpd18:55:492
145789932,0cyclictest15246-21basename19:49:132
145779932,0cyclictest3262-21irqbalance18:19:011
145769933,0cyclictest32047-21kworker/0:023:03:580
145769933,0cyclictest32047-21kworker/0:022:14:010
145769933,0cyclictest32047-21kworker/0:022:09:190
145769933,0cyclictest32047-21kworker/0:022:03:590
145769933,0cyclictest32047-21kworker/0:021:08:590
145769933,0cyclictest32047-21kworker/0:019:58:590
145769933,0cyclictest29883-21kworker/0:118:38:570
145769933,0cyclictest29883-21kworker/0:118:28:570
145769933,0cyclictest10402-21kworker/0:119:24:030
145769932,0cyclictest13012-21grep21:44:100
145769931,0cyclictest3220-13audispd23:08:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional