You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 02:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Dec 09, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
228623929,0sleep30-21swapper/318:17:063
213123727,0sleep20-21swapper/218:15:172
213523525,0sleep10-21swapper/118:15:201
239723228,0sleep00-21swapper/018:18:230
329970,0watchdog/32559-40yum-updatesd-he19:03:093
29925070,0irq/32-eth0-rx-13109-21irqstats20:54:113
29925070,0irq/32-eth0-rx-0-21swapper/322:04:153
29925070,0irq/32-eth0-rx-0-21swapper/321:33:473
29925070,0irq/32-eth0-rx-0-21swapper/320:49:103
339960,0migration/328938-21munin-node22:34:133
339960,0migration/325478-21sh21:55:013
339960,0migration/320560-21timerandwakeup20:19:223
329960,0watchdog/36511-21chrt20:12:413
329960,0watchdog/331718-21python22:54:173
329960,0watchdog/314031-21sh22:28:453
329960,0watchdog/30-21swapper/320:41:253
329960,0watchdog/30-21swapper/318:53:453
29935060,0irq/33-eth0-tx-0-21swapper/019:38:190
29935060,0irq/33-eth0-tx-0-21swapper/019:29:140
29925060,0irq/32-eth0-rx-5222-21python21:24:173
29925060,0irq/32-eth0-rx-4331-21df23:19:073
29925060,0irq/32-eth0-rx-23405-21perl21:19:083
29925060,0irq/32-eth0-rx-11072-21iostat21:49:103
29925060,0irq/32-eth0-rx-0-21swapper/323:34:083
29925060,0irq/32-eth0-rx-0-21swapper/323:28:573
29925060,0irq/32-eth0-rx-0-21swapper/323:13:033
29925060,0irq/32-eth0-rx-0-21swapper/323:04:103
29925060,0irq/32-eth0-rx-0-21swapper/323:01:563
29925060,0irq/32-eth0-rx-0-21swapper/322:50:383
29925060,0irq/32-eth0-rx-0-21swapper/322:46:133
29925060,0irq/32-eth0-rx-0-21swapper/322:40:193
29925060,0irq/32-eth0-rx-0-21swapper/321:43:033
29925060,0irq/32-eth0-rx-0-21swapper/321:14:483
29925060,0irq/32-eth0-rx-0-21swapper/321:11:373
29925060,0irq/32-eth0-rx-0-21swapper/320:47:323
29925060,0irq/32-eth0-rx-0-21swapper/320:38:513
29925060,0irq/32-eth0-rx-0-21swapper/319:34:063
25059966,0cyclictest26890-21kworker/0:120:54:110
25059960,0cyclictest0-21swapper/019:14:120
149960,0migration/02685-21sh23:16:150
149960,0migration/02685-21sh23:16:150
4150,0ktimersoftd/031216-21munin-node21:24:140
339950,0migration/36419-21latency_hist18:43:523
339950,0migration/329522-21munin-node20:24:203
339950,0migration/327219-21sshd22:14:193
339950,0migration/32558-21kthreadcore18:39:123
339950,0migration/320882-21taskset23:28:403
339950,0migration/316236-21proc_pri19:09:163
339950,0migration/312571-21kthreadcore19:54:123
339950,0migration/310989-21kthreadcore23:39:123
339950,0migration/310905-21kthreadcore19:29:113
329950,0watchdog/34086-21cat21:44:133
329950,0watchdog/322291-21cut19:14:133
329950,0watchdog/30-21swapper/323:14:133
329950,0watchdog/30-21swapper/323:14:133
329950,0watchdog/30-21swapper/321:59:093
329950,0watchdog/30-21swapper/319:39:093
29935050,0irq/33-eth0-tx-8521-21hddtemp_smartct21:29:072
29935050,0irq/33-eth0-tx-5999-21awk22:39:192
29935050,0irq/33-eth0-tx-21415-21telnet23:29:062
29935050,0irq/33-eth0-tx-17865-21ssh23:06:292
29935050,0irq/33-eth0-tx-1620-21munin-node22:59:212
29935050,0irq/33-eth0-tx-11444-21ssh23:21:202
29935050,0irq/33-eth0-tx-0-21swapper/220:28:082
29925050,0irq/32-eth0-rx-4260-21ssh22:20:393
29925050,0irq/32-eth0-rx-2110-21cat20:29:133
29925050,0irq/32-eth0-rx-0-21swapper/323:44:063
29925050,0irq/32-eth0-rx-0-21swapper/322:29:053
29925050,0irq/32-eth0-rx-0-21swapper/322:11:233
29925050,0irq/32-eth0-rx-0-21swapper/321:34:123
29925050,0irq/32-eth0-rx-0-21swapper/321:04:363
29925050,0irq/32-eth0-rx-0-21swapper/321:00:113
29925050,0irq/32-eth0-rx-0-21swapper/320:08:263
29925050,0irq/32-eth0-rx-0-21swapper/319:59:063
29925050,0irq/32-eth0-rx-0-21swapper/319:44:123
29925050,0irq/32-eth0-rx-0-21swapper/319:19:063
25079955,0cyclictest0-21swapper/222:05:242
25079955,0cyclictest0-21swapper/221:41:352
25079955,0cyclictest0-21swapper/220:30:102
25079950,0cyclictest0-21swapper/222:36:552
25079950,0cyclictest0-21swapper/220:55:332
25079950,0cyclictest0-21swapper/220:20:242
25059955,0cyclictest26890-21kworker/0:120:49:350
25059955,0cyclictest26890-21kworker/0:120:44:110
25059955,0cyclictest26890-21kworker/0:120:39:190
25059955,0cyclictest26890-21kworker/0:120:38:050
25059955,0cyclictest26890-21kworker/0:120:26:070
25059955,0cyclictest26890-21kworker/0:120:19:390
25059955,0cyclictest26890-21kworker/0:120:14:050
25059955,0cyclictest26890-21kworker/0:119:26:490
25059955,0cyclictest26890-21kworker/0:119:03:110
25059955,0cyclictest26890-21kworker/0:118:26:140
25059955,0cyclictest26547-21kworker/0:022:43:590
25059955,0cyclictest26547-21kworker/0:022:39:190
25059955,0cyclictest26547-21kworker/0:022:36:410
25059955,0cyclictest26547-21kworker/0:022:29:050
25059955,0cyclictest26547-21kworker/0:022:25:010
25059955,0cyclictest26547-21kworker/0:022:04:290
25059955,0cyclictest26547-21kworker/0:022:01:510
25059955,0cyclictest26547-21kworker/0:021:49:110
25059955,0cyclictest26547-21kworker/0:021:39:170
25059955,0cyclictest26547-21kworker/0:021:37:170
25059955,0cyclictest26547-21kworker/0:021:30:290
25059955,0cyclictest26547-21kworker/0:021:13:110
25059955,0cyclictest25044-21kworker/0:223:04:150
25059955,0cyclictest25044-21kworker/0:222:59:430
25059955,0cyclictest25044-21kworker/0:222:58:050
25059955,0cyclictest16744-21kworker/0:023:43:530
25059955,0cyclictest16744-21kworker/0:023:33:550
25059955,0cyclictest16744-21kworker/0:023:30:050
25059955,0cyclictest16744-21kworker/0:023:27:210
25059955,0cyclictest16744-21kworker/0:023:21:210
25059955,0cyclictest0-21swapper/022:52:140
25059954,0cyclictest17982-21fschecks_time18:29:070
25059952,0cyclictest31519-21munin-run19:23:520
25059950,0cyclictest0-21swapper/022:15:300
25059950,0cyclictest0-21swapper/022:09:120
259950,0migration/23474-21switchtime22:19:192
259950,0migration/224845-21sh20:41:252
259950,0migration/224533-21missed_timers21:54:132
259950,0migration/215650-21kthreadcore23:24:122
249950,0watchdog/229296-21if_err_eth1.319:44:092
19150,0ktimersoftd/10-21swapper/119:45:221
179950,0migration/1718-21kthreadcore23:14:131
179950,0migration/1718-21kthreadcore23:14:131
179950,0migration/13487-21kthreadcore22:39:111
179950,0migration/131597-21kthreadcore23:34:121
179950,0migration/130895-21sh20:27:361
179950,0migration/130338-21taskset22:36:041
179950,0migration/12645-21munin-node20:49:051
179950,0migration/117068-21kthreadcore18:49:121
179950,0migration/116540-21sh19:54:171
179950,0migration/110333-21munin-node23:19:161
179950,0migration/110048-21kthreadcore19:29:101
169950,0watchdog/16386-21runrttasks22:55:491
169950,0watchdog/130523-21ssh21:22:491
169950,0watchdog/129806-21cut21:59:131
169950,0watchdog/127123-21python22:14:171
169950,0watchdog/124039-21ssh20:39:211
169950,0watchdog/10-21swapper/122:11:491
169950,0watchdog/10-21swapper/120:58:571
169950,0watchdog/10-21swapper/120:54:131
169950,0watchdog/10-21swapper/119:02:171
149950,0migration/09633-21taskset18:22:090
149950,0migration/07692-21kthreadcore23:39:110
149950,0migration/06381-21taskset20:11:080
149950,0migration/0424-21kthreadcore22:19:110
149950,0migration/04120-21kthreadcore20:29:130
149950,0migration/04108-21idleruntime19:49:080
149950,0migration/03705-21kthreadcore21:44:130
149950,0migration/029083-21cpuspeed_turbos21:04:050
149950,0migration/027770-21sh21:01:420
149950,0migration/025756-21kthreadcore21:19:120
149950,0migration/025549-21kthreadcore18:54:110
149950,0migration/025076-21timerwakeupswit21:54:190
149950,0migration/02063-21kthreadcore18:39:120
149950,0migration/018973-21sh23:08:560
149950,0migration/018467-21gltestperf19:59:070
149950,0migration/016110-21kthreadcore21:14:100
149950,0migration/013744-21aten_r1power_en18:49:050
8315040,0irq/26-0000:00:13817-21diskmemload20:44:002
339940,0migration/39634-21taskset19:05:383
339940,0migration/35671-21kthreadcore19:49:113
339940,0migration/33209-21fschecks_count18:19:103
339940,0migration/323416-21sendmail_mailtr18:29:153
339940,0migration/321833-21gltestperf18:54:073
329940,0watchdog/324809-21df_abs18:34:053
329940,0watchdog/310918-21fschecks_time18:24:093
29935040,0irq/33-eth0-tx-22218-21ssh22:32:342
29935040,0irq/33-eth0-tx-13817-21diskmemload21:34:592
29935040,0irq/33-eth0-tx-13817-21diskmemload21:08:592
29935040,0irq/33-eth0-tx-0-21swapper/223:13:562
29935040,0irq/33-eth0-tx-0-21swapper/223:13:562
29935040,0irq/33-eth0-tx-0-21swapper/222:54:042
29935040,0irq/33-eth0-tx-0-21swapper/222:49:512
29935040,0irq/33-eth0-tx-0-21swapper/222:43:532
29935040,0irq/33-eth0-tx-0-21swapper/222:23:562
29935040,0irq/33-eth0-tx-0-21swapper/222:08:582
29935040,0irq/33-eth0-tx-0-21swapper/221:48:532
29935040,0irq/33-eth0-tx-0-21swapper/221:24:102
29935040,0irq/33-eth0-tx-0-21swapper/221:19:272
29935040,0irq/33-eth0-tx-0-21swapper/221:13:552
29935040,0irq/33-eth0-tx-0-21swapper/221:04:122
29935040,0irq/33-eth0-tx-0-21swapper/220:58:572
29935040,0irq/33-eth0-tx-0-21swapper/019:09:060
25079944,0cyclictest0-21swapper/220:49:052
25079943,0cyclictest6983-21awk23:39:092
25079943,0cyclictest3599-21lldpd23:08:592
25079943,0cyclictest3599-21lldpd19:01:162
25079943,0cyclictest3599-21lldpd18:48:152
25079943,0cyclictest3262-21irqbalance20:08:572
25079943,0cyclictest3262-21irqbalance20:03:572
25079943,0cyclictest3262-21irqbalance19:40:072
25079943,0cyclictest3262-21irqbalance19:29:272
25079943,0cyclictest3262-21irqbalance19:24:272
25079943,0cyclictest25730-21awk19:19:102
25079943,0cyclictest25475-21awk18:34:082
25079943,0cyclictest23871-21snmpd20:14:082
25079943,0cyclictest23871-21snmpd19:48:532
25079943,0cyclictest2216-21awk21:44:112
25079943,0cyclictest15496-21awk23:44:092
25079940,0cyclictest0-21swapper/220:33:572
25069943,0cyclictest8053-21awk20:14:101
25069943,0cyclictest527-21awk20:09:101
25069943,0cyclictest4555-21awk22:04:111
25069943,0cyclictest3599-21lldpd23:03:591
25069943,0cyclictest3599-21lldpd20:06:151
25069943,0cyclictest3599-21lldpd19:40:151
25069943,0cyclictest3599-21lldpd19:09:151
25069943,0cyclictest3599-21lldpd18:45:151
25069943,0cyclictest3599-21lldpd18:36:151
25069943,0cyclictest3599-21lldpd18:24:451
25069943,0cyclictest25682-21awk19:19:101
25069943,0cyclictest23871-21snmpd21:40:541
25069943,0cyclictest23871-21snmpd21:28:541
25069943,0cyclictest23871-21snmpd20:37:081
25069943,0cyclictest18376-21awk18:29:091
25069940,0cyclictest0-21swapper/121:17:011
25059944,0cyclictest26890-21kworker/0:120:04:130
25059944,0cyclictest26890-21kworker/0:119:54:150
25059944,0cyclictest26890-21kworker/0:119:44:150
25059944,0cyclictest26890-21kworker/0:118:44:120
25059943,0cyclictest4058-21awk19:04:090
25059940,0cyclictest21027-21munin-node19:39:100
259940,0migration/229632-21latency_hist23:33:522
259940,0migration/225698-21kthreadcore22:14:122
259940,0migration/222564-21kthreadcore18:54:102
259940,0migration/217983-21kthreadcore19:34:132
259940,0migration/215358-21kthreadcore19:54:132
259940,0migration/212383-21kthreadcore19:09:122
259940,0migration/210702-21fschecks_time18:24:092
249940,0watchdog/227740-21fschecks_count21:59:092
249940,0watchdog/218654-21if_eth119:59:092
249940,0watchdog/20-21swapper/218:39:092
179940,0migration/1991-21kthreadcore20:29:121
179940,0migration/15258-21kthreadcore19:49:101
179940,0migration/13347-21kthreadcore19:24:111
179940,0migration/129953-21kthreadcore20:44:131
179940,0migration/12927-21irqcore22:59:111
179940,0migration/128803-21ksmtuned21:03:551
179940,0migration/126127-21kthreadcore18:54:111
179940,0migration/122435-21kthreadcore22:49:121
179940,0migration/122400-21munin-node21:34:151
179940,0migration/121136-21latency_hist23:28:521
179940,0migration/11734-21kthreadcore22:19:121
179940,0migration/115914-21irqrtprio22:29:101
179940,0migration/115197-21fschecks_time23:44:071
169940,0watchdog/19167-21ssh22:44:091
169940,0watchdog/13176-21diskstats18:19:091
169940,0watchdog/131173-21ssh21:23:571
169940,0watchdog/126494-21ssh23:11:251
169940,0watchdog/124511-21missed_timers21:54:131
169940,0watchdog/116660-21kthreadcore23:24:131
169940,0watchdog/115951-21grep20:19:131
169940,0watchdog/10-21swapper/122:23:531
169940,0watchdog/10-21swapper/121:44:171
169940,0watchdog/10-21swapper/121:09:091
149940,0migration/028740-21kthreadcore18:34:110
329930,0watchdog/30-21swapper/319:24:093
27130,0ktimersoftd/20-21swapper/219:06:002
25079932,0cyclictest23871-21snmpd18:18:532
25079932,0cyclictest18968-21cut19:14:122
25079930,0cyclictest18059-21perl18:29:072
25069932,0cyclictest2881-21munin-node19:04:071
25069932,0cyclictest23871-21snmpd23:38:561
25069932,0cyclictest15821-21cut19:34:121
25069932,0cyclictest11025-21awk21:49:091
259930,0migration/218676-21kthreadcore18:49:122
169930,0watchdog/10-21swapper/119:59:091
169930,0watchdog/10-21swapper/119:13:531
169930,0watchdog/10-21swapper/118:39:091
329920,0watchdog/30-21swapper/320:13:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional