You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 05:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Apr 13, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2253323625,0sleep10-21swapper/119:18:211
2258523526,0sleep20-21swapper/219:18:542
2250723228,0sleep00-21swapper/019:18:000
2267123127,0sleep30-21swapper/319:19:553
22753991010,0cyclictest0-21swapper/021:21:100
339970,0migration/314549-21sh00:30:483
339960,0migration/32508-21irqrtprio23:30:213
339960,0migration/324148-21sh22:09:443
339960,0migration/319972-21sh22:44:363
339960,0migration/319348-21munin-node22:25:203
339960,0migration/31269-21sh22:31:023
329960,0watchdog/323692-21cut21:30:233
29815060,0irq/29-eth0-tx-27143-21munin-node21:15:270
29815060,0irq/29-eth0-tx-26684-21munin-node19:45:230
29805060,0irq/28-eth0-rx-28729-21munin-node21:35:173
29805060,0irq/28-eth0-rx-21666-21irqcore22:45:203
29805060,0irq/28-eth0-rx-14675-21hwlatdetect21:45:193
29805060,0irq/28-eth0-rx-13682-21cut21:25:233
227559965,0cyclictest3188-21ps21:20:202
227559960,0cyclictest5507-21munin-node21:00:282
227539966,0cyclictest8664-21ps22:18:250
227539966,0cyclictest8664-21ps22:18:250
149960,0migration/026378-21sh21:30:510
149960,0migration/018964-21fschecks_time22:25:170
149960,0migration/016904-21sh23:36:370
149960,0migration/013964-21smart_sdb23:15:290
8305050,0irq/26-0000:00:3223-13audispd00:40:042
4150,0ktimersoftd/00-21swapper/000:15:330
339950,0migration/39385-21latency_hist22:20:043
339950,0migration/39385-21latency_hist22:20:043
339950,0migration/39118-21kthreadcore21:40:223
339950,0migration/33380-21kthreadcore20:35:213
339950,0migration/332630-21needreboot19:45:223
339950,0migration/331391-21kthreadcore23:45:233
339950,0migration/331000-21fschecks_time19:25:183
339950,0migration/329149-21munin-node19:20:263
339950,0migration/324888-21latency_hist00:40:043
339950,0migration/323035-21kthreadcore20:25:213
339950,0migration/321654-21kthreadcore19:40:203
339950,0migration/320902-21cpuspeed_turbos00:00:183
339950,0migration/319569-21kthreadcore20:00:233
339950,0migration/317430-21irqcore20:45:213
339950,0migration/316321-21kthreadcore23:55:223
339950,0migration/316123-21latency_hist23:20:043
339950,0migration/31528-21aten_r1power_cu19:50:143
339950,0migration/314147-21sh22:00:573
339950,0migration/313609-21taskset22:59:433
339950,0migration/311607-21kthreadcore19:55:233
329950,0watchdog/36216-21if_eth1.319:30:183
329950,0watchdog/35928-21diskstats21:00:193
329950,0watchdog/34300-21python20:10:273
329950,0watchdog/326129-21sh23:43:193
329950,0watchdog/324558-21aten_r1power_cu22:10:153
329950,0watchdog/323036-21awk00:35:323
329950,0watchdog/312329-21kthreadcore23:15:233
29815050,0irq/29-eth0-tx-31307-21munin-node23:10:302
29815050,0irq/29-eth0-tx-3049-21munin-node22:35:172
29815050,0irq/29-eth0-tx-28224-21ssh00:03:112
29815050,0irq/29-eth0-tx-0-21swapper/223:15:092
29815050,0irq/29-eth0-tx-0-21swapper/222:23:002
29815050,0irq/29-eth0-tx-0-21swapper/200:34:102
29815050,0irq/29-eth0-tx-0-21swapper/021:10:220
29815050,0irq/29-eth0-tx-0-21swapper/020:45:170
29815050,0irq/29-eth0-tx-0-21swapper/020:24:200
29805050,0irq/28-eth0-rx-9543-21ssh22:20:153
29805050,0irq/28-eth0-rx-5639-21ssh00:10:173
29805050,0irq/28-eth0-rx-31986-21kthreadcore22:50:233
29805050,0irq/28-eth0-rx-31818-21iostat20:55:203
29805050,0irq/28-eth0-rx-28823-21kthreadcore20:05:223
29805050,0irq/28-eth0-rx-23659-21perl00:20:183
29805050,0irq/28-eth0-rx-21584-21sshd00:17:373
29805050,0irq/28-eth0-rx-11079-21irqcore23:35:203
29805050,0irq/28-eth0-rx-0-21swapper/323:50:133
29805050,0irq/28-eth0-rx-0-21swapper/323:05:213
29805050,0irq/28-eth0-rx-0-21swapper/323:03:073
29805050,0irq/28-eth0-rx-0-21swapper/320:20:213
259950,0migration/227395-21sh22:46:102
259950,0migration/226187-21kthreadcore00:20:222
259950,0migration/225974-21hddtemp_smartct00:40:202
259950,0migration/21819-21munin-node21:35:232
249950,0watchdog/219899-21kthreadcore20:00:232
227559955,0cyclictest0-21swapper/219:55:312
227559954,0cyclictest31993-21cut23:45:232
227559950,0cyclictest0-21swapper/223:58:182
227559950,0cyclictest0-21swapper/222:18:402
227559950,0cyclictest0-21swapper/222:18:402
227549954,0cyclictest20437-21hwlatdetect19:40:181
227549950,0cyclictest0-21swapper/123:14:051
227549950,0cyclictest0-21swapper/122:08:011
227539955,0cyclictest0-21swapper/020:55:290
179950,0migration/14028-21kthreadcore21:55:231
179950,0migration/13014-21processes22:50:271
179950,0migration/120314-21latency_hist00:00:041
179950,0migration/115957-21kthreadcore19:35:201
179950,0migration/111713-21timerwakeupswit20:15:281
169950,0watchdog/16457-21ssh00:45:241
169950,0watchdog/127702-21kthreadcore19:20:221
169950,0watchdog/12118-21if_err_eth023:30:191
169950,0watchdog/119595-21cut00:35:241
169950,0watchdog/115668-21grep23:00:231
169950,0watchdog/112328-21cut23:15:231
169950,0watchdog/110953-21cut20:40:231
149950,0migration/09952-21kthreadcore22:00:230
149950,0migration/09144-21kthreadcore21:40:220
149950,0migration/08305-21sh00:46:230
149950,0migration/05546-21taskset21:55:580
149950,0migration/04735-21kthreadcore23:30:220
149950,0migration/032084-21kthreadcore19:25:210
149950,0migration/031775-21kthreadcore21:35:220
149950,0migration/029983-21taskset20:07:530
149950,0migration/029705-21kthreadcore22:30:230
149950,0migration/028283-21irqcore23:45:210
149950,0migration/028189-21kthreadcore23:05:220
149950,0migration/028083-21kthreadcore22:10:220
149950,0migration/027432-21sh22:46:160
149950,0migration/025190-21kthreadcore20:25:220
149950,0migration/024730-21latency_hist23:25:040
149950,0migration/023928-21fschecks_count20:50:170
149950,0migration/021943-21taskset20:00:250
149950,0migration/021832-21kthreadcore23:20:230
149950,0migration/019227-21kthreadcore22:05:220
149950,0migration/018916-21taskset19:36:300
149950,0migration/018791-21kthreadcore00:35:230
149950,0migration/016411-21kthreadcore21:45:220
149950,0migration/016294-21kthreadcore21:25:230
149950,0migration/01627-21kthreadcore22:50:240
149950,0migration/014681-21kthreadcore22:40:220
149950,0migration/014232-21timerandwakeup00:30:320
149950,0migration/013300-21fschecks_count21:05:170
149950,0migration/011431-21kthreadcore19:55:230
8305040,0irq/26-0000:00:18347-21cut23:40:042
339940,0migration/39569-21switchtime22:35:293
339940,0migration/34789-21kthreadcore21:20:213
339940,0migration/33594-21runrttasks00:05:353
339940,0migration/33161-21kthreadcore00:25:223
329940,0watchdog/30-21swapper/300:45:243
29815040,0irq/29-eth0-tx-7938-21grep00:45:312
29815040,0irq/29-eth0-tx-5386-21munin-node22:55:312
29815040,0irq/29-eth0-tx-5147-21netstat00:25:232
29815040,0irq/29-eth0-tx-29572-21ssh23:06:022
29815040,0irq/29-eth0-tx-24555-21munin-node22:10:242
29815040,0irq/29-eth0-tx-0-21swapper/223:50:312
29815040,0irq/29-eth0-tx-0-21swapper/223:25:252
29815040,0irq/29-eth0-tx-0-21swapper/223:20:082
29815040,0irq/29-eth0-tx-0-21swapper/223:00:092
29815040,0irq/29-eth0-tx-0-21swapper/222:50:062
29815040,0irq/29-eth0-tx-0-21swapper/222:05:242
29815040,0irq/29-eth0-tx-0-21swapper/222:00:112
29815040,0irq/29-eth0-tx-0-21swapper/221:55:202
29815040,0irq/29-eth0-tx-0-21swapper/221:50:122
29815040,0irq/29-eth0-tx-0-21swapper/221:25:072
29815040,0irq/29-eth0-tx-0-21swapper/200:16:052
29815040,0irq/29-eth0-tx-0-21swapper/200:05:242
29815040,0irq/29-eth0-tx-0-21swapper/020:35:170
29815040,0irq/29-eth0-tx-0-21swapper/019:53:350
29805040,0irq/28-eth0-rx-6853-21irqstats20:15:203
29805040,0irq/28-eth0-rx-26502-21kthreadcore23:25:243
29805040,0irq/28-eth0-rx-0-21swapper/323:11:263
29805040,0irq/28-eth0-rx-0-21swapper/321:55:053
29805040,0irq/28-eth0-rx-0-21swapper/321:50:483
259940,0migration/231527-21kthreadcore22:30:232
259940,0migration/224001-21fschecks_time20:05:172
259940,0migration/213491-21fschecks_time21:05:182
259940,0migration/210951-21taskset23:35:192
259940,0migration/210060-21kthreadcore00:10:232
249940,0watchdog/227703-21kthreadcore19:20:222
249940,0watchdog/226803-21cut19:45:152
249940,0watchdog/214673-21sh21:45:192
249940,0watchdog/20-21swapper/222:26:472
249940,0watchdog/20-21swapper/220:40:232
227559943,0cyclictest5962-21awk21:40:202
227559943,0cyclictest3524-21snmpd20:51:592
227559943,0cyclictest3524-21snmpd20:27:282
227559943,0cyclictest3524-21snmpd20:21:432
227559943,0cyclictest3250-21irqbalance21:30:102
227559943,0cyclictest3250-21irqbalance20:45:202
227559943,0cyclictest3250-21irqbalance19:30:302
227559943,0cyclictest3250-21irqbalance19:26:102
227559943,0cyclictest31675-21awk20:55:192
227559943,0cyclictest28271-21awk21:15:202
227559943,0cyclictest2151-21awk23:30:202
227559943,0cyclictest12871-21awk22:40:202
227549944,0cyclictest0-21swapper/122:47:261
227549944,0cyclictest0-21swapper/120:25:231
227549944,0cyclictest0-21swapper/100:10:411
227549943,0cyclictest6145-21awk19:30:181
227549943,0cyclictest6002-21awk21:40:201
227549943,0cyclictest3571-21lldpd23:42:071
227549943,0cyclictest3571-21lldpd22:59:071
227549943,0cyclictest3571-21lldpd21:54:061
227549943,0cyclictest3571-21lldpd21:30:361
227549943,0cyclictest3571-21lldpd20:10:051
227549943,0cyclictest3250-21irqbalance22:44:011
227549943,0cyclictest3250-21irqbalance21:21:201
227549943,0cyclictest3250-21irqbalance20:36:101
227549943,0cyclictest3250-21irqbalance20:05:101
227549943,0cyclictest3250-21irqbalance20:01:201
227549943,0cyclictest3250-21irqbalance19:55:201
227549943,0cyclictest3250-21irqbalance19:52:201
227549943,0cyclictest3250-21irqbalance00:07:211
227549943,0cyclictest27984-21awk20:30:201
227549943,0cyclictest23785-21awk23:05:191
227549943,0cyclictest13567-21awk20:20:191
227539944,0cyclictest19022-21kworker/0:100:20:220
227539943,0cyclictest7463-21sadc00:30:040
227539943,0cyclictest3571-21lldpd23:40:070
227539943,0cyclictest3524-21snmpd23:57:310
227539943,0cyclictest3524-21snmpd23:13:300
227539943,0cyclictest31445-21awk20:10:190
227539943,0cyclictest24141-21awk19:20:200
227539943,0cyclictest15269-21tr23:00:230
227539940,0cyclictest0-21swapper/020:16:420
179940,0migration/17174-21latency_hist22:00:041
179940,0migration/15888-21taskset00:25:471
179940,0migration/14493-21kthreadcore22:15:221
179940,0migration/14493-21kthreadcore22:15:221
179940,0migration/1438-21latency23:45:231
179940,0migration/132730-21kthreadcore21:15:231
179940,0migration/132595-21kthreadcore20:55:211
179940,0migration/130832-21fschecks_time19:25:181
179940,0migration/127762-21kthreadcore23:25:251
179940,0migration/127191-21kthreadcore00:40:241
179940,0migration/12650-21sh21:35:331
179940,0migration/122335-21kthreadcore21:10:211
179940,0migration/117545-21kthreadcore00:15:221
179940,0migration/117069-21kthreadcore21:05:221
179940,0migration/112197-21taskset21:01:421
169940,0watchdog/19567-21aten_r1power_cu22:20:151
169940,0watchdog/19105-21memory22:35:231
169940,0watchdog/124557-21aten_r1power_cu22:10:151
169940,0watchdog/124530-21if_eth020:50:191
169940,0watchdog/117587-21ssh21:26:031
169940,0watchdog/117005-21ssh23:36:551
169940,0watchdog/114220-21ssh00:30:321
169940,0watchdog/10-21swapper/123:50:231
169940,0watchdog/10-21swapper/123:23:591
169940,0watchdog/10-21swapper/120:45:231
169940,0watchdog/10-21swapper/100:20:201
169940,0watchdog/10-21swapper/100:00:231
149940,0migration/025678-21kthreadcore21:50:210
329930,0watchdog/30-21swapper/320:50:433
329930,0watchdog/30-21swapper/319:35:153
29815030,0irq/29-eth0-tx-5153-21aten2.4-expect19:30:140
29805030,0irq/28-eth0-rx-0-21swapper/321:15:153
29805030,0irq/28-eth0-rx-0-21swapper/321:10:163
29805030,0irq/28-eth0-rx-0-21swapper/321:05:153
29805030,0irq/28-eth0-rx-0-21swapper/320:40:173
29805030,0irq/28-eth0-rx-0-21swapper/320:30:273
259930,0migration/230819-21df_abs20:10:172
249930,0watchdog/20-21swapper/219:35:152
227559932,0cyclictest3524-21snmpd21:14:142
227559932,0cyclictest28058-21awk20:30:202
227559932,0cyclictest2757-21awk20:35:192
227559932,0cyclictest2598-21awk19:50:182
227559932,0cyclictest20633-21awk19:40:192
227559930,0cyclictest7182-21grep20:15:202
227549932,0cyclictest3571-21lldpd22:25:371
227549932,0cyclictest27538-21tune2fs22:30:191
227539933,0cyclictest7099-21sort21:00:230
227539933,0cyclictest3571-21lldpd23:50:070
227539933,0cyclictest0-21swapper/020:32:280
227539932,0cyclictest3341-21cpuspeed_turbos22:35:160
227539932,0cyclictest30334-21awk00:05:200
227539932,0cyclictest10616-21awk22:20:190
227539932,0cyclictest10088-21awk20:40:210
227539932,0cyclictest0-21swapper/019:43:040
227539930,0cyclictest10183-21grep00:10:230
169930,0watchdog/10-21swapper/121:45:231
169930,0watchdog/10-21swapper/119:45:151
149930,0migration/031871-21sh00:40:570
149930,0migration/012515-21sh22:56:380
227539921,0cyclictest20446-21sed00:00:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional