You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 02:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Jan 07, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
723524132,0sleep10-21swapper/119:09:051
728624028,0sleep30-21swapper/319:09:353
710723627,0sleep20-21swapper/219:07:382
712723127,0sleep00-21swapper/019:07:520
29805070,0irq/28-eth0-rx-25678-21if_err_eth023:57:233
75729960,0cyclictest0-21swapper/223:52:192
75709966,0cyclictest19105-21diskmemload00:16:210
75709960,0cyclictest0-21swapper/023:55:040
35160,0ktimersoftd/30-21swapper/321:43:513
339960,0migration/33605-21sh21:19:443
339960,0migration/326912-21sh00:15:053
339960,0migration/321700-21sh22:06:563
339960,0migration/310380-21aten_r1power_vo00:07:193
329960,0watchdog/38706-21sh21:40:373
29815060,0irq/29-eth0-tx-11758-21munin-node20:22:240
29815060,0irq/29-eth0-tx-0-21swapper/221:51:152
29805060,0irq/28-eth0-rx-26687-21iostat_ios22:27:243
29805060,0irq/28-eth0-rx-20937-21munin-node21:12:243
29805060,0irq/28-eth0-rx-13148-21sendmail_mailqu23:47:293
29805060,0irq/28-eth0-rx-0-21swapper/323:24:203
19160,0ktimersoftd/10-21swapper/123:17:471
149960,0migration/08280-21sh00:03:080
8305050,0irq/26-0000:00:29755-21sh20:57:062
8305050,0irq/26-0000:00:17538-21tr21:07:252
75729955,0cyclictest0-21swapper/223:43:202
75729950,0cyclictest0-21swapper/221:56:082
75729950,0cyclictest0-21swapper/221:44:282
75719955,0cyclictest0-21swapper/123:43:571
75719950,0cyclictest0-21swapper/121:31:501
75719950,0cyclictest0-21swapper/100:08:521
75709955,0cyclictest28513-21kworker/0:023:44:040
75709955,0cyclictest28513-21kworker/0:023:05:180
75709955,0cyclictest28513-21kworker/0:022:52:240
75709954,0cyclictest1695-21kworker/0:121:42:300
75709950,0cyclictest0-21swapper/022:37:390
75709950,0cyclictest0-21swapper/021:28:170
75709950,0cyclictest0-21swapper/021:20:140
35150,0ktimersoftd/30-21swapper/323:17:473
339950,0migration/3958-21cpuspeed_turbos19:52:183
339950,0migration/38025-21taskset20:41:423
339950,0migration/35867-21idleruntime21:02:223
339950,0migration/34201-21kthreadcore22:12:253
339950,0migration/331895-21munin-node00:37:213
339950,0migration/331565-21kthreadcore19:47:243
339950,0migration/330412-21cpuspeed_turbos23:42:203
339950,0migration/329058-21taskset19:26:093
339950,0migration/323114-21kthreadcore19:42:243
339950,0migration/318828-21taskset21:09:003
339950,0migration/317838-21kthreadcore20:02:243
339950,0migration/316591-21kthreadcore22:57:263
339950,0migration/315060-21munin-node19:17:173
339950,0migration/31460-21kthreadcore20:12:253
339950,0migration/313736-21kthreadcore23:12:253
339950,0migration/312650-21sh00:25:343
339950,0migration/310879-21kthreadcore19:12:253
329950,0watchdog/324174-21perl23:02:223
329950,0watchdog/323072-21munin-node22:07:223
329950,0watchdog/318124-21yum19:37:333
329950,0watchdog/311249-21ssh21:58:303
329950,0watchdog/30-21swapper/320:07:213
329950,0watchdog/30-21swapper/319:32:173
329950,0watchdog/30-21swapper/319:32:173
29815050,0irq/29-eth0-tx-7228-21ssh23:47:202
29815050,0irq/29-eth0-tx-1473-21df00:02:182
29815050,0irq/29-eth0-tx-12448-21ssh00:25:042
29815050,0irq/29-eth0-tx-0-21swapper/222:05:292
29815050,0irq/29-eth0-tx-0-21swapper/221:25:202
29815050,0irq/29-eth0-tx-0-21swapper/021:12:190
29815050,0irq/29-eth0-tx-0-21swapper/021:10:450
29815050,0irq/29-eth0-tx-0-21swapper/020:52:210
29815050,0irq/29-eth0-tx-0-21swapper/019:59:470
29805050,0irq/28-eth0-rx-8446-21ssh00:03:323
29805050,0irq/28-eth0-rx-28844-21cut21:32:253
29805050,0irq/28-eth0-rx-27572-21python23:37:303
29805050,0irq/28-eth0-rx-21498-21kthreadcore21:47:223
29805050,0irq/28-eth0-rx-19101-21kthreadcore23:52:233
29805050,0irq/28-eth0-rx-15290-21kthreadcore22:37:233
29805050,0irq/28-eth0-rx-0-21swapper/323:33:243
29805050,0irq/28-eth0-rx-0-21swapper/323:10:113
29805050,0irq/28-eth0-rx-0-21swapper/322:53:063
29805050,0irq/28-eth0-rx-0-21swapper/322:48:163
29805050,0irq/28-eth0-rx-0-21swapper/322:32:253
29805050,0irq/28-eth0-rx-0-21swapper/322:22:183
29805050,0irq/28-eth0-rx-0-21swapper/322:17:143
29805050,0irq/28-eth0-rx-0-21swapper/321:56:403
29805050,0irq/28-eth0-rx-0-21swapper/321:31:513
29805050,0irq/28-eth0-rx-0-21swapper/321:25:493
29805050,0irq/28-eth0-rx-0-21swapper/320:57:183
29805050,0irq/28-eth0-rx-0-21swapper/320:47:243
29805050,0irq/28-eth0-rx-0-21swapper/320:42:223
29805050,0irq/28-eth0-rx-0-21swapper/300:32:013
29805050,0irq/28-eth0-rx-0-21swapper/300:17:243
27150,0ktimersoftd/20-21swapper/223:17:472
249950,0watchdog/24558-21latency22:12:262
179950,0migration/19060-21sh00:05:011
179950,0migration/17155-21kthreadcore20:17:241
179950,0migration/15823-21fschecks_time21:22:211
179950,0migration/13202-21munin-node19:27:321
179950,0migration/13122-21sh00:19:161
179950,0migration/130811-21kthreadcore21:17:241
179950,0migration/128972-21sh23:40:031
179950,0migration/128241-21kthreadcore23:02:261
179950,0migration/128175-21ntp_offset22:07:271
179950,0migration/127611-21kthreadcore00:32:261
179950,0migration/127512-21taskset00:16:291
179950,0migration/120285-21kthreadcore21:47:221
179950,0migration/114805-21taskset19:59:341
169950,0watchdog/132425-21gltestperf00:37:221
169950,0watchdog/131857-21needreboot19:47:251
169950,0watchdog/119735-21hwlatdetect19:42:211
149950,0migration/07510-21timerwakeupswit20:37:320
149950,0migration/07006-21kthreadcore21:22:250
149950,0migration/05775-21kthreadcore19:52:240
149950,0migration/04147-21latency_hist19:32:060
149950,0migration/031995-21kthreadcore21:52:250
149950,0migration/031554-21kthreadcore19:47:240
149950,0migration/028989-21kthreadcore20:32:240
149950,0migration/028478-21latency00:32:270
149950,0migration/028290-21proc_pri22:07:280
149950,0migration/026048-21ntp_kernel_pll_22:42:260
149950,0migration/024231-21timerandwakeup23:17:320
149950,0migration/022326-21munin-node19:22:190
149950,0migration/021836-21sh00:31:080
149950,0migration/020910-21kthreadcore19:42:240
149950,0migration/019072-21fschecks_count21:47:180
149950,0migration/015277-21fschecks_time22:57:220
149950,0migration/015035-21aten_r1power_en19:17:170
149950,0migration/013205-21taskset22:02:200
149950,0migration/011955-21sh00:23:550
149950,0migration/011294-21munin-node00:07:230
149950,0migration/010648-21timerandwakeup21:57:330
149950,0migration/010526-21munin-node20:17:260
149950,0migration/010521-21kthreadcore23:47:250
8305040,0irq/26-0000:00:24579-21memory19:42:252
75729944,0cyclictest0-21swapper/222:54:472
75729943,0cyclictest9372-21awk20:42:212
75729943,0cyclictest5326-21awk21:57:232
75729943,0cyclictest3571-21lldpd21:12:182
75729943,0cyclictest3571-21lldpd20:26:182
75729943,0cyclictest3571-21lldpd20:01:472
75729943,0cyclictest32565-21awk00:37:242
75729943,0cyclictest3250-21irqbalance23:27:132
75729943,0cyclictest3250-21irqbalance19:12:122
75729943,0cyclictest31071-21awk20:57:232
75729943,0cyclictest30711-21awk20:12:222
75729943,0cyclictest30565-21awk19:27:242
75729943,0cyclictest24640-21awk21:32:222
75729943,0cyclictest23495-21awk20:07:232
75729943,0cyclictest23339-21awk19:22:232
75729943,0cyclictest2046-21awk20:37:222
75729943,0cyclictest15389-21awk21:27:222
75729943,0cyclictest12144-21awk22:37:202
75729943,0cyclictest10062-21awk23:12:232
75729940,0cyclictest0-21swapper/221:04:552
75719944,0cyclictest0-21swapper/121:05:021
75719943,0cyclictest6550-21awk22:52:221
75719943,0cyclictest5779-21awk00:22:231
75719943,0cyclictest3571-21lldpd23:53:501
75719943,0cyclictest3571-21lldpd22:16:491
75719943,0cyclictest3571-21lldpd19:33:171
75719943,0cyclictest3571-21lldpd19:33:171
75719943,0cyclictest3571-21lldpd19:13:471
75719943,0cyclictest3571-21lldpd00:29:211
75719943,0cyclictest26638-21awk22:27:231
75719943,0cyclictest1994-21awk20:37:211
75719943,0cyclictest17700-21awk22:22:231
75719943,0cyclictest14254-21awk22:02:241
75719943,0cyclictest10863-21awk21:42:231
75709944,0cyclictest28513-21kworker/0:023:59:100
75709944,0cyclictest28513-21kworker/0:023:27:220
75709944,0cyclictest28513-21kworker/0:023:26:240
75709944,0cyclictest28513-21kworker/0:022:47:280
75709944,0cyclictest28513-21kworker/0:022:12:160
75709944,0cyclictest28513-21kworker/0:000:17:280
75709944,0cyclictest17526-21kworker/0:219:12:530
75709944,0cyclictest1695-21kworker/0:121:32:220
75709944,0cyclictest1695-21kworker/0:121:04:140
75709944,0cyclictest1695-21kworker/0:120:46:140
75709944,0cyclictest1695-21kworker/0:120:09:550
75709943,0cyclictest8701-21awk22:17:220
75709943,0cyclictest3571-21lldpd20:13:470
75709943,0cyclictest3571-21lldpd20:02:170
75709943,0cyclictest3250-21irqbalance22:32:130
75709943,0cyclictest3250-21irqbalance22:27:130
75709943,0cyclictest3250-21irqbalance22:22:230
75709943,0cyclictest3250-21irqbalance19:37:120
75709943,0cyclictest3250-21irqbalance19:32:120
75709943,0cyclictest3250-21irqbalance19:32:120
75709943,0cyclictest3250-21irqbalance00:38:030
339940,0migration/37110-21kthreadcore23:27:253
339940,0migration/35012-21fschecks_count20:17:203
339940,0migration/331577-21kthreadcore20:32:253
329940,0watchdog/318341-21sshd20:22:493
29815040,0irq/29-eth0-tx-9905-21kthreadcore22:17:242
29815040,0irq/29-eth0-tx-5735-21grep23:07:242
29815040,0irq/29-eth0-tx-29672-21kthreadcore23:22:252
29815040,0irq/29-eth0-tx-26433-21ssh22:27:212
29815040,0irq/29-eth0-tx-19105-21diskmemload21:37:502
29815040,0irq/29-eth0-tx-12700-21ssh23:32:212
29815040,0irq/29-eth0-tx-0-21swapper/223:40:192
29815040,0irq/29-eth0-tx-0-21swapper/223:03:072
29815040,0irq/29-eth0-tx-0-21swapper/222:57:142
29815040,0irq/29-eth0-tx-0-21swapper/222:24:402
29815040,0irq/29-eth0-tx-0-21swapper/221:17:082
29815040,0irq/29-eth0-tx-0-21swapper/200:12:092
29805040,0irq/28-eth0-rx-22836-21aten_r1power_en20:52:163
29805040,0irq/28-eth0-rx-0-21swapper/322:42:543
29805040,0irq/28-eth0-rx-0-21swapper/319:27:203
29805040,0irq/28-eth0-rx-0-21swapper/300:32:263
259940,0migration/229856-21munin-node22:47:222
259940,0migration/226477-21df20:32:192
259940,0migration/226097-21kthreadcore22:07:252
259940,0migration/223301-21fschecks_time00:32:222
259940,0migration/222073-21kthreadcore22:42:232
259940,0migration/219526-21fschecks_count20:27:222
259940,0migration/21658-21gltestperf19:52:202
259940,0migration/215604-21fschecks_count19:17:192
259940,0migration/214455-21kthreadcore19:37:232
259940,0migration/213738-21munin-node00:27:192
259940,0migration/211113-21fschecks_time00:07:212
249940,0watchdog/26901-21kthreadcore22:32:262
249940,0watchdog/231856-21strings19:47:252
249940,0watchdog/231175-21kthreadcore00:17:262
249940,0watchdog/20-21swapper/223:57:302
249940,0watchdog/20-21swapper/220:02:252
249940,0watchdog/20-21swapper/219:32:172
249940,0watchdog/20-21swapper/219:32:172
179940,0migration/17844-21idleruntime23:47:221
179940,0migration/1633-21fschecks_time23:07:191
179940,0migration/15708-21kthreadcore19:52:241
179940,0migration/14440-21cpuspeed_turbos21:57:201
179940,0migration/13632-21kernelversion22:32:241
179940,0migration/132096-21kthreadcore20:57:241
179940,0migration/129791-21latency_hist20:57:061
179940,0migration/129410-21kthreadcore20:32:241
179940,0migration/129318-21kthreadcore21:32:251
179940,0migration/126380-21kthreadcore23:57:251
179940,0migration/124983-21kthreadcore22:42:241
179940,0migration/115555-21runrttasks20:47:061
169940,0watchdog/18613-21if_err_eth022:17:221
169940,0watchdog/11980-21kthreadcore20:12:251
169940,0watchdog/116238-21ssh23:14:141
169940,0watchdog/115306-21taskset20:46:491
169940,0watchdog/10-21swapper/123:32:221
169940,0watchdog/10-21swapper/122:47:541
169940,0watchdog/10-21swapper/120:07:211
169940,0watchdog/10-21swapper/119:22:251
149940,0migration/030449-21fschecks_count20:57:200
149940,0migration/022682-21kthreadcore20:27:270
149940,0migration/017306-21kthreadcore20:47:230
149940,0migration/01668-21kthreadcore23:07:230
149940,0migration/016229-21diskmemload23:32:250
149940,0migration/013661-21kthreadcore23:12:250
75719933,0cyclictest0-21swapper/120:29:531
75719932,0cyclictest32537-21kthreadcore21:52:251
75719932,0cyclictest270692sleep123:22:221
75719932,0cyclictest19105-21diskmemload22:38:521
75719932,0cyclictest16301-21awk20:02:221
75719932,0cyclictest12568-21awk19:37:211
75709933,0cyclictest28513-21kworker/0:023:37:140
75709933,0cyclictest1695-21kworker/0:121:37:120
329930,0watchdog/30-21swapper/319:57:213
29805030,0irq/28-eth0-rx-0-21swapper/320:27:213
249930,0watchdog/20-21swapper/220:47:332
179930,0migration/114940-21latency_hist19:17:061
179930,0migration/110677-21sh23:29:061
169930,0watchdog/10-21swapper/123:00:501
169930,0watchdog/10-21swapper/121:39:211
169930,0watchdog/10-21swapper/121:12:251
75719921,0cyclictest11904-21latency_hist21:07:061
75719920,0cyclictest0-21swapper/120:22:181
249920,0watchdog/20-21swapper/220:17:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional