You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 04:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Mar 23, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2051423728,0sleep30-21swapper/319:16:093
2055223526,0sleep10-21swapper/119:16:391
2045223424,0sleep20-21swapper/219:15:282
2037623228,0sleep00-21swapper/019:14:340
339970,0migration/326946-21unixbench-2d23:03:423
207689976,0cyclictest11219-21tune2fs20:18:330
339960,0migration/37496-21sh22:18:293
339960,0migration/34492-21sh21:56:453
339960,0migration/34359-21munin-node22:53:363
339960,0migration/32935-21sh00:08:163
339960,0migration/328227-21sh21:51:443
339960,0migration/325738-21sh22:46:093
339960,0migration/319717-21sh23:02:153
339960,0migration/317978-21munin-node21:43:393
339960,0migration/315269-21sh23:36:543
329960,0watchdog/327529-21ssh00:19:193
29815060,0irq/29-eth0-tx-6747-21munin-node19:53:410
29805060,0irq/28-eth0-rx-6266-21perl21:58:343
29805060,0irq/28-eth0-rx-6266-21perl21:58:343
29805060,0irq/28-eth0-rx-5967-21kthreadcore22:33:383
29805060,0irq/28-eth0-rx-26457-21kthreadcore23:43:383
29805060,0irq/28-eth0-rx-23646-21perl00:38:343
29805060,0irq/28-eth0-rx-16163-21grep00:13:373
207699966,0cyclictest0-21swapper/122:18:431
207699960,0cyclictest32079-21diskmemload22:16:121
207699960,0cyclictest0-21swapper/121:38:311
207689960,0cyclictest0-21swapper/023:22:510
207689960,0cyclictest0-21swapper/000:47:310
149960,0migration/06919-21sh23:13:370
149960,0migration/026085-21latency_hist21:33:200
149960,0migration/024730-21sh23:43:280
149960,0migration/023452-21sh22:25:390
149960,0migration/021778-21sh22:06:490
8305050,0irq/26-0000:00:3103-21turbostat.cron20:58:202
4150,0ktimersoftd/00-21swapper/022:39:390
339950,0migration/39004-21kthreadcore00:08:393
339950,0migration/37507-21sshd21:21:063
339950,0migration/3477-21kthreadcore23:28:373
339950,0migration/33327-21df_abs19:28:333
339950,0migration/332546-21kthreadcore20:53:373
339950,0migration/331500-21kthreadcore22:48:393
339950,0migration/331144-21kthreadcore20:08:373
339950,0migration/328350-21latency_hist20:53:203
339950,0migration/324004-21kthreadcore20:03:373
339950,0migration/322927-21df_abs23:23:303
339950,0migration/320374-21timerwakeupswit19:58:453
339950,0migration/317133-21idleruntime23:38:363
339950,0migration/31702-21kthreadcore00:23:383
339950,0migration/316953-21taskset19:35:353
339950,0migration/314833-21fschecks_time20:43:333
339950,0migration/314589-21fschecks_count22:03:343
339950,0migration/313905-21latency_hist20:43:193
339950,0migration/311708-21munin-node00:28:403
329950,0watchdog/38293-21ssh23:50:073
329950,0watchdog/327056-21proc_pri19:18:423
329950,0watchdog/324262-21ssh21:28:513
329950,0watchdog/320089-21ntp_states23:18:393
329950,0watchdog/31955-21cut20:33:383
329950,0watchdog/315034-21python21:23:433
29815050,0irq/29-eth0-tx-7482-21munin-node23:33:462
29815050,0irq/29-eth0-tx-32079-21diskmemload23:50:012
29815050,0irq/29-eth0-tx-31186-21munin-node22:13:412
29815050,0irq/29-eth0-tx-27694-21cat23:43:382
29815050,0irq/29-eth0-tx-21148-21kthreadcore22:23:392
29815050,0irq/29-eth0-tx-1461-21ssh21:18:350
29815050,0irq/29-eth0-tx-13771-21rt-features22:18:422
29815050,0irq/29-eth0-tx-11789-21munin-node22:58:342
29815050,0irq/29-eth0-tx-10452-21perl22:38:332
29815050,0irq/29-eth0-tx-0-21swapper/223:54:402
29815050,0irq/29-eth0-tx-0-21swapper/223:38:322
29815050,0irq/29-eth0-tx-0-21swapper/223:27:572
29815050,0irq/29-eth0-tx-0-21swapper/222:53:382
29815050,0irq/29-eth0-tx-0-21swapper/222:33:342
29815050,0irq/29-eth0-tx-0-21swapper/221:56:412
29815050,0irq/29-eth0-tx-0-21swapper/221:49:342
29815050,0irq/29-eth0-tx-0-21swapper/221:36:002
29815050,0irq/29-eth0-tx-0-21swapper/221:28:322
29815050,0irq/29-eth0-tx-0-21swapper/019:58:320
29805050,0irq/28-eth0-rx-9522-21wc20:13:453
29805050,0irq/28-eth0-rx-3991-21cut20:58:343
29805050,0irq/28-eth0-rx-3109-21cpu21:38:333
29805050,0irq/28-eth0-rx-30869-21python19:43:423
29805050,0irq/28-eth0-rx-27145-21kthreadcore21:13:383
29805050,0irq/28-eth0-rx-12855-21kthreadcore23:53:393
29805050,0irq/28-eth0-rx-0-21swapper/323:58:383
29805050,0irq/28-eth0-rx-0-21swapper/323:08:203
29805050,0irq/28-eth0-rx-0-21swapper/322:28:323
29805050,0irq/28-eth0-rx-0-21swapper/322:23:373
29805050,0irq/28-eth0-rx-0-21swapper/321:35:533
29805050,0irq/28-eth0-rx-0-21swapper/300:43:283
29805050,0irq/28-eth0-rx-0-21swapper/300:33:363
27150,0ktimersoftd/20-21swapper/200:20:372
259950,0migration/27278-21fschecks_count19:53:332
259950,0migration/25411-21kthreadcore00:08:382
259950,0migration/229940-21kthreadcore21:13:392
259950,0migration/22857-21sh00:08:022
259950,0migration/224987-21latency_hist21:13:202
259950,0migration/220540-21unixbench-2d23:18:442
259950,0migration/213872-21latency_hist22:03:202
259950,0migration/211063-21munin-node21:03:322
207779955,0cyclictest0-21swapper/220:03:382
207779955,0cyclictest0-21swapper/200:15:062
207779950,0cyclictest0-21swapper/223:11:242
207779950,0cyclictest0-21swapper/222:43:392
207779950,0cyclictest0-21swapper/222:11:392
207699955,0cyclictest0-21swapper/122:00:451
207699955,0cyclictest0-21swapper/122:00:451
207699955,0cyclictest0-21swapper/100:15:231
207699950,0cyclictest0-21swapper/123:14:321
207699950,0cyclictest0-21swapper/123:00:491
207699950,0cyclictest0-21swapper/122:55:461
207699950,0cyclictest0-21swapper/122:39:131
207699950,0cyclictest0-21swapper/122:07:121
207699950,0cyclictest0-21swapper/121:23:511
207689955,0cyclictest0-21swapper/022:20:250
207689955,0cyclictest0-21swapper/019:28:340
207689955,0cyclictest0-21swapper/000:35:510
207689955,0cyclictest0-21swapper/000:30:010
207689953,0cyclictest27806-21kworker/0:123:38:470
207689950,0cyclictest0-21swapper/022:38:040
207689950,0cyclictest0-21swapper/021:49:500
207689950,0cyclictest0-21swapper/021:43:220
207689950,0cyclictest0-21swapper/000:41:410
207689950,0cyclictest0-21swapper/000:02:440
179950,0migration/13104-21aten2.4-expect19:28:321
179950,0migration/127567-21kthreadcore00:38:391
179950,0migration/119243-21kthreadcore00:33:401
169950,0watchdog/132550-21tune2fs20:33:341
149950,0migration/08162-21runrttasks23:49:460
149950,0migration/06029-21sh23:30:030
149950,0migration/04172-21kthreadcore20:33:390
149950,0migration/032502-21kthreadcore00:23:370
149950,0migration/031851-21taskset21:15:560
149950,0migration/030926-21kthreadcore20:53:370
149950,0migration/030119-21kthreadcore22:48:380
149950,0migration/027965-21taskset20:49:460
149950,0migration/027283-21kthreadcore19:43:370
149950,0migration/027218-21kthreadcore22:08:380
149950,0migration/025466-21kthreadcore23:23:350
149950,0migration/023682-21kthreadcore00:18:370
149950,0migration/021022-21aten_r1power_en19:18:320
149950,0migration/018981-21irqcore20:23:370
149950,0migration/017351-21kthreadcore20:43:370
149950,0migration/014649-21taskset23:35:070
149950,0migration/014442-21kthreadcore19:33:370
149950,0migration/013322-21kthreadcore21:03:370
149950,0migration/011680-21latency_hist22:58:190
149950,0migration/011429-21sh22:58:090
149950,0migration/010450-21kthreadcore20:38:380
8305040,0irq/26-0000:00:0-21swapper/220:23:342
339940,0migration/35324-21diskmemload23:13:303
339940,0migration/324716-21latency_hist20:28:193
339940,0migration/31821-21kthreadcore19:48:373
339940,0migration/315816-21kthreadcore20:18:373
339940,0migration/313249-21kthreadcore21:03:373
329940,0watchdog/320245-21kthreadcore21:08:383
29815040,0irq/29-eth0-tx-32555-21basename00:43:382
29815040,0irq/29-eth0-tx-17886-21ssh21:43:392
29815040,0irq/29-eth0-tx-0-21swapper/223:58:332
29815040,0irq/29-eth0-tx-0-21swapper/223:28:262
29815040,0irq/29-eth0-tx-0-21swapper/222:48:402
29815040,0irq/29-eth0-tx-0-21swapper/222:28:242
29815040,0irq/29-eth0-tx-0-21swapper/221:38:262
29815040,0irq/29-eth0-tx-0-21swapper/221:23:302
29815040,0irq/29-eth0-tx-0-21swapper/221:20:152
29815040,0irq/29-eth0-tx-0-21swapper/200:28:332
29805040,0irq/28-eth0-rx-0-21swapper/322:39:313
29805040,0irq/28-eth0-rx-0-21swapper/322:13:333
29805040,0irq/28-eth0-rx-0-21swapper/322:11:033
29805040,0irq/28-eth0-rx-0-21swapper/319:23:383
259940,0migration/25271-21runrttasks23:13:202
259940,0migration/231777-21kthreadcore20:08:372
259940,0migration/231504-21kthreadcore19:23:372
259940,0migration/225984-21kthreadcore20:48:372
259940,0migration/222204-21kthreadcore19:38:372
259940,0migration/220366-21swap20:43:442
259940,0migration/216455-21kthreadcore00:33:392
259940,0migration/210941-21fschecks_count20:18:322
259940,0migration/210359-21aten2.4-expect19:33:312
249940,0watchdog/27499-21grep21:58:392
249940,0watchdog/27499-21grep21:58:392
249940,0watchdog/20-21swapper/223:03:312
207779943,0cyclictest7948-21awk20:38:352
207779943,0cyclictest3571-21lldpd20:58:322
207779943,0cyclictest3571-21lldpd19:43:302
207779943,0cyclictest3571-21lldpd19:30:002
207779943,0cyclictest3571-21lldpd19:20:002
207779943,0cyclictest3524-21snmpd20:33:462
207779943,0cyclictest30458-21awk00:23:362
207779943,0cyclictest25989-21awk20:28:352
207779943,0cyclictest23954-21awk00:38:362
207699943,0cyclictest999-21awk21:18:341
207699943,0cyclictest3571-21lldpd20:50:311
207699943,0cyclictest3571-21lldpd20:09:001
207699943,0cyclictest3571-21lldpd19:44:001
207699943,0cyclictest3524-21snmpd20:20:161
207699943,0cyclictest3524-21snmpd20:17:161
207699943,0cyclictest32705-21awk00:43:391
207699943,0cyclictest3250-21irqbalance23:31:061
207699943,0cyclictest3250-21irqbalance23:21:461
207699943,0cyclictest3250-21irqbalance22:34:261
207699943,0cyclictest3250-21irqbalance22:24:361
207699943,0cyclictest3250-21irqbalance20:53:361
207699943,0cyclictest30206-21awk21:53:361
207699943,0cyclictest28172-21awk00:03:371
207699943,0cyclictest22368-21irqcore20:03:361
207699943,0cyclictest21670-21awk00:18:351
207699943,0cyclictest21499-21awk23:03:331
207699943,0cyclictest18721-21awk20:23:351
207699943,0cyclictest17168-21awk23:38:361
207699943,0cyclictest15137-21awk20:43:351
207699943,0cyclictest11809-21awk21:03:351
207689944,0cyclictest5582-21kworker/0:019:48:260
207689944,0cyclictest0-21swapper/022:15:220
207689944,0cyclictest0-21swapper/021:39:250
207689944,0cyclictest0-21swapper/000:12:120
207689944,0cyclictest0-21swapper/000:07:280
207689943,0cyclictest5582-21kworker/0:021:08:310
207689943,0cyclictest5582-21kworker/0:020:28:330
207689943,0cyclictest4559-21awk20:58:370
207689943,0cyclictest30078-21awk23:08:350
207689943,0cyclictest21523-21awk23:03:330
207689942,0cyclictest5582-21kworker/0:021:33:350
207689941,0cyclictest5582-21kworker/0:021:58:470
207689941,0cyclictest5582-21kworker/0:021:58:470
179940,0migration/130941-21sh22:28:411
179940,0migration/129165-21kthreadcore20:28:371
179940,0migration/128521-21kthreadcore21:13:391
179940,0migration/127916-21kernelversion21:33:361
179940,0migration/126672-21munin-node21:48:421
179940,0migration/117767-21munin-node21:43:371
169940,0watchdog/18351-21tr00:08:391
169940,0watchdog/13913-21ssh23:10:111
169940,0watchdog/13524-21snmpd23:53:231
169940,0watchdog/131594-21kthreadcore22:48:391
169940,0watchdog/129588-21cut23:43:391
169940,0watchdog/125889-21ssh22:46:351
169940,0watchdog/120244-21kthreadcore21:08:381
169940,0watchdog/119003-21kthreadcore19:58:381
169940,0watchdog/118408-21ssh23:58:311
169940,0watchdog/111194-21hddtemp_smartct19:33:341
169940,0watchdog/10-21swapper/123:33:391
169940,0watchdog/10-21swapper/123:23:431
169940,0watchdog/10-21swapper/119:18:421
149940,0migration/031693-21kthreadcore20:08:370
149940,0migration/030543-21irqrtprio21:53:370
149940,0migration/021022-21kthreadcore19:38:370
149940,0migration/012425-21kthreadcore21:23:370
339930,0migration/311008-21kthreadcore19:53:373
329930,0watchdog/30-21swapper/320:31:223
29805030,0irq/28-eth0-rx-0-21swapper/319:38:343
249930,0watchdog/20-21swapper/219:58:382
207779932,0cyclictest4314-21awk20:13:362
207699933,0cyclictest3571-21lldpd19:48:311
207699933,0cyclictest3571-21lldpd00:23:361
207699932,0cyclictest3524-21snmpd19:27:351
207699932,0cyclictest3250-21irqbalance20:38:461
207699932,0cyclictest23872-21irqcore22:08:361
207699932,0cyclictest23655-21sensors19:38:411
207699931,0cyclictest23148-21kthreadcore21:28:391
207699930,0cyclictest7259-21tune2fs19:53:331
207689933,0cyclictest5582-21kworker/0:022:28:210
207689933,0cyclictest5582-21kworker/0:020:03:200
207689933,0cyclictest5582-21kworker/0:019:23:220
207689933,0cyclictest4401-21awk20:13:360
207689933,0cyclictest4298-21kworker/0:000:13:310
207689933,0cyclictest27806-21kworker/0:123:53:210
207689932,0cyclictest19258-21awk22:43:340
179930,0migration/17330-21kthreadcore00:28:371
169930,0watchdog/14178-21fschecks_time20:58:341
169930,0watchdog/10-21swapper/123:50:391
207779921,0cyclictest31833-21sed19:48:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional