You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 05:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Sat Jan 10, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2794124435,0sleep10-21swapper/119:08:121
2827923627,0sleep20-21swapper/219:12:092
2799323626,0sleep30-21swapper/319:08:463
2825122925,0sleep00-21swapper/019:11:470
28374991616,0cyclictest3524-21snmpd23:58:380
149970,0migration/020907-21sh23:12:120
8305060,0irq/26-0000:00:3443-21munin-run20:02:212
339960,0migration/39909-21sh00:17:453
339960,0migration/35270-21sh00:37:153
339960,0migration/34505-21sh23:18:413
339960,0migration/32939-21sh23:00:153
339960,0migration/326650-21munin-node21:22:373
339960,0migration/321531-21sh23:28:243
339960,0migration/317179-21sh00:03:443
339960,0migration/316613-21sh22:32:123
339960,0migration/315350-21sh23:44:233
339960,0migration/310026-21needreboot21:47:393
29815060,0irq/29-eth0-tx-0-21swapper/223:47:112
29815060,0irq/29-eth0-tx-0-21swapper/021:05:160
29805060,0irq/28-eth0-rx-23530-21kthreadcore00:27:383
29805060,0irq/28-eth0-rx-14853-21aten2.4-expect22:12:323
283759960,0cyclictest26852-21kthreadcore23:52:381
283759960,0cyclictest0-21swapper/100:40:241
259960,0migration/225259-21timerwakeupswit00:07:472
149960,0migration/09346-21kthreadcore23:22:390
149960,0migration/025190-21sh22:37:020
8305050,0irq/26-0000:00:25272-21rsyslogd22:02:212
8305050,0irq/26-0000:00:1363-21cat21:27:212
8305050,0irq/26-0000:00:0-21swapper/200:12:222
8305050,0irq/26-0000:00:0-21swapper/200:12:222
339950,0migration/38541-21taskset21:28:143
339950,0migration/37325-21kthreadcore22:42:393
339950,0migration/36731-21fschecks_count22:07:343
339950,0migration/36079-21kthreadcore19:17:373
339950,0migration/35994-21kthreadcore20:47:393
339950,0migration/33855-21aten2.4-expect20:02:343
339950,0migration/331380-21munin-node20:17:413
339950,0migration/327472-21munin-node23:12:433
339950,0migration/326880-21kthreadcore21:57:393
339950,0migration/32404-21munin-node23:57:353
339950,0migration/322677-21munin-node23:47:413
339950,0migration/319060-21switchtime23:07:463
339950,0migration/313710-21kthreadcore19:22:373
339950,0migration/312788-21kthreadcore20:27:393
329950,0watchdog/330244-21df_inode22:02:333
329950,0watchdog/319009-21cut20:32:403
329950,0watchdog/30-21swapper/319:42:363
29815050,0irq/29-eth0-tx-5557-21ssh22:06:332
29815050,0irq/29-eth0-tx-30799-21ssh22:19:442
29815050,0irq/29-eth0-tx-27686-21munin-node21:42:462
29815050,0irq/29-eth0-tx-25404-21munin-node20:17:420
29815050,0irq/29-eth0-tx-25085-21munin-node19:32:410
29815050,0irq/29-eth0-tx-22821-21grep21:37:392
29815050,0irq/29-eth0-tx-20313-21kthreadcore23:27:402
29815050,0irq/29-eth0-tx-19150-21munin-node22:52:472
29815050,0irq/29-eth0-tx-14858-21ssh21:14:222
29815050,0irq/29-eth0-tx-12836-21ssh23:22:572
29815050,0irq/29-eth0-tx-0-21swapper/223:56:532
29815050,0irq/29-eth0-tx-0-21swapper/222:37:052
29815050,0irq/29-eth0-tx-0-21swapper/020:57:070
29815050,0irq/29-eth0-tx-0-21swapper/020:37:370
29815050,0irq/29-eth0-tx-0-21swapper/020:11:440
29805050,0irq/28-eth0-rx-32100-21kthreadcore21:42:383
29805050,0irq/28-eth0-rx-28729-21irqrtprio00:12:373
29805050,0irq/28-eth0-rx-28729-21irqrtprio00:12:373
29805050,0irq/28-eth0-rx-22538-21cut00:07:393
29805050,0irq/28-eth0-rx-13811-21cut00:22:393
29805050,0irq/28-eth0-rx-13073-21kthreadcore20:07:383
29805050,0irq/28-eth0-rx-0-21swapper/323:52:393
29805050,0irq/28-eth0-rx-0-21swapper/323:22:353
29805050,0irq/28-eth0-rx-0-21swapper/323:06:503
29805050,0irq/28-eth0-rx-0-21swapper/322:52:433
29805050,0irq/28-eth0-rx-0-21swapper/322:52:203
29805050,0irq/28-eth0-rx-0-21swapper/322:35:153
29805050,0irq/28-eth0-rx-0-21swapper/321:52:233
29805050,0irq/28-eth0-rx-0-21swapper/321:37:383
29805050,0irq/28-eth0-rx-0-21swapper/321:17:393
29805050,0irq/28-eth0-rx-0-21swapper/300:37:333
283769955,0cyclictest7566-21diskmemload23:14:512
283769955,0cyclictest0-21swapper/223:20:512
283769955,0cyclictest0-21swapper/222:07:232
283769955,0cyclictest0-21swapper/220:57:232
283769954,0cyclictest3524-21snmpd00:18:182
283769950,0cyclictest0-21swapper/222:29:462
283759955,0cyclictest0-21swapper/122:43:441
283759955,0cyclictest0-21swapper/122:40:441
283759955,0cyclictest0-21swapper/122:16:271
283759955,0cyclictest0-21swapper/121:22:131
283759955,0cyclictest0-21swapper/120:07:391
283759954,0cyclictest1002-21awk19:37:361
283759950,0cyclictest0-21swapper/123:13:131
283759950,0cyclictest0-21swapper/121:47:361
283759950,0cyclictest0-21swapper/100:00:021
27150,0ktimersoftd/20-21swapper/219:36:212
259950,0migration/27842-21munin-node20:27:332
259950,0migration/27665-21taskset23:42:072
259950,0migration/232033-21runrttasks21:23:242
259950,0migration/230308-21hwlatdetect00:32:372
259950,0migration/215318-21gltestperf19:47:342
259950,0migration/213927-21irqcore21:52:372
259950,0migration/212656-21runrttasks21:32:392
249950,0watchdog/29733-21cat19:17:442
179950,0migration/132734-21fschecks_time22:22:341
179950,0migration/131160-21pmu-power19:32:411
179950,0migration/129495-21kthreadcore20:17:391
179950,0migration/126507-21kthreadcore00:27:391
179950,0migration/122008-21kthreadcore00:07:391
179950,0migration/117649-21fschecks_time22:32:351
179950,0migration/113522-21kthreadcore23:42:391
169950,0watchdog/113821-21ssh23:07:371
149950,0migration/08230-21kthreadcore20:47:400
149950,0migration/07819-21taskset22:26:370
149950,0migration/06793-21munin-node20:22:450
149950,0migration/05105-21kthreadcore22:42:390
149950,0migration/030988-21kthreadcore20:42:360
149950,0migration/029899-21kthreadcore22:37:400
149950,0migration/029787-21munin-node19:12:360
149950,0migration/029618-21kthreadcore00:12:380
149950,0migration/029618-21kthreadcore00:12:380
149950,0migration/029409-21sh23:16:550
149950,0migration/02847-21timerwakeupswit19:57:470
149950,0migration/026894-21kthreadcore23:52:380
149950,0migration/026746-21sh21:40:300
149950,0migration/02584-21kthreadcore21:07:380
149950,0migration/024568-21kthreadcore00:27:380
149950,0migration/024185-21sh23:50:100
149950,0migration/024136-21kthreadcore21:57:380
149950,0migration/023047-21kthreadcore00:07:400
149950,0migration/017536-21sshd22:48:380
149950,0migration/017508-21taskset21:33:470
149950,0migration/015145-21df_abs22:12:330
149950,0migration/014398-21taskset20:31:500
149950,0migration/014222-21kthreadcore00:22:390
149950,0migration/011118-21sh00:20:140
149950,0migration/010071-21mdstat23:02:430
8305040,0irq/26-0000:00:0-21swapper/220:07:462
8305040,0irq/26-0000:00:0-21swapper/219:37:362
4140,0ktimersoftd/00-21swapper/021:26:180
339940,0migration/332557-21kthreadcore20:42:373
339940,0migration/330563-21kthreadcore19:12:373
339940,0migration/329860-21runrttasks19:57:363
339940,0migration/328126-21kthreadcore19:32:383
339940,0migration/328019-21timerwakeupswit19:52:463
339940,0migration/326904-21kthreadcore22:17:383
339940,0migration/322511-21kthreadcore20:12:383
339940,0migration/321828-21latency_hist20:37:213
329940,0watchdog/332527-21cpu19:37:323
329940,0watchdog/30-21swapper/322:26:293
329940,0watchdog/30-21swapper/321:32:403
329940,0watchdog/30-21swapper/320:58:163
329940,0watchdog/30-21swapper/319:27:403
29815040,0irq/29-eth0-tx-17581-21tail23:47:352
29815040,0irq/29-eth0-tx-1746-21ssh22:42:232
29815040,0irq/29-eth0-tx-16321-21kthreadcore00:22:402
29815040,0irq/29-eth0-tx-10516-21ssh22:47:332
29815040,0irq/29-eth0-tx-0-21swapper/223:57:342
29815040,0irq/29-eth0-tx-0-21swapper/200:38:522
29805040,0irq/28-eth0-rx-0-21swapper/323:37:393
29805040,0irq/28-eth0-rx-0-21swapper/323:32:343
29805040,0irq/28-eth0-rx-0-21swapper/322:37:483
29805040,0irq/28-eth0-rx-0-21swapper/321:16:413
29805040,0irq/28-eth0-rx-0-21swapper/319:47:373
283769943,0cyclictest8344-21awk19:42:352
283769943,0cyclictest4751-21awk20:02:372
283769943,0cyclictest3571-21lldpd20:47:372
283769943,0cyclictest3571-21lldpd00:27:402
283769943,0cyclictest3524-21snmpd20:20:162
283769943,0cyclictest3524-21snmpd19:24:462
283769943,0cyclictest29621-21awk19:12:352
283769943,0cyclictest26668-21awk22:37:372
283769943,0cyclictest13805-21awk23:07:372
283769943,0cyclictest11224-21awk00:02:372
283759944,0cyclictest0-21swapper/121:45:241
283759943,0cyclictest9478-21awk22:27:361
283759943,0cyclictest5047-21awk20:47:371
283759943,0cyclictest3571-21lldpd23:19:101
283759943,0cyclictest3571-21lldpd20:29:361
283759943,0cyclictest3571-21lldpd20:02:361
283759943,0cyclictest3250-21irqbalance23:37:281
283759943,0cyclictest3250-21irqbalance23:33:181
283759943,0cyclictest3250-21irqbalance23:27:381
283759943,0cyclictest3250-21irqbalance21:14:081
283759943,0cyclictest3250-21irqbalance21:03:381
283759943,0cyclictest3250-21irqbalance20:32:281
283759943,0cyclictest3250-21irqbalance20:22:281
283759943,0cyclictest3250-21irqbalance20:12:281
283759943,0cyclictest3250-21irqbalance19:58:071
283759943,0cyclictest3250-21irqbalance19:54:171
283759943,0cyclictest3250-21irqbalance19:27:371
283759943,0cyclictest3250-21irqbalance00:23:081
283759943,0cyclictest3250-21irqbalance00:13:181
283759943,0cyclictest3250-21irqbalance00:13:181
283759943,0cyclictest24505-21awk22:17:361
283759943,0cyclictest1543-21awk21:07:361
283759943,0cyclictest11861-21sadc00:22:221
283759943,0cyclictest11486-21awk21:32:371
283749944,0cyclictest0-21swapper/021:52:470
283749943,0cyclictest5791-21sadc23:22:220
283749943,0cyclictest3524-21snmpd19:17:310
283749943,0cyclictest19410-21kworker/0:122:17:390
283749943,0cyclictest13940-21sadc00:42:220
283749943,0cyclictest11722-21awk19:22:340
259940,0migration/24112-21munin-node21:47:322
259940,0migration/232610-21kthreadcore20:42:372
259940,0migration/232547-21fschecks_count22:22:342
259940,0migration/230965-21kthreadcore22:57:402
259940,0migration/227800-21missed_timers20:37:402
259940,0migration/226547-21fschecks_time21:02:352
259940,0migration/22110-21kthreadcore21:07:372
259940,0migration/220783-21kthreadcore20:12:382
259940,0migration/217585-21irqcore21:17:372
259940,0migration/216817-21kthreadcore22:12:382
249940,0watchdog/24522-21fschecks_count23:02:372
249940,0watchdog/219010-21tr20:32:402
249940,0watchdog/20-21swapper/223:32:372
249940,0watchdog/20-21swapper/220:52:362
179940,0migration/14513-21kthreadcore21:27:381
179940,0migration/132341-21kthreadcore00:32:391
179940,0migration/128715-21munin-node22:57:361
179940,0migration/128466-21runrttasks21:59:201
179940,0migration/127428-21kthreadcore21:22:371
179940,0migration/125791-21kthreadcore20:37:381
179940,0migration/119185-21aten_r1power_po21:37:331
179940,0migration/116792-21aten2.4-expect23:47:331
179940,0migration/111416-21fschecks_time19:22:331
179940,0migration/111381-21kthreadcore19:42:371
179940,0migration/110325-21kthreadcore23:22:391
169940,0watchdog/129536-21diskstats20:42:321
169940,0watchdog/111529-21cut22:47:371
169940,0watchdog/10-21swapper/123:02:371
169940,0watchdog/10-21swapper/121:52:321
169940,0watchdog/10-21swapper/100:02:371
149940,0migration/031326-21irqrtprio22:02:360
149940,0migration/028762-21if_err_eth121:42:360
149940,0migration/024374-21sh21:21:140
149940,0migration/022869-21kthreadcore22:52:390
149940,0migration/019008-21kthreadcore19:47:380
149940,0migration/014634-21diskmemload22:27:420
149940,0migration/012433-21sensors_volt22:07:430
329930,0watchdog/30-21swapper/321:11:123
329930,0watchdog/30-21swapper/321:02:403
329930,0watchdog/30-21swapper/320:52:363
29805030,0irq/28-eth0-rx-0-21swapper/320:22:313
283769932,0cyclictest3524-21snmpd19:57:162
283759932,0cyclictest29652-21awk19:12:351
283759932,0cyclictest20621-21sensors19:47:421
283759932,0cyclictest20252-21awk22:52:371
283759930,0cyclictest6562-21df_inode22:07:341
283749933,0cyclictest29556-21kworker/0:219:27:260
283749933,0cyclictest2647-21kworker/0:220:57:290
283749933,0cyclictest2647-21kworker/0:220:32:240
283749933,0cyclictest2647-21kworker/0:220:12:240
283749933,0cyclictest2647-21kworker/0:220:02:280
283749933,0cyclictest24103-21kworker/0:019:52:240
283749933,0cyclictest24103-21kworker/0:019:42:280
283749933,0cyclictest24103-21kworker/0:019:37:280
283749933,0cyclictest2381-21kworker/0:000:02:510
283749933,0cyclictest19410-21kworker/0:123:42:230
283749933,0cyclictest19410-21kworker/0:122:57:230
283749933,0cyclictest19410-21kworker/0:121:27:370
283749933,0cyclictest19410-21kworker/0:121:12:270
283749932,0cyclictest3524-21snmpd23:27:240
283749932,0cyclictest31244-21grep00:32:390
283749932,0cyclictest24255-21awk23:32:370
283749932,0cyclictest2086-21kthreadcore23:37:380
283749932,0cyclictest19410-21kworker/0:121:47:330
249930,0watchdog/20-21swapper/220:22:322
249930,0watchdog/20-21swapper/219:27:402
169930,0watchdog/14922-21irqrtprio19:17:361
169930,0watchdog/10-21swapper/122:03:011
169930,0watchdog/10-21swapper/120:57:361
169930,0watchdog/10-21swapper/120:52:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional