You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 13:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Dec 17, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1562824534,0sleep30-21swapper/319:09:193
1561223527,0sleep20-21swapper/219:09:062
1534423525,0sleep10-21swapper/119:05:571
1560023329,0sleep00-21swapper/019:08:560
15786991010,0cyclictest3524-21snmpd00:35:370
157869999,0cyclictest3524-21snmpd21:35:040
157889974,0cyclictest29466-21grep22:00:422
157889973,0cyclictest3571-21lldpd21:46:582
157889973,0cyclictest3524-21snmpd19:42:452
157889973,0cyclictest28214-21awk20:25:382
157889972,0cyclictest24622-21awk20:45:352
157889971,0cyclictest17463-21sadc22:50:222
157889971,0cyclictest0-21swapper/200:02:212
35160,0ktimersoftd/30-21swapper/322:05:003
339960,0migration/34172-21sh21:49:143
339960,0migration/332230-21munin-node00:05:443
339960,0migration/329417-21pmu-power20:00:413
339960,0migration/32418-21sh23:34:153
339960,0migration/323546-21munin-node19:15:343
29815060,0irq/29-eth0-tx-19841-21munin-node20:20:480
29815060,0irq/29-eth0-tx-0-21swapper/020:09:270
29805060,0irq/28-eth0-rx-26619-21ssh22:18:573
29805060,0irq/28-eth0-rx-21036-21kthreadcore00:00:413
29805060,0irq/28-eth0-rx-16025-21cut21:55:403
29805060,0irq/28-eth0-rx-0-21swapper/322:35:263
157889963,0cyclictest14192-21munin-node21:55:402
157889962,0cyclictest5952-21uname22:25:402
157889962,0cyclictest4168-21grep00:10:392
157889962,0cyclictest3762-21cut22:40:402
157889962,0cyclictest3465-21sadc23:00:222
157889962,0cyclictest3465-21sadc23:00:222
157889962,0cyclictest27148-21kthreadcore22:35:402
157889962,0cyclictest26500-21munin-node23:30:412
157889962,0cyclictest20300-21tune2fs20:20:362
157889962,0cyclictest19602-21sadc20:20:212
157889961,0cyclictest4204-21sh00:25:472
157889961,0cyclictest2471-21kauditd19:50:212
157889961,0cyclictest0-21swapper/221:35:522
157889961,0cyclictest0-21swapper/221:02:202
157889960,0cyclictest8539-21ssh22:09:212
157889960,0cyclictest7003-21munin-node00:30:442
157889960,0cyclictest4317-21ssh23:35:362
157889960,0cyclictest32439-21munin-node21:30:362
157889960,0cyclictest32338-21kthreadcore20:05:392
157889960,0cyclictest30154-21grep21:10:402
157889960,0cyclictest24703-21irqrtprio19:15:382
157889960,0cyclictest24639-21kthreadcore00:20:412
157889960,0cyclictest21460-21cat23:45:212
157889960,0cyclictest18917-21munin-node21:40:352
157889960,0cyclictest18368-21wc23:25:372
157889960,0cyclictest12955-21kthreadcore22:10:402
157889960,0cyclictest11933-21munin-node00:15:372
157889960,0cyclictest10527-21switchtime21:15:462
157889960,0cyclictest0-21swapper/222:30:402
157889960,0cyclictest0-21swapper/221:51:432
157889960,0cyclictest0-21swapper/220:02:202
149960,0migration/032742-21sh00:05:590
149960,0migration/031219-21sh23:50:350
149960,0migration/017380-21kthreadcore21:00:400
149960,0migration/014051-21kthreadcore22:10:400
149960,0migration/011004-21unixbench-2d22:25:480
4150,0ktimersoftd/00-21swapper/023:00:450
339950,0migration/38796-21sh23:55:393
339950,0migration/38538-21latency_hist22:45:223
339950,0migration/37964-21latency_hist23:20:223
339950,0migration/36961-21diskmemload00:30:293
339950,0migration/35308-21irqrtprio23:00:393
339950,0migration/35143-21munin-node23:50:503
339950,0migration/33498-21sh22:24:143
339950,0migration/329682-21kthreadcore22:55:393
339950,0migration/329682-21kthreadcore22:55:393
339950,0migration/327842-21hddtemp_smartct19:40:363
339950,0migration/32585-21kthreadcore20:05:393
339950,0migration/325462-21kthreadcore20:20:413
339950,0migration/322097-21runrttasks23:10:243
339950,0migration/319462-21idleruntime-cro19:35:213
339950,0migration/318812-21irqrtprio23:25:393
339950,0migration/314200-21kthreadcore23:40:393
339950,0migration/314198-21munin-node20:15:403
339950,0migration/310641-21kthreadcore23:20:393
329950,0watchdog/321637-21sh23:45:293
329950,0watchdog/310113-21cut20:55:403
329950,0watchdog/30-21swapper/322:25:373
29815050,0irq/29-eth0-tx-20033-21munin-node21:05:330
29805050,0irq/28-eth0-rx-9207-21swap00:10:473
29805050,0irq/28-eth0-rx-5018-21grep22:40:403
29805050,0irq/28-eth0-rx-4949-21ssh21:50:263
29805050,0irq/28-eth0-rx-4009-21ssh21:15:283
29805050,0irq/28-eth0-rx-32310-21wc22:05:223
29805050,0irq/28-eth0-rx-24733-21cut21:25:393
29805050,0irq/28-eth0-rx-20997-21ssh00:20:243
29805050,0irq/28-eth0-rx-18996-21ssh22:50:383
29805050,0irq/28-eth0-rx-16322-21kthreadcore00:15:383
29805050,0irq/28-eth0-rx-15412-21munin-node22:10:413
29805050,0irq/28-eth0-rx-13857-21df22:30:353
29805050,0irq/28-eth0-rx-0-21swapper/321:35:413
29805050,0irq/28-eth0-rx-0-21swapper/321:33:193
29805050,0irq/28-eth0-rx-0-21swapper/321:10:473
29805050,0irq/28-eth0-rx-0-21swapper/319:45:403
179950,0migration/127955-21idleruntime22:55:371
179950,0migration/127955-21idleruntime22:55:371
179950,0migration/127538-21idleruntime23:30:371
179950,0migration/125564-21missed_timers19:35:431
179950,0migration/125410-21kthreadcore22:00:391
179950,0migration/121512-21latency_hist23:45:211
179950,0migration/119029-21fschecks_count22:15:351
179950,0migration/11890-21munin-node21:45:421
179950,0migration/116311-21cpuspeed_turbos19:10:341
179950,0migration/115931-21taskset23:22:581
179950,0migration/110401-21kthreadcore22:45:391
157889952,0cyclictest6314-21runrttasks23:45:482
157889952,0cyclictest11471-21sensors19:25:452
157889952,0cyclictest0-21swapper/223:55:262
157889952,0cyclictest0-21swapper/200:05:312
157889951,0cyclictest8961-21kthreadcore20:10:412
157889951,0cyclictest4814-21grep20:50:482
157889951,0cyclictest31860-21awk23:50:372
157889951,0cyclictest23333-21munin-plugin-st20:45:212
157889951,0cyclictest12484-21aten_r1power_cu19:30:322
157889951,0cyclictest11898-21switchtime20:55:472
157889950,0cyclictest9075-21fschecks_time23:20:352
157889950,0cyclictest18927-21latency23:05:412
157889950,0cyclictest13987-21df_inode21:20:352
157889950,0cyclictest12405-21kthreadcore19:50:402
157889950,0cyclictest0-21swapper/223:15:302
157889950,0cyclictest0-21swapper/223:10:312
157889950,0cyclictest0-21swapper/223:00:322
157889950,0cyclictest0-21swapper/222:50:392
157889950,0cyclictest0-21swapper/222:20:462
157889950,0cyclictest0-21swapper/222:15:282
157889950,0cyclictest0-21swapper/221:25:282
157889950,0cyclictest0-21swapper/221:05:472
157889950,0cyclictest0-21swapper/220:35:372
157889950,0cyclictest0-21swapper/220:30:422
157889950,0cyclictest0-21swapper/219:20:512
157889950,0cyclictest0-21swapper/200:35:412
157879955,0cyclictest0-21swapper/123:27:111
157879955,0cyclictest0-21swapper/123:02:071
157879955,0cyclictest0-21swapper/122:26:101
157879955,0cyclictest0-21swapper/122:25:041
157879955,0cyclictest0-21swapper/121:11:551
157879955,0cyclictest0-21swapper/100:32:461
157879955,0cyclictest0-21swapper/100:18:071
157879950,0cyclictest0-21swapper/123:36:481
157879950,0cyclictest0-21swapper/123:11:441
157879950,0cyclictest0-21swapper/122:35:191
157879950,0cyclictest0-21swapper/121:39:301
157879950,0cyclictest0-21swapper/100:24:061
157869955,0cyclictest0-21swapper/022:17:040
157869955,0cyclictest0-21swapper/022:10:080
157869950,0cyclictest0-21swapper/000:01:360
149950,0migration/09943-21irqcore22:45:390
149950,0migration/06913-21kthreadcore19:25:400
149950,0migration/05765-21sh22:40:430
149950,0migration/05737-21kthreadcore23:35:390
149950,0migration/05581-21taskset20:55:290
149950,0migration/05381-21latency_hist20:10:210
149950,0migration/04787-21kthreadcore20:30:390
149950,0migration/0391-21kthreadcore22:20:420
149950,0migration/03597-21kthreadcore19:20:390
149950,0migration/032079-21kthreadcore00:25:400
149950,0migration/031929-21kthreadcore21:10:400
149950,0migration/031699-21kthreadcore21:45:390
149950,0migration/029873-21taskset19:17:050
149950,0migration/028811-21kthreadcore20:25:390
149950,0migration/025480-21kthreadcore20:45:370
149950,0migration/025423-21kthreadcore23:10:390
149950,0migration/024227-21fschecks_time22:00:350
149950,0migration/023913-21irqcore22:35:390
149950,0migration/023123-21irqrtprio23:45:390
149950,0migration/021789-21kthreadcore21:40:400
149950,0migration/021192-21kthreadcore19:10:390
149950,0migration/020712-21sh23:43:580
149950,0migration/019712-21kthreadcore22:50:390
149950,0migration/016350-21kthreadcore19:30:380
149950,0migration/015711-21kthreadcore00:15:380
149950,0migration/015405-21kthreadcore22:30:390
149950,0migration/015285-21kthreadcore21:20:390
149950,0migration/014221-21sh21:55:340
149950,0migration/012274-21kthreadcore23:55:400
149950,0migration/012181-21sh21:51:410
149950,0migration/010671-21munin-node21:35:380
339940,0migration/39660-21kthreadcore20:10:413
339940,0migration/37648-21kthreadcore19:25:403
339940,0migration/326791-21taskset21:07:453
339940,0migration/316732-21kthreadcore23:05:403
339940,0migration/310880-21kthreadcore20:35:373
329940,0watchdog/36314-21runrttasks20:35:123
329940,0watchdog/32593-21kthreadcore20:50:403
329940,0watchdog/318129-21kthreadcore21:00:403
329940,0watchdog/313912-21cut19:50:403
329940,0watchdog/30-21swapper/321:20:403
329940,0watchdog/30-21swapper/300:25:413
29815040,0irq/29-eth0-tx-0-21swapper/019:50:340
29805040,0irq/28-eth0-rx-0-21swapper/323:37:163
29805040,0irq/28-eth0-rx-0-21swapper/321:40:273
29805040,0irq/28-eth0-rx-0-21swapper/300:35:283
179940,0migration/19745-21df_abs22:10:351
179940,0migration/16931-21kthreadcore19:45:411
179940,0migration/129534-21kthreadcore20:25:391
179940,0migration/12916-21idleruntime20:30:371
179940,0migration/127613-21kthreadcore20:00:381
179940,0migration/126297-21kthreadcore22:35:401
179940,0migration/122151-21latency20:40:431
179940,0migration/121470-21sh21:22:581
179940,0migration/119330-21rt-features23:05:431
179940,0migration/11920-21kthreadcore23:50:391
179940,0migration/117937-21kthreadcore23:40:411
179940,0migration/11461-21taskset00:08:281
179940,0migration/112978-21kthreadcore20:35:381
169940,0watchdog/19650-21ssh00:11:011
169940,0watchdog/17185-21grep19:25:401
169940,0watchdog/130342-21ssh21:26:441
169940,0watchdog/13029-21kthreadcore00:25:411
169940,0watchdog/12591-21kthreadcore20:50:401
169940,0watchdog/125672-21users21:40:491
169940,0watchdog/120189-21cut00:00:411
169940,0watchdog/116141-21ssh00:35:291
169940,0watchdog/10-21swapper/122:50:371
169940,0watchdog/10-21swapper/121:30:481
157889943,0cyclictest3524-21snmpd19:40:002
157889943,0cyclictest3524-21snmpd19:11:302
157889940,0cyclictest0-21swapper/219:55:382
157879944,0cyclictest0-21swapper/123:56:121
157879944,0cyclictest0-21swapper/121:17:071
157879943,0cyclictest3524-21snmpd20:18:311
157879943,0cyclictest3524-21snmpd20:12:301
157879943,0cyclictest3524-21snmpd19:42:001
157879943,0cyclictest3524-21snmpd19:30:301
157879943,0cyclictest31661-21awk20:05:371
157879943,0cyclictest31460-21awk19:20:361
157879943,0cyclictest24709-21awk20:45:361
157879943,0cyclictest20874-21awk20:20:371
157879943,0cyclictest17205-21awk19:55:361
157879943,0cyclictest15375-21awk21:55:381
157879943,0cyclictest13868-21awk21:00:371
157879943,0cyclictest0-21swapper/120:55:411
157869944,0cyclictest0-21swapper/023:27:330
157869944,0cyclictest0-21swapper/023:17:460
157869943,0cyclictest9267-21awk23:20:370
157869943,0cyclictest5127-21awk21:15:360
157869943,0cyclictest3571-21lldpd22:56:590
157869943,0cyclictest3571-21lldpd22:56:590
157869943,0cyclictest28003-21awk19:40:380
157869943,0cyclictest27581-21awk23:30:380
157869943,0cyclictest20805-21awk19:35:390
157869943,0cyclictest10214-21awk20:35:350
157869942,0cyclictest27908-21kworker/0:023:06:350
157869941,0cyclictest3207-17auditd20:20:210
149940,0migration/08506-21irqrtprio00:30:400
339930,0migration/316619-21fschecks_count19:55:343
329930,0watchdog/30-21swapper/320:40:403
329930,0watchdog/30-21swapper/320:25:403
329930,0watchdog/30-21swapper/319:35:403
329930,0watchdog/30-21swapper/319:20:363
29805030,0irq/28-eth0-rx-0-21swapper/320:45:313
29805030,0irq/28-eth0-rx-0-21swapper/319:10:583
169930,0watchdog/120196-21munin-node21:05:321
169930,0watchdog/11821-21kthreadcore22:05:411
169930,0watchdog/10-21swapper/119:50:401
157879932,0cyclictest6120-21awk21:50:391
157879932,0cyclictest382-21awk22:40:371
157879932,0cyclictest31476-21tail23:15:341
157869933,0cyclictest3715-21kworker/0:100:20:390
157869933,0cyclictest27908-21kworker/0:000:10:270
157869933,0cyclictest25840-21kworker/0:221:25:250
157869933,0cyclictest25840-21kworker/0:220:50:230
157869933,0cyclictest25840-21kworker/0:220:40:270
157869933,0cyclictest25840-21kworker/0:220:00:280
157869933,0cyclictest25840-21kworker/0:219:55:220
157869933,0cyclictest25840-21kworker/0:219:45:420
169920,0watchdog/10-21swapper/119:15:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional