You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 22:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 18, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1055026766,0sleep20-21swapper/207:08:232
1035625349,0sleep00-21swapper/007:06:050
1037524940,0sleep30-21swapper/307:06:203
1034723026,0sleep10-21swapper/107:05:581
10803991818,0cyclictest3524-21snmpd11:09:000
108059988,0cyclictest31932-21sensors08:05:492
8305060,0irq/26-0000:00:32293-21latency_hist09:50:292
339960,0migration/35729-21sh11:36:393
339960,0migration/321367-21sh11:30:133
339960,0migration/318559-21sh12:36:243
339960,0migration/312888-21kthreadcore07:55:463
339960,0migration/312085-21sh10:12:283
29815060,0irq/29-eth0-tx-25435-21munin-node07:20:430
29805060,0irq/28-eth0-rx-3804-21df11:20:423
29805060,0irq/28-eth0-rx-29773-21sh10:20:593
29805060,0irq/28-eth0-rx-18406-21perl11:10:453
29805060,0irq/28-eth0-rx-18175-21sh09:25:373
29805060,0irq/28-eth0-rx-0-21swapper/311:40:493
259960,0migration/213821-21sh09:40:222
149960,0migration/019754-21sh12:39:030
149960,0migration/016976-21runrttasks10:33:310
8305050,0irq/26-0000:00:0-21swapper/209:30:292
339950,0migration/39508-21kthreadcore08:15:463
339950,0migration/3725-21runrttasks11:51:373
339950,0migration/36901-21taskset10:26:353
339950,0migration/36400-21taskset12:14:203
339950,0migration/34179-21munin-node10:45:403
339950,0migration/33332-21kthreadcore09:50:463
339950,0migration/332272-21taskset07:24:063
339950,0migration/329922-21fschecks_time07:45:453
339950,0migration/329179-21taskset11:32:193
339950,0migration/323471-21aten_r1power_cu09:45:403
339950,0migration/320853-21kthreadcore07:15:453
339950,0migration/319237-21munin-node10:50:483
339950,0migration/318841-21fschecks_count10:35:433
339950,0migration/315927-21sh11:07:363
339950,0migration/314514-21turbostat07:35:283
339950,0migration/310485-21timerwakeupswit07:50:543
329950,0watchdog/330489-21kthreadcore11:15:483
329950,0watchdog/326817-21kthreadcore12:05:483
329950,0watchdog/326185-21kthreadcore07:40:483
329950,0watchdog/319574-21munin-node08:00:443
329950,0watchdog/316915-21diskstats12:20:453
329950,0watchdog/315261-21sh09:40:443
329950,0watchdog/30-21swapper/311:00:443
29815050,0irq/29-eth0-tx-4233-21grep11:20:432
29815050,0irq/29-eth0-tx-29141-21munin-node07:45:460
29815050,0irq/29-eth0-tx-28110-21tr10:05:412
29815050,0irq/29-eth0-tx-2310-21munin-node12:30:442
29815050,0irq/29-eth0-tx-22418-21munin-node09:10:532
29815050,0irq/29-eth0-tx-19392-21tune2fs10:00:422
29815050,0irq/29-eth0-tx-13771-21munin-node10:15:422
29815050,0irq/29-eth0-tx-0-21swapper/210:33:532
29815050,0irq/29-eth0-tx-0-21swapper/209:28:562
29815050,0irq/29-eth0-tx-0-21swapper/209:19:512
29815050,0irq/29-eth0-tx-0-21swapper/007:38:230
29805050,0irq/28-eth0-rx-9442-21ssh09:55:403
29805050,0irq/28-eth0-rx-6314-21runrttasks09:01:403
29805050,0irq/28-eth0-rx-30161-21taskset10:58:023
29805050,0irq/28-eth0-rx-2786-21ssh10:43:193
29805050,0irq/28-eth0-rx-1808-21unixbench_multi09:30:553
29805050,0irq/28-eth0-rx-12850-21kthreadcore12:15:493
29805050,0irq/28-eth0-rx-12318-21awk09:37:273
29805050,0irq/28-eth0-rx-0-21swapper/312:27:393
29805050,0irq/28-eth0-rx-0-21swapper/312:04:173
29805050,0irq/28-eth0-rx-0-21swapper/311:58:113
29805050,0irq/28-eth0-rx-0-21swapper/311:45:483
29805050,0irq/28-eth0-rx-0-21swapper/310:30:483
29805050,0irq/28-eth0-rx-0-21swapper/310:15:423
29805050,0irq/28-eth0-rx-0-21swapper/310:07:293
29805050,0irq/28-eth0-rx-0-21swapper/309:18:583
29805050,0irq/28-eth0-rx-0-21swapper/309:12:093
29805050,0irq/28-eth0-rx-0-21swapper/308:40:453
29805050,0irq/28-eth0-rx-0-21swapper/307:10:283
27150,0ktimersoftd/20-21swapper/212:09:202
27150,0ktimersoftd/20-21swapper/211:32:282
259950,0migration/23888-21gltestperf11:55:432
259950,0migration/230693-21cpuspeed_turbos12:10:442
259950,0migration/230649-21kthreadcore08:50:482
259950,0migration/228154-21kthreadcore07:20:462
259950,0migration/226693-21fschecks_count11:50:442
259950,0migration/226619-21munin-node12:25:442
259950,0migration/22292-21sh10:42:182
259950,0migration/212859-21kthreadcore09:00:472
259950,0migration/212721-21fschecks_count12:00:442
259950,0migration/211510-21kthreadcore12:15:492
249950,0watchdog/25571-21tail10:10:442
249950,0watchdog/25321-21cut10:25:482
249950,0watchdog/217730-21irqcore12:20:492
19150,0ktimersoftd/10-21swapper/111:32:281
179950,0migration/17911-21kthreadcore10:10:481
179950,0migration/16408-21sh11:01:471
179950,0migration/15882-21kthreadcore08:55:461
179950,0migration/14209-21latency_hist08:35:291
179950,0migration/128548-21sh12:07:061
179950,0migration/124502-21munin-node08:00:481
179950,0migration/12222-21kthreadcore08:10:471
179950,0migration/122219-21latency_hist09:10:291
179950,0migration/117233-21cpuspeed_turbos11:45:431
179950,0migration/114639-21kthreadcore12:00:481
179950,0migration/113740-21kthreadcore12:35:451
179950,0migration/113592-21gltestperf11:25:451
169950,0watchdog/111375-21kthreadcore10:30:481
149950,0migration/09777-21runrttasks11:56:070
149950,0migration/09211-21kthreadcore10:10:480
149950,0migration/08755-21kthreadcore09:35:470
149950,0migration/07840-21sh09:52:450
149950,0migration/06259-21kthreadcore11:20:470
149950,0migration/05128-21kthreadcore10:25:480
149950,0migration/04069-21sh10:45:300
149950,0migration/032651-21sh12:26:380
149950,0migration/032502-21sh11:50:540
149950,0migration/032080-21smart_nvme0n108:50:520
149950,0migration/031626-21kthreadcore10:40:480
149950,0migration/02987-21kthreadcore11:35:480
149950,0migration/029567-21kthreadcore10:05:450
149950,0migration/027482-21sh10:05:290
149950,0migration/027476-21sh12:05:510
149950,0migration/027145-21irqrtprio08:05:440
149950,0migration/02676-21kthreadcore07:25:470
149950,0migration/026387-21kthreadcore10:55:460
149950,0migration/024354-21irqcore10:20:440
149950,0migration/022966-21kthreadcore08:45:460
149950,0migration/022242-21kthreadcore08:00:460
149950,0migration/020288-21kthreadcore11:45:480
149950,0migration/017572-21sh09:58:540
149950,0migration/016804-21kthreadcore12:00:490
149950,0migration/015324-21kthreadcore07:55:470
149950,0migration/014950-21kthreadcore08:40:470
149950,0migration/012587-21kthreadcore09:00:470
149950,0migration/012174-21kthreadcore07:30:470
108059955,0cyclictest0-21swapper/212:36:272
108059955,0cyclictest0-21swapper/211:40:292
108059955,0cyclictest0-21swapper/211:00:362
108059955,0cyclictest0-21swapper/209:58:102
108059955,0cyclictest0-21swapper/207:55:492
108059954,0cyclictest4606-21cut10:45:432
108059954,0cyclictest30112-21ssh10:57:552
108059950,0cyclictest0-21swapper/211:07:322
108049955,0cyclictest0-21swapper/112:24:121
108049950,0cyclictest0-21swapper/110:36:221
108049950,0cyclictest0-21swapper/110:07:311
108049950,0cyclictest0-21swapper/110:04:311
108039955,0cyclictest24712-21tr09:45:460
108039955,0cyclictest0-21swapper/012:30:390
108039950,0cyclictest0-21swapper/012:22:460
108039950,0cyclictest0-21swapper/012:12:590
108039950,0cyclictest0-21swapper/011:15:170
108039950,0cyclictest0-21swapper/010:17:160
8305040,0irq/26-0000:00:0-21swapper/208:20:292
339940,0migration/332112-21kthreadcore08:30:463
339940,0migration/318314-21kthreadcore07:35:473
329940,0watchdog/35418-21kthreadcore07:25:483
329940,0watchdog/3326602sleep308:10:083
329940,0watchdog/30-21swapper/309:20:323
329940,0watchdog/30-21swapper/308:10:483
29815040,0irq/29-eth0-tx-9815-21if_eth1.209:20:452
29815040,0irq/29-eth0-tx-12650-21ssh11:25:412
29815040,0irq/29-eth0-tx-11134-21telnet07:10:360
29815040,0irq/29-eth0-tx-0-21swapper/211:45:462
29815040,0irq/29-eth0-tx-0-21swapper/210:20:432
29815040,0irq/29-eth0-tx-0-21swapper/209:45:312
29815040,0irq/29-eth0-tx-0-21swapper/009:10:330
29815040,0irq/29-eth0-tx-0-21swapper/008:33:320
29815040,0irq/29-eth0-tx-0-21swapper/008:25:480
29815040,0irq/29-eth0-tx-0-21swapper/008:18:300
29805040,0irq/28-eth0-rx-20881-21kthreadcore10:00:463
29805040,0irq/28-eth0-rx-0-21swapper/312:30:363
259940,0migration/27778-21latency_hist08:15:292
259940,0migration/23604-21kthreadcore08:55:462
259940,0migration/229681-21cpuspeed_turbos08:30:412
259940,0migration/219087-21fschecks_time07:15:412
259940,0migration/218527-21munin-node08:00:392
259940,0migration/217359-21timerandwakeup07:10:492
259940,0migration/216606-21irqrtprio09:05:452
259940,0migration/215986-21kthreadcore09:40:462
259940,0migration/210727-21runrttasks07:51:592
249940,0watchdog/25011-21cut08:10:482
249940,0watchdog/217697-21sensors_fan08:40:522
179940,0migration/19345-21irqrtprio11:40:481
179940,0migration/18417-21kthreadcore11:55:471
179940,0migration/16058-21kthreadcore11:20:471
179940,0migration/14315-21kthreadcore12:30:461
179940,0migration/131709-21kthreadcore10:40:481
179940,0migration/130680-21sh10:59:101
179940,0migration/129419-21kthreadcore08:50:471
179940,0migration/126969-21fschecks_time11:50:451
179940,0migration/125096-21sh09:26:161
179940,0migration/122628-21fschecks_time07:40:431
179940,0migration/119771-21irqstats07:15:441
179940,0migration/119559-21fschecks_time08:45:421
179940,0migration/119445-21kthreadcore11:10:481
179940,0migration/11858-21unixbench_singl09:30:551
179940,0migration/115433-21kthreadcore08:40:481
179940,0migration/11186-21sh07:25:431
179940,0migration/111829-21kthreadcore08:15:471
179940,0migration/110730-21taskset07:52:021
179940,0migration/110273-21kthreadcore11:05:491
169940,0watchdog/18205-21gltestperf12:15:451
169940,0watchdog/122425-21ssh09:43:561
169940,0watchdog/122144-21diskmemload11:15:481
169940,0watchdog/119425-21grep07:35:481
169940,0watchdog/10-21swapper/109:15:561
169940,0watchdog/10-21swapper/109:00:521
149940,0migration/021133-21kthreadcore10:35:470
149940,0migration/020668-21kthreadcore09:25:470
149940,0migration/015168-21aten_r1power_vo08:20:390
149940,0migration/013783-21forks10:50:430
149940,0migration/01331-21kthreadcore09:15:470
149940,0migration/01164-21fschecks_count08:55:420
108059943,0cyclictest8914-21awk11:40:462
108059943,0cyclictest3524-21snmpd10:50:412
108059943,0cyclictest3524-21snmpd10:36:562
108059943,0cyclictest3524-21snmpd07:46:082
108059943,0cyclictest23046-21awk07:40:452
108059943,0cyclictest18781-21awk11:10:472
108059943,0cyclictest1286-21awk07:25:452
108059941,0cyclictest27243-21fschecks_count11:15:442
108049944,0cyclictest0-21swapper/110:46:081
108049944,0cyclictest0-21swapper/109:13:551
108049943,0cyclictest3524-21snmpd12:27:411
108049943,0cyclictest3524-21snmpd10:27:251
108049943,0cyclictest3524-21snmpd10:16:551
108049943,0cyclictest3524-21snmpd09:51:251
108049943,0cyclictest3524-21snmpd09:20:541
108049943,0cyclictest3524-21snmpd08:25:391
108049943,0cyclictest32704-21sadc08:10:281
108049943,0cyclictest30191-21awk07:45:461
108049943,0cyclictest24566-21awk09:45:451
108049943,0cyclictest12450-21awk07:55:451
108049943,0cyclictest0-21swapper/111:36:361
108039944,0cyclictest0-21swapper/009:42:350
108039943,0cyclictest8359-21awk12:15:460
108039943,0cyclictest5294-21awk08:35:460
108039943,0cyclictest3524-21snmpd11:29:410
329930,0watchdog/30-21swapper/308:52:043
329930,0watchdog/30-21swapper/308:37:283
329930,0watchdog/30-21swapper/308:25:323
29805030,0irq/28-eth0-rx-0-21swapper/309:05:403
29805030,0irq/28-eth0-rx-0-21swapper/308:55:403
29805030,0irq/28-eth0-rx-0-21swapper/308:20:383
249930,0watchdog/20-21swapper/208:45:322
249930,0watchdog/20-21swapper/208:35:442
169930,0watchdog/10-21swapper/112:10:481
169930,0watchdog/10-21swapper/109:36:441
108059930,0cyclictest8090-21fschecks_count07:30:432
108059930,0cyclictest23056-21perl08:25:462
108059930,0cyclictest20577-21mdstat07:35:482
108049932,0cyclictest3571-21lldpd07:23:561
108049932,0cyclictest3524-21snmpd08:23:301
108049932,0cyclictest3189-21sensors08:30:501
108049932,0cyclictest24272-21irqcore10:20:441
108049932,0cyclictest11917-21grep07:10:381
108049932,0cyclictest10598-21awk09:55:451
108049930,0cyclictest14110-21perl10:50:431
108049930,0cyclictest0-21swapper/107:30:411
108039933,0cyclictest9995-21kworker/0:007:50:320
108039933,0cyclictest9995-21kworker/0:007:40:300
108039933,0cyclictest9995-21kworker/0:007:15:340
108039933,0cyclictest9648-21kworker/0:109:30:380
108039933,0cyclictest9648-21kworker/0:109:20:500
108039933,0cyclictest32605-21kworker/0:111:40:310
108039933,0cyclictest32605-21kworker/0:111:30:330
108039933,0cyclictest32605-21kworker/0:111:15:330
108039933,0cyclictest23443-21kworker/0:211:00:300
108039933,0cyclictest12246-21kworker/0:109:05:340
108039933,0cyclictest12246-21kworker/0:108:10:380
329920,0watchdog/30-21swapper/308:45:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional