You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-05 - 21:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Jul 05, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2366424940,0sleep20-21swapper/206:24:112
2373423825,0sleep10-21swapper/106:24:581
2372623828,0sleep30-21swapper/306:24:523
1802423524,0sleep00-21swapper/006:23:410
329970,0watchdog/39571-21perl08:08:393
329970,0watchdog/323213-21kthreadcore09:33:433
329970,0watchdog/30-21swapper/308:38:353
329970,0watchdog/30-21swapper/308:13:393
329970,0watchdog/30-21swapper/307:08:443
29925070,0irq/32-eth0-rx-0-21swapper/310:23:453
29925070,0irq/32-eth0-rx-0-21swapper/309:58:423
29925070,0irq/32-eth0-rx-0-21swapper/309:43:423
35160,0ktimersoftd/30-21swapper/310:53:463
329960,0watchdog/30-21swapper/311:53:473
329960,0watchdog/30-21swapper/311:52:233
329960,0watchdog/30-21swapper/311:34:153
329960,0watchdog/30-21swapper/311:04:153
329960,0watchdog/30-21swapper/310:44:553
329960,0watchdog/30-21swapper/309:57:553
329960,0watchdog/30-21swapper/308:59:353
329960,0watchdog/30-21swapper/308:02:473
329960,0watchdog/30-21swapper/307:26:073
329960,0watchdog/30-21swapper/307:16:233
329960,0watchdog/30-21swapper/306:28:443
29935060,0irq/33-eth0-tx-24319-21munin-node06:28:470
29925060,0irq/32-eth0-rx-9937-21perl10:58:383
29925060,0irq/32-eth0-rx-6123-21ssh11:31:573
29925060,0irq/32-eth0-rx-32246-21fschecks_count06:33:393
29925060,0irq/32-eth0-rx-31323-21python11:43:443
29925060,0irq/32-eth0-rx-27079-21grep10:48:423
29925060,0irq/32-eth0-rx-19698-21sh09:29:063
29925060,0irq/32-eth0-rx-19682-21kthreadcore10:08:433
29925060,0irq/32-eth0-rx-0-21swapper/311:20:113
29925060,0irq/32-eth0-rx-0-21swapper/311:14:113
29925060,0irq/32-eth0-rx-0-21swapper/310:20:313
29925060,0irq/32-eth0-rx-0-21swapper/309:48:483
29925060,0irq/32-eth0-rx-0-21swapper/309:15:363
29925060,0irq/32-eth0-rx-0-21swapper/309:10:133
29925060,0irq/32-eth0-rx-0-21swapper/308:56:103
29925060,0irq/32-eth0-rx-0-21swapper/308:36:523
29925060,0irq/32-eth0-rx-0-21swapper/308:32:553
29925060,0irq/32-eth0-rx-0-21swapper/307:18:473
149960,0migration/019226-21kthreadcore09:48:410
149960,0migration/012298-21taskset10:38:460
339950,0migration/3999-21irqrtprio08:43:423
339950,0migration/32410-21smart_sdb06:53:513
339950,0migration/321410-21cpuspeed_turbos06:48:383
339950,0migration/321327-21latency_hist11:23:233
339950,0migration/320702-21taskset06:45:433
339950,0migration/311920-21kthreadcore06:38:463
329950,0watchdog/30-21swapper/311:38:593
329950,0watchdog/30-21swapper/310:38:353
329950,0watchdog/30-21swapper/310:13:233
329950,0watchdog/30-21swapper/309:03:433
329950,0watchdog/30-21swapper/308:48:273
329950,0watchdog/30-21swapper/308:23:393
329950,0watchdog/30-21swapper/308:05:233
329950,0watchdog/30-21swapper/307:53:433
329950,0watchdog/30-21swapper/307:46:193
329950,0watchdog/30-21swapper/307:38:433
329950,0watchdog/30-21swapper/307:33:273
329950,0watchdog/30-21swapper/307:28:313
329950,0watchdog/30-21swapper/307:04:363
329950,0watchdog/30-21swapper/306:58:443
29935050,0irq/33-eth0-tx-8696-21munin-node08:08:420
29935050,0irq/33-eth0-tx-5771-21munin-node10:38:352
29935050,0irq/33-eth0-tx-53351diskmemload08:34:192
29935050,0irq/33-eth0-tx-320-21ssh11:46:322
29935050,0irq/33-eth0-tx-29269-21ssh11:26:172
29935050,0irq/33-eth0-tx-22257-21munin-node07:33:390
29935050,0irq/33-eth0-tx-1751-21ntp_kernel_pll_09:18:452
29935050,0irq/33-eth0-tx-0-21swapper/211:41:032
29935050,0irq/33-eth0-tx-0-21swapper/210:18:292
29935050,0irq/33-eth0-tx-0-21swapper/209:47:482
29935050,0irq/33-eth0-tx-0-21swapper/007:38:500
29935050,0irq/33-eth0-tx-0-21swapper/007:11:120
29935050,0irq/33-eth0-tx-0-21swapper/006:51:100
29925050,0irq/32-eth0-rx-557-21tr09:38:433
29925050,0irq/32-eth0-rx-13019-21chrt07:48:413
29925050,0irq/32-eth0-rx-0-21swapper/311:08:303
29925050,0irq/32-eth0-rx-0-21swapper/311:08:303
29925050,0irq/32-eth0-rx-0-21swapper/310:33:313
29925050,0irq/32-eth0-rx-0-21swapper/310:28:293
29925050,0irq/32-eth0-rx-0-21swapper/310:03:453
29925050,0irq/32-eth0-rx-0-21swapper/309:23:253
29925050,0irq/32-eth0-rx-0-21swapper/309:19:093
29925050,0irq/32-eth0-rx-0-21swapper/308:18:413
259950,0migration/28730-21if_eth007:23:402
259950,0migration/2837-21kthreadcore07:38:432
259950,0migration/24929-21sh10:37:022
259950,0migration/24281-21kthreadcore11:48:452
259950,0migration/227039-21sh09:16:372
259950,0migration/226098-21kthreadcore08:38:422
259950,0migration/224784-21sh08:56:332
259950,0migration/224085-21kthreadcore07:33:412
259950,0migration/220783-21kthreadcore10:08:442
259950,0migration/216753-21pmu-power11:53:462
240969955,0cyclictest0-21swapper/208:28:482
240969955,0cyclictest0-21swapper/208:08:422
240959950,0cyclictest0-21swapper/111:38:241
240949955,0cyclictest0-21swapper/010:55:390
240949955,0cyclictest0-21swapper/008:55:210
240949955,0cyclictest0-21swapper/008:32:580
240949950,0cyclictest0-21swapper/009:25:090
240949950,0cyclictest0-21swapper/008:18:280
240949950,0cyclictest0-21swapper/006:44:010
179950,0migration/15660-21kthreadcore07:18:431
179950,0migration/13390-21kthreadcore11:48:441
179950,0migration/131673-21turbostat09:58:231
179950,0migration/12554-21taskset09:19:211
179950,0migration/114921-21latency_hist07:28:231
149950,0migration/09441-21cpuspeed_turbos10:58:370
149950,0migration/07957-21kthreadcore07:43:430
149950,0migration/05331-21sh08:28:230
149950,0migration/04994-21kthreadcore07:18:430
149950,0migration/04756-21taskset09:39:410
149950,0migration/030878-21kthreadcore11:08:430
149950,0migration/030878-21kthreadcore11:08:430
149950,0migration/026971-21kthreadcore07:13:430
149950,0migration/025787-21kthreadcore10:48:420
149950,0migration/023807-21timerwakeupswit10:08:520
149950,0migration/023419-21kthreadcore10:28:430
149950,0migration/022960-21irqrtprio09:33:430
149950,0migration/022730-21irqcore11:23:400
149950,0migration/021554-21kthreadcore09:13:430
149950,0migration/021518-21kthreadcore07:53:430
149950,0migration/018658-21needreboot11:18:430
149950,0migration/018431-21sh10:24:460
149950,0migration/01773-21munin-node11:48:400
149950,0migration/017088-21if_eth111:38:390
149950,0migration/016667-21fschecks_time08:13:360
149950,0migration/016368-21kthreadcore09:08:430
149950,0migration/015927-21munin-node10:43:400
149950,0migration/014510-21kthreadcore07:48:420
149950,0migration/012959-21aten_r1power_fr09:28:360
149950,0migration/012793-21switchtime09:43:500
149950,0migration/012302-21kthreadcore06:38:460
149950,0migration/012044-21sh11:17:550
149950,0migration/011449-21fschecks_time07:03:380
8315040,0irq/26-0000:00:0-21swapper/207:23:232
29935040,0irq/33-eth0-tx-4434-21kthreadcore09:03:422
29935040,0irq/33-eth0-tx-3741-21ssh11:13:352
29935040,0irq/33-eth0-tx-30359-21ssh11:28:282
29935040,0irq/33-eth0-tx-12592-21head11:18:352
29935040,0irq/33-eth0-tx-11294-21munin-node10:23:402
29935040,0irq/33-eth0-tx-11135-21ssh09:23:522
29935040,0irq/33-eth0-tx-0-21swapper/211:33:242
29935040,0irq/33-eth0-tx-0-21swapper/210:59:102
29935040,0irq/33-eth0-tx-0-21swapper/210:43:312
29935040,0irq/33-eth0-tx-0-21swapper/210:28:392
29935040,0irq/33-eth0-tx-0-21swapper/210:13:372
29935040,0irq/33-eth0-tx-0-21swapper/210:03:402
29935040,0irq/33-eth0-tx-0-21swapper/209:53:382
29935040,0irq/33-eth0-tx-0-21swapper/209:38:352
29935040,0irq/33-eth0-tx-0-21swapper/209:28:382
29935040,0irq/33-eth0-tx-0-21swapper/208:58:462
29935040,0irq/33-eth0-tx-0-21swapper/208:48:382
29935040,0irq/33-eth0-tx-0-21swapper/007:23:490
259940,0migration/228847-21kthreadcore11:08:432
259940,0migration/228847-21kthreadcore11:08:432
259940,0migration/227042-21kthreadcore10:48:422
259940,0migration/22618-21kthreadcore09:58:412
259940,0migration/224938-21fschecks_count06:28:392
259940,0migration/222448-21irqcore06:48:422
259940,0migration/218096-21aten_r1power_en07:08:372
259940,0migration/213827-21latency_hist06:43:232
259940,0migration/213032-21kthreadcore09:08:422
240969943,0cyclictest31768-21awk08:23:422
240969943,0cyclictest27572-21awk07:58:432
240969943,0cyclictest15906-21awk09:48:382
240969940,0cyclictest0-21swapper/207:06:252
240959944,0cyclictest0-21swapper/109:05:481
240959943,0cyclictest8680-21awk07:23:401
240959943,0cyclictest7411-21awk09:43:411
240959943,0cyclictest5615-21awk07:43:401
240959943,0cyclictest3658-21awk10:18:421
240959943,0cyclictest3599-21lldpd07:54:291
240959943,0cyclictest3262-21irqbalance08:06:471
240959943,0cyclictest31485-21awk11:28:381
240959943,0cyclictest27652-21sadc09:18:231
240959943,0cyclictest27124-21awk10:13:381
240959943,0cyclictest23871-21snmpd11:26:431
240959943,0cyclictest23871-21snmpd10:08:281
240959943,0cyclictest23871-21snmpd08:54:131
240959943,0cyclictest23871-21snmpd08:38:431
240959943,0cyclictest23871-21snmpd08:35:131
240959943,0cyclictest23871-21snmpd08:32:131
240959943,0cyclictest23871-21snmpd07:09:431
240959943,0cyclictest23871-21snmpd06:55:431
240959943,0cyclictest22334-21awk06:48:411
240959943,0cyclictest19274-21awk11:03:421
240959943,0cyclictest13760-21grep11:18:401
240959940,0cyclictest0-21swapper/110:24:561
240959940,0cyclictest0-21swapper/108:43:241
240949944,0cyclictest0-21swapper/011:53:300
240949944,0cyclictest0-21swapper/011:29:230
240949944,0cyclictest0-21swapper/009:04:010
240949943,0cyclictest534-21awk09:58:390
240949943,0cyclictest32673-21awk06:33:410
240949943,0cyclictest27099-21awk10:13:380
240949943,0cyclictest24177-21awk08:38:400
240949943,0cyclictest23871-21snmpd11:37:280
240949943,0cyclictest23871-21snmpd08:43:430
240949943,0cyclictest23871-21snmpd07:58:430
249940,0watchdog/2958-21fschecks_time10:53:392
249940,0watchdog/224603-21switchtime11:03:512
249940,0watchdog/220903-21munin-node07:28:432
249940,0watchdog/218606-21cut08:13:392
249940,0watchdog/210833-21python07:43:472
249940,0watchdog/20-21swapper/209:33:392
249940,0watchdog/20-21swapper/208:43:392
249940,0watchdog/20-21swapper/207:53:432
249940,0watchdog/20-21swapper/206:33:442
179940,0migration/19936-21kthreadcore09:23:421
179940,0migration/19091-21kthreadcore11:33:411
179940,0migration/18687-21taskset08:08:301
179940,0migration/16313-21fschecks_count10:38:361
179940,0migration/15791-21kthreadcore11:13:401
179940,0migration/14864-21taskset09:40:031
179940,0migration/131832-21latency_hist09:58:231
179940,0migration/130493-21users10:48:511
179940,0migration/13019-21kthreadcore06:33:431
179940,0migration/129999-21fschecks_count07:38:381
179940,0migration/126878-21munin-node08:58:411
179940,0migration/126431-21aten_r1power_en07:58:381
179940,0migration/12281-21runrttasks11:11:011
179940,0migration/12281-21runrttasks11:11:011
179940,0migration/121460-21aten_r1power_cu09:33:361
179940,0migration/119082-21kthreadcore06:43:461
179940,0migration/118215-21kthreadcore10:43:421
179940,0migration/116929-21gltestperf08:13:361
179940,0migration/116598-21sh11:00:201
179940,0migration/115232-21sh10:04:011
179940,0migration/114900-21timerandwakeup08:48:501
179940,0migration/113105-21cpuspeed_turbos09:28:371
169940,0watchdog/13516-21cut10:53:431
169940,0watchdog/129580-21df_inode10:33:391
169940,0watchdog/128290-21ssh10:31:591
169940,0watchdog/118563-21ssh11:57:031
169940,0watchdog/10-21swapper/111:43:431
169940,0watchdog/10-21swapper/106:58:441
149940,0migration/025677-21runrttasks11:05:430
149940,0migration/022049-21latency_hist07:33:230
149940,0migration/011511-21kthreadcore10:03:410
240969933,0cyclictest24457-21awk08:18:392
240969932,0cyclictest4614-21awk06:58:412
240969932,0cyclictest23871-21snmpd06:53:432
240969932,0cyclictest12160-21df_abs07:48:372
240959932,0cyclictest3262-21irqbalance06:28:271
240959932,0cyclictest24361-21awk08:18:381
240959932,0cyclictest12855-21awk07:48:401
240949933,0cyclictest17755-21kworker/0:010:33:270
240949933,0cyclictest13744-21kworker/0:110:18:270
240949933,0cyclictest13744-21kworker/0:109:53:230
240949933,0cyclictest13744-21kworker/0:109:18:230
240949933,0cyclictest13744-21kworker/0:108:58:250
240949933,0cyclictest13744-21kworker/0:108:48:250
240949933,0cyclictest13744-21kworker/0:108:33:260
240949933,0cyclictest13744-21kworker/0:108:03:240
240949933,0cyclictest13744-21kworker/0:106:58:260
240949933,0cyclictest13744-21kworker/0:106:53:240
240949933,0cyclictest10149-21kworker/0:211:43:270
249930,0watchdog/20-21swapper/207:13:522
249930,0watchdog/20-21swapper/206:38:402
179930,0migration/119363-21kthreadcore09:48:411
169930,0watchdog/13780-21ksmtuned07:33:231
169930,0watchdog/10-21swapper/109:09:351
169930,0watchdog/10-21swapper/108:23:431
169930,0watchdog/10-21swapper/107:13:441
169930,0watchdog/10-21swapper/107:03:441
240969921,0cyclictest0-21swapper/208:03:232
169920,0watchdog/10-21swapper/106:38:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional