You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 14:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Sun Nov 30, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3024325854,0sleep00-21swapper/006:18:350
3024325854,0sleep00-21swapper/006:18:350
3028023837,0sleep20-21swapper/206:19:012
3028023837,0sleep20-21swapper/206:19:012
3019923828,0sleep30-21swapper/306:18:053
3019923828,0sleep30-21swapper/306:18:053
3005223526,0sleep10-21swapper/106:16:191
3005223526,0sleep10-21swapper/106:16:191
329980,0watchdog/30-21swapper/308:36:123
329970,0watchdog/30-21swapper/309:05:323
29925070,0irq/32-eth0-rx-0-21swapper/311:01:033
339960,0migration/3837-21sendmail_mailqu06:39:453
339960,0migration/36228-21munin-node11:24:503
339960,0migration/323986-21sh09:42:093
339960,0migration/322748-21munin-node11:34:433
339960,0migration/31488-21sh10:08:403
339960,0migration/314551-21sh09:18:093
329960,0watchdog/39777-21fschecks_count06:49:403
329960,0watchdog/328990-21kthreadcore09:44:443
329960,0watchdog/30-21swapper/311:39:513
329960,0watchdog/30-21swapper/311:39:513
329960,0watchdog/30-21swapper/311:32:113
329960,0watchdog/30-21swapper/311:14:353
329960,0watchdog/30-21swapper/311:09:553
329960,0watchdog/30-21swapper/310:54:353
329960,0watchdog/30-21swapper/310:16:153
329960,0watchdog/30-21swapper/310:00:353
329960,0watchdog/30-21swapper/309:59:073
329960,0watchdog/30-21swapper/309:24:563
329960,0watchdog/30-21swapper/309:21:363
329960,0watchdog/30-21swapper/308:34:203
329960,0watchdog/30-21swapper/308:27:003
329960,0watchdog/30-21swapper/307:03:203
304029963,0cyclictest0-21swapper/010:59:230
29925060,0irq/32-eth0-rx-9656-21unixbench_singl10:29:513
29925060,0irq/32-eth0-rx-6574-21perl07:09:383
29925060,0irq/32-eth0-rx-4420-21sh11:05:093
29925060,0irq/32-eth0-rx-2449-21memory08:49:413
29925060,0irq/32-eth0-rx-23136-21cut10:39:423
29925060,0irq/32-eth0-rx-0-21swapper/310:47:343
29925060,0irq/32-eth0-rx-0-21swapper/310:11:413
29925060,0irq/32-eth0-rx-0-21swapper/309:35:283
29925060,0irq/32-eth0-rx-0-21swapper/309:30:393
29925060,0irq/32-eth0-rx-0-21swapper/308:56:363
29925060,0irq/32-eth0-rx-0-21swapper/308:47:023
29925060,0irq/32-eth0-rx-0-21swapper/308:41:183
19160,0ktimersoftd/10-21swapper/109:59:471
149960,0migration/012601-21munin-node11:09:470
8315050,0irq/26-0000:00:0-21swapper/306:34:523
339950,0migration/38777-21timerwakeupswit08:14:493
339950,0migration/34364-21munin-node06:19:453
339950,0migration/331656-21kthreadcore07:24:443
339950,0migration/328000-21kthreadcore11:19:433
339950,0migration/31987-21munin-node06:44:373
339950,0migration/315503-21kthreadcore07:14:423
339950,0migration/310886-21kthreadcore06:24:443
329950,0watchdog/32135-21if_eth1.209:49:403
329950,0watchdog/30-21swapper/310:34:353
329950,0watchdog/30-21swapper/310:24:313
329950,0watchdog/30-21swapper/310:19:393
329950,0watchdog/30-21swapper/308:19:443
329950,0watchdog/30-21swapper/308:10:483
329950,0watchdog/30-21swapper/308:05:003
329950,0watchdog/30-21swapper/308:02:003
329950,0watchdog/30-21swapper/307:54:283
329950,0watchdog/30-21swapper/307:49:363
329950,0watchdog/30-21swapper/307:44:443
329950,0watchdog/30-21swapper/307:40:523
329950,0watchdog/30-21swapper/307:34:283
329950,0watchdog/30-21swapper/307:29:443
329950,0watchdog/30-21swapper/307:04:363
329950,0watchdog/30-21swapper/306:56:203
329950,0watchdog/30-21swapper/306:29:243
304149955,0cyclictest0-21swapper/210:09:262
304149955,0cyclictest0-21swapper/208:43:022
304149950,0cyclictest0-21swapper/209:04:572
304149950,0cyclictest0-21swapper/208:29:102
304099955,0cyclictest0-21swapper/111:24:361
304099955,0cyclictest0-21swapper/109:45:071
304099955,0cyclictest0-21swapper/108:36:321
304099950,0cyclictest0-21swapper/111:48:531
304099950,0cyclictest0-21swapper/110:15:141
304099950,0cyclictest0-21swapper/109:34:241
304099950,0cyclictest0-21swapper/109:16:161
304029955,0cyclictest0-21swapper/010:30:280
304029955,0cyclictest0-21swapper/009:21:150
304029955,0cyclictest0-21swapper/008:51:370
29935050,0irq/33-eth0-tx-9306-21munin-node09:54:472
29935050,0irq/33-eth0-tx-26048-21munin-node10:04:512
29935050,0irq/33-eth0-tx-12987-21munin-node07:14:470
29935050,0irq/33-eth0-tx-0-21swapper/211:37:052
29935050,0irq/33-eth0-tx-0-21swapper/210:37:002
29935050,0irq/33-eth0-tx-0-21swapper/209:39:472
29935050,0irq/33-eth0-tx-0-21swapper/008:19:300
29935050,0irq/33-eth0-tx-0-21swapper/008:09:350
29935050,0irq/33-eth0-tx-0-21swapper/008:04:360
29935050,0irq/33-eth0-tx-0-21swapper/007:54:470
29935050,0irq/33-eth0-tx-0-21swapper/007:49:370
29935050,0irq/33-eth0-tx-0-21swapper/006:29:400
29925050,0irq/32-eth0-rx-0-21swapper/311:44:333
29925050,0irq/32-eth0-rx-0-21swapper/310:49:363
29925050,0irq/32-eth0-rx-0-21swapper/309:09:413
29925050,0irq/32-eth0-rx-0-21swapper/308:59:493
29925050,0irq/32-eth0-rx-0-21swapper/307:19:383
27150,0ktimersoftd/20-21swapper/209:50:252
259950,0migration/25997-21aten_r1power_fr07:54:362
259950,0migration/217003-21sh10:15:032
259950,0migration/214124-21latency11:29:412
19150,0ktimersoftd/10-21swapper/109:50:251
179950,0migration/130032-21kthreadcore11:39:441
179950,0migration/130032-21kthreadcore11:39:441
179950,0migration/127779-21munin-node07:24:391
179950,0migration/127249-21latency_hist07:24:231
179950,0migration/122656-21ntp_offset07:39:441
149950,0migration/09199-21kthreadcore08:54:410
149950,0migration/08192-21kthreadcore06:24:430
149950,0migration/07067-21cpuspeed_turbos09:14:380
149950,0migration/05619-21kthreadcore09:29:440
149950,0migration/04192-21kthreadcore07:29:420
149950,0migration/029783-21kthreadcore10:24:430
149950,0migration/029020-21sh11:02:400
149950,0migration/028719-21kthreadcore08:29:410
149950,0migration/028042-21sh10:44:230
149950,0migration/027997-21kthreadcore11:39:430
149950,0migration/027997-21kthreadcore11:39:430
149950,0migration/027105-21kthreadcore07:44:420
149950,0migration/027009-21latency_hist06:39:230
149950,0migration/026455-21switchtime07:19:500
149950,0migration/025585-21kthreadcore11:19:420
149950,0migration/025373-21taskset10:03:110
149950,0migration/025142-21munin-node09:44:370
149950,0migration/023973-21kthreadcore10:39:420
149950,0migration/023541-21latency_hist06:59:230
149950,0migration/022008-21kthreadcore09:39:440
149950,0migration/021725-21sh11:15:280
149950,0migration/01908-21aten_r1power_cu06:44:370
149950,0migration/018790-21kthreadcore11:34:420
149950,0migration/01826-21munin-node11:44:370
149950,0migration/017859-21smart_sdb08:39:470
149950,0migration/017542-21fschecks_time07:39:380
149950,0migration/017518-21sh10:16:350
149950,0migration/014074-21fschecks_count08:59:370
149950,0migration/013281-21kthreadcore11:29:410
149950,0migration/012279-21kthreadcore09:54:430
149950,0migration/011610-21taskset10:51:550
149950,0migration/010214-21sh08:36:380
304149943,0cyclictest9298-21awk09:34:402
304149943,0cyclictest6685-21awk06:24:422
304149943,0cyclictest3599-21lldpd08:54:232
304149943,0cyclictest2655-21awk11:44:392
304149943,0cyclictest23871-21snmpd08:13:512
304149943,0cyclictest23871-21snmpd07:44:512
304149943,0cyclictest23871-21snmpd07:01:212
304149943,0cyclictest23871-21snmpd06:57:212
304149943,0cyclictest23871-21snmpd06:45:512
304149943,0cyclictest23871-21snmpd06:33:062
304149943,0cyclictest21235-21awk07:19:402
304149943,0cyclictest15983-21awk11:14:412
304099944,0cyclictest0-21swapper/109:09:291
304099943,0cyclictest9344-21awk11:29:381
304099943,0cyclictest3599-21lldpd10:48:161
304099943,0cyclictest3599-21lldpd09:27:111
304099943,0cyclictest3599-21lldpd09:00:011
304099943,0cyclictest3599-21lldpd08:55:531
304099943,0cyclictest3599-21lldpd08:45:231
304099943,0cyclictest3599-21lldpd08:01:311
304099943,0cyclictest3599-21lldpd07:15:321
304099943,0cyclictest3599-21lldpd07:09:301
304099943,0cyclictest3262-21irqbalance10:55:071
304099943,0cyclictest3262-21irqbalance09:22:571
304099943,0cyclictest3262-21irqbalance08:24:281
304099943,0cyclictest3262-21irqbalance08:05:081
304099943,0cyclictest3262-21irqbalance07:49:581
304099943,0cyclictest3079-21awk06:44:411
304099943,0cyclictest28101-21awk10:24:411
304099943,0cyclictest27134-21awk10:04:411
304099943,0cyclictest25020-21awk07:44:401
304099943,0cyclictest19862-21awk10:19:491
304099943,0cyclictest16457-21sadc07:39:231
304099943,0cyclictest12627-21awk10:34:401
304099943,0cyclictest12549-21awk08:39:391
304099943,0cyclictest11508-21grep06:24:451
304029943,0cyclictest2127-21awk09:49:390
304029943,0cyclictest19741-21awk10:19:480
304029940,0cyclictest0-21swapper/007:09:420
29935040,0irq/33-eth0-tx-8005-21ssh09:14:422
29935040,0irq/33-eth0-tx-4889-21ssh11:06:342
29935040,0irq/33-eth0-tx-28834-21ssh08:49:252
29935040,0irq/33-eth0-tx-21312-21munin-node10:59:402
29935040,0irq/33-eth0-tx-14840-21ps08:59:412
29935040,0irq/33-eth0-tx-0-21swapper/211:41:442
29935040,0irq/33-eth0-tx-0-21swapper/211:41:442
29935040,0irq/33-eth0-tx-0-21swapper/211:24:362
29935040,0irq/33-eth0-tx-0-21swapper/211:19:232
29935040,0irq/33-eth0-tx-0-21swapper/211:10:032
29935040,0irq/33-eth0-tx-0-21swapper/210:49:302
29935040,0irq/33-eth0-tx-0-21swapper/210:44:352
29935040,0irq/33-eth0-tx-0-21swapper/210:39:352
29935040,0irq/33-eth0-tx-0-21swapper/210:29:312
29935040,0irq/33-eth0-tx-0-21swapper/210:19:482
29935040,0irq/33-eth0-tx-0-21swapper/209:59:252
29935040,0irq/33-eth0-tx-0-21swapper/209:46:072
29935040,0irq/33-eth0-tx-0-21swapper/209:24:352
29935040,0irq/33-eth0-tx-0-21swapper/209:19:362
29935040,0irq/33-eth0-tx-0-21swapper/208:34:472
29935040,0irq/33-eth0-tx-0-21swapper/208:20:552
29935040,0irq/33-eth0-tx-0-21swapper/008:17:420
29935040,0irq/33-eth0-tx-0-21swapper/007:59:440
29935040,0irq/33-eth0-tx-0-21swapper/007:04:420
29935040,0irq/33-eth0-tx-0-21swapper/006:54:420
29935040,0irq/33-eth0-tx-0-21swapper/006:39:330
259940,0migration/26264-21munin-node09:29:522
259940,0migration/24416-21kthreadcore08:14:422
259940,0migration/231493-21fschecks_time09:09:402
259940,0migration/231215-21fschecks_count06:19:372
259940,0migration/228992-21kthreadcore08:29:412
259940,0migration/222420-21kthreadcore08:44:412
259940,0migration/220736-21munin-node08:04:382
259940,0migration/216604-21latency_hist07:39:232
259940,0migration/212795-21latency_hist07:14:232
249940,0watchdog/228244-21perl07:24:402
249940,0watchdog/219881-21sh10:56:072
249940,0watchdog/20-21swapper/210:24:312
249940,0watchdog/20-21swapper/207:29:402
249940,0watchdog/20-21swapper/206:49:402
179940,0migration/19643-21forks06:49:401
179940,0migration/18209-21kthreadcore07:54:421
179940,0migration/132529-21kthreadcore07:04:421
179940,0migration/131946-21latency_hist09:29:231
179940,0migration/131625-21kthreadcore08:29:421
179940,0migration/128915-21aten2.4-expect08:49:331
179940,0migration/12494-21aten_r1power_vo08:14:361
179940,0migration/123523-21taskset09:40:491
179940,0migration/120664-21fschecks_time06:34:391
169940,0watchdog/19389-21diskmemload10:30:031
169940,0watchdog/13045-21cat10:09:391
169940,0watchdog/129892-21rm11:04:271
169940,0watchdog/129260-40yum-updatesd-he11:03:191
169940,0watchdog/126613-21taskset10:40:031
169940,0watchdog/124438-21cut09:04:441
169940,0watchdog/116707-21ssh09:57:281
169940,0watchdog/115613-21missed_timers08:19:441
169940,0watchdog/10-21swapper/110:49:471
169940,0watchdog/10-21swapper/106:29:441
169940,0watchdog/10-21swapper/106:19:361
149940,0migration/027758-21kthreadcore09:04:450
149940,0migration/023846-21kthreadcore08:44:420
149940,0migration/01750-21kthreadcore06:19:420
149940,0migration/016746-21kthreadcore10:34:420
149940,0migration/014245-21kthreadcore07:34:430
304149932,0cyclictest23871-21snmpd07:37:062
304149932,0cyclictest20997-21awk06:34:412
304149932,0cyclictest13725-21grep07:59:382
304149931,0cyclictest31809-21kthreadcore06:39:422
304149930,0cyclictest31470-21diskstats07:49:382
304099932,0cyclictest3262-21irqbalance08:09:281
304099932,0cyclictest24819-21awk06:59:531
304099932,0cyclictest17323-21grep11:34:381
304099932,0cyclictest16169-21cut11:14:421
304029933,0cyclictest27828-21kworker/0:211:04:400
304029933,0cyclictest26513-21kworker/0:008:25:060
304029933,0cyclictest16231-21kworker/0:010:11:480
304029933,0cyclictest0-21swapper/009:09:260
304029932,0cyclictest27934-21grep09:24:420
304029932,0cyclictest15140-21ssh09:35:370
304029932,0cyclictest13693-21kworker/0:006:49:480
304029932,0cyclictest11990-21kworker/0:207:24:520
304029930,0cyclictest26769-21perl10:04:390
259930,0migration/219714-21runrttasks07:16:462
249930,0watchdog/230875-21munin-node07:04:402
169930,0watchdog/11297-21chrt06:40:201
169930,0watchdog/10-21swapper/111:19:351
169930,0watchdog/10-21swapper/111:09:231
169930,0watchdog/10-21swapper/107:29:401
169930,0watchdog/10-21swapper/106:54:241
304029920,0cyclictest0-21swapper/011:24:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional