You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 04:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 04, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1261324026,0sleep00-21swapper/018:17:350
1258523727,0sleep30-21swapper/318:17:143
1248723526,0sleep20-21swapper/218:16:052
1244823526,0sleep10-21swapper/118:15:401
12827991212,0cyclictest9491-21sadc18:39:102
329980,0watchdog/30-21swapper/320:59:273
329970,0watchdog/30-21swapper/321:24:313
329970,0watchdog/30-21swapper/319:14:393
29925070,0irq/32-eth0-rx-0-21swapper/323:26:253
29925070,0irq/32-eth0-rx-0-21swapper/320:36:363
8315060,0irq/26-0000:00:13005-21crond22:04:102
4160,0ktimersoftd/00-21swapper/023:38:020
339960,0migration/331426-21sh23:48:233
339960,0migration/324536-21sh22:44:473
339960,0migration/323345-21munin-node20:14:303
329960,0watchdog/3299250irq/32-eth0-rx-22:09:113
329960,0watchdog/323855-21sh21:14:193
329960,0watchdog/30-21swapper/323:42:553
329960,0watchdog/30-21swapper/323:22:433
329960,0watchdog/30-21swapper/323:10:393
329960,0watchdog/30-21swapper/323:04:393
329960,0watchdog/30-21swapper/322:58:073
329960,0watchdog/30-21swapper/322:41:593
329960,0watchdog/30-21swapper/322:34:233
329960,0watchdog/30-21swapper/322:29:553
329960,0watchdog/30-21swapper/322:08:513
329960,0watchdog/30-21swapper/321:42:113
329960,0watchdog/30-21swapper/321:11:393
329960,0watchdog/30-21swapper/320:52:073
329960,0watchdog/30-21swapper/320:27:393
329960,0watchdog/30-21swapper/319:51:073
329960,0watchdog/30-21swapper/319:09:393
29935060,0irq/33-eth0-tx-0-21swapper/020:20:210
29935060,0irq/33-eth0-tx-0-21swapper/019:50:480
29935060,0irq/33-eth0-tx-0-21swapper/019:08:160
29935060,0irq/33-eth0-tx-0-21swapper/018:49:310
29925060,0irq/32-eth0-rx-10010-21cut20:44:303
29925060,0irq/32-eth0-rx-0-21swapper/323:17:333
29925060,0irq/32-eth0-rx-0-21swapper/322:23:503
29925060,0irq/32-eth0-rx-0-21swapper/322:01:423
29925060,0irq/32-eth0-rx-0-21swapper/321:54:223
29925060,0irq/32-eth0-rx-0-21swapper/321:44:283
29925060,0irq/32-eth0-rx-0-21swapper/321:32:023
29925060,0irq/32-eth0-rx-0-21swapper/321:19:253
29925060,0irq/32-eth0-rx-0-21swapper/320:20:103
29925060,0irq/32-eth0-rx-0-21swapper/319:39:273
149960,0migration/032347-21kthreadcore22:14:280
149960,0migration/019161-21taskset21:48:210
149960,0migration/015756-21cpuspeed_turbos22:24:230
128279966,0cyclictest24487-21diskmemload21:24:562
128279966,0cyclictest0-21swapper/223:20:212
128279960,0cyclictest0-21swapper/222:36:592
8315050,0irq/26-0000:00:31896-21kthreadcore20:59:292
339950,0migration/323279-21kthreadcore18:24:303
339950,0migration/315017-21kthreadcore20:09:293
329950,0watchdog/39896-21runrttasks20:29:193
329950,0watchdog/38042-21irqrtprio21:04:273
329950,0watchdog/37621-21if_eth019:44:273
329950,0watchdog/328872-21kthreadcore22:49:313
329950,0watchdog/30-21swapper/323:34:353
329950,0watchdog/30-21swapper/323:29:113
329950,0watchdog/30-21swapper/322:24:233
329950,0watchdog/30-21swapper/322:14:313
329950,0watchdog/30-21swapper/321:49:273
329950,0watchdog/30-21swapper/320:54:113
329950,0watchdog/30-21swapper/320:08:473
329950,0watchdog/30-21swapper/319:59:233
329950,0watchdog/30-21swapper/319:57:473
329950,0watchdog/30-21swapper/319:30:593
329950,0watchdog/30-21swapper/319:24:353
329950,0watchdog/30-21swapper/319:01:353
329950,0watchdog/30-21swapper/318:54:313
329950,0watchdog/30-21swapper/318:49:593
329950,0watchdog/30-21swapper/318:44:473
329950,0watchdog/30-21swapper/318:40:073
329950,0watchdog/30-21swapper/318:34:113
329950,0watchdog/30-21swapper/318:29:193
329950,0watchdog/30-21swapper/318:20:073
29935050,0irq/33-eth0-tx-8090-21ssh20:25:162
29935050,0irq/33-eth0-tx-30466-21ssh23:44:562
29935050,0irq/33-eth0-tx-2999-21munin-node20:04:310
29935050,0irq/33-eth0-tx-26241-21ssh23:04:332
29935050,0irq/33-eth0-tx-25234-21ssh21:32:282
29935050,0irq/33-eth0-tx-24243-21timerandwakeup22:44:382
29935050,0irq/33-eth0-tx-18789-21munin-node20:34:312
29935050,0irq/33-eth0-tx-11719-21ssh20:46:372
29935050,0irq/33-eth0-tx-11341-21irqrtprio20:29:302
29935050,0irq/33-eth0-tx-0-21swapper/223:14:262
29925050,0irq/32-eth0-rx-0-21swapper/322:59:243
29925050,0irq/32-eth0-rx-0-21swapper/322:59:243
29925050,0irq/32-eth0-rx-0-21swapper/321:34:173
29925050,0irq/32-eth0-rx-0-21swapper/320:39:133
29925050,0irq/32-eth0-rx-0-21swapper/319:34:213
29925050,0irq/32-eth0-rx-0-21swapper/319:04:523
27150,0ktimersoftd/20-21swapper/222:06:342
259950,0migration/23587-21sh21:56:582
259950,0migration/229585-21sh20:57:592
259950,0migration/213242-21taskset19:46:002
259950,0migration/210840-21idleruntime-cro21:44:102
249950,0watchdog/230339-21latency_hist23:29:112
249950,0watchdog/224535-21df_inode18:49:232
19150,0ktimersoftd/10-21swapper/123:03:591
19150,0ktimersoftd/10-21swapper/123:03:591
179950,0migration/131605-21latency_hist19:39:111
179950,0migration/129434-21munin-node21:54:251
179950,0migration/127424-21kthreadcore22:09:301
179950,0migration/126845-21kthreadcore23:44:321
179950,0migration/12657-21taskset20:03:121
179950,0migration/122901-21munin-node18:44:321
179950,0migration/121561-21missed_timers22:24:301
179950,0migration/120323-21kthreadcore21:29:291
179950,0migration/120188-21munin-node21:49:231
169950,0watchdog/18039-21ps21:04:271
149950,0migration/08497-21kthreadcore19:19:290
149950,0migration/05675-21taskset23:32:090
149950,0migration/05637-21kthreadcore21:39:290
149950,0migration/05591-21kthreadcore20:24:310
149950,0migration/04004-21kthreadcore19:39:290
149950,0migration/030463-21timerwakeupswit21:14:390
149950,0migration/029843-21kthreadcore21:34:290
149950,0migration/029310-21kthreadcore22:49:310
149950,0migration/027621-21kthreadcore22:29:300
149950,0migration/026612-21munin-node19:09:310
149950,0migration/025352-21kthreadcore19:54:280
149950,0migration/023931-21kthreadcore23:24:310
149950,0migration/023170-21kthreadcore21:49:280
149950,0migration/022188-21kthreadcore23:04:280
149950,0migration/02075-21taskset18:33:370
149950,0migration/018314-21sh23:00:280
149950,0migration/018314-21sh23:00:280
149950,0migration/015966-21kthreadcore22:04:280
149950,0migration/015328-21kthreadcore18:19:280
149950,0migration/015085-21taskset22:23:490
149950,0migration/014186-21fschecks_time23:19:260
149950,0migration/011234-21kthreadcore21:24:310
128279955,0cyclictest0-21swapper/223:35:572
128279955,0cyclictest0-21swapper/223:28:422
128279955,0cyclictest0-21swapper/221:45:452
128279955,0cyclictest0-21swapper/221:36:172
128279950,0cyclictest0-21swapper/223:00:192
128279950,0cyclictest0-21swapper/223:00:192
128279950,0cyclictest0-21swapper/222:26:262
128239950,0cyclictest0-21swapper/122:46:221
128229955,0cyclictest0-21swapper/021:22:180
128229955,0cyclictest0-21swapper/021:08:440
128229950,0cyclictest0-21swapper/020:50:180
128229950,0cyclictest0-21swapper/020:31:410
29935040,0irq/33-eth0-tx-839-21ssh22:50:112
29935040,0irq/33-eth0-tx-6228-21munin-node18:59:230
29935040,0irq/33-eth0-tx-2626-21kthreadcore21:19:312
29935040,0irq/33-eth0-tx-0-21swapper/222:19:372
29935040,0irq/33-eth0-tx-0-21swapper/221:09:132
29935040,0irq/33-eth0-tx-0-21swapper/220:49:362
29935040,0irq/33-eth0-tx-0-21swapper/220:20:412
29925040,0irq/32-eth0-rx-0-21swapper/319:19:243
259940,0migration/27572-21kthreadcore22:54:282
259940,0migration/231309-21kthreadcore23:09:292
259940,0migration/221646-21idleruntime19:09:272
259940,0migration/221345-21kthreadcore20:14:292
259940,0migration/220475-21kthreadcore19:29:322
259940,0migration/220038-21runrttasks19:04:532
259940,0migration/21976-21smart_sdb19:59:352
259940,0migration/213002-21latency_hist18:19:112
259940,0migration/211578-21irqcore20:09:282
249940,0watchdog/28044-21irqrtprio21:04:272
249940,0watchdog/21591-21python20:39:352
249940,0watchdog/20-21swapper/222:39:232
249940,0watchdog/20-21swapper/219:34:272
179940,0migration/19146-21kthreadcore20:44:301
179940,0migration/18781-21ntp_offset22:54:301
179940,0migration/17048-21kthreadcore19:19:291
179940,0migration/14100-21kthreadcore21:39:281
179940,0migration/131839-21kthreadcore18:29:301
179940,0migration/131025-21taskset18:53:391
179940,0migration/130854-21pmu-power20:19:321
179940,0migration/130800-21kthreadcore20:39:291
179940,0migration/130404-21ntp_kernel_pll_19:34:291
179940,0migration/125858-21kthreadcore18:24:311
179940,0migration/119924-21taskset18:21:531
179940,0migration/115617-21runrttasks21:24:451
179940,0migration/114393-21kthreadcore21:44:291
179940,0migration/112418-21kthreadcore20:09:291
179940,0migration/110824-21fschecks_time20:29:271
169940,0watchdog/18328-21ssh20:25:511
169940,0watchdog/17841-21kthreadcore23:14:311
169940,0watchdog/16702-21kthreadcore18:34:271
169940,0watchdog/14840-21ssh21:59:231
169940,0watchdog/130299-21munin-node20:59:311
169940,0watchdog/128003-21sensors20:54:351
169940,0watchdog/126034-21ssh20:35:511
169940,0watchdog/124322-21diskstats21:14:271
169940,0watchdog/116370-21sh22:41:151
169940,0watchdog/113035-21python23:34:351
169940,0watchdog/10-21swapper/123:09:111
169940,0watchdog/10-21swapper/122:37:511
169940,0watchdog/10-21swapper/120:52:471
149940,0migration/09796-21fschecks_time22:39:230
128279943,0cyclictest4126-21awk20:04:272
128279943,0cyclictest3599-21lldpd23:39:202
128279943,0cyclictest3599-21lldpd22:29:152
128279943,0cyclictest3599-21lldpd22:14:142
128279943,0cyclictest3599-21lldpd21:15:082
128279943,0cyclictest3599-21lldpd19:41:052
128279943,0cyclictest3599-21lldpd19:20:342
128279943,0cyclictest3599-21lldpd19:03:052
128279943,0cyclictest3599-21lldpd18:56:052
128279943,0cyclictest3599-21lldpd18:44:342
128279943,0cyclictest3599-21lldpd18:40:342
128279943,0cyclictest3599-21lldpd18:29:342
128279943,0cyclictest3599-21lldpd18:27:332
128279943,0cyclictest3262-21irqbalance21:49:152
128279943,0cyclictest3262-21irqbalance19:14:352
128279943,0cyclictest23005-21awk22:09:272
128279943,0cyclictest22027-21awk19:54:262
128279943,0cyclictest11148-21awk19:24:262
128239943,0cyclictest7652-21irqrtprio18:59:281
128239943,0cyclictest4174-21awk20:04:281
128239943,0cyclictest3599-21lldpd23:19:161
128239943,0cyclictest3599-21lldpd23:05:161
128239943,0cyclictest3599-21lldpd22:33:151
128239943,0cyclictest3599-21lldpd22:19:151
128239943,0cyclictest31653-21awk22:14:271
128239943,0cyclictest30138-21sadc23:29:111
128239943,0cyclictest27580-21awk22:49:291
128239943,0cyclictest27355-21awk21:34:281
128239943,0cyclictest23871-21snmpd19:58:151
128239943,0cyclictest23871-21snmpd19:50:151
128239943,0cyclictest23871-21snmpd19:44:451
128239943,0cyclictest23871-21snmpd19:27:451
128239943,0cyclictest23871-21snmpd19:18:151
128239943,0cyclictest23871-21snmpd19:09:151
128239943,0cyclictest23871-21snmpd19:05:451
128239943,0cyclictest23871-21snmpd18:54:151
128239943,0cyclictest18334-21awk19:29:301
128239940,0cyclictest0-21swapper/123:43:171
128229944,0cyclictest0-21swapper/022:01:050
128229944,0cyclictest0-21swapper/020:35:090
128229943,0cyclictest3590-21awk18:34:250
128229943,0cyclictest31397-21awk20:59:280
128229943,0cyclictest29466-21awk21:54:260
128229943,0cyclictest29302-21awk19:59:280
128229943,0cyclictest24764-21awk23:44:300
128229943,0cyclictest23871-21snmpd22:44:300
128229943,0cyclictest22871-21awk20:54:290
128229943,0cyclictest18561-21awk21:29:260
128229943,0cyclictest16925-21kworker/0:122:54:310
128229943,0cyclictest15742-21grep18:39:320
128229943,0cyclictest13520-21sadc19:49:100
128229943,0cyclictest10298-21munin-node20:09:290
128229940,0cyclictest16946-21munin-node18:44:300
179930,0migration/119334-21kthreadcore21:09:281
179930,0migration/111622-21kthreadcore18:39:291
169930,0watchdog/124487-21diskmemload22:04:271
169930,0watchdog/10-21swapper/121:19:311
169930,0watchdog/10-21swapper/120:14:111
149930,0migration/04163-21sh20:44:160
128279932,0cyclictest3599-21lldpd19:51:052
128239932,0cyclictest4456-21sensors23:29:331
128229933,0cyclictest16925-21kworker/0:122:34:230
128229933,0cyclictest16925-21kworker/0:122:09:250
128229933,0cyclictest16239-21kworker/0:020:41:590
128229933,0cyclictest16239-21kworker/0:020:14:170
128229933,0cyclictest16239-21kworker/0:019:34:190
128229933,0cyclictest16239-21kworker/0:019:29:210
128229933,0cyclictest12012-21kworker/0:119:24:190
128229933,0cyclictest12012-21kworker/0:119:14:180
128229933,0cyclictest12012-21kworker/0:118:54:180
128229933,0cyclictest12012-21kworker/0:118:24:140
128229932,0cyclictest29612-21awk23:09:270
128229932,0cyclictest21521-21sensors21:09:320
128229932,0cyclictest16323-21awk23:39:260
128229932,0cyclictest11239-21sensors23:14:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional