You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-18 - 20:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Oct 18, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2101225150,0sleep20-21swapper/206:19:222
2111923928,0sleep30-21swapper/306:20:403
2093023925,0sleep00-21swapper/006:18:240
2032023624,0sleep10-21swapper/106:17:251
329980,0watchdog/30-21swapper/311:22:193
29925080,0irq/32-eth0-rx-18095-21irqcore11:47:183
213099988,0cyclictest23871-21snmpd11:20:340
329970,0watchdog/328108-21ssh09:17:273
329970,0watchdog/30-21swapper/311:41:473
29935070,0irq/33-eth0-tx-0-21swapper/007:12:180
29925070,0irq/32-eth0-rx-0-21swapper/310:09:083
29925070,0irq/32-eth0-rx-0-21swapper/310:09:083
35160,0ktimersoftd/30-21swapper/311:30:533
329960,0watchdog/30-21swapper/311:43:153
329960,0watchdog/30-21swapper/311:03:513
329960,0watchdog/30-21swapper/310:55:033
329960,0watchdog/30-21swapper/310:50:393
329960,0watchdog/30-21swapper/310:41:313
329960,0watchdog/30-21swapper/310:32:193
329960,0watchdog/30-21swapper/310:02:073
329960,0watchdog/30-21swapper/309:59:433
329960,0watchdog/30-21swapper/309:52:113
329960,0watchdog/30-21swapper/309:40:153
329960,0watchdog/30-21swapper/309:15:393
329960,0watchdog/30-21swapper/309:10:153
329960,0watchdog/30-21swapper/309:02:153
329960,0watchdog/30-21swapper/308:53:073
329960,0watchdog/30-21swapper/308:51:353
329960,0watchdog/30-21swapper/308:42:513
329960,0watchdog/30-21swapper/308:39:313
329960,0watchdog/30-21swapper/308:32:353
329960,0watchdog/30-21swapper/308:24:553
329960,0watchdog/30-21swapper/307:07:203
29935060,0irq/33-eth0-tx-28385-21sshd07:08:410
29935060,0irq/33-eth0-tx-1022-21munin-node07:42:300
29935060,0irq/33-eth0-tx-0-21swapper/007:32:260
29935060,0irq/33-eth0-tx-0-21swapper/007:22:230
29935060,0irq/33-eth0-tx-0-21swapper/007:21:420
29935060,0irq/33-eth0-tx-0-21swapper/006:37:210
29925060,0irq/32-eth0-rx-23839-21kthreadcore06:22:193
29925060,0irq/32-eth0-rx-16915-21cut09:32:203
29925060,0irq/32-eth0-rx-0-21swapper/311:32:163
29925060,0irq/32-eth0-rx-0-21swapper/311:08:173
29925060,0irq/32-eth0-rx-0-21swapper/310:57:183
29925060,0irq/32-eth0-rx-0-21swapper/309:47:213
29925060,0irq/32-eth0-rx-0-21swapper/309:43:303
29925060,0irq/32-eth0-rx-0-21swapper/306:32:083
213109960,0cyclictest9958-21ssh08:29:431
213099966,0cyclictest26279-21diskmemload08:42:160
213099960,0cyclictest0-21swapper/008:40:030
179960,0migration/120402-21latency_hist08:56:591
149960,0migration/024280-21sh10:13:150
149960,0migration/020469-21kthreadcore10:32:180
149960,0migration/018556-21sh10:48:360
149960,0migration/015606-21aten_r1power_po07:52:120
149960,0migration/014118-21diskmemload09:12:140
8315050,0irq/26-0000:00:0-21swapper/306:36:593
339950,0migration/38433-21aten_r1power_po07:47:133
339950,0migration/329425-21fschecks_time06:27:153
339950,0migration/326912-21kthreadcore06:47:193
339950,0migration/325654-21kthreadcore07:57:183
339950,0migration/317712-21taskset07:24:003
339950,0migration/31063-21aten_r1power_en07:42:153
339950,0migration/310004-21kthreadcore06:57:193
329950,0watchdog/30-21swapper/311:17:433
329950,0watchdog/30-21swapper/310:27:193
329950,0watchdog/30-21swapper/310:22:153
329950,0watchdog/30-21swapper/310:17:153
329950,0watchdog/30-21swapper/310:13:113
329950,0watchdog/30-21swapper/309:27:033
329950,0watchdog/30-21swapper/308:57:073
329950,0watchdog/30-21swapper/308:17:113
329950,0watchdog/30-21swapper/308:12:353
329950,0watchdog/30-21swapper/308:07:113
329950,0watchdog/30-21swapper/308:02:123
329950,0watchdog/30-21swapper/307:52:123
329950,0watchdog/30-21swapper/307:39:563
329950,0watchdog/30-21swapper/307:33:563
329950,0watchdog/30-21swapper/307:27:043
329950,0watchdog/30-21swapper/307:12:043
329950,0watchdog/30-21swapper/307:02:403
329950,0watchdog/30-21swapper/306:52:003
329950,0watchdog/30-21swapper/306:42:043
29935050,0irq/33-eth0-tx-5766-21ssh11:21:142
29935050,0irq/33-eth0-tx-27727-21ssh08:58:502
29935050,0irq/33-eth0-tx-0-21swapper/008:22:180
29935050,0irq/33-eth0-tx-0-21swapper/008:02:110
29935050,0irq/33-eth0-tx-0-21swapper/007:02:170
29935050,0irq/33-eth0-tx-0-21swapper/006:52:150
29935050,0irq/33-eth0-tx-0-21swapper/006:34:460
29925050,0irq/32-eth0-rx-8385-21tr08:27:183
29925050,0irq/32-eth0-rx-21502-21munin-node11:12:163
29925050,0irq/32-eth0-rx-0-21swapper/310:42:123
29925050,0irq/32-eth0-rx-0-21swapper/309:22:123
29925050,0irq/32-eth0-rx-0-21swapper/307:17:133
27150,0ktimersoftd/20-21swapper/209:19:092
259950,0migration/27422-21latency_hist09:46:592
259950,0migration/226765-21latency_hist10:36:582
259950,0migration/223290-21idleruntime-cro11:31:582
213129954,0cyclictest12639-21awk10:47:192
213129950,0cyclictest0-21swapper/209:43:222
213109955,0cyclictest0-21swapper/111:48:121
213109955,0cyclictest0-21swapper/111:33:511
213109955,0cyclictest0-21swapper/109:37:211
213109950,0cyclictest0-21swapper/111:22:401
213109950,0cyclictest0-21swapper/111:04:031
213109950,0cyclictest0-21swapper/110:14:141
213109950,0cyclictest0-21swapper/109:00:081
213099955,0cyclictest0-21swapper/011:01:090
213099955,0cyclictest0-21swapper/010:18:540
213099955,0cyclictest0-21swapper/010:08:020
213099955,0cyclictest0-21swapper/010:08:020
213099955,0cyclictest0-21swapper/008:49:590
213099950,0cyclictest0-21swapper/011:42:370
213099950,0cyclictest0-21swapper/009:59:210
19150,0ktimersoftd/10-21swapper/109:19:091
179950,0migration/127464-21mdstat11:12:191
179950,0migration/124277-21kthreadcore07:07:191
179950,0migration/113852-21fschecks_time11:07:121
179950,0migration/11218-21sh10:21:291
169950,0watchdog/11771-21grep06:52:201
149950,0migration/08969-21kthreadcore06:57:190
149950,0migration/08463-21kthreadcore08:27:180
149950,0migration/08452-21kthreadcore09:27:160
149950,0migration/06402-21aten_r1power_en11:22:120
149950,0migration/032162-21kthreadcore09:02:170
149950,0migration/032041-21kthreadcore10:37:190
149950,0migration/028554-21taskset09:01:460
149950,0migration/028100-21munin-node09:17:270
149950,0migration/02252-21fschecks_count10:22:180
149950,0migration/021339-21kthreadcore08:17:190
149950,0migration/018849-21kthreadcore09:52:290
149950,0migration/017472-21timerwakeupswit08:32:260
149950,0migration/016306-21kthreadcore08:52:220
149950,0migration/016146-21if_eth1.311:27:160
149950,0migration/012312-21taskset09:09:310
29935040,0irq/33-eth0-tx-25744-21munin-node10:17:182
29935040,0irq/33-eth0-tx-17674-21kthreadcore09:12:182
29935040,0irq/33-eth0-tx-1668-21munin-node10:22:242
29935040,0irq/33-eth0-tx-14639-21munin-node09:32:232
29935040,0irq/33-eth0-tx-10024-21ssh10:43:152
29935040,0irq/33-eth0-tx-0-21swapper/211:43:312
29935040,0irq/33-eth0-tx-0-21swapper/211:32:102
29935040,0irq/33-eth0-tx-0-21swapper/211:22:182
29935040,0irq/33-eth0-tx-0-21swapper/211:08:012
29935040,0irq/33-eth0-tx-0-21swapper/211:02:152
29935040,0irq/33-eth0-tx-0-21swapper/210:57:002
29935040,0irq/33-eth0-tx-0-21swapper/210:52:082
29935040,0irq/33-eth0-tx-0-21swapper/210:13:002
29935040,0irq/33-eth0-tx-0-21swapper/210:02:032
29935040,0irq/33-eth0-tx-0-21swapper/209:57:102
29935040,0irq/33-eth0-tx-0-21swapper/209:22:152
29935040,0irq/33-eth0-tx-0-21swapper/209:09:042
29935040,0irq/33-eth0-tx-0-21swapper/208:37:232
29935040,0irq/33-eth0-tx-0-21swapper/208:29:202
29935040,0irq/33-eth0-tx-0-21swapper/008:12:260
29935040,0irq/33-eth0-tx-0-21swapper/007:37:240
29935040,0irq/33-eth0-tx-0-21swapper/006:47:230
29935040,0irq/33-eth0-tx-0-21swapper/006:27:130
259940,0migration/28842-21kthreadcore08:47:192
259940,0migration/232711-21kthreadcore08:42:182
259940,0migration/232009-21runrttasks06:50:302
259940,0migration/228881-21taskset09:02:032
259940,0migration/223745-21kthreadcore07:32:192
259940,0migration/223578-21sh11:47:412
259940,0migration/221560-21munin-node06:22:132
259940,0migration/218860-21kthreadcore07:02:192
259940,0migration/217271-21kthreadcore08:52:222
259940,0migration/21192-21irqrtprio11:37:192
259940,0migration/211256-21kthreadcore07:47:192
259940,0migration/210631-21kthreadcore09:27:172
249940,0watchdog/27719-21cut07:17:202
249940,0watchdog/220140-21perl08:17:152
249940,0watchdog/212383-21grep06:57:202
249940,0watchdog/20-21swapper/210:32:192
249940,0watchdog/20-21swapper/208:12:312
249940,0watchdog/20-21swapper/206:52:202
213129943,0cyclictest4635-21awk06:32:162
213129943,0cyclictest3599-21lldpd10:07:232
213129943,0cyclictest3599-21lldpd10:07:232
213129943,0cyclictest3599-21lldpd09:52:142
213129943,0cyclictest3599-21lldpd07:53:442
213129943,0cyclictest31015-21awk08:02:152
213129943,0cyclictest23871-21snmpd10:27:002
213129943,0cyclictest23871-21snmpd08:32:152
213129943,0cyclictest23871-21snmpd08:22:152
213129943,0cyclictest23871-21snmpd07:12:152
213129943,0cyclictest23871-21snmpd06:42:002
213129943,0cyclictest22738-21awk07:07:162
213129943,0cyclictest22702-21awk11:12:172
213129943,0cyclictest18697-21sadc07:31:592
213129943,0cyclictest12140-21awk07:22:172
213129940,0cyclictest4213-21kthreadcore07:42:222
213129940,0cyclictest23093-21munin-node09:37:162
213109944,0cyclictest0-21swapper/110:42:081
213109944,0cyclictest0-21swapper/110:32:311
213109943,0cyclictest8349-21awk06:57:171
213109943,0cyclictest7329-21awk09:27:141
213109943,0cyclictest4910-21awk07:17:181
213109943,0cyclictest23871-21snmpd11:37:451
213109943,0cyclictest23871-21snmpd11:28:451
213109943,0cyclictest23871-21snmpd10:48:151
213109943,0cyclictest23871-21snmpd09:45:001
213109943,0cyclictest23871-21snmpd08:42:451
213109943,0cyclictest23871-21snmpd08:08:451
213109943,0cyclictest23871-21snmpd07:59:301
213109943,0cyclictest23871-21snmpd07:51:151
213109943,0cyclictest23871-21snmpd07:42:451
213109943,0cyclictest23871-21snmpd07:38:301
213109943,0cyclictest23871-21snmpd06:46:301
213109943,0cyclictest22563-21awk06:22:171
213109943,0cyclictest17219-21awk09:52:281
213109943,0cyclictest12062-21awk08:32:161
213109943,0cyclictest12021-21awk07:22:161
213099944,0cyclictest4495-21ssh09:22:280
213099944,0cyclictest0-21swapper/011:38:220
213099944,0cyclictest0-21swapper/011:08:340
213099944,0cyclictest0-21swapper/010:54:130
213099944,0cyclictest0-21swapper/010:46:110
213099943,0cyclictest3599-21lldpd07:59:140
213099943,0cyclictest23871-21snmpd08:11:000
213099943,0cyclictest11171-21awk10:27:180
179940,0migration/14518-21fschecks_count08:47:141
179940,0migration/132192-21kthreadcore11:17:201
179940,0migration/131206-21irqcore08:02:161
179940,0migration/129620-21taskset06:27:151
179940,0migration/126907-21kthreadcore09:57:171
179940,0migration/126680-21irqrtprio06:47:181
179940,0migration/121180-21kthreadcore08:37:181
179940,0migration/119588-21fschecks_time07:32:151
179940,0migration/118014-21kthreadcore09:32:201
179940,0migration/117175-21kthreadcore07:52:181
179940,0migration/116355-21kthreadcore09:12:181
179940,0migration/115248-21switchtime10:07:281
179940,0migration/115248-21switchtime10:07:281
179940,0migration/112534-21fschecks_count08:12:271
179940,0migration/112457-21kthreadcore11:42:181
179940,0migration/111851-21if_err_eth106:37:161
179940,0migration/111057-21sh10:27:171
169940,0watchdog/1442-21kthreadcore09:22:191
169940,0watchdog/13716-21ssh09:03:431
169940,0watchdog/128846-21df_abs10:57:111
169940,0watchdog/12683-21smartctl10:22:191
169940,0watchdog/125854-21users08:17:271
169940,0watchdog/11433-21ssh08:24:551
169940,0watchdog/113653-21open_files09:47:231
169940,0watchdog/10-21swapper/110:52:191
149940,0migration/02885-21kthreadcore10:02:180
149940,0migration/027698-21kthreadcore11:32:170
149940,0migration/02474-21kthreadcore09:42:190
149940,0migration/024671-21kthreadcore06:22:190
149940,0migration/013120-21kthreadcore09:47:210
213129932,0cyclictest5754-21tail08:07:152
213129932,0cyclictest3599-21lldpd06:39:502
213129932,0cyclictest3262-21irqbalance06:27:242
213129932,0cyclictest23947-21irqcore07:57:172
213129932,0cyclictest23871-21snmpd07:37:302
213109932,0cyclictest823-21sensors10:37:231
213109932,0cyclictest3599-21lldpd07:31:351
213109932,0cyclictest23871-21snmpd09:10:301
213109932,0cyclictest23871-21snmpd06:34:301
213109932,0cyclictest19223-21grep07:02:191
213109930,0cyclictest31390-21cut07:12:161
213099933,0cyclictest4026-21kworker/0:011:47:090
213099933,0cyclictest4026-21kworker/0:011:12:030
213099933,0cyclictest4026-21kworker/0:011:01:590
213099933,0cyclictest16993-21kworker/0:106:42:120
213099933,0cyclictest11956-21kworker/0:109:36:590
213099933,0cyclictest11956-21kworker/0:109:31:590
213099933,0cyclictest11956-21kworker/0:107:27:240
213099930,0cyclictest0-21swapper/007:47:130
169930,0watchdog/10-21swapper/110:02:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional