You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 07:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Thu Sep 18, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
311652207150,44sleep30-21swapper/319:07:163
310762203149,41sleep10-21swapper/119:06:051
292092200159,27sleep20-21swapper/219:05:022
313702199161,25sleep00-21swapper/019:09:550
220002560,0sleep20-21swapper/222:37:542
3149699230,0cyclictest0-21swapper/223:30:102
21102150,0sleep32071-21perf00:25:013
93242140,0sleep10-21swapper/120:35:171
31475991313,0cyclictest9-21ksoftirqd/022:55:170
31475991312,1cyclictest9-21ksoftirqd/000:15:230
3147599128,1cyclictest9-21ksoftirqd/022:50:150
31475991211,1cyclictest9-21ksoftirqd/022:05:010
31475991210,1cyclictest9-21ksoftirqd/023:40:000
31475991210,1cyclictest9-21ksoftirqd/021:15:000
31475991210,1cyclictest11883-21aten2.4-expect19:35:130
3147599120,5cyclictest254-21systemd-journal23:50:170
3149699119,1cyclictest28-21ksoftirqd/221:00:002
3148499111,8cyclictest0-21swapper/100:10:141
3147599119,1cyclictest9-21ksoftirqd/022:45:140
3147599119,1cyclictest9-21ksoftirqd/020:05:000
31475991110,1cyclictest9-21ksoftirqd/000:40:000
3147599111,5cyclictest22907-21cat23:25:000
3149699109,1cyclictest28-21ksoftirqd/222:25:202
3149699109,1cyclictest28-21ksoftirqd/222:25:202
3149699108,1cyclictest24420-21tune2fs00:10:182
3147599109,1cyclictest9-21ksoftirqd/023:45:000
3147599109,1cyclictest9-21ksoftirqd/022:35:000
3147599109,1cyclictest9-21ksoftirqd/021:40:160
3147599109,1cyclictest9-21ksoftirqd/021:25:140
3147599108,1cyclictest9-21ksoftirqd/019:55:120
3147599108,1cyclictest9-21ksoftirqd/019:20:000
31475991010,0cyclictest9-21ksoftirqd/000:05:180
299402100,0sleep10-21swapper/100:17:461
224782100,0sleep10-21swapper/123:23:551
315059992,6cyclictest9955-21apt-get21:35:143
315059990,4cyclictest31641-21wc20:15:163
314969998,1cyclictest28-21ksoftirqd/222:55:012
314969998,1cyclictest28-21ksoftirqd/200:30:162
314969997,1cyclictest28-21ksoftirqd/220:38:422
314969997,1cyclictest28-21ksoftirqd/220:29:592
314969990,8cyclictest0-21swapper/221:20:462
314969990,8cyclictest0-21swapper/220:30:172
314759998,1cyclictest9-21ksoftirqd/021:30:160
314759998,1cyclictest9-21ksoftirqd/021:10:000
314759998,1cyclictest9-21ksoftirqd/020:55:010
314759997,1cyclictest9-21ksoftirqd/023:00:170
314759997,1cyclictest9-21ksoftirqd/022:35:210
314759997,1cyclictest9-21ksoftirqd/021:15:140
314759997,1cyclictest9-21ksoftirqd/020:10:000
314759997,1cyclictest9-21ksoftirqd/019:45:120
314759997,1cyclictest9-21ksoftirqd/019:45:110
314759997,0cyclictest9-21ksoftirqd/021:02:290
314759993,5cyclictest9165-21perf19:30:000
314759992,6cyclictest19802-21latency_hist21:00:000
315059987,1cyclictest35-21ksoftirqd/323:00:013
315059982,2cyclictest1278-21sshd21:23:423
315059982,1cyclictest12671-21df_inode22:25:133
315059982,1cyclictest12671-21df_inode22:25:123
315059980,5cyclictest0-21swapper/323:23:413
315059980,5cyclictest0-21swapper/321:30:143
314969987,1cyclictest28-21ksoftirqd/220:45:012
314969987,1cyclictest28-21ksoftirqd/220:45:002
314969986,1cyclictest60950irq/123-eno123:55:152
314969986,1cyclictest60950irq/123-eno123:10:172
314969986,1cyclictest3780-21sensors_temp00:25:202
314969985,2cyclictest819-21lldpd00:36:032
314969984,2cyclictest254-21systemd-journal00:17:012
314969982,5cyclictest14701-21/usr/sbin/munin21:40:172
314969981,5cyclictest11119-21vmstat19:30:232
314759988,0cyclictest9-21ksoftirqd/021:35:000
314759987,1cyclictest9-21ksoftirqd/021:50:000
314759987,1cyclictest9-21ksoftirqd/020:15:000
314759986,1cyclictest9-21ksoftirqd/023:25:150
314759986,1cyclictest9-21ksoftirqd/000:20:180
314759986,1cyclictest25438-21ssh21:57:410
314759986,1cyclictest25438-21ssh21:57:400
314759985,1cyclictest9-21ksoftirqd/020:40:000
314759981,6cyclictest22792-21diskmemload22:25:170
314759981,6cyclictest22792-21diskmemload22:25:160
314759981,1cyclictest930-21ssh21:22:440
314759980,7cyclictest4100-21ssh22:13:170
314759980,7cyclictest0-21swapper/019:20:120
314759980,4cyclictest569-21perf20:19:590
315059976,1cyclictest35-21ksoftirqd/300:40:003
315059976,1cyclictest20880-21cat00:05:193
315059975,1cyclictest27416-21cat22:00:163
315059975,1cyclictest24982-21ssh22:40:563
315059975,1cyclictest22063-21ssh22:38:053
315059975,1cyclictest10761-21ssh22:21:383
315059974,1cyclictest22792-21diskmemload23:29:443
315059973,2cyclictest254-21systemd-journal19:18:543
315059972,4cyclictest22792-21diskmemload23:50:123
315059971,4cyclictest28669-21cut00:15:233
315059971,4cyclictest0-21swapper/321:55:153
315059971,4cyclictest0-21swapper/321:55:153
315059971,3cyclictest22792-21diskmemload00:10:473
315059971,3cyclictest0-21swapper/321:00:123
315059970,6cyclictest29261-21ssh23:32:403
315059970,6cyclictest12897-21ntp_states19:35:183
315059970,4cyclictest18263-21hddtemp_smartct21:45:133
315059970,4cyclictest0-21swapper/321:40:153
315059970,3cyclictest24430-21ntp_states21:10:153
315059970,1cyclictest0-21swapper/322:05:133
314969976,1cyclictest60950irq/123-eno123:46:282
314969976,1cyclictest60950irq/123-eno123:28:432
314969976,1cyclictest60950irq/123-eno123:20:202
314969976,1cyclictest60950irq/123-eno121:59:382
314969976,1cyclictest60950irq/123-eno121:59:382
314969976,1cyclictest60950irq/123-eno121:45:102
314969976,1cyclictest60950irq/123-eno100:20:132
314969976,1cyclictest60950irq/123-eno100:02:582
314969976,1cyclictest28-21ksoftirqd/223:15:032
314969975,1cyclictest60950irq/123-eno122:15:222
314969975,1cyclictest60950irq/123-eno121:50:242
314969975,1cyclictest3643-21ssh22:56:412
314969974,1cyclictest60950irq/123-eno122:10:192
314969973,3cyclictest60950irq/123-eno123:44:222
314969973,2cyclictest60950irq/123-eno100:07:462
314969971,5cyclictest60950irq/123-eno123:35:392
314969970,3cyclictest9730-21/usr/sbin/munin22:20:212
314969970,2cyclictest254-21systemd-journal22:35:002
314849971,5cyclictest0-21swapper/123:05:131
314849970,4cyclictest0-21swapper/123:10:151
314849970,4cyclictest0-21swapper/100:30:211
314849970,3cyclictest0-21swapper/121:45:101
314759975,1cyclictest9-21ksoftirqd/000:10:180
314759975,1cyclictest17703-21cat00:00:170
314759975,1cyclictest14224-21ssh23:10:510
314759975,1cyclictest10521-21ssh23:05:360
314759973,3cyclictest15923-21sh00:00:000
314759970,6cyclictest8441-21ssh23:49:200
314759970,6cyclictest28593-21ssh23:30:370
314759970,6cyclictest22792-21diskmemload22:20:140
314759970,6cyclictest22792-21diskmemload21:50:070
314759970,6cyclictest17417-21sed23:15:200
314759970,6cyclictest15869-21taskset19:40:350
314759970,6cyclictest0-21swapper/000:30:200
314759970,1cyclictest4981-21ssh22:15:120
314759970,1cyclictest0-21swapper/022:40:160
314759970,1cyclictest0-21swapper/022:05:190
11428270,0sleep30-21swapper/323:08:243
315059965,1cyclictest8785-21ssh00:33:113
315059965,1cyclictest6982-21ssh23:00:483
315059965,1cyclictest6804-21ssh22:15:353
315059965,1cyclictest28643-21ssh21:15:253
315059965,1cyclictest17256-21sshd20:52:463
315059965,1cyclictest14876-21ssh23:12:493
315059965,1cyclictest10319-21sshd20:39:423
315059964,1cyclictest3620-21ssh23:40:363
315059963,1cyclictest4183-21ssh00:25:293
315059963,1cyclictest254-21systemd-journal23:57:333
315059963,1cyclictest254-21systemd-journal22:49:153
315059963,1cyclictest254-21systemd-journal19:29:543
315059962,3cyclictest25900-21/usr/sbin/munin20:05:143
315059962,2cyclictest254-21systemd-journal20:29:283
315059961,4cyclictest1449-21ntpd20:40:183
315059961,4cyclictest1449-21ntpd20:40:173
315059961,3cyclictest0-21swapper/300:00:093
315059961,2cyclictest0-21swapper/323:35:153
315059960,6cyclictest0-21swapper/322:30:283
315059960,5cyclictest557-21nscd22:53:453
315059960,2cyclictest0-21swapper/323:15:303
315059960,2cyclictest0-21swapper/321:50:493
315059960,2cyclictest0-21swapper/321:28:293
314969966,0cyclictest60950irq/123-eno123:00:142
314969966,0cyclictest60950irq/123-eno122:05:102
314969966,0cyclictest60950irq/123-eno122:01:312
314969966,0cyclictest60950irq/123-eno121:35:232
314969966,0cyclictest60950irq/123-eno121:30:432
314969966,0cyclictest60950irq/123-eno121:25:142
314969966,0cyclictest60950irq/123-eno121:15:252
314969966,0cyclictest60950irq/123-eno120:54:102
314969966,0cyclictest60950irq/123-eno120:10:122
314969966,0cyclictest60950irq/123-eno120:06:092
314969966,0cyclictest60950irq/123-eno120:02:452
314969966,0cyclictest60950irq/123-eno119:51:502
314969966,0cyclictest60950irq/123-eno119:23:012
314969965,1cyclictest60950irq/123-eno122:45:212
314969965,1cyclictest22315-21ntpq19:55:172
314969965,0cyclictest60950irq/123-eno123:05:052
314969964,1cyclictest60950irq/123-eno120:20:142
314969964,1cyclictest28-21ksoftirqd/219:45:162
314969964,1cyclictest28-21ksoftirqd/219:45:162
314969964,1cyclictest20055-21apt-get21:00:122
314969962,1cyclictest254-21systemd-journal21:10:002
314969962,1cyclictest0-21swapper/221:10:012
314969960,6cyclictest0-21swapper/223:50:022
314969960,6cyclictest0-21swapper/219:43:442
314969960,4cyclictest0-21swapper/222:42:292
314969960,2cyclictest0-21swapper/219:35:152
314849966,0cyclictest0-21swapper/122:17:551
314849963,3cyclictest0-21swapper/121:50:231
314849962,1cyclictest0-21swapper/123:55:221
314849961,3cyclictest0-21swapper/123:30:131
314849960,6cyclictest0-21swapper/123:50:111
314849960,6cyclictest0-21swapper/121:15:001
314849960,6cyclictest0-21swapper/100:05:151
314849960,4cyclictest0-21swapper/100:26:311
314849960,3cyclictest0-21swapper/121:55:141
314849960,3cyclictest0-21swapper/121:55:131
314849960,3cyclictest0-21swapper/119:10:121
314849960,1cyclictest0-21swapper/123:45:171
314759964,1cyclictest9-21ksoftirqd/020:40:130
314759964,1cyclictest9-21ksoftirqd/020:40:130
314759964,1cyclictest9-21ksoftirqd/020:25:000
314759963,1cyclictest9-21ksoftirqd/020:31:430
314759963,1cyclictest254-21systemd-journal19:10:540
314759962,1cyclictest254-21systemd-journal19:51:110
314759961,4cyclictest3540-21ntp_states00:25:190
314759960,6cyclictest0-21swapper/020:20:160
314759960,6cyclictest0-21swapper/019:30:140
315059953,1cyclictest9500-21head19:30:143
315059953,1cyclictest35-21ksoftirqd/320:24:473
315059953,1cyclictest29417-21ntp_states20:10:193
315059952,1cyclictest254-21systemd-journal21:00:003
315059952,1cyclictest254-21systemd-journal19:57:113
315059951,2cyclictest31666-21/usr/sbin/munin19:10:203
315059951,1cyclictest5924-21proc_pri19:20:193
315059951,1cyclictest254-21systemd-journal20:50:013
315059951,1cyclictest16463-21apt-get19:45:123
315059951,1cyclictest16463-21apt-get19:45:113
315059950,4cyclictest1868-21df_inode22:10:153
315059950,3cyclictest0-21swapper/323:45:053
314969955,0cyclictest60950irq/123-eno120:45:132
314969955,0cyclictest60950irq/123-eno120:15:142
314969954,1cyclictest60950irq/123-eno119:10:182
314969952,2cyclictest60950irq/123-eno119:15:102
314969951,1cyclictest0-21swapper/219:25:152
314849955,0cyclictest0-21swapper/121:30:061
314849955,0cyclictest0-21swapper/121:21:131
314849955,0cyclictest0-21swapper/119:40:031
314849952,2cyclictest0-21swapper/100:21:171
314849951,2cyclictest0-21swapper/123:00:161
314849951,2cyclictest0-21swapper/122:55:221
314849951,2cyclictest0-21swapper/119:20:121
314849951,1cyclictest28521-21taskset22:00:591
314849951,1cyclictest0-21swapper/123:17:571
314849951,1cyclictest0-21swapper/120:45:151
314849950,5cyclictest0-21swapper/100:01:391
314849950,3cyclictest0-21swapper/123:35:491
314849950,3cyclictest0-21swapper/122:30:071
314849950,2cyclictest0-21swapper/123:28:581
314849950,2cyclictest0-21swapper/122:46:541
314849950,2cyclictest0-21swapper/122:37:041
314849950,2cyclictest0-21swapper/122:10:151
314849950,2cyclictest0-21swapper/121:25:131
314849950,2cyclictest0-21swapper/100:39:381
314849950,1cyclictest0-21swapper/123:41:401
314849950,1cyclictest0-21swapper/122:50:361
314849950,1cyclictest0-21swapper/120:15:001
314849950,0cyclictest0-21swapper/121:36:561
314849950,0cyclictest0-21swapper/120:45:011
314849950,0cyclictest0-21swapper/120:45:001
314759950,2cyclictest0-21swapper/020:45:110
315059942,1cyclictest742-21runrttasks20:32:473
315059942,1cyclictest25405-21chrt20:01:513
315059942,1cyclictest225752sleep321:07:223
315059942,1cyclictest19728-21uname19:50:183
315059940,3cyclictest15013-21irqstats19:40:163
314849941,2cyclictest0-21swapper/121:09:591
314849940,3cyclictest0-21swapper/119:35:141
314849940,3cyclictest0-21swapper/119:15:231
314849940,2cyclictest0-21swapper/122:05:171
314849940,2cyclictest0-21swapper/121:15:581
314849940,2cyclictest0-21swapper/120:20:121
314849940,1cyclictest0-21swapper/122:40:061
314849940,1cyclictest0-21swapper/122:25:201
314849940,1cyclictest0-21swapper/122:25:191
314849940,1cyclictest0-21swapper/122:20:011
314849940,1cyclictest0-21swapper/121:40:181
314849940,1cyclictest0-21swapper/120:10:181
314849940,0cyclictest0-21swapper/120:55:191
314849940,0cyclictest0-21swapper/120:25:201
314849940,0cyclictest0-21swapper/120:08:161
314849940,0cyclictest0-21swapper/119:25:171
314849931,2cyclictest0-21swapper/121:00:161
314849931,1cyclictest0-21swapper/120:50:191
314849931,1cyclictest0-21swapper/119:55:111
314849931,1cyclictest0-21swapper/119:50:131
314849931,1cyclictest0-21swapper/119:45:171
314849931,1cyclictest0-21swapper/119:45:171
314849931,1cyclictest0-21swapper/119:30:131
314849930,3cyclictest25463-21taskset20:02:371
314849930,2cyclictest0-21swapper/120:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional