You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 02:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Dec 02, 2025 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190392215163,26sleep20-21swapper/219:06:072
192412211156,24sleep10-21swapper/119:08:431
192702210159,25sleep00-21swapper/019:09:060
192232201162,25sleep30-21swapper/319:08:293
174282680,0sleep00-21swapper/022:00:190
302092640,0sleep30-21swapper/322:20:013
76812570,0sleep00-21swapper/021:46:120
21082560,0sleep20-21swapper/221:40:072
77122200,0sleep20-21swapper/219:50:172
247142170,0sleep10-21swapper/122:55:511
218132120,0sleep10-21swapper/100:25:111
1943499121,7cyclictest21156-21ssh22:05:190
1943499121,6cyclictest13680-21perf20:04:590
196792110,0sleep10-21swapper/100:20:191
19463991110,1cyclictest35-21ksoftirqd/321:20:003
19454991110,1cyclictest28-21ksoftirqd/221:55:012
1946399108,1cyclictest0-21swapper/322:55:143
1945499108,1cyclictest28-21ksoftirqd/219:25:002
1943499100,3cyclictest254-21systemd-journal00:02:580
194549998,1cyclictest28-21ksoftirqd/223:24:592
194549998,1cyclictest28-21ksoftirqd/223:16:022
194549996,1cyclictest60950irq/123-eno100:10:002
194549990,3cyclictest0-21swapper/222:36:312
194349991,4cyclictest5391-21perf21:45:000
194349990,8cyclictest0-21swapper/023:50:170
194349990,4cyclictest22529-21perf22:55:000
6290280,0sleep20-21swapper/222:30:222
194639981,5cyclictest11531-21apt-get20:00:133
194639981,4cyclictest0-21swapper/320:05:173
194549986,1cyclictest60950irq/123-eno123:50:152
194549986,1cyclictest60950irq/123-eno119:30:202
194549986,1cyclictest60950irq/123-eno100:21:032
194549986,1cyclictest28-21ksoftirqd/222:21:122
194549986,1cyclictest28-21ksoftirqd/220:30:002
194549984,2cyclictest570-21systemd-logind23:35:222
194549984,2cyclictest570-21systemd-logind23:35:222
194549980,7cyclictest12328-21diskmemload00:15:132
194549980,4cyclictest0-21swapper/220:05:172
194449981,4cyclictest0-21swapper/119:50:201
194449980,4cyclictest0-21swapper/123:35:261
194449980,4cyclictest0-21swapper/123:35:251
194349987,1cyclictest0-21swapper/021:05:200
194349983,4cyclictest18890-21nscd23:17:350
194349983,2cyclictest9-21ksoftirqd/022:38:380
194349982,2cyclictest0-21swapper/022:20:130
194349981,3cyclictest23151-21perf20:25:000
194349980,7cyclictest1480-21ssh23:55:190
194349980,5cyclictest8955-21latency_hist19:55:010
194349980,4cyclictest11332-21perf20:00:000
194349980,1cyclictest23573-21apt-get21:25:150
194349980,1cyclictest12328-21diskmemload21:30:120
194639975,1cyclictest27746-21sshd00:32:183
194639975,1cyclictest12328-21diskmemload23:19:003
194639972,4cyclictest29909-21kworker/u8:023:21:173
194639971,5cyclictest24059-21sh00:26:493
194639971,4cyclictest20495-21if_eno119:10:163
194639971,3cyclictest0-21swapper/323:53:323
194639970,6cyclictest12328-21diskmemload21:21:223
194639970,3cyclictest0-21swapper/323:06:553
194549976,1cyclictest60950irq/123-eno123:57:522
194549976,1cyclictest60950irq/123-eno123:41:182
194549976,1cyclictest60950irq/123-eno123:41:172
194549976,1cyclictest60950irq/123-eno123:25:422
194549976,1cyclictest60950irq/123-eno122:55:132
194549976,1cyclictest60950irq/123-eno122:43:082
194549976,1cyclictest60950irq/123-eno122:10:212
194549976,1cyclictest60950irq/123-eno122:08:472
194549976,1cyclictest60950irq/123-eno121:47:412
194549976,1cyclictest60950irq/123-eno120:45:012
194549976,1cyclictest60950irq/123-eno100:31:142
194549975,1cyclictest60950irq/123-eno121:10:002
194549975,1cyclictest60950irq/123-eno100:10:162
194549975,1cyclictest28599-21ssh23:48:272
194549975,1cyclictest28-21ksoftirqd/200:00:002
194549975,1cyclictest20150-21cat22:50:162
194549975,1cyclictest15462-21ssh22:44:592
194549972,3cyclictest18598-21apt-get20:15:132
194549971,5cyclictest12328-21diskmemload23:10:122
194549970,6cyclictest0-21swapper/219:25:182
194549970,4cyclictest0-21swapper/221:21:442
194549970,4cyclictest0-21swapper/220:20:122
194549970,1cyclictest0-21swapper/220:35:162
194449970,7cyclictest0-21swapper/121:50:201
194449970,6cyclictest0-21swapper/121:20:111
194449970,4cyclictest0-21swapper/123:44:341
194449970,4cyclictest0-21swapper/123:44:331
194449970,4cyclictest0-21swapper/123:25:091
194449970,4cyclictest0-21swapper/122:53:421
194449970,3cyclictest0-21swapper/121:35:091
194349976,1cyclictest16154-21cat23:30:170
194349975,1cyclictest9-21ksoftirqd/000:06:190
194349975,1cyclictest15445-21head00:15:160
194349971,6cyclictest14351-21ssh22:42:100
194349971,5cyclictest8201-21/usr/sbin/munin23:20:200
194349971,5cyclictest30888-21ssh21:35:060
194349971,3cyclictest0-21swapper/023:40:150
194349971,3cyclictest0-21swapper/023:40:150
194349970,6cyclictest26778-21ssh22:15:120
194349970,6cyclictest19235-21ssh23:35:160
194349970,6cyclictest19235-21ssh23:35:160
194349970,6cyclictest1774-21memory20:45:180
194349970,6cyclictest12328-21diskmemload00:20:010
194349970,6cyclictest11152-21ssh00:10:110
194349970,6cyclictest0-21swapper/022:45:440
194349970,6cyclictest0-21swapper/020:50:210
194349970,6cyclictest0-21swapper/020:35:180
194349970,6cyclictest0-21swapper/020:25:150
194349970,6cyclictest0-21swapper/019:27:020
194349970,6cyclictest0-21swapper/000:35:180
194349970,1cyclictest5484-21apt-get20:55:150
194349970,1cyclictest22433-21ssh21:22:350
194349970,1cyclictest1409-21apt-get22:25:130
194349970,1cyclictest12328-21diskmemload21:52:290
194349970,1cyclictest12328-21diskmemload21:15:110
194349970,1cyclictest12328-21diskmemload21:12:240
194349970,1cyclictest11711-21ssh23:25:100
194349970,1cyclictest0-21swapper/023:05:240
194349970,1cyclictest0-21swapper/023:03:290
194349970,1cyclictest0-21swapper/022:30:170
194349970,1cyclictest0-21swapper/022:10:160
14595270,0sleep10-21swapper/121:11:181
20559260,0sleep30-21swapper/300:22:053
194639966,0cyclictest0-21swapper/321:52:273
194639965,1cyclictest31589-21ssh00:38:113
194639965,1cyclictest23568-21sshd21:25:143
194639965,1cyclictest21075-21ssh23:37:013
194639965,1cyclictest21075-21ssh23:37:013
194639965,1cyclictest15055-21ssh22:44:253
194639965,1cyclictest11678-21ssh00:10:163
194639965,1cyclictest11291-21ssh22:38:463
194639964,1cyclictest4438-21apt-get19:45:123
194639964,1cyclictest3246-21sh22:25:323
194639964,1cyclictest21278-21ssh22:51:113
194639964,1cyclictest20265-21ssh22:05:143
194639964,1cyclictest14637-21ssh00:15:023
194639963,2cyclictest4854-21ssh21:43:243
194639963,1cyclictest254-21systemd-journal21:49:543
194639963,1cyclictest254-21systemd-journal20:40:083
194639963,1cyclictest254-21systemd-journal20:34:233
194639963,1cyclictest22794-21expr23:40:153
194639963,1cyclictest22794-21expr23:40:153
194639962,3cyclictest675-21dpkg20:45:003
194639962,0cyclictest12328-21diskmemload22:23:303
194639961,3cyclictest0-21swapper/323:56:383
194639961,1cyclictest15247-21apt-get23:30:143
194639960,3cyclictest16748-21diskstats22:00:143
194639960,3cyclictest0-21swapper/322:45:133
194639960,3cyclictest0-21swapper/321:34:293
194639960,2cyclictest0-21swapper/323:25:253
194639960,2cyclictest0-21swapper/323:00:043
194639960,2cyclictest0-21swapper/322:12:143
194639960,2cyclictest0-21swapper/321:37:083
194639960,1cyclictest12328-21diskmemload00:03:243
194639960,0cyclictest0-21swapper/300:09:133
194549966,0cyclictest60950irq/123-eno123:30:422
194549966,0cyclictest60950irq/123-eno123:00:522
194549966,0cyclictest60950irq/123-eno122:00:132
194549966,0cyclictest60950irq/123-eno121:55:142
194549966,0cyclictest60950irq/123-eno121:15:112
194549966,0cyclictest60950irq/123-eno121:12:302
194549966,0cyclictest60950irq/123-eno121:00:552
194549966,0cyclictest60950irq/123-eno120:50:132
194549966,0cyclictest60950irq/123-eno120:44:132
194549966,0cyclictest60950irq/123-eno119:58:122
194549966,0cyclictest60950irq/123-eno119:40:142
194549966,0cyclictest60950irq/123-eno119:11:462
194549965,1cyclictest60950irq/123-eno119:35:122
194549965,1cyclictest60950irq/123-eno119:35:122
194549965,1cyclictest60950irq/123-eno100:25:132
194549965,1cyclictest29423-21ssh21:31:292
194549965,1cyclictest12698-21ntpq20:00:212
194549964,1cyclictest60950irq/123-eno120:55:162
194549964,1cyclictest28-21ksoftirqd/222:26:052
194549963,2cyclictest21844-21munin-node00:35:122
194549962,2cyclictest29841-21apt-get23:05:152
194549961,4cyclictest25158-21wc21:25:232
194549961,2cyclictest12328-21diskmemload21:35:122
194549960,3cyclictest0-21swapper/222:15:122
194449963,2cyclictest0-21swapper/100:04:571
194449961,4cyclictest0-21swapper/120:00:141
194449961,1cyclictest0-21swapper/121:57:551
194449960,6cyclictest0-21swapper/123:00:171
194449960,6cyclictest0-21swapper/120:55:231
194449960,5cyclictest0-21swapper/100:39:071
194449960,4cyclictest0-21swapper/123:55:171
194449960,4cyclictest0-21swapper/122:10:371
194449960,4cyclictest0-21swapper/122:05:151
194449960,4cyclictest0-21swapper/121:27:401
194449960,3cyclictest0-21swapper/121:41:071
194449960,2cyclictest0-21swapper/123:21:181
194449960,2cyclictest0-21swapper/123:15:281
194449960,2cyclictest0-21swapper/122:45:051
194449960,2cyclictest0-21swapper/122:25:131
194449960,2cyclictest0-21swapper/121:15:111
194449960,2cyclictest0-21swapper/119:35:121
194449960,2cyclictest0-21swapper/119:35:121
194449960,1cyclictest0-21swapper/100:15:131
194449960,0cyclictest0-21swapper/122:39:521
194449960,0cyclictest0-21swapper/122:31:381
194449960,0cyclictest0-21swapper/100:06:301
194349965,1cyclictest9002-21ntpq21:00:190
194349965,1cyclictest9-21ksoftirqd/019:20:120
194349964,1cyclictest9-21ksoftirqd/019:35:000
194349964,1cyclictest18348-21cron20:14:590
194349963,2cyclictest6548-21cron19:50:010
194349963,1cyclictest0-21swapper/020:30:140
194349960,6cyclictest25829-21ssh23:45:060
194349960,6cyclictest0-21swapper/020:18:310
194349960,5cyclictest19628-21/usr/sbin/munin19:10:130
194349960,5cyclictest12328-21diskmemload22:55:130
194349960,5cyclictest12328-21diskmemload00:25:150
194349960,5cyclictest0-21swapper/020:40:190
194349960,2cyclictest1132-21apt-get23:10:110
194349960,0cyclictest0-21swapper/021:55:410
194349960,0cyclictest0-21swapper/019:42:040
194349960,0cyclictest0-21swapper/000:30:240
7037250,1sleep30-21swapper/322:31:273
194639954,1cyclictest8173-21systemctl19:50:203
194639954,1cyclictest551-21cat19:35:163
194639954,1cyclictest551-21cat19:35:163
194639954,1cyclictest3120-21/usr/sbin/munin20:50:223
194639954,1cyclictest25978-21ssh23:45:123
194639954,1cyclictest14437-21ssh21:10:363
194639953,2cyclictest23841-21ntp_states19:15:173
194639953,1cyclictest28254-21apt-get20:35:123
194639953,1cyclictest2169-21load23:10:173
194639953,1cyclictest11267-21cron20:00:003
194639952,1cyclictest254-21systemd-journal21:04:233
194639952,1cyclictest24949-21runrttasks20:25:223
194639952,1cyclictest12328-21diskmemload21:55:153
194639952,1cyclictest0-21swapper/319:34:213
194639950,2cyclictest0-21swapper/320:15:133
194639950,1cyclictest0-21swapper/320:55:183
194549954,1cyclictest60950irq/123-eno119:45:132
194549950,5cyclictest0-21swapper/220:30:172
194549950,5cyclictest0-21swapper/219:15:162
194549950,2cyclictest254-21systemd-journal20:15:002
194449953,1cyclictest0-21swapper/120:45:131
194449952,2cyclictest0-21swapper/120:10:221
194449952,1cyclictest0-21swapper/119:30:201
194449950,5cyclictest0-21swapper/122:40:041
194449950,4cyclictest0-21swapper/122:00:311
194449950,3cyclictest0-21swapper/123:32:191
194449950,3cyclictest0-21swapper/122:19:361
194449950,3cyclictest0-21swapper/121:32:381
194449950,2cyclictest0-21swapper/123:51:171
194449950,2cyclictest0-21swapper/100:34:001
194449950,2cyclictest0-21swapper/100:10:141
194449950,0cyclictest0-21swapper/123:05:561
194349953,1cyclictest23422-21gltestperf19:15:140
194349950,5cyclictest0-21swapper/019:37:580
194349950,5cyclictest0-21swapper/019:37:570
194349950,1cyclictest13888-21/usr/sbin/munin20:05:240
194639942,1cyclictest17003-21sed20:10:163
194639942,1cyclictest10217-21aten_r1power_cu21:05:123
194639941,2cyclictest27418-21apt-get19:25:143
194639941,2cyclictest22593-21/usr/sbin/munin20:20:223
194639941,1cyclictest254-21systemd-journal19:20:063
194639940,1cyclictest254-21systemd-journal19:40:053
194449944,0cyclictest0-21swapper/120:09:151
194449944,0cyclictest0-21swapper/119:55:361
194449943,1cyclictest278232sleep120:32:411
194449941,2cyclictest0-21swapper/120:20:131
194449940,4cyclictest0-21swapper/119:40:541
194449940,3cyclictest0-21swapper/123:45:371
194449940,3cyclictest0-21swapper/121:45:151
194449940,2cyclictest0-21swapper/123:10:191
194449940,2cyclictest0-21swapper/122:20:181
194449940,2cyclictest0-21swapper/121:10:001
194449940,1cyclictest0-21swapper/120:25:201
194449940,1cyclictest0-21swapper/119:15:011
194449940,0cyclictest0-21swapper/120:50:151
194449940,0cyclictest0-21swapper/120:15:211
194449931,1cyclictest0-21swapper/121:00:131
194449931,1cyclictest0-21swapper/120:35:131
194449931,1cyclictest0-21swapper/119:45:121
194449931,1cyclictest0-21swapper/119:25:191
194449931,1cyclictest0-21swapper/119:20:121
194449931,1cyclictest0-21swapper/119:10:191
194449930,2cyclictest0-21swapper/120:40:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional