You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sat Jun 28, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262882233157,25sleep00-21swapper/007:08:480
262432218148,24sleep20-21swapper/207:08:142
262862214152,21sleep30-21swapper/307:08:473
262422198159,26sleep10-21swapper/107:08:131
75512740,0sleep20-21swapper/212:25:182
265382630,0sleep30-21swapper/312:05:253
94732160,0sleep00-21swapper/009:35:460
240822140,0sleep20-21swapper/209:55:192
273622130,0sleep10-21swapper/109:19:251
26467991210,1cyclictest9-21ksoftirqd/007:45:000
2648499119,1cyclictest28-21ksoftirqd/207:30:002
2646799112,4cyclictest24509-21perf12:05:000
2646799109,1cyclictest9-21ksoftirqd/011:15:000
2646799100,9cyclictest2122-21/usr/sbin/munin11:35:190
2646799100,7cyclictest24403-1kworker/u9:210:40:170
264929997,1cyclictest35-21ksoftirqd/310:33:583
264929996,2cyclictest35-21ksoftirqd/308:15:013
264929990,6cyclictest0-21swapper/310:35:153
264769998,1cyclictest21-21ksoftirqd/107:59:271
264679995,3cyclictest26795-21kworker/u8:210:45:350
1153290,0sleep20-21swapper/210:08:372
32440280,1sleep00-21swapper/008:25:260
264929986,1cyclictest35-21ksoftirqd/308:45:003
264929986,1cyclictest35-21ksoftirqd/308:05:003
264929986,1cyclictest17740-21snmpd11:50:073
264929986,1cyclictest17740-21snmpd11:07:543
264929986,1cyclictest17740-21snmpd09:55:103
264929986,1cyclictest17740-21snmpd09:06:593
264929986,1cyclictest17740-21snmpd07:24:553
264929980,4cyclictest17740-21snmpd07:32:083
264929980,4cyclictest0-21swapper/311:35:143
264929980,4cyclictest0-21swapper/309:20:463
264929980,3cyclictest3316-21kworker/u8:009:14:203
264929980,1cyclictest0-21swapper/310:27:163
264929980,1cyclictest0-21swapper/309:25:063
264849986,1cyclictest60950irq/123-eno110:55:182
264849986,1cyclictest60950irq/123-eno110:32:262
264849986,1cyclictest60950irq/123-eno110:13:512
264849986,1cyclictest60950irq/123-eno109:50:192
264849986,1cyclictest10840-21ntpq10:20:202
264849983,4cyclictest26461-21cyclictest10:54:272
264849982,5cyclictest28012-21ntpq10:00:272
264849981,4cyclictest0-21swapper/208:10:132
264849980,7cyclictest557-21nscd11:10:172
264849980,7cyclictest0-21swapper/211:20:152
264849980,2cyclictest0-21swapper/211:28:282
264769981,6cyclictest0-21swapper/110:50:111
264679986,1cyclictest17740-21snmpd08:20:250
264679985,2cyclictest29852-21sendmail_mailst12:10:220
264679983,5cyclictest8650-21ssh12:25:250
264679982,3cyclictest0-21swapper/007:50:180
264679982,2cyclictest13157-21idleruntime-cro10:25:010
264679980,7cyclictest29059-21ssh11:26:130
264679980,7cyclictest28102-21ssh12:09:520
264679980,7cyclictest1655-21grep10:50:240
264679980,4cyclictest27945-21/usr/sbin/munin09:20:220
264929976,1cyclictest22187-21ssh11:18:143
264929975,1cyclictest21225-21ssh09:51:093
264929975,1cyclictest17740-21snmpd10:02:103
264929975,1cyclictest17740-21snmpd09:40:533
264929975,1cyclictest17740-21snmpd09:02:143
264929975,1cyclictest17740-21snmpd08:47:383
264929975,1cyclictest17740-21snmpd08:19:583
264929975,1cyclictest17740-21snmpd07:35:113
264929974,1cyclictest254-21systemd-journal12:04:593
264929972,1cyclictest8984-21/usr/sbin/munin11:00:233
264929971,4cyclictest0-21swapper/312:30:133
264929970,6cyclictest0-21swapper/308:40:003
264929970,4cyclictest0-21swapper/312:10:293
264929970,1cyclictest0-21swapper/312:17:443
264929970,1cyclictest0-21swapper/310:43:493
264929970,1cyclictest0-21swapper/310:21:573
264929970,1cyclictest0-21swapper/310:08:473
264929970,1cyclictest0-21swapper/309:32:343
264929970,0cyclictest0-21swapper/312:21:533
264929970,0cyclictest0-21swapper/311:45:133
264849977,0cyclictest0-21swapper/212:19:592
264849976,1cyclictest60950irq/123-eno112:05:262
264849976,1cyclictest60950irq/123-eno111:35:242
264849976,1cyclictest60950irq/123-eno110:45:142
264849976,1cyclictest60950irq/123-eno109:40:202
264849976,1cyclictest60950irq/123-eno109:35:182
264849976,1cyclictest28-21ksoftirqd/208:50:132
264849976,1cyclictest17740-21snmpd12:21:322
264849976,1cyclictest17740-21snmpd09:06:172
264849976,1cyclictest17740-21snmpd07:23:592
264849976,0cyclictest60950irq/123-eno107:35:162
264849975,1cyclictest60950irq/123-eno112:30:192
264849975,1cyclictest60950irq/123-eno111:15:282
264849975,1cyclictest60950irq/123-eno108:40:132
264849975,1cyclictest17740-21snmpd12:11:092
264849971,5cyclictest20746-21idleruntime-cro12:00:002
264849971,5cyclictest0-21swapper/209:21:032
264849970,6cyclictest17740-21snmpd12:00:042
264849970,6cyclictest0-21swapper/211:05:012
264849970,6cyclictest0-21swapper/209:10:232
264849970,2cyclictest26676-21apt-get07:10:172
264849970,2cyclictest0-21swapper/208:45:162
264769971,6cyclictest0-21swapper/110:56:561
264769971,6cyclictest0-21swapper/108:33:101
264769971,2cyclictest0-21swapper/111:15:071
264769970,6cyclictest0-21swapper/111:05:111
264769970,1cyclictest0-21swapper/112:34:131
264769970,1cyclictest0-21swapper/108:55:171
264679976,1cyclictest9-21ksoftirqd/009:10:010
264679976,1cyclictest557-21nscd09:15:320
264679976,1cyclictest13402-21ssh09:40:370
264679976,1cyclictest11660-21ssh11:45:480
264679975,1cyclictest17740-21snmpd09:53:340
264679975,1cyclictest17740-21snmpd08:59:260
264679975,1cyclictest17740-21snmpd08:15:540
264679975,1cyclictest17740-21snmpd07:28:200
264679974,2cyclictest19533-21diskmemload11:02:380
264679973,1cyclictest570-21systemd-logind12:15:240
264679972,4cyclictest31909-21perf07:20:000
264679972,4cyclictest27984-21ntp_offset10:00:240
264679972,1cyclictest23965-21memory09:55:180
264679970,6cyclictest8770-21ssh11:43:140
264679970,6cyclictest5712-21ssh10:15:030
264679970,6cyclictest5007-21ssh09:30:260
264679970,6cyclictest32623-21ssh09:25:160
264679970,6cyclictest23176-21apt-get11:20:160
264679970,6cyclictest22763-21ssh09:13:040
264679970,6cyclictest20204-21smartctl11:15:220
264679970,6cyclictest20122-21open_files08:00:210
264679970,6cyclictest19500-21ssh11:56:320
264679970,6cyclictest17867-21ssh09:47:210
264679970,6cyclictest16127-21ssh11:52:320
264679970,6cyclictest11646-21ps08:50:220
264679970,6cyclictest11071-21grep12:30:140
264679970,5cyclictest19533-21diskmemload10:06:540
264679970,4cyclictest0-21swapper/012:35:140
264679970,2cyclictest0-21swapper/007:35:140
264679970,1cyclictest17544-21aten_r1power_po10:30:120
264679970,1cyclictest0-21swapper/010:55:150
264679970,1cyclictest0-21swapper/010:26:060
264679970,1cyclictest0-21swapper/010:10:150
5828260,1sleep10-21swapper/112:21:581
28887260,2sleep10-21swapper/110:01:151
264929965,1cyclictest9241-21ssh12:26:063
264929965,1cyclictest30883-21ntpq07:15:203
264929965,1cyclictest30721-21ssh11:30:103
264929965,1cyclictest26197-21ssh11:23:483
264929965,1cyclictest2267-21ssh10:50:473
264929964,1cyclictest9518-21ssh09:35:543
264929964,1cyclictest17740-21snmpd10:12:013
264929964,1cyclictest17740-21snmpd08:51:343
264929964,1cyclictest17740-21snmpd08:06:393
264929964,1cyclictest17740-21snmpd07:46:383
264929964,1cyclictest17454-21cat07:55:173
264929962,1cyclictest13544-21if_eno108:55:173
264929961,0cyclictest19533-21diskmemload09:16:263
264929960,4cyclictest16622-21ssh12:35:253
264929960,1cyclictest28962-21apt-get10:45:133
264929960,1cyclictest0-21swapper/311:25:253
264929960,1cyclictest0-21swapper/311:10:243
264929960,1cyclictest0-21swapper/310:55:163
264929960,1cyclictest0-21swapper/310:16:393
264929960,1cyclictest0-21swapper/309:45:563
264929960,0cyclictest19533-21diskmemload11:40:213
264849966,0cyclictest60950irq/123-eno111:45:162
264849966,0cyclictest60950irq/123-eno111:40:142
264849966,0cyclictest60950irq/123-eno110:25:222
264849966,0cyclictest60950irq/123-eno109:45:052
264849966,0cyclictest60950irq/123-eno109:15:132
264849966,0cyclictest60950irq/123-eno109:01:162
264849966,0cyclictest60950irq/123-eno108:09:252
264849966,0cyclictest60950irq/123-eno107:55:532
264849966,0cyclictest60950irq/123-eno107:54:102
264849966,0cyclictest60950irq/123-eno107:34:402
264849966,0cyclictest60950irq/123-eno107:15:272
264849966,0cyclictest0-21swapper/208:30:222
264849965,1cyclictest7899-21ssh11:00:032
264849965,1cyclictest60950irq/123-eno111:50:172
264849965,1cyclictest60950irq/123-eno110:35:152
264849965,1cyclictest60950irq/123-eno108:16:182
264849965,1cyclictest27107-21ssh10:41:072
264849964,1cyclictest60950irq/123-eno112:35:022
264849964,1cyclictest28-21ksoftirqd/208:30:002
264849960,5cyclictest6008-21cpuspeed_turbos10:15:152
264849960,5cyclictest3681-21sh09:30:182
264849960,2cyclictest0-21swapper/211:30:462
264849960,2cyclictest0-21swapper/209:25:112
264849960,1cyclictest0-21swapper/208:55:202
264849960,0cyclictest0-21swapper/208:35:172
264769962,1cyclictest19606-21taskset11:56:501
264769962,1cyclictest0-21swapper/111:40:001
264769962,1cyclictest0-21swapper/111:00:221
264769960,6cyclictest0-21swapper/112:14:311
264769960,6cyclictest0-21swapper/111:40:331
264769960,6cyclictest0-21swapper/111:28:391
264769960,6cyclictest0-21swapper/110:31:471
264769960,6cyclictest0-21swapper/109:52:341
264769960,6cyclictest0-21swapper/108:53:141
264769960,6cyclictest0-21swapper/107:22:531
264769960,5cyclictest0-21swapper/112:35:321
264769960,5cyclictest0-21swapper/112:27:111
264769960,5cyclictest0-21swapper/109:25:191
264769960,4cyclictest0-21swapper/111:12:521
264769960,4cyclictest0-21swapper/107:25:161
264769960,3cyclictest0-21swapper/112:01:101
264769960,3cyclictest0-21swapper/111:48:561
264769960,3cyclictest0-21swapper/109:35:021
264769960,3cyclictest0-21swapper/109:11:421
264769960,2cyclictest0-21swapper/112:05:421
264769960,2cyclictest0-21swapper/110:35:141
264769960,2cyclictest0-21swapper/110:23:561
264769960,2cyclictest0-21swapper/110:05:141
264769960,2cyclictest0-21swapper/109:55:231
264769960,1cyclictest0-21swapper/110:16:101
264679965,1cyclictest7886-1kworker/u9:011:05:040
264679965,1cyclictest3438-21ssh12:20:030
264679965,1cyclictest30688-21ssh11:30:020
264679964,1cyclictest15949-21cat09:00:190
264679962,3cyclictest18477-21taskset07:57:210
264679961,2cyclictest0-21swapper/008:35:170
264679960,6cyclictest0-21swapper/007:10:260
264679960,5cyclictest20498-1kworker/u9:110:35:010
264929954,1cyclictest11281-21sshd07:40:393
264929951,1cyclictest884-21apt-get08:30:143
264929950,5cyclictest0-21swapper/307:12:383
264929950,0cyclictest0-21swapper/311:55:213
264929950,0cyclictest0-21swapper/308:20:153
264929950,0cyclictest0-21swapper/307:50:183
264849955,0cyclictest60950irq/123-eno108:20:142
264849955,0cyclictest60950irq/123-eno107:45:182
264849955,0cyclictest60950irq/123-eno107:43:282
264849953,1cyclictest18954-21apt-get08:00:142
264769955,0cyclictest0-21swapper/109:43:481
264769951,3cyclictest0-21swapper/108:40:141
264769951,1cyclictest0-21swapper/111:20:171
264769950,5cyclictest0-21swapper/110:45:111
264769950,5cyclictest0-21swapper/108:25:311
264769950,5cyclictest0-21swapper/108:17:031
264769950,5cyclictest0-21swapper/108:11:301
264769950,5cyclictest0-21swapper/107:51:121
264769950,3cyclictest0-21swapper/111:53:201
264769950,3cyclictest0-21swapper/109:45:111
264769950,3cyclictest0-21swapper/109:20:131
264769950,3cyclictest0-21swapper/107:15:211
264769950,2cyclictest0-21swapper/110:41:291
264769950,2cyclictest0-21swapper/110:11:421
264769950,1cyclictest0-21swapper/110:25:351
264679955,0cyclictest0-21swapper/008:05:050
264679953,1cyclictest4735-21aten2.4-expect07:30:130
264679950,5cyclictest0-21swapper/008:30:150
264679950,5cyclictest0-21swapper/008:10:090
264679950,4cyclictest5617-21/usr/sbin/munin08:40:140
264679950,4cyclictest32295-21/usr/sbin/munin07:20:240
264679950,4cyclictest17740-21snmpd08:49:070
264679950,4cyclictest11869-21/usr/sbin/munin07:45:210
264929943,1cyclictest2976-21tail07:25:163
264929940,1cyclictest254-21systemd-journal08:25:113
264769941,1cyclictest0-21swapper/109:00:231
264769941,1cyclictest0-21swapper/107:30:151
264769940,4cyclictest9069-21chrt07:37:451
264769940,3cyclictest0-21swapper/112:15:031
264769940,3cyclictest0-21swapper/111:31:211
264769940,1cyclictest0-21swapper/109:31:031
264769940,1cyclictest0-21swapper/108:05:181
264769940,1cyclictest0-21swapper/108:00:201
264769940,0cyclictest0-21swapper/108:45:141
264769940,0cyclictest0-21swapper/107:40:211
264769931,1cyclictest0-21swapper/109:05:151
264769931,1cyclictest0-21swapper/108:35:191
264769930,1cyclictest0-21swapper/108:20:151
264769930,1cyclictest0-21swapper/107:45:151
264769930,0cyclictest0-21swapper/107:10:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional