You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 18:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 19, 2025 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4142205165,26sleep20-21swapper/207:05:012
25512203165,25sleep30-21swapper/307:07:243
24312202163,25sleep00-21swapper/007:05:480
27122200163,25sleep10-21swapper/107:09:271
1115321250,0sleep30-21swapper/310:56:243
179712630,0sleep30-21swapper/311:05:253
152072190,0sleep00-21swapper/010:18:160
153622180,0sleep30-21swapper/312:32:173
103282170,1sleep1283399cyclictest08:30:161
200362160,0sleep00-21swapper/008:50:130
50782140,0sleep10-21swapper/110:04:591
221642140,0sleep10-21swapper/111:56:351
2834991313,0cyclictest0-21swapper/209:30:242
128022130,0sleep20-21swapper/211:45:112
2834991211,1cyclictest28-21ksoftirqd/210:45:072
2834991211,1cyclictest28-21ksoftirqd/209:20:182
283099122,5cyclictest7362-21sort08:24:590
2835991110,1cyclictest35-21ksoftirqd/311:50:003
2835991110,1cyclictest35-21ksoftirqd/308:50:013
2834991110,1cyclictest28-21ksoftirqd/208:19:592
283499110,10cyclictest5402-21munin-node12:13:332
283099113,4cyclictest18073-21latency_hist07:40:000
2830991111,0cyclictest9-21ksoftirqd/009:47:110
290642100,0sleep20-21swapper/212:05:372
283599109,1cyclictest35-21ksoftirqd/309:20:013
283599109,1cyclictest35-21ksoftirqd/307:50:013
2835991010,0cyclictest35-21ksoftirqd/308:10:013
283499109,1cyclictest28-21ksoftirqd/211:15:232
283499108,1cyclictest28-21ksoftirqd/210:30:142
283499108,1cyclictest28-21ksoftirqd/209:10:012
283499100,7cyclictest28782-21diskmemload11:30:142
283499100,5cyclictest28782-21diskmemload10:05:212
283499100,0cyclictest0-21swapper/208:35:192
283399100,5cyclictest53872sleep112:19:431
283099108,1cyclictest9-21ksoftirqd/010:29:590
283099100,8cyclictest0-21swapper/010:32:460
28407290,1sleep00-21swapper/009:05:250
28359998,1cyclictest35-21ksoftirqd/312:40:013
28359998,1cyclictest35-21ksoftirqd/312:10:003
28359998,1cyclictest35-21ksoftirqd/310:05:003
28359998,1cyclictest35-21ksoftirqd/309:40:163
28359991,7cyclictest0-21swapper/307:12:063
28349999,0cyclictest28782-21diskmemload10:10:162
28349999,0cyclictest28-21ksoftirqd/211:25:212
28349998,1cyclictest28-21ksoftirqd/212:00:012
28349998,1cyclictest28-21ksoftirqd/208:10:002
28349997,1cyclictest28-21ksoftirqd/208:00:012
28349990,7cyclictest5402-21munin-node11:09:562
28339991,5cyclictest0-21swapper/111:15:111
28309998,1cyclictest9-21ksoftirqd/010:15:010
28309993,4cyclictest19778-21/usr/sbin/munin11:10:150
28359987,1cyclictest35-21ksoftirqd/309:55:013
28359987,1cyclictest19110-21snmpd11:03:013
28359986,1cyclictest567-21nscd10:36:263
28359986,1cyclictest35-21ksoftirqd/310:00:003
28359986,1cyclictest35-21ksoftirqd/308:30:003
28359986,1cyclictest19110-21snmpd10:22:543
28359980,5cyclictest12477-21apt-get10:15:123
28359980,3cyclictest1780-21apt-get11:30:123
28349988,0cyclictest28-21ksoftirqd/209:55:182
28349986,1cyclictest28782-21diskmemload11:35:142
28349986,1cyclictest19110-21snmpd12:30:492
28349986,1cyclictest19110-21snmpd11:52:292
28349981,4cyclictest742-21runrttasks10:51:502
28349980,6cyclictest60950irq/123-eno110:00:342
28309986,1cyclictest8339-21ssh11:38:510
28309983,4cyclictest12821-21/usr/sbin/munin11:45:200
28309981,6cyclictest25210-1kworker/u9:211:16:560
28309980,7cyclictest6110-21ssh10:05:170
28309980,7cyclictest30916-21ssh09:10:470
28309980,7cyclictest29068-21ssh12:05:370
28309980,7cyclictest19110-21snmpd09:18:130
28309980,7cyclictest1199-21ssh12:13:330
28309980,1cyclictest14702-21grep12:30:230
28309980,1cyclictest10858-21switchtime12:25:230
28359977,0cyclictest35-21ksoftirqd/310:35:003
28359976,1cyclictest19110-21snmpd11:42:473
28359976,1cyclictest19110-21snmpd10:14:243
28359975,1cyclictest26249-21ssh09:49:473
28359974,1cyclictest570-21systemd-logind08:17:103
28359974,0cyclictest28782-21diskmemload12:21:423
28359973,2cyclictest6496-21/usr/sbin/munin10:05:213
28359973,2cyclictest21662-21ssh10:25:563
28359972,4cyclictest7424-21runrttasks11:36:083
28359972,3cyclictest28782-21diskmemload11:29:143
28359971,3cyclictest1449-21ntpd09:13:053
28359970,5cyclictest28782-21diskmemload11:12:513
28359970,3cyclictest0-21swapper/311:58:563
28359970,3cyclictest0-21swapper/309:29:213
28359970,1cyclictest0-21swapper/309:20:133
28349977,0cyclictest28-21ksoftirqd/210:25:162
28349977,0cyclictest28-21ksoftirqd/209:40:132
28349976,1cyclictest60950irq/123-eno112:04:182
28349976,1cyclictest60950irq/123-eno111:40:132
28349976,1cyclictest60950irq/123-eno109:15:272
28349976,1cyclictest28-21ksoftirqd/207:44:432
28349976,1cyclictest19110-21snmpd07:12:272
28349976,0cyclictest60950irq/123-eno109:35:122
28349975,1cyclictest60950irq/123-eno110:35:162
28349975,1cyclictest24817-21ssh09:45:272
28349975,1cyclictest17465-21cat12:35:182
28349973,2cyclictest254-21systemd-journal08:24:552
28349971,3cyclictest60950irq/123-eno109:25:022
28349970,7cyclictest28-21ksoftirqd/212:19:492
28349970,4cyclictest28782-21diskmemload10:15:192
28349970,4cyclictest0-21swapper/212:29:522
28349970,4cyclictest0-21swapper/208:00:152
28349970,1cyclictest0-21swapper/207:50:012
28339970,6cyclictest0-21swapper/108:16:521
28339970,5cyclictest0-21swapper/112:29:021
28339970,5cyclictest0-21swapper/112:10:241
28339970,2cyclictest0-21swapper/107:15:161
28339970,1cyclictest0-21swapper/110:51:191
28339970,1cyclictest0-21swapper/110:22:501
28309976,1cyclictest8457-21cat08:25:160
28309976,1cyclictest25924-21ssh12:02:010
28309976,1cyclictest19110-21snmpd07:47:010
28309976,1cyclictest19110-21snmpd07:19:180
28309975,1cyclictest250772sleep007:51:340
28309975,1cyclictest22854-21ssh11:58:410
28309975,1cyclictest19110-21snmpd07:25:180
28309975,1cyclictest13650irq/124-ahci[0009:00:010
28309974,2cyclictest32459-21idleruntime-cro08:10:010
28309974,0cyclictest1134-21apt-get10:00:020
28309971,6cyclictest6011-1kworker/u9:209:21:220
28309971,5cyclictest0-21swapper/008:20:000
28309970,6cyclictest8770-21ssh12:24:040
28309970,6cyclictest28782-21diskmemload12:15:530
28309970,6cyclictest28782-21diskmemload10:35:070
28309970,6cyclictest28407-21ssh09:50:260
28309970,6cyclictest18930-21ssh11:52:400
28309970,6cyclictest17289-21ntp_states10:20:200
28309970,6cyclictest15944-21cstates09:35:150
28309970,6cyclictest0-21swapper/011:31:200
28309970,6cyclictest0-21swapper/011:05:120
28309970,6cyclictest0-21swapper/010:50:140
28309970,5cyclictest0-21swapper/010:47:510
28309970,4cyclictest29397-21ssh11:22:110
28309970,1cyclictest7876-21ssh09:25:040
28309970,1cyclictest28782-21diskmemload09:43:190
28309970,1cyclictest18730-21ssh12:36:360
28309970,1cyclictest14618-21ssh11:01:030
28309970,1cyclictest0-21swapper/009:34:330
28309970,1cyclictest0-21swapper/008:35:150
7506260,1sleep10-21swapper/109:24:441
28359965,1cyclictest3862-21ssh10:46:003
28359965,1cyclictest322-21ssh12:11:013
28359965,1cyclictest31888-21ntpq10:40:203
28359965,1cyclictest27551-21cat09:05:183
28359965,1cyclictest25356-21ssh11:15:563
28359965,1cyclictest23550-21ssh12:00:043
28359965,1cyclictest19110-21snmpd07:51:003
28359965,1cyclictest19110-21snmpd07:28:483
28359965,1cyclictest19110-21snmpd07:15:033
28359965,1cyclictest13874-21ssh09:31:143
28359965,0cyclictest20588-21latency_hist07:45:003
28359964,1cyclictest19110-21snmpd07:36:413
28359963,1cyclictest35-21ksoftirqd/308:35:093
28359963,1cyclictest254-21systemd-journal08:45:003
28359961,2cyclictest2603-21basename08:15:003
28359960,2cyclictest0-21swapper/310:50:393
28359960,1cyclictest0-21swapper/312:26:083
28359960,1cyclictest0-21swapper/311:21:423
28359960,0cyclictest28782-21diskmemload12:15:393
28349966,0cyclictest60950irq/123-eno111:20:162
28349966,0cyclictest60950irq/123-eno111:10:162
28349966,0cyclictest60950irq/123-eno109:50:142
28349966,0cyclictest60950irq/123-eno109:10:012
28349966,0cyclictest60950irq/123-eno109:00:182
28349966,0cyclictest60950irq/123-eno108:51:202
28349966,0cyclictest60950irq/123-eno107:30:372
28349966,0cyclictest60950irq/123-eno107:25:032
28349965,1cyclictest60950irq/123-eno110:20:072
28349965,1cyclictest28-21ksoftirqd/212:20:192
28349965,1cyclictest28-21ksoftirqd/207:40:002
28349965,1cyclictest28-21ksoftirqd/207:19:592
28349965,1cyclictest23062-21ntpq08:55:192
28349965,1cyclictest13810-21ntpq11:00:202
28349965,0cyclictest28-21ksoftirqd/208:40:152
28349964,1cyclictest60950irq/123-eno110:55:152
28349964,1cyclictest28-21ksoftirqd/207:50:142
28349961,2cyclictest1190-21gltestperf08:10:152
28349960,5cyclictest0-21swapper/207:21:092
28349960,1cyclictest31654-21latency10:40:172
28349960,1cyclictest0-21swapper/208:34:052
28339962,2cyclictest0-21swapper/111:09:591
28339961,2cyclictest0-21swapper/112:08:331
28339960,6cyclictest0-21swapper/110:42:541
28339960,6cyclictest0-21swapper/110:14:351
28339960,6cyclictest0-21swapper/109:53:321
28339960,6cyclictest0-21swapper/109:46:101
28339960,6cyclictest0-21swapper/109:40:191
28339960,6cyclictest0-21swapper/109:00:031
28339960,5cyclictest0-21swapper/109:15:031
28339960,5cyclictest0-21swapper/107:10:111
28339960,4cyclictest0-21swapper/110:30:041
28339960,4cyclictest0-21swapper/110:09:411
28339960,3cyclictest0-21swapper/112:35:031
28339960,3cyclictest0-21swapper/112:00:071
28339960,3cyclictest0-21swapper/109:25:131
28339960,2cyclictest0-21swapper/111:00:171
28339960,2cyclictest0-21swapper/109:30:201
28339960,1cyclictest0-21swapper/109:11:511
28339960,1cyclictest0-21swapper/108:06:581
28339960,1cyclictest0-21swapper/108:01:011
28339960,1cyclictest0-21swapper/107:22:201
28309966,0cyclictest32083-21ssh09:55:370
28309965,1cyclictest9-21ksoftirqd/007:55:130
28309965,1cyclictest3340-21tail07:10:120
28309965,1cyclictest19110-21snmpd08:46:360
28309960,6cyclictest0-21swapper/008:10:280
28309960,6cyclictest0-21swapper/007:40:270
28309960,6cyclictest0-21swapper/007:30:530
28309960,6cyclictest0-21swapper/007:23:020
28309960,5cyclictest0-21swapper/008:40:200
28309960,3cyclictest30620-21/usr/sbin/munin11:25:170
28309960,1cyclictest0-21swapper/010:55:490
28309960,0cyclictest28782-21diskmemload11:40:540
28309960,0cyclictest0-21swapper/010:43:500
28309960,0cyclictest0-21swapper/008:00:260
28359955,0cyclictest35-21ksoftirqd/311:50:173
28359954,1cyclictest19110-21snmpd09:36:133
28359953,1cyclictest27443-21sshd07:56:433
28359953,1cyclictest19841-21tr08:50:123
28359953,1cyclictest14100-21diskstats07:30:173
28359951,2cyclictest12045-21/usr/sbin/munin08:34:593
28359950,5cyclictest0-21swapper/308:58:443
28349954,1cyclictest60950irq/123-eno108:45:132
28349953,1cyclictest60950irq/123-eno108:25:152
28339954,1cyclictest0-21swapper/107:55:421
28339953,1cyclictest0-21swapper/108:50:121
28339953,0cyclictest0-21swapper/108:55:131
28339951,2cyclictest0-21swapper/107:35:001
28339951,1cyclictest0-21swapper/111:35:181
28339951,1cyclictest0-21swapper/110:25:141
28339950,5cyclictest0-21swapper/110:15:581
28339950,5cyclictest0-21swapper/109:56:081
28339950,5cyclictest0-21swapper/108:41:151
28339950,5cyclictest0-21swapper/108:21:071
28339950,5cyclictest0-21swapper/107:27:381
28339950,3cyclictest0-21swapper/112:23:221
28339950,3cyclictest0-21swapper/111:51:321
28339950,3cyclictest0-21swapper/111:30:161
28339950,3cyclictest0-21swapper/110:55:081
28339950,3cyclictest0-21swapper/110:38:511
28339950,2cyclictest0-21swapper/111:45:241
28339950,2cyclictest0-21swapper/111:24:321
28339950,2cyclictest0-21swapper/110:45:221
28339950,2cyclictest0-21swapper/108:35:111
28339950,1cyclictest0-21swapper/107:54:441
28339950,0cyclictest0-21swapper/111:26:201
28309953,1cyclictest557-21nscd09:00:200
28309951,2cyclictest0-21swapper/008:30:140
28359943,1cyclictest8931-21grep07:20:143
28359943,1cyclictest28180-21cpu08:00:153
28359942,1cyclictest6881-21unixbench_multi08:20:213
28359940,1cyclictest254-21systemd-journal09:00:003
28339944,0cyclictest0-21swapper/107:41:271
28339941,1cyclictest0-21swapper/107:35:161
28339941,0cyclictest0-21swapper/112:30:161
28339940,4cyclictest0-21swapper/108:10:151
28339940,3cyclictest0-21swapper/111:10:161
28339940,2cyclictest0-21swapper/107:45:111
28339940,1cyclictest0-21swapper/111:40:151
28339940,1cyclictest0-21swapper/109:35:221
28339940,1cyclictest0-21swapper/108:45:141
28339940,1cyclictest0-21swapper/108:26:071
28339930,1cyclictest0-21swapper/109:05:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional