You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 14:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Thu Nov 27, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260821080,1sleep22606-21lspci10:41:402
1277021050,0sleep20-21swapper/210:13:102
2373321030,0sleep20-21swapper/209:52:142
1497221030,0sleep014971-21sendmail_mailst07:25:160
491221020,1sleep341-21ksoftirqd/309:25:243
318652980,0sleep031863-21grepconf.sh10:22:520
299272970,2sleep3710799cyclictest11:20:543
141312950,0sleep1710399cyclictest11:19:171
204392640,0sleep220430-21lspci12:02:152
322452600,0sleep20-21swapper/212:19:262
146722600,0sleep20-21swapper/211:22:542
123672600,0sleep20-21swapper/207:20:142
107942580,0sleep20-21swapper/210:53:222
132402560,0sleep10-21swapper/112:35:541
313852550,0sleep00-21swapper/009:35:260
191272550,0sleep10-21swapper/111:40:521
44452540,2sleep2710699cyclictest11:35:482
190682510,0sleep0111rcuc/012:27:200
323772500,0sleep20-21swapper/210:27:142
312372500,1sleep0111rcuc/009:09:150
273552500,0sleep00-21swapper/011:31:170
100752480,0sleep30-21swapper/309:46:543
59252460,0sleep30-21swapper/310:12:253
267292400,0sleep30-21swapper/311:13:343
236982370,0sleep30-21swapper/312:33:573
164212350,0sleep30-21swapper/310:43:093
97992290,1sleep39797-21sshd10:35:163
67662297,7sleep10-21swapper/107:07:081
665322810,6sleep20-21swapper/207:05:422
327412260,0sleep20-21swapper/211:28:272
189482250,0sleep20-21swapper/209:27:032
38272240,0sleep10-21swapper/111:00:071
680722311,7sleep30-21swapper/307:07:393
680922210,7sleep00-21swapper/007:07:390
79632180,1sleep1231rcuc/112:17:051
34072180,2sleep1710399cyclictest11:10:561
318872180,0sleep0101ktimersoftd/012:19:230
286172180,0sleep00-21swapper/011:17:200
170342170,0sleep00-21swapper/009:30:220
91022160,0sleep30-21swapper/309:58:173
80502160,0sleep20-21swapper/210:24:152
67302160,0sleep00-21swapper/010:52:570
318962160,1sleep131892-21lspci09:32:031
19212160,1sleep00-21swapper/009:46:040
16082160,0sleep30-21swapper/309:10:053
109922160,0sleep2311rcuc/211:43:332
94642150,0sleep00-21swapper/011:50:350
41212150,0sleep30-21swapper/312:00:363
219192150,0sleep00-21swapper/011:20:070
13882150,0sleep20-21swapper/212:06:522
710799140,13cyclictest0-21swapper/310:16:573
710399140,2cyclictest30038-21id11:31:341
116872140,0sleep20-21swapper/209:43:462
7107991311,1cyclictest17062-21sshd12:36:173
710399130,1cyclictest700-21gdbus12:03:141
709799130,1cyclictest0-21swapper/009:56:450
317822130,0sleep00-21swapper/009:28:250
299912130,1sleep2321ktimersoftd/209:38:482
14852130,0sleep20-21swapper/209:10:042
710799120,1cyclictest21959-21sshd12:27:383
710799120,1cyclictest21067-21bash12:12:073
710799120,11cyclictest0-21swapper/309:33:573
710799120,0cyclictest0-21swapper/310:21:183
710699120,11cyclictest616-17auditd12:33:102
710699120,11cyclictest0-21swapper/210:09:092
7103991210,1cyclictest1358-21bash10:59:441
7103991210,1cyclictest0-21swapper/112:28:041
7103991210,1cyclictest0-21swapper/110:15:441
710399120,11cyclictest0-21swapper/110:53:251
7097991210,1cyclictest618-13audispd11:01:350
7097991210,1cyclictest0-21swapper/012:12:440
709799120,11cyclictest21011-21sshd09:51:540
710799119,1cyclictest2827-21sshd09:42:483
7107991110,0cyclictest0-21swapper/309:17:373
710799110,10cyclictest0-21swapper/311:06:473
710799110,10cyclictest0-21swapper/310:48:483
710799110,0cyclictest0-21swapper/312:19:283
710699119,1cyclictest4232-21sshd11:32:182
7106991110,0cyclictest0-21swapper/212:21:292
7106991110,0cyclictest0-21swapper/210:15:382
7103991110,0cyclictest0-21swapper/111:21:141
7103991110,0cyclictest0-21swapper/110:36:351
7103991110,0cyclictest0-21swapper/109:54:341
7103991110,0cyclictest0-21swapper/109:07:541
710399110,10cyclictest0-21swapper/109:28:541
710399110,0cyclictest0-21swapper/110:20:051
709799119,1cyclictest443-21systemd-journal09:24:340
709799119,1cyclictest15329-21bash10:25:150
7097991110,0cyclictest0-21swapper/011:28:250
7097991110,0cyclictest0-21swapper/010:48:240
7097991110,0cyclictest0-21swapper/010:35:150
7097991110,0cyclictest0-21swapper/010:31:340
90202100,0sleep10-21swapper/111:50:331
710799109,0cyclictest0-21swapper/311:01:573
710799109,0cyclictest0-21swapper/310:59:183
710799109,0cyclictest0-21swapper/310:27:473
710799108,1cyclictest18770-21sshd11:33:573
710799100,0cyclictest0-21swapper/311:28:183
710699109,0cyclictest0-21swapper/212:36:292
710699109,0cyclictest0-21swapper/211:51:492
710699109,0cyclictest0-21swapper/210:45:592
710699109,0cyclictest0-21swapper/209:56:192
710699108,1cyclictest28096-21/usr/sbin/munin11:10:192
710699108,1cyclictest24017-21sshd12:27:492
710399109,0cyclictest0-21swapper/110:29:141
710399100,0cyclictest0-21swapper/109:41:251
710399100,0cyclictest0-21swapper/109:20:441
709799109,0cyclictest0-21swapper/012:00:240
709799109,0cyclictest0-21swapper/011:37:540
709799109,0cyclictest0-21swapper/009:10:230
709799109,0cyclictest0-21swapper/008:40:240
709799103,3cyclictest6369-21perf10:20:000
709799100,0cyclictest0-21swapper/008:47:130
71079998,0cyclictest0-21swapper/311:59:473
71079998,0cyclictest0-21swapper/311:46:173
71079998,0cyclictest0-21swapper/310:52:573
71069998,0cyclictest0-21swapper/211:56:382
71069998,0cyclictest0-21swapper/211:00:392
71069998,0cyclictest0-21swapper/209:15:192
71039998,0cyclictest0-21swapper/110:45:051
70979998,0cyclictest0-21swapper/012:37:140
70979998,0cyclictest0-21swapper/010:58:540
70979996,2cyclictest23611-21kworker/0:010:04:400
29993290,0sleep10-21swapper/112:12:591
71079985,2cyclictest649-21avahi-daemon09:35:263
71079985,2cyclictest17186-21sshd11:16:003
71079984,3cyclictest7019-21sshd09:54:253
71069987,0cyclictest0-21swapper/209:33:392
71069987,0cyclictest0-21swapper/207:50:182
71069986,1cyclictest649-21avahi-daemon11:07:182
71069986,1cyclictest28176-21lspci11:45:292
71069986,1cyclictest27570-21sshd12:12:452
71069986,1cyclictest18881-21lspci10:32:492
71069985,2cyclictest700-21gdbus10:37:202
71039987,0cyclictest0-21swapper/112:23:051
71039987,0cyclictest0-21swapper/109:49:451
71039986,1cyclictest3068-21lspci10:01:001
71039986,1cyclictest26345-21sshd11:38:141
71039986,1cyclictest17879-21lspci11:26:451
71039985,2cyclictest649-21avahi-daemon10:12:071
71039985,2cyclictest649-21avahi-daemon09:58:191
70979985,2cyclictest22388-21sshd11:55:350
70979985,2cyclictest21415-21kworker/0:112:20:490
25197280,1sleep0101ktimersoftd/012:09:190
71079975,1cyclictest649-21avahi-daemon12:20:503
71079975,1cyclictest646-21dbus-daemon11:51:463
71079975,1cyclictest3037-21lspci11:35:393
71079975,1cyclictest23019-21sshd11:41:173
71079975,1cyclictest13692-21lspci10:05:503
71079974,2cyclictest7311-21sshd10:31:333
71079974,2cyclictest649-21avahi-daemon09:20:043
71069975,1cyclictest684-21polkitd09:45:232
71069975,1cyclictest3071-21lspci10:01:002
71069975,1cyclictest22023-21sshd11:16:342
71069974,2cyclictest27416-21sshd10:58:542
71039976,0cyclictest0-21swapper/111:05:041
71039976,0cyclictest0-21swapper/110:33:241
71039975,1cyclictest7953-21lspci11:46:501
71039975,1cyclictest700-21gdbus09:10:271
71039975,1cyclictest12978-21lspci09:36:581
71039974,2cyclictest7267-21sshd12:32:221
71039974,2cyclictest649-21avahi-daemon12:05:451
71039974,2cyclictest649-21avahi-daemon10:41:511
71039974,2cyclictest649-21avahi-daemon10:05:501
71039974,2cyclictest649-21avahi-daemon09:15:041
71039974,2cyclictest616-17auditd11:55:081
70979976,0cyclictest0-21swapper/011:46:240
70979976,0cyclictest0-21swapper/009:40:330
70979976,0cyclictest0-21swapper/008:58:130
70979976,0cyclictest0-21swapper/008:25:040
70979975,1cyclictest684-21polkitd11:06:180
70979975,1cyclictest6130-21sshd11:11:140
70979975,1cyclictest11094-21lspci09:18:590
70979974,2cyclictest5458-21sshd10:12:230
70979974,2cyclictest32383-21sshd10:41:210
70979974,2cyclictest27133-21sshd11:41:470
70979974,2cyclictest22155-21sshd12:30:390
70979970,0cyclictest0-21swapper/008:18:140
30768270,0sleep20-21swapper/209:21:062
27967270,1sleep328146-21tty12:06:143
71079964,1cyclictest684-21polkitd10:00:023
71079964,1cyclictest22699-21mii-tool09:05:113
71079963,2cyclictest17299-21snmpd08:03:103
71079963,2cyclictest17299-21snmpd07:49:463
71079963,2cyclictest11827-21sadc08:40:003
71079960,5cyclictest0-21swapper/308:20:473
71079960,5cyclictest0-21swapper/308:10:073
71079960,5cyclictest0-21swapper/307:22:173
71069964,1cyclictest649-21avahi-daemon09:06:332
71069964,1cyclictest19762-21sshd07:39:482
71069963,2cyclictest646-21dbus-daemon07:20:002
71069960,5cyclictest0-21swapper/208:22:382
71069960,5cyclictest0-21swapper/207:40:382
71039965,0cyclictest0-21swapper/107:57:131
71039960,5cyclictest0-21swapper/108:56:131
71039960,5cyclictest0-21swapper/108:37:131
71039960,0cyclictest0-21swapper/109:01:031
70979965,0cyclictest0-21swapper/007:36:140
70979964,1cyclictest6531-21sshd10:05:080
70979962,2cyclictest20181-21sshd09:00:040
70979960,1cyclictest121rcu_preempt08:55:000
71079954,0cyclictest0-21swapper/307:35:263
71079953,1cyclictest2396-21cat08:15:133
71079953,1cyclictest17299-21snmpd09:00:153
71079953,1cyclictest17299-21snmpd08:56:293
71079953,1cyclictest17299-21snmpd08:40:023
71079953,1cyclictest17299-21snmpd08:30:583
71079953,1cyclictest17299-21snmpd08:27:323
71079953,1cyclictest17299-21snmpd07:56:173
71079953,1cyclictest17299-21snmpd07:52:573
71079953,1cyclictest17299-21snmpd07:40:513
71079953,1cyclictest16624-21cat08:50:163
71079953,1cyclictest14426-21cat07:25:123
71079953,1cyclictest1109-21ntpd07:11:513
71079952,2cyclictest30925-21awk08:05:143
71079950,4cyclictest15442-21unixbench_multi08:45:223
71079950,1cyclictest9512-21diskstats07:15:003
71069954,0cyclictest0-21swapper/208:26:292
71069953,1cyclictest32680-21cat08:10:132
71069953,1cyclictest29619-210anacron08:01:002
71069953,1cyclictest17299-21snmpd08:55:232
71069953,1cyclictest17299-21snmpd08:50:542
71069953,1cyclictest17299-21snmpd08:47:562
71069953,1cyclictest17299-21snmpd08:15:492
71069953,1cyclictest17299-21snmpd08:05:462
71069953,1cyclictest17299-21snmpd07:45:102
71069953,1cyclictest17299-21snmpd07:34:102
71069953,1cyclictest17299-21snmpd07:14:382
71069953,1cyclictest14425-21cat07:25:122
71069953,1cyclictest12547-21mii-tool08:40:132
71069953,1cyclictest11401-21grep08:35:182
71069950,4cyclictest20188-21/usr/sbin/munin09:00:142
71069950,1cyclictest8004-21/usr/sbin/munin08:30:142
71069950,1cyclictest26114-21/usr/sbin/munin07:55:102
71039953,1cyclictest7784-21cat07:10:151
71039953,1cyclictest32372-21cpuspeed_turbos08:10:111
71039953,1cyclictest28243-21cpuspeed_turbos08:00:101
71039953,1cyclictest24096-21/usr/sbin/munin07:50:221
71039953,1cyclictest2282-21sed08:15:121
71039953,1cyclictest17299-21snmpd08:31:551
71039953,1cyclictest17299-21snmpd08:25:561
71039953,1cyclictest17299-21snmpd08:24:341
71039953,1cyclictest17299-21snmpd08:06:461
71039953,1cyclictest17299-21snmpd07:35:071
71039953,1cyclictest17299-21snmpd07:21:071
71039953,1cyclictest15406-21grep08:45:221
71039953,1cyclictest14275-21sed07:25:111
71039953,1cyclictest11260-21sed07:15:201
71039952,2cyclictest21565-21chrt07:41:551
71039950,4cyclictest0-21swapper/107:47:541
70979954,0cyclictest0-21swapper/008:30:230
70979954,0cyclictest0-21swapper/007:52:140
70979953,1cyclictest649-21avahi-daemon07:15:010
70979953,1cyclictest17299-21snmpd08:00:050
70979953,1cyclictest17299-21snmpd07:45:510
70979953,1cyclictest16841-21ntpq07:30:150
70979953,1cyclictest12404-21cat07:20:150
70979953,1cyclictest1053-21lldpd08:20:010
70979952,2cyclictest26492-21head07:55:120
70979952,2cyclictest21746-21sshd07:44:120
70979952,2cyclictest17299-21snmpd08:10:280
70979950,0cyclictest0-21swapper/008:08:230
71079942,1cyclictest16168-21expr07:30:123
71039942,1cyclictest16482-21gltestperf08:50:151
71039942,1cyclictest16086-21tr07:30:111
71039942,1cyclictest0-21swapper/108:40:121
70979942,1cyclictest9787-21threads07:15:010
70979942,1cyclictest17299-21snmpd08:35:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional