You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 05:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Tue Nov 25, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1307121070,2sleep1435599cyclictest00:16:171
303992970,0sleep030400-21sshd22:08:100
287432630,0sleep20-21swapper/221:36:082
182902630,0sleep00-21swapper/000:13:260
274872610,0sleep20-21swapper/221:32:512
323782600,2sleep2435699cyclictest00:11:282
253272600,1sleep025296-21sshd21:39:020
226362600,0sleep20-21swapper/200:24:142
44372550,0sleep10-21swapper/123:55:251
3942550,0sleep20-21swapper/200:08:122
300612550,0sleep00-21swapper/022:53:440
300612550,0sleep00-21swapper/022:53:440
247532550,1sleep124755-21bash22:17:081
257572540,0sleep10-21swapper/122:56:291
241832540,2sleep2435699cyclictest23:05:592
224142530,0sleep30-21swapper/322:16:543
63892520,0sleep00-21swapper/023:10:380
63892520,0sleep00-21swapper/023:10:380
36222520,0sleep00-21swapper/023:39:220
306572520,0sleep10-21swapper/121:45:481
175732510,0sleep10-21swapper/121:38:151
82802500,0sleep10-21swapper/100:29:411
62532500,0sleep20-21swapper/221:27:352
60072500,1sleep16000-21lspci00:08:471
128032500,0sleep30-21swapper/323:37:013
132702470,0sleep10-21swapper/123:43:311
408424023,7sleep20-21swapper/219:07:532
391323731,2sleep30-21swapper/319:05:503
219382370,2sleep3435799cyclictest22:36:173
394623126,3sleep10-21swapper/119:06:161
387823018,7sleep00-21swapper/019:05:230
98892220,1sleep0111rcuc/021:46:590
69772190,0sleep00-21swapper/000:02:130
4355991918,1cyclictest16910-21kworker/1:021:51:581
435599190,0cyclictest0-21swapper/121:07:491
261992190,0sleep10-21swapper/123:28:501
4355991817,0cyclictest8146-21kworker/1:121:56:511
4355991817,0cyclictest27115-21kworker/1:322:52:281
4355991817,0cyclictest27115-21kworker/1:322:52:281
326172180,0sleep20-21swapper/223:00:232
300492180,0sleep00-21swapper/021:23:320
223142180,0sleep10-21swapper/100:38:541
4355991717,0cyclictest8146-21kworker/1:121:42:591
4355991717,0cyclictest24518-21kworker/1:123:52:591
4355991716,1cyclictest8651-21kworker/1:322:29:561
4355991716,0cyclictest1312-21kworker/1:323:49:501
4355991715,1cyclictest22150-21kworker/1:000:20:421
326502170,0sleep00-21swapper/020:15:220
169142170,1sleep00-21swapper/023:53:330
4355991615,1cyclictest1743-21kworker/1:121:13:301
4355991615,0cyclictest4017-21kworker/1:222:02:021
4355991615,0cyclictest16505-21kworker/1:100:10:381
110852160,0sleep30-21swapper/321:47:063
435699151,13cyclictest21048-21sshd21:54:342
4355991515,0cyclictest4848-21kworker/1:023:23:501
4355991514,1cyclictest4848-21kworker/1:023:11:221
4355991514,1cyclictest4848-21kworker/1:023:11:221
4355991513,1cyclictest632-21kworker/1:222:45:431
4355991414,0cyclictest8651-21kworker/1:322:31:301
4355991414,0cyclictest30945-21kworker/1:200:31:061
4355991414,0cyclictest16910-21kworker/1:022:21:271
4355991414,0cyclictest13782-21kworker/1:223:09:591
435499140,13cyclictest14316-21sshd21:41:030
184632140,0sleep00-21swapper/023:21:320
160452140,1sleep016037-21bash23:05:140
134182140,0sleep30-21swapper/321:50:323
53472130,0sleep30-21swapper/321:59:243
435799130,12cyclictest27584-21sshd21:32:523
4355991312,0cyclictest29165-21kworker/1:023:01:181
4355991312,0cyclictest241ktimersoftd/122:14:321
4355991312,0cyclictest1312-21kworker/1:300:00:151
435599130,1cyclictest1966-21lspci21:27:081
229512130,0sleep30-21swapper/322:49:463
22242130,0sleep20-21swapper/222:08:372
182222130,0sleep10-21swapper/121:15:571
145522130,0sleep30-21swapper/300:13:023
4357991210,1cyclictest5332-21grepconf.sh00:22:233
4357991210,1cyclictest1017-21runrttasks22:57:423
435799120,1cyclictest8309-21bash22:09:133
435799120,11cyclictest0-21swapper/300:04:243
435699120,1cyclictest12458-21sshd23:49:542
435699120,11cyclictest5973-21id23:13:552
435699120,11cyclictest5973-21id23:13:542
435699120,11cyclictest0-21swapper/223:56:042
435699120,11cyclictest0-21swapper/200:35:042
4355991212,0cyclictest17007-21kworker/1:221:20:261
4355991212,0cyclictest10772-21kworker/1:119:24:181
4355991211,1cyclictest16910-21kworker/1:022:07:341
435599120,11cyclictest0-21swapper/123:35:091
4354991210,1cyclictest22184-21sshd23:31:330
435499120,11cyclictest0-21swapper/000:31:230
195082120,0sleep30-21swapper/300:27:203
91562110,2sleep2435699cyclictest23:20:332
4357991110,0cyclictest0-21swapper/322:34:333
4357991110,0cyclictest0-21swapper/321:08:423
435799110,10cyclictest0-21swapper/323:53:533
435799110,10cyclictest0-21swapper/321:26:533
4356991110,0cyclictest0-21swapper/221:47:142
435699110,10cyclictest0-21swapper/200:26:252
435699110,0cyclictest7246-21sshd00:02:152
435699110,0cyclictest0-21swapper/223:33:242
435699110,0cyclictest0-21swapper/200:30:442
4355991111,0cyclictest9051-21kworker/1:220:42:381
4355991111,0cyclictest6987-21kworker/1:020:35:321
4355991111,0cyclictest696-21kworker/1:020:18:021
4355991111,0cyclictest4912-21kworker/1:220:30:201
4355991111,0cyclictest2838-21kworker/1:120:24:581
4355991111,0cyclictest26883-21kworker/1:020:04:211
4355991111,0cyclictest16893-21kworker/1:121:01:221
4355991111,0cyclictest11130-21kworker/1:120:47:501
4355991111,0cyclictest10772-21kworker/1:119:47:101
4355991111,0cyclictest10772-21kworker/1:119:41:381
4355991111,0cyclictest10772-21kworker/1:119:29:401
4355991110,0cyclictest0-21swapper/122:40:181
435499119,1cyclictest16598-21lspci00:20:130
435499110,10cyclictest0-21swapper/022:18:330
435499110,10cyclictest0-21swapper/000:15:540
435499110,0cyclictest0-21swapper/022:02:230
98462100,0sleep10-21swapper/123:17:281
435799109,0cyclictest0-21swapper/323:34:533
435799100,9cyclictest11615-21sshd23:14:293
435799100,9cyclictest11615-21sshd23:14:283
435799100,0cyclictest0-21swapper/322:02:023
435799100,0cyclictest0-21swapper/321:20:223
435699100,0cyclictest0-21swapper/222:55:042
435699100,0cyclictest0-21swapper/222:19:142
435699100,0cyclictest0-21swapper/221:56:242
435599109,0cyclictest0-21swapper/123:33:191
4355991010,0cyclictest6073-21kworker/1:219:15:381
4355991010,0cyclictest6073-21kworker/1:219:12:311
4355991010,0cyclictest10772-21kworker/1:119:31:341
435499109,0cyclictest0-21swapper/023:26:040
435499109,0cyclictest0-21swapper/023:04:430
435499109,0cyclictest0-21swapper/021:31:240
435499109,0cyclictest0-21swapper/021:28:230
435499109,0cyclictest0-21swapper/000:09:030
435499108,1cyclictest21887-21lspci21:51:230
435499102,4cyclictest10975-21awk19:25:000
302002100,0sleep330202-21sshd23:06:373
146812100,1sleep341-21ksoftirqd/321:15:353
43579998,0cyclictest6786-21sshd00:15:333
43579998,0cyclictest0-21swapper/300:08:433
43579997,1cyclictest26210-21sshd21:35:523
43579996,2cyclictest649-21avahi-daemon22:29:023
43569998,0cyclictest0-21swapper/223:51:442
43569998,0cyclictest0-21swapper/222:51:252
43569998,0cyclictest0-21swapper/222:51:242
43569998,0cyclictest0-21swapper/221:43:352
43559999,0cyclictest21347-21kworker/1:019:52:021
43559999,0cyclictest14487-21kworker/1:020:59:481
43559998,0cyclictest28963-21kworker/1:120:09:221
43559998,0cyclictest2838-21kworker/1:120:25:291
43559998,0cyclictest24814-21kworker/1:119:59:081
43559998,0cyclictest14487-21kworker/1:020:52:431
43559997,1cyclictest25-21ksoftirqd/122:38:001
43559990,2cyclictest25-21ksoftirqd/121:32:221
43549998,0cyclictest0-21swapper/022:56:130
43549991,4cyclictest1011-21sshd22:00:010
43579987,0cyclictest0-21swapper/323:49:343
43579987,0cyclictest0-21swapper/322:21:123
43579987,0cyclictest0-21swapper/319:48:233
43579987,0cyclictest0-21swapper/319:20:233
43579987,0cyclictest0-21swapper/300:31:033
43579986,1cyclictest8489-21grep21:11:163
43579985,2cyclictest649-21avahi-daemon23:24:463
43579985,2cyclictest649-21avahi-daemon23:19:493
43579985,2cyclictest649-21avahi-daemon22:43:383
43569987,0cyclictest0-21swapper/222:45:542
43569987,0cyclictest0-21swapper/222:22:142
43569986,1cyclictest16080-21lspci21:15:442
43569986,1cyclictest0-21swapper/222:00:042
43559988,0cyclictest10772-21kworker/1:119:36:371
43549986,2cyclictest29633-21kworker/0:122:10:210
43549986,1cyclictest23905-21lspci23:57:250
43549986,1cyclictest13443-21lspci21:18:420
43549985,2cyclictest649-21avahi-daemon23:40:180
43549985,2cyclictest649-21avahi-daemon22:32:520
43549985,2cyclictest18368-21kworker/0:122:35:170
43549983,4cyclictest13320-21munin-run23:49:590
43549980,4cyclictest31318-21idleruntime-cro20:15:000
43579976,0cyclictest0-21swapper/320:50:133
43579976,0cyclictest0-21swapper/300:35:243
43579975,1cyclictest692-21NetworkManager22:11:263
43579975,1cyclictest648-21systemd-logind23:42:043
43579975,1cyclictest616-17auditd23:27:083
43579975,1cyclictest28002-21rm23:00:023
43579975,1cyclictest11850-21lspci23:56:113
43579974,2cyclictest649-21avahi-daemon22:51:393
43579974,2cyclictest649-21avahi-daemon22:51:383
43579974,2cyclictest646-21dbus-daemon21:40:063
43569976,0cyclictest0-21swapper/200:15:142
43569975,1cyclictest937-21lspci23:16:332
43569975,1cyclictest8217-21lspci23:39:502
43569975,1cyclictest670-21packagekitd21:21:052
43569975,1cyclictest649-21avahi-daemon22:10:132
43569975,1cyclictest32404-21lspci22:37:222
43569975,1cyclictest32004-21bash22:40:352
43569975,1cyclictest26628-21lspci23:25:342
43569975,1cyclictest15054-21lspci23:40:222
43569973,1cyclictest443-21systemd-journal22:25:242
43569972,2cyclictest1566-21sshd22:31:032
43559976,0cyclictest0-21swapper/120:10:181
43549976,0cyclictest17111-21kworker/0:021:01:020
43549976,0cyclictest0-21swapper/021:07:140
43549976,0cyclictest0-21swapper/020:35:130
43549975,1cyclictest684-21polkitd22:22:390
43549975,1cyclictest649-21avahi-daemon22:29:360
43549975,1cyclictest646-21dbus-daemon00:25:440
43549975,1cyclictest3707-21lspci23:16:500
43549975,1cyclictest28733-21sshd22:40:160
43549974,2cyclictest684-21polkitd21:11:100
43579965,0cyclictest0-21swapper/320:26:223
43579963,2cyclictest17299-21snmpd19:58:183
43579960,5cyclictest0-21swapper/319:34:423
43569964,1cyclictest646-21dbus-daemon21:09:082
43569964,1cyclictest17299-21snmpd20:09:062
43569964,1cyclictest15017-21crond19:35:002
43569962,3cyclictest30672-21sshd21:10:022
43569960,5cyclictest0-21swapper/220:12:242
43569960,5cyclictest0-21swapper/220:03:252
43569960,5cyclictest0-21swapper/219:40:042
43549966,0cyclictest6296-21kworker/0:019:15:000
43549966,0cyclictest20902-21kworker/0:019:49:000
43549964,2cyclictest16777-21kworker/0:000:35:020
43549964,1cyclictest5406-21ntp_states19:10:170
43549963,2cyclictest646-21dbus-daemon22:45:180
43549960,5cyclictest0-21swapper/020:07:220
43549960,5cyclictest0-21swapper/019:37:220
43579954,0cyclictest0-21swapper/321:02:233
43579953,1cyclictest684-21polkitd19:20:003
43579953,1cyclictest5293-21nfsd419:10:163
43579953,1cyclictest26387-21wc20:00:183
43579953,1cyclictest21850-21cat19:50:153
43579953,1cyclictest17299-21snmpd20:57:233
43579953,1cyclictest17299-21snmpd20:45:343
43579953,1cyclictest17299-21snmpd20:30:043
43579953,1cyclictest17299-21snmpd20:24:013
43579953,1cyclictest17299-21snmpd20:15:343
43579953,1cyclictest17299-21snmpd20:10:133
43579953,1cyclictest17299-21snmpd20:05:243
43579953,1cyclictest17299-21snmpd19:42:123
43579953,1cyclictest17299-21snmpd19:37:173
43579952,2cyclictest10052-21grep20:40:163
43579950,0cyclictest0-21swapper/320:37:033
43579950,0cyclictest0-21swapper/319:26:423
43569954,0cyclictest0-21swapper/220:22:142
43569954,0cyclictest0-21swapper/219:15:142
43569954,0cyclictest0-21swapper/219:10:352
43569953,1cyclictest3745-21cat20:25:152
43569953,1cyclictest23877-21cat19:55:132
43569953,1cyclictest19776-21cat19:45:142
43569953,1cyclictest17299-21snmpd21:00:502
43569953,1cyclictest17299-21snmpd20:53:002
43569953,1cyclictest17299-21snmpd20:44:012
43569953,1cyclictest17299-21snmpd20:32:072
43569953,1cyclictest17299-21snmpd20:15:372
43569953,1cyclictest17299-21snmpd19:21:352
43569953,1cyclictest15949-21cat20:55:142
43569953,1cyclictest15748-21cat19:35:172
43569953,1cyclictest12079-21open_files19:25:172
43569952,2cyclictest8187-21ntpq20:35:162
43569950,4cyclictest0-21swapper/220:46:042
43549955,0cyclictest25040-21kworker/0:219:59:220
43549953,1cyclictest17299-21snmpd20:55:200
43549953,1cyclictest17299-21snmpd20:41:170
43549953,1cyclictest17299-21snmpd20:32:520
43549953,1cyclictest17299-21snmpd20:26:010
43549953,1cyclictest17299-21snmpd19:50:280
43549953,1cyclictest17299-21snmpd19:40:270
43549953,1cyclictest1711-21cat20:20:150
43549953,1cyclictest11393-21/usr/sbin/munin20:45:180
43549953,1cyclictest1109-21ntpd20:00:180
43549953,1cyclictest1058-21sendmail19:27:480
43549952,2cyclictest13322-21tr19:30:130
43549950,4cyclictest0-21swapper/020:51:030
43569942,1cyclictest21475-21grep19:50:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional