You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 11:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Tue Dec 02, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
296821050,0sleep00-21swapper/022:51:480
1046321010,1sleep12542499cyclictest21:29:221
223592950,1sleep022355-21sshd23:35:250
102442870,0sleep210157-21sshd00:06:512
222572780,0sleep10-21swapper/100:01:261
252522740,0sleep00-21swapper/022:34:530
116952630,0sleep10-21swapper/123:34:291
48152590,1sleep14816-21tty22:42:231
238992590,0sleep00-21swapper/023:32:280
246722580,0sleep30-21swapper/323:51:463
28402560,2sleep32543599cyclictest22:00:323
181242560,0sleep20-21swapper/221:55:382
181242560,0sleep20-21swapper/221:55:382
125272560,0sleep20-21swapper/222:23:582
109652550,0sleep10-21swapper/122:52:361
318242540,0sleep30-21swapper/321:50:383
120952540,0sleep00-21swapper/022:01:280
28542530,0sleep00-21swapper/021:31:440
211772530,0sleep30-21swapper/300:04:443
66432520,2sleep32543599cyclictest19:40:173
52142520,1sleep25208-21bash22:10:192
318862520,2sleep32543599cyclictest23:36:243
303132520,0sleep10-21swapper/119:20:131
23642520,0sleep20-21swapper/223:33:342
281342510,0sleep00-21swapper/021:40:370
163242510,0sleep10-21swapper/100:20:471
127782510,0sleep00-21swapper/000:38:050
115042510,0sleep10-21swapper/121:55:051
115042510,0sleep10-21swapper/121:55:051
212382500,0sleep30-21swapper/321:59:163
212382500,0sleep30-21swapper/321:59:163
320962490,0sleep11095-21nfsd23:46:041
192442480,0sleep30-21swapper/300:35:083
4572460,0sleep00-21swapper/021:28:210
300702460,0sleep00-21swapper/000:18:550
260442450,0sleep20-21swapper/221:21:102
257412430,1sleep125743-21bash21:46:521
22212430,0sleep00-21swapper/023:46:180
2519523210,7sleep30-21swapper/319:08:223
249692268,6sleep20-21swapper/219:05:372
2457822411,7sleep00-21swapper/019:05:180
2519822110,7sleep10-21swapper/119:08:241
323962190,0sleep30-21swapper/323:49:223
315482190,1sleep231549-21sshd21:31:232
246872170,3sleep2321ktimersoftd/221:17:482
164812170,0sleep216470-21cp23:47:452
163862170,1sleep116385-21grep23:57:321
311012160,1sleep131103-21bash22:32:101
294842160,0sleep10-21swapper/123:39:271
293112160,0sleep10-21swapper/123:29:541
196602160,0sleep10-21swapper/122:05:231
192432160,1sleep319242-21sshd23:03:073
149502160,0sleep30-21swapper/322:20:553
311112150,0sleep20-21swapper/200:26:062
311112150,0sleep20-21swapper/200:26:062
289842150,0sleep30-21swapper/321:34:253
308702140,0sleep2311rcuc/223:04:192
26842140,0sleep00-21swapper/022:13:230
17792140,0sleep00-21swapper/023:17:270
164992140,0sleep20-21swapper/220:05:182
159422140,0sleep10-21swapper/123:15:351
14212140,0sleep00-21swapper/022:06:500
48312130,0sleep10-21swapper/122:10:191
26642130,0sleep00-21swapper/000:30:000
26642130,0sleep00-21swapper/000:30:000
2543599130,1cyclictest443-21systemd-journal23:18:133
2542899130,11cyclictest20813-21sshd22:08:482
212682130,0sleep00-21swapper/000:31:520
25435991211,0cyclictest0-21swapper/323:56:043
25435991210,1cyclictest16176-21bash23:44:333
2543599120,1cyclictest29509-21grepconf.sh23:33:043
2542899120,1cyclictest16105-21id21:08:472
25424991210,1cyclictest2210-21sshd22:48:351
25424991210,1cyclictest11543-21lspci00:16:551
2542499120,11cyclictest5975-21sshd21:15:531
2542499120,0cyclictest0-21swapper/121:14:041
25418991211,0cyclictest0-21swapper/020:35:150
25418991210,1cyclictest0-21swapper/023:40:560
25418991210,1cyclictest0-21swapper/000:10:450
2541899120,1cyclictest8027-21lspci21:57:550
2541899120,1cyclictest8027-21lspci21:57:550
2541899120,11cyclictest7809-21lspci22:36:150
2541899120,11cyclictest15879-21sshd00:24:250
2543599119,1cyclictest20420-21ls20:15:133
25435991110,0cyclictest0-21swapper/321:44:243
2543599110,10cyclictest0-21swapper/323:21:443
2543599110,10cyclictest0-21swapper/323:07:443
2543599110,10cyclictest0-21swapper/322:59:043
2543599110,10cyclictest0-21swapper/322:41:343
2543599110,0cyclictest0-21swapper/322:50:243
2542899110,0cyclictest0-21swapper/222:59:482
25424991110,0cyclictest0-21swapper/100:32:351
2542499110,0cyclictest0-21swapper/122:23:251
2542499110,0cyclictest0-21swapper/122:15:151
2541899119,1cyclictest0-21swapper/021:07:240
25418991110,0cyclictest0-21swapper/023:59:060
25418991110,0cyclictest0-21swapper/023:04:150
2541899110,0cyclictest3150-21sshd21:38:150
105352110,1sleep22542899cyclictest22:36:312
2543599109,0cyclictest0-21swapper/321:45:343
2543599109,0cyclictest0-21swapper/320:00:023
2543599109,0cyclictest0-21swapper/300:25:043
2543599109,0cyclictest0-21swapper/300:25:033
2543599108,1cyclictest26858-21lspci21:24:343
2543599108,1cyclictest19480-21sshd22:18:143
2542899109,0cyclictest0-21swapper/223:28:582
2542899109,0cyclictest0-21swapper/222:51:072
2542899108,1cyclictest29011-21bash23:07:182
2542899100,0cyclictest0-21swapper/223:20:082
2542899100,0cyclictest0-21swapper/222:16:382
2542499109,0cyclictest0-21swapper/122:39:451
2542499109,0cyclictest0-21swapper/121:32:341
2542499100,9cyclictest0-21swapper/121:53:441
2542499100,0cyclictest0-21swapper/122:03:141
2541899109,0cyclictest0-21swapper/022:56:450
2541899109,0cyclictest0-21swapper/021:52:350
2541899109,0cyclictest0-21swapper/019:20:150
2541899109,0cyclictest0-21swapper/000:06:260
2541899108,1cyclictest23243-21sshd22:47:250
2541899100,0cyclictest0-21swapper/022:15:140
254359998,0cyclictest0-21swapper/321:38:543
254359998,0cyclictest0-21swapper/319:47:123
254359998,0cyclictest0-21swapper/300:30:443
254359997,1cyclictest5889-21sshd21:28:533
254289998,0cyclictest0-21swapper/223:53:482
254289998,0cyclictest0-21swapper/221:52:072
254289998,0cyclictest0-21swapper/221:25:172
254289997,1cyclictest28880-21sshd22:28:472
254289997,1cyclictest24440-21sshd21:37:082
254289997,1cyclictest14622-21lspci21:13:372
254249998,0cyclictest0-21swapper/123:50:351
254249998,0cyclictest0-21swapper/121:35:041
254249998,0cyclictest0-21swapper/100:12:351
254249997,1cyclictest7855-21sshd21:03:141
254189998,0cyclictest0-21swapper/019:31:450
28930280,2sleep12542499cyclictest22:25:281
254359987,0cyclictest0-21swapper/319:19:133
254359987,0cyclictest0-21swapper/319:19:133
254359987,0cyclictest0-21swapper/300:13:143
254359986,1cyclictest41-21ksoftirqd/323:29:043
254359986,1cyclictest20230-21sshd22:47:073
254359986,1cyclictest15468-21lspci22:33:543
254359985,2cyclictest649-21avahi-daemon00:20:013
254359984,3cyclictest646-21dbus-daemon00:09:333
254289987,0cyclictest0-21swapper/223:35:382
254289987,0cyclictest0-21swapper/200:14:382
254289986,1cyclictest33-21ksoftirqd/223:11:252
254289986,1cyclictest14585-21lspci21:42:332
254289986,1cyclictest13526-21lspci00:20:272
254289985,2cyclictest649-21avahi-daemon23:40:172
254249987,0cyclictest0-21swapper/100:08:151
254249986,1cyclictest28107-21sshd23:00:451
254249986,1cyclictest15488-21lspci22:56:161
254249986,1cyclictest14074-21lspci00:38:171
254249985,2cyclictest649-21avahi-daemon23:42:571
254189987,0cyclictest0-21swapper/023:52:260
254189987,0cyclictest0-21swapper/022:21:050
254189986,1cyclictest646-21dbus-daemon21:17:450
254189986,1cyclictest28867-21lspci23:20:110
254189986,1cyclictest28022-21lspci23:26:280
254189986,1cyclictest23190-21lspci22:44:130
254189986,1cyclictest13913-21sshd00:03:580
254189985,2cyclictest649-21avahi-daemon21:23:230
254189984,2cyclictest646-21dbus-daemon23:07:000
254359976,0cyclictest0-21swapper/321:16:333
254359976,0cyclictest0-21swapper/321:14:433
254359976,0cyclictest0-21swapper/320:45:333
254359975,1cyclictest684-21polkitd22:37:193
254359975,1cyclictest649-21avahi-daemon22:26:033
254359975,1cyclictest646-21dbus-daemon22:09:003
254359975,1cyclictest4567-21lspci22:10:173
254289976,0cyclictest7294-21lspci00:30:212
254289975,1cyclictest684-21polkitd21:45:462
254289975,1cyclictest1034-21in:imjournal22:41:002
254289975,1cyclictest1011-21sshd22:01:162
254289974,2cyclictest700-21gdbus22:30:232
254289974,2cyclictest649-21avahi-daemon23:57:162
254289974,2cyclictest646-21dbus-daemon23:17:072
254289973,1cyclictest27502-21sshd00:15:162
254289973,1cyclictest25222-21sshd00:01:442
254289970,6cyclictest27876-21sshd22:47:542
254249976,0cyclictest0-21swapper/120:20:141
254249975,1cyclictest7956-21grep23:11:371
254249975,1cyclictest26600-21lspci00:25:331
254249975,1cyclictest26600-21lspci00:25:331
254249975,1cyclictest25-21ksoftirqd/123:21:521
254249974,2cyclictest649-21avahi-daemon23:05:301
254249974,2cyclictest649-21avahi-daemon21:21:551
254249974,2cyclictest16672-21sshd21:42:451
254189975,1cyclictest9405-21sshd23:11:460
254189975,1cyclictest684-21polkitd21:45:360
254189975,1cyclictest649-21avahi-daemon22:25:310
254189974,2cyclictest700-21gdbus21:13:550
254359965,0cyclictest0-21swapper/319:50:133
254359965,0cyclictest0-21swapper/319:31:133
254359964,1cyclictest646-21dbus-daemon23:10:043
254359964,1cyclictest25945-21sshd00:15:093
254359964,1cyclictest22989-21head20:20:173
254359963,2cyclictest17702-21sshd21:09:283
254289963,2cyclictest754-21needreboot20:45:172
254289963,2cyclictest17299-21snmpd20:36:372
254289960,5cyclictest18448-21sshd00:35:012
254249964,1cyclictest700-21gdbus21:07:261
254249964,1cyclictest17299-21snmpd20:55:081
254189965,0cyclictest0-21swapper/019:50:140
254359954,0cyclictest0-21swapper/320:13:423
254359953,1cyclictest29629-21ls20:35:203
254359953,1cyclictest26100-21cat19:10:143
254359953,1cyclictest17299-21snmpd20:58:083
254359953,1cyclictest17299-21snmpd20:51:403
254359953,1cyclictest17299-21snmpd20:41:493
254359953,1cyclictest17299-21snmpd20:26:063
254359953,1cyclictest17299-21snmpd20:05:393
254359953,1cyclictest17299-21snmpd19:58:123
254359953,1cyclictest17299-21snmpd19:22:343
254359953,1cyclictest0-21swapper/321:00:173
254359953,1cyclictest0-21swapper/319:25:153
254359950,0cyclictest0-21swapper/319:35:523
254289954,0cyclictest0-21swapper/220:54:262
254289953,1cyclictest5010-21sendmail_mailqu19:35:172
254289953,1cyclictest25995-21hddtemp_smartct19:10:142
254289953,1cyclictest17299-21snmpd21:00:172
254289953,1cyclictest17299-21snmpd20:57:592
254289953,1cyclictest17299-21snmpd20:40:132
254289953,1cyclictest17299-21snmpd20:30:342
254289953,1cyclictest17299-21snmpd20:25:362
254289953,1cyclictest17299-21snmpd20:22:182
254289953,1cyclictest17299-21snmpd20:01:202
254289953,1cyclictest17299-21snmpd19:55:302
254289953,1cyclictest17299-21snmpd19:45:082
254289953,1cyclictest17299-21snmpd19:44:142
254289953,1cyclictest17299-21snmpd19:34:262
254289953,1cyclictest17299-21snmpd19:28:532
254289953,1cyclictest17299-21snmpd19:20:142
254289953,1cyclictest17299-21snmpd19:15:342
254289953,1cyclictest17299-21snmpd19:15:332
254289953,1cyclictest10558-21mii-tool19:50:152
254289950,1cyclictest21076-21awk20:15:172
254289950,1cyclictest18222-21/usr/sbin/munin20:10:212
254249954,0cyclictest0-21swapper/120:01:431
254249953,1cyclictest494-21cat20:45:161
254249953,1cyclictest24613-21grep20:25:141
254249953,1cyclictest17299-21snmpd20:40:041
254249953,1cyclictest17299-21snmpd20:36:161
254249953,1cyclictest17299-21snmpd20:31:131
254249953,1cyclictest17299-21snmpd20:15:051
254249953,1cyclictest17299-21snmpd20:12:091
254249953,1cyclictest17299-21snmpd19:52:381
254249953,1cyclictest17299-21snmpd19:48:111
254249953,1cyclictest17299-21snmpd19:41:531
254249953,1cyclictest17299-21snmpd19:35:251
254249953,1cyclictest17299-21snmpd19:30:561
254249953,1cyclictest17299-21snmpd19:16:011
254249953,1cyclictest17299-21snmpd19:16:001
254249953,1cyclictest12436-21gltestperf19:55:151
254249952,2cyclictest32350-21tr19:25:131
254249952,2cyclictest17299-21snmpd19:10:521
254249952,2cyclictest16304-21tr20:05:171
254189953,1cyclictest5141-21processes20:55:210
254189953,1cyclictest30765-21tail20:40:130
254189953,1cyclictest24804-21cat20:25:160
254189953,1cyclictest17299-21snmpd20:48:370
254189953,1cyclictest17299-21snmpd20:33:400
254189953,1cyclictest17299-21snmpd20:21:270
254189953,1cyclictest17299-21snmpd20:16:290
254189953,1cyclictest17299-21snmpd20:10:270
254189953,1cyclictest17299-21snmpd20:05:090
254189953,1cyclictest17299-21snmpd19:55:510
254189953,1cyclictest17299-21snmpd19:45:170
254189953,1cyclictest17299-21snmpd19:35:020
254189953,1cyclictest17299-21snmpd19:25:010
254189953,1cyclictest17299-21snmpd19:19:500
254189953,1cyclictest17299-21snmpd19:19:490
254189953,1cyclictest17299-21snmpd19:10:430
254189953,1cyclictest14205-21tr20:00:140
254189952,2cyclictest7597-21who21:00:220
254189952,2cyclictest17299-21snmpd19:40:140
254359942,1cyclictest1017-21runrttasks20:30:043
254249942,1cyclictest0-21swapper/120:50:121
254189942,1cyclictest2216-21grep20:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional