You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 04:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Thu Nov 20, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
224362990,0sleep10-21swapper/100:26:461
142252970,2sleep32176499cyclictest21:38:103
299572710,0sleep30-21swapper/323:02:053
271292690,0sleep3391rcuc/321:49:233
31032670,1sleep03102-21grep00:04:260
182152650,0sleep10-21swapper/122:34:431
46232640,1sleep04616-21bash23:48:280
24782640,0sleep00-21swapper/023:09:110
133502610,0sleep10-21swapper/121:47:571
268682590,0sleep00-21swapper/023:14:590
64922580,0sleep00-21swapper/023:22:440
210842580,1sleep233-21ksoftirqd/222:21:472
183562570,0sleep10-21swapper/123:10:441
231622560,0sleep10-21swapper/123:56:421
184912560,1sleep1616-17auditd21:35:161
229582550,0sleep30-21swapper/323:17:513
158312550,2sleep22175999cyclictest22:17:582
22332530,0sleep10-21swapper/100:10:401
14972530,1sleep21485-21lspci23:22:142
85662500,0sleep20-21swapper/223:55:152
269722500,1sleep326968-21sshd23:24:523
260432500,1sleep326027-21bash00:13:063
126682490,0sleep00-21swapper/000:29:130
298492480,0sleep30-21swapper/322:12:463
173912390,1sleep2311rcuc/221:25:152
153372380,2sleep02174799cyclictest21:41:310
2135623116,10sleep30-21swapper/319:06:073
213032298,7sleep10-21swapper/119:05:291
2133322815,9sleep00-21swapper/019:05:480
213302287,7sleep20-21swapper/219:05:462
284662230,1sleep20-21swapper/223:28:152
95362220,0sleep30-21swapper/322:40:223
8582210,0sleep10-21swapper/121:20:141
72282210,1sleep30-21swapper/322:17:033
192832180,1sleep01034-21in:imjournal00:15:470
294822170,2sleep22175999cyclictest21:59:362
155442170,1sleep1231rcuc/122:11:161
282212160,0sleep20-21swapper/200:16:492
21764991615,0cyclictest23347-21lspci23:30:553
37702150,2sleep3401ktimersoftd/323:05:533
304982150,0sleep20-21swapper/221:46:222
2176499150,14cyclictest3808-21bash21:14:063
21754991515,0cyclictest27683-21kworker/1:200:04:321
153572150,1sleep115358-21bash23:07:071
14882150,0sleep20-21swapper/223:54:352
135342150,0sleep00-21swapper/021:31:260
110212150,0sleep20-21swapper/200:08:242
92452140,0sleep00-21swapper/022:50:120
37342140,0sleep00-21swapper/000:35:060
291592140,0sleep00-21swapper/021:19:530
2175999145,1cyclictest33-21ksoftirqd/221:33:352
2175999140,13cyclictest321ktimersoftd/223:10:362
21754991413,0cyclictest14748-21lspci21:58:041
21754991412,1cyclictest18441-21lspci22:51:051
2174799140,12cyclictest32235-21sshd21:26:450
182772140,0sleep20-21swapper/223:04:122
101722140,0sleep10-21swapper/123:19:531
21764991312,0cyclictest18917-21lspci23:36:593
21764991311,1cyclictest15767-21lspci22:21:133
2175999135,3cyclictest33-21ksoftirqd/222:51:342
2175999133,1cyclictest33-21ksoftirqd/223:41:562
2175999133,1cyclictest33-21ksoftirqd/223:09:072
2175999132,3cyclictest33-21ksoftirqd/221:21:112
2175999130,12cyclictest0-21swapper/223:47:162
21754991312,0cyclictest16926-21lspci23:49:421
21764991211,0cyclictest30722-21lspci23:50:583
21764991210,1cyclictest7114-21hwlatdetect20:20:153
21764991210,1cyclictest11777-21lspci21:31:153
2175999125,3cyclictest33-21ksoftirqd/222:27:512
2175999124,3cyclictest33-21ksoftirqd/221:19:462
2175999124,1cyclictest33-21ksoftirqd/222:31:592
2175999123,3cyclictest33-21ksoftirqd/222:49:262
2175999123,3cyclictest33-21ksoftirqd/200:38:072
2175999123,3cyclictest33-21ksoftirqd/200:00:382
2175999123,1cyclictest33-21ksoftirqd/223:33:472
21759991210,1cyclictest28701-21id00:27:262
21759991210,1cyclictest26358-21lspci22:35:262
2175999120,11cyclictest0-21swapper/200:34:072
2175999120,0cyclictest0-21swapper/221:13:262
21754991211,0cyclictest27516-21kworker/1:121:51:041
2175499120,1cyclictest10960-21id21:44:271
2175499120,11cyclictest2256-21bash21:17:071
2175499120,11cyclictest0-21swapper/100:35:181
21747991210,1cyclictest646-21dbus-daemon22:19:450
21747991210,1cyclictest0-21swapper/021:14:150
2174799120,1cyclictest0-21swapper/022:07:450
148762120,0sleep30-21swapper/300:05:293
21764991110,0cyclictest31111-21lspci21:26:383
21764991110,0cyclictest24660-21lspci23:40:443
21764991110,0cyclictest20526-21lspci23:14:203
21764991110,0cyclictest0-21swapper/322:52:263
21764991110,0cyclictest0-21swapper/321:09:463
21764991110,0cyclictest0-21swapper/300:15:563
2176499110,10cyclictest0-21swapper/300:35:563
2175999115,3cyclictest33-21ksoftirqd/222:00:202
2175999113,1cyclictest33-21ksoftirqd/223:39:422
2175999113,1cyclictest33-21ksoftirqd/222:07:552
2175999113,1cyclictest33-21ksoftirqd/221:40:402
2175999111,3cyclictest33-21ksoftirqd/221:38:362
2175999111,3cyclictest24639-21sshd00:12:572
2175999111,1cyclictest33-21ksoftirqd/221:52:552
21759991110,0cyclictest0-21swapper/222:40:062
21754991111,0cyclictest27683-21kworker/1:223:21:121
21754991110,0cyclictest33050irq/27-ahci[00023:27:441
21754991110,0cyclictest33050irq/27-ahci[00000:07:241
21754991110,0cyclictest0-21swapper/120:15:171
21754991110,0cyclictest0-21swapper/100:15:181
2175499110,10cyclictest0-21swapper/122:24:571
2175499110,0cyclictest0-21swapper/123:34:471
2174799119,1cyclictest16218-21irqstats23:30:150
21747991110,0cyclictest0-21swapper/023:39:450
2174799110,10cyclictest0-21swapper/021:49:250
2176499109,0cyclictest0-21swapper/300:29:163
2176499108,1cyclictest41-21ksoftirqd/322:31:133
2176499108,1cyclictest0-21swapper/321:23:263
2176499100,0cyclictest0-21swapper/321:42:463
2176499100,0cyclictest0-21swapper/300:03:563
2175999103,3cyclictest33-21ksoftirqd/222:10:582
2175999102,1cyclictest33-21ksoftirqd/222:55:572
2175999101,3cyclictest7062-21lspci00:21:362
2175999100,1cyclictest33-21ksoftirqd/223:16:422
2175499109,0cyclictest4374-21lspci21:10:081
2175499109,0cyclictest33050irq/27-ahci[00000:20:311
2175499109,0cyclictest0-21swapper/123:53:481
2175499109,0cyclictest0-21swapper/120:05:071
2175499100,0cyclictest0-21swapper/122:57:071
2174799109,0cyclictest0-21swapper/022:24:350
2174799109,0cyclictest0-21swapper/022:04:450
2174799109,0cyclictest0-21swapper/021:50:350
2174799109,0cyclictest0-21swapper/000:23:250
2174799109,0cyclictest0-21swapper/000:05:550
2174799108,1cyclictest20866-21bash22:57:550
2174799100,9cyclictest0-21swapper/020:58:440
2174799100,0cyclictest0-21swapper/022:49:050
2174799100,0cyclictest0-21swapper/020:35:140
2174799100,0cyclictest0-21swapper/000:30:050
4263290,0sleep10-21swapper/122:49:451
217649998,0cyclictest0-21swapper/323:55:363
217649998,0cyclictest0-21swapper/323:27:063
217649998,0cyclictest0-21swapper/321:52:463
217649998,0cyclictest0-21swapper/321:18:263
217649998,0cyclictest0-21swapper/319:50:553
217649998,0cyclictest0-21swapper/300:22:363
217649997,1cyclictest5002-21bash22:36:363
217649997,1cyclictest41-21ksoftirqd/322:10:003
217649997,1cyclictest41-21ksoftirqd/322:00:173
217649997,1cyclictest41-21ksoftirqd/300:33:083
217599998,0cyclictest0-21swapper/221:07:162
217599998,0cyclictest0-21swapper/220:50:162
217599998,0cyclictest0-21swapper/220:00:162
217549999,0cyclictest29470-21kworker/1:322:44:481
217549998,0cyclictest4771-21lspci21:30:301
217549998,0cyclictest33050irq/27-ahci[00022:37:541
217549998,0cyclictest33050irq/27-ahci[00021:25:171
217549998,0cyclictest24856-21lspci22:15:291
217549998,0cyclictest0-21swapper/123:40:081
217549997,1cyclictest17062-21kworker/1:022:27:401
217479998,0cyclictest0-21swapper/023:18:250
217479997,2cyclictest17607-21kworker/0:122:39:340
217479990,8cyclictest0-21swapper/020:48:440
217649986,1cyclictest41-21ksoftirqd/323:45:303
217649986,1cyclictest41-21ksoftirqd/322:28:363
217599982,3cyclictest33-21ksoftirqd/219:50:002
217549987,0cyclictest11458-21lspci22:00:571
217549987,0cyclictest0-21swapper/122:05:071
217549987,0cyclictest0-21swapper/121:08:271
217549986,1cyclictest25-21ksoftirqd/100:33:041
217549986,1cyclictest0-21swapper/123:00:371
217549981,1cyclictest121rcu_preempt23:37:491
217479987,0cyclictest0-21swapper/021:09:540
217479987,0cyclictest0-21swapper/019:25:040
217479986,1cyclictest28419-21lspci00:13:200
217479986,1cyclictest25825-21lspci22:32:080
217479980,4cyclictest0-21swapper/020:55:000
9675270,1sleep09809-21sshd23:00:070
217649975,1cyclictest41-21ksoftirqd/322:45:283
217649975,1cyclictest3887-21sshd21:56:563
217649975,1cyclictest25886-21lspci22:55:103
217549976,0cyclictest0-21swapper/120:55:171
217479976,0cyclictest29769-21lspci22:42:280
217479976,0cyclictest0-21swapper/023:57:350
217479976,0cyclictest0-21swapper/022:11:550
217479976,0cyclictest0-21swapper/020:21:240
217479975,1cyclictest9507-21id21:21:050
217479975,1cyclictest8949-21sshd21:37:360
217479975,1cyclictest649-21avahi-daemon23:53:110
217479975,1cyclictest5400-21sshd21:57:060
217479975,1cyclictest5287-21lspci23:25:510
217479974,2cyclictest649-21avahi-daemon23:40:080
217479974,2cyclictest28307-21sshd22:25:470
217649966,0cyclictest18256-21kworker/3:119:30:103
217649965,0cyclictest0-21swapper/319:23:253
217649964,1cyclictest41-21ksoftirqd/320:55:003
217649964,1cyclictest17299-21snmpd19:28:283
217649963,2cyclictest17299-21snmpd19:14:573
217599964,1cyclictest33-21ksoftirqd/220:00:002
217599964,1cyclictest17299-21snmpd19:22:222
217599961,2cyclictest33-21ksoftirqd/220:45:122
217599960,1cyclictest33-21ksoftirqd/220:05:192
217549965,0cyclictest27754-21kworker/1:020:20:221
217549965,0cyclictest14834-21kworker/1:220:40:181
217549965,0cyclictest10476-21kworker/1:020:39:241
217549965,0cyclictest0-21swapper/120:00:171
217549964,1cyclictest19273-21cut20:50:151
217549960,5cyclictest0-21swapper/120:25:371
217479965,1cyclictest22678-21kworker/0:121:00:120
217479961,4cyclictest25347-21munin-run19:35:000
217479960,5cyclictest0-21swapper/020:11:140
217649953,1cyclictest48-21kauditd19:15:363
217649953,1cyclictest17299-21snmpd21:00:463
217649953,1cyclictest17299-21snmpd20:55:103
217649953,1cyclictest17299-21snmpd20:48:583
217649953,1cyclictest17299-21snmpd20:40:363
217649953,1cyclictest17299-21snmpd20:27:423
217649953,1cyclictest17299-21snmpd20:16:393
217649953,1cyclictest17299-21snmpd20:09:023
217649953,1cyclictest17299-21snmpd20:00:263
217649953,1cyclictest17299-21snmpd19:45:083
217649953,1cyclictest17299-21snmpd19:40:283
217649953,1cyclictest17299-21snmpd19:37:073
217649953,1cyclictest1049-21rpcbind20:38:343
217649952,2cyclictest29835-21pmu-power19:55:303
217649952,2cyclictest17299-21snmpd20:32:543
217599953,1cyclictest17299-21snmpd20:35:002
217599953,1cyclictest17299-21snmpd20:22:332
217599953,1cyclictest17299-21snmpd20:10:052
217599953,1cyclictest17299-21snmpd19:36:102
217599953,1cyclictest17299-21snmpd19:29:192
217599953,1cyclictest17299-21snmpd19:11:072
217599953,1cyclictest15303-21cat20:40:152
217599951,2cyclictest33-21ksoftirqd/220:25:122
217599951,1cyclictest33-21ksoftirqd/220:15:172
217599951,0cyclictest33-21ksoftirqd/219:35:002
217599950,3cyclictest0-21swapper/219:50:482
217599950,1cyclictest33-21ksoftirqd/220:55:092
217599950,1cyclictest33-21ksoftirqd/219:15:012
217599950,1cyclictest121rcu_preempt21:00:192
217599950,1cyclictest1094-21nfsd20:30:192
217549955,0cyclictest27754-21kworker/1:019:52:271
217549954,0cyclictest0-21swapper/119:11:171
217549953,1cyclictest3143-21cat20:10:171
217549953,1cyclictest22842-21cut19:15:011
217549953,1cyclictest17299-21snmpd20:45:191
217549953,1cyclictest17299-21snmpd19:46:081
217549953,1cyclictest17299-21snmpd19:40:161
217549953,1cyclictest17299-21snmpd19:39:551
217549952,2cyclictest11810-21sendmail_mailqu20:30:211
217549950,0cyclictest0-21swapper/119:59:371
217479954,0cyclictest0-21swapper/019:42:240
217479953,1cyclictest29362-21cat19:55:090
217479953,1cyclictest17299-21snmpd20:25:240
217479953,1cyclictest17299-21snmpd19:50:410
217479953,1cyclictest17299-21snmpd19:13:550
217479953,1cyclictest15340-21cat20:40:150
217479953,1cyclictest11275-21cat20:30:170
217479953,1cyclictest1109-21ntpd20:15:170
217479953,1cyclictest1109-21ntpd20:05:160
217479952,2cyclictest17299-21snmpd19:39:400
217479950,4cyclictest30906-21sshd20:00:060
217479950,0cyclictest0-21swapper/019:15:240
217649942,1cyclictest17299-21snmpd20:10:023
217599940,2cyclictest33-21ksoftirqd/219:41:012
217549942,1cyclictest24970-21taskset19:30:191
217549942,1cyclictest24420-21seq19:26:131
217549942,1cyclictest23345-21grep21:00:131
217549942,1cyclictest17299-21snmpd19:20:251
217479943,0cyclictest0-21swapper/019:23:340
217479942,1cyclictest17299-21snmpd19:45:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional