You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 02:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 21, 2025 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1153221610,4sleep3725299cyclictest23:05:273
2313421450,0sleep123129-21cp22:41:161
1582021440,1sleep015817-21sshd22:56:190
2822121390,1sleep20-21swapper/223:26:062
166421350,1sleep01655-21sshd23:39:270
2022321310,4sleep2725199cyclictest22:25:072
1427821300,1sleep314279-21sshd23:50:003
3203921200,1sleep30-21swapper/322:00:383
2196721140,4sleep20-21swapper/200:16:252
2498821110,0sleep124989-21sshd21:47:141
6986210733,44sleep10-21swapper/119:09:551
114242930,1sleep10-21swapper/100:38:321
46582920,1sleep30-21swapper/321:42:023
58742900,2sleep30-21swapper/321:55:013
51052890,2sleep05104-21sshd21:26:080
51052890,2sleep05104-21sshd21:26:080
43272890,1sleep01848-21nfsd00:31:060
285822880,2sleep041ktimersoftd/021:19:030
21762870,2sleep30-21swapper/323:23:393
73062860,1sleep30-21swapper/321:26:243
73062860,1sleep30-21swapper/321:26:233
266212860,1sleep00-21swapper/021:56:580
257972850,1sleep025793-21sshd21:21:510
254342850,1sleep025426-21sshd22:28:450
18282850,2sleep31826-21sshd23:01:183
139042850,2sleep213903-21bash23:24:502
675628433,47sleep30-21swapper/319:07:083
64842820,1sleep30-21swapper/322:45:553
271132820,1sleep21848-21nfsd21:34:482
263802810,1sleep30-21swapper/300:20:143
109492800,1sleep00-21swapper/022:30:250
23712790,3sleep22369-21sshd00:27:432
18062780,4sleep10-21swapper/121:25:491
18062780,4sleep10-21swapper/121:25:491
50062770,0sleep00-21swapper/022:39:360
118022770,5sleep3725299cyclictest22:24:163
25852750,2sleep10-21swapper/100:17:481
123402740,2sleep21959-21sshd21:23:462
91292720,1sleep39126-21bash23:36:573
135352720,2sleep313531-21bash23:34:173
306012700,3sleep2725199cyclictest21:50:552
300162670,3sleep30-21swapper/321:13:053
260202660,1sleep00-21swapper/021:12:410
251302660,4sleep2725199cyclictest00:06:502
12812590,0sleep21280-21bash22:39:132
672425633,11sleep00-21swapper/019:06:450
724799550,46cyclictest18217-21sshd22:05:360
724799541,10cyclictest26616-21sshd23:13:210
184832540,1sleep0724799cyclictest00:16:020
724799520,45cyclictest21444-21sshd00:26:190
683425237,11sleep20-21swapper/219:07:592
724799461,42cyclictest19258-21sshd00:09:390
724799460,5cyclictest2416-21bash22:45:300
724799456,4cyclictest7676-21sshd00:11:400
724799451,6cyclictest6809-21bash21:35:520
724799451,6cyclictest6809-21bash21:35:520
724799450,42cyclictest1846-21nfsd22:44:160
724799440,40cyclictest1263-21sshd23:42:310
724799431,6cyclictest0-21swapper/000:00:190
724799431,39cyclictest0-21swapper/023:01:280
724799421,38cyclictest0-21swapper/023:57:320
724799411,7cyclictest30299-21sshd23:16:500
724799411,7cyclictest30299-21sshd23:16:500
724799411,4cyclictest0-21swapper/022:51:360
724799410,9cyclictest19872-21missed_timers23:25:200
724799410,8cyclictest13776-21sshd23:34:180
724799410,7cyclictest14113-21sshd22:21:120
724799410,38cyclictest0-21swapper/000:22:260
724799401,31cyclictest0-21swapper/022:17:590
724799400,37cyclictest1847-21nfsd21:33:370
724799391,5cyclictest1874-21sshd23:07:460
258842390,37sleep326950irq/26-ahci[00023:29:103
724799387,4cyclictest8325-21sshd23:49:250
724799380,9cyclictest10813-21sshd23:21:130
724799380,8cyclictest12243-21bash00:35:150
724799380,36cyclictest31039-21sshd21:41:250
725299372,4cyclictest0-21swapper/300:03:373
137602370,2sleep20-21swapper/222:49:552
725299361,6cyclictest0-21swapper/300:31:233
724799361,6cyclictest1544-21sshd21:51:170
724799361,5cyclictest0-21swapper/023:54:560
725299351,6cyclictest0-21swapper/300:07:223
724799340,9cyclictest0-21swapper/021:45:040
310222340,32sleep1135650irq/27-eth021:35:121
310222340,32sleep1135650irq/27-eth021:35:121
184602340,2sleep21847-21nfsd22:05:382
174762340,1sleep10-21swapper/121:52:541
725299337,17cyclictest135650irq/27-eth022:34:363
725299332,4cyclictest0-21swapper/323:16:093
725299332,4cyclictest0-21swapper/323:16:093
7251993312,18cyclictest33-21ksoftirqd/222:51:042
724799331,3cyclictest135650irq/27-eth022:04:590
725299322,5cyclictest0-21swapper/300:16:093
725299322,3cyclictest0-21swapper/322:37:253
725299321,7cyclictest0-21swapper/322:57:093
725299320,5cyclictest0-21swapper/321:30:043
724799321,30cyclictest0-21swapper/022:10:450
181142320,3sleep30-21swapper/323:12:293
725299312,8cyclictest0-21swapper/322:10:003
725299312,5cyclictest0-21swapper/323:40:313
725299312,5cyclictest0-21swapper/300:26:223
725299312,4cyclictest0-21swapper/322:50:533
725299311,8cyclictest0-21swapper/322:40:183
725299311,6cyclictest0-21swapper/322:11:483
725299304,3cyclictest0-21swapper/321:46:533
725299302,4cyclictest0-21swapper/321:39:543
725299302,4cyclictest0-21swapper/321:39:543
725299302,3cyclictest0-21swapper/323:55:513
725299301,5cyclictest0-21swapper/321:24:133
725299292,5cyclictest0-21swapper/322:17:353
725299283,4cyclictest0-21swapper/322:28:553
725299283,4cyclictest0-21swapper/321:19:303
725299282,3cyclictest0-21swapper/323:50:073
725299281,5cyclictest0-21swapper/300:11:523
164292280,2sleep21848-21nfsd23:31:202
725299270,4cyclictest0-21swapper/321:51:073
32962270,2sleep23295-21nfsd420:10:212
725299261,5cyclictest1073-21sshd00:37:273
156262260,23sleep1135650irq/27-eth023:40:411
7251992517,6cyclictest27905-21sshd23:51:112
725199251,17cyclictest33-21ksoftirqd/222:16:372
725199250,18cyclictest33-21ksoftirqd/200:34:542
7250992512,1cyclictest10950irq/23-ehci_hcd23:04:531
724799251,6cyclictest0-21swapper/019:31:200
166972251,22sleep1135650irq/27-eth000:05:591
9632240,21sleep1135650irq/27-eth000:20:541
724799240,22cyclictest0-21swapper/021:00:000
191782240,22sleep1135650irq/27-eth021:15:081
159082240,2sleep115899-21sshd22:24:411
13852240,2sleep10-21swapper/123:17:111
13852240,2sleep10-21swapper/123:17:111
7251992313,3cyclictest16145-21sshd23:18:392
7251992313,3cyclictest16145-21sshd23:18:382
7250992314,5cyclictest0-21swapper/123:22:291
725099230,20cyclictest29074-21perf22:10:001
724799231,7cyclictest0-21swapper/020:46:050
724799231,7cyclictest0-21swapper/019:48:500
199802230,2sleep119984-21bash00:12:551
131172230,1sleep10-21swapper/119:20:191
113232230,2sleep211245-21sshd22:01:492
7251992217,3cyclictest7381-21sshd23:01:532
7251992216,3cyclictest17143-21sshd00:12:372
7251992213,4cyclictest1845-21nfsd22:56:302
7250992213,5cyclictest15411-21bash23:37:361
7250992210,5cyclictest10950irq/23-ehci_hcd23:46:191
725099220,15cyclictest22-21ksoftirqd/121:40:221
724799220,8cyclictest0-21swapper/019:10:170
724799220,6cyclictest29420-21sadc21:10:000
145562220,20sleep1135650irq/27-eth022:02:091
106292220,20sleep1135650irq/27-eth022:52:441
725299210,9cyclictest0-21swapper/320:59:533
725299210,9cyclictest0-21swapper/320:10:163
725299210,2cyclictest0-21swapper/320:00:203
725299210,2cyclictest0-21swapper/319:25:223
725299210,2cyclictest0-21swapper/319:25:213
7251992117,2cyclictest1959-21sshd22:21:492
7251992116,3cyclictest1959-21sshd23:56:152
7251992116,3cyclictest1554-21sshd22:32:462
7251992115,4cyclictest26857-21bash23:35:272
7251992114,4cyclictest27178-21fschecks_count21:25:132
7251992114,4cyclictest27178-21fschecks_count21:25:132
7251992113,6cyclictest27338-21sshd00:00:302
7251992113,6cyclictest1848-21nfsd23:06:252
7251992113,2cyclictest29674-21sshd23:45:152
725099218,4cyclictest10950irq/23-ehci_hcd22:36:041
7250992115,2cyclictest10950irq/23-ehci_hcd23:54:131
7250992114,5cyclictest19877-21sshd22:56:431
7250992112,6cyclictest9862-21sshd22:49:311
725099210,19cyclictest7263-21id21:20:091
725099210,18cyclictest22-21ksoftirqd/123:25:351
724799218,12cyclictest0-21swapper/020:02:480
724799218,11cyclictest0-21swapper/019:40:150
724799210,6cyclictest0-21swapper/020:25:210
157862210,2sleep10-21swapper/100:29:071
125932210,1sleep2725199cyclictest21:42:502
725299201,9cyclictest0-21swapper/319:55:203
725299201,1cyclictest0-21swapper/319:10:163
725299200,9cyclictest0-21swapper/319:35:503
725299200,2cyclictest0-21swapper/320:52:283
725299200,1cyclictest0-21swapper/319:32:323
7251992017,2cyclictest27196-21sshd23:13:232
7251992016,2cyclictest3087-21unixbench_multi22:10:312
7251992014,4cyclictest31833-21sshd00:24:132
7251992013,5cyclictest25928-21sshd21:18:482
7251992013,4cyclictest8216-21sshd23:40:052
7251992012,4cyclictest9510-21sshd21:55:182
725199200,18cyclictest33-21ksoftirqd/222:42:462
725099207,2cyclictest25374-21sshd22:25:271
724799203,6cyclictest14881-21irqstats19:25:160
724799203,6cyclictest14881-21irqstats19:25:150
724799201,6cyclictest0-21swapper/019:36:200
724799201,3cyclictest0-21swapper/019:15:130
724799200,8cyclictest636-21munin-node20:05:150
724799200,19cyclictest0-21swapper/019:53:210
724799200,11cyclictest8231-21munin-node20:20:230
41662200,19sleep1135650irq/27-eth000:34:321
296372201,17sleep1135650irq/27-eth021:13:041
725299198,1cyclictest0-21swapper/320:05:213
725299197,2cyclictest0-21swapper/321:00:133
725299196,3cyclictest0-21swapper/321:05:133
725299195,2cyclictest0-21swapper/319:20:183
725299191,9cyclictest0-21swapper/319:46:513
725299191,8cyclictest0-21swapper/320:45:253
725299190,9cyclictest0-21swapper/320:40:183
725299190,9cyclictest0-21swapper/320:34:033
725299190,9cyclictest0-21swapper/319:50:173
725299190,1cyclictest0-21swapper/319:16:113
725199195,7cyclictest10950irq/23-ehci_hcd21:38:242
725199195,7cyclictest10950irq/23-ehci_hcd21:38:242
7251991915,2cyclictest9667-21sshd21:14:142
7251991911,6cyclictest9806-21sshd00:35:052
725099198,2cyclictest26590-21bash23:32:201
724799195,4cyclictest0-21swapper/019:20:070
724799190,8cyclictest0-21swapper/019:55:170
724799190,6cyclictest0-21swapper/021:00:130
724799190,11cyclictest3306-21grep20:10:210
724799190,10cyclictest22134-21users20:50:240
724799190,10cyclictest17104-21munin-node20:40:220
725299188,1cyclictest0-21swapper/320:25:143
725299188,1cyclictest0-21swapper/320:15:173
725299188,1cyclictest0-21swapper/319:40:113
725299181,1cyclictest0-21swapper/320:20:163
725299180,9cyclictest0-21swapper/320:35:123
725099187,1cyclictest135650irq/27-eth023:57:421
725099184,5cyclictest1847-21nfsd23:14:531
7250991812,4cyclictest7532-21sshd21:55:111
7250991811,5cyclictest9295-21nscd22:33:131
725099180,16cyclictest0-21swapper/122:18:441
724799187,8cyclictest0-21swapper/020:35:590
724799180,17cyclictest0-21swapper/020:15:300
724799180,11cyclictest0-21swapper/020:30:200
725199179,4cyclictest4817-21fschecks_time21:45:152
7250991714,2cyclictest0-21swapper/122:12:101
7250991711,5cyclictest28354-21sshd00:03:561
287792170,2sleep228781-21nfsd419:55:192
725199162,4cyclictest0-21swapper/219:46:412
725099166,8cyclictest19027-21sshd23:06:151
725099165,9cyclictest0-21swapper/121:05:141
725099164,11cyclictest10950irq/23-ehci_hcd19:31:091
725099160,15cyclictest3291-21sshd21:32:231
725199159,4cyclictest29561-21bash21:10:002
725099154,10cyclictest10950irq/23-ehci_hcd19:28:171
725099154,10cyclictest10950irq/23-ehci_hcd19:28:171
725099150,9cyclictest15730-21awk20:40:001
725099150,2cyclictest135650irq/27-eth020:27:141
10642150,2sleep1211ktimersoftd/120:05:191
725199143,10cyclictest10950irq/23-ehci_hcd20:25:372
725199141,11cyclictest0-21swapper/220:47:502
7250991410,3cyclictest10950irq/23-ehci_hcd21:00:101
725199138,3cyclictest22084-21ntp_states19:40:162
725199132,9cyclictest417-21jbd2/dm-0-820:30:052
725199132,7cyclictest135650irq/27-eth019:19:072
725199131,11cyclictest135650irq/27-eth020:41:462
725199131,11cyclictest10950irq/23-ehci_hcd20:51:022
7251991311,1cyclictest0-21swapper/220:01:362
725199130,12cyclictest16388-21munin-node19:30:232
725199130,12cyclictest135650irq/27-eth019:10:162
725199130,12cyclictest0-21swapper/221:01:242
725199130,12cyclictest0-21swapper/220:56:202
725199130,12cyclictest0-21swapper/220:37:402
725199130,12cyclictest0-21swapper/220:20:042
725199130,12cyclictest0-21swapper/220:05:342
725199130,11cyclictest11825-21munin-node19:20:112
725099139,3cyclictest12173-21kernelversion20:30:221
725099139,3cyclictest10950irq/23-ehci_hcd20:22:551
725099138,1cyclictest1848-21nfsd19:10:161
725099130,8cyclictest0-21swapper/120:10:151
725099130,4cyclictest2405-21runrttasks20:47:061
725099130,12cyclictest0-21swapper/120:52:151
725099130,12cyclictest0-21swapper/120:15:341
725099130,12cyclictest0-21swapper/119:55:401
725099130,12cyclictest0-21swapper/119:54:101
725099130,12cyclictest0-21swapper/119:47:321
725099130,12cyclictest0-21swapper/119:40:121
725099130,12cyclictest0-21swapper/119:35:221
725099130,12cyclictest0-21swapper/119:16:421
725199120,11cyclictest25835-21munin-node19:50:132
725199120,11cyclictest1927-21snmpd20:15:032
725199120,11cyclictest1848-21nfsd19:35:162
725099120,11cyclictest0-21swapper/120:55:141
725099120,11cyclictest0-21swapper/120:40:081
725099120,11cyclictest0-21swapper/120:00:081
725199110,2cyclictest0-21swapper/219:25:132
725199110,2cyclictest0-21swapper/219:25:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional