You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 09:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Dec 08, 2025 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1307821500,0sleep20-21swapper/222:54:142
1799521380,1sleep30-21swapper/323:31:273
753921250,2sleep11018499cyclictest22:44:311
756821160,4sleep31018899cyclictest22:17:073
875621150,2sleep20-21swapper/200:01:202
243621110,2sleep30-21swapper/323:11:383
2232621080,1sleep31845-21nfsd23:59:373
474721010,1sleep11018499cyclictest23:45:241
505221000,2sleep01017999cyclictest23:05:430
505221000,2sleep01017999cyclictest23:05:420
159232950,1sleep01017999cyclictest23:52:450
253932940,2sleep22405-21runrttasks23:32:092
981929233,47sleep10-21swapper/119:08:361
304482890,3sleep21018799cyclictest22:25:202
275782880,3sleep327567-21sshd22:40:163
269912880,3sleep01017999cyclictest22:00:420
146902880,3sleep314691-21sshd00:01:583
128992880,4sleep21018799cyclictest23:03:282
976228733,50sleep30-21swapper/319:07:543
131122870,2sleep30-21swapper/323:40:083
208682860,1sleep020861-21sshd23:40:450
36052840,2sleep30-21swapper/300:31:073
285432830,3sleep31018899cyclictest22:37:203
91972820,2sleep39194-21sshd23:18:283
324782820,2sleep20-21swapper/222:19:322
241372820,2sleep324138-21sshd23:01:253
218902820,2sleep20-21swapper/222:45:452
157942820,2sleep315792-21sshd21:23:333
157942820,2sleep315792-21sshd21:23:333
210252790,0sleep00-21swapper/022:06:150
129032790,1sleep112888-21sshd23:25:001
267162780,1sleep30-21swapper/322:28:013
13912780,2sleep30-21swapper/321:43:183
137242770,3sleep10-21swapper/122:14:451
201452760,2sleep30-21swapper/323:22:323
77782750,2sleep30-21swapper/322:50:303
270012690,1sleep10-21swapper/121:12:281
119222670,0sleep00-21swapper/000:28:440
54952610,2sleep10-21swapper/100:17:511
269572590,0sleep11848-21nfsd23:29:211
284942570,1sleep20-21swapper/223:26:202
973425631,22sleep00-21swapper/019:07:310
190892560,2sleep219076-21sshd21:11:412
24912530,3sleep32382-21sshd23:48:223
959425034,11sleep20-21swapper/219:06:062
211712460,44sleep1135650irq/27-eth023:44:011
10188993726,7cyclictest1959-21sshd23:37:113
10188993628,5cyclictest13618-21id22:20:393
10188993528,5cyclictest0-21swapper/322:59:073
10188993525,6cyclictest0-21swapper/323:50:243
10188993525,5cyclictest1848-21nfsd23:08:013
10188993525,5cyclictest1848-21nfsd23:08:013
10188993524,7cyclictest0-21swapper/300:15:463
166002340,3sleep20-21swapper/222:36:112
10188993428,4cyclictest1848-21nfsd22:49:093
10188993426,5cyclictest360-21sshd23:29:553
10188993420,9cyclictest15241-21sshd22:33:023
10187993429,4cyclictest1847-21nfsd00:24:262
10188993323,6cyclictest11072-21sshd00:35:253
10188993323,6cyclictest0-21swapper/300:10:143
10188993226,3cyclictest16489-21sshd21:29:373
10188993226,3cyclictest0-21swapper/300:05:453
10188993225,5cyclictest4667-21sshd00:24:423
10188993221,6cyclictest1847-21nfsd00:27:273
10188993125,4cyclictest27354-21id22:03:523
278612280,1sleep027862-21bash22:34:170
277062280,5sleep10-21swapper/123:35:211
119572280,2sleep247-21rcuop/323:58:352
10188992824,3cyclictest9579-21sshd21:50:073
10188992821,4cyclictest0-21swapper/322:08:393
10184992815,5cyclictest31922-21sshd00:30:391
10188992719,4cyclictest22662-21sshd21:45:153
10188992711,8cyclictest31677-21sshd21:30:553
1018799278,9cyclictest5010-21sshd23:21:032
21642260,1sleep20-21swapper/221:37:182
146892260,3sleep11018499cyclictest20:30:131
10184992612,6cyclictest5966-21bash23:51:451
1018899255,6cyclictest3557-21sshd21:19:263
1018499254,19cyclictest22-21ksoftirqd/122:50:131
10184992512,4cyclictest1845-21nfsd23:33:551
1017999250,20cyclictest31070-21sshd00:13:360
206902240,2sleep120667-21sshd00:02:351
191002240,2sleep10-21swapper/122:18:131
1018899244,8cyclictest135650irq/27-eth021:37:363
10188992419,3cyclictest0-21swapper/322:10:043
10184992417,4cyclictest19767-21sshd22:57:581
1018499240,21cyclictest22-21ksoftirqd/122:24:211
10179992414,8cyclictest3-21ksoftirqd/023:21:030
10179992413,4cyclictest3-21ksoftirqd/022:35:200
258692230,2sleep20-21swapper/222:00:352
207892230,0sleep041ktimersoftd/023:46:580
1018899235,13cyclictest15553-21grep19:20:173
10188992313,9cyclictest17686-21sshd21:14:433
1018499239,3cyclictest1125-21sshd23:57:311
1018499239,12cyclictest22-21ksoftirqd/100:05:461
1018499231,20cyclictest22-21ksoftirqd/122:36:401
1018899223,8cyclictest20601-21sshd21:57:083
10188992210,8cyclictest28993-21nfsd421:00:193
10184992214,6cyclictest0-21swapper/121:51:141
10184992214,5cyclictest24642-21rm23:01:281
10184992211,4cyclictest135650irq/27-eth022:25:471
10179992211,3cyclictest2153-21sshd23:02:270
10179992210,4cyclictest0-21swapper/022:26:320
79402210,2sleep01017999cyclictest00:04:380
319102210,19sleep032211-21bash21:55:130
26172210,2sleep00-21swapper/000:07:230
10187992113,4cyclictest14565-21sshd21:23:262
10187992113,4cyclictest14565-21sshd21:23:252
10184992117,2cyclictest2684-21sshd00:10:381
10184992116,3cyclictest22229-21id22:45:471
10184992113,5cyclictest23098-21sshd23:16:411
10184992113,4cyclictest1847-21nfsd22:04:541
1017999217,1cyclictest10716-21sshd00:18:250
1017999210,13cyclictest0-21swapper/023:36:210
319512202,16sleep1135650irq/27-eth000:20:361
1018899203,15cyclictest20119-21processes20:40:253
10188992018,1cyclictest0-21swapper/319:55:193
10187992015,4cyclictest1915-21snmpd21:32:262
10187992014,4cyclictest21506-21bash22:42:452
10187992010,4cyclictest135650irq/27-eth021:15:072
10184992015,3cyclictest19776-21nfsd422:30:221
10184992015,3cyclictest13384-21sshd23:06:321
10184992015,3cyclictest13384-21sshd23:06:321
10184992015,3cyclictest12364-21sshd00:35:311
1017999209,4cyclictest0-21swapper/023:17:460
1017999201,13cyclictest0-21swapper/023:56:100
1017999200,10cyclictest29777-21sshd22:43:320
1018899194,13cyclictest31479-21ls21:05:233
1018899194,13cyclictest21492-21munin-node20:45:153
1018899193,8cyclictest12799-21df_inode19:15:143
1018899193,8cyclictest12799-21df_inode19:15:143
1018899193,14cyclictest1848-21nfsd20:53:173
10188991914,3cyclictest27605-21timerwakeupswit19:45:223
10187991914,3cyclictest1846-21nfsd23:05:182
10187991914,3cyclictest1846-21nfsd23:05:172
10187991913,4cyclictest25319-21bash00:13:012
1018799191,13cyclictest135650irq/27-eth000:19:552
10184991914,3cyclictest1848-21nfsd23:10:341
10184991914,3cyclictest1846-21nfsd00:25:341
1017999196,12cyclictest0-21swapper/020:45:170
10179991914,4cyclictest1848-21nfsd00:24:270
1017999190,2cyclictest0-21swapper/022:49:480
1017999190,11cyclictest28072-21bash21:45:410
268172180,2sleep126815-21sshd21:15:251
217542180,0sleep00-21swapper/023:10:230
1018899184,12cyclictest10950irq/23-ehci_hcd20:20:413
1018899182,14cyclictest2405-21runrttasks20:08:253
1018899182,14cyclictest1847-21nfsd20:55:303
1018899182,13cyclictest135650irq/27-eth020:11:573
10188991813,3cyclictest0-21swapper/320:25:313
10188991813,3cyclictest0-21swapper/319:15:003
1018799184,11cyclictest0-21swapper/223:45:172
1018799183,6cyclictest135650irq/27-eth023:50:162
10187991813,4cyclictest20350-21sshd22:21:182
10187991813,3cyclictest26221-21sshd23:44:302
10187991813,1cyclictest1848-21nfsd00:05:052
10187991812,4cyclictest8319-21cp22:32:212
10187991812,2cyclictest135650irq/27-eth021:57:302
1018799181,13cyclictest18251-21bash21:50:492
10187991810,1cyclictest2806-21sshd00:34:392
1018799180,9cyclictest0-21swapper/222:59:552
1018799180,15cyclictest135650irq/27-eth000:38:532
1018499186,10cyclictest0-21swapper/121:36:281
10184991813,4cyclictest31457-21sshd21:55:111
1017999180,1cyclictest135650irq/27-eth021:10:180
1017999180,1cyclictest0-21swapper/021:36:530
1017999180,17cyclictest4644-21sshd22:50:160
1017999180,11cyclictest0-21swapper/000:35:040
1017999180,11cyclictest0-21swapper/000:34:400
51642170,3sleep21848-21nfsd21:46:372
256032170,4sleep01017999cyclictest22:24:580
1018899178,7cyclictest44-21ksoftirqd/319:50:153
1018899172,13cyclictest24197-21df_inode19:40:133
1018899172,13cyclictest1848-21nfsd20:37:333
1018799179,4cyclictest30361-21sshd23:14:242
1018799178,4cyclictest21715-21bash23:16:332
1018799172,7cyclictest0-21swapper/220:17:392
1018799172,13cyclictest8157-21sshd21:40:482
1018799170,4cyclictest15520-21sshd22:11:492
1018499173,12cyclictest36-21rcuop/222:08:581
1017999170,9cyclictest0-21swapper/022:55:050
1017999170,10cyclictest17517-21bash23:31:250
1018899164,10cyclictest21922-21diskstats19:35:143
1018899163,6cyclictest135650irq/27-eth019:25:153
1018899161,13cyclictest1848-21nfsd20:32:333
10188991610,5cyclictest1848-21nfsd20:15:593
10188991610,5cyclictest1848-21nfsd19:30:293
1018799168,5cyclictest11960-21sshd00:25:222
1018799168,4cyclictest2405-21runrttasks19:20:582
1018799165,3cyclictest5124-21sshd21:25:272
1018799162,9cyclictest7864-21sshd23:36:322
1018799162,9cyclictest13146-21ntp_kernel_err20:25:202
1018799162,13cyclictest0-21swapper/220:06:032
1018799161,7cyclictest0-21swapper/220:10:472
1018799161,7cyclictest0-21swapper/219:10:192
1018499168,5cyclictest24200-21sshd21:27:171
1018499164,11cyclictest3737-21sshd21:22:251
1018499164,11cyclictest3737-21sshd21:22:241
10184991610,4cyclictest25-21rcuop/121:45:561
1018499160,14cyclictest0-21swapper/120:05:211
1017999162,10cyclictest0-21swapper/021:20:150
1017999162,10cyclictest0-21swapper/021:20:150
10179991612,3cyclictest3-21ksoftirqd/023:26:300
1017999160,13cyclictest0-21swapper/022:17:170
1017999160,12cyclictest0-21swapper/021:42:420
1018799158,5cyclictest24437-21sshd22:06:342
1018799152,7cyclictest0-21swapper/219:43:332
1018799150,2cyclictest0-21swapper/219:32:272
1018799150,13cyclictest0-21swapper/220:40:542
1018499159,4cyclictest9540-21awk20:19:591
1018499153,11cyclictest10950irq/23-ehci_hcd20:46:151
10184991512,2cyclictest31909-21sshd21:40:071
10184991511,3cyclictest10950irq/23-ehci_hcd20:43:361
10184991510,3cyclictest32327-21bash21:30:591
1018499150,7cyclictest0-21swapper/119:36:521
1017999150,9cyclictest25876-21sshd21:30:240
1017999150,1cyclictest0-21swapper/022:12:490
1017999150,14cyclictest0-21swapper/021:16:140
1018899142,10cyclictest869-21forks20:00:133
1018799147,6cyclictest0-21swapper/221:00:202
1018799142,6cyclictest417-21jbd2/dm-0-820:30:052
1018799141,11cyclictest28218-21munin-run19:50:002
1018799140,3cyclictest135650irq/27-eth020:23:222
1018499143,10cyclictest10950irq/23-ehci_hcd19:16:421
1018499143,10cyclictest10950irq/23-ehci_hcd19:16:411
10184991411,2cyclictest0-21swapper/121:01:441
1018499140,13cyclictest11213-21awk19:10:251
1017999147,3cyclictest0-21swapper/021:51:110
1017999147,1cyclictest2405-21runrttasks19:21:400
1017999140,4cyclictest0-21swapper/020:26:360
1017999140,3cyclictest2655-21sshd21:25:170
1017999140,1cyclictest2405-21runrttasks20:23:070
1017999140,13cyclictest0-21swapper/021:01:120
1017999140,13cyclictest0-21swapper/020:10:260
1017999140,13cyclictest0-21swapper/020:06:050
1018799139,3cyclictest26265-40kipmi019:35:172
1018799139,3cyclictest135650irq/27-eth019:50:032
1018799138,4cyclictest135650irq/27-eth019:55:032
1018799137,5cyclictest0-21swapper/220:45:062
1018799137,5cyclictest0-21swapper/219:25:462
1018799135,4cyclictest10950irq/23-ehci_hcd20:50:212
10187991311,1cyclictest0-21swapper/220:37:102
10187991311,1cyclictest0-21swapper/219:17:002
10187991311,1cyclictest0-21swapper/219:17:002
10187991310,2cyclictest135650irq/27-eth020:00:422
1018799130,12cyclictest31569-21munin-node21:05:242
1018799130,10cyclictest135650irq/27-eth020:56:092
1018499137,5cyclictest0-21swapper/121:06:521
1018499137,5cyclictest0-21swapper/120:00:421
1018499137,5cyclictest0-21swapper/119:25:181
1018499137,5cyclictest0-21swapper/119:20:421
10184991310,3cyclictest10950irq/23-ehci_hcd20:53:231
1018499130,12cyclictest144550irq/28-eth1-rx-20:59:281
1018499130,12cyclictest10950irq/23-ehci_hcd20:22:171
1018499130,12cyclictest0-21swapper/119:56:231
1018499130,12cyclictest0-21swapper/119:42:081
1018499130,12cyclictest0-21swapper/119:30:321
1018499130,11cyclictest5876-21hddtemp_smartct20:10:171
1018499130,11cyclictest0-21swapper/119:50:541
1017999137,1cyclictest0-21swapper/019:28:360
1017999136,6cyclictest0-21swapper/020:52:140
1017999130,5cyclictest0-21swapper/021:06:010
1017999130,1cyclictest0-21swapper/020:40:340
1017999130,12cyclictest0-21swapper/020:18:300
1017999130,12cyclictest0-21swapper/019:57:570
1017999130,12cyclictest0-21swapper/019:50:590
1017999130,12cyclictest0-21swapper/019:40:050
1017999130,12cyclictest0-21swapper/019:39:120
1017999130,10cyclictest0-21swapper/020:55:030
1017999130,10cyclictest0-21swapper/019:45:280
1017999130,10cyclictest0-21swapper/019:32:460
1018499126,5cyclictest0-21swapper/119:45:221
1018499120,3cyclictest12354-21df_inode20:25:131
1018499120,11cyclictest0-21swapper/120:35:181
1017999120,11cyclictest0-21swapper/020:01:140
1017999120,11cyclictest0-21swapper/019:15:090
1017999120,11cyclictest0-21swapper/019:15:090
1017999120,10cyclictest0-21swapper/020:31:010
1017999120,10cyclictest0-21swapper/019:14:250
1017999117,3cyclictest0-21swapper/020:35:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional