You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 04:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Nov 19, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1423821450,2sleep3709999cyclictest22:47:363
146921380,0sleep00-21swapper/000:15:340
1254321320,5sleep3709999cyclictest00:04:033
1010821280,2sleep30-21swapper/323:17:463
2194521270,1sleep021930-21sshd21:51:090
2112921240,4sleep1709799cyclictest22:09:061
2803121080,4sleep3709999cyclictest21:51:443
676129829,39sleep30-21swapper/319:09:003
257592950,0sleep00-21swapper/000:28:090
229672940,2sleep322968-21bash21:27:233
52052930,2sleep35198-21sshd23:29:243
246702930,4sleep3709999cyclictest22:39:303
241222930,2sleep30-21swapper/322:03:233
248932890,1sleep324892-21sshd00:21:163
74962880,4sleep2709899cyclictest21:52:522
297492880,1sleep10-21swapper/100:18:281
185262880,1sleep00-21swapper/021:20:550
123192880,1sleep30-21swapper/323:48:323
310942870,0sleep00-21swapper/021:49:050
40282850,2sleep10-21swapper/122:49:461
34112850,2sleep21845-21nfsd23:38:252
221862850,0sleep00-21swapper/022:36:100
195442850,2sleep319545-21sshd21:41:583
547028432,43sleep10-21swapper/119:05:181
21772840,1sleep00-21swapper/020:10:150
70942830,2sleep27082-21sshd23:26:302
196122820,0sleep00-21swapper/023:00:220
213742810,3sleep10-21swapper/122:30:101
241682800,2sleep20-21swapper/222:24:222
143942780,1sleep11848-21nfsd21:56:261
128882780,2sleep112889-21bash00:04:051
313802770,3sleep2709899cyclictest23:50:192
21042770,3sleep2709899cyclictest23:20:052
33902760,3sleep03389-21bash23:35:180
179442760,1sleep117938-21sshd00:10:421
37062750,1sleep00-21swapper/021:55:260
274392740,2sleep20-21swapper/222:15:322
274392740,2sleep20-21swapper/222:15:322
215982720,2sleep30-21swapper/300:07:563
18522720,3sleep30-21swapper/322:25:153
122212710,4sleep2709899cyclictest22:26:102
145542700,2sleep10-21swapper/123:24:171
140852700,3sleep2709899cyclictest23:18:092
212732680,3sleep2709899cyclictest20:50:192
203272680,4sleep3709999cyclictest22:42:023
183142680,5sleep20-21swapper/200:24:022
169602660,1sleep016958-21sshd22:50:530
681525733,13sleep00-21swapper/019:09:410
657625036,9sleep20-21swapper/219:06:432
709699438,3cyclictest11100-21sshd23:20:490
99322400,3sleep22405-21runrttasks21:20:132
7096994011,3cyclictest23681-21id23:06:540
80432380,0sleep18042-21bash22:10:461
709699361,15cyclictest0-21swapper/000:32:020
322092350,2sleep30-21swapper/322:13:053
7099993429,3cyclictest1959-21sshd23:38:373
709699345,14cyclictest1959-21sshd21:18:400
709699340,16cyclictest0-21swapper/022:26:020
52822344,28sleep1135650irq/27-eth000:25:591
7098993124,5cyclictest15010-21sshd00:13:472
7096993110,5cyclictest0-21swapper/022:58:150
13772310,28sleep3135650irq/27-eth000:32:183
709699303,12cyclictest6408-21sshd23:57:160
709699303,12cyclictest0-21swapper/000:23:310
709699290,16cyclictest13183-21sshd22:47:290
709699281,10cyclictest0-21swapper/023:50:270
709699280,9cyclictest1846-21nfsd22:40:420
260402270,4sleep20-21swapper/222:51:472
215022270,1sleep021500-21seq22:03:080
7096992614,2cyclictest0-21swapper/022:14:060
24602260,3sleep30-21swapper/321:37:263
7098992514,3cyclictest12152-21sshd23:05:462
7097992522,2cyclictest20170-21sshd23:06:331
63112250,1sleep010-21rcuc/023:47:570
178702250,3sleep10-21swapper/100:37:171
162862250,2sleep21848-21nfsd21:35:402
7099992414,2cyclictest10950irq/23-ehci_hcd22:57:573
709899242,19cyclictest33-21ksoftirqd/200:01:202
7098992419,3cyclictest6178-21sshd00:16:042
7098992416,6cyclictest9360-21sshd00:29:532
7098992414,6cyclictest13138-21sshd22:56:412
266322240,2sleep12405-21runrttasks00:24:571
244702242,20sleep3135650irq/27-eth000:14:463
228622240,3sleep0709699cyclictest21:30:210
177482240,22sleep1135650irq/27-eth023:00:171
169082240,2sleep233-21ksoftirqd/222:32:442
137802240,1sleep00-21swapper/023:42:280
7099992315,4cyclictest0-21swapper/323:40:473
7098992317,3cyclictest2070-21bash23:32:052
7098992315,6cyclictest29527-21sshd21:28:012
709899231,19cyclictest33-21ksoftirqd/221:16:592
709899230,17cyclictest33-21ksoftirqd/223:45:292
709899230,17cyclictest33-21ksoftirqd/200:38:432
709699230,14cyclictest11502-21sshd22:23:100
49522230,3sleep0709699cyclictest22:16:300
49522230,3sleep0709699cyclictest22:16:300
311612230,0sleep20-21swapper/223:01:292
7099992212,8cyclictest22354-21sshd21:15:213
7098992216,4cyclictest30168-21sshd00:05:372
7098992214,5cyclictest19106-21sshd22:38:582
7098992214,4cyclictest24052-21sshd21:33:282
7098992211,4cyclictest2124-21sshd23:41:182
709699220,18cyclictest0-21swapper/021:26:060
56662220,20sleep1135650irq/27-eth022:59:091
56342220,2sleep10-21swapper/121:16:471
33552220,12sleep3135650irq/27-eth023:32:133
709999216,7cyclictest135650irq/27-eth023:23:273
7099992111,3cyclictest0-21swapper/300:29:463
7098992114,5cyclictest24454-21sshd21:45:242
7098992113,5cyclictest30978-21bash22:40:052
7098992113,4cyclictest1848-21nfsd22:02:242
7098992112,7cyclictest316-21bash23:10:442
709899211,17cyclictest33-21ksoftirqd/222:12:482
709899211,17cyclictest33-21ksoftirqd/200:34:052
7098992111,3cyclictest25514-21sshd21:57:302
7097992112,1cyclictest135650irq/27-eth021:39:151
709699219,3cyclictest15729-21sshd00:04:230
709699210,13cyclictest0-21swapper/023:17:220
709699210,12cyclictest1959-21sshd00:14:110
166042210,19sleep2135650irq/27-eth023:55:132
709899206,7cyclictest10950irq/23-ehci_hcd22:46:052
709799208,5cyclictest1959-21sshd23:14:271
709799206,1cyclictest3503-21bash22:43:321
709799205,7cyclictest12501-21rm21:14:301
709699200,9cyclictest13154-21sshd00:07:070
709699200,7cyclictest0-21swapper/022:32:240
249762200,0sleep00-21swapper/023:13:060
709999191,6cyclictest0-21swapper/321:34:593
7099991911,5cyclictest11963-21sshd23:02:453
709999190,9cyclictest1847-21nfsd22:07:463
709999190,8cyclictest9785-21sshd23:57:363
709999190,11cyclictest0-21swapper/323:14:203
7098991915,2cyclictest1848-21nfsd22:05:272
7098991914,3cyclictest12679-21rm21:44:252
709799199,1cyclictest18338-21rm23:36:421
709799190,14cyclictest8831-21rm22:25:511
304762190,17sleep1135650irq/27-eth023:16:361
27282190,17sleep3135650irq/27-eth022:16:183
27282190,17sleep3135650irq/27-eth022:16:183
231732190,2sleep30-21swapper/321:45:193
709999188,8cyclictest0-21swapper/321:21:293
709999188,3cyclictest135650irq/27-eth000:15:363
709999185,6cyclictest0-21swapper/321:58:133
709999181,7cyclictest1846-21nfsd22:51:443
709999180,5cyclictest18416-21sshd21:11:573
709999180,16cyclictest0-21swapper/323:50:403
7098991813,3cyclictest32112-21sshd21:10:132
709799182,1cyclictest0-21swapper/121:40:261
709799182,13cyclictest135650irq/27-eth021:50:051
7097991811,2cyclictest10950irq/23-ehci_hcd22:39:551
7097991810,7cyclictest0-21swapper/119:40:211
709799180,16cyclictest135650irq/27-eth023:57:561
709799180,13cyclictest0-21swapper/100:05:501
709699180,9cyclictest32326-21sshd21:40:130
255222180,16sleep1135650irq/27-eth023:52:561
709999171,8cyclictest27052-21sshd22:30:363
709799178,1cyclictest3990-21sshd00:32:321
709799177,3cyclictest135650irq/27-eth023:28:511
709799176,1cyclictest0-21swapper/121:30:151
7097991712,4cyclictest10950irq/23-ehci_hcd21:26:401
7097991712,3cyclictest7584-21sshd22:50:061
7097991712,3cyclictest1959-21sshd22:15:431
7097991712,3cyclictest1959-21sshd22:15:431
709799171,11cyclictest24433-21cat23:40:221
709799170,13cyclictest0-21swapper/121:45:581
709699174,3cyclictest0-21swapper/023:34:460
709699170,2cyclictest14335-21sshd23:27:120
230792170,2sleep023243-21sshd21:39:240
200882171,14sleep3135650irq/27-eth022:23:593
709999164,11cyclictest10950irq/23-ehci_hcd19:22:023
7099991612,3cyclictest10950irq/23-ehci_hcd19:33:373
709799169,5cyclictest1848-21nfsd23:33:061
709799161,6cyclictest1847-21nfsd23:45:581
709699161,12cyclictest1893-21nscd21:10:450
709699160,14cyclictest10466-21bash22:05:080
709699160,11cyclictest8395-21bash00:36:150
33602160,14sleep3135650irq/27-eth023:05:043
709999158,5cyclictest6277-21bash00:39:243
709999154,3cyclictest10950irq/23-ehci_hcd20:16:563
709999150,13cyclictest0-21swapper/320:20:093
709899150,4cyclictest135650irq/27-eth020:45:242
709799157,6cyclictest0-21swapper/119:25:161
709799155,4cyclictest18921-21sshd21:20:571
709799150,5cyclictest26520-21sshd22:24:361
709799150,10cyclictest13846-21sshd22:02:251
709699156,8cyclictest0-21swapper/019:55:170
709699150,14cyclictest0-21swapper/021:05:500
709699150,13cyclictest0-21swapper/020:00:250
709999147,6cyclictest11237-21sshd19:17:333
709999144,10cyclictest10950irq/23-ehci_hcd20:28:533
709999140,3cyclictest135650irq/27-eth020:13:523
709999140,12cyclictest18507-21munin-node19:35:233
709999140,12cyclictest14109-21cpu19:25:143
709899142,4cyclictest135650irq/27-eth020:00:342
709899142,10cyclictest0-21swapper/219:50:162
7098991411,2cyclictest23501-21grep19:45:152
709899141,11cyclictest0-21swapper/219:33:152
709899140,10cyclictest0-21swapper/220:56:272
709799140,5cyclictest0-21swapper/119:35:131
709799140,3cyclictest10950irq/23-ehci_hcd20:46:581
709699147,6cyclictest0-21swapper/019:40:120
709699140,6cyclictest0-21swapper/019:23:550
709699140,12cyclictest0-21swapper/019:50:190
709999137,5cyclictest0-21swapper/321:00:153
709999136,3cyclictest10950irq/23-ehci_hcd19:40:173
709999132,10cyclictest0-21swapper/320:56:513
709999131,10cyclictest0-21swapper/320:07:423
709999130,4cyclictest29337-21chrt19:56:083
709999130,12cyclictest28888-21runrttasks21:05:573
709999130,12cyclictest1848-21nfsd20:46:323
709999130,12cyclictest0-21swapper/320:35:473
709999130,12cyclictest0-21swapper/319:10:493
709999130,11cyclictest30233-21df_inode20:00:163
709999130,11cyclictest26106-21iostat_ios19:50:183
709999130,11cyclictest23822-21iostat19:45:183
709999130,11cyclictest21101-21iostat_ios20:50:183
709999130,11cyclictest16463-21hddtemp_smartct20:40:193
709999130,11cyclictest11554-21diskstats20:30:143
709899139,3cyclictest135650irq/27-eth019:15:442
709899138,4cyclictest9605-21perl20:25:142
709899138,4cyclictest1848-21nfsd19:20:152
709899131,3cyclictest5062-21hddtemp_smartct20:15:182
709899131,11cyclictest1848-21nfsd20:35:242
709899131,11cyclictest1847-21nfsd20:30:042
709899131,11cyclictest144550irq/28-eth1-rx-19:56:482
7098991310,2cyclictest0-21swapper/221:00:132
7098991310,2cyclictest0-21swapper/220:20:202
709899130,12cyclictest0-21swapper/221:05:302
709899130,12cyclictest0-21swapper/220:40:502
709899130,12cyclictest0-21swapper/220:10:062
709899130,12cyclictest0-21swapper/220:05:432
709899130,12cyclictest0-21swapper/219:41:142
709799137,5cyclictest0-21swapper/120:41:341
709799133,10cyclictest10950irq/23-ehci_hcd20:32:461
709799131,11cyclictest26950irq/26-ahci[00020:01:151
709799131,11cyclictest2405-21runrttasks19:16:501
7097991311,1cyclictest0-21swapper/120:25:481
7097991311,1cyclictest0-21swapper/120:14:001
7097991311,1cyclictest0-21swapper/119:30:001
7097991311,1cyclictest0-21swapper/119:21:121
709799130,2cyclictest135650irq/27-eth019:58:111
709799130,12cyclictest0-21swapper/121:07:141
709799130,12cyclictest0-21swapper/120:55:191
709799130,12cyclictest0-21swapper/120:53:501
709799130,12cyclictest0-21swapper/120:20:101
709799130,12cyclictest0-21swapper/119:13:201
709799130,11cyclictest4714-21entropy20:15:161
709799130,11cyclictest135650irq/27-eth019:50:211
709699137,5cyclictest0-21swapper/020:36:410
709699131,1cyclictest25671-21irqstats21:00:170
7096991311,1cyclictest0-21swapper/019:39:590
7096991310,1cyclictest0-21swapper/019:45:330
709699130,5cyclictest0-21swapper/020:40:210
709699130,3cyclictest0-21swapper/020:20:140
709699130,1cyclictest0-21swapper/020:45:310
709699130,12cyclictest0-21swapper/020:17:350
709699130,12cyclictest0-21swapper/020:05:200
709699130,12cyclictest0-21swapper/019:27:250
709899128,3cyclictest7378-21df19:10:112
709899128,3cyclictest15179-21munin-node19:25:212
709899120,10cyclictest18666-21munin-node19:35:142
709799121,0cyclictest0-21swapper/120:07:351
709799120,11cyclictest1848-21nfsd20:35:291
709799120,11cyclictest0-21swapper/119:45:081
709799120,10cyclictest0-21swapper/121:00:131
709699120,4cyclictest21094-21iostat20:50:180
709699120,1cyclictest0-21swapper/020:30:570
709699120,1cyclictest0-21swapper/020:26:110
709699120,11cyclictest0-21swapper/020:55:200
709699120,11cyclictest0-21swapper/019:14:330
709699120,10cyclictest0-21swapper/019:30:240
709699118,2cyclictest0-21swapper/019:15:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional