You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 08:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Sep 18, 2025 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2743521840,4sleep11598299cyclictest23:20:231
986221580,1sleep09859-21bash22:51:040
3151021570,2sleep11598299cyclictest00:04:401
316321550,1sleep31846-21nfsd23:18:093
1089421440,0sleep310852-21sshd00:30:353
1714121370,1sleep30-21swapper/322:18:123
2560121360,3sleep01598199cyclictest21:42:340
1703621320,4sleep11598299cyclictest23:10:131
1872721180,3sleep318726-21bash23:56:323
2462821140,2sleep124630-21id23:26:201
3269721110,1sleep30-21swapper/322:01:253
1873521080,1sleep018731-21bash23:25:430
2587021060,1sleep025873-21bash22:06:510
2762021040,102sleep126950irq/26-ahci[00000:07:421
15412210433,42sleep10-21swapper/119:06:201
2804521000,0sleep01848-21nfsd21:21:180
252542970,1sleep025253-21sshd23:50:480
201952930,2sleep20-21swapper/222:52:062
60952920,2sleep30-21swapper/323:05:583
234342900,2sleep11847-21nfsd21:20:511
155322892,82sleep3135650irq/27-eth019:07:353
49232870,2sleep20-21swapper/222:07:572
157302870,4sleep21598399cyclictest21:32:252
307242860,2sleep130722-21sshd21:40:031
85572850,1sleep20-21swapper/223:24:532
33192850,2sleep13310-21sshd22:10:451
160712850,0sleep00-21swapper/023:37:500
31372840,1sleep33114-21sshd00:22:383
55032820,2sleep10-21swapper/121:25:201
113532800,2sleep30-21swapper/323:28:153
124342790,1sleep30-21swapper/321:44:263
113692790,3sleep20-21swapper/221:29:012
304652780,3sleep20-21swapper/222:37:512
29442770,1sleep10-21swapper/100:37:061
140972760,3sleep01598199cyclictest00:34:410
55982750,2sleep35593-21sshd21:52:553
259282740,2sleep10-21swapper/120:40:201
183802740,2sleep20-21swapper/222:55:032
239902730,1sleep20-21swapper/222:49:302
217312730,20sleep1135650irq/27-eth021:30:011
117772730,3sleep01598199cyclictest23:00:260
241092720,0sleep224099-21sshd00:03:532
192952720,2sleep10-21swapper/122:21:271
185632690,3sleep21598399cyclictest23:10:182
89212680,2sleep38919-21sshd21:59:173
274342680,4sleep21598399cyclictest23:26:372
119052650,1sleep30-21swapper/323:12:483
155692640,0sleep015549-21sshd21:53:520
11942620,2sleep10-21swapper/121:12:451
224352600,2sleep122426-21sshd23:01:271
1565725935,11sleep20-21swapper/219:09:092
1555625932,23sleep00-21swapper/019:07:520
90272470,2sleep20-21swapper/223:55:312
159952440,0sleep215993-21bash00:31:112
104742412,37sleep3135650irq/27-eth021:31:563
215172400,0sleep221515-21id23:41:202
151702330,31sleep3135650irq/27-eth023:22:233
15982993215,3cyclictest22-21ksoftirqd/122:52:341
15982993211,18cyclictest22-21ksoftirqd/100:24:541
168472310,2sleep30-21swapper/322:30:233
15982993111,18cyclictest22-21ksoftirqd/123:19:091
1598299301,19cyclictest22-21ksoftirqd/121:59:421
43662293,24sleep1135650irq/27-eth023:30:301
43662293,24sleep1135650irq/27-eth023:30:301
1598499290,20cyclictest44-21ksoftirqd/322:25:333
1598199290,15cyclictest21430-21bash23:19:560
129222290,27sleep326950irq/26-ahci[00023:40:303
48192280,3sleep20-21swapper/223:51:582
315702280,4sleep20-21swapper/223:05:212
1598299288,18cyclictest22-21ksoftirqd/121:35:201
1598299282,17cyclictest22-21ksoftirqd/122:57:361
1598299278,16cyclictest22-21ksoftirqd/122:06:381
15982992715,5cyclictest18594-21sshd22:15:161
15982992710,6cyclictest1845-21nfsd00:19:531
1598199270,10cyclictest26916-21sshd22:55:440
15984992622,3cyclictest28738-21bash23:48:123
15982992612,3cyclictest0-21swapper/122:40:471
1598299260,24cyclictest22-21ksoftirqd/123:35:541
134522260,1sleep00-21swapper/022:02:420
256382250,20sleep3135650irq/27-eth022:46:313
248412250,4sleep10-21swapper/122:00:391
15984992515,6cyclictest24721-21sshd23:04:483
15982992514,5cyclictest972-21sshd22:25:471
15982992512,4cyclictest19097-21bash22:39:531
1598299250,23cyclictest9558-21sshd23:40:151
1598299250,17cyclictest22-21ksoftirqd/123:55:121
15981992511,5cyclictest3-21ksoftirqd/022:24:290
285752240,3sleep10-21swapper/121:15:171
15982992417,5cyclictest2903-21sshd21:52:401
15982992413,5cyclictest1845-21nfsd23:48:271
15982992411,6cyclictest135650irq/27-eth000:25:551
1598299240,21cyclictest22-21ksoftirqd/123:51:001
1598299240,21cyclictest22-21ksoftirqd/100:10:031
1598199241,12cyclictest0-21swapper/022:14:090
15984992311,7cyclictest10950irq/23-ehci_hcd21:11:513
15982992318,3cyclictest17781-21sshd22:45:431
15982992316,4cyclictest23322-21sshd00:32:021
15982992315,5cyclictest27138-21cp22:31:221
1598299230,17cyclictest22-21ksoftirqd/123:06:531
102512230,3sleep20-21swapper/221:56:192
6532220,20sleep3135650irq/27-eth022:41:063
213902220,1sleep021389-21sshd23:22:590
15984992215,5cyclictest1848-21nfsd21:38:503
15983992216,2cyclictest10950irq/23-ehci_hcd00:24:092
15983992213,5cyclictest1959-21sshd21:11:482
15983992212,8cyclictest19582-21bash22:42:552
15982992210,2cyclictest22-21ksoftirqd/121:46:411
15981992217,3cyclictest3-21ksoftirqd/000:06:440
1598199220,14cyclictest1846-21nfsd00:23:480
1598199220,12cyclictest15076-21sshd21:26:120
95982210,0sleep21848-21nfsd21:53:172
15984992113,5cyclictest3768-21sshd00:15:413
15981992112,3cyclictest0-21swapper/023:43:040
1598199210,20cyclictest0-21swapper/021:12:140
63972200,1sleep20-21swapper/223:15:192
51672200,18sleep3135650irq/27-eth022:14:053
1598499209,5cyclictest10950irq/23-ehci_hcd00:05:383
1598499207,6cyclictest10950irq/23-ehci_hcd00:29:283
1598499206,6cyclictest135650irq/27-eth023:30:303
1598499206,6cyclictest135650irq/27-eth023:30:293
15984992014,3cyclictest28684-21sshd21:21:223
15983992012,4cyclictest1627-21sshd21:43:232
1598199203,3cyclictest21043-21bash22:46:020
1598199203,14cyclictest18076-21sshd21:57:040
15981992016,3cyclictest3-21ksoftirqd/022:44:380
1598199201,3cyclictest25844-21sshd00:11:120
15981992013,1cyclictest14883-21sshd22:39:280
15981992011,7cyclictest3-21ksoftirqd/023:11:060
1598199200,18cyclictest17798-21sshd00:38:540
1598199200,13cyclictest0-21swapper/000:26:300
195432190,6sleep30-21swapper/300:10:313
1598499197,5cyclictest135650irq/27-eth023:52:293
1598499193,8cyclictest12812-21sshd21:29:093
15984991911,5cyclictest3731-21sshd22:56:393
1598499190,16cyclictest135650irq/27-eth021:45:173
1598399197,5cyclictest33-21ksoftirqd/222:15:022
15983991916,2cyclictest1847-21nfsd00:10:282
15983991915,3cyclictest31810-21sshd21:21:412
15983991913,4cyclictest20680-21bash23:01:172
1598199199,3cyclictest3277-21sshd22:26:010
1598199198,4cyclictest0-21swapper/000:15:170
1598199196,3cyclictest0-21swapper/023:55:540
15981991915,2cyclictest3-21ksoftirqd/021:48:010
1598199190,18cyclictest0-21swapper/021:19:130
1598199190,13cyclictest0-21swapper/023:05:400
1598499189,2cyclictest10950irq/23-ehci_hcd22:54:433
1598499187,1cyclictest26066-21sshd00:35:533
1598499183,3cyclictest981-21sshd22:35:073
15984991811,4cyclictest0-21swapper/323:35:353
1598499180,16cyclictest44-21ksoftirqd/322:20:363
15983991816,1cyclictest0-21swapper/219:55:512
15983991815,2cyclictest1846-21nfsd21:15:092
15983991814,3cyclictest29470-21sshd22:34:452
15983991813,3cyclictest22781-21sshd22:27:552
15983991812,2cyclictest10950irq/23-ehci_hcd22:20:512
1598399181,15cyclictest0-21swapper/223:30:142
1598399181,15cyclictest0-21swapper/223:30:142
15983991810,5cyclictest4807-21bash22:14:012
15982991813,3cyclictest4120-21sshd21:10:001
1598199182,12cyclictest20341-21awk19:19:590
1598199180,11cyclictest0-21swapper/000:04:500
318082170,15sleep310950irq/23-ehci_hcd00:04:433
15984991712,3cyclictest1959-21sshd21:15:393
1598399179,6cyclictest2513-21sshd00:26:072
1598399172,11cyclictest135650irq/27-eth020:55:132
1598399171,9cyclictest135650irq/27-eth020:15:172
1598399171,8cyclictest0-21swapper/221:48:222
15983991713,3cyclictest29317-21bash00:36:162
15983991711,4cyclictest16346-21sshd21:38:402
1598399170,15cyclictest0-21swapper/220:35:202
1598199175,9cyclictest0-21swapper/023:48:550
1598199175,2cyclictest20091-21sshd22:30:400
1598199171,2cyclictest135650irq/27-eth021:32:490
1598199170,9cyclictest0-21swapper/021:36:100
1598199170,10cyclictest23697-21sshd23:32:250
1598199170,10cyclictest23697-21sshd23:32:250
234102160,3sleep21847-21nfsd23:47:422
1598499167,5cyclictest0-21swapper/320:40:223
1598499167,4cyclictest10950irq/23-ehci_hcd20:05:203
15984991612,2cyclictest0-21swapper/322:05:243
1598399164,3cyclictest28657-21sshd00:15:032
15983991612,2cyclictest0-21swapper/200:06:002
15983991610,4cyclictest19421-21fschecks_count22:00:142
15984991511,3cyclictest10950irq/23-ehci_hcd20:01:573
1598399153,3cyclictest0-21swapper/223:35:162
1598399150,3cyclictest105832sleep220:07:562
15982991512,2cyclictest10950irq/23-ehci_hcd20:49:511
1598299150,14cyclictest0-21swapper/120:25:161
1598199152,10cyclictest0-21swapper/020:47:560
1598199151,12cyclictest0-21swapper/022:16:100
1598499143,10cyclictest10950irq/23-ehci_hcd19:51:133
15984991410,1cyclictest0-21swapper/320:49:213
1598499140,5cyclictest225212sleep319:24:063
1598499140,13cyclictest10950irq/23-ehci_hcd20:23:523
1598499140,13cyclictest0-21swapper/320:35:133
1598499140,10cyclictest1123-21awk21:00:003
1598399142,11cyclictest135650irq/27-eth019:15:212
1598399141,6cyclictest135650irq/27-eth020:45:152
1598399140,13cyclictest0-21swapper/219:40:392
1598399140,11cyclictest0-21swapper/219:25:192
1598299149,4cyclictest2405-21runrttasks19:33:371
1598299149,3cyclictest0-21swapper/119:50:211
1598299148,5cyclictest1848-21nfsd20:51:321
1598299140,13cyclictest2405-21runrttasks20:00:441
1598299140,13cyclictest0-21swapper/120:36:021
1598299140,12cyclictest22489-21taskset19:23:391
1598199140,7cyclictest0-21swapper/019:45:160
1598199140,7cyclictest0-21swapper/019:45:150
1598199140,1cyclictest0-21swapper/020:43:240
1598199140,13cyclictest0-21swapper/019:50:170
1598499137,4cyclictest16971-21needreboot19:10:183
1598499132,3cyclictest10950irq/23-ehci_hcd20:33:193
15984991311,1cyclictest0-21swapper/321:05:493
15984991311,1cyclictest0-21swapper/321:03:183
1598499130,4cyclictest29860-21cpuspeed_turbos19:40:123
1598499130,3cyclictest363-21memory19:45:173
1598499130,3cyclictest363-21memory19:45:163
1598499130,12cyclictest0-21swapper/320:53:313
1598499130,12cyclictest0-21swapper/320:10:113
1598499130,12cyclictest0-21swapper/319:56:293
1598499130,12cyclictest0-21swapper/319:36:273
1598499130,12cyclictest0-21swapper/319:18:263
1598499130,11cyclictest25711-21uniq19:30:143
1598499130,11cyclictest23156-21diskstats19:25:103
1598499130,11cyclictest18590-21iostat_ios20:25:163
1598399138,4cyclictest8111-21runrttasks20:00:562
1598399138,4cyclictest1848-21nfsd20:50:242
1598399137,5cyclictest0-21swapper/220:30:132
1598399131,1cyclictest0-21swapper/221:06:552
1598399131,11cyclictest135650irq/27-eth020:27:162
1598399131,11cyclictest135650irq/27-eth019:30:382
15983991311,1cyclictest0-21swapper/221:00:482
1598399130,12cyclictest0-21swapper/219:39:302
1598399130,12cyclictest0-21swapper/219:23:242
1598399130,11cyclictest11669-21munin-node20:10:152
1598299137,5cyclictest0-21swapper/120:10:581
1598299132,7cyclictest0-21swapper/120:05:211
1598299131,10cyclictest0-21swapper/119:15:151
15982991310,2cyclictest10950irq/23-ehci_hcd20:21:211
1598299130,5cyclictest0-21swapper/120:55:101
1598299130,2cyclictest135650irq/27-eth019:41:061
1598299130,12cyclictest1915-21snmpd20:15:011
1598299130,12cyclictest1848-21nfsd20:30:411
1598299130,12cyclictest0-21swapper/121:00:141
1598299130,12cyclictest0-21swapper/119:45:441
1598299130,12cyclictest0-21swapper/119:45:431
1598299130,12cyclictest0-21swapper/119:36:261
1598299130,11cyclictest4918-21irqstats19:55:151
1598299130,11cyclictest23588-21iostat_ios19:25:121
1598199138,4cyclictest0-21swapper/020:56:570
1598199137,5cyclictest0-21swapper/021:08:040
15981991311,1cyclictest0-21swapper/020:00:040
1598199130,5cyclictest0-21swapper/020:50:030
1598199130,1cyclictest0-21swapper/019:14:010
1598199130,12cyclictest0-21swapper/021:00:160
1598199130,12cyclictest0-21swapper/020:32:550
1598199130,12cyclictest0-21swapper/020:21:580
1598199130,12cyclictest0-21swapper/020:10:160
1598199130,12cyclictest0-21swapper/019:55:460
1598199130,12cyclictest0-21swapper/019:29:100
1598199130,12cyclictest0-21swapper/019:21:090
1598199130,10cyclictest0-21swapper/020:17:330
1598199130,10cyclictest0-21swapper/019:30:220
1598499120,11cyclictest0-21swapper/320:15:093
1598399127,4cyclictest16324-21munin-node19:10:132
1598399127,3cyclictest2009-21munin-node19:50:132
1598399120,11cyclictest15652-21atenall_r5power20:20:122
1598399120,11cyclictest0-21swapper/220:40:122
1598399120,11cyclictest0-21swapper/219:45:512
1598399120,11cyclictest0-21swapper/219:45:512
1598299125,3cyclictest16660-21perl19:10:131
1598199128,3cyclictest0-21swapper/019:40:030
1598199121,2cyclictest0-21swapper/020:27:580
1598199120,4cyclictest0-21swapper/020:07:140
1598199120,11cyclictest0-21swapper/019:35:240
1598199110,10cyclictest0-21swapper/020:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional