You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack5slot0.osadl.org (updated Mon May 05, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2563421790,2sleep125632-21sensors_temp23:40:221
455521340,4sleep20-21swapper/222:05:112
2137621330,4sleep21730899cyclictest00:35:542
2603421280,1sleep026027-21sshd23:12:260
1502721280,3sleep21730899cyclictest22:36:542
1296521270,2sleep312963-21sshd21:10:283
2529321160,2sleep11847-21nfsd00:36:221
2480721140,5sleep30-21swapper/322:59:483
1401921140,0sleep314021-21id22:24:323
1861321100,3sleep10-21swapper/121:11:031
16883210734,44sleep10-21swapper/119:07:421
1680021070,12sleep00-21swapper/022:37:040
2662021050,1sleep20-21swapper/221:15:012
1625921040,2sleep10-21swapper/121:50:511
1627321030,2sleep116268-21sshd21:35:311
1390921030,3sleep11730199cyclictest22:02:571
2032821020,1sleep01729799cyclictest22:46:420
325282990,2sleep132475-21sshd00:00:061
73102980,1sleep01729799cyclictest23:20:050
183172980,2sleep11847-21nfsd00:08:161
102032980,1sleep010201-21sshd22:42:410
102032980,1sleep010201-21sshd22:42:400
53342970,1sleep05318-21sshd22:26:420
1704329734,43sleep30-21swapper/319:09:463
188342950,2sleep118827-21sshd22:55:531
76612930,2sleep11848-21nfsd23:01:091
323782920,9sleep032377-21bash23:34:560
44342910,0sleep3431ktimersoftd/322:08:133
291302910,1sleep31731399cyclictest23:03:203
10982910,5sleep20-21swapper/222:01:422
134592900,2sleep113457-21sshd23:33:051
245952890,2sleep10-21swapper/122:34:481
221812890,2sleep21959-21sshd22:56:132
297622880,2sleep10-21swapper/121:46:021
122322880,2sleep312227-21bash22:18:103
89662870,1sleep08967-21sshd22:17:520
75322870,2sleep17530-21sshd22:05:221
73242870,1sleep30-21swapper/323:51:143
59882870,2sleep25984-21cp21:40:422
255152870,0sleep00-21swapper/000:29:110
183072870,4sleep01729799cyclictest22:24:570
181732870,1sleep00-21swapper/000:35:320
5622850,1sleep00-21swapper/022:32:270
312872850,1sleep20-21swapper/200:33:302
18302850,5sleep21730899cyclictest22:14:092
303992840,0sleep11845-21nfsd22:19:571
254892840,2sleep125487-21sshd21:27:181
139012830,2sleep20-21swapper/221:29:192
314172820,0sleep231414-21sshd00:12:542
305252820,3sleep01729799cyclictest22:13:460
231272820,2sleep323124-21sshd23:12:103
177682820,0sleep017762-21ls23:55:240
58902810,1sleep30-21swapper/322:32:583
55112810,2sleep15509-21sshd00:26:561
300882810,1sleep30-21swapper/323:15:553
219832800,2sleep20-21swapper/223:49:372
16732800,2sleep10-21swapper/122:48:031
297232780,1sleep029721-21sshd00:19:250
305152770,3sleep21730899cyclictest23:37:472
67622760,0sleep00-21swapper/021:19:230
214252760,1sleep11730199cyclictest21:33:021
261142750,2sleep30-21swapper/323:28:063
259872750,4sleep11730199cyclictest21:21:091
231572740,1sleep010-21rcuc/021:20:520
218992730,4sleep31731399cyclictest21:30:053
61982710,1sleep00-21swapper/021:46:530
248242710,0sleep124826-21bash23:18:381
210172700,4sleep11730199cyclictest21:17:321
17352700,1sleep20-21swapper/222:51:042
1685527035,11sleep20-21swapper/219:07:242
178402690,2sleep30-21swapper/320:20:243
90322680,2sleep19027-21bash23:10:441
299752680,1sleep029965-21sshd23:03:250
127872680,1sleep012788-21sshd00:10:550
316502590,1sleep21730899cyclictest19:40:172
1694725934,13sleep00-21swapper/019:08:340
82022550,50sleep126950irq/26-ahci[00022:36:131
172922550,0sleep017294-21sshd21:41:470
163832540,1sleep21730899cyclictest23:33:222
178982530,1sleep017890-21bash22:00:160
222882510,2sleep322286-21sshd21:23:593
1729799471,12cyclictest26771-21bash22:07:140
1729799441,9cyclictest0-21swapper/023:05:150
17301994215,23cyclictest22-21ksoftirqd/122:14:261
17308994131,3cyclictest10226-21sshd22:24:102
259942400,37sleep2135650irq/27-eth023:15:312
1729799401,7cyclictest607-21sshd00:30:030
17297993913,3cyclictest21014-21id23:52:380
17301993712,9cyclictest3045-21sshd21:40:271
17297993733,3cyclictest0-21swapper/023:28:060
1729799372,2cyclictest14627-21sshd23:42:300
17301993627,5cyclictest12269-21sshd21:59:461
17297993611,3cyclictest0-21swapper/021:30:270
17301993513,19cyclictest22-21ksoftirqd/122:27:481
1729799350,3cyclictest25329-21sshd21:14:530
1729799350,31cyclictest0-21swapper/000:02:430
1729799350,14cyclictest28574-21sshd21:27:360
1729799350,12cyclictest0-21swapper/023:15:120
17301993425,6cyclictest1847-21nfsd00:15:151
17301993424,6cyclictest18367-21bash23:05:211
17301993412,20cyclictest22-21ksoftirqd/123:49:431
1729799341,12cyclictest30511-21id00:09:340
1729799341,11cyclictest0-21swapper/023:36:380
163902340,2sleep11848-21nfsd23:20:501
1730199339,10cyclictest27541-21sshd23:28:141
17301993313,17cyclictest22-21ksoftirqd/122:43:231
17301993313,17cyclictest22-21ksoftirqd/122:43:231
17297993311,3cyclictest19071-21bash22:59:120
17313993214,6cyclictest10950irq/23-ehci_hcd20:15:223
17308993228,3cyclictest17903-21sshd23:27:152
17301993223,4cyclictest3465-21sshd00:30:181
17301993213,18cyclictest22-21ksoftirqd/123:57:501
17301993212,17cyclictest22-21ksoftirqd/122:23:131
1729799321,17cyclictest0-21swapper/021:51:480
17313993127,2cyclictest1847-21nfsd23:46:183
1730199318,20cyclictest22-21ksoftirqd/100:12:191
17301993122,6cyclictest11932-21sshd00:24:191
17301993114,16cyclictest22-21ksoftirqd/122:50:241
1729799312,11cyclictest16180-21bash21:38:420
1729799300,11cyclictest0-21swapper/000:22:470
319922290,1sleep00-21swapper/019:40:180
17301992922,3cyclictest1847-21nfsd23:53:281
17301992920,4cyclictest1848-21nfsd23:36:091
1729799291,4cyclictest16858-21df_abs20:20:170
1730899287,3cyclictest0-21swapper/223:02:102
17308992811,3cyclictest0-21swapper/200:23:352
1729799282,23cyclictest0-21swapper/022:50:300
1729799281,14cyclictest28340-21bash21:55:100
1730899278,3cyclictest20183-21sshd23:21:122
1730899270,4cyclictest4516-21sshd21:19:102
120382270,22sleep2135650irq/27-eth022:18:112
313362260,2sleep331317-21sshd21:27:523
17313992610,14cyclictest417-21jbd2/dm-0-800:08:433
17308992614,9cyclictest135650irq/27-eth023:13:492
17308992612,3cyclictest11764-21sshd21:53:342
17308992611,3cyclictest18050-21sshd23:42:512
42652250,2sleep24266-21sshd21:55:482
17313992516,2cyclictest10950irq/23-ehci_hcd23:42:333
144552250,1sleep21848-21nfsd23:05:042
105332250,2sleep20-21swapper/222:33:252
324132240,22sleep326950irq/26-ahci[00021:18:423
286942240,22sleep326950irq/26-ahci[00021:49:053
233702240,2sleep20-21swapper/222:47:012
17313992421,2cyclictest0-21swapper/323:05:313
17313992416,5cyclictest1848-21nfsd22:01:203
17313992415,7cyclictest135650irq/27-eth023:35:293
17313992413,7cyclictest5222-21sshd00:20:133
17313992413,10cyclictest23470-21sshd00:25:233
17313992410,5cyclictest10950irq/23-ehci_hcd23:57:203
1731399240,18cyclictest44-21ksoftirqd/322:12:563
17308992416,3cyclictest24030-21sshd21:39:282
17308992411,3cyclictest28716-21cp22:41:182
17308992411,3cyclictest28716-21cp22:41:182
17301992410,9cyclictest1656-21needreboot19:45:201
125012240,2sleep30-21swapper/322:36:393
17313992321,1cyclictest0-21swapper/322:50:103
17313992318,3cyclictest1959-21sshd23:21:103
17313992314,4cyclictest1846-21nfsd23:34:103
17313992313,7cyclictest12603-21sshd00:38:403
17308992318,3cyclictest3194-21sshd21:31:162
1730899231,5cyclictest2513-21sshd21:22:022
17308992310,3cyclictest25979-21sshd22:25:312
17301992316,4cyclictest0-21swapper/119:50:191
17313992217,4cyclictest25495-21sshd21:39:363
17313992215,4cyclictest30395-21id00:16:033
17313992215,4cyclictest0-21swapper/300:02:263
17313992213,5cyclictest13680-21sshd21:41:263
1731399220,20cyclictest44-21ksoftirqd/322:45:263
1730899222,7cyclictest1846-21nfsd00:25:102
17308992215,4cyclictest1959-21sshd23:51:592
17308992214,5cyclictest2405-21runrttasks23:58:362
17308992212,1cyclictest135650irq/27-eth000:00:152
17308992211,4cyclictest0-21swapper/200:17:372
17301992216,3cyclictest0-21swapper/119:45:001
1730199221,17cyclictest14647-21fschecks_count20:15:191
17297992210,7cyclictest0-21swapper/023:48:590
133222220,2sleep31848-21nfsd00:31:233
234822210,2sleep323485-21bash22:44:003
234822210,2sleep323485-21bash22:43:593
17313992118,2cyclictest135650irq/27-eth000:12:053
17313992116,3cyclictest6696-21sshd21:10:013
17313992116,1cyclictest1848-21nfsd21:53:323
17313992113,5cyclictest1579-21sshd21:58:443
1731399206,6cyclictest10950irq/23-ehci_hcd19:41:193
1731399200,6cyclictest135650irq/27-eth022:25:233
17308992016,3cyclictest6772-21bash21:10:012
17308992015,3cyclictest32612-21sshd21:46:192
17308992011,7cyclictest0-21swapper/220:15:242
1730899200,5cyclictest8012-21sshd00:07:092
17301992015,3cyclictest18584-21dump-pmu-power20:25:001
17301992010,5cyclictest6706-21sshd21:10:001
1730199199,5cyclictest6718-21timerwakeupswit19:55:231
1730199195,10cyclictest9038-21unixbench-2d20:00:241
17301991913,4cyclictest14077-21sleep20:15:001
17301991910,5cyclictest26569-21cut19:30:131
17308991810,5cyclictest135650irq/27-eth020:50:192
1729799181,15cyclictest0-21swapper/019:45:180
1730199174,9cyclictest32255-21latency_hist20:55:011
17301991712,4cyclictest22-21ksoftirqd/119:39:591
17301991710,3cyclictest2137-21latency_hist21:00:011
1729799177,9cyclictest0-21swapper/020:35:220
1729799170,13cyclictest0-21swapper/019:15:150
17313991610,3cyclictest0-21swapper/320:50:203
1730899160,6cyclictest0-21swapper/220:40:172
1730199169,4cyclictest0-21swapper/120:05:251
1729799160,14cyclictest15481-21pmu-power20:15:240
1729799160,12cyclictest0-21swapper/019:10:230
1731399151,11cyclictest135650irq/27-eth020:39:103
17313991510,3cyclictest26566-21grep19:30:143
1730899157,3cyclictest0-21swapper/219:25:252
17308991510,3cyclictest26567-21tr19:30:142
1730199159,4cyclictest19486-21latency_hist19:15:011
1730199158,5cyclictest1848-21nfsd19:15:151
1730199157,6cyclictest18981-21cpuspeed_turbos20:25:151
1730199150,13cyclictest0-21swapper/120:31:271
1729799150,1cyclictest0-21swapper/020:50:130
1729799150,14cyclictest0-21swapper/021:07:410
1729799150,14cyclictest0-21swapper/019:35:210
1731399145,3cyclictest10950irq/23-ehci_hcd21:00:203
1731399143,10cyclictest10950irq/23-ehci_hcd20:00:063
17313991410,3cyclictest0-21swapper/320:09:493
1731399140,3cyclictest0-21swapper/320:25:173
1731399140,13cyclictest1847-21nfsd20:31:563
1731399140,13cyclictest0-21swapper/319:46:083
1731399140,12cyclictest7203-21taskset19:59:023
1731399140,12cyclictest0-21swapper/319:35:213
1730899149,1cyclictest0-21swapper/220:48:152
1730899146,3cyclictest0-21swapper/221:01:442
1730899140,6cyclictest1846-21nfsd20:00:162
1730899140,12cyclictest0-21swapper/219:55:232
1730199148,2cyclictest21873-21aten_r5power_fr19:20:151
1730199145,6cyclictest3688-21timerwakeupswit21:00:261
1730199145,1cyclictest0-21swapper/120:47:341
1730199141,11cyclictest0-21swapper/120:40:221
1729799146,7cyclictest0-21swapper/020:33:260
1729799146,5cyclictest0-21swapper/019:26:090
1729799141,11cyclictest0-21swapper/019:50:130
1731399137,5cyclictest0-21swapper/320:13:013
1731399136,3cyclictest135650irq/27-eth019:50:143
17313991311,1cyclictest0-21swapper/319:15:073
1731399130,12cyclictest0-21swapper/320:56:333
1731399130,12cyclictest0-21swapper/319:29:433
1731399130,12cyclictest0-21swapper/319:22:183
1731399130,11cyclictest27366-21taskset20:42:073
1730899135,6cyclictest0-21swapper/220:56:122
1730899135,4cyclictest10950irq/23-ehci_hcd19:38:312
1730899132,9cyclictest1131-21jbd2/dm-2-820:20:232
1730899131,4cyclictest10950irq/23-ehci_hcd19:25:002
1730899131,3cyclictest0-21swapper/220:25:372
17308991311,1cyclictest0-21swapper/220:08:032
1730899130,4cyclictest0-21swapper/219:15:172
1730899130,3cyclictest0-21swapper/220:30:252
1730899130,12cyclictest0-21swapper/220:37:472
1730899130,11cyclictest4230-21wc19:50:192
1730199137,4cyclictest24157-21munin-node20:35:171
1730199133,0cyclictest0-21swapper/119:25:231
1729799137,5cyclictest0-21swapper/020:25:120
1729799137,5cyclictest0-21swapper/019:59:400
1729799136,6cyclictest0-21swapper/020:10:140
17297991311,1cyclictest0-21swapper/020:45:410
1729799130,1cyclictest0-21swapper/021:00:060
1729799130,12cyclictest26367-21munin-node20:40:180
1729799130,12cyclictest0-21swapper/020:55:070
1729799130,10cyclictest0-21swapper/019:21:310
17313991210,1cyclictest0-21swapper/319:10:173
1731399120,3cyclictest28716-21memory20:45:183
1730899120,3cyclictest17608-21df19:10:142
1730899120,3cyclictest0-21swapper/220:10:162
1730899120,1cyclictest1848-21nfsd19:45:402
17297991210,1cyclictest0-21swapper/020:05:190
1729799120,10cyclictest0-21swapper/019:30:180
1729799110,3cyclictest0-21swapper/020:00:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional