You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-09 - 11:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Wed Jul 09, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2814721830,3sleep22181199cyclictest23:30:502
976121740,2sleep22181199cyclictest22:08:292
77521610,4sleep32181699cyclictest22:57:213
1503821240,3sleep32181699cyclictest00:16:293
420921220,2sleep34206-21sshd23:50:233
3272721210,3sleep332722-21sshd21:55:113
3020321200,2sleep22181199cyclictest23:46:422
129321200,3sleep22181199cyclictest22:57:232
772621190,1sleep30-21swapper/300:12:443
3229321180,1sleep032294-21sshd22:47:510
2611321170,2sleep20-21swapper/221:57:392
1271921170,0sleep112718-21sshd23:35:351
3129421160,2sleep32181699cyclictest21:24:173
493221150,1sleep12405-21runrttasks23:31:461
2454121140,3sleep021796-21cyclictest23:39:580
2343821110,2sleep30-21swapper/323:24:233
1684521050,2sleep30-21swapper/300:33:133
241642980,1sleep10-21swapper/121:35:451
230962970,0sleep223089-21sshd23:55:242
2145929737,39sleep10-21swapper/119:08:411
279882950,1sleep20-21swapper/223:27:512
170412950,1sleep10-21swapper/122:55:421
57082940,2sleep35709-21sshd23:41:103
155452900,1sleep00-21swapper/021:35:040
145082890,1sleep014506-21bash22:40:020
2144128834,49sleep30-21swapper/319:08:263
17752880,5sleep12180799cyclictest00:31:341
46722870,4sleep10-21swapper/123:41:031
317072870,2sleep22181199cyclictest23:22:002
205812860,0sleep00-21swapper/023:42:400
307192850,3sleep30-21swapper/321:18:003
114292850,0sleep211425-21sshd23:41:442
32372840,1sleep041ktimersoftd/023:16:100
26742840,3sleep12180799cyclictest00:02:571
26742840,3sleep12180799cyclictest00:02:561
252182830,2sleep225215-21sshd21:48:132
63422820,3sleep20-21swapper/223:16:272
16962820,4sleep32181699cyclictest21:36:433
156102820,1sleep30-21swapper/322:21:253
287802810,0sleep00-21swapper/022:56:540
151192810,2sleep215113-21sshd22:46:092
235372800,2sleep30-21swapper/323:33:363
17542800,1sleep00-21swapper/000:02:520
17542800,1sleep00-21swapper/000:02:510
326282790,2sleep30-21swapper/300:38:343
11602790,1sleep01158-21sshd23:59:420
298132780,2sleep12180799cyclictest23:00:111
237432770,2sleep30-21swapper/323:46:023
149052770,2sleep10-21swapper/100:13:261
167232750,1sleep30-21swapper/300:23:103
59532740,1sleep00-21swapper/000:32:020
319782740,1sleep10-21swapper/123:46:521
257182730,2sleep02180199cyclictest22:31:440
161242730,1sleep22181199cyclictest22:18:272
271922720,3sleep22181199cyclictest00:08:272
271922720,3sleep22181199cyclictest00:08:262
67632670,2sleep02180199cyclictest23:00:580
2148126034,14sleep00-21swapper/019:08:550
236142590,1sleep30-21swapper/319:11:463
2148325734,9sleep20-21swapper/219:08:582
151732550,3sleep02180199cyclictest22:21:230
144362490,2sleep10-21swapper/122:02:471
2180199481,39cyclictest0-21swapper/022:26:190
16232470,44sleep326950irq/26-ahci[00023:16:013
2180199440,2cyclictest23176-21sshd21:11:000
305982420,1sleep230601-21id22:01:122
2180199411,5cyclictest13687-21bash23:23:250
238382400,38sleep3135650irq/27-eth023:02:423
313032390,3sleep02180199cyclictest00:15:010
2180199391,1cyclictest0-21swapper/000:06:150
2180199391,1cyclictest0-21swapper/000:06:140
2180199391,12cyclictest4862-21sshd23:10:150
2180199388,4cyclictest28973-21sshd23:49:470
2180199380,11cyclictest0-21swapper/000:10:310
102602360,2sleep30-21swapper/321:31:233
21811993531,2cyclictest25223-21sshd23:02:512
2180199351,2cyclictest20061-21sshd00:23:310
2180199351,13cyclictest6701-21sshd23:07:160
2180199350,33cyclictest0-21swapper/021:58:250
2180199341,12cyclictest21486-21sshd23:52:070
2181699330,30cyclictest3228-21sshd23:06:553
2180199330,12cyclictest1848-21nfsd21:47:000
2181199320,13cyclictest0-21swapper/200:23:162
2180199321,3cyclictest4721-21sshd21:27:500
2180199321,2cyclictest12692-21rm22:02:370
248772310,2sleep324876-21sshd21:42:013
2181199310,9cyclictest0-21swapper/221:42:342
139042310,1sleep30-21swapper/322:43:013
21811993010,2cyclictest0-21swapper/200:25:302
150072300,2sleep21848-21nfsd21:53:262
2180199292,12cyclictest19508-21sshd23:33:120
2180199291,1cyclictest0-21swapper/021:44:030
2180199281,25cyclictest0-21swapper/022:05:070
21816992710,6cyclictest135650irq/27-eth022:06:373
21816992710,5cyclictest135650irq/27-eth023:28:553
21807992721,4cyclictest21311-21sshd21:13:591
2180199271,2cyclictest12550-21sshd22:11:490
2180199271,1cyclictest0-21swapper/000:38:340
21801992710,1cyclictest7887-21sshd00:25:310
2181199260,10cyclictest0-21swapper/200:10:542
2180799267,6cyclictest29736-21sshd21:17:541
326732250,1sleep10-21swapper/121:33:371
21816992510,7cyclictest10950irq/23-ehci_hcd22:48:093
21807992513,5cyclictest10950irq/23-ehci_hcd22:23:571
21807992513,3cyclictest10950irq/23-ehci_hcd21:53:131
2180199259,15cyclictest0-21swapper/023:28:240
2180199251,3cyclictest7372-21sshd21:15:390
21801992510,14cyclictest1848-21nfsd21:52:030
2180199250,24cyclictest0-21swapper/021:21:140
321102240,22sleep1135650irq/27-eth023:53:111
29962240,2sleep10-21swapper/100:25:081
2181699248,5cyclictest135650irq/27-eth022:54:343
21816992419,4cyclictest17261-21sshd23:14:313
2180799241,14cyclictest0-21swapper/122:09:381
21807992410,3cyclictest24278-21sshd00:17:251
2180199248,2cyclictest5930-21bash22:17:270
2180199241,7cyclictest0-21swapper/021:31:330
253862231,20sleep3135650irq/27-eth022:00:423
2181199230,12cyclictest0-21swapper/222:12:182
2180799239,3cyclictest21157-21sshd00:20:191
21807992314,3cyclictest135650irq/27-eth022:37:051
2180799231,14cyclictest22-21ksoftirqd/100:06:351
2180799231,14cyclictest22-21ksoftirqd/100:06:351
21807992311,4cyclictest135650irq/27-eth022:16:401
166102230,3sleep316606-21ls21:10:223
291072223,17sleep310950irq/23-ehci_hcd23:37:133
261062220,3sleep10-21swapper/121:23:471
2181699228,6cyclictest0-21swapper/300:06:463
2181699228,6cyclictest0-21swapper/300:06:463
21811992215,4cyclictest31915-21sshd21:30:222
21807992215,6cyclictest3436-21sshd22:51:161
21807992214,6cyclictest1847-21nfsd22:48:521
21807992214,5cyclictest1848-21nfsd22:28:571
21807992213,4cyclictest22861-21sshd23:15:031
21807992210,4cyclictest27355-21sshd21:48:251
18512220,20sleep3135650irq/27-eth022:32:363
107512223,17sleep3135650irq/27-eth022:27:123
52002210,19sleep1135650irq/27-eth021:43:161
275572210,3sleep20-21swapper/222:28:492
2181199218,6cyclictest10950irq/23-ehci_hcd22:30:512
21811992117,3cyclictest19408-21sshd23:51:552
21811992116,3cyclictest31578-21sshd00:38:252
2180799219,6cyclictest135650irq/27-eth023:56:001
2180799213,7cyclictest31863-21sshd23:12:491
21807992110,5cyclictest135650irq/27-eth000:39:361
2180199212,2cyclictest980-21sshd22:38:440
2180199211,9cyclictest0-21swapper/020:20:170
2181699209,4cyclictest10950irq/23-ehci_hcd19:41:453
2181699208,5cyclictest10950irq/23-ehci_hcd21:28:103
21816992012,4cyclictest135650irq/27-eth023:59:243
21816992010,5cyclictest4738-21sshd21:49:223
21811992013,5cyclictest3670-21sshd21:36:552
2180799209,4cyclictest8053-21bash21:25:091
2180799208,5cyclictest10950irq/23-ehci_hcd22:32:461
2181699190,8cyclictest23275-21sshd22:15:583
2181699190,13cyclictest0-21swapper/321:54:123
2181199199,6cyclictest19826-21sshd23:14:462
2181199190,9cyclictest0-21swapper/223:09:592
2180799192,6cyclictest0-21swapper/121:55:121
2180799191,9cyclictest25573-21id23:05:551
2180799191,5cyclictest26784-21sshd22:41:051
21807991912,5cyclictest10950irq/23-ehci_hcd23:20:041
2180199190,13cyclictest0-21swapper/019:35:340
2181699186,5cyclictest10950irq/23-ehci_hcd00:25:383
21816991814,2cyclictest0-21swapper/322:35:203
21816991811,4cyclictest5952-21sshd00:00:103
21816991811,4cyclictest5952-21sshd00:00:093
21816991810,6cyclictest7563-21bash22:14:333
21811991815,2cyclictest1300-21sshd22:54:182
2180799187,2cyclictest2715-21sshd22:10:511
2180799180,3cyclictest15991-21sshd23:26:391
2180199181,15cyclictest0-21swapper/022:52:350
2180199180,12cyclictest0-21swapper/019:18:060
2181199178,6cyclictest28030-21sshd22:35:102
21811991712,4cyclictest29304-21sshd21:14:462
2181199170,15cyclictest0-21swapper/222:41:562
21816991612,3cyclictest10950irq/23-ehci_hcd21:06:223
2181199169,5cyclictest20884-21sshd00:04:452
2181199169,5cyclictest20884-21sshd00:04:452
2181199161,6cyclictest894-21bash22:20:072
21811991612,3cyclictest12061-21cat21:25:252
2181699157,4cyclictest10950irq/23-ehci_hcd20:50:223
21816991511,3cyclictest10950irq/23-ehci_hcd20:57:123
21816991510,0cyclictest0-21swapper/319:34:283
21811991511,3cyclictest1847-21nfsd21:15:342
21811991510,4cyclictest4515-21sshd00:18:392
21811991510,1cyclictest22370-21sshd21:20:192
2181199150,14cyclictest14263-21bash23:38:572
2181199150,14cyclictest0-21swapper/220:40:142
2181199150,13cyclictest0-21swapper/220:55:202
2181199150,13cyclictest0-21swapper/200:30:222
2180799154,10cyclictest10950irq/23-ehci_hcd21:00:331
2180799152,1cyclictest5367-21munin-node19:45:231
21807991511,3cyclictest10950irq/23-ehci_hcd19:55:211
2180199158,3cyclictest0-21swapper/019:46:070
2180199151,13cyclictest0-21swapper/020:57:370
2180199150,14cyclictest0-21swapper/020:10:010
2180199150,14cyclictest0-21swapper/019:30:180
2181699149,4cyclictest144550irq/28-eth1-rx-20:15:013
2181699147,3cyclictest0-21swapper/320:11:323
2181699142,10cyclictest29951-21swap19:25:213
2181699141,11cyclictest144550irq/28-eth1-rx-21:04:183
21816991410,3cyclictest10950irq/23-ehci_hcd20:46:323
21816991410,3cyclictest10950irq/23-ehci_hcd20:00:353
2181699140,13cyclictest0-21swapper/320:35:143
2181699140,13cyclictest0-21swapper/319:55:053
2181199149,4cyclictest0-21swapper/220:18:142
21811991410,3cyclictest0-21swapper/219:58:162
2181199140,6cyclictest0-21swapper/219:53:262
2181199140,13cyclictest0-21swapper/220:26:042
2181199140,13cyclictest0-21swapper/220:26:042
2180799148,5cyclictest1915-21snmpd20:58:481
2180799145,7cyclictest2308-21munin-run20:50:001
2180799143,10cyclictest10950irq/23-ehci_hcd20:07:011
2180799143,10cyclictest10950irq/23-ehci_hcd20:03:321
2180799143,10cyclictest10950irq/23-ehci_hcd19:20:111
21807991410,3cyclictest10950irq/23-ehci_hcd20:29:431
21807991410,3cyclictest10950irq/23-ehci_hcd20:29:431
2180799140,3cyclictest135650irq/27-eth019:40:141
2180799140,13cyclictest2405-21runrttasks20:23:361
2180799140,13cyclictest0-21swapper/120:10:031
2180799140,11cyclictest0-21swapper/119:35:201
2180199148,5cyclictest0-21swapper/020:45:450
2180199141,9cyclictest0-21swapper/020:30:000
2180199141,9cyclictest0-21swapper/020:30:000
21801991412,1cyclictest0-21swapper/020:30:450
2180199141,1cyclictest0-21swapper/021:00:510
2180199141,12cyclictest0-21swapper/020:50:210
2180199141,12cyclictest0-21swapper/019:10:220
2180199140,2cyclictest0-21swapper/020:09:520
2180199140,13cyclictest0-21swapper/020:43:390
2180199140,13cyclictest0-21swapper/019:55:420
2181699133,7cyclictest0-21swapper/320:25:173
2181699133,7cyclictest0-21swapper/320:25:173
2181699132,10cyclictest0-21swapper/320:05:233
21816991311,1cyclictest0-21swapper/319:16:333
2181699130,12cyclictest135650irq/27-eth019:50:143
2181699130,12cyclictest1231-21fschecks_time19:35:143
2181699130,12cyclictest0-21swapper/320:41:463
2181699130,12cyclictest0-21swapper/319:49:353
2181699130,12cyclictest0-21swapper/319:20:253
2181699130,11cyclictest0-21swapper/320:20:213
2181199137,5cyclictest0-21swapper/220:20:062
21811991311,1cyclictest0-21swapper/221:07:112
21811991311,1cyclictest0-21swapper/220:46:192
21811991311,1cyclictest0-21swapper/220:31:012
21811991311,1cyclictest0-21swapper/219:18:342
2181199130,5cyclictest0-21swapper/219:20:362
2181199130,12cyclictest0-21swapper/220:37:322
2181199130,12cyclictest0-21swapper/220:05:242
2181199130,12cyclictest0-21swapper/220:00:302
2181199130,12cyclictest0-21swapper/219:49:022
2181199130,12cyclictest0-21swapper/219:30:322
2181199130,12cyclictest0-21swapper/219:27:322
2180799139,3cyclictest135650irq/27-eth019:50:191
2180799139,3cyclictest10950irq/23-ehci_hcd20:43:481
2180799137,5cyclictest0-21swapper/120:32:021
2180799135,1cyclictest23527-21sshd19:10:451
2180799133,2cyclictest10950irq/23-ehci_hcd20:36:131
2180799132,3cyclictest135650irq/27-eth019:15:461
2180799130,4cyclictest2405-21runrttasks20:53:411
2180799130,12cyclictest0-21swapper/120:15:341
2180799130,12cyclictest0-21swapper/119:31:061
2180799130,12cyclictest0-21swapper/119:25:371
2180199138,4cyclictest0-21swapper/019:50:270
2180199138,1cyclictest0-21swapper/019:25:150
2180199130,12cyclictest0-21swapper/020:35:520
2180199130,12cyclictest0-21swapper/019:40:520
2180199130,12cyclictest0-21swapper/019:21:530
2181699120,11cyclictest26514-21hwlatdetect20:30:173
2181199120,4cyclictest0-21swapper/219:36:082
2181199120,11cyclictest3232-21munin-node20:50:182
2181199120,11cyclictest2405-21runrttasks21:00:432
2181199120,11cyclictest22025-21munin-node19:10:132
2181199120,11cyclictest1848-21nfsd19:42:322
2181199120,11cyclictest0-21swapper/220:11:562
2180799120,3cyclictest0-21swapper/121:05:141
2180199128,3cyclictest0-21swapper/021:05:040
21801991211,1cyclictest0-21swapper/020:16:220
2180199120,11cyclictest0-21swapper/020:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional