You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 02:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Nov 18, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2985721550,0sleep129814-21sshd21:21:171
1126521460,4sleep11688499cyclictest21:28:401
2336421440,2sleep21688599cyclictest00:22:152
3268021340,2sleep10-21swapper/100:23:151
2560521290,1sleep125590-21sshd21:14:571
523121270,1sleep10-21swapper/100:33:331
1392921150,1sleep013922-21diskstats22:20:130
1804621070,5sleep11688499cyclictest23:28:151
665821040,1sleep30-21swapper/300:17:193
293412940,2sleep229340-21sshd22:21:352
293592930,2sleep21688599cyclictest22:45:552
88642920,2sleep31847-21nfsd00:14:183
195972920,2sleep20-21swapper/222:39:032
126262920,2sleep212612-21sshd00:27:452
314442910,2sleep30-21swapper/322:37:033
171632910,2sleep01688399cyclictest22:38:480
299562890,3sleep10-21swapper/121:39:261
299562890,3sleep10-21swapper/121:39:251
1636528927,40sleep10-21swapper/119:07:001
314122880,2sleep331399-21sshd22:34:033
20602880,3sleep31893-21nscd22:49:343
77722860,2sleep20-21swapper/221:10:042
251402860,1sleep00-21swapper/023:53:320
166622860,4sleep11688499cyclictest22:38:461
111202860,2sleep311119-21sshd23:58:243
262342850,4sleep31688699cyclictest23:47:253
223682850,0sleep00-21swapper/021:35:360
223682850,0sleep00-21swapper/021:35:360
1642528533,43sleep30-21swapper/319:07:433
272542840,0sleep00-21swapper/023:44:300
47912830,2sleep30-21swapper/321:43:043
47912830,2sleep30-21swapper/321:43:033
238262830,2sleep32405-21runrttasks22:02:553
145342830,5sleep10-21swapper/123:49:271
48812820,0sleep00-21swapper/000:10:270
255702820,2sleep225568-21bash23:56:382
105152820,1sleep20-21swapper/223:05:522
143972810,2sleep12405-21runrttasks22:26:151
19482800,3sleep31688699cyclictest21:45:453
64702790,2sleep10-21swapper/121:43:141
64702790,2sleep10-21swapper/121:43:141
28412790,1sleep02839-21bash21:15:440
36742780,1sleep03672-21bash00:17:000
291502760,1sleep30-21swapper/321:24:213
233722760,1sleep20-21swapper/222:42:232
249712750,2sleep324966-21sshd22:51:423
296232740,4sleep01688399cyclictest22:03:280
141462740,3sleep31688699cyclictest21:55:553
27102730,2sleep30-21swapper/321:15:433
207522720,1sleep01688399cyclictest23:22:210
207522720,1sleep01688399cyclictest23:22:210
301942710,0sleep330195-21sshd00:03:213
23672710,1sleep02366-21bash23:57:320
190982680,1sleep30-21swapper/300:08:423
1658926828,11sleep20-21swapper/219:09:332
289062620,3sleep328903-21sshd23:41:283
206192620,1sleep30-21swapper/300:38:243
1649725532,11sleep00-21swapper/019:08:240
101102520,1sleep30-21swapper/300:20:523
267992490,0sleep026795-21bash23:10:310
143202480,2sleep214311-21sshd00:34:302
291452470,0sleep129144-21bash22:21:341
183262380,3sleep01688399cyclictest21:53:230
7912350,2sleep10-21swapper/123:23:351
7912350,2sleep10-21swapper/123:23:351
233142350,2sleep123266-21sshd23:50:161
1688599340,17cyclictest10612-21sshd00:17:442
37212330,1sleep00-21swapper/000:20:170
1688599330,16cyclictest4339-21sshd22:01:022
1688599320,27cyclictest1847-21nfsd00:06:092
40062310,2sleep24001-21bash21:52:012
1688599311,25cyclictest1848-21nfsd22:11:582
1688599310,20cyclictest28290-21bash23:50:382
111792310,3sleep10-21swapper/121:31:361
18202300,4sleep31688699cyclictest23:23:413
18202300,4sleep31688699cyclictest23:23:413
1688599301,24cyclictest23271-21sshd22:05:492
1688599300,27cyclictest7343-21sshd00:10:432
1688599300,24cyclictest1959-21sshd23:14:062
1688599291,25cyclictest13452-21bash23:21:382
1688599291,25cyclictest13452-21bash23:21:382
1688599291,23cyclictest30486-21sshd23:47:512
44342280,2sleep21848-21nfsd22:16:142
294122280,2sleep229399-21sshd23:01:272
1688599281,24cyclictest1848-21nfsd00:02:122
1688599281,22cyclictest1848-21nfsd23:26:342
1688599280,25cyclictest1848-21nfsd22:26:482
1688599280,24cyclictest2036-21sshd00:36:262
1688599280,16cyclictest1847-21nfsd23:31:392
300612270,1sleep10-21swapper/121:48:271
1688599270,24cyclictest1845-21nfsd23:39:042
136312270,25sleep326950irq/26-ahci[00022:29:193
1688599268,7cyclictest1847-21nfsd22:52:522
1688599261,22cyclictest1847-21nfsd23:40:402
1688599261,21cyclictest11897-21sshd23:15:212
1688599260,22cyclictest31742-21sshd22:30:532
1688599260,21cyclictest135650irq/27-eth022:57:242
1688399260,10cyclictest1848-21nfsd23:19:250
4762250,0sleep00-21swapper/022:34:120
297142250,1sleep10-21swapper/123:07:471
292362250,2sleep329238-21bash23:13:593
1688599250,10cyclictest135650irq/27-eth021:27:292
1688399250,15cyclictest12724-21sshd22:07:580
237482240,1sleep01847-21nfsd00:32:070
38202230,2sleep13821-21sshd21:51:591
225342230,2sleep222536-21unixbench-2d20:30:232
16886992314,6cyclictest25330-21sshd23:25:483
1688599236,6cyclictest21249-21sshd21:41:322
1688599236,6cyclictest21249-21sshd21:41:322
1688599233,9cyclictest31414-21sshd21:39:342
1688599233,9cyclictest31414-21sshd21:39:332
1688599231,10cyclictest4548-21sshd21:45:592
1688599230,9cyclictest7305-21sshd21:34:182
1688599230,14cyclictest3710-21sshd21:55:032
1688599230,11cyclictest14046-21sshd21:19:562
1688499231,13cyclictest0-21swapper/100:36:441
1688399230,5cyclictest0-21swapper/023:45:470
1688399230,2cyclictest1847-21nfsd00:36:330
1688399230,12cyclictest0-21swapper/023:25:060
82082220,2sleep38194-21sshd21:25:203
81732220,2sleep30-21swapper/323:05:373
1688599221,12cyclictest30185-21sshd21:24:272
1688499229,6cyclictest135650irq/27-eth022:02:451
1688399227,3cyclictest7972-21sshd22:19:410
1688399220,8cyclictest0-21swapper/022:40:200
1688399220,10cyclictest23275-21sshd21:32:460
265172212,17sleep1135650irq/27-eth023:41:151
1688599210,19cyclictest18074-21pmu-power19:10:212
1688499219,1cyclictest0-21swapper/122:48:351
1688399211,3cyclictest7382-21sshd00:27:120
1688399210,20cyclictest0-21swapper/022:12:590
1688399210,10cyclictest6137-21sshd22:25:270
1688399210,10cyclictest0-21swapper/023:05:190
258412200,2sleep125836-21sshd23:38:091
1688699209,2cyclictest19239-21sshd23:16:003
16886992012,5cyclictest17600-21sshd00:28:163
16886992011,6cyclictest15366-21munin-node22:05:263
1688599200,18cyclictest2323-21munin-node21:00:162
1688599200,11cyclictest9618-21munin-node20:05:222
1688499208,3cyclictest135650irq/27-eth000:15:551
1688499203,5cyclictest1073-21sshd23:14:231
16884992014,4cyclictest24898-21sshd00:12:371
1688499200,15cyclictest18528-21sshd22:32:451
1688399200,17cyclictest22828-21sshd22:45:220
1688399200,11cyclictest12192-21rm22:53:400
1688399200,10cyclictest0-21swapper/022:56:440
1688699199,3cyclictest11009-21sshd22:22:573
1688699197,3cyclictest4911-21sshd00:30:143
16886991910,6cyclictest29607-21sshd22:15:323
1688599196,11cyclictest0-21swapper/220:50:172
1688599190,9cyclictest144550irq/28-eth1-rx-20:35:162
1688599190,18cyclictest1848-21nfsd21:05:092
1688599190,18cyclictest135650irq/27-eth020:21:322
1688599190,17cyclictest29881-21runrttasks20:49:452
1688599190,16cyclictest135650irq/27-eth020:19:162
1688499195,6cyclictest135650irq/27-eth000:25:021
16884991914,3cyclictest19395-21id22:17:411
16884991912,4cyclictest0-21swapper/122:12:341
16884991910,3cyclictest11551-21bash23:18:261
1688499190,7cyclictest30698-21sshd23:32:311
1688399190,13cyclictest1846-21nfsd23:31:480
1688399190,13cyclictest14764-21sshd00:08:140
1688399190,13cyclictest0-21swapper/019:50:170
1688399190,12cyclictest369-21cp00:00:240
47462180,16sleep1135650irq/27-eth022:07:121
1688699186,4cyclictest18330-21sshd23:52:513
1688699181,11cyclictest32078-21sshd23:04:553
1688699180,7cyclictest9242-21sshd22:10:363
1688699180,6cyclictest1847-21nfsd23:31:073
1688599180,9cyclictest3253-21fschecks_time19:50:162
1688599180,9cyclictest2405-21runrttasks19:32:122
1688599180,9cyclictest2405-21runrttasks19:15:222
1688599180,17cyclictest1848-21nfsd19:20:002
1688599180,16cyclictest32130-21munin-node19:40:252
1688599180,11cyclictest25936-21fschecks_count20:40:152
1688499188,2cyclictest135650irq/27-eth023:56:291
1688499183,14cyclictest135650irq/27-eth000:03:111
1688499181,14cyclictest16648-21sshd22:57:101
16884991810,2cyclictest135650irq/27-eth021:55:271
1688499180,13cyclictest0-21swapper/121:18:041
1688399189,3cyclictest0-21swapper/019:20:180
1688399188,9cyclictest0-21swapper/021:55:080
1688399183,1cyclictest0-21swapper/021:10:430
1688399181,16cyclictest0-21swapper/020:50:150
1688399180,2cyclictest0-21swapper/023:39:440
1688399180,17cyclictest0-21swapper/021:48:290
1688399180,12cyclictest0-21swapper/021:20:540
1688699172,4cyclictest10950irq/23-ehci_hcd19:10:183
1688699170,7cyclictest0-21swapper/323:37:433
1688599170,8cyclictest135650irq/27-eth019:45:242
1688599170,8cyclictest135650irq/27-eth019:45:232
1688599170,8cyclictest0-21swapper/220:56:312
1688599170,15cyclictest2405-21runrttasks19:36:182
1688499177,4cyclictest135650irq/27-eth023:00:011
1688499172,2cyclictest28909-21bash00:06:181
1688499170,12cyclictest25883-21id22:42:381
1688399178,3cyclictest0-21swapper/023:00:120
1688399170,13cyclictest0-21swapper/020:00:230
1688699167,4cyclictest29658-21sshd21:12:063
1688699165,3cyclictest10950irq/23-ehci_hcd22:57:093
1688699164,10cyclictest27669-21sshd22:42:483
16886991612,3cyclictest0-21swapper/321:32:333
16886991611,4cyclictest19295-21sshd21:53:293
1688699160,11cyclictest17870-21bash21:38:163
1688699160,11cyclictest17870-21bash21:38:163
1688599166,8cyclictest12002-21grep20:10:142
1688599160,8cyclictest24605-21grep19:25:172
1688599160,14cyclictest9398-21munin-run20:05:002
1688499160,5cyclictest3891-21sshd22:52:501
1688399167,4cyclictest0-21swapper/020:48:580
16883991612,1cyclictest9744-21sshd21:25:260
1688399160,3cyclictest0-21swapper/020:05:210
1688699154,10cyclictest10950irq/23-ehci_hcd21:02:263
1688699150,13cyclictest0-21swapper/320:38:353
1688699150,11cyclictest135650irq/27-eth020:15:143
1688599157,7cyclictest1848-21nfsd19:55:392
1688599151,10cyclictest135650irq/27-eth020:25:212
1688499151,2cyclictest26260-21smartctl20:40:151
1688399150,9cyclictest0-21swapper/020:35:200
1688399150,7cyclictest0-21swapper/021:43:570
1688399150,7cyclictest0-21swapper/021:43:560
1688399150,1cyclictest0-21swapper/020:25:140
1688399150,12cyclictest0-21swapper/019:13:060
1688699144,9cyclictest0-21swapper/319:24:383
1688699143,10cyclictest10950irq/23-ehci_hcd20:40:393
1688699140,2cyclictest0-21swapper/319:45:163
1688699140,2cyclictest0-21swapper/319:45:163
1688699140,13cyclictest0-21swapper/320:23:333
1688499141,12cyclictest144550irq/28-eth1-rx-20:45:131
16884991410,2cyclictest0-21swapper/120:55:231
1688499140,12cyclictest28299-21munin-node19:35:141
1688399140,8cyclictest0-21swapper/020:15:590
16886991311,1cyclictest0-21swapper/321:06:243
1688699130,12cyclictest1848-21nfsd20:51:253
1688699130,12cyclictest1848-21nfsd20:25:523
1688699130,12cyclictest135650irq/27-eth020:10:183
1688699130,12cyclictest0-21swapper/320:55:133
1688699130,12cyclictest0-21swapper/320:31:203
1688699130,12cyclictest0-21swapper/320:07:593
1688699130,12cyclictest0-21swapper/320:02:513
1688699130,12cyclictest0-21swapper/319:50:023
1688499139,3cyclictest135650irq/27-eth019:15:011
1688499139,3cyclictest10950irq/23-ehci_hcd21:05:271
1688499137,5cyclictest0-21swapper/119:12:311
1688499137,4cyclictest14170-21munin-node20:15:221
1688499132,1cyclictest0-21swapper/121:01:321
1688499132,10cyclictest135650irq/27-eth020:35:031
1688499132,10cyclictest10950irq/23-ehci_hcd19:20:021
16884991311,1cyclictest0-21swapper/120:14:031
1688499130,4cyclictest5825-21irqstats19:55:201
1688499130,4cyclictest24296-21fschecks_time19:25:151
1688499130,12cyclictest0-21swapper/120:50:081
1688499130,12cyclictest0-21swapper/120:30:581
1688499130,12cyclictest0-21swapper/120:25:491
1688499130,12cyclictest0-21swapper/120:20:101
1688499130,12cyclictest0-21swapper/119:40:221
1688499130,12cyclictest0-21swapper/119:30:131
1688499130,11cyclictest7337-21munin-node20:00:121
1688399137,5cyclictest0-21swapper/019:56:230
1688399137,5cyclictest0-21swapper/019:27:510
16883991311,1cyclictest0-21swapper/019:41:220
1688399130,1cyclictest0-21swapper/020:44:090
1688399130,12cyclictest0-21swapper/021:08:550
1688399130,12cyclictest0-21swapper/021:00:380
1688399130,12cyclictest0-21swapper/020:22:500
1688399130,12cyclictest0-21swapper/019:30:100
1688699127,4cyclictest30587-21munin-node19:40:163
1688699122,10cyclictest135650irq/27-eth019:27:153
1688699120,4cyclictest0-21swapper/319:55:023
1688699120,11cyclictest0-21swapper/320:45:013
1688699120,11cyclictest0-21swapper/319:37:443
1688499122,9cyclictest0-21swapper/119:50:101
1688499120,3cyclictest1078-21hddtemp_smartct19:45:181
1688499120,3cyclictest1078-21hddtemp_smartct19:45:171
1688499120,3cyclictest0-21swapper/120:05:131
1688399127,4cyclictest29063-21iostat_ios19:35:160
1688399122,9cyclictest0-21swapper/020:56:560
1688399120,1cyclictest0-21swapper/020:30:340
1688399120,11cyclictest0-21swapper/019:47:060
1688399120,11cyclictest0-21swapper/019:47:060
1688399120,11cyclictest0-21swapper/019:16:230
1688699110,3cyclictest0-21swapper/319:15:123
1688699110,10cyclictest135650irq/27-eth019:30:013
1688399117,3cyclictest0-21swapper/020:10:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional