You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 05:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Thu Dec 04, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1142121440,2sleep30-21swapper/321:52:133
495721330,5sleep32438299cyclictest22:25:043
1845921310,5sleep32438299cyclictest23:18:313
1056121280,0sleep00-21swapper/022:34:470
2388321270,2sleep3417-21jbd2/dm-0-823:40:243
2182521230,3sleep22437799cyclictest21:41:022
1833321200,1sleep00-21swapper/022:41:280
2737521160,4sleep20-21swapper/223:43:552
1550521160,1sleep20-21swapper/220:00:152
2956521100,3sleep21846-21nfsd00:28:522
2542621030,2sleep10-21swapper/123:13:041
2542621030,2sleep10-21swapper/123:13:041
1532521020,1sleep015322-21sshd23:33:310
219782980,1sleep00-21swapper/023:59:000
39642970,0sleep00-21swapper/023:07:580
126142970,1sleep012606-21sshd23:24:050
100512940,1sleep310038-21sshd22:43:473
95772930,3sleep22437799cyclictest22:59:132
171692930,3sleep02436699cyclictest21:28:320
61682920,4sleep12437299cyclictest23:41:501
257792900,2sleep10-21swapper/121:41:241
184222900,2sleep018408-21sshd22:50:340
307792880,2sleep130776-21sshd22:21:211
263382880,2sleep126333-21bash23:03:541
169082880,2sleep20-21swapper/221:46:392
91382870,2sleep19142-21id21:12:301
163562870,3sleep016354-21bash23:52:100
92742860,1sleep20-21swapper/222:16:162
47732860,2sleep24772-21sshd22:12:522
277412850,2sleep10-21swapper/122:39:251
6742840,2sleep2672-21sshd22:36:492
269522820,2sleep12405-21runrttasks19:15:121
2405228233,44sleep10-21swapper/119:08:491
2399528232,45sleep30-21swapper/319:08:073
281032810,2sleep328100-21bash23:56:233
122292810,4sleep12437299cyclictest22:25:371
257152800,2sleep125714-21sshd22:33:041
83832790,2sleep38381-21bash00:30:023
21612790,4sleep12437299cyclictest21:27:061
164002780,3sleep22437799cyclictest00:17:422
14702770,3sleep02436699cyclictest21:30:100
314492760,6sleep02436699cyclictest22:58:120
309142760,4sleep12437299cyclictest23:59:541
177062750,2sleep317702-21sshd21:19:313
250132730,3sleep32438299cyclictest00:08:453
42962720,2sleep30-21swapper/322:58:433
147462720,1sleep014732-21sshd21:58:390
100092710,3sleep02436699cyclictest21:21:430
292512700,2sleep129248-21sshd23:47:111
2399426633,12sleep20-21swapper/219:08:052
204742630,0sleep00-21swapper/021:16:380
2393825633,11sleep00-21swapper/019:07:240
254232540,1sleep10-21swapper/122:14:521
24366994921,23cyclictest27062-21sshd23:46:580
24366994818,26cyclictest4956-21sshd22:06:480
24366994721,23cyclictest1367-21sshd00:12:530
24366994617,25cyclictest20316-21sshd22:02:100
24366994521,21cyclictest1847-21nfsd22:18:590
24366994518,23cyclictest24586-21sshd22:26:510
24366994517,4cyclictest24907-21sshd00:28:240
24366994419,22cyclictest10954-21sshd21:52:100
24366994415,25cyclictest17237-21cp00:20:590
24366994330,11cyclictest1847-21nfsd22:46:430
24366994318,22cyclictest0-21swapper/023:18:360
24366994317,23cyclictest19945-21sshd23:43:110
6212410,38sleep126950irq/26-ahci[00022:42:551
24366994123,11cyclictest1959-21sshd22:35:470
24366994120,11cyclictest2081-21bash23:04:420
24366994118,18cyclictest135650irq/27-eth021:36:450
24366994118,18cyclictest135650irq/27-eth021:36:450
187122400,2sleep10-21swapper/122:47:391
2438299390,11cyclictest0-21swapper/321:14:533
24366993921,4cyclictest0-21swapper/000:07:240
24366993915,21cyclictest31640-21sshd00:03:020
104532390,0sleep00-21swapper/021:49:100
24366993814,4cyclictest135650irq/27-eth000:17:290
24366993724,8cyclictest14740-21sshd22:13:500
24366993721,8cyclictest1846-21nfsd22:21:150
24366993711,23cyclictest1848-21nfsd23:35:020
24366993627,6cyclictest17240-21sshd21:40:360
24366993620,6cyclictest2362-21sshd00:36:000
24366993522,9cyclictest24228-21sshd23:25:120
24366993522,10cyclictest23938-21bash23:12:560
24366993522,10cyclictest23938-21bash23:12:550
24366993516,17cyclictest1847-21nfsd21:10:280
24366993512,20cyclictest1848-21nfsd00:30:110
153442350,2sleep30-21swapper/322:13:543
136672350,31sleep1135650irq/27-eth021:22:061
2438299347,4cyclictest0-21swapper/300:27:373
24382993414,18cyclictest30837-21sshd21:45:013
24382993411,4cyclictest0-21swapper/323:08:553
133332340,32sleep3135650irq/27-eth021:25:123
2438299329,3cyclictest0-21swapper/322:03:013
2438299320,3cyclictest0-21swapper/322:37:423
2438299316,3cyclictest0-21swapper/322:06:143
208672300,28sleep1135650irq/27-eth000:01:591
2438299294,1cyclictest0-21swapper/323:00:323
2438299292,8cyclictest0-21swapper/323:28:563
24372992914,3cyclictest0-21swapper/122:55:191
2438299281,7cyclictest0-21swapper/321:37:543
2438299281,7cyclictest0-21swapper/321:37:543
111442280,26sleep1135650irq/27-eth000:07:201
83972270,2sleep30-21swapper/322:22:203
74812279,16sleep210950irq/23-ehci_hcd22:07:042
308032270,3sleep30-21swapper/300:39:193
2438299270,8cyclictest0-21swapper/323:14:523
2438299270,8cyclictest0-21swapper/323:14:523
24372992713,4cyclictest20947-21fw_packets22:05:171
24366992711,8cyclictest25647-21unixbench_singl20:20:260
54232260,1sleep21848-21nfsd21:36:292
54232260,1sleep21848-21nfsd21:36:282
35242260,2sleep23520-21sshd00:03:272
324412260,2sleep332440-21sshd23:22:523
24382992623,2cyclictest31672-21sshd00:22:313
2438299261,3cyclictest0-21swapper/322:53:233
24377992615,1cyclictest22112-21sshd00:15:002
2437799260,3cyclictest26237-21sshd21:11:002
2437299260,18cyclictest22-21ksoftirqd/121:51:591
24366992620,4cyclictest14376-21sshd19:56:120
167462260,4sleep20-21swapper/221:16:172
2438299259,3cyclictest0-21swapper/323:35:563
2438299254,11cyclictest0-21swapper/322:45:563
2438299251,8cyclictest0-21swapper/300:02:183
2438299250,8cyclictest0-21swapper/321:56:033
2438299250,3cyclictest0-21swapper/321:22:383
206532250,2sleep320650-21sshd23:34:023
151002250,3sleep336-21rcuop/221:49:373
82462240,2sleep10-21swapper/123:05:131
263732240,0sleep20-21swapper/223:59:262
2438299249,3cyclictest0-21swapper/323:51:443
2438299241,8cyclictest135650irq/27-eth000:19:303
2438299241,4cyclictest0-21swapper/300:12:453
2438299240,14cyclictest0-21swapper/321:32:233
24372992413,3cyclictest26159-21sshd23:28:261
2436699243,20cyclictest32597-21rt-features19:25:180
24372992320,2cyclictest0-21swapper/123:16:371
2437299231,8cyclictest2984-21bash22:03:371
24372992316,4cyclictest1959-21sshd23:34:181
24372992314,4cyclictest1847-21nfsd00:15:421
24366992313,6cyclictest25759-21switchtime19:10:210
307282220,2sleep21847-21nfsd00:32:132
2437799222,12cyclictest22056-21sshd23:46:272
24377992211,1cyclictest24993-21rm00:05:272
2437799220,2cyclictest6332-21id21:27:302
24372992212,2cyclictest10950irq/23-ehci_hcd23:24:121
24366992216,3cyclictest8421-21kernelversion20:55:180
24382992113,4cyclictest29435-21nfsd422:30:203
2437799219,4cyclictest10950irq/23-ehci_hcd23:01:202
2437799212,12cyclictest7580-21runrttasks19:41:362
2437799212,12cyclictest7580-21runrttasks19:41:352
24377992116,3cyclictest25982-21bash23:22:142
24366992116,3cyclictest12088-21sshd19:51:100
70002202,16sleep110950irq/23-ehci_hcd23:35:421
2438299206,8cyclictest15075-21sshd22:19:593
2437799203,1cyclictest3008-21cp23:29:192
2437799202,7cyclictest0-21swapper/222:24:552
2437799201,8cyclictest29692-21bash21:50:512
2437799201,6cyclictest8589-21id21:55:032
24377992016,3cyclictest1848-21nfsd23:17:172
24377992015,3cyclictest27123-21sshd22:27:062
2437799200,19cyclictest144550irq/28-eth1-rx-20:14:432
2437299204,5cyclictest135650irq/27-eth000:22:051
2437299201,9cyclictest1846-21nfsd22:16:101
2437299201,8cyclictest3309-21sshd21:57:331
2437299201,7cyclictest1846-21nfsd00:36:141
24372992014,4cyclictest0-21swapper/121:45:571
2436699206,12cyclictest0-21swapper/020:13:220
24366992016,3cyclictest18390-21pmu-power20:05:210
24366992011,7cyclictest135650irq/27-eth019:25:010
24366992011,6cyclictest0-21swapper/021:01:260
2437799195,10cyclictest144550irq/28-eth1-rx-22:01:342
2437799193,7cyclictest15434-21sshd00:20:472
24377991913,4cyclictest19636-21id21:22:402
24377991912,4cyclictest26765-21sshd23:37:362
24377991912,4cyclictest15333-21sshd22:44:192
2437799191,15cyclictest30016-21bash22:54:592
2437299195,6cyclictest29043-21cp21:32:411
2437299195,5cyclictest1846-21nfsd23:51:381
2437299191,9cyclictest0-21swapper/100:28:381
24372991914,4cyclictest27574-21sshd21:38:381
24372991914,4cyclictest27574-21sshd21:38:381
2436699199,8cyclictest0-21swapper/020:45:300
24366991914,3cyclictest30668-21crond20:35:000
24366991914,3cyclictest2405-21runrttasks19:31:190
24366991912,5cyclictest2069-21sendmail_mailqu20:40:210
120732190,17sleep1135650irq/27-eth000:10:371
2437799185,6cyclictest10950irq/23-ehci_hcd21:32:162
2437799185,3cyclictest27333-21sshd23:07:032
2437799184,2cyclictest0-21swapper/221:07:592
24377991813,3cyclictest11346-21sshd23:33:072
24377991813,2cyclictest0-21swapper/223:53:492
2437299188,1cyclictest0-21swapper/100:32:231
24372991813,2cyclictest0-21swapper/121:16:431
24366991813,4cyclictest0-21swapper/021:09:140
24366991810,5cyclictest2405-21runrttasks19:35:070
2438299174,5cyclictest13067-21sshd23:45:333
2438299170,14cyclictest0-21swapper/320:34:353
2437799174,3cyclictest23221-21sshd23:12:512
2437799174,3cyclictest23221-21sshd23:12:512
2437799174,3cyclictest16829-21bash22:32:112
2437799174,2cyclictest0-21swapper/219:15:552
24372991712,4cyclictest27927-21bash22:54:471
2437299170,15cyclictest0-21swapper/120:15:181
2436699179,6cyclictest2405-21runrttasks20:19:480
2436699179,6cyclictest0-21swapper/020:40:000
2436699174,12cyclictest0-21swapper/020:25:140
24366991713,2cyclictest2405-21runrttasks19:17:330
2438299167,5cyclictest10950irq/23-ehci_hcd20:20:153
2437799164,1cyclictest26950irq/26-ahci[00000:35:492
24377991610,2cyclictest10950irq/23-ehci_hcd22:45:382
24366991612,3cyclictest0-21swapper/019:42:360
24366991612,3cyclictest0-21swapper/019:42:360
24366991610,4cyclictest2405-21runrttasks20:01:480
2438299154,10cyclictest10950irq/23-ehci_hcd20:47:073
2438299153,10cyclictest26350-21sshd19:13:363
2438299152,12cyclictest135650irq/27-eth020:52:173
2437799154,10cyclictest144550irq/28-eth1-rx-20:32:062
2437799152,2cyclictest0-21swapper/219:51:552
2437799152,12cyclictest144550irq/28-eth1-rx-20:41:032
2437799151,13cyclictest144550irq/28-eth1-rx-20:56:542
2437799150,14cyclictest144550irq/28-eth1-rx-20:51:512
2437799150,13cyclictest0-21swapper/220:15:142
2437299150,13cyclictest2405-21runrttasks19:27:111
2437299150,13cyclictest0-21swapper/121:02:381
24382991410,3cyclictest135650irq/27-eth019:37:143
24382991410,3cyclictest10950irq/23-ehci_hcd20:10:183
2438299140,12cyclictest1848-21nfsd19:25:123
2437799144,5cyclictest144550irq/28-eth1-rx-19:37:042
2437799142,9cyclictest0-21swapper/219:34:192
2437799142,5cyclictest135650irq/27-eth020:37:312
2437799142,1cyclictest0-21swapper/221:00:062
2437799142,1cyclictest0-21swapper/220:05:362
2437799141,2cyclictest0-21swapper/219:45:312
2437799141,12cyclictest144550irq/28-eth1-rx-20:28:582
2437799141,12cyclictest144550irq/28-eth1-rx-19:11:032
2437799141,12cyclictest135650irq/27-eth019:25:032
2437799140,12cyclictest0-21swapper/220:45:222
2437299147,6cyclictest0-21swapper/119:55:151
2437299146,6cyclictest0-21swapper/120:00:171
2437299143,4cyclictest135650irq/27-eth020:25:211
2437299142,11cyclictest135650irq/27-eth020:51:081
2437299142,11cyclictest10950irq/23-ehci_hcd19:48:011
2437299141,2cyclictest0-21swapper/119:20:211
24372991410,3cyclictest135650irq/27-eth019:36:561
2436699142,11cyclictest8762-21sh19:45:140
2438299137,5cyclictest0-21swapper/320:57:273
2438299135,3cyclictest0-21swapper/320:40:133
2438299133,2cyclictest10950irq/23-ehci_hcd20:37:373
24382991311,1cyclictest0-21swapper/320:26:183
2438299130,4cyclictest22095-21df20:15:113
2438299130,2cyclictest135650irq/27-eth021:00:053
2438299130,12cyclictest0-21swapper/321:09:413
2438299130,11cyclictest6522-21idleruntime19:40:133
2438299130,11cyclictest6522-21idleruntime19:40:133
2438299130,11cyclictest29817-21iostat_ios19:20:163
2438299130,11cyclictest2392-21ntp_states19:30:193
2438299130,11cyclictest14024-21threads19:55:223
2438299130,11cyclictest12353-21runrttasks19:54:163
2437799138,4cyclictest135650irq/27-eth019:20:572
2437799130,12cyclictest144550irq/28-eth1-rx-19:56:242
2437799130,12cyclictest0-21swapper/220:24:402
2437299139,3cyclictest144550irq/28-eth1-rx-19:32:341
2437299139,3cyclictest135650irq/27-eth020:35:001
2437299136,3cyclictest135650irq/27-eth019:42:221
2437299136,3cyclictest135650irq/27-eth019:42:221
2437299136,3cyclictest10950irq/23-ehci_hcd19:50:131
2437299132,10cyclictest135650irq/27-eth020:47:281
2437299130,9cyclictest0-21swapper/120:05:171
2437299130,5cyclictest0-21swapper/121:05:371
2437299130,12cyclictest0-21swapper/120:44:401
2437299130,12cyclictest0-21swapper/120:12:321
2437299130,11cyclictest28888-21df20:30:111
2437299130,11cyclictest24737-21hddtemp_smartct20:20:171
2436699134,8cyclictest5696-21munin-node20:50:140
2438299122,9cyclictest0-21swapper/320:05:223
2438299120,3cyclictest0-21swapper/319:45:123
2438299120,11cyclictest0-21swapper/320:00:113
2438299120,10cyclictest27095-21diskstats19:15:143
2437299120,3cyclictest8400-21iostat_ios20:55:161
2437299120,3cyclictest25252-21munin-node19:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional