You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 22:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue Jul 15, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1367221540,2sleep12405-21runrttasks12:29:051
1234321480,3sleep212337-21sshd11:13:152
3255421310,5sleep2804399cyclictest09:23:402
1797921260,1sleep30-21swapper/310:33:273
2542121230,1sleep125420-21sshd09:29:401
1014921230,4sleep1804099cyclictest11:51:461
2951921210,2sleep0803499cyclictest12:06:110
949221190,2sleep29489-21sshd12:04:202
1094321150,1sleep10-21swapper/112:37:581
754021070,2sleep20-21swapper/209:51:262
2375121050,3sleep0803499cyclictest12:11:450
2375121050,3sleep0803499cyclictest12:11:440
1240621030,0sleep00-21swapper/010:59:570
3193221010,2sleep0803499cyclictest11:57:010
2474521000,5sleep3804899cyclictest10:54:283
236352960,1sleep023631-21bash11:24:310
101432960,3sleep110134-21sshd09:55:141
163482950,1sleep016345-21sshd09:11:480
322572940,1sleep032254-21sshd09:20:140
139052940,3sleep20-21swapper/210:36:192
314662920,0sleep0417-21jbd2/dm-0-810:51:370
190062870,0sleep019005-21sshd12:20:220
290662860,2sleep20-21swapper/209:36:432
262972860,2sleep10-21swapper/110:17:231
262972860,2sleep10-21swapper/110:17:221
776028534,39sleep30-21swapper/307:09:373
749828534,47sleep10-21swapper/107:06:311
224982850,1sleep30-21swapper/309:53:033
6892840,2sleep30-21swapper/311:54:033
267232840,2sleep226717-21sshd11:59:432
161432820,1sleep30-21swapper/312:01:463
279762810,3sleep0803499cyclictest11:53:320
24242810,4sleep11848-21nfsd10:51:571
181472790,1sleep2804399cyclictest11:03:522
158642790,1sleep20-21swapper/209:59:272
4822770,2sleep2480-21sshd11:15:182
181432770,2sleep218121-21sshd10:03:052
293572760,1sleep029261-21sshd12:27:270
283682760,2sleep21846-21nfsd12:36:312
276372730,2sleep30-21swapper/311:59:483
244302720,2sleep024427-21bash09:53:170
145772690,5sleep3804899cyclictest10:16:053
145772690,5sleep3804899cyclictest10:16:043
322362680,1sleep3804899cyclictest09:30:193
299842660,1sleep3804899cyclictest12:06:143
105382640,2sleep21848-21nfsd10:12:232
105382640,2sleep21848-21nfsd10:12:222
209482600,2sleep20-21swapper/211:52:512
91182550,1sleep0803499cyclictest12:04:190
767625434,11sleep20-21swapper/207:08:442
764524925,21sleep00-21swapper/007:08:220
803499410,3cyclictest0-21swapper/010:09:240
73642380,1sleep17349-21sshd12:16:141
8034993733,2cyclictest15759-21hddtemp_smartct11:00:140
8040993615,17cyclictest22-21ksoftirqd/111:44:541
8040993514,14cyclictest22-21ksoftirqd/110:10:411
8040993514,14cyclictest22-21ksoftirqd/110:10:411
8040993313,17cyclictest22-21ksoftirqd/110:46:461
8040993313,13cyclictest22-21ksoftirqd/110:21:261
8040993311,8cyclictest32671-21bash11:31:401
8034993328,4cyclictest0-21swapper/009:18:520
261952320,0sleep226194-21bash10:44:292
149062320,3sleep014901-21bash09:31:560
8040993114,14cyclictest22-21ksoftirqd/109:35:401
8048993014,8cyclictest135650irq/27-eth011:15:193
8040993012,12cyclictest22-21ksoftirqd/110:56:251
8034993028,1cyclictest2092-21sshd09:37:190
804399291,3cyclictest0-21swapper/210:20:482
8040992910,16cyclictest22-21ksoftirqd/112:09:581
79882290,2sleep37964-21sshd11:38:523
804099289,7cyclictest11727-21sshd11:39:161
804099282,23cyclictest22-21ksoftirqd/112:22:571
804099280,24cyclictest8965-21cp10:42:361
804099280,20cyclictest22-21ksoftirqd/110:09:221
171342280,5sleep30-21swapper/311:46:023
804399277,7cyclictest135650irq/27-eth012:07:232
804099270,24cyclictest22-21ksoftirqd/111:28:321
804099270,24cyclictest22-21ksoftirqd/109:20:511
265232270,3sleep10-21swapper/110:34:221
91582260,4sleep30-21swapper/312:28:383
8048992612,8cyclictest10950irq/23-ehci_hcd12:34:143
804399269,3cyclictest29847-21sshd10:51:242
8043992621,3cyclictest4705-21sshd11:25:462
8043992611,13cyclictest33-21ksoftirqd/212:11:532
8043992611,13cyclictest33-21ksoftirqd/212:11:532
804099261,22cyclictest22-21ksoftirqd/111:58:561
8040992611,6cyclictest22-21ksoftirqd/109:34:021
8040992611,4cyclictest12968-21sshd11:03:201
8040992611,14cyclictest22-21ksoftirqd/109:46:521
804099260,16cyclictest22-21ksoftirqd/109:51:371
72922260,3sleep17289-21sshd10:25:281
52952260,1sleep05291-21sshd09:44:390
287262260,2sleep20-21swapper/211:44:042
81932250,23sleep226950irq/26-ahci[00012:34:442
804399250,19cyclictest33-21ksoftirqd/211:20:092
804099257,4cyclictest5683-21sshd12:03:571
804099257,17cyclictest22-21ksoftirqd/110:01:331
8040992522,2cyclictest135650irq/27-eth011:47:541
8040992516,7cyclictest0-21swapper/111:11:211
8040992514,9cyclictest22-21ksoftirqd/111:24:261
804099251,18cyclictest22-21ksoftirqd/111:06:101
6262250,23sleep226950irq/26-ahci[00012:27:502
804399245,17cyclictest33-21ksoftirqd/209:34:242
804399243,19cyclictest33-21ksoftirqd/210:50:002
804399243,0cyclictest0-21swapper/209:25:292
8043992418,4cyclictest17514-21bash12:23:202
8043992415,5cyclictest1959-21sshd09:43:232
804399241,20cyclictest33-21ksoftirqd/212:19:062
8043992410,4cyclictest33-21ksoftirqd/211:47:332
804099241,20cyclictest22-21ksoftirqd/110:36:051
804099241,20cyclictest22-21ksoftirqd/109:17:281
804099240,16cyclictest22-21ksoftirqd/111:18:021
803499243,13cyclictest0-21swapper/010:41:110
803499242,16cyclictest0-21swapper/010:00:050
803499240,13cyclictest18378-21sshd11:17:120
144422240,2sleep30-21swapper/309:25:103
8048992312,2cyclictest10950irq/23-ehci_hcd09:55:223
8048992310,7cyclictest135650irq/27-eth010:56:133
8043992316,5cyclictest18912-21sshd11:30:212
804399230,21cyclictest33-21ksoftirqd/210:15:332
804399230,21cyclictest33-21ksoftirqd/210:15:332
8040992321,1cyclictest21921-21sshd12:14:411
8040992321,1cyclictest21921-21sshd12:14:401
8040992316,5cyclictest22-21ksoftirqd/112:30:151
804099230,21cyclictest22-21ksoftirqd/109:10:151
803499231,17cyclictest0-21swapper/011:25:490
803499230,17cyclictest0-21swapper/011:08:300
326142232,19sleep3135650irq/27-eth012:36:583
235002230,0sleep023499-21bash11:30:440
202112230,2sleep30-21swapper/310:20:133
804899229,6cyclictest135650irq/27-eth009:16:373
804399228,3cyclictest1959-21sshd10:07:262
804399223,16cyclictest33-21ksoftirqd/209:13:392
8043992213,5cyclictest19167-21sshd10:30:112
804399220,19cyclictest33-21ksoftirqd/211:37:122
804399220,19cyclictest33-21ksoftirqd/209:46:152
804099220,11cyclictest22-21ksoftirqd/109:41:381
803499229,4cyclictest21768-21sshd12:39:020
8034992210,3cyclictest3872-21sshd10:38:480
803499220,6cyclictest0-21swapper/012:19:250
224532220,1sleep022434-21sshd11:46:350
8048992114,4cyclictest1847-21nfsd10:08:413
8048992113,6cyclictest2368-21sshd09:10:213
8048992112,7cyclictest135650irq/27-eth010:41:363
8043992113,4cyclictest2474-21sshd10:25:062
8043992111,3cyclictest23920-21sshd10:57:422
8034992112,6cyclictest0-21swapper/010:32:570
803499211,13cyclictest8875-21sshd10:45:560
8034992110,6cyclictest1848-21nfsd12:31:400
803499210,13cyclictest14416-21sshd10:12:490
803499210,13cyclictest14416-21sshd10:12:480
93062203,15sleep310950irq/23-ehci_hcd11:12:563
804899209,5cyclictest10950irq/23-ehci_hcd10:45:143
8048992018,1cyclictest0-21swapper/308:31:133
8048992016,2cyclictest0-21swapper/312:12:253
8048992016,2cyclictest0-21swapper/312:12:243
8048992014,4cyclictest1847-21nfsd10:02:163
8048992013,4cyclictest0-21swapper/312:16:373
8048992010,4cyclictest135650irq/27-eth011:06:003
8043992015,3cyclictest0-21swapper/211:05:542
804399200,18cyclictest33-21ksoftirqd/209:16:422
804099200,17cyclictest22-21ksoftirqd/107:40:001
803499203,10cyclictest6208-21sshd10:28:470
803499200,16cyclictest1959-21sshd11:42:060
803499200,10cyclictest31249-21id10:24:450
230172200,18sleep3135650irq/27-eth010:10:173
230172200,18sleep3135650irq/27-eth010:10:163
804899197,5cyclictest135650irq/27-eth011:03:473
804899196,6cyclictest10950irq/23-ehci_hcd11:20:443
804899190,5cyclictest1846-21nfsd10:39:123
804399191,14cyclictest1131-21jbd2/dm-2-808:56:172
8040991917,1cyclictest0-21swapper/107:24:241
803499198,5cyclictest0-21swapper/011:35:160
803499195,12cyclictest18553-21sshd09:25:260
803499192,10cyclictest17767-21sshd09:45:480
803499190,11cyclictest7416-21sshd10:18:510
803499190,11cyclictest7416-21sshd10:18:500
803499190,11cyclictest26942-21sshd11:11:190
40452190,3sleep30-21swapper/311:28:593
804899184,6cyclictest1845-21nfsd10:26:473
804899184,6cyclictest10950irq/23-ehci_hcd12:20:113
8048991812,4cyclictest29090-21sshd09:43:453
804899181,14cyclictest3836-21sshd11:41:373
804899180,9cyclictest1847-21nfsd11:34:243
8043991812,4cyclictest10454-21gltestperf08:25:172
8043991812,4cyclictest10454-21gltestperf08:25:172
804099181,3cyclictest0-21swapper/107:46:321
803499187,5cyclictest14548-21bash09:55:350
804899177,3cyclictest10950irq/23-ehci_hcd09:35:233
8048991714,2cyclictest0-21swapper/309:45:213
8048991712,4cyclictest10950irq/23-ehci_hcd08:12:513
8043991711,4cyclictest12556-21latency_hist07:20:002
804099170,15cyclictest22-21ksoftirqd/108:45:231
803499170,15cyclictest0-21swapper/007:15:240
803499170,14cyclictest0-21swapper/008:18:160
263732170,2sleep30-21swapper/309:00:183
804899165,3cyclictest25657-21sshd09:22:573
8048991611,1cyclictest135650irq/27-eth007:50:113
804899160,14cyclictest0-21swapper/307:45:213
804399162,10cyclictest0-21swapper/207:43:362
8048991511,3cyclictest10950irq/23-ehci_hcd08:54:283
804399150,6cyclictest135650irq/27-eth007:20:152
804099157,2cyclictest0-21swapper/107:30:431
804099153,10cyclictest23729-21diskstats08:55:141
8040991511,3cyclictest10950irq/23-ehci_hcd08:50:071
8040991511,3cyclictest10950irq/23-ehci_hcd08:37:001
8040991510,3cyclictest23027-21switchtime07:40:201
8040991510,3cyclictest1400-21kernelversion08:05:211
803499157,7cyclictest0-21swapper/008:38:120
803499150,14cyclictest0-21swapper/007:20:220
803499150,12cyclictest0-21swapper/008:26:330
803499150,12cyclictest0-21swapper/008:26:330
804899140,13cyclictest0-21swapper/307:33:113
804899140,12cyclictest0-21swapper/309:06:533
804399148,3cyclictest135650irq/27-eth008:36:032
804399145,2cyclictest0-21swapper/208:42:062
804399141,12cyclictest1848-21nfsd08:05:492
8043991410,3cyclictest10950irq/23-ehci_hcd08:53:192
804399140,5cyclictest135650irq/27-eth008:35:002
804399140,13cyclictest21373-21runrttasks07:39:042
804099144,4cyclictest10950irq/23-ehci_hcd07:12:451
804099141,11cyclictest0-21swapper/107:59:101
804099140,12cyclictest7502-21munin-node08:20:141
803499147,5cyclictest0-21swapper/008:10:430
8034991411,2cyclictest0-21swapper/008:30:560
803499140,9cyclictest0-21swapper/008:20:030
803499140,1cyclictest0-21swapper/007:44:290
803499140,13cyclictest0-21swapper/007:54:310
804899136,3cyclictest10950irq/23-ehci_hcd08:35:123
8048991311,1cyclictest0-21swapper/308:17:043
804899130,4cyclictest15221-21fschecks_count07:25:153
804899130,2cyclictest0-21swapper/308:55:133
804899130,12cyclictest11097-21iostat07:15:183
804899130,12cyclictest0-21swapper/308:40:173
804899130,12cyclictest0-21swapper/307:22:173
804899130,11cyclictest30779-21munin-node08:00:243
804899130,11cyclictest2405-21runrttasks07:57:053
804899130,11cyclictest20058-21perl07:35:143
804899130,11cyclictest10111-21diskstats08:25:173
804899130,11cyclictest10111-21diskstats08:25:163
804899130,10cyclictest0-21swapper/308:05:193
804399139,3cyclictest10950irq/23-ehci_hcd08:22:342
804399138,3cyclictest16601-21chrt07:26:192
804399132,7cyclictest8827-21iostat_ios07:10:172
8043991311,1cyclictest0-21swapper/208:45:222
8043991311,1cyclictest0-21swapper/207:50:272
804399130,12cyclictest36-21rcuop/208:18:062
804399130,12cyclictest1848-21nfsd08:10:072
804399130,12cyclictest0-21swapper/208:00:262
804399130,12cyclictest0-21swapper/207:30:462
804399130,11cyclictest28909-21grep09:05:182
804399130,10cyclictest135650irq/27-eth009:01:082
804399130,10cyclictest10950irq/23-ehci_hcd07:46:142
804099139,3cyclictest135650irq/27-eth008:30:291
804099137,1cyclictest26950irq/26-ahci[00008:25:151
804099137,1cyclictest26950irq/26-ahci[00008:25:151
804099130,12cyclictest22-21ksoftirqd/107:50:171
804099130,12cyclictest0-21swapper/109:06:101
804099130,12cyclictest0-21swapper/107:29:501
804099130,11cyclictest5330-21atenall_r5power08:15:111
804099130,11cyclictest4106-21ntp_states08:10:201
804099130,11cyclictest30767-21runrttasks08:00:031
804099130,11cyclictest26436-21iostat_ios09:00:181
804099130,11cyclictest11014-21hddtemp_smartct07:15:171
803499137,4cyclictest0-21swapper/007:56:210
803499137,1cyclictest0-21swapper/008:05:170
803499134,1cyclictest25459-21awk09:00:000
803499131,1cyclictest135650irq/27-eth008:45:140
803499130,1cyclictest0-21swapper/007:36:080
803499130,12cyclictest0-21swapper/009:00:470
803499130,12cyclictest0-21swapper/007:47:010
803499130,12cyclictest0-21swapper/007:25:270
803499130,10cyclictest0-21swapper/009:06:030
804899122,9cyclictest0-21swapper/308:45:053
804899120,3cyclictest0-21swapper/307:10:133
804899120,11cyclictest0-21swapper/307:40:113
804899120,10cyclictest74872sleep308:20:013
804399120,4cyclictest0-21swapper/207:55:082
804099120,10cyclictest0-21swapper/108:40:131
803499127,3cyclictest0-21swapper/008:40:020
803499120,2cyclictest0-21swapper/007:30:000
803499120,1cyclictest0-21swapper/008:00:120
803499120,11cyclictest0-21swapper/008:50:220
803499118,2cyclictest0-21swapper/007:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional