You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 05:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Tue Dec 02, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
328821770,2sleep1798999cyclictest23:12:101
90721750,2sleep1798999cyclictest23:48:501
3261921460,1sleep20-21swapper/221:34:262
2686421430,2sleep126856-21sshd23:05:131
907321400,4sleep2799399cyclictest22:57:162
3108021350,2sleep0798499cyclictest00:17:050
1308521330,3sleep00-21swapper/023:03:500
2638221320,5sleep3799899cyclictest21:27:463
1672521260,1sleep20-21swapper/221:38:592
592121230,3sleep0798499cyclictest22:23:220
592121230,3sleep0798499cyclictest22:23:220
1867221210,3sleep3799899cyclictest23:44:183
992221160,4sleep3799899cyclictest21:38:213
3123921140,0sleep00-21swapper/022:04:350
2023521070,2sleep20-21swapper/222:36:512
636921010,1sleep10-21swapper/100:08:251
42252990,2sleep34224-21bash21:31:423
251772990,1sleep0798499cyclictest22:43:270
113512990,2sleep30-21swapper/300:34:573
761429633,42sleep30-21swapper/319:08:233
326092950,1sleep00-21swapper/022:28:550
28912930,2sleep20-21swapper/222:53:352
323342900,2sleep00-21swapper/000:23:520
286262900,2sleep11848-21nfsd21:30:571
263822860,4sleep2799399cyclictest23:11:152
90982840,2sleep39097-21bash23:09:433
248502840,2sleep10-21swapper/123:01:521
746928330,49sleep10-21swapper/119:06:491
213022830,2sleep221294-21sshd23:16:552
19212820,2sleep21846-21nfsd22:20:002
167762820,1sleep021630-21kworker/0:023:53:300
166782810,1sleep20-21swapper/223:25:382
162932810,2sleep116294-21bash22:30:221
65482800,3sleep10-21swapper/123:58:521
316202800,2sleep2799399cyclictest23:39:212
301562790,2sleep30-21swapper/322:01:213
212012780,2sleep121200-21sshd00:00:161
108322780,0sleep01848-21nfsd23:46:360
163512760,1sleep20-21swapper/221:45:012
16032760,2sleep30-21swapper/321:49:423
205822750,1sleep1798999cyclictest22:24:471
205822750,1sleep1798999cyclictest22:24:471
85782740,2sleep30-21swapper/322:23:383
85782740,2sleep30-21swapper/322:23:383
15042730,2sleep31498-21sshd00:24:023
293272720,1sleep0798499cyclictest21:12:560
765827133,9sleep20-21swapper/219:08:582
63202700,0sleep21848-21nfsd21:22:522
182392660,3sleep0798499cyclictest00:25:480
93442620,1sleep30-21swapper/321:23:093
770026032,4sleep00-21swapper/019:09:280
87622550,3sleep2799399cyclictest23:31:032
212912550,2sleep10-21swapper/122:06:371
217362500,1sleep30-21swapper/321:54:353
169462500,1sleep10-21swapper/123:22:391
323112431,40sleep1135650irq/27-eth022:47:091
7998993934,2cyclictest0-21swapper/322:55:003
7984993732,4cyclictest29896-21sshd21:40:140
22062360,33sleep1135650irq/27-eth022:01:491
213582350,1sleep20-21swapper/221:27:172
7998993125,2cyclictest1959-21sshd00:07:003
240042310,4sleep20-21swapper/222:40:162
20692310,2sleep10-21swapper/121:28:331
100542310,4sleep20-21swapper/200:02:202
7993992910,4cyclictest20898-21sshd00:16:042
105222290,0sleep00-21swapper/019:15:130
799399273,7cyclictest0-21swapper/221:54:262
798999263,11cyclictest17228-21sshd22:27:271
7989992616,3cyclictest1845-21nfsd00:13:431
7989992611,5cyclictest21156-21sshd21:12:081
7989992610,3cyclictest0-21swapper/123:50:191
7984992614,5cyclictest3-21ksoftirqd/022:36:270
7998992511,3cyclictest12253-21sshd00:25:143
7993992513,3cyclictest8668-21sshd22:14:342
798999258,3cyclictest0-21swapper/123:15:041
798999257,10cyclictest1847-21nfsd00:15:481
7989992514,3cyclictest0-21swapper/122:59:171
7984992513,6cyclictest3-21ksoftirqd/023:17:050
7984992510,6cyclictest3-21ksoftirqd/023:56:120
261112250,1sleep00-21swapper/021:00:150
25612250,21sleep1135650irq/27-eth000:24:141
16452250,3sleep0798499cyclictest00:37:190
799899249,5cyclictest135650irq/27-eth022:10:203
7993992415,6cyclictest1240-21sshd23:21:072
799399241,0cyclictest0-21swapper/222:49:212
798999244,17cyclictest22-21ksoftirqd/121:52:451
7989992418,3cyclictest0-21swapper/122:18:131
7989992416,4cyclictest1959-21sshd21:43:441
798999241,20cyclictest22-21ksoftirqd/122:40:011
7989992411,3cyclictest10950irq/23-ehci_hcd00:26:461
7989992411,2cyclictest1846-21nfsd23:29:131
798999240,17cyclictest22-21ksoftirqd/121:47:471
7984992412,5cyclictest3-21ksoftirqd/000:30:520
48442240,2sleep30-21swapper/323:30:403
151382240,2sleep20-21swapper/223:59:442
147852240,2sleep114783-21bash23:37:431
7993992315,5cyclictest0-21swapper/222:30:262
7989992320,2cyclictest0-21swapper/122:41:021
7989992316,4cyclictest28436-21sshd21:55:131
7984992313,5cyclictest3-21ksoftirqd/022:58:450
7984992313,4cyclictest1675-21sshd21:52:400
44052230,20sleep2135650irq/27-eth021:19:452
322992230,21sleep3135650irq/27-eth023:51:483
249272230,2sleep30-21swapper/322:34:193
19842230,3sleep01972-21sshd22:07:520
156792230,2sleep315678-21bash00:12:333
91182220,19sleep3135650irq/27-eth021:59:293
799899229,5cyclictest10950irq/23-ehci_hcd22:40:443
799399222,18cyclictest33-21ksoftirqd/223:42:072
7993992216,3cyclictest21776-21id23:53:582
7993992215,5cyclictest27390-21sshd00:13:412
7993992215,2cyclictest135650irq/27-eth000:39:222
7993992214,6cyclictest24676-21bash23:01:512
799399220,20cyclictest33-21ksoftirqd/222:26:262
799399220,19cyclictest1848-21nfsd23:06:142
7989992214,5cyclictest0-21swapper/122:52:371
7989992211,7cyclictest20071-21bash21:39:181
798499220,15cyclictest0-21swapper/023:10:080
67812220,1sleep20-21swapper/221:56:062
46112220,11sleep01847-21nfsd21:25:390
318792220,3sleep30-21swapper/321:40:213
305062220,1sleep31959-21sshd22:46:593
247812220,2sleep20-21swapper/200:26:292
244052220,1sleep024399-21sshd23:35:290
174042220,20sleep3135650irq/27-eth023:59:593
7998992111,7cyclictest135650irq/27-eth000:00:193
7998992111,4cyclictest28535-21sshd21:18:563
7993992116,3cyclictest26512-21sshd22:01:002
7993992115,4cyclictest4103-21sshd00:05:032
7993992115,4cyclictest10987-21cp21:44:312
7993992115,3cyclictest30150-21bash22:07:262
7993992114,5cyclictest26924-21sshd00:30:012
7993992113,5cyclictest32254-21bash00:20:252
798999219,5cyclictest10950irq/23-ehci_hcd00:35:271
7989992114,4cyclictest1959-21sshd23:41:541
7989992112,3cyclictest135650irq/27-eth023:32:371
7989992110,2cyclictest8680-21sshd22:14:341
798499215,1cyclictest0-21swapper/021:34:210
798499211,12cyclictest0-21swapper/021:57:590
7984992110,9cyclictest3-21ksoftirqd/021:46:260
7984992110,3cyclictest7671-21sshd23:09:340
156032210,19sleep3135650irq/27-eth023:04:063
106392210,2sleep310575-21sshd23:19:023
799899209,2cyclictest10950irq/23-ehci_hcd22:09:253
799899206,3cyclictest19219-21bash00:39:223
7998992014,5cyclictest10950irq/23-ehci_hcd20:05:173
7993992015,3cyclictest31746-21sshd23:48:402
798999206,9cyclictest0-21swapper/121:23:161
798999200,9cyclictest0-21swapper/100:33:341
798499209,4cyclictest26382-21sshd22:46:350
798499208,2cyclictest1845-21nfsd22:51:000
798499206,6cyclictest3-21ksoftirqd/000:12:360
798499201,16cyclictest18896-21sshd00:06:250
798499200,18cyclictest1847-21nfsd22:32:080
798499200,14cyclictest8393-21sshd23:43:170
308112200,2sleep030809-21seq22:16:340
183032200,18sleep1135650irq/27-eth021:17:591
799899196,2cyclictest19863-21sshd23:29:083
7998991912,5cyclictest1846-21nfsd22:25:493
799899190,6cyclictest0-21swapper/323:39:553
7993991914,3cyclictest21150-21sshd21:12:092
7993991913,5cyclictest36-21rcuop/222:22:172
7993991913,5cyclictest36-21rcuop/222:22:172
798499190,3cyclictest0-21swapper/023:22:390
297982191,15sleep3135650irq/27-eth023:45:193
799899180,4cyclictest30370-21sshd22:37:503
799899180,13cyclictest15673-21sshd23:10:163
7984991813,4cyclictest3-21ksoftirqd/022:14:460
799899177,4cyclictest2407-21bash23:24:243
799899174,1cyclictest961-21bash22:16:493
799899171,5cyclictest14376-21sshd00:15:243
799399171,2cyclictest0-21swapper/220:49:492
798499177,6cyclictest8152-21sshd21:23:020
798499176,9cyclictest25390-21bash23:26:300
798499173,9cyclictest0-21swapper/023:32:180
798499171,9cyclictest1629-21sshd21:16:210
798499171,9cyclictest0-21swapper/000:01:310
7984991711,4cyclictest11168-21sshd21:35:220
798499170,11cyclictest0-21swapper/019:24:140
799899160,6cyclictest10327-21sshd22:57:243
799399162,5cyclictest135650irq/27-eth019:58:472
798999167,4cyclictest10950irq/23-ehci_hcd19:25:241
799899152,2cyclictest17077-21sshd21:11:453
799399157,2cyclictest0-21swapper/219:20:202
799399150,13cyclictest0-21swapper/220:30:162
799399150,13cyclictest0-21swapper/219:50:162
798999157,1cyclictest6848-21grep20:15:231
7989991511,3cyclictest10950irq/23-ehci_hcd20:27:321
798499152,12cyclictest0-21swapper/019:40:170
798499150,1cyclictest0-21swapper/019:30:140
799899147,3cyclictest10950irq/23-ehci_hcd20:10:193
799899146,4cyclictest0-21swapper/321:05:133
799899140,12cyclictest0-21swapper/319:30:163
799399149,4cyclictest135650irq/27-eth020:20:252
799399143,2cyclictest0-21swapper/219:15:162
799399141,5cyclictest135650irq/27-eth019:36:562
799399141,10cyclictest135650irq/27-eth020:17:192
799399140,4cyclictest0-21swapper/220:29:332
799399140,13cyclictest1848-21nfsd20:52:122
799399140,13cyclictest0-21swapper/220:09:402
799399140,13cyclictest0-21swapper/220:01:322
798999149,4cyclictest135650irq/27-eth019:14:011
798999144,1cyclictest0-21swapper/120:11:021
798999142,11cyclictest135650irq/27-eth021:06:241
798999142,11cyclictest0-21swapper/120:35:031
798999141,6cyclictest12360-21perf19:19:591
798999140,13cyclictest135650irq/27-eth020:45:151
798999140,13cyclictest0-21swapper/120:00:241
7984991410,3cyclictest31024-21kworker/0:220:28:120
798499140,13cyclictest0-21swapper/020:57:170
799899137,5cyclictest0-21swapper/320:15:213
799899137,3cyclictest0-21swapper/320:42:193
799899137,3cyclictest0-21swapper/320:42:183
799899134,6cyclictest135650irq/27-eth019:55:183
7998991311,1cyclictest0-21swapper/319:50:563
799899130,4cyclictest12576-21munin-node19:20:253
799899130,12cyclictest0-21swapper/321:00:093
799899130,12cyclictest0-21swapper/320:50:103
799899130,12cyclictest0-21swapper/320:45:143
799899130,12cyclictest0-21swapper/320:36:533
799899130,12cyclictest0-21swapper/320:30:313
799899130,12cyclictest0-21swapper/320:27:303
799899130,12cyclictest0-21swapper/319:25:573
799899130,11cyclictest23793-21df20:55:153
799899130,11cyclictest21692-21munin-node19:40:163
799899130,11cyclictest19738-21diskstats19:35:133
799399139,1cyclictest144550irq/28-eth1-rx-21:09:212
799399138,3cyclictest17118-21chrt19:30:012
799399131,4cyclictest3171-21cpuspeed_turbos20:10:142
799399130,4cyclictest25798-21munin-node21:00:162
799399130,4cyclictest21961-21df19:40:132
799399130,12cyclictest14855-21sshd19:25:122
799399130,12cyclictest0-21swapper/220:43:412
799399130,12cyclictest0-21swapper/220:43:412
799399130,12cyclictest0-21swapper/220:35:542
799399130,12cyclictest0-21swapper/219:45:562
799399130,11cyclictest8346-21diskstats19:10:132
799399130,11cyclictest23522-21munin-node20:55:142
798999138,4cyclictest8684-21grep20:20:211
798999137,5cyclictest13020-21missed_timers20:30:191
798999132,10cyclictest135650irq/27-eth019:45:151
798999132,10cyclictest1131-21jbd2/dm-2-820:56:171
798999131,11cyclictest135650irq/27-eth019:40:171
7989991311,1cyclictest0-21swapper/119:30:441
798999130,4cyclictest13455-21load19:20:171
798999130,12cyclictest0-21swapper/121:00:211
798999130,12cyclictest0-21swapper/120:54:041
798999130,11cyclictest29668-21grep19:55:201
798999130,11cyclictest17362-21hddtemp_smartct20:40:141
798999130,11cyclictest17362-21hddtemp_smartct20:40:141
798999130,11cyclictest0-21swapper/120:05:171
798499139,3cyclictest0-21swapper/020:46:150
798499139,1cyclictest0-21swapper/020:22:380
798499138,4cyclictest0-21swapper/019:45:220
798499137,5cyclictest0-21swapper/020:00:100
798499137,5cyclictest0-21swapper/019:26:490
798499131,2cyclictest0-21swapper/020:18:360
7984991311,1cyclictest0-21swapper/020:35:590
798499130,1cyclictest0-21swapper/020:52:060
798499130,1cyclictest0-21swapper/019:51:550
798499130,12cyclictest0-21swapper/020:40:200
798499130,12cyclictest0-21swapper/020:40:200
798499130,12cyclictest0-21swapper/020:31:450
798499130,12cyclictest0-21swapper/019:35:210
798499130,12cyclictest0-21swapper/019:10:120
799899127,4cyclictest8294-21cat20:20:163
799899122,4cyclictest0-21swapper/319:45:143
799899120,3cyclictest10296-21munin-node19:15:193
799899120,11cyclictest31483-21gltestperf20:00:173
799899120,10cyclictest8187-21cpuspeed_turbos19:10:123
798999120,11cyclictest27082-21munin-node19:50:181
798999120,10cyclictest19683-21munin-node19:35:121
798499120,11cyclictest0-21swapper/021:05:190
798499120,11cyclictest0-21swapper/020:10:330
798499120,11cyclictest0-21swapper/020:05:020
798499120,11cyclictest0-21swapper/019:56:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional