You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 20:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Nov 27, 2025 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1453821490,4sleep21999099cyclictest11:40:082
2376321450,4sleep11998699cyclictest12:00:551
1120421430,1sleep111160-21sshd10:13:101
479321330,4sleep31999199cyclictest09:22:503
1739621300,2sleep317392-21iostat_ios09:50:163
3042321290,0sleep00-21swapper/011:58:300
1131221270,2sleep111308-21sshd12:26:251
2932321180,1sleep229319-21sshd12:19:322
2892321130,0sleep028924-21sshd10:41:430
19676210732,45sleep30-21swapper/307:09:213
3157721000,2sleep11847-21nfsd11:55:141
7822990,1sleep10-21swapper/111:15:461
300182990,3sleep01998199cyclictest11:51:440
58632970,4sleep00-21swapper/012:31:370
1959029534,39sleep10-21swapper/107:08:141
244512940,2sleep20-21swapper/209:21:252
192612940,2sleep00-21swapper/010:30:400
266192900,1sleep00-21swapper/010:51:330
279032880,2sleep127894-21bash10:58:271
26952880,1sleep02693-21sshd12:20:020
186412880,1sleep11998699cyclictest10:40:351
315442870,1sleep031528-21rm10:55:170
244522860,1sleep10-21swapper/109:24:521
291382840,5sleep11998699cyclictest11:45:001
287252840,1sleep228724-21bash09:18:322
287252840,1sleep228724-21bash09:18:312
212302840,2sleep11998699cyclictest12:21:351
45432830,3sleep21999099cyclictest09:45:422
297182830,1sleep029713-21bash11:12:130
287422830,2sleep128738-21sshd11:28:331
264802830,0sleep00-21swapper/012:16:220
219342810,2sleep121933-21sshd10:30:571
273602790,2sleep10-21swapper/112:16:261
185572790,1sleep10-21swapper/110:20:391
137932790,3sleep21999099cyclictest11:07:182
101752790,0sleep00-21swapper/009:23:230
42972780,3sleep11998699cyclictest09:52:221
25052780,2sleep22506-21sshd09:12:312
108402780,1sleep10-21swapper/110:06:251
47152770,1sleep00-21swapper/011:02:550
32642770,1sleep33263-21bash09:12:353
280852750,1sleep30-21swapper/310:41:383
151072740,4sleep30-21swapper/311:17:173
272012730,2sleep10-21swapper/112:13:391
210932730,4sleep21999099cyclictest11:57:312
155042710,4sleep21999099cyclictest11:30:222
133022710,4sleep31999199cyclictest10:20:133
162752690,4sleep21999099cyclictest10:23:492
187272660,1sleep10-21swapper/110:37:191
319002590,1sleep21999099cyclictest12:36:442
1956525734,11sleep00-21swapper/007:07:570
180562550,0sleep00-21swapper/010:03:470
136012520,2sleep30-21swapper/309:16:573
136012520,2sleep30-21swapper/309:16:573
1963125035,11sleep20-21swapper/207:08:482
89232480,2sleep28920-21sshd10:06:102
112872470,1sleep111288-21bash09:43:121
19990993632,3cyclictest1848-21nfsd09:32:022
125402360,32sleep1135650irq/27-eth009:13:351
252662320,2sleep325267-21bash12:07:183
306892310,29sleep3135650irq/27-eth010:15:133
19986992912,8cyclictest22-21ksoftirqd/112:08:471
288722280,2sleep20-21swapper/210:51:472
19986992813,2cyclictest22-21ksoftirqd/111:51:131
152202280,1sleep30-21swapper/310:50:233
275042270,2sleep31848-21nfsd10:08:113
1998699270,13cyclictest22-21ksoftirqd/109:32:511
86142260,1sleep08541-21sshd11:26:230
326862260,24sleep1135650irq/27-eth009:38:561
19991992610,6cyclictest10950irq/23-ehci_hcd09:37:243
1998699263,17cyclictest22-21ksoftirqd/111:34:471
19986992612,9cyclictest0-21swapper/109:45:341
1998199261,2cyclictest22423-21bash12:00:480
181162260,2sleep218112-21bash12:12:462
109182260,2sleep310909-21diskstats11:00:133
203182250,1sleep30-21swapper/311:30:513
15922250,2sleep30-21swapper/311:38:503
19991992416,6cyclictest28001-21bash09:44:563
19986992412,4cyclictest18164-21sshd11:00:531
181512240,1sleep00-21swapper/010:13:530
105182240,3sleep110521-21sshd10:26:331
241092230,2sleep324110-21id12:00:583
19986992317,4cyclictest789-21sshd11:05:571
19986992314,6cyclictest135650irq/27-eth009:18:391
19986992314,6cyclictest135650irq/27-eth009:18:381
19986992313,6cyclictest6863-21sshd10:15:571
19986992313,3cyclictest0-21swapper/110:47:021
1998199231,13cyclictest0-21swapper/010:35:140
151792230,2sleep215178-21sshd11:14:032
24552220,3sleep21999099cyclictest12:02:002
19991992213,5cyclictest0-21swapper/311:22:263
19990992218,1cyclictest0-21swapper/210:36:252
19986992216,4cyclictest3820-21sshd11:35:421
19986992211,8cyclictest18277-21grep10:00:221
19986992210,3cyclictest3150-21sshd09:25:521
19981992216,4cyclictest22820-21bash11:18:030
137812220,0sleep013768-21sshd09:16:580
137812220,0sleep013768-21sshd09:16:580
1999199217,2cyclictest2807-21bash12:20:033
1999199210,16cyclictest135650irq/27-eth010:32:383
19990992113,6cyclictest1927-21snmpd11:18:502
19986992114,4cyclictest1959-21sshd11:13:411
1998199210,17cyclictest6085-21cp12:05:230
179382210,19sleep1135650irq/27-eth011:47:051
6512201,18sleep1135650irq/27-eth007:35:511
1999199208,4cyclictest135650irq/27-eth012:30:003
1999199202,7cyclictest4737-21bash09:55:453
19991992013,5cyclictest27012-21bash10:28:143
1999099201,12cyclictest135650irq/27-eth012:07:022
19990992011,2cyclictest10950irq/23-ehci_hcd11:02:442
19986992015,3cyclictest29585-21sshd09:55:071
1998699200,18cyclictest22-21ksoftirqd/110:53:411
167152200,2sleep116718-21swap12:35:221
145382201,17sleep2135650irq/27-eth008:07:162
112152200,2sleep30-21swapper/310:36:293
1999199195,8cyclictest26903-21bash09:28:223
1999099195,3cyclictest0-21swapper/211:54:402
19990991912,4cyclictest23734-21bash09:41:092
19986991915,2cyclictest1959-21sshd12:32:221
1998199196,8cyclictest6583-21sshd11:09:560
1998199190,16cyclictest13679-21bash11:36:440
7392180,16sleep3135650irq/27-eth007:36:563
29282181,15sleep3135650irq/27-eth010:55:463
1999199185,4cyclictest32390-21sshd11:09:143
1999199182,3cyclictest29814-21sshd10:45:203
1999199181,7cyclictest27143-21sshd11:28:233
1999099184,11cyclictest0-21swapper/210:25:352
1999099181,6cyclictest10012-21sshd12:31:592
19990991814,1cyclictest0-21swapper/209:53:302
19990991812,4cyclictest1848-21nfsd11:20:382
1998699186,2cyclictest8820-21cp11:23:111
1998199187,8cyclictest18237-21sshd09:53:560
1998199181,16cyclictest0-21swapper/009:45:520
1998199180,9cyclictest0-21swapper/012:10:450
1998199180,13cyclictest14762-21sshd11:20:250
210762170,0sleep221070-21cp12:27:172
1999199174,3cyclictest25528-21bash11:51:133
1999199173,5cyclictest0-21swapper/310:13:023
1999199170,8cyclictest1846-21nfsd09:46:143
1999199170,12cyclictest3050-21sshd12:39:583
1999199170,12cyclictest12407-21bash11:13:453
1999199170,12cyclictest0-21swapper/312:34:423
1999099174,3cyclictest2114-21sshd10:42:172
1999099173,2cyclictest0-21swapper/209:01:582
1999099172,14cyclictest135650irq/27-eth011:35:212
19990991713,3cyclictest11024-21sshd09:36:412
19990991712,3cyclictest16575-21sshd10:47:182
19990991711,3cyclictest31006-21bash10:11:522
19986991715,1cyclictest0-21swapper/108:44:561
19981991713,3cyclictest3-21ksoftirqd/010:05:020
1998199170,7cyclictest0-21swapper/009:11:330
1998199170,15cyclictest24902-21sshd11:41:030
1998199170,12cyclictest6958-21sshd12:28:560
1999199165,4cyclictest1846-21nfsd10:00:193
1999199163,1cyclictest0-21swapper/312:11:203
1999199160,4cyclictest0-21swapper/311:41:203
1999199160,14cyclictest0-21swapper/311:46:473
1999199160,11cyclictest4878-21sshd12:17:213
1999099168,6cyclictest12731-21bash11:46:312
1999099166,9cyclictest10950irq/23-ehci_hcd12:20:212
1999099162,7cyclictest22202-21cp10:30:592
1999099161,13cyclictest3454-21sshd10:15:352
19990991610,4cyclictest26955-21sshd11:28:212
1999099160,1cyclictest0-21swapper/210:02:262
1998199168,4cyclictest0-21swapper/009:35:290
1998199161,12cyclictest0-21swapper/010:20:090
1998199160,9cyclictest0-21swapper/009:32:020
1998199160,9cyclictest0-21swapper/009:25:400
1998199160,15cyclictest0-21swapper/009:42:370
1998199160,14cyclictest0-21swapper/010:29:550
1999199157,6cyclictest0-21swapper/308:25:133
1999199150,6cyclictest0-21swapper/309:05:133
1999199150,6cyclictest0-21swapper/308:35:153
1999199150,14cyclictest0-21swapper/309:30:593
1999199150,13cyclictest1320-21bash11:55:233
1999099153,5cyclictest12015-21bash09:59:512
1999099153,2cyclictest0-21swapper/207:11:592
1999099153,11cyclictest135650irq/27-eth008:14:212
1999099152,9cyclictest8335-21sshd10:56:232
1999099152,5cyclictest1959-21sshd09:26:592
19990991511,3cyclictest10950irq/23-ehci_hcd07:19:572
1998199155,9cyclictest0-21swapper/008:40:110
1998199150,2cyclictest0-21swapper/009:55:130
1998199150,12cyclictest0-21swapper/010:15:090
19991991410,3cyclictest10950irq/23-ehci_hcd08:11:013
1999199140,3cyclictest135650irq/27-eth007:51:093
1999199140,12cyclictest0-21swapper/307:30:213
1999099149,3cyclictest0-21swapper/209:06:042
1999099144,2cyclictest0-21swapper/208:30:112
1999099144,2cyclictest0-21swapper/207:21:112
1999099142,6cyclictest135650irq/27-eth008:46:552
19990991411,2cyclictest3924-21munin-node08:55:152
1999099140,12cyclictest0-21swapper/208:35:182
19986991410,3cyclictest10950irq/23-ehci_hcd09:05:261
19986991410,3cyclictest10950irq/23-ehci_hcd08:03:411
19986991410,3cyclictest10950irq/23-ehci_hcd07:32:561
1998699140,13cyclictest25272-21hwlatdetect07:20:151
1998699140,13cyclictest0-21swapper/107:51:521
1998699140,10cyclictest0-21swapper/109:00:441
1998199149,2cyclictest0-21swapper/008:50:170
1998199147,4cyclictest0-21swapper/008:49:100
1998199145,6cyclictest31455-21sshd11:45:130
1998199140,3cyclictest0-21swapper/012:36:260
1998199140,12cyclictest14008-21bash11:30:160
1998199140,11cyclictest28937-21sshd10:45:160
1999199139,3cyclictest135650irq/27-eth008:55:003
1999199138,4cyclictest0-21swapper/307:20:123
1999199137,5cyclictest0-21swapper/308:00:043
1999199136,6cyclictest20295-21sed07:10:133
19991991310,2cyclictest26950irq/26-ahci[00008:50:053
1999199130,9cyclictest144550irq/28-eth1-rx-07:55:163
1999199130,5cyclictest2405-21runrttasks09:00:263
1999199130,4cyclictest17410-21cpu08:15:113
1999199130,12cyclictest144550irq/28-eth1-rx-07:26:473
1999199130,12cyclictest0-21swapper/308:45:133
1999199130,12cyclictest0-21swapper/307:15:393
1999199130,11cyclictest24118-21munin-node08:30:123
1999099137,5cyclictest0-21swapper/208:50:502
1999099137,4cyclictest20219-21munin-node08:20:112
1999099137,4cyclictest11448-21nfsd408:00:152
1999099134,1cyclictest0-21swapper/207:46:472
1999099133,2cyclictest0-21swapper/208:16:512
1999099131,6cyclictest19543-21kworker/u8:108:25:472
1999099131,2cyclictest78642sleep207:54:272
1999099131,11cyclictest135650irq/27-eth007:31:192
19990991311,1cyclictest0-21swapper/207:40:362
1999099130,5cyclictest0-21swapper/207:55:052
1999099130,12cyclictest0-21swapper/208:40:202
1999099130,12cyclictest0-21swapper/207:25:332
1998699138,4cyclictest0-21swapper/108:45:181
1998699137,5cyclictest0-21swapper/107:25:201
1998699133,9cyclictest0-21swapper/108:27:421
19986991311,1cyclictest0-21swapper/107:57:011
1998699130,8cyclictest0-21swapper/107:45:001
1998699130,4cyclictest4578-21needreboot07:45:171
1998699130,4cyclictest20157-21grep07:10:121
1998699130,12cyclictest1848-21nfsd07:15:131
1998699130,11cyclictest18030-21iostat08:15:151
1998199135,6cyclictest31637-21kworker/0:008:11:210
19981991311,1cyclictest0-21swapper/007:28:350
1998199130,1cyclictest0-21swapper/009:07:180
1998199130,12cyclictest0-21swapper/008:18:000
1998199130,12cyclictest0-21swapper/007:59:540
1998199130,12cyclictest0-21swapper/007:51:250
1998199130,12cyclictest0-21swapper/007:37:490
1998199130,12cyclictest0-21swapper/007:30:010
1998199130,10cyclictest0-21swapper/008:25:550
1998199130,10cyclictest0-21swapper/007:45:410
1999199127,4cyclictest19710-21cpu08:20:103
1999199126,1cyclictest4354-21iostat07:45:143
1999199120,3cyclictest13393-21hddtemp_smartct08:05:133
1999199120,3cyclictest1245-21sshd07:40:123
1999199120,10cyclictest28947-21df08:40:123
1999099120,10cyclictest31738-21diskstats07:35:122
1998699120,9cyclictest0-21swapper/108:12:571
1998699120,3cyclictest25417-21munin-node08:30:201
1998699120,3cyclictest13482-21iostat_ios08:05:151
1998699120,11cyclictest27177-21munin-node08:35:141
1998699120,10cyclictest2505-21munin-node08:50:241
1998699120,10cyclictest19820-21sh08:20:101
1998699120,10cyclictest0-21swapper/108:55:111
1998199127,4cyclictest0-21swapper/008:35:130
19981991210,1cyclictest0-21swapper/009:01:240
1998199120,2cyclictest0-21swapper/008:05:090
1998199120,1cyclictest0-21swapper/008:02:030
1998199120,1cyclictest0-21swapper/007:13:140
1998199120,12cyclictest0-21swapper/007:41:530
1998199120,11cyclictest0-21swapper/008:30:530
1998199120,11cyclictest0-21swapper/007:21:410
1998199120,10cyclictest0-21swapper/007:15:270
1998199110,6cyclictest0-21swapper/008:20:060
1998199110,10cyclictest0-21swapper/008:55:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional