You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 04:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Dec 05, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2278221680,2sleep01300599cyclictest22:30:390
188221510,3sleep21301399cyclictest22:00:482
2846521500,1sleep30-21swapper/323:50:103
1694521320,2sleep20-21swapper/200:31:582
992921290,1sleep10-21swapper/100:17:111
1636121280,0sleep00-21swapper/023:52:050
1361721140,2sleep013605-21sshd00:14:200
478221100,0sleep00-21swapper/023:09:550
2763921020,2sleep20-21swapper/223:56:152
232072970,1sleep223203-21cp00:25:332
188652970,1sleep03-21ksoftirqd/022:55:200
62582890,3sleep10-21swapper/122:54:091
301022890,2sleep130098-21sshd23:43:591
21172890,2sleep12113-21bash21:33:571
175172890,2sleep20-21swapper/222:48:532
175172890,1sleep21301399cyclictest00:35:262
190752870,2sleep119072-21sshd22:36:341
1269428733,50sleep10-21swapper/119:09:141
1269128734,49sleep30-21swapper/319:09:113
112142870,2sleep30-21swapper/323:10:263
271432850,1sleep30-21swapper/323:56:133
208332820,2sleep31848-21nfsd23:36:483
111092820,2sleep10-21swapper/122:04:471
71182810,2sleep37117-21bash23:29:143
270752810,2sleep20-21swapper/223:08:532
271992800,1sleep20-21swapper/200:15:352
214712790,5sleep00-21swapper/023:01:580
206982790,0sleep020690-21sshd22:52:200
22582770,1sleep02260-21nfsd419:55:190
13622770,2sleep20-21swapper/200:09:542
223892760,3sleep30-21swapper/323:33:513
58452730,3sleep05843-21sshd23:41:340
319362730,1sleep10-21swapper/122:12:401
163592670,1sleep20-21swapper/200:04:522
48342660,2sleep20-21swapper/223:50:542
306452660,3sleep31301499cyclictest22:25:133
53252640,4sleep31301499cyclictest22:41:253
81172600,3sleep31301499cyclictest00:38:003
69482540,1sleep30-21swapper/322:47:503
1256625432,9sleep20-21swapper/219:07:352
311002510,1sleep30-21swapper/300:16:003
240662490,1sleep224065-21sshd23:11:422
96272480,1sleep20-21swapper/222:29:292
278272420,0sleep00-21swapper/022:37:250
1248224133,4sleep00-21swapper/019:06:440
98352390,2sleep19825-21sshd21:16:421
13014993933,4cyclictest29182-21sshd00:22:403
1300599380,33cyclictest18422-21bash00:18:020
13005993719,5cyclictest0-21swapper/000:30:570
13010993430,3cyclictest29180-21sshd00:22:401
141212320,1sleep00-21swapper/021:35:040
13005993117,4cyclictest3-21ksoftirqd/022:27:040
113722310,2sleep10-21swapper/122:32:481
11132300,28sleep2135650irq/27-eth022:44:132
11552290,2sleep31138-21sshd21:39:523
13005992811,16cyclictest3-21ksoftirqd/023:11:370
31952270,2sleep13194-21sshd22:56:581
299362270,4sleep31301499cyclictest00:26:183
13005992713,7cyclictest3-21ksoftirqd/000:39:470
245452260,2sleep324490-21sshd22:00:003
242682260,2sleep12405-21runrttasks00:25:401
13005992615,3cyclictest3-21ksoftirqd/022:08:020
201172250,1sleep03-21ksoftirqd/022:11:320
13005992517,3cyclictest3-21ksoftirqd/023:56:220
13005992514,6cyclictest3-21ksoftirqd/023:16:080
13005992511,6cyclictest3-21ksoftirqd/023:27:370
1300599251,16cyclictest14154-21sshd00:04:390
1300599250,5cyclictest36-21rcuop/222:49:210
1300599250,1cyclictest24346-21sshd23:21:210
83562240,0sleep00-21swapper/021:49:300
161492230,3sleep10-21swapper/123:20:301
1301399230,5cyclictest25-21rcuop/122:13:522
1300599238,12cyclictest3-21ksoftirqd/000:08:090
13005992312,6cyclictest3-21ksoftirqd/022:01:260
1300599231,18cyclictest22806-21sshd23:46:220
1300599231,15cyclictest0-21swapper/023:35:490
1300599231,13cyclictest0-21swapper/022:40:560
1300599230,14cyclictest10354-21sshd00:20:280
315052220,2sleep20-21swapper/222:31:342
13005992213,4cyclictest3-21ksoftirqd/000:27:480
283562210,2sleep228349-21bash22:25:002
283562210,2sleep228349-21bash22:24:592
217602210,0sleep321750-21sshd22:21:053
217602210,0sleep321750-21sshd22:21:053
13013992115,3cyclictest135650irq/27-eth023:44:042
1301099215,8cyclictest4121-21sshd21:25:111
13005992116,3cyclictest3-21ksoftirqd/023:31:060
113212210,19sleep2135650irq/27-eth023:45:172
67112200,2sleep30-21swapper/321:25:223
52102200,1sleep05200-21bash21:10:120
36562200,1sleep00-21swapper/021:40:050
13014992015,4cyclictest11963-21sshd22:17:043
13014992015,4cyclictest11963-21sshd22:17:033
1301399203,1cyclictest1847-21nfsd00:11:142
13013992014,5cyclictest36-21rcuop/223:26:012
1300599200,13cyclictest0-21swapper/022:18:080
1300599200,13cyclictest0-21swapper/022:18:080
55202190,17sleep2135650irq/27-eth023:35:192
233652190,3sleep20-21swapper/221:32:532
13014991914,3cyclictest2167-21sshd22:38:043
13013991915,3cyclictest9508-21sshd22:51:112
13013991915,2cyclictest1847-21nfsd00:22:042
13013991914,3cyclictest20986-21sshd23:21:012
13013991913,5cyclictest10950irq/23-ehci_hcd21:24:362
13013991913,3cyclictest10950irq/23-ehci_hcd22:35:222
1301099195,1cyclictest6420-21sshd21:13:221
13010991911,4cyclictest10950irq/23-ehci_hcd23:52:401
1301099190,5cyclictest16850-21bash00:01:341
1300599190,1cyclictest25423-21sshd22:21:270
1300599190,1cyclictest25423-21sshd22:21:270
13014991814,2cyclictest1847-21nfsd00:02:393
13014991813,3cyclictest27668-21bash00:05:533
13014991812,5cyclictest1846-21nfsd23:09:033
13014991811,6cyclictest30570-21sshd21:18:403
13014991811,5cyclictest1848-21nfsd23:45:593
13014991810,5cyclictest5387-21sshd22:13:163
1301399188,8cyclictest8499-21bash23:16:332
1301399184,13cyclictest10950irq/23-ehci_hcd20:06:332
13013991814,3cyclictest29045-21cp22:09:272
13013991813,4cyclictest4142-21sshd23:32:042
1301099186,1cyclictest6932-21sshd21:55:191
1301099183,12cyclictest6390-21sshd00:07:021
13010991813,2cyclictest22578-21sshd23:46:201
13010991812,4cyclictest3961-21sshd00:37:321
1300599188,5cyclictest18699-21sshd21:26:270
110852180,2sleep11301099cyclictest23:00:541
13014991714,2cyclictest1848-21nfsd22:53:023
13014991713,3cyclictest1846-21nfsd23:16:563
13014991713,2cyclictest20189-21sshd21:47:343
13014991712,3cyclictest27868-21sshd00:12:273
13014991711,4cyclictest21426-21sshd00:32:283
1301399173,11cyclictest135650irq/27-eth020:10:212
13013991714,2cyclictest9852-21sshd21:55:312
13013991712,4cyclictest135650irq/27-eth022:17:262
13013991712,4cyclictest135650irq/27-eth022:17:262
13013991710,2cyclictest135650irq/27-eth021:16:442
1301099176,4cyclictest10950irq/23-ehci_hcd21:23:011
13010991714,2cyclictest25037-21sshd22:09:041
13010991713,3cyclictest7818-21sshd22:26:031
13010991713,3cyclictest29085-21sshd23:18:411
1301499162,13cyclictest144550irq/28-eth1-rx-23:00:353
1301499161,14cyclictest19834-21rm21:23:383
13014991611,3cyclictest0-21swapper/323:20:193
1301499161,13cyclictest0-21swapper/321:42:513
13014991610,5cyclictest1847-21nfsd22:01:133
1301399168,7cyclictest0-21swapper/222:56:282
1301399162,1cyclictest0-21swapper/219:33:122
13013991611,4cyclictest17131-21sshd21:38:192
1301399160,4cyclictest30086-21sshd21:42:282
1301099162,2cyclictest1845-21nfsd23:11:471
1300599161,4cyclictest0-21swapper/021:50:210
13005991614,1cyclictest0-21swapper/020:17:490
1300599160,15cyclictest1142-21sshd21:30:470
1300599160,15cyclictest0-21swapper/021:17:520
1300599160,15cyclictest0-21swapper/020:40:020
1301499159,3cyclictest0-21swapper/322:34:433
13014991510,4cyclictest1848-21nfsd22:09:003
1301499150,14cyclictest0-21swapper/321:05:153
1301499150,13cyclictest36-21rcuop/221:53:293
1301499150,13cyclictest0-21swapper/321:32:273
1301499150,12cyclictest21217-21sshd23:40:013
1301399153,1cyclictest6266-21sshd21:10:162
1301399153,11cyclictest10950irq/23-ehci_hcd19:36:202
1301399152,3cyclictest0-21swapper/219:27:122
1301399151,9cyclictest135650irq/27-eth021:27:452
1301399151,12cyclictest21051-21bash21:53:392
13013991510,1cyclictest27280-21sshd21:45:162
1301399150,14cyclictest0-21swapper/221:01:072
1301399150,10cyclictest48442chrt23:00:192
1301099159,5cyclictest29110-21latency21:45:221
1301099158,1cyclictest1847-21nfsd23:06:081
1301099157,1cyclictest27895-21rm22:46:431
1301099156,2cyclictest25468-21sshd21:50:591
1301099155,6cyclictest9291-21nscd00:32:021
1301099155,1cyclictest13986-21sshd22:42:161
1301099154,3cyclictest29862-21sshd23:31:221
1301099153,11cyclictest23496-21sshd22:15:081
1301099153,11cyclictest23496-21sshd22:15:081
1301099152,4cyclictest21304-21sshd21:44:431
13010991511,3cyclictest135650irq/27-eth020:34:371
13010991511,3cyclictest135650irq/27-eth020:34:371
13010991510,1cyclictest4134-21sshd00:13:211
1301099150,6cyclictest27350-21sshd21:36:131
1301099150,13cyclictest31953-21sshd23:56:401
1301099150,13cyclictest27363-21sshd22:21:401
1301099150,13cyclictest27363-21sshd22:21:401
1300599157,5cyclictest0-21swapper/019:44:020
1300599157,5cyclictest0-21swapper/019:14:010
1300599151,3cyclictest0-21swapper/021:55:220
13005991511,1cyclictest0-21swapper/020:50:320
1300599150,14cyclictest0-21swapper/021:20:380
1301499147,6cyclictest0-21swapper/320:31:393
1301499147,6cyclictest0-21swapper/320:31:383
13014991412,1cyclictest0-21swapper/319:40:183
1301499141,1cyclictest36-21rcuop/221:10:333
1301499140,5cyclictest2405-21runrttasks20:55:193
1301499140,13cyclictest20127-21idleruntime20:35:163
1301499140,13cyclictest0-21swapper/320:47:373
1301499140,12cyclictest21274-21sshd22:55:303
1301399140,3cyclictest135650irq/27-eth019:16:322
1301399140,2cyclictest0-21swapper/220:30:282
1301399140,2cyclictest0-21swapper/220:30:282
1301399140,13cyclictest135650irq/27-eth020:35:562
1301099148,0cyclictest3185-21bash23:35:101
1301099146,1cyclictest8201-21sshd23:26:071
1301099142,11cyclictest144550irq/28-eth1-rx-20:52:101
1301099141,12cyclictest0-21swapper/120:04:341
13010991410,2cyclictest0-21swapper/119:40:151
1301099140,13cyclictest0-21swapper/119:15:051
1301099140,13cyclictest0-21swapper/119:11:321
1300599148,3cyclictest0-21swapper/019:50:220
1300599148,3cyclictest0-21swapper/019:35:010
1300599147,5cyclictest0-21swapper/020:12:310
1300599140,3cyclictest0-21swapper/020:20:230
1300599140,1cyclictest0-21swapper/019:25:210
1300599140,13cyclictest0-21swapper/019:16:290
1300599140,12cyclictest0-21swapper/021:05:550
1301499137,5cyclictest0-21swapper/320:10:173
1301499137,5cyclictest0-21swapper/320:06:013
1301499130,12cyclictest0-21swapper/321:02:273
1301499130,12cyclictest0-21swapper/320:26:433
1301499130,12cyclictest0-21swapper/320:04:303
1301499130,12cyclictest0-21swapper/319:20:053
1301499130,12cyclictest0-21swapper/319:18:473
1301499130,11cyclictest31593-21diskstats19:50:133
1301499130,11cyclictest27895-21users20:50:263
1301499130,11cyclictest2405-21runrttasks20:15:103
1301499130,11cyclictest22824-21hddtemp_smartct19:30:133
1301499130,11cyclictest20624-21iostat_ios19:25:153
1301499130,11cyclictest1906-21munin-node19:55:173
1301499130,11cyclictest13300-21df19:10:133
1301399138,4cyclictest135650irq/27-eth020:21:082
1301399138,3cyclictest1923-21irqstats19:55:182
1301399137,3cyclictest135650irq/27-eth020:02:162
1301399136,3cyclictest10950irq/23-ehci_hcd19:40:172
1301399133,9cyclictest135650irq/27-eth021:05:162
1301399130,12cyclictest135650irq/27-eth020:40:142
1301399130,12cyclictest0-21swapper/220:56:472
1301399130,12cyclictest0-21swapper/220:54:262
1301399130,12cyclictest0-21swapper/220:25:082
1301399130,12cyclictest0-21swapper/220:15:102
1301399130,12cyclictest0-21swapper/219:50:152
1301399130,12cyclictest0-21swapper/219:45:422
1301399130,12cyclictest0-21swapper/219:22:122
1301099139,3cyclictest135650irq/27-eth021:05:381
1301099139,3cyclictest135650irq/27-eth020:06:271
1301099138,4cyclictest0-21swapper/120:40:281
1301099137,5cyclictest0-21swapper/120:45:571
1301099137,5cyclictest0-21swapper/120:35:141
1301099137,2cyclictest12093-21sshd20:17:091
1301099135,1cyclictest1795-21hddtemp_smartct19:55:161
1301099134,0cyclictest0-21swapper/119:30:121
1301099132,3cyclictest135650irq/27-eth019:35:051
1301099132,10cyclictest135650irq/27-eth021:00:481
13010991311,1cyclictest0-21swapper/119:52:131
1301099130,5cyclictest1927-21snmpd19:25:011
1301099130,12cyclictest16537-21taskset20:25:421
1301099130,12cyclictest0-21swapper/120:14:321
1301099130,12cyclictest0-21swapper/119:47:231
1301099130,12cyclictest0-21swapper/119:20:191
1300599138,3cyclictest0-21swapper/020:07:530
1300599133,9cyclictest5087-21munin-node20:00:240
1300599133,9cyclictest0-21swapper/019:31:250
1300599130,1cyclictest0-21swapper/019:23:240
1300599130,12cyclictest0-21swapper/019:45:530
1300599130,10cyclictest0-21swapper/020:45:050
1300599130,10cyclictest0-21swapper/020:35:220
1300599130,10cyclictest0-21swapper/020:33:000
1300599130,10cyclictest0-21swapper/020:33:000
1300599130,10cyclictest0-21swapper/020:26:540
1301499120,3cyclictest25567-21ntp_states19:35:183
1301499120,3cyclictest12903-21diskstats20:20:143
1301499120,11cyclictest1927-21snmpd19:45:053
1301499120,10cyclictest22373-21hddtemp_smartct20:40:163
1301399121,10cyclictest1847-21nfsd20:46:162
1301399120,3cyclictest13357-21diskstats19:10:122
1301099127,4cyclictest12734-21cpu20:20:131
1301099120,11cyclictest28594-21atenall_r5power20:55:131
1300599120,2cyclictest0-21swapper/020:55:170
1300599120,10cyclictest0-21swapper/021:00:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional