You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 09:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Fri Dec 05, 2025 00:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2201134997436,38cyclictest2230800-21kworker/u32:4+rpciod20:22:567
2201134997435,19cyclictest2365129-21/usr/sbin/munin00:00:267
2201134997432,40cyclictest1088-21runrttasks22:41:237
2201134997416,39cyclictest2347276-21grep23:25:267
2201132997435,38cyclictest875-21mta-sts-daemon19:55:185
2201134997232,40cyclictest0-21swapper/720:47:207
2201134997135,18cyclictest871ktimers/721:20:587
2201134997132,21cyclictest0-21swapper/721:19:207
2201134997132,20cyclictest0-21swapper/723:35:487
2201134997132,19cyclictest8750ktimers/700:40:007
2201134997113,39cyclictest2380544-21ntpq00:25:307
2201134997031,39cyclictest0-21swapper/721:40:567
2201134997031,21cyclictest0-21swapper/719:26:047
2201134997031,19cyclictest0-21swapper/720:17:097
2201134996930,21cyclictest0-21swapper/723:06:487
2201134996930,19cyclictest0-21swapper/722:54:357
2201134996930,19cyclictest0-21swapper/700:15:067
2201134996830,38cyclictest8750ktimers/700:24:077
2201134996829,20cyclictest0-21swapper/720:35:127
2201134996829,19cyclictest0-21swapper/719:48:167
2201134996728,19cyclictest0-21swapper/720:12:347
220113499666,20cyclictest0-21swapper/700:30:447
2201134996628,19cyclictest871ktimers/721:02:307
2201134996526,19cyclictest0-21swapper/719:59:527
2201134996427,18cyclictest0-21swapper/723:24:487
2201134996023,37cyclictest0-21swapper/721:35:137
2201134995919,39cyclictest362-21jbd2/sda2-819:37:147
220113099570,18cyclictest0-21swapper/319:30:163
2201134995619,37cyclictest0-21swapper/723:31:227
2201134995619,37cyclictest0-21swapper/722:33:157
2201134995537,0cyclictest0-21swapper/719:20:397
2201134995536,19cyclictest871ktimers/722:20:347
2201134995519,36cyclictest0-21swapper/721:26:217
2201134995518,18cyclictest191rcu_preempt20:51:507
2201134995436,18cyclictest88-21ksoftirqd/722:06:577
2201134995419,35cyclictest0-21swapper/700:09:327
2201134995419,15cyclictest0-21swapper/723:55:417
2201134995419,15cyclictest0-21swapper/723:54:467
2201134995419,15cyclictest0-21swapper/723:43:507
2201134995419,15cyclictest0-21swapper/723:16:147
2201134995419,15cyclictest0-21swapper/723:14:477
2201134995419,15cyclictest0-21swapper/722:47:547
2201134995419,15cyclictest0-21swapper/722:28:287
2201134995419,15cyclictest0-21swapper/722:17:487
2201134995419,15cyclictest0-21swapper/720:57:267
2201134995419,15cyclictest0-21swapper/720:44:377
2201134995419,15cyclictest0-21swapper/720:26:227
2201134995419,15cyclictest0-21swapper/719:34:177
2201134995419,15cyclictest0-21swapper/719:17:547
2201134995416,19cyclictest2289466-21expr21:45:177
2201134995415,39cyclictest0-21swapper/720:31:027
2201134995414,39cyclictest0-21swapper/721:57:337
2201132995416,19cyclictest0-21swapper/519:50:155
2201130995414,39cyclictest0-21swapper/300:05:173
2201134995319,34cyclictest0-21swapper/722:58:107
2201134995319,34cyclictest0-21swapper/721:34:547
2201134995319,15cyclictest0-21swapper/723:47:597
2201134995319,15cyclictest0-21swapper/722:12:427
2201134995319,15cyclictest0-21swapper/721:09:507
2201134995319,15cyclictest0-21swapper/720:08:497
2201134995319,15cyclictest0-21swapper/719:51:387
2201134995314,39cyclictest0-21swapper/723:02:477
2201134995314,39cyclictest0-21swapper/722:36:087
2201134995314,39cyclictest0-21swapper/722:02:207
2201134995314,39cyclictest0-21swapper/721:51:347
2201134995314,39cyclictest0-21swapper/721:11:347
2201134995314,39cyclictest0-21swapper/720:00:267
2201134995314,39cyclictest0-21swapper/719:11:047
2201134995314,39cyclictest0-21swapper/700:10:547
2201134995313,19cyclictest1088-21runrttasks19:42:247
2201132995315,38cyclictest0-21swapper/521:20:165
2201130995314,19cyclictest0-21swapper/321:00:223
2201129995214,19cyclictest0-21swapper/222:30:212
2201130995113,19cyclictest0-21swapper/322:20:163
2201132995013,37cyclictest0-21swapper/523:40:165
2201132995012,38cyclictest0-21swapper/519:40:165
2201132994931,18cyclictest0-21swapper/519:30:165
220113299489,38cyclictest0-21swapper/521:05:205
2201128994829,19cyclictest0-21swapper/119:45:181
220113299479,19cyclictest0-21swapper/522:35:185
220113099479,19cyclictest0-21swapper/319:20:153
220112999479,19cyclictest0-21swapper/223:55:202
2201128994728,19cyclictest321rcuc/122:55:191
2201129994644,1cyclictest421ktimers/200:25:242
220112999446,19cyclictest0-21swapper/221:20:172
220112999446,19cyclictest0-21swapper/200:35:212
220112999445,39cyclictest0-21swapper/221:10:162
220112899446,19cyclictest0-21swapper/121:20:171
220113299435,19cyclictest0-21swapper/520:35:175
220113099424,19cyclictest0-21swapper/320:10:183
2201130994222,19cyclictest0-21swapper/320:20:173
220113399413,19cyclictest0-21swapper/623:55:206
220112799400,40cyclictest0-21swapper/022:26:500
2201129993921,18cyclictest876-21mta-sts-daemon23:35:172
220112899390,39cyclictest321rcuc/123:20:161
220113099380,19cyclictest0-21swapper/322:45:183
220112999380,19cyclictest0-21swapper/223:50:152
220112999380,19cyclictest0-21swapper/219:15:162
220113199370,35cyclictest0-21swapper/420:30:234
2201132993618,0cyclictest0-21swapper/521:55:205
220112899360,17cyclictest0-21swapper/100:30:181
2201127993617,0cyclictest2327808-21kworker/0:0+ice23:05:190
220113399350,35cyclictest0-21swapper/622:55:186
220113399350,15cyclictest0-21swapper/621:15:176
2201131993514,20cyclictest0-21swapper/420:10:184
220113199350,35cyclictest0-21swapper/419:55:184
2201130993515,19cyclictest0-21swapper/323:25:183
220113099350,16cyclictest0-21swapper/323:50:163
220113099350,15cyclictest0-21swapper/300:15:183
220112999350,15cyclictest0-21swapper/221:50:152
220112999350,15cyclictest0-21swapper/221:40:152
2201134993415,19cyclictest2201143-21unin-run19:10:017
220113399340,34cyclictest0-21swapper/622:05:186
2201131993414,19cyclictest0-21swapper/419:25:164
220113199340,34cyclictest0-21swapper/420:40:174
220113199340,34cyclictest0-21swapper/400:20:174
220113199340,15cyclictest0-21swapper/422:05:174
220113199340,14cyclictest0-21swapper/422:10:184
2201130993415,19cyclictest0-21swapper/321:35:153
2201130993414,19cyclictest0-21swapper/321:50:163
220113099340,15cyclictest0-21swapper/322:55:193
220112999340,34cyclictest0-21swapper/220:50:202
220112999340,34cyclictest0-21swapper/220:25:172
220112999340,15cyclictest0-21swapper/220:30:232
220112899340,15cyclictest0-21swapper/122:35:181
2201133993314,19cyclictest0-21swapper/622:50:186
2201133993314,19cyclictest0-21swapper/620:50:206
220113399330,33cyclictest0-21swapper/600:25:246
2201132993314,19cyclictest0-21swapper/523:45:195
2201132993314,19cyclictest0-21swapper/523:20:165
2201132993314,19cyclictest0-21swapper/520:25:175
2201132993314,19cyclictest0-21swapper/500:15:185
2201132993314,19cyclictest0-21swapper/500:10:185
2201131993314,19cyclictest0-21swapper/423:35:184
2201131993314,19cyclictest0-21swapper/422:45:184
2201131993314,19cyclictest0-21swapper/421:45:194
2201131993314,19cyclictest0-21swapper/421:40:164
2201131993314,19cyclictest0-21swapper/420:55:184
2201131993314,19cyclictest0-21swapper/420:05:174
2201131993314,19cyclictest0-21swapper/419:50:164
2201131993314,19cyclictest0-21swapper/400:30:184
2201130993314,19cyclictest0-21swapper/323:45:193
2201130993314,19cyclictest0-21swapper/323:10:273
2201130993314,19cyclictest0-21swapper/322:25:273
2201130993314,19cyclictest0-21swapper/322:00:163
2201130993314,19cyclictest0-21swapper/319:40:163
2201130993314,19cyclictest0-21swapper/319:15:163
2201130993314,19cyclictest0-21swapper/300:25:253
2201130993314,19cyclictest0-21swapper/300:00:183
2201130993313,19cyclictest0-21swapper/320:50:193
2201129993314,19cyclictest0-21swapper/222:50:182
2201129993314,19cyclictest0-21swapper/221:30:222
2201129993314,19cyclictest0-21swapper/220:20:162
2201129993314,19cyclictest0-21swapper/219:45:182
2201129993313,20cyclictest0-21swapper/219:35:162
2201128993314,19cyclictest0-21swapper/121:00:211
220112899330,14cyclictest0-21swapper/100:10:181
2201127993314,19cyclictest0-21swapper/023:00:170
2201127993314,19cyclictest0-21swapper/022:45:180
2201127993314,19cyclictest0-21swapper/022:05:180
2201127993314,19cyclictest0-21swapper/020:30:220
2201127993314,19cyclictest0-21swapper/019:45:170
2201127993314,19cyclictest0-21swapper/019:35:160
2201127993314,19cyclictest0-21swapper/019:25:160
220112799330,14cyclictest0-21swapper/022:40:190
220112799330,14cyclictest0-21swapper/021:15:170
220113399328,19cyclictest0-21swapper/622:25:206
2201133993213,19cyclictest0-21swapper/623:00:176
2201133993213,19cyclictest0-21swapper/622:40:196
2201133993213,19cyclictest0-21swapper/621:35:156
2201132993213,19cyclictest0-21swapper/521:10:155
2201132993213,19cyclictest0-21swapper/520:15:175
2201131993214,18cyclictest0-21swapper/419:20:144
2201131993213,19cyclictest0-21swapper/422:40:184
2201131993213,19cyclictest0-21swapper/422:00:164
2201131993213,19cyclictest0-21swapper/421:55:194
2201131993213,19cyclictest0-21swapper/420:45:174
2201131993213,19cyclictest0-21swapper/419:10:174
2201131993213,19cyclictest0-21swapper/400:00:194
2201131993213,18cyclictest23490682chrt23:30:234
2201131993213,18cyclictest0-21swapper/421:30:234
2201131993212,19cyclictest0-21swapper/423:45:184
2201130993213,19cyclictest0-21swapper/323:20:173
2201130993213,19cyclictest0-21swapper/321:55:203
2201130993213,19cyclictest0-21swapper/321:05:193
2201130993213,19cyclictest0-21swapper/300:20:183
2201129993213,19cyclictest0-21swapper/221:35:152
2201129993213,19cyclictest0-21swapper/200:10:182
2201128993213,19cyclictest0-21swapper/120:45:171
2201128993213,19cyclictest0-21swapper/120:00:181
2201127993213,19cyclictest0-21swapper/022:55:200
2201127993213,19cyclictest0-21swapper/022:30:200
2201127993213,19cyclictest0-21swapper/021:05:190
2201133993112,19cyclictest0-21swapper/621:50:166
2201133993112,19cyclictest0-21swapper/620:00:186
2201133993112,19cyclictest0-21swapper/600:30:196
2201132993112,19cyclictest0-21swapper/523:30:225
2201132993112,19cyclictest0-21swapper/523:10:215
2201132993112,19cyclictest0-21swapper/520:55:185
2201132993112,19cyclictest0-21swapper/519:10:175
2201131993113,0cyclictest0-21swapper/423:00:164
2201131993113,0cyclictest0-21swapper/420:35:184
2201131993112,19cyclictest0-21swapper/423:15:174
2201131993112,19cyclictest0-21swapper/422:35:254
2201131993112,19cyclictest0-21swapper/421:10:164
2201131993112,19cyclictest0-21swapper/420:15:164
2201130993113,0cyclictest0-21swapper/322:30:203
2201130993112,19cyclictest0-21swapper/322:15:153
2201130993112,19cyclictest0-21swapper/321:25:183
2201130993112,19cyclictest0-21swapper/320:35:183
2201130993112,19cyclictest0-21swapper/300:35:203
2201129993112,19cyclictest0-21swapper/223:00:172
2201129993112,19cyclictest0-21swapper/219:25:152
2201128993113,18cyclictest0-21swapper/119:30:151
2201128993112,19cyclictest0-21swapper/123:40:171
2201128993112,19cyclictest0-21swapper/120:40:241
2201127993113,18cyclictest0-21swapper/020:10:180
220113399307,19cyclictest0-21swapper/623:40:176
2201133993011,19cyclictest0-21swapper/623:25:186
2201133993011,19cyclictest0-21swapper/622:20:176
2201132993011,19cyclictest0-21swapper/521:30:225
2201131993011,19cyclictest0-21swapper/419:15:164
2201130993011,19cyclictest0-21swapper/323:05:193
2201129993011,19cyclictest0-21swapper/222:10:182
2201127993011,19cyclictest0-21swapper/021:40:160
220113399299,1cyclictest0-21swapper/600:35:206
2201132992911,0cyclictest0-21swapper/519:15:155
2201132992910,19cyclictest0-21swapper/523:35:175
2201132992910,19cyclictest0-21swapper/522:00:165
2201131992911,0cyclictest0-21swapper/423:25:194
2201131992910,19cyclictest0-21swapper/422:25:204
2201131992910,19cyclictest0-21swapper/419:45:184
220113099299,19cyclictest0-21swapper/322:05:183
2201130992910,19cyclictest0-21swapper/323:55:193
2201130992910,19cyclictest0-21swapper/323:15:163
2201129992910,19cyclictest0-21swapper/223:25:192
2201129992910,19cyclictest0-21swapper/223:05:182
2201129992910,19cyclictest0-21swapper/222:40:192
2201129992910,19cyclictest0-21swapper/220:00:232
2201127992911,18cyclictest0-21swapper/022:15:160
2201127992910,19cyclictest0-21swapper/020:40:170
220113399289,19cyclictest0-21swapper/623:50:166
220113299289,19cyclictest0-21swapper/520:05:185
220113299289,19cyclictest0-21swapper/520:00:175
220112999289,19cyclictest0-21swapper/220:45:162
220113299278,19cyclictest0-21swapper/522:40:195
220113199277,19cyclictest0-21swapper/419:40:154
220113099277,19cyclictest0-21swapper/322:40:253
220112999278,19cyclictest0-21swapper/220:55:182
220113399268,18cyclictest0-21swapper/621:20:176
220112999266,1cyclictest0-21swapper/219:30:162
220112899267,19cyclictest0-21swapper/120:05:181
220113399256,19cyclictest0-21swapper/623:05:186
220113299256,19cyclictest0-21swapper/520:10:245
220113199256,19cyclictest0-21swapper/422:15:144
220113099255,19cyclictest0-21swapper/320:40:183
220113299245,19cyclictest0-21swapper/521:40:155
220113199245,19cyclictest0-21swapper/420:00:184
220113099245,19cyclictest0-21swapper/300:10:173
2201130992419,4cyclictest2191939-21kworker/3:2+events19:10:043
220112899246,18cyclictest0-21swapper/119:55:181
2201133992320,3cyclictest1089-21snmpd22:46:346
220113199234,19cyclictest0-21swapper/421:35:144
220113199230,20cyclictest0-21swapper/419:34:514
220112999234,19cyclictest0-21swapper/223:40:162
220112899235,18cyclictest0-21swapper/122:20:171
220113399223,19cyclictest0-21swapper/621:10:166
220113199223,19cyclictest0-21swapper/419:35:164
2201130992219,3cyclictest2191939-21kworker/3:2+events21:11:443
220112899220,21cyclictest0-21swapper/122:31:061
220112799220,22cyclictest0-21swapper/021:23:020
220112799220,22cyclictest0-21swapper/000:37:490
220113399210,21cyclictest0-21swapper/620:42:406
220113299212,19cyclictest0-21swapper/500:35:215
220113199212,19cyclictest0-21swapper/422:20:184
220113199211,20cyclictest0-21swapper/420:25:164
220113199210,19cyclictest0-21swapper/423:07:204
2201130992120,1cyclictest2277515-21kworker/3:1+events23:33:203
2201130992120,1cyclictest2191939-21kworker/3:2+events19:35:553
2201130992118,3cyclictest2277515-21kworker/3:1+events23:40:013
2201130992118,3cyclictest2277515-21kworker/3:1+events21:25:023
2201130992117,3cyclictest2277515-21kworker/3:1+events22:35:263
220113099210,20cyclictest0-21swapper/320:05:243
2201127992120,1cyclictest2224790-21ethtool19:50:160
220112799210,21cyclictest0-21swapper/023:56:020
220112799210,21cyclictest0-21swapper/023:31:580
220112799210,21cyclictest0-21swapper/023:27:050
220112799210,21cyclictest0-21swapper/023:24:300
220112799210,21cyclictest0-21swapper/021:54:420
220112799210,21cyclictest0-21swapper/021:36:290
220112799210,21cyclictest0-21swapper/021:02:380
220112799210,21cyclictest0-21swapper/020:57:250
220112799210,21cyclictest0-21swapper/020:28:100
220112799210,21cyclictest0-21swapper/020:18:020
220112799210,21cyclictest0-21swapper/019:33:300
220112799210,21cyclictest0-21swapper/019:23:450
220112799210,21cyclictest0-21swapper/019:13:160
220112799210,20cyclictest0-21swapper/000:08:340
220112799210,0cyclictest0-21swapper/023:49:410
220112799210,0cyclictest0-21swapper/020:36:580
2201133992020,0cyclictest2216350-21mii-tool19:35:156
2201133992019,1cyclictest2295466-21cat21:55:206
2201133992019,1cyclictest2244427-21mii-tool20:25:176
2201133992019,1cyclictest2241647-21mii-tool20:20:166
2201133992019,1cyclictest2205114-21ethtool19:15:166
2201133992019,1cyclictest1089-21snmpd20:35:286
2201133992019,1cyclictest1080-21lldpd22:39:056
220113399201,19cyclictest0-21swapper/623:30:236
220113399200,20cyclictest0-21swapper/621:40:086
220113399200,20cyclictest0-21swapper/620:33:446
220113399200,20cyclictest0-21swapper/620:05:216
220113399200,20cyclictest0-21swapper/619:33:536
220113399200,20cyclictest0-21swapper/600:16:256
220113399200,20cyclictest0-21swapper/600:06:346
2201132992019,1cyclictest1089-21snmpd00:32:505
220113299201,19cyclictest0-21swapper/522:50:185
220113299201,19cyclictest0-21swapper/520:50:195
220113299200,20cyclictest0-21swapper/522:49:015
220113299200,20cyclictest0-21swapper/519:46:035
220113299200,19cyclictest0-21swapper/522:25:195
2201131992020,0cyclictest2273015-21mii-tool21:15:184
220113199200,1cyclictest0-21swapper/422:31:064
2201130992020,0cyclictest2277515-21kworker/3:1+events23:41:063
2201130992020,0cyclictest2277515-21kworker/3:1+events23:01:103
2201130992020,0cyclictest2277515-21kworker/3:1+events22:50:063
2201130992020,0cyclictest2277515-21kworker/3:1+events22:10:173
2201130992020,0cyclictest2277515-21kworker/3:1+events21:45:343
2201130992020,0cyclictest2277515-21kworker/3:1+events21:30:183
2201130992020,0cyclictest2277515-21kworker/3:1+events00:30:063
2201130992020,0cyclictest2191939-21kworker/3:2+events21:15:373
2201130992020,0cyclictest2191939-21kworker/3:2+events20:46:043
2201130992020,0cyclictest2191939-21kworker/3:2+events20:30:253
2201130992020,0cyclictest2191939-21kworker/3:2+events20:25:063
2201130992020,0cyclictest2191939-21kworker/3:2+events20:15:103
2201130992020,0cyclictest2191939-21kworker/3:2+events20:01:303
2201130992020,0cyclictest2191939-21kworker/3:2+events19:55:593
2201130992020,0cyclictest2191939-21kworker/3:2+events19:50:343
2201130992020,0cyclictest2191939-21kworker/3:2+events19:25:143
2201130992019,1cyclictest1089-21snmpd20:55:243
2201130992019,0cyclictest2277515-21kworker/3:1+events21:40:043
2201130992019,0cyclictest2191939-21kworker/3:2+events19:45:093
2201129992020,0cyclictest2301093-21mii-tool22:05:182
2201129992019,1cyclictest1089-21snmpd20:38:102
2201129992019,1cyclictest1089-21snmpd20:12:142
2201129992019,0cyclictest2312325-21mii-tool22:25:202
2201129992018,1cyclictest1089-21snmpd00:30:162
220112999201,19cyclictest0-21swapper/221:55:262
220112999200,20cyclictest0-21swapper/222:46:272
2201128992020,0cyclictest1089-21snmpd21:39:051
220112899200,20cyclictest0-21swapper/122:42:421
2201127992020,0cyclictest2340618-21mii-tool23:15:170
2201127992019,1cyclictest2289853-21mii-tool21:45:200
2201127992019,1cyclictest1089-21snmpd21:55:530
220112799200,20cyclictest0-21swapper/023:50:380
220112799200,20cyclictest0-21swapper/023:42:140
220112799200,20cyclictest0-21swapper/023:11:170
220112799200,20cyclictest0-21swapper/022:51:540
220112799200,20cyclictest0-21swapper/022:22:050
220112799200,20cyclictest0-21swapper/021:27:010
220112799200,20cyclictest0-21swapper/021:12:500
220112799200,20cyclictest0-21swapper/020:06:490
220112799200,20cyclictest0-21swapper/020:03:580
220112799200,20cyclictest0-21swapper/000:33:540
220112799200,20cyclictest0-21swapper/000:29:260
220112799200,20cyclictest0-21swapper/000:22:090
220112799200,20cyclictest0-21swapper/000:17:340
220112799200,20cyclictest0-21swapper/000:13:050
220112799200,0cyclictest0-21swapper/023:35:290
220112799200,0cyclictest0-21swapper/000:01:580
2201133991919,0cyclictest2357488-21ethtool23:45:196
2201133991919,0cyclictest2281449-21mii-tool21:30:236
2201133991919,0cyclictest1089-21snmpd19:45:206
2201133991914,5cyclictest0-21swapper/600:10:176
220113399190,19cyclictest0-21swapper/623:15:166
220113399190,19cyclictest0-21swapper/623:13:176
220113399190,19cyclictest0-21swapper/620:17:186
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional