You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 00:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Tue Sep 16, 2025 12:46:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36153979910568,19cyclictest171ktimers/011:15:180
361539799678,59cyclictest0-21swapper/008:05:160
361539799678,59cyclictest0-21swapper/008:05:160
361540099635,39cyclictest3765617-21grep11:30:303
3615400996324,19cyclictest0-21swapper/309:52:143
361540099624,39cyclictest3617219-21/usr/sbin/munin07:10:233
3615400996222,39cyclictest3660630-21systemctl08:30:023
3615400996020,39cyclictest0-21swapper/311:14:323
361540099590,58cyclictest0-21swapper/309:47:563
3615400995719,19cyclictest0-21swapper/310:27:363
3615400995717,39cyclictest3670510-21meminfo08:45:213
3615400995717,39cyclictest3662334-21ntp_states08:30:233
3615399995719,38cyclictest0-21swapper/209:20:162
3615400995615,39cyclictest3644846-21/usr/sbin/munin08:00:153
3615400995536,18cyclictest3793202-21/usr/sbin/munin12:20:203
3615400995536,18cyclictest3725918-21perf10:25:013
3615400995535,19cyclictest3781759-21irqstats12:00:193
3615400995414,39cyclictest0-21swapper/312:18:483
3615400995414,39cyclictest0-21swapper/311:43:043
3615400995414,39cyclictest0-21swapper/309:22:433
3615400995413,19cyclictest3629525-21munin-run07:35:013
3615400995333,19cyclictest0-21swapper/311:20:223
3615400995314,39cyclictest0-21swapper/310:05:163
3615400995314,39cyclictest0-21swapper/309:44:403
3615400995314,39cyclictest0-21swapper/309:29:023
3615400995314,39cyclictest0-21swapper/308:10:073
3615400995313,39cyclictest0-21swapper/312:11:093
3615400995313,39cyclictest0-21swapper/311:45:123
3615400995313,39cyclictest0-21swapper/309:05:283
3615400995313,39cyclictest0-21swapper/307:22:463
3615400995214,19cyclictest0-21swapper/310:31:093
3615400995213,39cyclictest0-21swapper/311:56:363
3615400995213,39cyclictest0-21swapper/310:44:243
3615400995132,19cyclictest0-21swapper/308:42:423
3615400995131,19cyclictest0-21swapper/311:01:483
3615400995113,19cyclictest1-21systemd08:25:013
3615400995113,19cyclictest0-21swapper/310:15:173
3615400995113,19cyclictest0-21swapper/309:55:253
3615400995112,39cyclictest0-21swapper/307:37:153
3615400995111,39cyclictest783-21mta-sts-daemon12:28:363
3615400995111,39cyclictest0-21swapper/311:18:213
3615400995111,39cyclictest0-21swapper/310:59:543
3615400995111,39cyclictest0-21swapper/310:01:143
3615400995111,39cyclictest0-21swapper/307:47:203
3615400995111,39cyclictest0-21swapper/307:47:193
3615399995113,19cyclictest0-21swapper/208:25:162
3615400995032,18cyclictest0-21swapper/310:54:203
3615400995011,38cyclictest0-21swapper/310:45:023
3615400995010,39cyclictest0-21swapper/312:05:263
3615400995010,39cyclictest0-21swapper/307:41:553
3615400995010,39cyclictest0-21swapper/307:41:553
3615400995010,39cyclictest0-21swapper/307:17:173
361540099499,39cyclictest0-21swapper/312:35:543
361540099499,39cyclictest0-21swapper/312:30:483
361540099499,39cyclictest0-21swapper/311:36:073
361540099498,39cyclictest0-21swapper/308:05:273
361540099498,39cyclictest0-21swapper/308:05:273
3615400994931,18cyclictest0-21swapper/307:50:413
3615400994930,19cyclictest0-21swapper/308:15:063
3615400994929,19cyclictest0-21swapper/309:00:133
3615400994911,19cyclictest0-21swapper/309:30:183
3615400994910,39cyclictest0-21swapper/310:35:563
3615400994910,39cyclictest0-21swapper/309:18:103
361540099489,39cyclictest0-21swapper/308:57:343
361540099488,39cyclictest0-21swapper/310:11:223
361540099488,39cyclictest0-21swapper/309:38:203
361540099488,39cyclictest0-21swapper/308:52:333
3615400994829,19cyclictest0-21swapper/311:05:023
361539999489,39cyclictest0-21swapper/209:35:162
361540399478,39cyclictest0-21swapper/611:09:216
361540199468,19cyclictest0-21swapper/409:25:174
361540099467,39cyclictest3643792-21munin-run08:00:013
361540099467,39cyclictest0-21swapper/308:36:013
3615400994627,19cyclictest0-21swapper/309:14:313
361539799468,19cyclictest0-21swapper/012:35:180
3615403994527,18cyclictest0-21swapper/609:15:116
3615401994527,18cyclictest0-21swapper/407:15:244
361540099456,39cyclictest0-21swapper/311:25:213
361540099456,19cyclictest0-21swapper/307:29:033
361540199446,19cyclictest0-21swapper/410:00:184
361540099445,39cyclictest0-21swapper/311:51:043
361540199436,18cyclictest0-21swapper/407:35:134
361540199435,19cyclictest0-21swapper/411:35:214
361540199424,19cyclictest0-21swapper/409:00:214
361540399413,19cyclictest0-21swapper/611:15:176
361540499391,19cyclictest0-21swapper/712:20:217
361540499390,39cyclictest0-21swapper/708:05:177
361540499390,39cyclictest0-21swapper/708:05:167
3615403993938,0cyclictest3721356-21fschecks_time10:15:166
361540499381,37cyclictest3609297-21kworker/7:2+events07:50:277
3615401993813,20cyclictest0-21swapper/411:50:164
3615404993719,18cyclictest0-21swapper/707:25:157
361540399370,18cyclictest0-21swapper/610:30:166
361540199370,18cyclictest0-21swapper/407:10:164
361540399360,17cyclictest0-21swapper/608:50:196
361540399360,17cyclictest0-21swapper/608:45:176
361540199360,17cyclictest0-21swapper/411:00:184
3615404993514,20cyclictest0-21swapper/709:00:217
361540199350,35cyclictest0-21swapper/410:25:184
361540199350,35cyclictest0-21swapper/409:45:214
361539999350,35cyclictest0-21swapper/211:45:172
361540499340,34cyclictest0-21swapper/710:47:407
361540499340,15cyclictest0-21swapper/712:30:207
361540499340,15cyclictest0-21swapper/711:25:167
361540499340,15cyclictest0-21swapper/709:35:167
3615403993415,19cyclictest0-21swapper/611:10:196
3615403993415,19cyclictest0-21swapper/607:40:186
3615403993415,19cyclictest0-21swapper/607:40:186
3615403993414,19cyclictest0-21swapper/609:35:166
361540399340,15cyclictest0-21swapper/611:40:166
3615401993414,19cyclictest0-21swapper/410:10:174
361540199340,34cyclictest0-21swapper/407:20:174
361540199340,15cyclictest0-21swapper/408:15:184
361539999340,34cyclictest0-21swapper/207:40:182
361539999340,34cyclictest0-21swapper/207:40:182
361539799340,15cyclictest0-21swapper/010:55:180
3615404993314,19cyclictest0-21swapper/712:10:187
3615404993314,19cyclictest0-21swapper/712:05:187
3615404993314,19cyclictest0-21swapper/711:30:237
3615404993314,19cyclictest0-21swapper/707:40:197
3615404993314,19cyclictest0-21swapper/707:40:187
3615403993314,19cyclictest0-21swapper/612:15:176
3615403993314,19cyclictest0-21swapper/611:45:226
3615403993314,19cyclictest0-21swapper/610:50:176
3615403993314,19cyclictest0-21swapper/610:05:226
3615403993314,19cyclictest0-21swapper/609:50:166
3615403993314,19cyclictest0-21swapper/609:45:226
3615403993314,19cyclictest0-21swapper/609:00:226
3615403993314,19cyclictest0-21swapper/608:25:166
3615403993314,19cyclictest0-21swapper/608:15:196
3615403993314,0cyclictest0-21swapper/607:10:176
3615401993314,19cyclictest0-21swapper/412:05:184
3615401993314,19cyclictest0-21swapper/408:10:224
3615401993314,19cyclictest0-21swapper/408:00:154
3615401993314,19cyclictest0-21swapper/407:25:154
3615399993314,19cyclictest0-21swapper/212:25:162
3615399993314,19cyclictest0-21swapper/208:55:182
361539999330,14cyclictest0-21swapper/209:55:162
3615397993314,19cyclictest0-21swapper/010:45:220
3615397993314,19cyclictest0-21swapper/008:50:180
3615397993314,19cyclictest0-21swapper/008:15:180
3615397993314,19cyclictest0-21swapper/007:45:190
3615397993314,19cyclictest0-21swapper/007:45:190
3615397993313,19cyclictest0-21swapper/008:55:180
3615404993214,18cyclictest0-21swapper/707:20:177
3615404993213,19cyclictest0-21swapper/710:20:177
3615403993213,19cyclictest0-21swapper/611:30:226
3615403993213,19cyclictest0-21swapper/610:45:226
3615403993213,19cyclictest0-21swapper/610:10:176
3615403993213,19cyclictest0-21swapper/609:10:186
3615401993214,18cyclictest0-21swapper/410:30:164
3615401993214,0cyclictest0-21swapper/411:20:174
3615401993213,19cyclictest0-21swapper/411:40:154
3615401993213,19cyclictest0-21swapper/410:20:174
3615401993213,19cyclictest0-21swapper/408:30:184
3615401993213,19cyclictest0-21swapper/408:05:174
3615401993213,19cyclictest0-21swapper/408:05:164
3615399993213,19cyclictest0-21swapper/209:15:172
3615399993213,19cyclictest0-21swapper/209:10:172
3615397993213,19cyclictest0-21swapper/011:35:220
3615397993213,19cyclictest0-21swapper/008:00:150
3615397993213,19cyclictest0-21swapper/007:35:130
3615404993112,19cyclictest0-21swapper/711:05:177
3615404993112,19cyclictest0-21swapper/709:55:167
3615404993112,19cyclictest0-21swapper/708:20:207
3615404993111,19cyclictest0-21swapper/711:55:167
3615403993112,19cyclictest0-21swapper/611:57:236
3615403993112,19cyclictest0-21swapper/607:55:176
3615401993112,19cyclictest0-21swapper/407:30:184
3615399993112,19cyclictest0-21swapper/209:05:182
3615397993112,19cyclictest0-21swapper/011:50:160
3615404993011,19cyclictest0-21swapper/710:50:187
3615404993010,19cyclictest0-21swapper/708:30:187
3615403993011,19cyclictest0-21swapper/612:25:156
3615403993011,19cyclictest0-21swapper/610:55:186
3615401993011,19cyclictest0-21swapper/410:05:224
3615399993011,19cyclictest0-21swapper/208:10:212
3615397993011,19cyclictest0-21swapper/010:40:200
3615397993011,19cyclictest0-21swapper/010:20:170
3615403992910,19cyclictest0-21swapper/611:20:236
3615401992927,2cyclictest90850irq/69-eno6-TxRx-710:56:284
3615399992910,19cyclictest0-21swapper/207:35:142
3615397992911,0cyclictest0-21swapper/009:00:210
361540499289,19cyclictest0-21swapper/708:25:167
361540399289,19cyclictest0-21swapper/610:03:156
361540399289,19cyclictest0-21swapper/609:55:166
361540399289,19cyclictest0-21swapper/609:05:186
361539999289,19cyclictest0-21swapper/210:50:172
361539799289,19cyclictest221rcuc/007:30:190
361540399278,19cyclictest0-21swapper/610:27:166
361540399278,19cyclictest0-21swapper/607:25:156
3615403992725,1cyclictest3586226-21kworker/u32:4+events_unbound07:45:066
3615403992725,1cyclictest3586226-21kworker/u32:4+events_unbound07:45:056
361540199278,19cyclictest0-21swapper/410:40:194
361540199278,19cyclictest0-21swapper/410:35:184
361540199278,19cyclictest0-21swapper/409:37:494
361540199278,19cyclictest0-21swapper/407:45:204
361540199278,19cyclictest0-21swapper/407:45:194
361539999278,19cyclictest0-21swapper/211:35:212
361539799279,18cyclictest0-21swapper/010:35:180
361539799278,19cyclictest0-21swapper/011:20:170
361540399267,19cyclictest0-21swapper/609:27:126
361540399267,19cyclictest0-21swapper/608:20:206
361540399267,19cyclictest0-21swapper/607:39:046
361540399267,19cyclictest0-21swapper/607:15:026
361540199267,19cyclictest0-21swapper/410:45:224
361540199267,19cyclictest0-21swapper/409:40:204
361540199266,20cyclictest0-21swapper/409:50:164
3615401992626,0cyclictest0-21swapper/407:52:234
361539799268,18cyclictest0-21swapper/012:30:190
361540499256,19cyclictest0-21swapper/711:00:187
361540499256,19cyclictest0-21swapper/709:30:197
361540399256,19cyclictest0-21swapper/612:21:256
361540399256,19cyclictest0-21swapper/610:35:186
361540399256,19cyclictest0-21swapper/608:57:106
361540399256,19cyclictest0-21swapper/608:40:146
361540399256,19cyclictest0-21swapper/608:00:156
361540199256,19cyclictest0-21swapper/411:05:234
361540199256,19cyclictest0-21swapper/409:05:184
361540199256,19cyclictest0-21swapper/408:20:264
361539999256,19cyclictest0-21swapper/207:50:272
3615404992420,4cyclictest3754797-21kworker/7:1+events11:45:417
3615404992420,4cyclictest3638234-21kworker/7:0+events10:32:567
3615404992420,4cyclictest3638234-21kworker/7:0+events10:14:187
3615404992420,4cyclictest3638234-21kworker/7:0+events10:07:217
3615404992420,4cyclictest3638234-21kworker/7:0+events09:07:027
3615404992420,4cyclictest3638234-21kworker/7:0+events08:38:397
3615404992419,5cyclictest3754797-21kworker/7:1+events12:16:087
3615404992419,4cyclictest3754797-21kworker/7:1+events12:00:227
3615404992419,4cyclictest3609297-21kworker/7:2+events07:35:057
361540399246,18cyclictest0-21swapper/609:33:126
361540399246,18cyclictest0-21swapper/607:33:046
361540399245,19cyclictest0-21swapper/612:39:276
361540399245,19cyclictest0-21swapper/612:33:266
361540399245,19cyclictest0-21swapper/612:03:246
361540399245,19cyclictest0-21swapper/611:27:216
361540399245,19cyclictest0-21swapper/611:03:196
361540399245,19cyclictest0-21swapper/608:39:086
361540399245,19cyclictest0-21swapper/608:30:186
361540299245,19cyclictest0-21swapper/509:55:165
361540299245,19cyclictest0-21swapper/509:40:195
361540299245,19cyclictest0-21swapper/509:10:175
361540299244,19cyclictest0-21swapper/512:35:185
3615401992424,0cyclictest0-21swapper/412:04:424
361539799245,19cyclictest0-21swapper/011:25:170
3615404992320,3cyclictest3754797-21kworker/7:1+events11:21:327
3615404992320,3cyclictest3638234-21kworker/7:0+events10:43:017
3615404992320,3cyclictest3638234-21kworker/7:0+events10:25:467
3615404992320,3cyclictest3638234-21kworker/7:0+events09:41:547
3615404992320,3cyclictest3638234-21kworker/7:0+events09:25:367
3615404992320,3cyclictest3638234-21kworker/7:0+events09:24:347
3615404992320,3cyclictest3638234-21kworker/7:0+events09:11:187
3615404992320,3cyclictest3638234-21kworker/7:0+events08:40:347
3615404992320,3cyclictest3609297-21kworker/7:2+events07:10:497
3615404992319,4cyclictest3754797-21kworker/7:1+events12:26:227
3615404992319,4cyclictest3754797-21kworker/7:1+events11:50:267
3615404992319,4cyclictest3754797-21kworker/7:1+events11:43:027
3615404992319,4cyclictest3754797-21kworker/7:1+events11:37:267
3615404992319,4cyclictest3754797-21kworker/7:1+events11:15:407
3615404992319,4cyclictest3638234-21kworker/7:0+events11:11:147
3615404992319,4cyclictest3638234-21kworker/7:0+events10:55:467
3615404992319,4cyclictest3638234-21kworker/7:0+events10:35:547
3615404992319,4cyclictest3638234-21kworker/7:0+events10:15:447
3615404992319,4cyclictest3638234-21kworker/7:0+events10:00:227
3615404992319,4cyclictest3638234-21kworker/7:0+events09:45:467
3615404992319,4cyclictest3638234-21kworker/7:0+events09:15:307
3615404992319,4cyclictest3638234-21kworker/7:0+events08:55:027
3615404992319,4cyclictest3638234-21kworker/7:0+events08:50:267
3615404992319,4cyclictest3638234-21kworker/7:0+events08:45:027
3615404992319,4cyclictest3638234-21kworker/7:0+events08:16:397
3615404992319,4cyclictest3638234-21kworker/7:0+events08:10:317
3615404992319,4cyclictest3609297-21kworker/7:2+events07:55:047
3615404992319,4cyclictest3609297-21kworker/7:2+events07:46:377
3615404992319,4cyclictest3609297-21kworker/7:2+events07:46:377
3615404992319,4cyclictest3609297-21kworker/7:2+events07:31:397
3615404992319,4cyclictest3609297-21kworker/7:2+events07:15:517
3615404992319,3cyclictest3754797-21kworker/7:1+events12:35:107
3615404992318,4cyclictest3638234-21kworker/7:0+events09:50:027
3615404992318,4cyclictest3609297-21kworker/7:2+events08:00:037
361540399234,19cyclictest0-21swapper/611:51:236
361540399234,19cyclictest0-21swapper/611:39:226
361540399234,19cyclictest0-21swapper/607:21:046
361540299234,19cyclictest0-21swapper/512:20:205
361540299234,19cyclictest0-21swapper/511:50:165
361540299234,19cyclictest0-21swapper/509:25:185
361540299234,19cyclictest0-21swapper/508:10:215
361540299234,19cyclictest0-21swapper/508:05:225
361540299234,19cyclictest0-21swapper/508:05:225
361540299234,19cyclictest0-21swapper/507:55:175
361540299234,19cyclictest0-21swapper/507:30:185
361540199230,22cyclictest0-21swapper/412:20:234
361540399223,19cyclictest0-21swapper/612:09:246
361540399223,19cyclictest0-21swapper/610:21:176
361540399223,19cyclictest0-21swapper/609:21:126
361540299223,19cyclictest0-21swapper/512:30:195
361540299223,19cyclictest0-21swapper/511:40:175
361540299223,19cyclictest0-21swapper/511:15:175
361540299223,19cyclictest0-21swapper/511:00:175
361540299223,19cyclictest0-21swapper/509:20:175
361540299222,19cyclictest0-21swapper/510:30:165
361540299222,19cyclictest0-21swapper/508:20:205
361540299222,19cyclictest0-21swapper/508:00:155
361539999223,19cyclictest0-21swapper/208:15:182
361539799223,19cyclictest0-21swapper/011:05:170
361539799223,19cyclictest0-21swapper/010:12:330
361540399212,19cyclictest0-21swapper/607:51:056
361540299212,19cyclictest0-21swapper/512:25:155
361540299212,19cyclictest0-21swapper/512:10:185
361540299212,19cyclictest0-21swapper/512:05:195
361540299212,19cyclictest0-21swapper/511:55:165
361540299212,19cyclictest0-21swapper/511:45:175
361540299212,19cyclictest0-21swapper/509:05:185
361540299212,19cyclictest0-21swapper/507:15:255
361540299212,19cyclictest0-21swapper/507:10:165
361540299210,20cyclictest0-21swapper/507:51:095
3615401992121,0cyclictest0-21swapper/409:13:264
361539999212,19cyclictest0-21swapper/211:32:452
3615398992120,1cyclictest1089-21snmpd08:09:491
3615398992120,1cyclictest1089-21snmpd08:09:481
361539799212,19cyclictest0-21swapper/011:00:170
3615397992120,1cyclictest3618292-21/usr/sbin/munin07:15:010
3615403992019,1cyclictest1089-21snmpd08:13:366
3615402992019,1cyclictest3750210-21mii-tool11:05:165
3615402992019,0cyclictest3661814-21mii-tool08:30:195
3615402992019,0cyclictest3625043-21mii-tool07:25:165
3615402992018,1cyclictest1089-21snmpd09:39:025
3615402992018,1cyclictest1089-21snmpd08:35:095
361540299200,20cyclictest0-21swapper/508:40:145
361540299200,1cyclictest3765619-21sed11:30:315
361540299200,19cyclictest0-21swapper/511:10:195
361540299200,19cyclictest0-21swapper/507:41:265
361540299200,19cyclictest0-21swapper/507:41:265
3615401992020,0cyclictest3801827-21mii-tool12:35:184
3615401992020,0cyclictest3673070-21mii-tool08:50:184
361540199201,19cyclictest0-21swapper/408:47:174
3615399992020,0cyclictest3753015-21mii-tool11:10:192
3615399992020,0cyclictest3704774-21mii-tool09:45:212
3615399992020,0cyclictest3673051-21mii-tool08:50:182
3615399992020,0cyclictest3670263-21mii-tool08:45:182
3615399992020,0cyclictest3616592-21mii-tool07:10:162
3615399992019,1cyclictest3609397-21kworker/2:0+events07:15:022
3615399992019,1cyclictest1089-21snmpd10:11:522
361539999200,1cyclictest0-21swapper/211:16:142
3615398992020,0cyclictest3710351-21ethtool09:55:161
3615398992020,0cyclictest3701952-21mii-tool09:40:201
3615398992020,0cyclictest3684809-21mii-tool09:10:171
3615398992020,0cyclictest1089-21snmpd08:28:151
3615398992019,1cyclictest3801808-21mii-tool12:35:181
3615398992019,1cyclictest3793137-21mii-tool12:20:201
3615398992019,1cyclictest3642146-21mii-tool07:55:171
361539899200,20cyclictest0-21swapper/107:12:521
361539899200,1cyclictest0-21swapper/112:00:171
361539799204,0cyclictest0-21swapper/009:20:120
3615397992020,0cyclictest3713182-21mii-tool10:00:180
3615397992020,0cyclictest3693523-21mii-tool09:25:170
3615397992019,1cyclictest3730019-21ethtool10:30:170
3615397992019,1cyclictest1089-21snmpd09:43:140
3615397992019,1cyclictest1089-21snmpd09:16:310
361539799200,20cyclictest0-21swapper/012:25:160
361539799200,20cyclictest0-21swapper/009:14:430
361539799200,20cyclictest0-21swapper/008:10:150
361540399190,19cyclictest0-21swapper/610:40:406
3615402991919,0cyclictest3676109-21ethtool08:55:185
3615402991919,0cyclictest1089-21snmpd10:49:055
3615402991919,0cyclictest1089-21snmpd09:02:255
3615402991918,0cyclictest1089-21snmpd08:26:305
361540299190,19cyclictest0-21swapper/512:17:205
361540299190,19cyclictest0-21swapper/512:02:095
361540299190,19cyclictest0-21swapper/511:26:025
361540299190,19cyclictest0-21swapper/510:14:575
361540299190,19cyclictest0-21swapper/509:50:165
361540299190,19cyclictest0-21swapper/509:45:285
361540299190,19cyclictest0-21swapper/509:16:445
361540299190,19cyclictest0-21swapper/507:36:365
361540299190,19cyclictest0-21swapper/507:20:175
361540299190,0cyclictest0-21swapper/510:40:315
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional