You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Sat Jun 28, 2025 12:46:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2266516999516,59cyclictest2322059-21ntpq08:45:233
2266516999516,59cyclictest2322059-21ntpq08:45:223
2266516998810,59cyclictest2403002-21taskset11:06:113
2266516998769,18cyclictest0-21swapper/310:25:283
226651699835,59cyclictest2394905-21munin-run10:55:003
2266516997719,19cyclictest191rcu_preempt08:30:223
2266516997719,19cyclictest191rcu_preempt08:30:223
2266516997618,39cyclictest2439415-21users12:10:263
2266516997415,58cyclictest2292510-21/usr/sbin/munin07:55:143
2266516997211,59cyclictest2268235-21ntp_states07:10:273
2266516997113,39cyclictest2431371-21sleep12:00:003
2266516997033,37cyclictest0-21swapper/312:28:043
2266516997012,39cyclictest2397407-21sshd10:56:333
2266516996910,19cyclictest0-21swapper/309:16:023
226651699689,59cyclictest2356779-21ntpq09:45:233
2266516996830,38cyclictest873-21mta-sts-daemon11:18:073
2266516996829,19cyclictest0-21swapper/307:22:423
226651699679,39cyclictest2428556-21munin-run11:55:013
226651699678,58cyclictest2369647-21cat10:10:003
2266516996729,19cyclictest2299344-21ntpq08:05:223
226651699655,59cyclictest2412267-21cut11:25:163
2266516996526,39cyclictest0-21swapper/311:38:283
226651699613,39cyclictest2436716-21taskset12:06:413
2266516996122,39cyclictest0-21swapper/311:24:293
226651699601,39cyclictest2354642-21awk09:40:283
2266516995920,39cyclictest511ktimers/308:13:113
2266516995917,19cyclictest874-21mta-sts-daemon09:34:043
226651699580,39cyclictest778-21dbus-daemon08:25:003
2266516995719,19cyclictest2424514-21meminfo11:45:223
2266516995618,19cyclictest2443482-21munin-run12:20:033
2266516995618,19cyclictest2443482-21munin-run12:20:023
2266516995618,19cyclictest2327082-21cut08:55:163
2266516995536,1cyclictest52-21ksoftirqd/310:35:183
2266516995536,19cyclictest2374898-21seq10:15:543
2266516995517,19cyclictest2345680-21unixbench_multi09:25:273
2266516995435,19cyclictest2280179-21fwupdmgr07:31:323
2266516995432,19cyclictest0-21swapper/310:42:243
2266516995431,19cyclictest0-21swapper/312:35:013
2266516995419,35cyclictest0-21swapper/307:53:373
2266516995416,19cyclictest2277649-21munin-run07:30:013
2266513995415,38cyclictest2266504-21cyclictest10:05:190
2266520995335,18cyclictest876-21mta-sts-daemon12:05:197
2266516995319,34cyclictest0-21swapper/310:30:173
2266516995319,15cyclictest0-21swapper/310:01:163
2266516995319,15cyclictest0-21swapper/308:04:573
2266516995314,39cyclictest0-21swapper/312:36:193
2266516995314,39cyclictest0-21swapper/307:44:473
2266520995214,19cyclictest0-21swapper/710:45:187
2266520995214,19cyclictest0-21swapper/709:25:197
2266518995214,19cyclictest0-21swapper/508:20:235
2266516995233,19cyclictest0-21swapper/312:01:393
2266516995233,19cyclictest0-21swapper/311:42:273
2266516995233,19cyclictest0-21swapper/311:33:193
2266516995233,19cyclictest0-21swapper/311:11:263
2266516995233,19cyclictest0-21swapper/311:00:523
2266516995233,19cyclictest0-21swapper/310:48:153
2266516995233,19cyclictest0-21swapper/309:56:353
2266516995233,19cyclictest0-21swapper/309:06:063
2266516995233,19cyclictest0-21swapper/308:25:473
2266516995233,0cyclictest0-21swapper/307:37:253
2266516995214,38cyclictest0-21swapper/309:20:023
2266516995213,39cyclictest0-21swapper/308:35:273
2266516995213,39cyclictest0-21swapper/308:35:263
2266516995133,18cyclictest0-21swapper/310:10:233
2266516995133,18cyclictest0-21swapper/309:50:503
2266516995133,18cyclictest0-21swapper/309:35:593
2266516995133,18cyclictest0-21swapper/308:50:293
2266516995133,18cyclictest0-21swapper/308:50:293
2266516995132,19cyclictest0-21swapper/310:20:393
2266516995132,19cyclictest0-21swapper/308:16:103
2266516995132,19cyclictest0-21swapper/307:48:503
2266516995132,19cyclictest0-21swapper/307:17:313
2266516995113,20cyclictest501rcuc/309:00:273
2266513995133,0cyclictest0-21swapper/009:10:190
2266520995012,19cyclictest0-21swapper/711:50:227
2266517995011,20cyclictest0-21swapper/409:50:194
2266516995032,18cyclictest0-21swapper/308:42:033
2266516995032,18cyclictest0-21swapper/308:42:023
2266516995031,19cyclictest0-21swapper/312:22:273
2266516995031,19cyclictest0-21swapper/309:12:113
226652099489,20cyclictest0-21swapper/709:15:187
2266520994810,19cyclictest0-21swapper/707:15:187
226651799479,19cyclictest0-21swapper/408:05:204
226651399468,19cyclictest221rcuc/012:10:180
226651899457,19cyclictest0-21swapper/511:10:215
226651499456,39cyclictest0-21swapper/110:10:181
226651499456,19cyclictest0-21swapper/109:55:181
226651399447,18cyclictest0-21swapper/008:55:180
226651399446,19cyclictest0-21swapper/012:30:180
226652099435,19cyclictest0-21swapper/708:00:197
226651799434,19cyclictest0-21swapper/407:30:184
226651599423,39cyclictest0-21swapper/210:15:192
226651899413,19cyclictest0-21swapper/509:50:205
226651799413,19cyclictest0-21swapper/409:00:194
2266520994021,19cyclictest0-21swapper/712:00:197
226651799402,19cyclictest0-21swapper/407:25:174
226651399402,19cyclictest0-21swapper/011:55:170
2266520993920,18cyclictest0-21swapper/712:30:187
226651599390,20cyclictest0-21swapper/211:40:172
226651499390,20cyclictest0-21swapper/111:35:201
2266513993921,18cyclictest0-21swapper/009:20:180
226651399390,20cyclictest0-21swapper/007:25:180
226651399390,0cyclictest0-21swapper/007:55:170
2266520993838,0cyclictest2266268-21kworker/7:1+events11:36:107
2266520993838,0cyclictest2266268-21kworker/7:1+events10:16:227
226651999380,19cyclictest0-21swapper/609:55:186
226651899380,38cyclictest0-21swapper/507:40:185
226651899380,19cyclictest0-21swapper/509:35:215
2266513993838,0cyclictest0-21swapper/012:06:410
2266520993737,0cyclictest2446184-21kworker/7:0+events12:26:067
2266520993737,0cyclictest2266268-21kworker/7:1+events12:16:317
2266520993737,0cyclictest2266268-21kworker/7:1+events12:16:307
2266520993737,0cyclictest2266268-21kworker/7:1+events11:45:587
2266520993737,0cyclictest2266268-21kworker/7:1+events11:41:277
2266520993737,0cyclictest2266268-21kworker/7:1+events11:30:067
2266520993737,0cyclictest2266268-21kworker/7:1+events11:16:397
2266520993737,0cyclictest2266268-21kworker/7:1+events11:08:397
2266520993737,0cyclictest2266268-21kworker/7:1+events10:59:507
2266520993737,0cyclictest2266268-21kworker/7:1+events10:31:037
2266520993737,0cyclictest2266268-21kworker/7:1+events10:22:317
2266520993737,0cyclictest2266268-21kworker/7:1+events10:05:477
2266520993737,0cyclictest2266268-21kworker/7:1+events10:01:107
2266520993737,0cyclictest2266268-21kworker/7:1+events09:55:197
2266520993737,0cyclictest2266268-21kworker/7:1+events09:47:037
2266520993737,0cyclictest2266268-21kworker/7:1+events09:41:227
2266520993737,0cyclictest2266268-21kworker/7:1+events09:38:157
2266520993737,0cyclictest2266268-21kworker/7:1+events09:03:357
2266520993737,0cyclictest2266268-21kworker/7:1+events08:55:317
2266520993737,0cyclictest2266268-21kworker/7:1+events08:23:037
2266520993737,0cyclictest2266268-21kworker/7:1+events08:17:427
2266520993737,0cyclictest2266268-21kworker/7:1+events07:54:557
2266520993737,0cyclictest2266268-21kworker/7:1+events07:37:117
2266518993713,24cyclictest0-21swapper/512:35:195
226651899370,18cyclictest0-21swapper/512:25:215
2266517993737,0cyclictest0-21swapper/412:37:144
2266517993737,0cyclictest0-21swapper/411:13:144
226651499370,18cyclictest0-21swapper/107:55:181
2266513993718,19cyclictest2352165-21kworker/0:0+ice09:45:190
2266520993636,0cyclictest2266268-21kworker/7:1+events12:24:317
2266520993636,0cyclictest2266268-21kworker/7:1+events12:10:507
2266520993636,0cyclictest2266268-21kworker/7:1+events11:12:267
2266520993636,0cyclictest2266268-21kworker/7:1+events11:04:037
2266520993636,0cyclictest2266268-21kworker/7:1+events10:25:427
2266520993636,0cyclictest2266268-21kworker/7:1+events10:11:347
2266520993636,0cyclictest2266268-21kworker/7:1+events09:52:347
2266520993636,0cyclictest2266268-21kworker/7:1+events09:33:267
2266520993636,0cyclictest2266268-21kworker/7:1+events08:11:037
2266520993636,0cyclictest2266268-21kworker/7:1+events07:59:347
2266520993636,0cyclictest2266268-21kworker/7:1+events07:41:027
2266520993636,0cyclictest2266268-21kworker/7:1+events07:29:107
2266520993636,0cyclictest2266268-21kworker/7:1+events07:21:117
2266520993636,0cyclictest2266268-21kworker/7:1+events07:13:277
2266519993636,0cyclictest0-21swapper/609:25:196
226651999360,35cyclictest0-21swapper/612:20:196
226651799360,36cyclictest90850irq/69-eno6-TxRx-709:26:384
2266520993535,0cyclictest2266268-21kworker/7:1+events10:50:317
2266520993535,0cyclictest2266268-21kworker/7:1+events09:22:477
2266520993535,0cyclictest2266268-21kworker/7:1+events08:45:197
2266520993535,0cyclictest2266268-21kworker/7:1+events08:45:187
2266520993535,0cyclictest2266268-21kworker/7:1+events07:30:267
226651999350,15cyclictest0-21swapper/612:05:206
226651999350,15cyclictest0-21swapper/612:00:186
226651999350,15cyclictest0-21swapper/611:45:206
226651999350,15cyclictest0-21swapper/610:10:196
226651899350,16cyclictest0-21swapper/512:05:195
2266513993535,0cyclictest0-21swapper/010:12:160
2266513993516,19cyclictest171ktimers/011:25:210
226651399350,35cyclictest0-21swapper/008:10:300
2266520993434,0cyclictest2266268-21kworker/7:1+events09:10:037
2266520993434,0cyclictest2266268-21kworker/7:1+events08:50:037
2266520993434,0cyclictest2266268-21kworker/7:1+events08:50:027
2266519993416,18cyclictest781ktimers/607:40:196
2266519993415,19cyclictest0-21swapper/608:25:286
2266519993413,20cyclictest0-21swapper/608:55:176
226651999340,15cyclictest0-21swapper/611:00:226
226651899340,15cyclictest0-21swapper/510:00:235
226651899340,15cyclictest0-21swapper/508:45:205
226651899340,15cyclictest0-21swapper/508:45:195
2266517993415,19cyclictest0-21swapper/407:35:204
2266517993414,20cyclictest0-21swapper/411:20:204
2266517993410,19cyclictest0-21swapper/409:10:194
226651799340,15cyclictest0-21swapper/408:25:274
2266514993415,0cyclictest0-21swapper/110:50:221
2266513993434,0cyclictest0-21swapper/009:42:160
2266513993415,19cyclictest0-21swapper/007:10:220
2266520993333,0cyclictest2446184-21kworker/7:0+events12:35:187
2266520993333,0cyclictest2266268-21kworker/7:1+events11:55:147
2266520993333,0cyclictest2266268-21kworker/7:1+events11:25:477
2266520993333,0cyclictest2266268-21kworker/7:1+events10:41:557
2266520993333,0cyclictest2266268-21kworker/7:1+events10:35:027
2266520993314,19cyclictest0-21swapper/708:40:187
2266520993314,19cyclictest0-21swapper/708:40:177
2266520993313,19cyclictest0-21swapper/707:45:207
2266519993314,19cyclictest0-21swapper/611:55:166
2266519993314,19cyclictest0-21swapper/611:40:186
2266519993314,19cyclictest0-21swapper/610:55:196
2266519993314,19cyclictest0-21swapper/610:35:246
2266519993314,19cyclictest0-21swapper/609:50:196
2266519993314,19cyclictest0-21swapper/609:20:176
2266519993314,19cyclictest0-21swapper/609:10:196
2266519993314,19cyclictest0-21swapper/607:10:216
2266519993313,19cyclictest0-21swapper/612:10:186
2266519993313,19cyclictest0-21swapper/610:20:196
2266519993313,19cyclictest0-21swapper/608:00:206
2266518993314,19cyclictest0-21swapper/510:55:195
2266518993314,19cyclictest0-21swapper/509:40:215
2266518993314,19cyclictest0-21swapper/509:18:135
2266518993314,19cyclictest0-21swapper/509:10:195
2266518993314,19cyclictest0-21swapper/508:25:275
2266518993314,19cyclictest0-21swapper/507:10:215
2266518993313,19cyclictest0-21swapper/512:10:195
2266517993314,19cyclictest0-21swapper/409:05:204
2266517993314,19cyclictest0-21swapper/408:55:184
2266517993314,19cyclictest0-21swapper/408:45:204
2266517993314,19cyclictest0-21swapper/408:45:194
2266517993314,19cyclictest0-21swapper/407:50:244
2266515993314,19cyclictest0-21swapper/212:05:202
2266515993314,19cyclictest0-21swapper/210:25:222
2266515993314,19cyclictest0-21swapper/210:05:182
2266515993314,19cyclictest0-21swapper/209:20:172
2266515993314,19cyclictest0-21swapper/208:10:292
2266515993314,0cyclictest0-21swapper/209:25:192
226651599330,14cyclictest0-21swapper/207:30:182
2266514993318,15cyclictest0-21swapper/111:45:211
2266514993314,19cyclictest0-21swapper/111:50:211
2266514993314,19cyclictest0-21swapper/110:40:201
2266514993314,19cyclictest0-21swapper/110:20:181
2266514993314,19cyclictest0-21swapper/109:35:211
2266514993314,19cyclictest0-21swapper/109:00:191
2266513993333,0cyclictest0-21swapper/010:30:570
2266513993315,18cyclictest171ktimers/011:30:170
2266513993314,19cyclictest0-21swapper/011:35:190
2266513993314,19cyclictest0-21swapper/011:20:200
2266513993314,19cyclictest0-21swapper/011:05:240
2266513993314,19cyclictest0-21swapper/010:45:190
2266513993314,19cyclictest0-21swapper/009:15:180
2266520993232,0cyclictest2266268-21kworker/7:1+events11:20:347
2266520993232,0cyclictest2266268-21kworker/7:1+events09:09:317
2266520993232,0cyclictest2266268-21kworker/7:1+events08:35:117
2266520993232,0cyclictest2266268-21kworker/7:1+events08:35:107
2266520993232,0cyclictest2266268-21kworker/7:1+events08:25:077
2266519993213,19cyclictest0-21swapper/608:20:236
2266519993213,19cyclictest0-21swapper/607:45:196
2266519993212,19cyclictest0-21swapper/608:30:196
2266519993212,19cyclictest0-21swapper/608:30:186
2266519993212,19cyclictest0-21swapper/607:15:196
2266518993213,19cyclictest0-21swapper/511:15:285
2266518993213,19cyclictest0-21swapper/511:00:235
2266518993213,19cyclictest0-21swapper/510:50:225
2266517993213,19cyclictest0-21swapper/411:40:184
2266517993213,19cyclictest0-21swapper/407:20:204
2266516993213,19cyclictest0-21swapper/307:10:023
2266515993214,0cyclictest0-21swapper/209:30:232
2266515993213,19cyclictest0-21swapper/212:00:182
2266515993213,19cyclictest0-21swapper/211:10:212
2266515993213,19cyclictest0-21swapper/210:30:162
2266515993213,19cyclictest0-21swapper/208:35:222
2266515993213,19cyclictest0-21swapper/208:35:212
2266514993213,19cyclictest0-21swapper/111:20:201
2266514993213,19cyclictest0-21swapper/108:20:251
2266514993213,19cyclictest0-21swapper/107:35:201
2266513993213,19cyclictest0-21swapper/012:15:210
2266513993213,19cyclictest0-21swapper/012:15:200
2266513993213,19cyclictest0-21swapper/008:40:190
2266513993213,19cyclictest0-21swapper/008:40:180
2266513993213,19cyclictest0-21swapper/008:35:220
2266513993213,19cyclictest0-21swapper/008:35:210
2266513993213,19cyclictest0-21swapper/007:45:190
2266513993213,19cyclictest0-21swapper/007:20:190
2266513993212,20cyclictest0-21swapper/010:00:220
2266520993131,0cyclictest2266268-21kworker/7:1+events08:30:357
2266520993131,0cyclictest2266268-21kworker/7:1+events08:30:347
2266520993131,0cyclictest2266268-21kworker/7:1+events08:09:227
2266519993113,18cyclictest0-21swapper/612:35:196
2266519993112,19cyclictest0-21swapper/609:30:226
2266518993113,18cyclictest0-21swapper/512:00:185
2266517993112,19cyclictest0-21swapper/410:00:224
2266513993112,19cyclictest0-21swapper/011:15:290
2266513993112,19cyclictest0-21swapper/009:00:200
2266513993112,19cyclictest0-21swapper/007:35:200
2266519993012,0cyclictest0-21swapper/612:25:216
2266519993011,19cyclictest0-21swapper/611:10:206
2266519993011,19cyclictest0-21swapper/608:35:226
2266519993011,19cyclictest0-21swapper/608:35:216
2266519993011,19cyclictest0-21swapper/607:20:196
2266518993012,0cyclictest0-21swapper/508:30:195
2266518993012,0cyclictest0-21swapper/508:30:185
2266518993011,19cyclictest0-21swapper/511:35:205
2266518993011,19cyclictest0-21swapper/511:25:205
2266518993011,19cyclictest0-21swapper/511:20:215
2266518993011,19cyclictest0-21swapper/511:05:235
2266518993011,19cyclictest0-21swapper/510:40:195
2266518993011,19cyclictest0-21swapper/508:50:195
2266518993011,19cyclictest0-21swapper/508:50:185
2266515993011,19cyclictest0-21swapper/212:15:212
2266515993011,19cyclictest0-21swapper/212:15:202
2266515993011,19cyclictest0-21swapper/208:05:202
2266515993011,19cyclictest0-21swapper/208:00:192
2266513993011,19cyclictest0-21swapper/010:50:270
2266513993011,19cyclictest0-21swapper/008:45:200
2266513993011,19cyclictest0-21swapper/008:45:190
2266513993011,19cyclictest0-21swapper/008:05:190
2266519992911,0cyclictest0-21swapper/609:05:196
2266519992911,0cyclictest0-21swapper/608:50:196
2266519992911,0cyclictest0-21swapper/608:50:186
2266519992910,19cyclictest0-21swapper/612:15:216
2266519992910,19cyclictest0-21swapper/612:15:206
2266519992910,19cyclictest0-21swapper/608:45:206
2266519992910,19cyclictest0-21swapper/608:45:206
2266518992910,19cyclictest0-21swapper/511:45:215
2266515992910,19cyclictest0-21swapper/210:55:192
2266515992910,19cyclictest0-21swapper/210:50:212
2266515992910,19cyclictest0-21swapper/208:40:182
2266515992910,19cyclictest0-21swapper/208:40:182
2266514992910,19cyclictest0-21swapper/111:10:211
2266514992910,19cyclictest0-21swapper/108:30:191
2266514992910,19cyclictest0-21swapper/108:30:191
2266514992910,19cyclictest0-21swapper/107:20:201
2266513992910,19cyclictest0-21swapper/007:50:250
226651999289,19cyclictest0-21swapper/608:05:196
226651499289,19cyclictest0-21swapper/110:35:231
226651499289,19cyclictest0-21swapper/108:40:191
226651499289,19cyclictest0-21swapper/108:40:181
226651399289,19cyclictest0-21swapper/008:15:200
226651999277,19cyclictest0-21swapper/607:30:176
226651999276,20cyclictest0-21swapper/610:15:196
226651799278,19cyclictest0-21swapper/412:03:324
226651799278,0cyclictest0-21swapper/411:55:174
226651999267,19cyclictest0-21swapper/610:45:196
226651499267,19cyclictest0-21swapper/112:20:201
226651499267,19cyclictest0-21swapper/111:05:231
226651499257,18cyclictest0-21swapper/111:55:231
226651499256,19cyclictest0-21swapper/111:00:231
226651499256,19cyclictest0-21swapper/107:40:171
226651399256,19cyclictest0-21swapper/009:30:220
226651799246,18cyclictest0-21swapper/409:55:184
226651899234,19cyclictest0-21swapper/510:25:225
226651599230,19cyclictest0-21swapper/212:35:002
226651499234,19cyclictest0-21swapper/109:45:251
226651899223,19cyclictest0-21swapper/508:10:295
226651799223,0cyclictest0-21swapper/408:00:194
226651599224,18cyclictest0-21swapper/207:15:192
226651599223,19cyclictest0-21swapper/208:30:192
226651599223,19cyclictest0-21swapper/208:30:182
226651399223,19cyclictest0-21swapper/012:35:180
2266519992119,1cyclictest1089-21snmpd09:39:276
226651799212,19cyclictest0-21swapper/410:40:204
2266517992120,1cyclictest1089-21snmpd08:22:044
226651499212,19cyclictest0-21swapper/110:55:181
226651499212,19cyclictest0-21swapper/107:50:241
2266519992020,0cyclictest2301718-21mii-tool08:10:306
2266519992020,0cyclictest1089-21snmpd07:36:356
226651999200,20cyclictest0-21swapper/610:30:176
2266518992020,0cyclictest2370907-21mii-tool10:10:195
2266518992020,0cyclictest2361979-21mii-tool09:55:175
2266518992020,0cyclictest1089-21snmpd10:16:005
2266518992019,1cyclictest1089-21snmpd08:56:045
2266518992018,1cyclictest1089-21snmpd11:31:595
226651899200,20cyclictest0-21swapper/512:22:005
226651899200,20cyclictest0-21swapper/510:35:465
2266517992020,0cyclictest2368561-21sensors10:05:254
2266517992020,0cyclictest2338718-21ethtool09:15:184
2266517992020,0cyclictest1089-21snmpd09:40:534
2266517992019,1cyclictest2316019-21cat08:35:224
2266517992019,1cyclictest2316019-21cat08:35:214
2266517992019,1cyclictest1089-21snmpd12:32:554
226651799200,0cyclictest0-21swapper/407:45:124
2266515992019,1cyclictest1089-21snmpd12:38:462
226651599200,20cyclictest0-21swapper/210:01:542
226651599200,1cyclictest0-21swapper/207:42:392
2266514992020,0cyclictest2452820-21mii-tool12:35:181
2266514992019,1cyclictest1089-21snmpd10:49:181
226651499201,19cyclictest0-21swapper/111:30:171
226651499200,20cyclictest0-21swapper/107:48:541
226651399200,20cyclictest0-21swapper/008:32:070
226651399200,20cyclictest0-21swapper/008:32:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional