You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 13:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Fri Nov 28, 2025 00:46:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1625426997617,59cyclictest1666585-21ps20:20:234
1625426997617,58cyclictest1743997-21/usr/sbin/munin22:40:164
162542699580,39cyclictest987366-21NetworkManager21:47:304
162542699580,39cyclictest1765172-21collect223:15:204
162542699570,38cyclictest1676324-21kworker/u32:0+flush-8:021:09:214
162542699570,38cyclictest1622841-21kworker/u32:1+events_unbound20:08:024
1625426995638,18cyclictest601ktimers/420:43:484
1625426995638,18cyclictest601ktimers/419:39:274
1625426995618,19cyclictest1704502-21munin-run21:30:014
1625426995618,19cyclictest1634118-21munin-run19:25:024
1625426995417,18cyclictest1710130-21munin-run21:40:024
1625426995233,19cyclictest0-21swapper/423:22:204
1625426995233,19cyclictest0-21swapper/423:22:194
1625426995233,19cyclictest0-21swapper/400:38:014
1625426995233,19cyclictest0-21swapper/400:08:224
1625426995133,18cyclictest0-21swapper/422:50:444
1625426995133,18cyclictest0-21swapper/422:23:044
1625426995132,19cyclictest0-21swapper/423:57:524
1625426995132,19cyclictest0-21swapper/422:02:054
1625423995113,38cyclictest0-21swapper/122:40:171
1625426995032,18cyclictest0-21swapper/420:12:164
1625426995031,19cyclictest0-21swapper/423:37:504
1625427994912,19cyclictest0-21swapper/521:40:175
1625426994930,19cyclictest0-21swapper/423:44:464
1625426994930,19cyclictest0-21swapper/423:27:504
1625426994930,19cyclictest0-21swapper/423:27:494
1625426994930,19cyclictest0-21swapper/423:10:094
1625426994930,19cyclictest0-21swapper/422:58:174
1625426994930,19cyclictest0-21swapper/419:56:334
1625426994930,19cyclictest0-21swapper/419:30:144
1625426994930,19cyclictest0-21swapper/419:19:504
1625426994930,19cyclictest0-21swapper/400:29:344
1625426994930,19cyclictest0-21swapper/400:01:574
162542399499,39cyclictest0-21swapper/119:35:171
1625423994911,19cyclictest0-21swapper/123:00:171
1625427994810,19cyclictest0-21swapper/521:50:205
1625426994830,18cyclictest0-21swapper/421:21:384
1625426994829,19cyclictest0-21swapper/423:45:104
1625426994829,19cyclictest0-21swapper/422:17:024
1625426994829,19cyclictest0-21swapper/421:56:184
1625426994829,19cyclictest0-21swapper/421:45:024
1625426994829,19cyclictest0-21swapper/421:19:554
1625426994829,19cyclictest0-21swapper/420:31:554
1625426994829,19cyclictest0-21swapper/420:17:324
1625426994829,19cyclictest0-21swapper/419:46:594
1625426994829,19cyclictest0-21swapper/400:32:124
1625426994829,19cyclictest0-21swapper/400:18:424
1625426994828,19cyclictest0-21swapper/419:43:444
1625426994729,18cyclictest0-21swapper/422:45:274
1625426994728,19cyclictest0-21swapper/423:33:244
1625426994728,19cyclictest0-21swapper/423:33:234
1625426994728,19cyclictest0-21swapper/423:08:584
1625426994728,19cyclictest0-21swapper/422:13:094
1625426994728,19cyclictest0-21swapper/420:59:264
1625426994728,19cyclictest0-21swapper/419:28:244
1625426994728,19cyclictest0-21swapper/419:13:194
162542399479,19cyclictest0-21swapper/121:25:191
1625426994628,18cyclictest0-21swapper/422:35:284
1625426994628,18cyclictest0-21swapper/421:14:464
1625426994628,18cyclictest0-21swapper/420:25:204
1625426994628,0cyclictest0-21swapper/419:50:124
1625426994627,19cyclictest0-21swapper/422:09:104
1625426994627,19cyclictest0-21swapper/420:04:284
1625426994325,18cyclictest0-21swapper/423:51:574
1625426994325,18cyclictest0-21swapper/400:11:104
162542399423,19cyclictest0-21swapper/100:15:181
162542399402,19cyclictest0-21swapper/119:10:171
162542899390,39cyclictest0-21swapper/623:05:176
162542699390,39cyclictest0-21swapper/400:21:564
162542699380,38cyclictest1681958-21apt-get20:50:144
162542399370,18cyclictest0-21swapper/120:20:181
162542999360,35cyclictest0-21swapper/723:20:177
162542999360,35cyclictest0-21swapper/723:20:167
162542999360,17cyclictest0-21swapper/721:15:167
1625426993616,19cyclictest1681779-21unin-run20:50:024
1625423993618,18cyclictest0-21swapper/100:20:181
1625423993612,19cyclictest0-21swapper/120:05:171
1625423993610,25cyclictest0-21swapper/122:55:161
162542999350,35cyclictest0-21swapper/722:25:167
162542999350,34cyclictest0-21swapper/722:20:097
162542999350,15cyclictest0-21swapper/723:25:177
162542999350,15cyclictest0-21swapper/723:25:167
162542799350,15cyclictest0-21swapper/521:25:205
1625426993517,18cyclictest0-21swapper/422:31:124
162542699350,34cyclictest0-21swapper/421:52:004
162542699350,15cyclictest0-21swapper/421:02:324
162542699350,15cyclictest0-21swapper/420:37:364
162542399359,25cyclictest0-21swapper/121:50:201
162542399359,19cyclictest0-21swapper/121:20:171
1625423993512,19cyclictest0-21swapper/119:15:171
1625429993433,0cyclictest0-21swapper/722:10:227
1625429993414,19cyclictest0-21swapper/722:40:167
162542699340,34cyclictest0-21swapper/423:00:484
162542699340,15cyclictest0-21swapper/421:33:004
1625429993314,19cyclictest0-21swapper/721:50:197
1625429993314,19cyclictest0-21swapper/721:30:177
1625429993314,19cyclictest0-21swapper/720:35:177
1625429993314,19cyclictest0-21swapper/720:10:167
1625429993314,19cyclictest0-21swapper/719:40:167
1625429993314,19cyclictest0-21swapper/700:10:177
1625429993314,19cyclictest0-21swapper/700:00:187
1625429993313,19cyclictest0-21swapper/722:35:177
1625429993313,19cyclictest0-21swapper/721:55:177
1625429993313,19cyclictest0-21swapper/700:35:177
1625427993314,19cyclictest0-21swapper/520:15:165
1625427993314,19cyclictest0-21swapper/520:10:175
1625427993314,19cyclictest0-21swapper/500:35:175
162542699330,14cyclictest0-21swapper/422:27:084
1625425993314,19cyclictest0-21swapper/321:35:193
1625425993314,19cyclictest0-21swapper/321:10:173
1625425993314,19cyclictest0-21swapper/319:50:193
1625425993314,19cyclictest0-21swapper/319:25:163
1625425993314,0cyclictest0-21swapper/323:20:173
1625425993314,0cyclictest0-21swapper/323:20:173
162542599330,14cyclictest0-21swapper/323:25:173
162542599330,14cyclictest0-21swapper/323:25:163
1625423993314,19cyclictest0-21swapper/122:30:171
1625423993314,19cyclictest0-21swapper/122:05:191
1625423993314,19cyclictest0-21swapper/119:40:161
1625423993314,19cyclictest0-21swapper/100:35:151
1625423993313,19cyclictest0-21swapper/100:05:161
1625429993213,19cyclictest872-21mta-sts-daemon22:15:177
1625429993213,19cyclictest0-21swapper/723:55:167
1625429993213,19cyclictest0-21swapper/723:00:177
1625429993213,19cyclictest0-21swapper/721:05:187
1625429993213,19cyclictest0-21swapper/700:05:167
1625429993213,0cyclictest0-21swapper/723:45:177
1625429993212,19cyclictest0-21swapper/720:45:177
1625427993213,19cyclictest0-21swapper/522:55:175
1625427993213,19cyclictest0-21swapper/522:15:175
1625427993213,19cyclictest0-21swapper/521:15:175
1625427993213,19cyclictest0-21swapper/519:10:175
1625427993213,19cyclictest0-21swapper/500:20:185
1625427993213,19cyclictest0-21swapper/500:15:185
1625427993213,0cyclictest0-21swapper/519:20:195
1625425993213,19cyclictest0-21swapper/323:05:233
1625425993213,19cyclictest0-21swapper/322:40:173
1625425993213,19cyclictest0-21swapper/322:35:183
1625425993213,19cyclictest0-21swapper/321:00:213
1625425993213,19cyclictest0-21swapper/300:30:223
1625423993213,19cyclictest0-21swapper/123:05:171
1625423993213,19cyclictest0-21swapper/120:55:171
1625423993213,19cyclictest0-21swapper/120:45:171
1625429993112,19cyclictest0-21swapper/719:45:147
1625429993112,19cyclictest0-21swapper/700:30:227
1625427993112,19cyclictest0-21swapper/523:30:155
1625427993112,19cyclictest0-21swapper/523:30:155
1625427993112,19cyclictest0-21swapper/523:25:175
1625427993112,19cyclictest0-21swapper/523:25:175
1625427993112,19cyclictest0-21swapper/521:45:165
1625427993112,19cyclictest0-21swapper/520:05:165
1625425993113,18cyclictest0-21swapper/300:20:193
1625425993112,19cyclictest0-21swapper/323:45:173
1625425993112,19cyclictest0-21swapper/322:45:173
1625423993112,19cyclictest0-21swapper/121:15:161
1625423993112,19cyclictest0-21swapper/100:00:181
1625429993011,19cyclictest0-21swapper/719:35:167
1625429993011,18cyclictest0-21swapper/723:05:197
1625427993011,19cyclictest0-21swapper/522:45:185
1625425993012,18cyclictest0-21swapper/320:25:173
1625425993011,19cyclictest0-21swapper/322:20:173
1625423993012,18cyclictest0-21swapper/123:35:161
1625423993011,19cyclictest0-21swapper/120:35:171
1625427992911,18cyclictest0-21swapper/519:50:245
1625427992910,19cyclictest0-21swapper/523:50:185
1625427992910,19cyclictest0-21swapper/519:15:175
1625427992910,19cyclictest0-21swapper/500:25:195
1625423992911,0cyclictest0-21swapper/123:50:181
1625422992929,0cyclictest0-21swapper/021:00:210
162542999285,23cyclictest0-21swapper/722:50:167
162542999284,24cyclictest0-21swapper/721:00:217
162542599289,19cyclictest0-21swapper/322:15:163
162542599289,19cyclictest0-21swapper/320:35:173
1625423992810,18cyclictest0-21swapper/121:55:171
162542999278,19cyclictest0-21swapper/722:00:157
162542999278,19cyclictest0-21swapper/720:09:447
162542999278,19cyclictest0-21swapper/719:25:167
162542999278,19cyclictest0-21swapper/719:20:197
162542799278,19cyclictest0-21swapper/520:20:185
162542599278,19cyclictest0-21swapper/323:55:163
162542399278,19cyclictest0-21swapper/120:25:171
162542399278,19cyclictest0-21swapper/120:00:161
162542299277,19cyclictest0-21swapper/023:30:160
162542299277,19cyclictest0-21swapper/023:30:150
162542599267,19cyclictest0-21swapper/321:30:173
162542599267,19cyclictest0-21swapper/300:35:163
162542399268,18cyclictest0-21swapper/120:40:151
162542399267,19cyclictest0-21swapper/122:10:151
162542399266,20cyclictest0-21swapper/123:30:151
162542399266,20cyclictest0-21swapper/123:30:141
162542299267,19cyclictest0-21swapper/023:45:170
162542299267,19cyclictest0-21swapper/023:35:160
162542299267,19cyclictest0-21swapper/022:50:170
162542299267,19cyclictest0-21swapper/022:15:160
162542299267,19cyclictest0-21swapper/021:50:190
162542299267,19cyclictest0-21swapper/021:15:170
162542299267,19cyclictest0-21swapper/020:30:170
162542299267,19cyclictest0-21swapper/020:05:170
162542299267,19cyclictest0-21swapper/019:40:160
162542299267,19cyclictest0-21swapper/019:15:170
162542299266,19cyclictest0-21swapper/022:05:190
162542299266,19cyclictest0-21swapper/022:00:160
1625422992625,1cyclictest0-21swapper/000:15:180
162542999256,19cyclictest0-21swapper/721:10:177
162542999256,19cyclictest0-21swapper/700:25:187
162542599255,19cyclictest0-21swapper/323:50:193
162542499256,19cyclictest0-21swapper/222:45:172
162542499256,19cyclictest0-21swapper/200:15:192
162542499255,19cyclictest0-21swapper/219:35:172
162542399250,24cyclictest0-21swapper/123:10:171
162542299256,19cyclictest0-21swapper/022:35:170
162542299256,19cyclictest0-21swapper/021:35:180
162542299256,19cyclictest0-21swapper/021:10:170
162542299256,19cyclictest0-21swapper/020:20:170
162542299256,19cyclictest0-21swapper/019:55:160
162542299256,19cyclictest0-21swapper/000:00:190
162542999245,19cyclictest0-21swapper/721:20:177
162542799245,19cyclictest0-21swapper/521:00:275
162542799245,19cyclictest0-21swapper/520:35:175
162542799245,0cyclictest0-21swapper/521:08:595
1625427992424,0cyclictest0-21swapper/522:10:225
162542499245,19cyclictest0-21swapper/223:50:192
162542499245,19cyclictest0-21swapper/223:15:152
162542499245,19cyclictest0-21swapper/222:30:162
162542499245,19cyclictest0-21swapper/222:20:172
162542499245,19cyclictest0-21swapper/221:40:162
162542499245,19cyclictest0-21swapper/221:20:162
162542499245,19cyclictest0-21swapper/220:50:182
162542499245,19cyclictest0-21swapper/220:40:172
162542499245,19cyclictest0-21swapper/220:20:182
162542499245,19cyclictest0-21swapper/220:15:162
162542499245,19cyclictest0-21swapper/220:00:162
162542499245,19cyclictest0-21swapper/219:45:152
162542499245,19cyclictest0-21swapper/219:20:192
162542499245,19cyclictest0-21swapper/200:10:172
162542299245,19cyclictest0-21swapper/022:55:170
162542299245,19cyclictest0-21swapper/020:50:190
162542299245,19cyclictest0-21swapper/019:45:150
162542299245,19cyclictest0-21swapper/019:30:160
162542299245,19cyclictest0-21swapper/000:05:160
162542499234,19cyclictest0-21swapper/223:10:172
162542499234,19cyclictest0-21swapper/223:05:162
162542499234,19cyclictest0-21swapper/221:10:162
162542499234,19cyclictest0-21swapper/221:05:182
162542499233,19cyclictest0-21swapper/223:00:172
1625424992323,0cyclictest43-21ksoftirqd/220:55:172
162542299235,0cyclictest0-21swapper/023:10:170
162542299235,0cyclictest0-21swapper/020:00:150
162542999223,19cyclictest0-21swapper/720:20:247
1625429992221,1cyclictest1739632-21ntpq22:30:207
1625429992218,4cyclictest1089-21snmpd20:17:357
162542499223,19cyclictest0-21swapper/221:35:182
162542499223,19cyclictest0-21swapper/220:45:172
162542499223,19cyclictest0-21swapper/200:00:192
162542499223,0cyclictest0-21swapper/220:10:172
162542399220,22cyclictest0-21swapper/123:55:201
162542299223,19cyclictest0-21swapper/022:30:170
162542299223,19cyclictest0-21swapper/022:10:160
162542299223,19cyclictest0-21swapper/021:25:200
1625422992222,0cyclictest1734801-21kworker/0:1+events22:21:160
162542999212,19cyclictest0-21swapper/723:50:247
162542999212,19cyclictest0-21swapper/723:40:167
162542999210,20cyclictest0-21swapper/720:51:307
1625427992119,1cyclictest1089-21snmpd21:33:045
1625425992120,1cyclictest1660339-21ethtool20:10:163
162542499212,19cyclictest0-21swapper/223:30:162
162542499212,19cyclictest0-21swapper/223:30:162
162542499212,19cyclictest0-21swapper/222:05:192
162542499212,19cyclictest0-21swapper/200:25:192
162542499211,19cyclictest0-21swapper/219:30:162
1625429992020,0cyclictest0-21swapper/723:15:227
1625428992020,0cyclictest1798759-21ethtool00:15:196
1625428992020,0cyclictest1764756-21mii-tool23:15:156
1625428992020,0cyclictest1747656-21mii-tool22:45:176
1625428992020,0cyclictest1699941-21mii-tool21:20:166
1625428992020,0cyclictest1654716-21mii-tool20:00:156
1625428992019,1cyclictest1711154-21mii-tool21:40:166
1625428992019,1cyclictest1651910-21mii-tool19:55:166
1625428992019,1cyclictest1089-21snmpd22:28:426
1625428992019,1cyclictest1089-21snmpd20:19:266
1625427992019,1cyclictest1089-21snmpd00:33:125
1625425992020,0cyclictest1795959-21mii-tool00:10:173
1625425992019,1cyclictest1679985-21ethtool20:45:163
1625425992019,1cyclictest1657535-21ethtool20:05:173
1625425992019,1cyclictest1089-21snmpd20:43:093
162542599200,20cyclictest0-21swapper/322:34:003
162542599200,1cyclictest0-21swapper/323:11:253
162542499202,0cyclictest0-21swapper/200:30:212
1625424992020,0cyclictest1728008-21mii-tool22:10:162
1625424992019,1cyclictest1089-21snmpd22:29:032
1625424992019,1cyclictest1089-21snmpd19:44:182
1625424992019,1cyclictest1089-21snmpd19:11:512
1625424992019,0cyclictest1089-21snmpd00:05:292
1625424992018,1cyclictest1089-21snmpd21:25:162
162542499201,19cyclictest0-21swapper/223:55:152
162542499201,19cyclictest0-21swapper/223:40:172
162542499201,19cyclictest0-21swapper/221:30:182
162542499201,19cyclictest0-21swapper/220:25:162
162542499201,19cyclictest0-21swapper/219:55:162
162542499201,19cyclictest0-21swapper/219:50:182
162542499200,20cyclictest0-21swapper/223:45:162
1625423992020,0cyclictest1733636-21ethtool22:20:171
1625423992020,0cyclictest1632268-21mii-tool19:20:191
1625423992019,1cyclictest1089-21snmpd21:00:211
1625422992020,0cyclictest1804844-21kworker/0:1+events00:30:300
1625422992020,0cyclictest1800052-21kworker/0:2+events00:25:070
1625422992020,0cyclictest1800052-21kworker/0:2+events00:20:060
1625422992020,0cyclictest1763258-21kworker/0:0+events23:55:080
1625422992020,0cyclictest1763258-21kworker/0:0+events23:50:280
1625422992020,0cyclictest1763258-21kworker/0:0+events23:41:510
1625422992020,0cyclictest1763258-21kworker/0:0+events23:25:200
1625422992020,0cyclictest1763258-21kworker/0:0+events23:25:200
1625422992020,0cyclictest1763258-21kworker/0:0+events23:20:100
1625422992020,0cyclictest1763258-21kworker/0:0+events23:20:100
1625422992020,0cyclictest1763258-21kworker/0:0+events00:10:320
1625422992020,0cyclictest1759138-21kworker/0:2+events23:15:060
1625422992020,0cyclictest1754979-21kworker/0:0+events23:00:010
1625422992020,0cyclictest1751847-21kworker/0:1+events23:06:000
1625422992020,0cyclictest1731931-21kworker/0:2+events22:45:140
1625422992020,0cyclictest1731931-21kworker/0:2+events22:40:080
1625422992020,0cyclictest1731931-21kworker/0:2+events22:25:470
1625422992020,0cyclictest1715336-21kworker/0:1+events21:55:120
1625422992020,0cyclictest1696152-21kworker/0:0+events21:45:080
1625422992020,0cyclictest1696152-21kworker/0:0+events21:41:030
1625422992020,0cyclictest1696152-21kworker/0:0+events21:20:060
1625422992020,0cyclictest1689819-21kworker/0:2+events21:05:110
1625422992020,0cyclictest1658740-21kworker/0:1+events20:55:110
1625422992020,0cyclictest1658740-21kworker/0:1+events20:45:130
1625422992020,0cyclictest1658740-21kworker/0:1+events20:40:340
1625422992020,0cyclictest1658740-21kworker/0:1+events20:25:060
1625422992020,0cyclictest1658740-21kworker/0:1+events20:15:320
1625422992020,0cyclictest1658740-21kworker/0:1+events20:10:490
1625422992020,0cyclictest1642007-21kworker/0:1+events19:50:240
1625422992020,0cyclictest1634914-21kworker/0:0+events19:35:030
1625422992020,0cyclictest1622234-21kworker/0:1+events19:25:350
1625422992020,0cyclictest1622234-21kworker/0:1+events19:20:160
1625422992020,0cyclictest1622234-21kworker/0:1+events19:11:130
1625422992019,1cyclictest1800052-21kworker/0:2+events00:35:260
1625422992019,0cyclictest1696152-21kworker/0:0+events21:30:040
1625422992019,0cyclictest1658740-21kworker/0:1+events20:35:040
1625429991919,0cyclictest1747652-21ethtool22:45:167
1625429991919,0cyclictest1708350-21mii-tool21:35:197
1625429991919,0cyclictest1649112-21mii-tool19:50:197
1625429991919,0cyclictest1089-21snmpd19:14:117
1625429991918,1cyclictest1089-21snmpd19:58:207
1625429991917,1cyclictest1668775-21mii-tool20:25:177
162542999190,19cyclictest0-21swapper/700:15:257
162542999190,0cyclictest0-21swapper/719:17:247
1625428991919,0cyclictest1795940-21mii-tool00:10:176
1625428991919,0cyclictest1739247-21mii-tool22:30:176
1625428991919,0cyclictest1733640-21mii-tool22:20:176
1625428991919,0cyclictest1705546-21mii-tool21:30:176
1625428991919,0cyclictest1691488-21mii-tool21:05:186
1625428991919,0cyclictest1682795-21mii-tool20:50:196
1625428991919,0cyclictest1677207-21mii-tool20:40:176
1625428991919,0cyclictest1665951-21ethtool20:20:186
1625428991919,0cyclictest1646280-21ethtool19:45:156
1625428991919,0cyclictest1640675-21ethtool19:35:176
1625428991919,0cyclictest1632249-21mii-tool19:20:196
1625428991919,0cyclictest1089-21snmpd19:44:556
1625428991918,1cyclictest1784425-21ethtool23:50:186
1625428991918,1cyclictest1713956-21mii-tool21:45:176
1625428991918,1cyclictest1694287-21ethtool21:10:176
1625428991918,1cyclictest1089-21snmpd19:25:186
162542899190,19cyclictest0-21swapper/623:26:046
162542899190,19cyclictest0-21swapper/623:26:036
162542899190,19cyclictest0-21swapper/622:44:456
162542899190,19cyclictest0-21swapper/622:10:166
162542899190,19cyclictest0-21swapper/621:55:586
162542899190,19cyclictest0-21swapper/621:37:226
162542899190,19cyclictest0-21swapper/621:26:196
162542899190,19cyclictest0-21swapper/621:00:266
162542899190,19cyclictest0-21swapper/620:57:366
162542899190,19cyclictest0-21swapper/600:25:196
162542899190,0cyclictest0-21swapper/623:44:586
162542899190,0cyclictest0-21swapper/622:15:016
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional