You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 10:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7.osadl.org (updated Sat Nov 15, 2025 00:46:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1615451998911,59cyclictest1639827-21/usr/sbin/munin19:50:214
1615451997961,0cyclictest0-21swapper/400:29:394
1615451997859,0cyclictest0-21swapper/420:38:354
1615451997717,39cyclictest1088-21runrttasks22:04:304
1615451997618,39cyclictest1757099-21latency_hist23:20:024
1615451997214,39cyclictest1701632-21ntpq21:40:194
1615451997133,38cyclictest0-21swapper/422:41:584
1615451997133,38cyclictest0-21swapper/422:36:374
1615451997133,38cyclictest0-21swapper/420:05:064
1615451996950,19cyclictest1743060-21sh22:55:134
1615451996931,38cyclictest0-21swapper/419:55:274
1615451996728,39cyclictest0-21swapper/419:34:524
1615449996627,38cyclictest0-21swapper/220:55:162
161545199646,39cyclictest1633912-21ntpq19:40:204
161545199635,39cyclictest1750109-21ntpq23:05:214
1615451996325,19cyclictest1681966-21ntpq21:05:234
1615451996041,19cyclictest0-21swapper/422:16:594
1615451995959,0cyclictest0-21swapper/423:12:474
1615451995959,0cyclictest0-21swapper/422:14:434
1615451995959,0cyclictest0-21swapper/420:01:274
1615451995941,0cyclictest0-21swapper/400:08:514
161545199591,39cyclictest1708276-21latency_hist21:55:014
1615451995840,18cyclictest0-21swapper/421:45:094
1615451995840,0cyclictest0-21swapper/423:28:564
1615451995839,0cyclictest0-21swapper/423:36:164
1615451995820,38cyclictest0-21swapper/420:10:274
1615451995739,0cyclictest0-21swapper/421:57:274
1615451995739,0cyclictest0-21swapper/421:02:044
1615451995739,0cyclictest0-21swapper/400:13:084
1615451995738,0cyclictest0-21swapper/422:26:314
1615451995718,0cyclictest0-21swapper/422:33:314
161545199570,38cyclictest1686988-21smartctl21:15:184
1615451995617,20cyclictest1661843-21lpstat20:30:174
1615451995537,18cyclictest0-21swapper/421:31:074
1615451995537,0cyclictest0-21swapper/423:34:554
1615451995517,38cyclictest105-21kcompactd022:06:314
1615451995517,19cyclictest191rcu_preempt00:03:204
1615451995517,19cyclictest1713723-21kworker/4:2-events23:04:434
1615451995517,19cyclictest1677774-21munin-run21:00:014
1615451995436,18cyclictest0-21swapper/419:39:004
1615451995419,15cyclictest0-21swapper/419:28:184
1615451995419,15cyclictest0-21swapper/419:15:464
1615451995416,19cyclictest783-21mta-sts-daemon23:23:054
1615451995335,18cyclictest878-21mta-sts-daemon23:54:134
1615451995334,19cyclictest0-21swapper/400:31:024
1615451995334,19cyclictest0-21swapper/400:31:014
1615451995319,15cyclictest0-21swapper/420:43:004
1615451995319,15cyclictest0-21swapper/419:20:394
1615453995214,19cyclictest0-21swapper/621:15:186
1615452995214,38cyclictest70-21ksoftirqd/523:45:175
1615451995233,19cyclictest0-21swapper/423:55:334
1615451995233,19cyclictest0-21swapper/422:50:064
1615451995233,19cyclictest0-21swapper/422:47:254
1615451995233,19cyclictest0-21swapper/421:36:374
1615451995233,19cyclictest0-21swapper/420:51:204
1615451995233,19cyclictest0-21swapper/420:45:414
1615451995233,19cyclictest0-21swapper/420:29:174
1615451995233,19cyclictest0-21swapper/420:20:034
1615451995233,19cyclictest0-21swapper/420:19:224
1615451995233,19cyclictest0-21swapper/400:36:494
1615451995233,19cyclictest0-21swapper/400:24:384
1615451995233,19cyclictest0-21swapper/400:16:494
1615451995218,15cyclictest0-21swapper/419:13:024
1615449995214,38cyclictest0-21swapper/223:50:152
1615449995214,19cyclictest0-21swapper/220:25:172
1615448995214,19cyclictest0-21swapper/121:00:181
1615448995214,19cyclictest0-21swapper/120:35:171
1615448995214,19cyclictest0-21swapper/119:30:181
1615451995133,18cyclictest0-21swapper/422:22:184
1615451995133,18cyclictest0-21swapper/421:26:424
1615451995133,18cyclictest0-21swapper/419:46:544
1615452995011,39cyclictest0-21swapper/523:20:165
1615451995032,18cyclictest0-21swapper/423:45:084
1615451995031,19cyclictest0-21swapper/421:24:354
1615453994910,38cyclictest0-21swapper/623:00:166
1615452994829,19cyclictest0-21swapper/521:20:205
1615449994810,19cyclictest0-21swapper/223:30:172
161544999479,38cyclictest0-21swapper/222:15:192
161545299468,19cyclictest0-21swapper/519:35:165
1615451994628,18cyclictest0-21swapper/421:14:114
161544799467,39cyclictest0-21swapper/000:05:180
161545399457,19cyclictest0-21swapper/621:20:206
1615451994526,0cyclictest0-21swapper/423:41:594
161544999446,19cyclictest0-21swapper/220:45:212
161544899445,20cyclictest0-21swapper/119:35:161
161544799445,39cyclictest0-21swapper/019:45:200
1615452994325,18cyclictest0-21swapper/519:40:175
161545399424,19cyclictest0-21swapper/621:05:206
161545399424,19cyclictest0-21swapper/620:05:186
161545299424,19cyclictest0-21swapper/522:35:165
161545299424,19cyclictest0-21swapper/519:55:165
1615452994141,0cyclictest0-21swapper/523:16:555
161545299413,19cyclictest0-21swapper/519:45:195
161544799411,39cyclictest0-21swapper/020:40:170
161544799402,19cyclictest0-21swapper/022:25:160
1615447994021,19cyclictest0-21swapper/020:25:160
161544799401,39cyclictest0-21swapper/021:05:200
161545399390,38cyclictest0-21swapper/623:40:186
1615452993920,19cyclictest0-21swapper/523:10:245
161544799390,16cyclictest0-21swapper/022:15:190
1615452993818,20cyclictest70-21ksoftirqd/520:00:175
1615449993819,19cyclictest0-21swapper/223:10:182
1615449993814,19cyclictest0-21swapper/219:40:162
161544999380,19cyclictest0-21swapper/200:35:172
161544899380,19cyclictest0-21swapper/100:30:171
161544899380,19cyclictest0-21swapper/100:30:161
161545299370,18cyclictest0-21swapper/520:35:195
161544899370,18cyclictest0-21swapper/122:10:161
1615447993713,19cyclictest0-21swapper/022:10:160
161545299360,17cyclictest0-21swapper/522:00:165
1615447993612,19cyclictest0-21swapper/023:15:170
161545299350,35cyclictest0-21swapper/523:50:155
161545299350,16cyclictest0-21swapper/519:10:165
161544899350,35cyclictest0-21swapper/120:05:181
161544799350,16cyclictest0-21swapper/000:25:180
161544799350,15cyclictest0-21swapper/020:10:150
161544799350,15cyclictest0-21swapper/019:35:170
1615453993415,19cyclictest0-21swapper/622:35:176
1615453993415,19cyclictest0-21swapper/622:05:176
161545399340,15cyclictest0-21swapper/622:20:146
161545299340,15cyclictest0-21swapper/521:55:175
161545299340,15cyclictest0-21swapper/520:25:175
161545299340,15cyclictest0-21swapper/500:00:155
1615449993415,19cyclictest0-21swapper/223:25:172
1615449993410,24cyclictest0-21swapper/220:05:182
161544999340,34cyclictest0-21swapper/220:50:162
161544899340,15cyclictest0-21swapper/123:35:191
1615447993433,1cyclictest1732974-21kworker/0:0+events22:51:550
1615447993414,19cyclictest0-21swapper/019:55:170
1615447993414,19cyclictest0-21swapper/019:25:150
161544799340,15cyclictest0-21swapper/019:30:170
1615453993314,19cyclictest0-21swapper/600:20:166
1615452993314,19cyclictest0-21swapper/521:25:165
1615452993314,19cyclictest0-21swapper/521:15:185
1615452993314,19cyclictest0-21swapper/521:00:185
1615452993314,19cyclictest0-21swapper/520:30:155
1615452993314,19cyclictest0-21swapper/520:15:155
1615452993314,19cyclictest0-21swapper/520:05:185
1615452993314,19cyclictest0-21swapper/519:50:165
1615449993314,19cyclictest0-21swapper/223:40:172
1615449993314,19cyclictest0-21swapper/200:20:162
1615449993313,19cyclictest0-21swapper/219:30:172
1615448993314,19cyclictest0-21swapper/123:25:191
1615448993314,19cyclictest0-21swapper/122:30:181
1615448993314,19cyclictest0-21swapper/119:10:221
1615448993314,19cyclictest0-21swapper/100:10:171
1615448993314,0cyclictest0-21swapper/123:10:171
1615448993313,19cyclictest0-21swapper/122:50:181
1615447993314,19cyclictest0-21swapper/022:55:180
1615447993314,19cyclictest0-21swapper/022:40:180
1615447993314,19cyclictest0-21swapper/022:20:150
1615447993314,19cyclictest0-21swapper/000:00:160
1615447993313,19cyclictest0-21swapper/021:40:170
1615453993214,18cyclictest0-21swapper/619:10:176
1615453993214,0cyclictest0-21swapper/621:55:156
1615453993213,19cyclictest0-21swapper/623:20:176
1615453993213,19cyclictest0-21swapper/623:05:186
1615453993213,19cyclictest0-21swapper/621:45:176
1615453993213,19cyclictest0-21swapper/619:30:236
1615453993213,19cyclictest0-21swapper/600:25:186
1615453993213,19cyclictest0-21swapper/600:00:156
1615452993213,19cyclictest0-21swapper/523:55:175
1615452993213,19cyclictest0-21swapper/523:40:185
1615452993213,19cyclictest0-21swapper/522:50:185
1615452993213,19cyclictest0-21swapper/522:30:185
1615452993213,19cyclictest0-21swapper/520:10:165
1615449993213,19cyclictest0-21swapper/222:35:172
1615449993213,19cyclictest0-21swapper/221:45:182
1615449993213,19cyclictest0-21swapper/220:15:152
1615449993213,19cyclictest0-21swapper/219:50:152
1615448993214,0cyclictest0-21swapper/123:50:151
1615448993213,19cyclictest0-21swapper/123:05:181
1615448993213,19cyclictest0-21swapper/122:55:171
1615448993213,19cyclictest0-21swapper/121:50:161
1615448993213,19cyclictest0-21swapper/120:25:161
1615448993213,19cyclictest0-21swapper/100:35:221
1615448993213,0cyclictest0-21swapper/121:40:161
1615448993213,0cyclictest0-21swapper/121:38:461
1615447993213,19cyclictest0-21swapper/023:10:170
1615447993213,19cyclictest0-21swapper/022:30:170
1615447993213,19cyclictest0-21swapper/021:10:170
1615453993113,0cyclictest0-21swapper/620:55:176
1615453993112,19cyclictest0-21swapper/623:30:186
1615453993112,19cyclictest0-21swapper/620:35:246
1615453993112,19cyclictest0-21swapper/620:00:176
1615452993112,19cyclictest0-21swapper/522:44:275
1615452993112,19cyclictest0-21swapper/521:50:165
1615452993112,19cyclictest0-21swapper/521:05:195
1615448993112,19cyclictest0-21swapper/100:15:161
1615447993112,19cyclictest0-21swapper/021:35:170
1615447993112,19cyclictest0-21swapper/021:30:190
1615447993112,19cyclictest0-21swapper/020:20:160
1615447993112,19cyclictest0-21swapper/000:35:160
1615447993112,19cyclictest0-21swapper/000:10:160
1615452993011,19cyclictest0-21swapper/523:05:185
1615452993011,19cyclictest0-21swapper/519:20:185
1615449993011,19cyclictest0-21swapper/220:40:162
1615449993011,19cyclictest0-21swapper/200:00:152
1615448993011,19cyclictest0-21swapper/123:45:171
1615448993011,19cyclictest0-21swapper/120:10:151
1615453992911,18cyclictest0-21swapper/622:40:186
1615452992910,19cyclictest0-21swapper/523:35:195
161544999295,19cyclictest0-21swapper/200:25:172
1615449992910,19cyclictest0-21swapper/219:15:162
1615448992910,19cyclictest0-21swapper/122:20:151
161545399289,19cyclictest0-21swapper/622:00:166
1615448992810,0cyclictest0-21swapper/122:15:181
161544799289,19cyclictest0-21swapper/020:15:150
161544799288,19cyclictest0-21swapper/023:40:180
161545299278,19cyclictest0-21swapper/523:25:175
1615447992717,9cyclictest1609546-21kworker/0:1+events19:10:040
161544899267,19cyclictest0-21swapper/120:50:171
161545399256,19cyclictest0-21swapper/600:35:166
161545299256,19cyclictest0-21swapper/521:35:185
1615452992525,0cyclictest105-21kcompactd000:33:445
1615452992525,0cyclictest105-21kcompactd000:33:435
161544999256,19cyclictest0-21swapper/200:10:162
161544999252,23cyclictest0-21swapper/223:20:162
161544899256,0cyclictest0-21swapper/119:20:181
161544799256,19cyclictest0-21swapper/021:19:170
161545399246,18cyclictest0-21swapper/620:30:156
161544999245,19cyclictest0-21swapper/222:45:162
161544999240,24cyclictest0-21swapper/200:33:262
161544999240,24cyclictest0-21swapper/200:33:262
161544899245,19cyclictest0-21swapper/119:45:191
161544799245,19cyclictest0-21swapper/023:20:160
161544799245,19cyclictest0-21swapper/020:30:230
161545499230,22cyclictest0-21swapper/723:10:137
161545299234,19cyclictest0-21swapper/521:45:185
161544899234,19cyclictest0-21swapper/123:55:151
161544899234,19cyclictest0-21swapper/120:30:151
161544899234,19cyclictest0-21swapper/119:15:161
1615447992318,4cyclictest1685739-21kworker/0:1+events21:20:150
161544799230,23cyclictest0-21swapper/023:46:010
161545499223,19cyclictest0-21swapper/723:35:187
161545499223,19cyclictest0-21swapper/723:00:167
161545499223,19cyclictest0-21swapper/722:45:167
161545499223,19cyclictest0-21swapper/722:35:177
161545499223,19cyclictest0-21swapper/721:50:167
161545499223,19cyclictest0-21swapper/720:50:167
161545499223,19cyclictest0-21swapper/720:35:187
161545499223,19cyclictest0-21swapper/719:20:197
161545499223,19cyclictest0-21swapper/700:30:177
161545499223,19cyclictest0-21swapper/700:30:167
161545499222,19cyclictest0-21swapper/721:25:177
161545499222,19cyclictest0-21swapper/720:40:177
161545399222,0cyclictest0-21swapper/619:38:466
161545299224,0cyclictest0-21swapper/500:10:355
1615452992222,0cyclictest0-21swapper/519:26:335
1615449992217,5cyclictest1749715-21mii-tool23:05:182
161544999220,22cyclictest0-21swapper/221:13:042
161544899220,21cyclictest0-21swapper/119:25:141
161544799223,19cyclictest0-21swapper/000:30:170
161544799223,19cyclictest0-21swapper/000:30:160
1615447992220,2cyclictest1779065-21kworker/0:0+events00:15:150
1615447992220,2cyclictest1776194-21kworker/0:1+events23:55:190
1615447992220,2cyclictest1736568-21kworker/0:1+events23:30:240
1615447992220,2cyclictest1736568-21kworker/0:1+events23:05:240
1615447992220,2cyclictest1732974-21kworker/0:0+events22:45:160
1615447992220,2cyclictest1710741-21kworker/0:0+events22:05:030
1615447992220,2cyclictest1696792-21kworker/0:2+events21:55:150
1615447992220,2cyclictest1685739-21kworker/0:1+events21:25:190
1615447992220,2cyclictest1620708-21kworker/0:2+events19:43:590
1615447992219,3cyclictest1770191-21kworker/0:2+events23:50:120
1615447992219,3cyclictest1609546-21kworker/0:1+events19:15:120
1615447992219,2cyclictest1668572-21kworker/0:1+events20:55:120
1615447992218,3cyclictest1668572-21kworker/0:1+events20:50:150
161545499212,19cyclictest0-21swapper/723:20:167
161545499212,19cyclictest0-21swapper/700:05:187
161545499211,20cyclictest0-21swapper/720:05:207
161545499210,21cyclictest0-21swapper/723:25:227
161545499210,0cyclictest0-21swapper/719:25:147
1615453992120,1cyclictest0-21swapper/622:11:456
161545399210,21cyclictest0-21swapper/622:17:096
161544999210,21cyclictest0-21swapper/220:20:122
1615447992120,1cyclictest1696792-21kworker/0:2+events21:53:200
1615447992120,1cyclictest1668572-21kworker/0:1+events21:03:110
1615447992119,2cyclictest1779065-21kworker/0:0+events00:20:190
1615447992119,2cyclictest1736568-21kworker/0:1+events23:35:150
1615447992119,2cyclictest1736568-21kworker/0:1+events23:25:150
1615447992119,2cyclictest1696792-21kworker/0:2+events22:00:160
1615447992119,2cyclictest1696792-21kworker/0:2+events21:45:190
1615447992119,2cyclictest1668572-21kworker/0:1+events20:45:270
1615447992119,2cyclictest1637502-21kworker/0:0+events19:51:510
1615447992118,3cyclictest1637502-21kworker/0:0+events20:05:240
1615454992020,0cyclictest0-21swapper/722:50:137
1615454992019,1cyclictest1089-21snmpd23:53:597
161545499201,19cyclictest0-21swapper/722:25:167
161545499201,19cyclictest0-21swapper/721:20:197
161545499201,19cyclictest0-21swapper/719:40:167
161545499201,19cyclictest0-21swapper/719:15:157
161545499201,19cyclictest0-21swapper/719:10:167
161545499200,20cyclictest0-21swapper/720:59:207
161545499200,1cyclictest0-21swapper/720:17:057
1615453992020,0cyclictest1089-21snmpd19:15:516
1615453992020,0cyclictest0-21swapper/622:45:586
1615453992019,1cyclictest89450irq/46-eno5-TxRx-223:14:106
1615453992019,1cyclictest1089-21snmpd20:21:566
1615453992019,1cyclictest1089-21snmpd00:10:146
1615453992019,0cyclictest89450irq/46-eno5-TxRx-221:25:056
161545399200,1cyclictest0-21swapper/623:57:386
161545299201,19cyclictest1660716-21kworker/u32:1+events_unbound22:15:125
1615450992020,0cyclictest1777770-21mii-tool23:55:153
1615450992020,0cyclictest1766539-21ethtool23:35:183
1615450992020,0cyclictest1732593-21mii-tool22:35:183
1615450992020,0cyclictest1616659-21mii-tool19:10:173
1615450992020,0cyclictest0-21swapper/323:10:133
1615450992020,0cyclictest0-21swapper/321:20:253
1615450992019,1cyclictest1706781-21mii-tool21:50:173
1615450992019,1cyclictest1089-21snmpd21:48:283
1615450992019,1cyclictest1089-21snmpd19:29:243
1615450992019,1cyclictest1089-21snmpd00:00:263
161545099200,20cyclictest0-21swapper/320:05:023
161545099200,0cyclictest0-21swapper/321:34:263
1615449992020,0cyclictest1715469-21ethtool22:05:182
1615449992019,1cyclictest1706793-21cat21:50:162
1615449992019,1cyclictest1692740-21ethtool21:25:162
161544999200,20cyclictest0-21swapper/223:15:092
161544999200,20cyclictest0-21swapper/219:14:242
161544999200,20cyclictest0-21swapper/200:06:032
161544999200,1cyclictest0-21swapper/200:17:452
1615448992020,0cyclictest1732574-21mii-tool22:35:161
1615448992020,0cyclictest1653147-21mii-tool20:15:161
1615448992020,0cyclictest1089-21snmpd21:46:071
1615448992019,1cyclictest1709597-21ethtool21:55:161
1615448992019,1cyclictest1089-21snmpd00:28:171
161544899200,20cyclictest0-21swapper/122:45:171
161544899200,20cyclictest0-21swapper/121:20:251
1615447992020,0cyclictest1736568-21kworker/0:1+events23:00:070
1615447992020,0cyclictest1732974-21kworker/0:0+events22:35:580
1615447992020,0cyclictest1637502-21kworker/0:0+events20:00:270
1615447992018,2cyclictest1637502-21kworker/0:0+events20:35:190
1615447992017,3cyclictest1620708-21kworker/0:2+events19:20:170
1615454991919,0cyclictest1789550-21mii-tool00:15:167
1615454991919,0cyclictest1089-21snmpd21:56:197
1615454991919,0cyclictest1089-21snmpd20:45:117
1615454991919,0cyclictest1089-21snmpd00:03:547
1615454991918,1cyclictest89550irq/47-eno5-TxRx-321:00:137
1615454991918,0cyclictest1089-21snmpd22:18:407
161545499190,19cyclictest30650irq/60-ahci[0000:00:07.0]21:30:267
161545499190,19cyclictest0-21swapper/723:55:157
161545499190,19cyclictest0-21swapper/722:55:177
161545499190,19cyclictest0-21swapper/722:40:197
161545499190,19cyclictest0-21swapper/722:05:177
161545499190,19cyclictest0-21swapper/721:46:017
161545499190,19cyclictest0-21swapper/721:35:177
161545499190,19cyclictest0-21swapper/721:16:197
161545499190,19cyclictest0-21swapper/720:34:447
161545499190,19cyclictest0-21swapper/720:20:167
161545499190,19cyclictest0-21swapper/720:10:157
161545499190,19cyclictest0-21swapper/719:55:177
161545499190,19cyclictest0-21swapper/700:10:177
1615453991919,0cyclictest89450irq/46-eno5-TxRx-220:14:306
1615453991919,0cyclictest1774985-21ethtool23:50:156
1615453991919,0cyclictest1673077-21mii-tool20:50:166
1615453991919,0cyclictest1658789-21ethtool20:25:166
1615453991919,0cyclictest1639111-21mii-tool19:50:156
1615453991919,0cyclictest1089-21snmpd23:45:196
1615453991919,0cyclictest1089-21snmpd19:42:486
1615453991918,1cyclictest89450irq/46-eno5-TxRx-221:10:456
1615453991918,1cyclictest1783415-21cat00:05:196
161545399190,19cyclictest0-21swapper/623:27:286
161545399190,19cyclictest0-21swapper/619:28:016
161545399190,19cyclictest0-21swapper/619:21:336
161545399190,19cyclictest0-21swapper/600:34:076
161545399190,19cyclictest0-21swapper/600:34:066
161545399190,0cyclictest0-21swapper/621:35:576
1615452991919,0cyclictest1743805-21mii-tool22:55:175
1615452991918,1cyclictest1619458-21ethtool19:15:175
1615452991918,1cyclictest1089-21snmpd23:01:195
161545299190,19cyclictest319-21ice-ptp-0000:f4:00.022:29:355
161545299190,19cyclictest0-21swapper/522:21:235
161545299190,19cyclictest0-21swapper/522:09:085
161545299190,19cyclictest0-21swapper/521:13:015
161545299190,19cyclictest0-21swapper/520:55:115
161545299190,0cyclictest0-21swapper/521:33:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional