You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 15:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Mon Aug 10, 2026 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117725527060,7sleep40-21swapper/407:06:014
117713325621,30sleep70-21swapper/707:04:207
1177714994643,2cyclictest1534168-21kworker/u16:4+events_unbound09:58:145
1177714994341,2cyclictest1583045-21kworker/u16:3+flush-8:010:38:435
1177714994138,2cyclictest1805991-21kworker/u16:4+events_unbound11:58:155
117732124130,8sleep50-21swapper/507:06:585
1177717994035,4cyclictest1695693-21latency_hist11:03:137
1177714993937,2cyclictest1791925-21kworker/u16:0+events_unbound12:33:145
1177714993937,2cyclictest1326766-21kworker/u16:3+events_unbound08:23:135
1177714993835,2cyclictest1583045-21kworker/u16:3+events_unbound10:43:165
1177714993634,2cyclictest1583045-21kworker/u16:3+flush-8:011:03:505
1177714993633,2cyclictest1150793-21kworker/u16:1+flush-8:007:33:135
1177714993533,2cyclictest1487120-21kworker/u16:2+events_unbound10:05:315
117717023524,8sleep60-21swapper/607:04:516
1177714993432,2cyclictest1645287-21kworker/u16:1+flush-8:011:36:465
1177714993432,2cyclictest1645287-21kworker/u16:1+flush-8:011:36:465
1177714993432,2cyclictest1583045-21kworker/u16:3+events_unbound10:27:115
1177714993432,2cyclictest1436502-21kworker/u16:0+events_unbound09:19:165
1177714993432,2cyclictest1326766-21kworker/u16:3+events_unbound09:11:315
1177714993331,2cyclictest1791925-21kworker/u16:0+events_unbound11:42:025
1177714993331,2cyclictest1732406-21kworker/u16:3+events_unbound11:47:035
1177714993331,2cyclictest1461526-21kworker/u16:1+events_unbound10:29:305
1177714993331,2cyclictest1326766-21kworker/u16:3+events_unbound09:14:315
12243702320,1chrt0-21swapper/707:28:317
1177714993230,2cyclictest1766040-21kworker/u16:2+flush-8:011:51:275
1177714993230,2cyclictest1645287-21kworker/u16:1+events_unbound11:12:275
1177714993230,2cyclictest1583045-21kworker/u16:3+events_unbound10:56:595
1177714993230,2cyclictest1583045-21kworker/u16:3+events_unbound10:56:595
1177714993230,2cyclictest1512541-21kworker/u16:3+events_unbound09:51:315
1177717993128,2cyclictest1740233-21ssh11:18:357
1177717993126,4cyclictest1438832-21latency_hist09:18:137
1177714993129,2cyclictest1645287-21kworker/u16:1+flush-8:011:23:075
1177714993129,2cyclictest1645287-21kworker/u16:1+events_unbound11:15:145
1177714993129,2cyclictest1632409-21kworker/u16:0+flush-8:010:35:305
1177714993128,2cyclictest1326766-21kworker/u16:3+flush-8:008:23:155
1177710993129,2cyclictest1150793-21kworker/u16:1+flush-8:008:18:284
1177717993026,3cyclictest125-21kswapd010:17:057
1177717993026,3cyclictest125-21kswapd010:17:057
1177714993028,2cyclictest1805991-21kworker/u16:4+events_unbound12:16:305
1177714993028,2cyclictest1805991-21kworker/u16:4+events_unbound12:16:305
1177714993028,2cyclictest1791925-21kworker/u16:0+flush-8:012:31:235
1177714993028,2cyclictest1791925-21kworker/u16:0+flush-8:011:53:585
1177714993028,2cyclictest1766040-21kworker/u16:2+flush-8:012:06:595
1177714993028,2cyclictest1632409-21kworker/u16:0+events_unbound10:51:275
1177714993028,2cyclictest1570897-21kworker/u16:0+flush-8:010:11:275
1177714993028,2cyclictest1570897-21kworker/u16:0+events_unbound10:15:355
1177714993028,2cyclictest1570897-21kworker/u16:0+events_unbound10:15:355
1177714993028,2cyclictest1534168-21kworker/u16:4+flush-8:009:57:475
1177714993028,2cyclictest1461526-21kworker/u16:1+events_unbound09:46:245
1177714993028,2cyclictest1461526-21kworker/u16:1+events_unbound09:42:305
1177714993028,2cyclictest1176767-21kworker/u16:2+events_unbound07:23:155
1177710993028,2cyclictest1766040-21kworker/u16:2+events_unbound11:53:424
1177710993028,2cyclictest1645287-21kworker/u16:1+flush-8:010:43:084
1177717992927,1cyclictest1414384-21diskmemload09:26:237
1177714992927,2cyclictest1463650-21kworker/u16:4+events_unbound09:31:145
1177714992927,2cyclictest1461526-21kworker/u16:1+events_unbound10:22:265
1177714992927,2cyclictest1461526-21kworker/u16:1+events_unbound10:22:265
1177714992927,2cyclictest1436502-21kworker/u16:0+events_unbound09:25:265
1177710992927,2cyclictest1791925-21kworker/u16:0+events_unbound11:48:274
1177710992927,2cyclictest1307973-21kworker/u16:2+events_unbound09:13:444
1177710992927,2cyclictest1268868-21kworker/u16:3+events_unbound07:58:284
1177717992825,1cyclictest1732405-21systemd-run11:18:137
1177714992826,2cyclictest1866664-21kworker/u16:1+events_unbound12:24:325
1177714992826,2cyclictest1805991-21kworker/u16:4+events_unbound12:20:305
1177710992826,2cyclictest1705506-21kworker/u16:0+events_unbound11:23:404
1177710992826,2cyclictest1534168-21kworker/u16:4+flush-8:010:13:404
1177710992826,2cyclictest1534168-21kworker/u16:4+flush-8:010:13:404
1177710992826,2cyclictest1307973-21kworker/u16:2+events_unbound08:53:324
1177710992826,2cyclictest1307973-21kworker/u16:2+events_unbound08:23:274
1177717992725,1cyclictest1804179-21ssh11:45:397
1177714992725,2cyclictest1791925-21kworker/u16:0+events_unbound12:09:065
1177714992725,2cyclictest1705506-21kworker/u16:0+events_unbound11:24:275
1177714992725,2cyclictest1463650-21kworker/u16:4+flush-8:009:36:075
1177714992725,2cyclictest1463650-21kworker/u16:4+flush-8:009:36:075
1177710992725,2cyclictest1240081-21kworker/u16:0+events_unbound08:33:254
1177714992624,2cyclictest1585156-21kworker/u16:6+flush-8:010:59:555
1177714992623,2cyclictest1240081-21kworker/u16:0+events_unbound08:43:155
1177710992624,2cyclictest1732406-21kworker/u16:3+events_unbound11:38:274
1177710992624,2cyclictest1307973-21kworker/u16:2+events_unbound08:48:304
1177717992520,4cyclictest1878844-21latency_hist12:18:127
1177717992520,4cyclictest1878844-21latency_hist12:18:127
1177714992524,1cyclictest1645287-21kworker/u16:1+events_unbound11:30:345
1177714992523,2cyclictest1150793-21kworker/u16:1+events_unbound07:15:485
1177710992523,2cyclictest1461526-21kworker/u16:1+events_unbound10:28:354
1177710992523,2cyclictest1461526-21kworker/u16:1+events_unbound10:23:284
1177710992523,2cyclictest1307973-21kworker/u16:2+events_unbound08:28:284
1177710992523,2cyclictest1176767-21kworker/u16:2+events_unbound07:23:294
1177717992421,2cyclictest1235423-21cut07:33:337
1177717992322,0cyclictest0-21swapper/710:45:477
1177717992321,1cyclictest0-21swapper/710:53:327
1177717992321,1cyclictest0-21swapper/710:53:327
1177714992321,2cyclictest1414070-21kworker/u16:1+events_unbound09:04:315
1177714992321,2cyclictest1150793-21kworker/u16:1+flush-8:008:13:415
1177714992321,2cyclictest1150793-21kworker/u16:1+flush-8:008:13:415
1177710992321,2cyclictest1585156-21kworker/u16:6+events_unbound10:18:354
1177710992321,2cyclictest1585156-21kworker/u16:6+events_unbound10:18:354
14247992220,1chrt1424797-21ssh09:09:507
1177714992219,2cyclictest1150793-21kworker/u16:1+flush-8:007:33:195
1177710992220,2cyclictest1805991-21kworker/u16:4+events_unbound12:18:274
1177710992220,2cyclictest1766040-21kworker/u16:2+events_unbound11:33:264
1177710992220,2cyclictest1766040-21kworker/u16:2+events_unbound11:33:264
1177710992220,2cyclictest1583045-21kworker/u16:3+flush-8:010:48:534
1177715992118,3cyclictest1176767-21kworker/u16:2+flush-8:007:13:186
1177714992119,2cyclictest1326766-21kworker/u16:3+flush-8:008:50:235
1177714992119,2cyclictest1176767-21kworker/u16:2+flush-8:007:49:115
1177710992119,2cyclictest1900757-21kworker/u16:3+events_unbound12:33:414
1177710992119,2cyclictest1570897-21kworker/u16:0+events_unbound10:10:274
1177710992119,2cyclictest1436502-21kworker/u16:0+events_unbound09:18:264
1177717992019,0cyclictest0-21swapper/708:58:287
1177717992019,0cyclictest0-21swapper/708:58:287
1177717992017,2cyclictest1618266-21ssh10:28:367
1177717992015,4cyclictest1259122-21latency_hist07:48:147
1177714992018,2cyclictest1307973-21kworker/u16:2+events_unbound08:37:235
1177710992018,2cyclictest500961-21kworker/u16:5+events_unbound07:18:424
1177710992018,2cyclictest1766040-21kworker/u16:2+events_unbound11:28:414
1177710992018,2cyclictest1583045-21kworker/u16:3+events_unbound10:43:264
1177710992018,2cyclictest1436502-21kworker/u16:0+events_unbound09:23:194
1177710992016,2cyclictest1645287-21kworker/u16:1+events_unbound11:14:034
18530612190,1sleep40-21swapper/412:05:474
1177717991918,0cyclictest0-21swapper/708:43:367
1177717991917,1cyclictest1545903-21ssh09:58:417
1177717991917,1cyclictest0-21swapper/709:38:357
1177717991915,3cyclictest1282495-21kthreadcore07:58:327
1177714991917,2cyclictest500961-21kworker/u16:5+events_unbound07:09:235
1177714991917,2cyclictest1240081-21kworker/u16:0+flush-8:008:43:095
1177714991917,2cyclictest1150793-21kworker/u16:1+flush-8:008:05:205
1177710991917,2cyclictest500961-21kworker/u16:5+events_unbound07:13:414
1177710991917,2cyclictest1805991-21kworker/u16:4+events_unbound12:13:324
1177710991917,2cyclictest1805991-21kworker/u16:4+events_unbound12:13:324
1177710991917,2cyclictest1645287-21kworker/u16:1+events_unbound10:56:084
1177710991917,2cyclictest1645287-21kworker/u16:1+events_unbound10:56:084
1177710991917,2cyclictest1326766-21kworker/u16:3+flush-8:009:08:284
1177710991916,2cyclictest1240081-21kworker/u16:0+events_unbound08:38:244
1177717991816,1cyclictest1414384-21diskmemload11:38:377
1177717991816,1cyclictest1414384-21diskmemload11:23:347
1177717991815,2cyclictest1302-21snmpd09:46:087
1177715991813,1cyclictest0-21swapper/612:23:576
1177714991816,2cyclictest1307973-21kworker/u16:2+flush-8:008:59:235
1177714991816,2cyclictest1307973-21kworker/u16:2+flush-8:008:59:235
1177714991816,2cyclictest1268868-21kworker/u16:3+events_unbound07:55:205
1177714991816,2cyclictest1240081-21kworker/u16:0+flush-8:007:59:235
1177710991816,2cyclictest1805991-21kworker/u16:4+flush-8:011:58:424
1177710991816,2cyclictest1791925-21kworker/u16:0+events_unbound11:46:554
1177710991816,2cyclictest1585156-21kworker/u16:6+flush-8:010:58:224
1177710991816,2cyclictest1583045-21kworker/u16:3+events_unbound11:10:544
1177710991816,2cyclictest1583045-21kworker/u16:3+events_unbound10:35:594
1177710991816,2cyclictest1487120-21kworker/u16:2+events_unbound09:53:284
1177710991816,2cyclictest1436502-21kworker/u16:0+flush-8:009:41:354
1177710991815,2cyclictest1461526-21kworker/u16:1+events_unbound09:43:344
1177717991716,0cyclictest0-21swapper/708:33:397
1177717991715,1cyclictest1414384-21diskmemload09:28:337
117771799170,15cyclictest648-21systemd-journal08:33:137
1177714991715,2cyclictest1240081-21kworker/u16:0+events_unbound08:53:365
1177714991715,2cyclictest1176767-21kworker/u16:2+events_unbound07:41:245
1177710991715,2cyclictest1791925-21kworker/u16:0+flush-8:012:26:474
1177710991715,2cyclictest1583045-21kworker/u16:3+events_unbound11:08:134
1177710991715,2cyclictest1307973-21kworker/u16:2+flush-8:009:03:264
1177710991715,2cyclictest1240081-21kworker/u16:0+events_unbound08:08:084
1177710991715,2cyclictest1240081-21kworker/u16:0+events_unbound07:48:364
1177710991715,2cyclictest1176767-21kworker/u16:2+flush-8:007:33:284
1177717991615,0cyclictest0-21swapper/711:56:227
1177717991613,2cyclictest1302-21snmpd11:08:377
1177710991614,2cyclictest1766040-21kworker/u16:2+events_unbound12:11:234
1177710991614,2cyclictest1487120-21kworker/u16:2+flush-8:009:49:104
1177710991614,2cyclictest1487120-21kworker/u16:2+events_unbound10:03:324
1177710991614,2cyclictest1463650-21kworker/u16:4+events_unbound09:33:264
1177710991614,2cyclictest1463650-21kworker/u16:4+events_unbound09:33:264
1177710991614,2cyclictest1463650-21kworker/u16:4+events_unbound09:30:524
1177710991614,2cyclictest1201012-21kworker/u16:3+flush-8:007:28:464
1177710991614,2cyclictest1150793-21kworker/u16:1+events_unbound07:38:364
1177710991613,2cyclictest1240081-21kworker/u16:0+events_unbound07:53:314
117771799158,5cyclictest648-21systemd-journal08:03:137
1177717991514,0cyclictest0-21swapper/710:33:167
1177717991513,1cyclictest1414384-21diskmemload12:03:127
117771799150,14cyclictest0-21swapper/710:18:367
117771799150,14cyclictest0-21swapper/710:18:367
1177715991514,1cyclictest0-21swapper/609:36:116
1177715991514,1cyclictest0-21swapper/609:36:116
1177715991513,2cyclictest1805991-21kworker/u16:4+flush-8:012:18:226
117771599150,14cyclictest0-21swapper/609:28:286
1177714991513,2cyclictest1240081-21kworker/u16:0+events_unbound08:09:245
1177710991513,2cyclictest1791925-21kworker/u16:0+events_unbound12:29:434
1177710991513,2cyclictest1645287-21kworker/u16:1+flush-8:011:23:124
1177710991513,2cyclictest1487120-21kworker/u16:2+events_unbound09:58:474
1177710991513,2cyclictest1176767-21kworker/u16:2+events_unbound07:43:294
1177710991511,3cyclictest1305285-21kthreadcore08:08:344
1177717991413,0cyclictest0-21swapper/710:03:407
117771799140,1cyclictest0-21swapper/711:03:387
117771599149,4cyclictest1299096-21cat08:08:286
117771599146,7cyclictest0-21swapper/609:58:296
1177715991413,1cyclictest0-21swapper/611:46:066
1177715991413,1cyclictest0-21swapper/610:44:096
1177715991413,1cyclictest0-21swapper/610:16:526
1177715991413,1cyclictest0-21swapper/610:16:526
1177715991413,1cyclictest0-21swapper/609:38:146
1177715991413,1cyclictest0-21swapper/609:20:446
117771599140,7cyclictest0-21swapper/607:33:296
117771599140,1cyclictest0-21swapper/612:11:206
117771599140,1cyclictest0-21swapper/609:47:336
117771599140,1cyclictest0-21swapper/609:26:256
117771599140,14cyclictest86-21ksoftirqd/612:03:366
117771599140,14cyclictest0-21swapper/610:58:586
117771599140,14cyclictest0-21swapper/610:21:556
117771599140,14cyclictest0-21swapper/610:21:556
1177714991411,2cyclictest1150793-21kworker/u16:1+events_unbound07:43:375
1177710991412,2cyclictest1307973-21kworker/u16:2+events_unbound08:43:314
117771799139,3cyclictest5965-21gmain12:23:387
117771799139,3cyclictest1302-21snmpd09:06:137
117771799139,3cyclictest1302-21snmpd08:13:187
117771799139,3cyclictest1302-21snmpd08:13:187
117771799139,3cyclictest1302-21snmpd07:26:537
117771799138,4cyclictest648-21systemd-journal07:13:147
1177717991311,1cyclictest1866626-21turbostat12:13:127
1177717991310,2cyclictest0-21swapper/710:53:127
117771799130,12cyclictest0-21swapper/709:48:377
117771799130,11cyclictest1927988-21cat12:38:137
117771599131,7cyclictest1180944-21grep07:08:306
1177715991312,1cyclictest0-21swapper/611:34:176
1177715991312,1cyclictest0-21swapper/611:34:176
1177715991312,1cyclictest0-21swapper/611:24:026
1177715991312,1cyclictest0-21swapper/611:07:106
1177715991312,1cyclictest0-21swapper/610:41:376
1177715991312,1cyclictest0-21swapper/610:34:326
1177715991312,1cyclictest0-21swapper/608:08:136
1177715991310,2cyclictest0-21swapper/610:08:286
117771599130,0cyclictest0-21swapper/612:01:336
1177710991311,2cyclictest1307973-21kworker/u16:2+events_unbound08:59:014
1177710991311,2cyclictest1307973-21kworker/u16:2+events_unbound08:59:014
1177710991311,2cyclictest1150793-21kworker/u16:1+events_unbound08:13:294
1177710991311,2cyclictest1150793-21kworker/u16:1+events_unbound08:13:294
1177710991310,2cyclictest500961-21kworker/u16:5+flush-8:007:08:244
117771799129,2cyclictest1302-21snmpd07:43:027
117771799128,3cyclictest1302-21snmpd11:32:327
117771799128,3cyclictest1302-21snmpd10:27:397
117771799128,3cyclictest1302-21snmpd09:33:267
117771799128,3cyclictest1302-21snmpd09:33:267
117771799126,5cyclictest1573192-21latency_hist10:13:137
117771799123,7cyclictest6233-21gvfs-afc-volume07:18:387
1177717991210,1cyclictest0-21swapper/707:48:297
117771799120,2cyclictest1889136-21ssh12:19:457
117771599126,5cyclictest1758187-21irqcore11:28:306
117771599123,8cyclictest1612396-21cut10:28:326
1177715991211,1cyclictest0-21swapper/612:35:376
1177715991211,1cyclictest0-21swapper/611:55:536
1177715991211,1cyclictest0-21swapper/609:51:396
117771599121,10cyclictest1554605-21cut10:03:326
117771599121,10cyclictest1371662-21kthreadcore08:43:326
117771599120,1cyclictest0-21swapper/608:25:156
117771599120,1cyclictest0-21swapper/607:19:306
117771799117,3cyclictest1302-21snmpd12:04:577
117771799117,3cyclictest1302-21snmpd11:33:177
117771799117,3cyclictest1302-21snmpd11:33:177
117771799117,3cyclictest1302-21snmpd08:38:547
117771799117,3cyclictest1302-21snmpd08:27:277
117771799116,4cyclictest6233-21gvfs-afc-volume08:53:447
117771799114,2cyclictest1383023-21kthreadcore08:48:357
117771799110,2cyclictest1442754-21ssh09:18:317
117771799110,1cyclictest1645691-21ssh10:41:177
117771799110,10cyclictest1815761-21ssh11:49:277
117771799110,10cyclictest1302-21snmpd12:30:367
117771799110,10cyclictest1302-21snmpd08:21:397
117771599117,3cyclictest1318473-21cat08:18:286
117771599116,4cyclictest1377246-21kthreadcore08:48:316
117771599115,5cyclictest1357019-21/usr/sbin/munin08:38:266
117771599112,8cyclictest1415149-21grep09:08:266
117771599112,5cyclictest1905574-21kthreadcore12:28:316
117771599112,3cyclictest1428045-21sed09:13:316
117771599111,9cyclictest1604180-21cut10:23:336
117771599111,9cyclictest1408264-21grep09:03:306
117771599111,4cyclictest1244544-21grep07:38:316
1177715991110,1cyclictest0-21swapper/610:54:526
1177715991110,1cyclictest0-21swapper/610:54:526
1177715991110,1cyclictest0-21swapper/608:29:586
1177715991110,1cyclictest0-21swapper/607:31:386
117771599110,4cyclictest1279141-21cpuspeed_turbos07:58:266
117771599110,3cyclictest1275854-21kthreadcore07:53:326
117771599110,10cyclictest1402409-21kthreadcore08:58:356
117771599110,10cyclictest1402409-21kthreadcore08:58:356
117771799100,2cyclictest1525689-21ssh09:53:307
117771599109,1cyclictest0-21swapper/612:14:586
117771599109,1cyclictest0-21swapper/612:14:586
117771599106,3cyclictest1525416-21tune2fs09:53:286
117771599103,6cyclictest1783429-21cut11:38:306
117771599103,6cyclictest1737777-21tr11:18:346
117771599103,6cyclictest0-21swapper/611:13:316
117771599102,7cyclictest1809982-21grep11:48:326
117771599101,4cyclictest1711365-21cut11:08:296
117771599101,4cyclictest13529191kthreadcore08:33:346
117771599100,9cyclictest1211393-21expr07:23:276
11777179995,3cyclictest6233-21gvfs-afc-volume08:08:267
11777179994,4cyclictest1271675-21cut07:53:297
11777179994,4cyclictest1187273-21cat07:13:087
11777159996,2cyclictest1659493-21grep10:48:256
11777159992,6cyclictest1385768-21grep08:53:286
11777159992,6cyclictest1253110-21grep07:43:296
11777159992,5cyclictest1259606-21cpuspeed_turbos07:48:246
11777159982,5cyclictest1310253-21kthreadcore08:13:306
11777159982,5cyclictest1310253-21kthreadcore08:13:306
11777149987,1cyclictest0-21swapper/507:20:385
11777149975,1cyclictest0-21swapper/508:28:265
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional