You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 17:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri May 01, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40224225140,8sleep40-21swapper/407:08:414
40196625039,8sleep50-21swapper/507:04:495
402534994442,2cyclictest912778-21kworker/u16:0+events_unbound11:01:145
402530994441,2cyclictest818536-21kworker/u16:2+events_unbound10:28:554
402534994139,2cyclictest891163-21kworker/u16:2+events_unbound11:59:555
402530994139,2cyclictest670057-21kworker/u16:0+events_unbound09:23:564
402530994138,2cyclictest891163-21kworker/u16:2+events_unbound11:18:554
3930952413,31sleep70-21swapper/707:04:037
402534994038,2cyclictest559685-21kworker/u16:3+events_unbound09:58:005
402534993937,2cyclictest626712-21kworker/u16:2+events_unbound09:15:555
402534993937,2cyclictest364323-21kworker/u16:1+events_unbound07:23:535
402534993836,2cyclictest1085446-21kworker/u16:0+events_unbound12:33:555
402530993836,2cyclictest912778-21kworker/u16:0+events_unbound11:26:034
402534993735,2cyclictest976047-21kworker/u16:1+events_unbound11:45:355
402534993735,2cyclictest976047-21kworker/u16:1+events_unbound11:45:355
402534993735,2cyclictest891163-21kworker/u16:2+events_unbound11:30:035
402534993735,2cyclictest757585-21kworker/u16:0+flush-8:010:14:515
402534993735,2cyclictest742922-21kworker/u16:1+events_unbound09:50:035
402534993735,2cyclictest1085446-21kworker/u16:0+events_unbound12:17:075
402530993735,2cyclictest839947-21kworker/u16:4+flush-8:010:38:594
402530993735,2cyclictest839947-21kworker/u16:4+events_unbound11:31:274
402539993634,1cyclictest540394-21perf08:18:537
402539993633,2cyclictest412018-21munin-run07:13:547
402534993634,2cyclictest742922-21kworker/u16:1+events_unbound10:23:365
402534993634,2cyclictest742922-21kworker/u16:1+events_unbound10:23:365
402530993634,2cyclictest839947-21kworker/u16:4+events_unbound10:57:114
402530993634,2cyclictest1086776-21kworker/u16:3+events_unbound12:28:314
402536993533,2cyclictest976047-21kworker/u16:1+flush-8:011:54:196
402534993533,2cyclictest976047-21kworker/u16:1+events_unbound12:06:125
402534993533,2cyclictest976047-21kworker/u16:1+events_unbound11:58:025
402534993533,2cyclictest976047-21kworker/u16:1+events_unbound11:38:595
402534993533,2cyclictest912778-21kworker/u16:0+events_unbound11:07:485
402534993533,2cyclictest742922-21kworker/u16:1+flush-8:010:24:515
402534993533,2cyclictest670057-21kworker/u16:0+flush-8:009:48:195
402534993533,2cyclictest616923-21kworker/u16:1+flush-8:009:09:355
402534993533,2cyclictest559685-21kworker/u16:3+events_unbound10:30:525
402534993532,2cyclictest839947-21kworker/u16:4+events_unbound10:57:075
402530993533,2cyclictest976047-21kworker/u16:1+events_unbound12:36:474
402530993533,2cyclictest559685-21kworker/u16:3+events_unbound09:57:314
402534993432,2cyclictest891163-21kworker/u16:2+events_unbound12:11:315
402534993432,2cyclictest839947-21kworker/u16:4+events_unbound10:50:035
402534993432,2cyclictest839947-21kworker/u16:4+events_unbound10:38:435
402534993432,2cyclictest757585-21kworker/u16:0+events_unbound10:01:045
402534993431,2cyclictest1086776-21kworker/u16:3+events_unbound12:19:045
402530993432,2cyclictest976047-21kworker/u16:1+events_unbound11:52:304
402530993432,2cyclictest839947-21kworker/u16:4+events_unbound11:38:354
402530993432,2cyclictest757585-21kworker/u16:0+events_unbound10:06:234
402539993328,4cyclictest745334-21latency_hist09:53:547
402534993331,2cyclictest891163-21kworker/u16:2+events_unbound11:15:555
402534993331,2cyclictest839947-21kworker/u16:4+events_unbound10:42:555
402534993331,2cyclictest757585-21kworker/u16:0+events_unbound10:11:045
402534993331,2cyclictest742922-21kworker/u16:1+events_unbound10:08:395
402534993331,2cyclictest626712-21kworker/u16:2+events_unbound09:33:355
402534993331,2cyclictest559685-21kworker/u16:3+events_unbound09:28:365
402534993331,2cyclictest364323-21kworker/u16:1+events_unbound08:40:045
402530993331,2cyclictest670057-21kworker/u16:0+events_unbound09:46:034
402530993331,2cyclictest559685-21kworker/u16:3+events_unbound10:00:034
402530993331,2cyclictest435106-21kworker/u16:2+events_unbound07:53:564
402530993331,2cyclictest1086776-21kworker/u16:3+events_unbound12:17:444
402530993331,2cyclictest1085446-21kworker/u16:0+events_unbound12:21:314
402539993226,5cyclictest696713-21latency_hist09:33:537
402536993230,2cyclictest976047-21kworker/u16:1+flush-8:011:49:236
402534993230,2cyclictest976047-21kworker/u16:1+events_unbound12:32:315
402534993230,2cyclictest976047-21kworker/u16:1+events_unbound11:35:595
402534993230,2cyclictest626712-21kworker/u16:2+events_unbound09:37:395
402534993230,2cyclictest559685-21kworker/u16:3+events_unbound09:41:005
402534993230,2cyclictest559685-21kworker/u16:3+events_unbound09:41:005
402530993230,2cyclictest891163-21kworker/u16:2+events_unbound11:47:444
402530993230,2cyclictest891163-21kworker/u16:2+events_unbound11:47:444
402530993230,2cyclictest891163-21kworker/u16:2+events_unbound11:15:044
402530993230,2cyclictest839947-21kworker/u16:4+events_unbound12:07:074
402530993230,2cyclictest839947-21kworker/u16:4+events_unbound10:34:234
402530993230,2cyclictest757585-21kworker/u16:0+events_unbound10:20:114
402530993230,2cyclictest757585-21kworker/u16:0+events_unbound10:20:114
402530993230,2cyclictest626712-21kworker/u16:2+events_unbound09:52:364
402530993230,2cyclictest616923-21kworker/u16:1+events_unbound09:17:354
402534993129,2cyclictest912778-21kworker/u16:0+events_unbound11:21:065
402534993129,2cyclictest891163-21kworker/u16:2+flush-8:011:24:565
402534993129,2cyclictest670057-21kworker/u16:0+events_unbound09:23:075
402534993129,2cyclictest1085446-21kworker/u16:0+events_unbound12:27:155
402530993129,2cyclictest742922-21kworker/u16:1+events_unbound10:28:314
402530993129,2cyclictest670057-21kworker/u16:0+events_unbound09:22:204
402530993128,2cyclictest976047-21kworker/u16:1+flush-8:012:09:034
402539993028,1cyclictest636106-21diskmemload11:13:077
402534993028,2cyclictest976047-21kworker/u16:1+events_unbound11:49:595
402534993027,2cyclictest502193-21kworker/u16:0+events_unbound08:58:555
402534993027,2cyclictest364323-21kworker/u16:1+events_unbound07:34:045
402530993028,2cyclictest891163-21kworker/u16:2+events_unbound11:39:554
402530993028,2cyclictest839947-21kworker/u16:4+events_unbound11:09:424
402530993028,2cyclictest616923-21kworker/u16:1+flush-8:009:08:594
402530993028,2cyclictest559685-21kworker/u16:3+events_unbound09:40:394
402530993028,2cyclictest559685-21kworker/u16:3+events_unbound09:40:394
402530993028,2cyclictest559685-21kworker/u16:3+events_unbound09:36:404
402539992926,2cyclictest569210-21sed08:33:547
402539992923,5cyclictest878841-21latency_hist10:48:547
402536992927,2cyclictest757585-21kworker/u16:0+events_unbound10:34:196
402534992927,2cyclictest891163-21kworker/u16:2+events_unbound11:13:365
402534992927,2cyclictest839947-21kworker/u16:4+events_unbound10:44:355
402530992927,2cyclictest912778-21kworker/u16:0+events_unbound11:06:504
402530992927,2cyclictest912778-21kworker/u16:0+events_unbound11:02:324
402530992927,2cyclictest839947-21kworker/u16:4+events_unbound11:58:434
402530992927,2cyclictest742922-21kworker/u16:1+events_unbound10:17:564
402530992927,2cyclictest626712-21kworker/u16:2+flush-8:009:30:554
402530992927,2cyclictest559685-21kworker/u16:3+events_unbound10:45:474
402530992927,2cyclictest502193-21kworker/u16:0+flush-8:008:59:034
402539992827,0cyclictest0-21swapper/711:59:037
402539992825,2cyclictest646604-21ssh09:11:047
402536992825,2cyclictest502193-21kworker/u16:0+flush-8:008:59:116
402530992826,2cyclictest891163-21kworker/u16:2+events_unbound12:02:044
402530992826,2cyclictest757585-21kworker/u16:0+events_unbound10:53:034
402530992826,2cyclictest1086776-21kworker/u16:3+events_unbound12:29:514
402539992725,1cyclictest636106-21diskmemload12:24:037
402539992722,4cyclictest1097208-21latency_hist12:18:537
40253999270,25cyclictest434933-21perf07:23:537
402534992725,2cyclictest559685-21kworker/u16:3+events_unbound08:33:545
402530992725,2cyclictest757585-21kworker/u16:0+events_unbound10:13:154
402539992625,0cyclictest0-21swapper/711:44:397
402539992625,0cyclictest0-21swapper/711:44:397
402539992624,1cyclictest891425-21ssh10:53:567
402539992624,1cyclictest636106-21diskmemload11:42:267
40253999260,24cyclictest1234-21snmpd10:52:047
402536992623,2cyclictest626712-21kworker/u16:2+flush-8:009:04:116
402530992624,2cyclictest626712-21kworker/u16:2+events_unbound09:07:044
402530992623,2cyclictest364323-21kworker/u16:1+events_unbound07:33:554
402539992524,0cyclictest0-21swapper/711:16:037
402539992523,1cyclictest636106-21diskmemload11:54:447
402539992523,1cyclictest0-21swapper/709:39:057
402539992523,1cyclictest0-21swapper/709:39:057
402539992521,2cyclictest816740-21ssh10:21:277
402539992521,2cyclictest816740-21ssh10:21:277
402536992523,2cyclictest626712-21kworker/u16:2+flush-8:009:24:306
402536992522,2cyclictest818536-21kworker/u16:2+flush-8:010:29:136
402534992523,2cyclictest616923-21kworker/u16:1+events_unbound09:08:515
402534992523,2cyclictest483269-21kworker/u16:3+events_unbound08:02:035
402534992523,2cyclictest364323-21kworker/u16:1+events_unbound07:53:045
402530992523,2cyclictest483269-21kworker/u16:3+events_unbound07:59:234
9756882240,0chrt975686-21ssh11:28:227
402539992422,1cyclictest926764-21ssh11:07:447
402539992422,1cyclictest669934-21ssh09:19:237
402539992422,1cyclictest636106-21diskmemload12:32:047
402539992420,2cyclictest732793-21ssh09:48:047
402539992418,5cyclictest988125-21latency_hist11:33:547
402530992422,2cyclictest364323-21kworker/u16:1+events_unbound08:38:034
40197622413,8sleep60-21swapper/607:04:586
40253999230,21cyclictest511641-21latency_hist08:03:537
402536992321,2cyclictest891163-21kworker/u16:2+flush-8:010:59:096
402536992321,2cyclictest839947-21kworker/u16:4+flush-8:012:08:536
402534992321,2cyclictest435107-21kworker/u16:3+events_unbound07:24:045
402534992320,2cyclictest435106-21kworker/u16:2+events_unbound07:43:565
402539992221,0cyclictest0-21swapper/709:25:597
402539992218,3cyclictest1034253-21ssh11:49:347
402536992220,2cyclictest626712-21kworker/u16:2+events_unbound09:14:226
402534992220,2cyclictest559685-21kworker/u16:3+events_unbound08:57:045
402534992220,2cyclictest483269-21kworker/u16:3+events_unbound08:09:235
402530992220,2cyclictest364323-21kworker/u16:1+events_unbound07:27:044
402539992120,0cyclictest0-21swapper/711:34:027
402539992120,0cyclictest0-21swapper/710:30:117
402539992120,0cyclictest0-21swapper/709:35:037
402539992120,0cyclictest0-21swapper/708:09:137
402539992118,2cyclictest124-21kswapd012:09:167
402539992117,3cyclictest963648-21ssh11:23:327
402536992119,2cyclictest757585-21kworker/u16:0+events_unbound09:59:076
402536992119,2cyclictest559685-21kworker/u16:3+events_unbound08:29:196
402530992119,2cyclictest483269-21kworker/u16:3+events_unbound08:12:034
402530992119,2cyclictest364323-21kworker/u16:1+events_unbound07:33:044
402534992018,2cyclictest364323-21kworker/u16:1+events_unbound07:42:035
402530992018,2cyclictest559685-21kworker/u16:3+events_unbound08:43:054
402530992018,2cyclictest530850-21kworker/u16:2+events_unbound08:23:044
402530992018,2cyclictest502193-21kworker/u16:0+events_unbound08:05:034
402539991918,0cyclictest0-21swapper/708:24:047
402539991917,1cyclictest0-21swapper/710:08:557
402539991911,6cyclictest635-21systemd-journal08:43:547
40253999190,17cyclictest865380-21sshd-session10:41:317
402534991917,2cyclictest502193-21kworker/u16:0+events_unbound08:28:035
402539991817,0cyclictest0-21swapper/710:59:167
402539991816,1cyclictest0-21swapper/710:06:157
402539991815,2cyclictest768483-21ssh10:01:517
402536991816,2cyclictest616923-21kworker/u16:1+events_unbound09:09:076
402534991816,2cyclictest364323-21kworker/u16:1+events_unbound07:57:045
402530991816,2cyclictest502193-21kworker/u16:0+events_unbound08:31:044
402539991716,0cyclictest0-21swapper/712:23:427
402539991716,0cyclictest0-21swapper/710:36:587
402539991716,0cyclictest0-21swapper/710:18:497
40253999171,14cyclictest657181-21ssh09:14:207
402534991715,2cyclictest435106-21kworker/u16:2+events_unbound07:32:055
402530991715,2cyclictest588279-21kworker/u16:2+events_unbound08:58:284
402530991715,2cyclictest559685-21kworker/u16:3+events_unbound08:50:044
402530991715,2cyclictest364323-21kworker/u16:1+events_unbound07:40:044
402530991714,2cyclictest502193-21kworker/u16:0+events_unbound08:13:564
40253999163,11cyclictest626538-21latency_hist09:03:547
402539991615,0cyclictest0-21swapper/712:37:327
402539991615,0cyclictest0-21swapper/710:25:517
402539991615,0cyclictest0-21swapper/708:44:147
402536991615,1cyclictest0-21swapper/611:38:196
402534991614,2cyclictest502193-21kworker/u16:0+events_unbound08:17:295
402530991614,2cyclictest364323-21kworker/u16:1+events_unbound07:19:094
402530991612,3cyclictest412021-21perf07:18:494
402539991514,0cyclictest0-21swapper/707:44:067
402536991511,3cyclictest698000-21cat09:34:086
402536991510,4cyclictest916332-21fschecks_count11:04:076
402534991513,2cyclictest559685-21kworker/u16:3+flush-8:008:44:285
402534991513,2cyclictest559685-21kworker/u16:3+events_unbound08:34:555
402530991513,2cyclictest3903547-21kworker/u16:4+events_unbound07:13:494
402539991413,0cyclictest0-21swapper/708:34:167
402539991411,2cyclictest1072923-21idleruntime-cro12:08:537
402536991413,1cyclictest0-21swapper/611:44:096
402536991413,1cyclictest0-21swapper/611:44:096
402536991413,1cyclictest0-21swapper/611:17:406
402536991413,1cyclictest0-21swapper/611:09:006
402536991413,1cyclictest0-21swapper/609:48:076
402536991411,2cyclictest504158-21kthreadcore07:59:116
40253699140,1cyclictest0-21swapper/611:41:286
40253699140,1cyclictest0-21swapper/611:26:586
40253699140,1cyclictest0-21swapper/611:21:276
40253699140,14cyclictest0-21swapper/611:32:396
40253699140,14cyclictest0-21swapper/607:29:096
40253499140,14cyclictest0-21swapper/508:49:175
402530991412,2cyclictest502193-21kworker/u16:0+events_unbound08:27:044
402530991412,2cyclictest435106-21kworker/u16:2+flush-8:007:44:134
40253999136,6cyclictest5822-21gmain07:54:117
402536991311,2cyclictest530850-21kworker/u16:2+events_unbound08:24:086
402534991311,2cyclictest502193-21kworker/u16:0+events_unbound08:06:525
40253999128,3cyclictest1234-21snmpd08:04:387
40253999126,5cyclictest6895-21gmain07:39:477
40253699129,2cyclictest86-21ksoftirqd/610:19:116
40253699129,2cyclictest86-21ksoftirqd/610:19:116
40253699120,1cyclictest0-21swapper/607:57:456
402534991210,2cyclictest364323-21kworker/u16:1+events_unbound07:09:095
402530991211,1cyclictest0-21swapper/408:44:074
402530991210,2cyclictest364323-21kworker/u16:1+events_unbound07:49:174
40253999118,2cyclictest1234-21snmpd07:33:287
40253999118,2cyclictest1234-21snmpd07:15:517
40253999117,3cyclictest1234-21snmpd07:28:317
40253999116,4cyclictest1234-21snmpd09:05:137
40253999114,6cyclictest6032-21gmain09:57:147
40253999110,10cyclictest1234-21snmpd07:48:557
40253699118,2cyclictest86-21ksoftirqd/610:04:116
40253699116,1cyclictest745336-21turbostat09:53:536
40253699115,5cyclictest0-21swapper/612:34:116
40253699114,6cyclictest0-21swapper/611:59:116
402536991110,1cyclictest0-21swapper/608:19:126
402536991110,1cyclictest0-21swapper/608:18:256
402536991110,1cyclictest0-21swapper/607:47:026
402536991110,1cyclictest0-21swapper/607:38:316
40253699110,1cyclictest0-21swapper/607:21:016
402534991110,1cyclictest0-21swapper/507:17:015
40253999107,2cyclictest6895-21gmain08:19:477
40253999106,3cyclictest1234-21snmpd08:49:397
40253999106,3cyclictest1234-21snmpd07:35:377
40253699109,1cyclictest0-21swapper/607:12:126
40253699108,2cyclictest86-21ksoftirqd/610:57:016
40253699107,2cyclictest517249-21kthreadcore08:04:146
40253699106,3cyclictest589412-21cat08:44:096
40253699105,4cyclictest693326-21load09:29:156
40253699104,5cyclictest0-21swapper/612:29:136
40253699102,3cyclictest1115211-21cut12:24:126
40253699100,9cyclictest709897-21expr09:39:056
40253699100,9cyclictest709897-21expr09:39:056
40253699100,9cyclictest666858-21cut09:19:116
40253699100,4cyclictest1087667-21kthreadcore12:14:096
40253699100,3cyclictest1100479-21kthreadcore12:19:106
40253699100,1cyclictest0-21swapper/610:24:096
40253499108,2cyclictest530850-21kworker/u16:2+events_unbound08:22:485
4025399997,1cyclictest0-21swapper/708:54:057
4025369997,2cyclictest86-21ksoftirqd/610:46:246
4025369997,2cyclictest86-21ksoftirqd/610:09:066
4025369996,2cyclictest879302-21/usr/sbin/munin10:49:056
4025369995,3cyclictest858343-21cat10:39:106
4025369995,3cyclictest800675-21kthreadcore10:14:136
4025369995,3cyclictest483890-21tune2fs07:49:076
4025369993,5cyclictest0-21swapper/607:27:366
4025369990,8cyclictest415316-21kthreadcore07:13:586
4025369990,8cyclictest0-21swapper/607:39:216
4025369990,4cyclictest747416-21kthreadcore09:54:096
4025369990,3cyclictest1073410-21grep12:09:046
4025369985,2cyclictest570101-21tune2fs08:34:076
4025369983,4cyclictest608538-21cat08:54:086
4025369983,4cyclictest598868-21cut08:49:086
4025369983,4cyclictest584300-21grep08:39:126
4025369980,7cyclictest530677-21pool-NetworkMan08:12:056
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional