You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 05:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Apr 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2540562960,1sleep7254057-21kthreadcore19:55:037
158003994441,2cyclictest119608-21kworker/u16:2+flush-8:019:29:394
158003994441,2cyclictest119608-21kworker/u16:2+flush-8:019:29:394
15756724333,7sleep50-21swapper/519:07:345
1493042413,31sleep70-21swapper/719:04:557
158011994037,2cyclictest824648-21kworker/u16:2+events_unbound00:24:566
158011994037,2cyclictest824648-21kworker/u16:2+events_unbound00:24:566
158009994039,1cyclictest476199-21kworker/u16:0+flush-8:022:19:395
15801699390,37cyclictest621348-21latency_hist22:44:397
158011993932,2cyclictest754850-21kworker/u16:1+events_unbound23:49:536
158016993836,1cyclictest180937-21latency_hist19:19:397
158011993836,2cyclictest363104-21kworker/u16:2+events_unbound22:05:576
158011993735,2cyclictest754850-21kworker/u16:1+events_unbound00:14:546
158011993735,2cyclictest754850-21kworker/u16:1+events_unbound00:08:256
158011993735,2cyclictest524671-21kworker/u16:1+events_unbound22:50:296
158011993735,2cyclictest476199-21kworker/u16:0+events_unbound22:47:216
158011993735,2cyclictest476199-21kworker/u16:0+events_unbound22:43:096
158011993735,2cyclictest438720-21kworker/u16:3+events_unbound22:02:486
15754723727,7sleep40-21swapper/419:07:174
158016993634,1cyclictest0-21swapper/723:50:097
15801699360,34cyclictest635-21systemd-journal22:24:397
15801699360,34cyclictest635-21systemd-journal22:24:397
158011993634,2cyclictest718182-21kworker/u16:4+flush-8:023:27:296
158011993634,2cyclictest633620-21kworker/u16:3+events_unbound23:20:136
158011993634,2cyclictest476199-21kworker/u16:0+events_unbound22:33:016
158011993634,2cyclictest476199-21kworker/u16:0+events_unbound21:52:386
158011993634,2cyclictest438720-21kworker/u16:3+events_unbound22:16:136
158011993533,2cyclictest839072-21kworker/u16:0+events_unbound00:22:336
158011993533,2cyclictest824648-21kworker/u16:2+events_unbound00:13:266
158011993533,2cyclictest633620-21kworker/u16:3+events_unbound23:03:386
158011993533,2cyclictest633620-21kworker/u16:3+events_unbound23:03:386
158011993533,2cyclictest438720-21kworker/u16:3+events_unbound21:32:566
158011993533,2cyclictest362943-21kworker/u16:1+events_unbound21:23:176
158003993533,2cyclictest476199-21kworker/u16:0+events_unbound22:30:214
158003993533,2cyclictest363104-21kworker/u16:2+flush-8:022:09:394
15745723525,7sleep60-21swapper/619:05:596
158011993432,2cyclictest839209-21kworker/u16:4+events_unbound00:32:246
158011993432,2cyclictest524671-21kworker/u16:1+events_unbound23:08:576
158011993432,2cyclictest363104-21kworker/u16:2+events_unbound22:21:246
158011993432,2cyclictest363104-21kworker/u16:2+events_unbound22:21:246
158011993431,2cyclictest363104-21kworker/u16:2+events_unbound21:41:026
4778302330,1chrt477831-21irqcore21:44:577
158011993331,2cyclictest718182-21kworker/u16:4+events_unbound23:47:016
158011993331,2cyclictest633620-21kworker/u16:3+flush-8:000:00:386
158011993331,2cyclictest438720-21kworker/u16:3+events_unbound21:47:536
158011993331,2cyclictest3639029-21kworker/u16:0+flush-8:019:14:456
158011993331,2cyclictest363104-21kworker/u16:2+events_unbound21:58:536
158011993331,2cyclictest362943-21kworker/u16:1+events_unbound21:17:416
158011993331,2cyclictest157775-21kworker/u16:3+flush-8:019:20:016
158011993230,2cyclictest416330-21kworker/u16:0+events_unbound21:26:216
158003993229,2cyclictest476199-21kworker/u16:0+events_unbound22:34:534
158003993228,3cyclictest887449-21kworker/u16:2+flush-8:000:34:584
158016993130,0cyclictest0-21swapper/722:34:497
158011993129,2cyclictest633620-21kworker/u16:3+flush-8:023:35:096
158011993129,2cyclictest476199-21kworker/u16:0+events_unbound23:16:366
158011993129,2cyclictest363104-21kworker/u16:2+events_unbound21:13:296
158011993129,2cyclictest362943-21kworker/u16:1+events_unbound21:38:186
158011993129,2cyclictest243893-21kworker/u16:4+events_unbound19:50:026
158003993129,2cyclictest718182-21kworker/u16:4+flush-8:023:29:344
158003993129,2cyclictest438720-21kworker/u16:3+events_unbound22:19:384
158003993129,2cyclictest362943-21kworker/u16:1+flush-8:021:34:494
158011993028,2cyclictest573193-21kworker/u16:4+flush-8:022:28:366
158011993028,2cyclictest476199-21kworker/u16:0+events_unbound23:12:106
158011993028,2cyclictest476199-21kworker/u16:0+events_unbound22:56:096
158011993028,2cyclictest309773-21kworker/u16:4+events_unbound20:27:456
158003993029,1cyclictest476199-21kworker/u16:0+events_unbound23:30:094
158003993027,2cyclictest324573-21kworker/u16:3+flush-8:020:45:054
8481002290,1chrt848101-21sh00:15:077
158011992927,2cyclictest573193-21kworker/u16:4+events_unbound22:38:086
158011992927,2cyclictest438720-21kworker/u16:3+events_unbound22:11:086
158011992927,2cyclictest309773-21kworker/u16:4+events_unbound20:35:506
158003992926,2cyclictest257782-21kworker/u16:0+flush-8:020:09:394
158016992823,4cyclictest635-21systemd-journal00:00:387
158011992826,2cyclictest3639029-21kworker/u16:0+events_unbound19:38:506
158011992826,2cyclictest324573-21kworker/u16:3+flush-8:020:50:096
158003992827,1cyclictest416330-21kworker/u16:0+events_unbound21:26:384
158003992826,2cyclictest3639029-21kworker/u16:0+flush-8:019:34:394
158011992725,2cyclictest887449-21kworker/u16:2+events_unbound00:38:176
158011992725,2cyclictest754850-21kworker/u16:1+events_unbound23:42:286
158011992725,2cyclictest718182-21kworker/u16:4+events_unbound23:56:246
158011992725,2cyclictest633620-21kworker/u16:3+events_unbound23:30:176
158011992725,2cyclictest309773-21kworker/u16:4+events_unbound20:41:496
158011992725,2cyclictest309773-21kworker/u16:4+events_unbound20:30:496
158011992725,2cyclictest238389-21kworker/u16:1+events_unbound20:01:446
158003992724,2cyclictest754850-21kworker/u16:1+flush-8:023:54:494
158003992724,2cyclictest362943-21kworker/u16:1+flush-8:021:19:574
158011992624,2cyclictest257782-21kworker/u16:0+flush-8:020:15:506
158003992625,1cyclictest839072-21kworker/u16:0+events_unbound00:16:574
158003992624,2cyclictest754850-21kworker/u16:1+events_unbound00:25:494
158003992624,2cyclictest754850-21kworker/u16:1+events_unbound00:25:494
158011992523,2cyclictest363104-21kworker/u16:2+events_unbound21:05:016
158003992523,2cyclictest718182-21kworker/u16:4+events_unbound23:37:054
158003992523,2cyclictest633620-21kworker/u16:3+flush-8:023:20:414
158003992523,2cyclictest633620-21kworker/u16:3+flush-8:023:05:224
158003992523,2cyclictest524671-21kworker/u16:1+events_unbound22:29:204
158003992522,2cyclictest754850-21kworker/u16:1+events_unbound00:29:414
158003992522,2cyclictest362943-21kworker/u16:1+flush-8:021:44:494
7121112240,1chrt712112-21tr23:20:017
158016992419,4cyclictest335050-21expr20:39:527
15801699240,22cyclictest635-21systemd-journal22:09:397
158003992422,2cyclictest296130-21kworker/u16:2+events_unbound20:19:544
158003992422,2cyclictest157775-21kworker/u16:3+flush-8:020:15:094
158003992422,2cyclictest157775-21kworker/u16:3+flush-8:019:54:584
158003992422,2cyclictest119608-21kworker/u16:2+flush-8:019:49:574
158016992318,4cyclictest754370-21latency_hist23:39:397
158011992317,6cyclictest119608-21kworker/u16:2+flush-8:019:30:046
158003992322,1cyclictest3639029-21kworker/u16:0+flush-8:019:34:534
158003992321,2cyclictest573193-21kworker/u16:4+flush-8:022:40:054
158003992321,2cyclictest476199-21kworker/u16:0+flush-8:023:12:484
158003992320,2cyclictest718182-21kworker/u16:4+events_unbound23:39:494
158003992320,2cyclictest157775-21kworker/u16:3+flush-8:019:19:414
3696332220,0chrt0-21swapper/520:55:025
158011992220,2cyclictest157775-21kworker/u16:3+events_unbound19:56:456
158003992220,2cyclictest476199-21kworker/u16:0+flush-8:023:48:494
158003992220,2cyclictest476199-21kworker/u16:0+flush-8:022:54:564
158003992220,2cyclictest438720-21kworker/u16:3+flush-8:021:33:494
158016992117,2cyclictest314391-21sed20:25:107
158016992115,5cyclictest802743-21latency_hist23:59:397
158016992115,5cyclictest464212-21latency_hist21:39:397
158003992119,2cyclictest621811-21kworker/u16:2+events_unbound22:45:454
158003992119,2cyclictest363104-21kworker/u16:2+events_unbound22:20:134
158003992119,2cyclictest363104-21kworker/u16:2+events_unbound22:20:134
158003992119,2cyclictest257782-21kworker/u16:0+events_unbound20:35:094
158003992118,2cyclictest476199-21kworker/u16:0+events_unbound22:59:484
158003992118,2cyclictest476199-21kworker/u16:0+events_unbound22:59:484
158003992118,2cyclictest362943-21kworker/u16:1+events_unbound21:19:384
158016992019,0cyclictest0-21swapper/721:10:417
158016992014,5cyclictest669777-21latency_hist23:04:397
158016992014,5cyclictest669777-21latency_hist23:04:397
158011992018,2cyclictest157775-21kworker/u16:3+flush-8:020:10:056
158011992017,2cyclictest3639029-21kworker/u16:0+flush-8:019:24:556
158011992017,2cyclictest3639029-21kworker/u16:0+flush-8:019:24:556
158003992017,2cyclictest476199-21kworker/u16:0+events_unbound21:49:484
158016991918,0cyclictest0-21swapper/722:14:357
158016991915,3cyclictest1234-21snmpd20:58:347
158016991915,2cyclictest391695-21munin-run21:09:397
158016991913,5cyclictest645536-21latency_hist22:54:397
158011991917,2cyclictest3639029-21kworker/u16:0+flush-8:019:41:426
158011991917,2cyclictest157775-21kworker/u16:3+events_unbound19:11:426
158009991916,2cyclictest839209-21kworker/u16:4+flush-8:000:19:395
158003991918,1cyclictest363104-21kworker/u16:2+flush-8:021:40:094
158003991917,2cyclictest778619-21kworker/u16:2+events_unbound23:51:044
158003991917,2cyclictest510241-21kworker/u16:4+events_unbound21:55:444
158011991816,2cyclictest362943-21kworker/u16:1+flush-8:021:00:106
158011991816,2cyclictest362943-21kworker/u16:1+flush-8:021:00:106
158009991817,1cyclictest0-21swapper/521:15:265
15800999181,5cyclictest0-21swapper/523:23:265
158003991816,2cyclictest824648-21kworker/u16:2+flush-8:000:19:524
158003991816,2cyclictest438720-21kworker/u16:3+events_unbound22:10:504
158003991815,2cyclictest476199-21kworker/u16:0+flush-8:023:14:444
158016991716,0cyclictest0-21swapper/722:27:247
158016991714,2cyclictest0-21swapper/719:49:407
158003991715,2cyclictest633620-21kworker/u16:3+events_unbound00:12:244
158003991715,2cyclictest363104-21kworker/u16:2+flush-8:021:09:494
158016991612,3cyclictest0-21swapper/721:39:527
158016991610,5cyclictest276591-21latency_hist20:09:397
15801699160,14cyclictest731551-21ip_192.168.115.23:29:557
158009991615,1cyclictest754850-21kworker/u16:1+flush-8:000:09:535
158003991614,2cyclictest754850-21kworker/u16:1+events_unbound00:04:564
158003991614,2cyclictest621811-21kworker/u16:2+events_unbound22:54:214
158003991614,2cyclictest476199-21kworker/u16:0+events_unbound22:03:544
3769642150,1chrt376968-21kthreadcore21:00:017
3769642150,1chrt376968-21kthreadcore21:00:017
158016991513,1cyclictest0-21swapper/700:20:007
158011991513,2cyclictest238389-21kworker/u16:1+flush-8:020:04:396
158003991513,2cyclictest633620-21kworker/u16:3+events_unbound00:03:444
15800399150,1cyclictest0-21swapper/421:04:594
158016991412,1cyclictest874172-21ssh00:27:327
158016991412,1cyclictest874172-21ssh00:27:327
158016991411,2cyclictest0-21swapper/721:29:397
158016991410,3cyclictest1234-21snmpd00:32:247
15801699140,12cyclictest296140-21/usr/sbin/munin20:20:047
158009991413,1cyclictest0-21swapper/523:41:545
158009991413,1cyclictest0-21swapper/522:59:395
158009991413,1cyclictest0-21swapper/522:59:395
158009991413,1cyclictest0-21swapper/522:46:435
15800999140,1cyclictest0-21swapper/523:19:225
15800999140,14cyclictest0-21swapper/521:56:165
15800999140,14cyclictest0-21swapper/519:50:095
158003991412,2cyclictest362943-21kworker/u16:1+flush-8:021:00:414
158003991412,2cyclictest362943-21kworker/u16:1+flush-8:021:00:414
158003991412,2cyclictest119608-21kworker/u16:2+flush-8:019:45:114
15801699139,3cyclictest1234-21snmpd20:17:367
15801699138,4cyclictest828228-21cat00:09:557
15801699138,4cyclictest635-21systemd-journal21:59:407
15801699138,4cyclictest489641-21cat21:49:557
15801699136,6cyclictest6063-21gdbus21:29:187
158016991311,1cyclictest0-21swapper/720:00:067
158016991311,1cyclictest0-21swapper/719:30:007
158016991310,2cyclictest0-21swapper/723:05:057
15801699130,12cyclictest826938-21turbostat00:09:397
158011991311,2cyclictest3639029-21kworker/u16:0+events_unbound19:48:466
158009991312,1cyclictest0-21swapper/522:33:005
158009991312,1cyclictest0-21swapper/522:06:505
158009991312,1cyclictest0-21swapper/521:46:025
158009991311,2cyclictest438720-21kworker/u16:3+flush-8:021:34:395
15800999130,13cyclictest0-21swapper/521:35:565
158003991311,2cyclictest363104-21kworker/u16:2+events_unbound20:59:364
15801699129,2cyclictest1234-21snmpd20:45:577
15801699128,3cyclictest6032-21gmain23:18:167
15801699128,3cyclictest1234-21snmpd20:32:397
15801699128,3cyclictest1234-21snmpd20:10:037
15801699127,4cyclictest646833-21cat22:54:557
15801699127,4cyclictest181999-21cat19:19:557
158016991210,1cyclictest0-21swapper/719:25:067
158016991210,1cyclictest0-21swapper/719:25:067
15801699120,10cyclictest229825-21cat19:44:547
15801199120,12cyclictest0-21swapper/620:57:586
15800999129,2cyclictest5829-21JS15:59:265
158009991211,1cyclictest0-21swapper/521:25:325
158009991211,1cyclictest0-21swapper/519:36:075
158009991210,2cyclictest157775-21kworker/u16:3+flush-8:020:24:405
15800999120,12cyclictest0-21swapper/520:17:065
15800999120,12cyclictest0-21swapper/520:06:515
158003991211,1cyclictest0-21swapper/419:39:414
158003991210,2cyclictest309773-21kworker/u16:4+flush-8:020:25:094
15801699119,1cyclictest0-21swapper/720:34:557
15801699118,2cyclictest1234-21snmpd23:48:507
15801699118,2cyclictest1234-21snmpd22:48:497
15801699118,2cyclictest1234-21snmpd19:40:147
15801699118,2cyclictest1234-21snmpd00:35:137
15801699116,5cyclictest6382-21gvfs-afc-volume21:16:437
15801699116,4cyclictest755666-21cat23:39:547
15801699116,4cyclictest594175-21ntpq22:30:087
15801699115,4cyclictest722638-21grep23:25:007
15801699114,6cyclictest6895-21gmain19:09:537
158016991110,0cyclictest0-21swapper/720:50:107
15801699110,10cyclictest506257-21tr21:55:017
15801699110,10cyclictest1234-21snmpd19:36:207
15801199119,2cyclictest157775-21kworker/u16:3+events_unbound20:24:146
158009991110,1cyclictest0-21swapper/520:50:135
15800999110,11cyclictest0-21swapper/520:27:025
158003991110,1cyclictest0-21swapper/420:13:444
15801699107,2cyclictest426838-21sh21:22:337
15801699106,3cyclictest1234-21snmpd23:13:527
15801699100,9cyclictest1234-21snmpd22:16:307
15801199108,2cyclictest309773-21kworker/u16:4+flush-8:020:45:046
15800999109,1cyclictest0-21swapper/520:37:555
15800999105,4cyclictest362943-21kworker/u16:1+flush-8:021:04:395
15800999105,4cyclictest362943-21kworker/u16:1+flush-8:021:04:395
1580099990,1cyclictest0-21swapper/522:39:005
1580039997,2cyclictest3639029-21kworker/u16:0+flush-8:019:14:444
1580039997,2cyclictest257782-21kworker/u16:0+events_unbound20:33:494
1580039996,2cyclictest309773-21kworker/u16:4+flush-8:020:49:494
1580099983,4cyclictest6331-21gdbus23:54:395
1580099980,6cyclictest209469-21taskset19:34:095
826905270,1sleep50-21swapper/500:09:375
237985270,0sleep50-21swapper/519:46:435
1580099975,1cyclictest0-21swapper/519:14:415
1580099972,3cyclictest0-21swapper/500:04:235
1580039975,2cyclictest157775-21kworker/u16:3+flush-8:019:59:534
1580039974,2cyclictest158499-21cstates19:09:514
643986260,1sleep50-21swapper/522:51:475
1580099964,1cyclictest0-21swapper/500:39:115
1580099963,2cyclictest8868982sleep500:33:415
1580099963,2cyclictest76-21ksoftirqd/519:09:515
1580099963,2cyclictest4925832sleep521:50:005
1580099962,4cyclictest0-21swapper/523:07:535
1580099962,2cyclictest0-21swapper/523:27:125
1580099961,4cyclictest324330-21chrt20:31:545
1580099961,3cyclictest0-21swapper/521:59:595
1580099961,1cyclictest0-21swapper/523:33:245
1580099960,3cyclictest0-21swapper/522:25:075
1580099960,2cyclictest0-21swapper/520:02:455
1580099960,1cyclictest201rcu_preempt21:41:085
1580099960,1cyclictest0-21swapper/523:58:565
1580039960,2cyclictest0-21swapper/420:43:444
1580099953,1cyclictest8636242chrt00:24:435
1580099953,1cyclictest8636242chrt00:24:435
1580099951,1cyclictest201rcu_preempt00:15:025
1580099950,4cyclictest776275-21chrt23:45:325
1580099950,4cyclictest742743-21chrt23:34:425
1580099950,4cyclictest618988-21chrt22:40:165
1580099950,4cyclictest5944-21gsd-housekeepin22:55:385
1580099950,4cyclictest561344-21taskset22:19:415
1580099950,4cyclictest561344-21taskset22:19:415
1580099950,4cyclictest546202-21taskset22:10:115
1580099950,4cyclictest344160-21chrt20:44:445
1580099950,4cyclictest342794-21taskset20:40:045
1580099950,4cyclictest276971-21chrt20:09:435
1580099950,4cyclictest248176-21taskset19:54:455
1580099950,4cyclictest228408-21taskset19:41:145
1580099950,4cyclictest199705-21chrt19:26:085
1580099950,4cyclictest199705-21chrt19:26:085
1580099950,4cyclictest190101-21chrt19:20:555
1580099950,3cyclictest0-21swapper/523:09:515
1580099950,2cyclictest0-21swapper/521:20:075
1580099950,1cyclictest0-21swapper/521:05:375
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional