You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 10:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Mar 25, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18532525747,7sleep50-21swapper/519:00:215
18531525746,8sleep40-21swapper/419:00:124
185818994842,5cyclictest650-21systemd-journal21:58:087
185818994740,6cyclictest208496-21latency_hist19:13:097
185816994238,3cyclictest218437-21kworker/u16:0+flush-8:019:28:406
185816994238,3cyclictest218437-21kworker/u16:0+flush-8:019:28:406
18525924232,7sleep60-21swapper/618:59:266
18581899400,38cyclictest256196-21latency_hist19:38:097
1851432403,31sleep70-21swapper/718:58:477
18581899390,37cyclictest562858-21latency_hist22:03:097
185818993731,5cyclictest650-21systemd-journal21:33:087
185808993734,2cyclictest755587-21kworker/u16:0+flush-8:023:43:035
18581899360,34cyclictest284955-21sed19:53:097
185808993634,2cyclictest623142-21kworker/u16:3+flush-8:022:38:045
185808993332,1cyclictest623142-21kworker/u16:3+events_unbound22:43:345
185816993230,2cyclictest755587-21kworker/u16:0+flush-8:023:43:406
185816993230,2cyclictest218437-21kworker/u16:0+flush-8:019:18:276
185808993230,2cyclictest693807-21kworker/u16:4+flush-8:023:08:035
3411602310,0chrt341159-21/usr/sbin/munin20:18:347
185816993129,2cyclictest346604-21kworker/u16:4+events_unbound21:13:276
185808993129,2cyclictest719453-21kworker/u16:1+events_unbound23:28:335
185808993129,2cyclictest294461-21kworker/u16:4+events_unbound20:08:325
185808993128,2cyclictest502707-21kworker/u16:0+events_unbound21:53:215
185808993128,2cyclictest132667-21kworker/u16:1+flush-8:019:13:245
185808993028,2cyclictest623143-21kworker/u16:4+events_unbound22:38:355
185808993028,2cyclictest346604-21kworker/u16:4+events_unbound21:23:375
185808993027,2cyclictest452689-21kworker/u16:1+flush-8:021:58:145
185818992928,0cyclictest0-21swapper/720:38:407
185808992927,2cyclictest693807-21kworker/u16:4+flush-8:023:18:385
6950662280,1chrt695065-21ssh22:57:337
185816992826,2cyclictest275465-21kworker/u16:2+flush-8:019:48:316
185816992825,2cyclictest452689-21kworker/u16:1+events_unbound21:28:226
6583492270,1chrt658347-21ssh22:41:227
185818992722,4cyclictest900067-21latency_hist00:23:087
18581899270,25cyclictest361183-21latency_hist20:33:097
185816992725,2cyclictest623144-21kworker/u16:5+events_unbound22:33:386
185816992725,2cyclictest399128-21kworker/u16:0+flush-8:021:03:476
185808992725,2cyclictest599237-21kworker/u16:2+flush-8:000:08:395
185808992725,2cyclictest502707-21kworker/u16:0+events_unbound21:38:345
185808992725,2cyclictest502707-21kworker/u16:0+events_unbound21:38:345
6748922260,1chrt741rcuc/522:48:265
6334462260,0sleep60-21swapper/622:29:596
185818992625,0cyclictest0-21swapper/719:28:087
185816992624,2cyclictest693807-21kworker/u16:4+flush-8:023:33:256
185816992624,2cyclictest527195-21kworker/u16:4+events_unbound22:18:086
185816992624,2cyclictest452689-21kworker/u16:1+events_unbound22:18:356
185816992624,2cyclictest452689-21kworker/u16:1+events_unbound21:58:326
185816992624,2cyclictest218437-21kworker/u16:0+events_unbound19:23:356
185808992623,2cyclictest876078-21kworker/u16:1+flush-8:000:33:035
18581899250,23cyclictest294459-21cat19:58:097
185808992523,2cyclictest683835-21kworker/u16:1+events_unbound22:53:365
185808992523,2cyclictest502707-21kworker/u16:0+flush-8:021:53:085
185818992422,1cyclictest740416-21ssh23:13:327
18581899240,23cyclictest833586-21grep23:53:287
185816992422,2cyclictest132667-21kworker/u16:1+events_unbound19:08:346
185816992421,2cyclictest186015-21kworker/u16:3+events_unbound20:23:236
185808992422,2cyclictest346604-21kworker/u16:4+flush-8:020:58:245
185808992421,3cyclictest693807-21kworker/u16:4+flush-8:023:23:255
185818992322,0cyclictest0-21swapper/722:03:317
185816992321,2cyclictest803696-21kworker/u16:1+flush-8:023:58:346
185816992321,2cyclictest132667-21kworker/u16:1+events_unbound19:03:236
185816992220,2cyclictest623142-21kworker/u16:3+flush-8:022:48:306
185816992219,2cyclictest599237-21kworker/u16:2+events_unbound22:23:216
185816992219,2cyclictest186015-21kworker/u16:3+flush-8:019:33:356
185816992218,3cyclictest719453-21kworker/u16:1+flush-8:023:08:136
185808992119,2cyclictest275465-21kworker/u16:2+events_unbound19:48:325
185818992012,7cyclictest0-21swapper/722:23:087
185816992018,2cyclictest466731-21kworker/u16:3+flush-8:021:33:266
185816992018,2cyclictest466731-21kworker/u16:3+events_unbound21:38:306
185816992018,2cyclictest466731-21kworker/u16:3+events_unbound21:38:306
185816992018,2cyclictest275465-21kworker/u16:2+flush-8:019:58:286
185816992018,2cyclictest186015-21kworker/u16:3+events_unbound20:43:316
185816992017,2cyclictest218437-21kworker/u16:0+events_unbound19:43:236
185808992018,2cyclictest186015-21kworker/u16:3+events_unbound20:03:375
185808992017,2cyclictest502707-21kworker/u16:0+flush-8:021:43:335
185808992017,2cyclictest346604-21kworker/u16:4+events_unbound21:08:225
185818991918,0cyclictest0-21swapper/719:03:287
185818991917,1cyclictest792949-21ssh23:38:247
185818991916,2cyclictest620186-21sh22:23:367
185808991917,2cyclictest693807-21kworker/u16:4+flush-8:023:53:485
185818991818,0cyclictest0-21swapper/722:13:367
185818991814,3cyclictest124-21kswapd022:58:347
18581899180,17cyclictest1267-21snmpd00:12:037
185816991816,2cyclictest502707-21kworker/u16:0+events_unbound21:43:276
185808991814,3cyclictest218437-21kworker/u16:0+flush-8:019:23:345
185803991815,2cyclictest5873-21gsd-housekeepin23:42:534
18581899179,7cyclictest0-21swapper/721:03:217
18581899176,9cyclictest0-21swapper/721:43:317
18581899176,9cyclictest0-21swapper/721:23:277
185818991716,0cyclictest0-21swapper/720:36:427
185818991713,3cyclictest1267-21snmpd20:26:037
18581899171,2cyclictest680285-21ssh22:48:337
185816991714,3cyclictest186015-21kworker/u16:3+events_unbound20:33:336
185816991714,2cyclictest852281-21kworker/u16:3+flush-8:000:08:266
185808991715,2cyclictest599237-21kworker/u16:2+flush-8:022:28:285
185808991715,2cyclictest399128-21kworker/u16:0+events_unbound21:03:315
185808991714,2cyclictest218437-21kworker/u16:0+flush-8:019:43:295
18581899168,7cyclictest0-21swapper/721:53:087
18581899167,8cyclictest0-21swapper/722:33:257
185818991613,2cyclictest625831-21ssh22:28:267
185816991614,2cyclictest693807-21kworker/u16:4+events_unbound22:58:356
185816991614,2cyclictest527195-21kworker/u16:4+flush-8:022:13:046
185816991611,3cyclictest452689-21kworker/u16:1+events_unbound22:03:236
185803991615,1cyclictest0-21swapper/421:36:264
185803991614,2cyclictest5873-21gsd-housekeepin21:27:334
185803991613,2cyclictest5873-21gsd-housekeepin00:01:534
185803991612,3cyclictest295287-21df19:58:224
18580399160,1cyclictest201rcu_preempt19:08:234
18581899157,7cyclictest0-21swapper/721:13:217
18581899156,8cyclictest0-21swapper/723:08:267
185818991513,1cyclictest242129-21kthreadcore19:28:297
185818991513,1cyclictest242129-21kthreadcore19:28:297
18581899151,2cyclictest752428-21ssh23:18:337
18581899150,6cyclictest462633-21ssh21:18:297
185816991513,2cyclictest346604-21kworker/u16:4+flush-8:021:28:096
185816991512,2cyclictest623143-21kworker/u16:4+flush-8:022:38:256
185816991512,2cyclictest527195-21kworker/u16:4+events_unbound21:53:236
185808991514,1cyclictest0-21swapper/522:27:295
185808991513,2cyclictest876078-21kworker/u16:1+flush-8:000:23:135
185808991513,2cyclictest452689-21kworker/u16:1+events_unbound22:18:245
18580899150,14cyclictest593747-21kthreadcore22:13:275
185803991514,1cyclictest65-21ksoftirqd/421:46:214
185803991513,2cyclictest5873-21gsd-housekeepin23:16:534
185803991513,2cyclictest5873-21gsd-housekeepin22:52:334
185803991513,2cyclictest5873-21gsd-housekeepin22:42:334
185803991513,2cyclictest399544-21kworker/u16:2+events_unbound20:53:564
185803991512,2cyclictest5873-21gsd-housekeepin20:45:334
185803991512,2cyclictest423175-21kthreadcore21:03:284
185803991512,1cyclictest201rcu_preempt22:13:324
18581899148,5cyclictest514723-21latency_hist21:43:087
18581899148,5cyclictest514723-21latency_hist21:43:087
18581899146,7cyclictest0-21swapper/723:28:237
18581899146,7cyclictest0-21swapper/700:28:227
18581899145,8cyclictest0-21swapper/723:23:227
185818991412,1cyclictest0-21swapper/719:38:327
185818991411,2cyclictest584823-21ssh22:09:077
185816991413,1cyclictest0-21swapper/623:05:576
185816991413,1cyclictest0-21swapper/621:50:456
185816991413,1cyclictest0-21swapper/600:23:316
185816991412,2cyclictest186015-21kworker/u16:3+events_unbound20:13:316
185816991411,2cyclictest218437-21kworker/u16:0+flush-8:019:38:356
18581699140,1cyclictest0-21swapper/623:42:416
185808991412,2cyclictest218437-21kworker/u16:0+events_unbound19:18:245
185808991412,2cyclictest186015-21kworker/u16:3+flush-8:020:18:235
185803991413,1cyclictest312501-21netstat20:03:344
185803991413,1cyclictest0-21swapper/423:34:494
185803991413,1cyclictest0-21swapper/423:30:244
185803991413,1cyclictest0-21swapper/421:40:504
185803991413,1cyclictest0-21swapper/421:40:504
185803991413,1cyclictest0-21swapper/400:30:474
185803991412,2cyclictest5873-21gsd-housekeepin20:41:334
185803991412,1cyclictest264780-21ntpq19:38:324
185803991412,1cyclictest211506-21tr19:13:264
185803991411,2cyclictest692251-21ntpq22:53:324
185803991411,2cyclictest236169-21ntpq19:23:334
18580399140,1cyclictest65-21ksoftirqd/422:20:054
18580399140,1cyclictest0-21swapper/422:01:104
18580399140,1cyclictest0-21swapper/400:20:134
18580399140,14cyclictest0-21swapper/423:43:394
18581899139,3cyclictest1267-21snmpd21:08:287
18581899139,3cyclictest1267-21snmpd20:15:387
18581899136,6cyclictest0-21swapper/723:37:187
18581899136,6cyclictest0-21swapper/723:03:227
18581899136,6cyclictest0-21swapper/700:26:537
18581899136,6cyclictest0-21swapper/700:03:367
18581899135,7cyclictest0-21swapper/723:59:237
18581899135,7cyclictest0-21swapper/723:46:357
18581899135,7cyclictest0-21swapper/722:44:467
18581899134,8cyclictest885002-21ntp_states00:13:377
18581899134,8cyclictest0-21swapper/721:33:257
185818991312,0cyclictest0-21swapper/720:48:067
185818991312,0cyclictest0-21swapper/719:58:337
18581899130,1cyclictest0-21swapper/720:53:297
185816991312,1cyclictest346604-21kworker/u16:4+events_unbound20:58:326
185816991312,1cyclictest0-21swapper/623:15:446
185816991311,2cyclictest850214-21kworker/u16:0+flush-8:000:13:256
185816991311,2cyclictest452689-21kworker/u16:1+events_unbound21:18:346
185816991311,2cyclictest346604-21kworker/u16:4+flush-8:020:48:336
185816991311,2cyclictest323408-21kworker/u16:0+flush-8:020:18:396
185816991311,2cyclictest186015-21kworker/u16:3+flush-8:020:28:326
18581699130,13cyclictest0-21swapper/623:25:306
18581699130,0cyclictest0-21swapper/623:53:346
18581699130,0cyclictest0-21swapper/622:56:116
185808991312,1cyclictest0-21swapper/500:18:005
185808991311,2cyclictest527195-21kworker/u16:4+events_unbound22:08:305
185808991311,2cyclictest452689-21kworker/u16:1+events_unbound21:28:245
18580899130,13cyclictest0-21swapper/523:48:505
18580899130,13cyclictest0-21swapper/523:14:095
18580399137,2cyclictest0-21swapper/421:53:264
185803991312,1cyclictest744008-21/usr/sbin/munin23:18:214
185803991312,1cyclictest724336-21cut23:08:254
185803991312,1cyclictest716946-21/usr/sbin/munin23:03:364
185803991312,1cyclictest640071-21cut22:33:284
185803991312,1cyclictest618258-21grep22:23:294
185803991312,1cyclictest580317-21cut22:08:274
185803991312,1cyclictest535322-21kthreadcore21:48:304
185803991312,1cyclictest480844-21kthreadcore21:28:264
185803991312,1cyclictest433045-21kthreadcore21:08:254
185803991312,1cyclictest226884-21sed19:18:364
185803991312,1cyclictest0-21swapper/423:56:444
185803991312,1cyclictest0-21swapper/422:43:254
185803991311,2cyclictest5873-21gsd-housekeepin20:35:334
185803991311,2cyclictest5873-21gsd-housekeepin20:19:344
185803991311,1cyclictest851868-21perf00:08:034
185803991311,1cyclictest704013-21latency22:58:304
185803991311,1cyclictest274178-21missed_timers19:43:304
185803991311,1cyclictest0-21swapper/423:23:264
18580399130,1cyclictest0-21swapper/422:06:514
18580399130,13cyclictest0-21swapper/421:20:494
18581899128,3cyclictest1267-21snmpd21:00:427
18581899128,3cyclictest1267-21snmpd20:52:007
18581899128,3cyclictest1267-21snmpd20:10:387
18581899128,3cyclictest1267-21snmpd19:17:587
18581899125,6cyclictest0-21swapper/723:48:167
18581899120,2cyclictest0-21swapper/720:03:347
185816991211,1cyclictest0-21swapper/622:44:216
185816991211,1cyclictest0-21swapper/621:12:266
185816991211,1cyclictest0-21swapper/600:19:166
185816991211,1cyclictest0-21swapper/600:06:296
185816991210,2cyclictest719453-21kworker/u16:1+flush-8:023:18:346
185816991210,2cyclictest275465-21kworker/u16:2+events_unbound20:08:286
185808991211,1cyclictest0-21swapper/523:44:165
185808991211,1cyclictest0-21swapper/500:22:255
185808991210,2cyclictest693807-21kworker/u16:4+events_unbound23:33:225
185803991211,1cyclictest411997-21kthreadcore20:58:284
185803991211,1cyclictest355901-21kthreadcore20:28:284
185803991211,1cyclictest325017-21kthreadcore20:13:264
185803991211,1cyclictest318804-21kthreadcore20:08:264
185803991211,1cyclictest280217-21tr19:48:274
185803991211,1cyclictest0-21swapper/421:13:344
185803991211,1cyclictest0-21swapper/400:15:584
185803991211,1cyclictest0-21swapper/400:11:434
185803991210,2cyclictest346604-21kworker/u16:4+events_unbound20:50:084
185803991210,2cyclictest186015-21kworker/u16:3+events_unbound20:25:114
185803991210,1cyclictest190183-21kthreadcore19:03:304
18581899117,3cyclictest1267-21snmpd19:43:387
18581899110,1cyclictest185800-21cyclictest19:18:217
18581699119,2cyclictest186015-21kworker/u16:3+flush-8:019:13:366
18581699110,11cyclictest0-21swapper/620:05:076
18581699110,11cyclictest0-21swapper/619:56:466
18580899119,2cyclictest399128-21kworker/u16:0+events_unbound21:13:215
18580899118,3cyclictest186015-21kworker/u16:3+flush-8:020:38:355
18580899118,2cyclictest186015-21kworker/u16:3+events_unbound20:28:245
18580899118,2cyclictest132667-21kworker/u16:1+events_unbound19:38:245
185808991110,1cyclictest0-21swapper/520:27:025
185808991110,1cyclictest0-21swapper/519:59:555
18580399119,1cyclictest815673-21perf23:53:034
18580399112,5cyclictest65-21ksoftirqd/419:33:214
185803991110,1cyclictest238036-21dnf19:28:234
185803991110,1cyclictest238036-21dnf19:28:234
185803991110,1cyclictest0-21swapper/422:28:294
18581699109,1cyclictest0-21swapper/623:49:096
18581699109,1cyclictest0-21swapper/600:32:026
18580899109,1cyclictest0-21swapper/522:05:345
18580899109,1cyclictest0-21swapper/519:09:105
18580899107,2cyclictest399128-21kworker/u16:0+flush-8:020:53:395
18580399109,1cyclictest910473-21sendmail00:25:124
18580399109,1cyclictest186015-21kworker/u16:3-events_unbound19:53:224
1858089998,1cyclictest0-21swapper/522:59:585
1858089998,1cyclictest0-21swapper/519:57:535
1858089998,1cyclictest0-21swapper/519:29:305
1858089998,1cyclictest0-21swapper/519:29:305
1858089995,3cyclictest0-21swapper/520:13:295
1858169987,1cyclictest0-21swapper/623:31:296
1858169987,1cyclictest0-21swapper/620:57:096
1858089987,1cyclictest0-21swapper/500:06:495
1858089986,1cyclictest0-21swapper/523:08:275
1858089986,1cyclictest0-21swapper/521:18:235
1858089986,1cyclictest0-21swapper/520:43:215
1858089984,3cyclictest186746-21tune2fs19:03:235
1858089983,4cyclictest495324-21grep21:33:285
1858089983,4cyclictest392111-21kthreadcore20:48:245
1858089983,4cyclictest364540-21cat20:33:265
1858169972,4cyclictest371705-21tune2fs20:38:226
1858089965,1cyclictest0-21swapper/500:00:025
1858089964,1cyclictest0-21swapper/519:33:215
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional