You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 10:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Wed Jul 29, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9049025646,7sleep40-21swapper/419:06:194
905982452,38sleep70-21swapper/719:07:517
9048324232,7sleep60-21swapper/619:06:136
90975994136,4cyclictest729308-21latency_hist23:54:007
9049124131,7sleep50-21swapper/519:06:205
9097599380,36cyclictest172721-21latency_hist19:49:017
90969993836,2cyclictest510177-21kworker/u16:3+events_unbound22:44:325
90975993736,0cyclictest0-21swapper/722:29:047
9097599360,34cyclictest648-21systemd-journal23:59:017
9097599360,34cyclictest648-21systemd-journal23:59:017
90974993533,2cyclictest559625-21kworker/u16:4+flush-8:023:19:166
90974993533,2cyclictest559625-21kworker/u16:4+flush-8:023:19:166
90975993430,3cyclictest617866-21sh23:05:007
90969993432,2cyclictest241195-21kworker/u16:0+events_unbound20:29:165
90975993332,0cyclictest0-21swapper/721:24:337
90975993331,1cyclictest789301-21ssh00:17:497
90975993330,2cyclictest571745-21ssh22:49:047
90975993230,1cyclictest0-21swapper/723:27:577
90975993226,5cyclictest741421-21latency_hist23:59:017
90975993226,5cyclictest741421-21latency_hist23:59:017
90969993230,2cyclictest510177-21kworker/u16:3+flush-8:023:29:165
2287382320,0chrt228739-21kthreadcore20:14:247
90975993130,0cyclictest0-21swapper/700:28:487
90975993129,1cyclictest644117-21ssh23:18:367
90975993129,1cyclictest606274-21ssh23:01:057
90969993129,2cyclictest510177-21kworker/u16:3+flush-8:022:58:565
90969993129,2cyclictest3574114-21kworker/u16:5+events_unbound20:24:255
90975993029,0cyclictest0-21swapper/723:37:367
90975993029,0cyclictest0-21swapper/722:58:357
90975993029,0cyclictest0-21swapper/722:43:167
90975993029,0cyclictest0-21swapper/721:49:457
90975993028,1cyclictest0-21swapper/721:58:217
90974993028,2cyclictest289051-21kworker/u16:3+events_unbound20:49:206
90975992928,0cyclictest0-21swapper/720:13:567
90975992928,0cyclictest0-21swapper/700:10:287
90975992928,0cyclictest0-21swapper/700:04:407
90969992927,2cyclictest279339-21kworker/u16:1+flush-8:020:43:565
90975992826,1cyclictest328324-21diskmemload22:35:567
90975992826,1cyclictest0-21swapper/722:45:567
90969992826,2cyclictest751182-21kworker/u16:3+flush-8:000:24:165
90969992826,2cyclictest656431-21kworker/u16:1+flush-8:023:43:565
90969992826,2cyclictest546838-21kworker/u16:0+flush-8:022:39:305
90969992825,2cyclictest581751-21kworker/u16:0+flush-8:023:19:065
90969992825,2cyclictest581751-21kworker/u16:0+flush-8:023:19:065
90975992726,0cyclictest0-21swapper/723:20:327
90975992726,0cyclictest0-21swapper/723:20:327
90975992726,0cyclictest0-21swapper/721:39:007
90975992726,0cyclictest0-21swapper/721:12:537
90975992725,1cyclictest800850-21ssh00:21:447
90975992725,1cyclictest362905-21ssh21:20:407
90975992721,5cyclictest318592-21latency_hist21:04:027
90969992725,2cyclictest717213-21kworker/u16:3+events_unbound23:49:195
90969992725,2cyclictest61298-21kworker/u16:0+events_unbound19:29:225
90969992725,2cyclictest289051-21kworker/u16:3+events_unbound22:04:155
90975992625,0cyclictest0-21swapper/723:30:367
90975992625,0cyclictest0-21swapper/723:10:327
90975992625,0cyclictest0-21swapper/722:21:567
90975992625,0cyclictest0-21swapper/721:31:007
90975992624,1cyclictest328324-21diskmemload22:26:007
90975992621,3cyclictest704214-21ssh23:42:337
90969992624,2cyclictest71695-21kworker/u16:2+events_unbound19:34:155
90974992523,2cyclictest692660-21kworker/u16:2+events_unbound00:14:286
90969992523,2cyclictest692660-21kworker/u16:2+flush-8:000:03:565
90969992523,2cyclictest692660-21kworker/u16:2+flush-8:000:03:565
90969992523,2cyclictest656431-21kworker/u16:1+flush-8:023:47:125
90969992523,2cyclictest559625-21kworker/u16:4+events_unbound23:24:155
90969992523,2cyclictest389371-21kworker/u16:0+flush-8:022:29:275
90969992523,2cyclictest3574114-21kworker/u16:5+events_unbound19:24:175
90969992523,2cyclictest279339-21kworker/u16:1+events_unbound20:59:205
90975992423,0cyclictest0-21swapper/722:11:567
90975992423,0cyclictest0-21swapper/721:15:377
90975992422,1cyclictest706165-21ssh23:44:177
90974992422,2cyclictest71695-21kworker/u16:2+flush-8:019:39:136
90974992421,3cyclictest3574114-21kworker/u16:5+flush-8:020:39:326
90969992422,2cyclictest3574114-21kworker/u16:5+events_unbound19:09:305
90975992322,0cyclictest0-21swapper/722:18:257
90974992321,2cyclictest559625-21kworker/u16:4+flush-8:022:44:216
90974992321,2cyclictest253139-21kworker/u16:2+flush-8:020:38:566
90969992321,2cyclictest71695-21kworker/u16:2+events_unbound19:49:305
90969992321,2cyclictest71695-21kworker/u16:2+events_unbound19:49:305
90969992321,2cyclictest692660-21kworker/u16:2+flush-8:000:18:565
90969992321,2cyclictest692660-21kworker/u16:2+events_unbound23:54:205
90969992321,2cyclictest692660-21kworker/u16:2+events_unbound23:54:205
90969992321,2cyclictest289051-21kworker/u16:3+flush-8:022:14:015
90975992219,2cyclictest182467-21awk19:54:017
90975992219,2cyclictest182467-21awk19:54:017
90975992216,4cyclictest306352-21cut20:54:247
90969992220,2cyclictest389371-21kworker/u16:0+events_unbound22:25:045
90969992218,2cyclictest401569-21kworker/u16:1+events_unbound21:59:335
90963992221,1cyclictest389371-21kworker/u16:0+events_unbound22:08:114
90975992120,0cyclictest0-21swapper/722:02:297
90975992120,0cyclictest0-21swapper/700:29:567
90975992119,1cyclictest471748-21sh22:04:377
9097599210,19cyclictest269504-21sed20:34:307
90974992120,1cyclictest510177-21kworker/u16:3+events_unbound22:58:076
90974992120,1cyclictest472524-21kworker/u16:2+events_unbound22:06:146
90974992118,2cyclictest559625-21kworker/u16:4+events_unbound23:04:286
90969992119,2cyclictest401569-21kworker/u16:1+flush-8:021:55:255
90969992119,2cyclictest289639-21kworker/u16:4+flush-8:021:46:325
90975992019,0cyclictest0-21swapper/721:48:297
90975992019,0cyclictest0-21swapper/721:42:527
90974992018,2cyclictest71695-21kworker/u16:2+flush-8:019:29:306
90969992018,2cyclictest358347-21kworker/u16:0+flush-8:021:24:015
90969992018,2cyclictest3574114-21kworker/u16:5+events_unbound19:14:045
90969992018,2cyclictest289639-21kworker/u16:4+events_unbound21:51:215
90969992018,2cyclictest279339-21kworker/u16:1+flush-8:021:12:455
90975991918,0cyclictest0-21swapper/719:15:027
90974991917,2cyclictest289639-21kworker/u16:4+events_unbound21:44:156
90974991917,2cyclictest230888-21kworker/u16:1+flush-8:020:19:156
90974991917,2cyclictest182571-21kworker/u16:3+events_unbound19:59:286
90969991917,2cyclictest825071-21kworker/u16:0+flush-8:000:38:595
90969991917,2cyclictest751183-21kworker/u16:4+flush-8:000:08:115
90969991917,2cyclictest689677-21kworker/u16:0+flush-8:023:34:315
90969991917,2cyclictest289639-21kworker/u16:4+events_unbound21:34:135
90969991917,2cyclictest289639-21kworker/u16:4+events_unbound21:14:295
90969991917,2cyclictest289051-21kworker/u16:3+events_unbound21:24:135
90969991917,2cyclictest182482-21kworker/u16:0+events_unbound19:59:265
90963991915,3cyclictest546838-21kworker/u16:0+flush-8:022:39:184
90975991816,1cyclictest0-21swapper/700:35:367
90975991812,5cyclictest648-21systemd-journal20:09:017
90974991816,2cyclictest71695-21kworker/u16:2+flush-8:019:49:586
90974991816,2cyclictest71695-21kworker/u16:2+flush-8:019:49:586
90974991816,2cyclictest559625-21kworker/u16:4+events_unbound22:59:186
90969991816,2cyclictest751182-21kworker/u16:3+events_unbound00:10:165
90969991816,2cyclictest581751-21kworker/u16:0+events_unbound23:15:215
90969991816,2cyclictest559625-21kworker/u16:4+flush-8:023:00:165
90969991816,2cyclictest532604-21kworker/u16:2+flush-8:022:49:405
90969991816,2cyclictest510177-21kworker/u16:3+flush-8:023:04:115
90969991816,2cyclictest401569-21kworker/u16:1+events_unbound21:41:295
90969991814,2cyclictest375951-21kworker/u16:1+events_unbound21:29:325
9097599170,1cyclictest0-21swapper/719:34:237
90974991715,2cyclictest91181-21kworker/u16:3+flush-8:019:28:576
90974991714,2cyclictest289051-21kworker/u16:3+flush-8:021:29:186
90974991711,6cyclictest751183-21kworker/u16:4+flush-8:000:04:076
90969991715,2cyclictest532604-21kworker/u16:2+events_unbound22:35:045
90969991715,2cyclictest510177-21kworker/u16:3+events_unbound23:11:365
90969991715,2cyclictest3574114-21kworker/u16:5+flush-8:019:43:565
90963991716,1cyclictest751183-21kworker/u16:4-xprtiod00:05:574
90974991614,2cyclictest751182-21kworker/u16:3+events_unbound00:24:306
90974991614,2cyclictest289051-21kworker/u16:3+events_unbound21:54:156
90969991614,2cyclictest91181-21kworker/u16:3+flush-8:019:19:175
90969991614,2cyclictest751182-21kworker/u16:3+events_unbound00:31:565
90969991614,2cyclictest484810-21kworker/u16:1+events_unbound22:15:255
9096399160,15cyclictest584471-21diskstats22:54:154
90974991512,2cyclictest71695-21kworker/u16:2+flush-8:019:34:336
90969991513,2cyclictest472524-21kworker/u16:2+events_unbound22:20:365
90969991513,2cyclictest162913-21kworker/u16:1+events_unbound19:44:395
90969991512,2cyclictest71695-21kworker/u16:2+events_unbound19:54:065
90969991512,2cyclictest241195-21kworker/u16:0+events_unbound20:34:075
90963991514,1cyclictest0-21swapper/400:27:174
90963991512,2cyclictest3574114-21kworker/u16:5+flush-8:019:14:274
9097599148,5cyclictest958-21NetworkManager20:39:277
90975991413,0cyclictest0-21swapper/720:24:197
90974991413,1cyclictest0-21swapper/622:01:276
90969991412,2cyclictest751183-21kworker/u16:4+flush-8:000:20:085
90969991412,2cyclictest289051-21kworker/u16:3+flush-8:021:08:495
90963991413,1cyclictest0-21swapper/421:38:064
90963991413,1cyclictest0-21swapper/400:12:464
90963991413,1cyclictest0-21swapper/400:00:194
90963991413,1cyclictest0-21swapper/400:00:194
90963991412,2cyclictest289639-21kworker/u16:4+flush-8:021:44:164
90963991411,2cyclictest3574114-21kworker/u16:5+flush-8:019:54:014
90963991411,2cyclictest3574114-21kworker/u16:5+flush-8:019:54:014
9096399140,1cyclictest0-21swapper/421:52:374
9096399140,1cyclictest0-21swapper/421:19:394
9096399140,1cyclictest0-21swapper/400:16:244
9096399140,14cyclictest0-21swapper/423:49:264
9096399140,14cyclictest0-21swapper/423:21:034
9096399140,14cyclictest0-21swapper/423:21:034
9096399140,14cyclictest0-21swapper/423:18:324
9096399140,14cyclictest0-21swapper/423:11:264
9096399140,14cyclictest0-21swapper/422:46:414
9096399140,14cyclictest0-21swapper/422:23:504
9096399140,14cyclictest0-21swapper/422:01:074
9096399140,14cyclictest0-21swapper/421:55:364
9096399140,14cyclictest0-21swapper/400:30:264
9096399140,13cyclictest0-21swapper/421:14:294
9097599139,3cyclictest1302-21snmpd21:05:417
9097599137,5cyclictest143494-21latency_hist19:34:027
90975991312,0cyclictest0-21swapper/720:31:377
90975991310,2cyclictest0-21swapper/720:04:017
90974991311,2cyclictest751182-21kworker/u16:3+flush-8:000:29:546
90969991311,2cyclictest182482-21kworker/u16:0+events_unbound20:11:535
90963991312,1cyclictest0-21swapper/423:42:214
90963991312,1cyclictest0-21swapper/423:28:094
90963991312,1cyclictest0-21swapper/423:03:524
90963991312,1cyclictest0-21swapper/422:51:444
90963991312,1cyclictest0-21swapper/422:11:414
90963991312,1cyclictest0-21swapper/421:32:074
90963991312,1cyclictest0-21swapper/419:59:434
90963991312,1cyclictest0-21swapper/400:23:394
9096399130,13cyclictest0-21swapper/423:55:074
9096399130,13cyclictest0-21swapper/423:55:074
9096399130,13cyclictest0-21swapper/423:32:444
9096399130,13cyclictest0-21swapper/422:35:014
9096399130,13cyclictest0-21swapper/421:10:124
9097599128,3cyclictest6466-21gmain20:49:287
9097599128,3cyclictest1302-21snmpd20:45:557
9097599127,4cyclictest1302-21snmpd19:55:367
90975991211,0cyclictest0-21swapper/720:20:097
9097499129,2cyclictest633666-21irqcore23:14:186
9097499129,2cyclictest629010-21needreboot23:09:236
9097499127,4cyclictest791226-21cat00:19:166
9097499127,4cyclictest222514-21cat20:14:186
90974991211,1cyclictest0-21swapper/623:42:096
90974991211,1cyclictest0-21swapper/622:31:506
90974991211,1cyclictest0-21swapper/622:28:126
90974991211,1cyclictest0-21swapper/621:15:316
90974991210,2cyclictest91181-21kworker/u16:3+events_unbound19:19:286
90974991210,2cyclictest484810-21kworker/u16:1+flush-8:022:34:266
9097499120,1cyclictest0-21swapper/621:53:126
9097499120,1cyclictest0-21swapper/621:40:266
9097499120,12cyclictest0-21swapper/621:13:006
9097499120,12cyclictest0-21swapper/600:34:296
90969991210,2cyclictest3574114-21kworker/u16:5+events_unbound20:04:235
90969991210,2cyclictest182482-21kworker/u16:0+events_unbound20:14:175
9096999120,12cyclictest0-21swapper/520:55:085
90963991211,1cyclictest0-21swapper/423:44:524
90963991211,1cyclictest0-21swapper/423:08:554
90963991211,1cyclictest0-21swapper/421:07:404
90963991211,1cyclictest0-21swapper/400:35:104
9096399120,1cyclictest0-21swapper/419:33:424
7661622125,6sleep60-21swapper/600:09:126
9097599118,2cyclictest1302-21snmpd19:24:327
9097599117,3cyclictest1302-21snmpd19:19:567
9097499119,2cyclictest86-21ksoftirqd/623:59:146
9097499119,2cyclictest86-21ksoftirqd/623:59:146
9097499119,2cyclictest559625-21kworker/u16:4+flush-8:023:34:326
9097499117,3cyclictest207015-21cut20:04:206
90974991110,1cyclictest0-21swapper/622:11:396
90974991110,1cyclictest0-21swapper/620:57:426
90974991110,1cyclictest0-21swapper/620:13:526
9097499110,11cyclictest0-21swapper/623:58:236
9097499110,11cyclictest0-21swapper/623:58:236
9097499110,11cyclictest0-21swapper/622:17:196
9097499110,11cyclictest0-21swapper/620:27:546
9096999119,2cyclictest289051-21kworker/u16:3+flush-8:020:51:565
9096999119,2cyclictest230888-21kworker/u16:1+flush-8:020:23:575
90963991110,1cyclictest0-21swapper/420:54:264
90963991110,1cyclictest0-21swapper/420:41:114
90963991110,1cyclictest0-21swapper/419:10:134
9096399110,11cyclictest0-21swapper/420:38:404
9097599100,9cyclictest1302-21snmpd19:40:007
9097499108,2cyclictest559625-21kworker/u16:4+events_unbound23:29:296
9097499106,3cyclictest548300-21cat22:39:166
9097499106,3cyclictest164142-21cat19:44:196
9097499100,9cyclictest572870-21irqcore22:49:176
9097499100,9cyclictest185222-21cut19:54:186
9097499100,9cyclictest0-21swapper/620:44:256
9097499100,4cyclictest398620-21cat21:34:306
9097499100,3cyclictest725846-21kthreadcore23:49:246
9097499100,3cyclictest371788-21kthreadcore21:24:216
9097499100,3cyclictest110336-21kthreadcore19:14:236
9097499100,2cyclictest259270-21ntpq20:29:256
9096999108,2cyclictest253139-21kworker/u16:2+flush-8:020:45:575
9096399109,1cyclictest0-21swapper/420:29:504
9096399109,1cyclictest0-21swapper/419:54:314
9096399108,2cyclictest401569-21kworker/u16:1+flush-8:021:39:224
9096399108,1cyclictest515292-21kthreadcore22:24:184
9096399100,10cyclictest0-21swapper/419:45:414
909759995,3cyclictest1302-21snmpd19:09:327
909749996,2cyclictest656875-21/usr/sbin/munin23:24:136
909749996,2cyclictest0-21swapper/622:19:176
909749996,2cyclictest0-21swapper/619:09:206
909749995,3cyclictest309882-21tune2fs20:59:146
909749990,8cyclictest706768-21ps23:44:206
909639998,1cyclictest0-21swapper/421:26:074
909639996,2cyclictest213258-21kthreadcore20:09:204
909639994,4cyclictest312827-21kthreadcore20:59:194
909639990,8cyclictest0-21swapper/422:29:144
909639990,8cyclictest0-21swapper/420:49:194
909749985,2cyclictest353184-21grep21:19:146
909749980,7cyclictest0-21swapper/621:04:136
909639985,2cyclictest91181-21kworker/u16:3+flush-8:019:19:194
909639984,3cyclictest284135-21cut20:44:214
909639984,3cyclictest232499-21irqcore20:19:174
909639983,4cyclictest486883-21cut22:14:154
909639983,4cyclictest242730-21grep20:24:194
909639983,4cyclictest126115-21grep19:24:194
909639973,3cyclictest681691-21entropy23:34:154
909639973,3cyclictest222156-21cat20:14:154
909639973,3cyclictest159371-21kthreadcore19:39:224
909639972,4cyclictest204099-21cut20:04:184
909639972,4cyclictest147826-21cut19:34:184
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional