You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 01:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue May 12, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3663329995654,2cyclictest4065623-21kworker/u16:1+events_unbound23:13:406
3663334994640,5cyclictest4126976-21latency_hist22:43:127
366293324635,8sleep50-21swapper/519:06:585
36628492394,30sleep70-21swapper/719:05:477
3663329993836,2cyclictest3743889-21kworker/u16:3+events_unbound21:44:546
3663329993735,2cyclictest90868-21kworker/u16:2+events_unbound00:00:306
3663329993735,2cyclictest151119-21kworker/u16:3+events_unbound00:27:386
366333499360,35cyclictest3921387-21latency_hist21:18:127
3663329993634,2cyclictest3957781-21kworker/u16:2+flush-8:022:15:556
3663329993633,2cyclictest3830077-21kworker/u16:0+events_unbound20:58:146
3663329993633,2cyclictest3830077-21kworker/u16:0+events_unbound20:58:146
3663324993633,2cyclictest2952171-21kworker/u16:3+events_unbound19:13:154
3663329993533,2cyclictest4151556-21kworker/u16:2+events_unbound23:11:426
3663329993533,2cyclictest209594-21kworker/u16:1+events_unbound00:34:426
3663334993428,5cyclictest4054450-21latency_hist22:13:117
3663329993432,2cyclictest16909-21kworker/u16:3+events_unbound23:24:546
3663329993331,2cyclictest4125231-21kworker/u16:0+events_unbound22:51:076
3663329993331,2cyclictest4125231-21kworker/u16:0+events_unbound22:47:426
3663329993331,2cyclictest4065623-21kworker/u16:1+events_unbound23:06:026
3663329993331,2cyclictest3991566-21kworker/u16:0+events_unbound21:55:026
3663329993331,2cyclictest3743889-21kworker/u16:3+events_unbound22:19:556
3663329993331,2cyclictest3743889-21kworker/u16:3+events_unbound22:19:556
3663329993331,2cyclictest186453-21kworker/u16:0+events_unbound00:30:106
3663329993331,2cyclictest151119-21kworker/u16:3+flush-8:000:17:256
3663329993331,2cyclictest115422-21kworker/u16:4+events_unbound00:11:546
3663334993231,0cyclictest0-21swapper/722:28:277
3663329993230,2cyclictest4125231-21kworker/u16:0+events_unbound23:50:346
3663329993230,2cyclictest4125231-21kworker/u16:0+events_unbound23:03:036
3663329993230,2cyclictest4125231-21kworker/u16:0+events_unbound23:03:036
3663329993230,2cyclictest3991566-21kworker/u16:0+events_unbound22:00:286
3663329993230,2cyclictest3743889-21kworker/u16:3+events_unbound22:26:266
366291423222,7sleep60-21swapper/619:06:436
3663329993129,2cyclictest4078303-21kworker/u16:2+events_unbound22:34:156
3663329993028,2cyclictest90868-21kworker/u16:2+events_unbound00:06:066
3663329993028,2cyclictest3878184-21kworker/u16:1+events_unbound21:26:426
3663329993028,2cyclictest3743889-21kworker/u16:3+events_unbound22:09:436
3663329993027,2cyclictest3685154-21kworker/u16:1+events_unbound19:48:146
3663329992927,2cyclictest90868-21kworker/u16:2+events_unbound23:56:596
3663329992927,2cyclictest77759-21kworker/u16:1+events_unbound00:23:086
3663329992927,2cyclictest3878184-21kworker/u16:1+flush-8:021:39:346
3663329992927,2cyclictest3743889-21kworker/u16:3+flush-8:021:13:586
3663326992927,2cyclictest77759-21kworker/u16:1+flush-8:023:48:355
3663334992826,1cyclictest89380-21ssh23:45:377
3663329992826,2cyclictest3991566-21kworker/u16:0+events_unbound21:51:546
3663329992826,2cyclictest3830077-21kworker/u16:0+events_unbound20:44:316
3663329992826,2cyclictest3801584-21kworker/u16:2+events_unbound20:33:506
3663329992826,2cyclictest3743889-21kworker/u16:3+events_unbound20:16:506
3663329992826,2cyclictest3743889-21kworker/u16:3+events_unbound20:16:506
366297122818,7sleep40-21swapper/419:07:294
3663334992726,0cyclictest0-21swapper/723:40:017
3663334992726,0cyclictest0-21swapper/723:40:017
3663334992726,0cyclictest0-21swapper/720:12:557
3663334992722,4cyclictest114995-21latency_hist23:58:127
3663329992725,2cyclictest4125231-21kworker/u16:0+events_unbound23:36:536
3663329992725,2cyclictest3957781-21kworker/u16:2+events_unbound21:37:076
3663329992725,2cyclictest3830077-21kworker/u16:0+flush-8:021:19:106
3663329992725,2cyclictest3830077-21kworker/u16:0+events_unbound21:10:196
39335342260,1chrt3933535-21idleruntime-cro21:23:127
3663334992625,0cyclictest0-21swapper/723:08:047
3663334992625,0cyclictest0-21swapper/721:33:057
3663334992625,0cyclictest0-21swapper/720:44:357
3663329992624,2cyclictest4125231-21kworker/u16:0+flush-8:023:41:456
3663329992624,2cyclictest4125231-21kworker/u16:0+flush-8:023:41:456
3663329992624,2cyclictest4125231-21kworker/u16:0+flush-8:022:54:296
3663329992624,2cyclictest3743889-21kworker/u16:3+flush-8:020:08:506
3663329992624,2cyclictest3685154-21kworker/u16:1+flush-8:019:41:086
3663329992623,2cyclictest4125231-21kworker/u16:0+events_unbound23:43:166
3663326992622,3cyclictest3878184-21kworker/u16:1+flush-8:021:13:375
366332499260,16cyclictest0-21swapper/423:28:364
3663334992524,0cyclictest0-21swapper/723:58:137
3663334992524,0cyclictest0-21swapper/723:16:457
3663334992524,0cyclictest0-21swapper/721:24:397
3663334992524,0cyclictest0-21swapper/719:51:517
3663329992523,2cyclictest3878184-21kworker/u16:1+events_unbound21:29:496
3663329992522,2cyclictest3743889-21kworker/u16:3+events_unbound20:23:136
3663326992522,2cyclictest4125231-21kworker/u16:0+flush-8:023:43:295
3663334992423,0cyclictest0-21swapper/722:04:257
3663334992423,0cyclictest0-21swapper/721:12:537
3663334992423,0cyclictest0-21swapper/719:56:587
3663329992422,2cyclictest16909-21kworker/u16:3+events_unbound23:20:266
3663334992322,0cyclictest0-21swapper/723:37:447
3663334992322,0cyclictest0-21swapper/722:00:307
3663334992322,0cyclictest0-21swapper/719:38:367
3663334992322,0cyclictest0-21swapper/719:33:037
3663334992321,1cyclictest0-21swapper/721:57:367
3663329992321,2cyclictest3878184-21kworker/u16:1+events_unbound21:05:516
3663329992321,2cyclictest3743889-21kworker/u16:3+events_unbound22:38:546
3663329992321,2cyclictest3743889-21kworker/u16:3+events_unbound22:05:126
3663326992320,2cyclictest3743889-21kworker/u16:3+flush-8:020:08:305
3663334992221,0cyclictest0-21swapper/723:28:477
3663334992221,0cyclictest0-21swapper/722:48:177
3663334992221,0cyclictest0-21swapper/722:25:287
3663334992221,0cyclictest0-21swapper/720:56:117
3663334992221,0cyclictest0-21swapper/720:13:527
3663334992221,0cyclictest0-21swapper/720:13:527
3663334992221,0cyclictest0-21swapper/720:04:277
3663334992221,0cyclictest0-21swapper/720:01:397
3663334992221,0cyclictest0-21swapper/700:35:417
3663334992221,0cyclictest0-21swapper/700:25:337
3663329992220,2cyclictest2952171-21kworker/u16:3+events_unbound19:13:076
3663329992220,2cyclictest16909-21kworker/u16:3+events_unbound23:31:096
3663326992220,2cyclictest77759-21kworker/u16:1+events_unbound00:18:355
3663326992220,2cyclictest3695855-21kworker/u16:0+flush-8:019:48:285
3663324992220,2cyclictest3957781-21kworker/u16:2+events_unbound22:08:274
3663324992219,3cyclictest3991566-21kworker/u16:0+flush-8:022:18:374
3663324992219,3cyclictest3991566-21kworker/u16:0+flush-8:022:18:374
3663334992120,0cyclictest0-21swapper/722:57:367
3663334992120,0cyclictest0-21swapper/722:33:307
3663334992120,0cyclictest0-21swapper/722:16:497
3663334992120,0cyclictest0-21swapper/721:01:497
3663334992120,0cyclictest0-21swapper/721:01:497
3663334992120,0cyclictest0-21swapper/720:35:037
3663334992120,0cyclictest0-21swapper/720:21:517
3663334992120,0cyclictest0-21swapper/700:11:037
3663329992119,2cyclictest4078303-21kworker/u16:2+flush-8:022:31:376
3663329992119,2cyclictest3830077-21kworker/u16:0+events_unbound20:58:026
3663329992119,2cyclictest3743889-21kworker/u16:3+events_unbound20:06:076
3663329992119,2cyclictest3685154-21kworker/u16:1+events_unbound19:28:046
3663326992119,2cyclictest4151556-21kworker/u16:2+events_unbound23:39:315
3663326992119,2cyclictest4151556-21kworker/u16:2+events_unbound23:39:315
3663326992118,3cyclictest4151556-21kworker/u16:2+events_unbound23:33:385
3663326992118,2cyclictest4078303-21kworker/u16:2+events_unbound22:38:255
3663334992019,0cyclictest0-21swapper/723:09:157
3663334992019,0cyclictest0-21swapper/721:04:507
3663334992019,0cyclictest0-21swapper/720:41:397
3663329992018,2cyclictest3830077-21kworker/u16:0+events_unbound20:43:076
3663329992018,2cyclictest3801584-21kworker/u16:2+events_unbound20:30:216
3663329992018,2cyclictest3685154-21kworker/u16:1+events_unbound19:16:316
3663326992018,2cyclictest4125231-21kworker/u16:0+events_unbound22:53:405
3663334991918,0cyclictest0-21swapper/723:22:337
3663334991918,0cyclictest0-21swapper/719:12:277
3663334991917,1cyclictest0-21swapper/700:07:577
3663334991915,3cyclictest1234-21snmpd00:32:077
3663329991917,2cyclictest3743889-21kworker/u16:3+events_unbound20:22:516
3663329991917,2cyclictest3743889-21kworker/u16:3+events_unbound19:55:126
3663329991917,2cyclictest3397567-21kworker/u16:2+events_unbound19:22:246
3663326991917,2cyclictest3743889-21kworker/u16:3+flush-8:022:28:285
3663334991817,0cyclictest0-21swapper/722:59:377
3663334991817,0cyclictest0-21swapper/722:59:377
3663334991817,0cyclictest0-21swapper/722:43:497
3663329991816,2cyclictest3743889-21kworker/u16:3+flush-8:020:49:236
3663329991816,2cyclictest3397567-21kworker/u16:2+flush-8:019:28:386
3663329991816,2cyclictest3397567-21kworker/u16:2+events_unbound19:36:236
3663334991716,0cyclictest0-21swapper/720:52:347
3663334991715,1cyclictest3980540-21ssh21:40:467
366333499170,1cyclictest0-21swapper/720:28:347
366333499170,15cyclictest1234-21snmpd20:27:457
3663329991715,2cyclictest3685154-21kworker/u16:1+events_unbound19:46:446
366332499170,14cyclictest0-21swapper/421:48:054
3663334991615,0cyclictest0-21swapper/719:26:067
3663334991614,1cyclictest3897237-21diskmemload23:23:367
3663334991613,2cyclictest0-21swapper/721:43:127
3663326991614,2cyclictest4125231-21kworker/u16:0+flush-8:023:08:275
3663326991614,2cyclictest3830077-21kworker/u16:0+flush-8:020:53:395
3663326991614,2cyclictest115422-21kworker/u16:4+events_unbound00:33:265
366332499160,2cyclictest3873446-21cut20:53:324
3663334991514,0cyclictest0-21swapper/719:45:107
3663334991514,0cyclictest0-21swapper/700:14:577
366333499150,14cyclictest0-21swapper/721:48:337
3663329991513,2cyclictest3695855-21kworker/u16:0+flush-8:019:59:276
3663326991513,2cyclictest3743889-21kworker/u16:3+events_unbound20:58:415
3663326991513,2cyclictest3743889-21kworker/u16:3+events_unbound20:58:415
3663326991512,2cyclictest3743889-21kworker/u16:3+flush-8:022:03:275
3663326991512,2cyclictest3743889-21kworker/u16:3+events_unbound21:18:275
366332499150,1cyclictest0-21swapper/421:05:214
366332499150,14cyclictest0-21swapper/400:23:324
366332499150,0cyclictest0-21swapper/423:14:284
954072140,1sleep40-21swapper/423:48:304
3663334991413,0cyclictest0-21swapper/719:35:147
3663326991413,1cyclictest0-21swapper/521:36:195
3663326991412,2cyclictest4065623-21kworker/u16:1+flush-8:022:33:405
3663326991412,2cyclictest3991566-21kworker/u16:0+flush-8:021:48:365
3663326991412,2cyclictest3878184-21kworker/u16:1+events_unbound21:38:295
3663326991412,2cyclictest3743889-21kworker/u16:3+flush-8:020:48:305
366332699140,1cyclictest0-21swapper/523:17:425
366332699140,1cyclictest0-21swapper/500:01:315
366332699140,14cyclictest0-21swapper/523:05:435
366332699140,14cyclictest0-21swapper/521:54:275
3663324991413,1cyclictest0-21swapper/423:43:484
3663324991413,1cyclictest0-21swapper/422:04:384
3663324991413,1cyclictest0-21swapper/421:30:354
3663324991413,1cyclictest0-21swapper/421:14:394
366332499140,1cyclictest0-21swapper/422:46:154
366332499140,14cyclictest0-21swapper/423:54:124
366332499140,14cyclictest0-21swapper/423:34:114
366332499140,14cyclictest0-21swapper/422:54:274
366332499140,14cyclictest0-21swapper/422:29:324
366332499140,14cyclictest0-21swapper/421:56:164
366332499140,13cyclictest0-21swapper/423:03:174
3663334991312,0cyclictest0-21swapper/719:14:147
3663334991310,2cyclictest4070372-21sh22:18:287
3663334991310,2cyclictest4070372-21sh22:18:287
3663334991310,2cyclictest0-21swapper/723:53:117
3663326991312,1cyclictest0-21swapper/523:28:345
3663326991312,1cyclictest0-21swapper/522:20:565
3663326991312,1cyclictest0-21swapper/522:20:565
3663326991312,1cyclictest0-21swapper/522:12:545
3663326991312,1cyclictest0-21swapper/519:27:215
366332699130,13cyclictest0-21swapper/520:36:245
3663324991312,1cyclictest0-21swapper/422:38:034
3663324991312,1cyclictest0-21swapper/421:38:464
3663324991310,3cyclictest0-21swapper/400:09:014
3663324991310,2cyclictest3801584-21kworker/u16:2+events_unbound20:38:264
366332499130,13cyclictest0-21swapper/420:07:484
366333499129,2cyclictest0-21swapper/719:23:127
366333499127,4cyclictest1025-21runrttasks21:33:327
3663326991211,1cyclictest0-21swapper/521:44:595
3663326991211,1cyclictest0-21swapper/521:10:285
3663326991211,1cyclictest0-21swapper/520:05:115
3663326991211,1cyclictest0-21swapper/500:17:555
366332499123,8cyclictest4055287-21cat22:13:234
366332499123,8cyclictest3754318-21tune2fs19:53:274
366332499123,8cyclictest3693047-21cut19:18:324
366332499122,3cyclictest193439-21kthreadcore00:28:324
3663324991211,1cyclictest0-21swapper/423:24:244
3663324991211,1cyclictest0-21swapper/421:22:424
366332499120,11cyclictest0-21swapper/420:28:274
366333499117,3cyclictest1234-21snmpd00:19:377
3663326991110,1cyclictest0-21swapper/522:47:355
3663326991110,1cyclictest0-21swapper/520:20:295
366332499116,5cyclictest3685154-21kworker/u16:1+flush-8:019:43:384
366332499114,6cyclictest3838509-21sed20:33:344
366332499113,7cyclictest4080703-21cut22:23:314
366332499113,7cyclictest3744536-21expr19:48:254
366332499113,7cyclictest18903-21cpuspeed_turbos23:18:224
366332499113,4cyclictest4171658-21grep22:58:334
366332499113,4cyclictest4171658-21grep22:58:334
366332499113,3cyclictest4002906-21grep21:48:344
366332499113,3cyclictest3730166-21cut19:38:314
366332499113,3cyclictest3715595-21cstates19:33:244
366332499112,4cyclictest4146997-21cut22:48:344
366332499112,4cyclictest169490-21cut00:18:314
366332499112,3cyclictest3663678-21cut19:08:244
366332499110,10cyclictest3700590-21cut19:23:314
366332499110,10cyclictest0-21swapper/421:08:284
366332699109,1cyclictest0-21swapper/521:27:585
366332699108,2cyclictest186453-21kworker/u16:0+events_unbound00:28:385
366332699106,3cyclictest3706506-21cat19:28:265
366332499105,4cyclictest0-21swapper/421:33:294
366332499105,4cyclictest0-21swapper/400:13:384
366332499104,5cyclictest4193793-21cut23:08:324
366332499104,5cyclictest122942-21grep23:58:324
366332499103,6cyclictest3867813-21cat20:48:404
366332499103,6cyclictest3854110-21kthreadcore20:43:314
366332499103,3cyclictest4116046-21tune2fs22:38:264
366332499102,4cyclictest3815612-21tr20:23:314
366332499102,3cyclictest4022100-21grep21:58:324
366332499102,3cyclictest3880126-21kthreadcore20:58:294
366332499102,3cyclictest3880126-21kthreadcore20:58:294
366332499101,4cyclictest3936574-21cut21:23:304
366332499101,4cyclictest3804661-21tr20:18:304
366332499100,4cyclictest67141-21/usr/sbin/munin23:38:264
366332499100,4cyclictest67141-21/usr/sbin/munin23:38:264
366332499100,4cyclictest3797658-21grep20:13:334
366332499100,4cyclictest3797658-21grep20:13:334
366332499100,4cyclictest3769147-21kthreadcore19:58:324
366332499100,4cyclictest201529-21cut00:33:284
366332499100,4cyclictest128130-21cstates00:03:254
36633269997,2cyclictest90868-21kworker/u16:2+events_unbound00:03:385
36633269996,2cyclictest30839-21/usr/sbin/munin23:23:295
36633269996,2cyclictest0-21swapper/500:08:305
36633269995,3cyclictest4164568-21cat22:58:275
36633269995,3cyclictest4164568-21cat22:58:275
36633269990,8cyclictest0-21swapper/519:38:275
36633269990,7cyclictest4079461-21cat22:23:275
36633249990,4cyclictest3791355-21taskset20:09:214
36633249990,4cyclictest3705961-21tr19:28:234
36633269986,2cyclictest4018541-21kworker/u16:1+flush-8:021:58:185
36633269986,2cyclictest3830077-21kworker/u16:0+events_unbound20:43:275
36633269986,1cyclictest0-21swapper/519:58:325
36633269984,3cyclictest3677723-21cat19:13:265
36633269983,4cyclictest4060448-21grep22:13:305
36633269983,4cyclictest180055-21grep00:23:325
36633269983,4cyclictest104216-21iostat_ios23:53:285
36633269980,7cyclictest3757211-21cut19:53:315
36633269975,1cyclictest0-21swapper/520:38:285
36633269975,1cyclictest0-21swapper/519:18:285
36633269974,2cyclictest0-21swapper/520:23:305
36633269973,3cyclictest4144259-21tr22:48:335
36633269973,3cyclictest3949297-21cut21:28:305
36633269973,3cyclictest3888416-21expr21:03:255
36633269973,3cyclictest3794678-21grep20:13:315
36633269973,3cyclictest3794678-21grep20:13:315
36633269973,3cyclictest3715621-21expr19:33:245
36633269973,3cyclictest3663963-21cat19:08:245
36633269973,3cyclictest18759-21cpuspeed23:18:225
36633269972,4cyclictest3822230-21grep20:28:295
36633269972,4cyclictest3736976-21kthreadcore19:43:305
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional