You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 12:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Apr 29, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1178121480,1sleep711779-21ssh23:22:217
415875321000,1sleep50-21swapper/523:04:165
3645577995148,2cyclictest3735723-21ps19:51:537
3645577994642,3cyclictest3754526-21ps19:59:317
3645566994440,3cyclictest97777-21kworker/u16:2+flush-8:000:19:204
3645566994440,3cyclictest97777-21kworker/u16:2+flush-8:000:04:214
3645566994241,1cyclictest3870113-21kworker/u16:1+events_unbound22:14:314
364507924232,7sleep50-21swapper/519:06:175
3645570994038,2cyclictest3697209-21kworker/u16:4+events_unbound19:41:395
3645566994038,2cyclictest73321-21kworker/u16:4+events_unbound00:29:204
3645566994037,2cyclictest3913766-21kworker/u16:2+flush-8:021:29:214
36450992403,31sleep70-21swapper/719:06:357
364516223814,7sleep40-21swapper/419:07:294
3645566993735,2cyclictest3913766-21kworker/u16:2+flush-8:021:39:334
3645572993634,1cyclictest3870113-21kworker/u16:1+flush-8:021:09:376
3645566993634,2cyclictest3870113-21kworker/u16:1+flush-8:022:19:294
3645577993429,4cyclictest61052-21latency_hist23:44:037
3645566993128,2cyclictest21459-21kworker/u16:0+flush-8:023:39:224
3645566992724,3cyclictest4182061-21kworker/u16:2+flush-8:023:21:494
3645577992624,1cyclictest0-21swapper/719:14:227
3645566992624,2cyclictest4133719-21kworker/u16:3+flush-8:023:09:224
3645566992624,2cyclictest3859768-21kworker/u16:3+flush-8:021:14:044
3645566992624,2cyclictest21459-21kworker/u16:0+flush-8:023:57:094
363612622616,7sleep60-21swapper/619:04:106
3645577992524,0cyclictest0-21swapper/719:13:257
3645577992523,1cyclictest3916565-21ssh21:24:117
3645577992419,4cyclictest4194104-21latency_hist23:19:037
3645572992422,2cyclictest3354620-21kworker/u16:1+flush-8:019:19:296
3645566992422,2cyclictest73321-21kworker/u16:4+flush-8:023:49:324
3645566992422,2cyclictest4073320-21kworker/u16:2+flush-8:022:29:344
3645566992422,2cyclictest132927-21kworker/u16:0+events_unbound00:16:534
3645577992322,0cyclictest0-21swapper/720:49:327
3645577992321,1cyclictest0-21swapper/722:04:117
3645566992321,2cyclictest4145877-21kworker/u16:4+flush-8:023:24:294
3645566992321,2cyclictest4145877-21kworker/u16:4+flush-8:023:24:294
3645566992320,2cyclictest4133719-21kworker/u16:3+flush-8:023:04:044
1943142230,1sleep40-21swapper/400:39:044
3645566992220,2cyclictest4109561-21kworker/u16:0+flush-8:022:49:344
1541452220,1sleep7154146-21tr00:19:277
3645577992117,3cyclictest124-21kswapd022:29:317
3645566992119,2cyclictest3697209-21kworker/u16:4+flush-8:019:34:254
3645572992017,2cyclictest3870113-21kworker/u16:1+flush-8:021:19:086
3645566992018,2cyclictest3697209-21kworker/u16:4+flush-8:020:09:234
3645566992018,2cyclictest3653998-21kworker/u16:3+events_unbound19:29:254
3645577991918,0cyclictest0-21swapper/719:46:567
3645577991915,3cyclictest1234-21snmpd00:00:587
3645577991913,4cyclictest635-21systemd-journal19:41:377
3645566991917,2cyclictest4145877-21kworker/u16:4+flush-8:023:14:334
3645566991917,2cyclictest4095245-21kworker/u16:1+flush-8:022:44:284
3645566991917,2cyclictest4095245-21kworker/u16:1+flush-8:022:44:284
3645566991917,2cyclictest3870113-21kworker/u16:1+events_unbound21:20:134
3645577991817,0cyclictest0-21swapper/720:22:077
3645577991817,0cyclictest0-21swapper/719:57:007
3645577991817,0cyclictest0-21swapper/719:57:007
3645577991816,1cyclictest0-21swapper/719:24:297
3645577991813,4cyclictest48965-21latency_hist23:39:037
3645566991816,2cyclictest3901672-21kworker/u16:0+events_unbound21:39:034
3645566991816,2cyclictest3774538-21kworker/u16:2+events_unbound20:29:244
3645566991816,2cyclictest3646301-21kworker/u16:2+flush-8:019:14:194
3645566991815,2cyclictest97828-21kworker/u16:3+flush-8:000:09:064
3645577991716,0cyclictest0-21swapper/723:49:437
3645577991716,0cyclictest0-21swapper/722:59:477
3645577991715,1cyclictest132835-21ssh00:12:317
3645577991712,4cyclictest3881260-21cat21:09:217
3645566991715,2cyclictest4182061-21kworker/u16:2+events_unbound23:36:144
3645566991715,2cyclictest4145877-21kworker/u16:4+events_unbound22:59:224
3645566991715,2cyclictest3754992-21kworker/u16:0+flush-8:020:14:254
3645566991714,2cyclictest132927-21kworker/u16:0+flush-8:000:24:084
3645577991615,0cyclictest0-21swapper/721:01:087
3645577991615,0cyclictest0-21swapper/720:24:237
3645577991613,2cyclictest0-21swapper/721:59:037
3645577991612,3cyclictest73132-21latency_hist23:49:047
3645577991612,2cyclictest1172-21tuned19:29:307
3645566991614,2cyclictest4073320-21kworker/u16:2+events_unbound22:34:174
3645566991614,2cyclictest3940431-21kworker/u16:4+events_unbound22:07:134
3645566991614,2cyclictest3870113-21kworker/u16:1+events_unbound21:24:334
3645566991614,2cyclictest3859768-21kworker/u16:3+events_unbound21:17:134
3645566991614,2cyclictest3697209-21kworker/u16:4+flush-8:019:59:254
3645566991614,2cyclictest21459-21kworker/u16:0+flush-8:023:47:054
3645577991514,0cyclictest0-21swapper/720:34:247
3645577991514,0cyclictest0-21swapper/720:12:207
3645577991514,0cyclictest0-21swapper/720:06:407
3645577991512,2cyclictest4036622-21ssh22:13:137
3645577991511,3cyclictest1234-21snmpd21:44:367
3645570991512,3cyclictest0-21swapper/523:16:535
364557099150,1cyclictest0-21swapper/521:34:245
3645566991513,2cyclictest3974162-21kworker/u16:0+flush-8:021:49:294
3645566991513,2cyclictest3974162-21kworker/u16:0+events_unbound22:28:434
3645566991513,2cyclictest3974162-21kworker/u16:0+events_unbound21:59:144
3645572991413,1cyclictest0-21swapper/623:44:476
3645572991413,1cyclictest0-21swapper/622:01:216
3645572991413,1cyclictest0-21swapper/600:37:266
364557299140,1cyclictest0-21swapper/623:07:166
364557299140,1cyclictest0-21swapper/600:02:556
364557299140,14cyclictest0-21swapper/623:24:086
364557299140,14cyclictest0-21swapper/623:24:086
364557299140,14cyclictest0-21swapper/621:35:306
3645570991413,1cyclictest0-21swapper/523:47:375
3645570991413,1cyclictest0-21swapper/522:09:245
3645570991413,1cyclictest0-21swapper/519:34:255
3645570991412,2cyclictest0-21swapper/521:19:355
364557099140,14cyclictest0-21swapper/521:49:045
3645566991413,1cyclictest0-21swapper/400:03:074
364557799139,3cyclictest1234-21snmpd21:19:457
364557799139,2cyclictest0-21swapper/700:24:327
364557799138,4cyclictest4050209-21tune2fs22:19:177
364557799138,4cyclictest3941465-21tune2fs21:34:177
364557799138,4cyclictest171282-21cat00:29:207
364557799136,6cyclictest6382-21gvfs-afc-volume19:34:357
3645577991312,0cyclictest0-21swapper/721:15:067
3645577991312,0cyclictest0-21swapper/720:39:237
3645577991312,0cyclictest0-21swapper/720:14:247
3645577991311,1cyclictest0-21swapper/723:32:497
3645572991312,1cyclictest0-21swapper/622:48:306
3645572991312,1cyclictest0-21swapper/622:48:306
3645572991312,1cyclictest0-21swapper/621:47:386
3645572991312,1cyclictest0-21swapper/620:49:186
3645572991312,1cyclictest0-21swapper/600:19:286
3645570991312,1cyclictest0-21swapper/500:31:375
3645566991311,2cyclictest3697209-21kworker/u16:4+events_unbound19:39:194
3645566991310,2cyclictest3754992-21kworker/u16:0+events_unbound20:59:224
364557799129,2cyclictest0-21swapper/721:54:347
364557799128,3cyclictest6382-21gvfs-afc-volume21:04:287
364557799128,3cyclictest1234-21snmpd20:44:567
364557799128,3cyclictest1234-21snmpd00:15:507
364557799128,3cyclictest1234-21snmpd00:08:357
364557799127,4cyclictest3953706-21cat21:39:207
364557799127,4cyclictest3929512-21cat21:29:207
364557799126,5cyclictest6382-21gvfs-afc-volume22:39:517
364557799126,5cyclictest6382-21gvfs-afc-volume20:29:227
364557799126,5cyclictest1200-21containerd23:05:327
3645577991211,0cyclictest0-21swapper/719:21:237
3645577991210,1cyclictest0-21swapper/722:24:367
3645577991210,1cyclictest0-21swapper/721:49:307
3645572991210,2cyclictest4182061-21kworker/u16:2+flush-8:023:19:086
364557299120,0cyclictest0-21swapper/619:18:116
364557099129,3cyclictest3870113-21kworker/u16:1+flush-8:021:15:115
364557099123,8cyclictest3789649-21cut20:19:245
3645570991211,1cyclictest0-21swapper/522:48:495
3645570991211,1cyclictest0-21swapper/522:48:495
3645570991211,1cyclictest0-21swapper/500:08:545
364557099121,10cyclictest3695753-21cut19:29:245
364557099120,4cyclictest3665210-21grep19:14:235
3645566991210,2cyclictest3754992-21kworker/u16:0+events_unbound20:45:144
364557799118,3cyclictest6032-21gmain22:52:567
364557799118,2cyclictest5822-21gmain22:45:287
364557799118,2cyclictest5822-21gmain22:45:287
364557799118,2cyclictest0-21swapper/723:13:347
364557799117,3cyclictest4038375-21cat22:14:207
364557799117,3cyclictest1234-21snmpd23:26:157
364557799117,3cyclictest1234-21snmpd23:26:157
364557799117,3cyclictest1234-21snmpd22:57:297
364557799117,3cyclictest1234-21snmpd20:54:057
364557799115,5cyclictest6382-21gvfs-afc-volume23:56:277
364557299119,2cyclictest86-21ksoftirqd/622:13:316
364557299116,4cyclictest3746739-21cat19:59:186
3645572991110,1cyclictest0-21swapper/622:23:546
364557299110,3cyclictest3802319-21ntpq20:24:286
364557299110,10cyclictest3836217-21kthreadcore20:44:236
364557299110,10cyclictest3702159-21kthreadcore19:34:256
364557099113,7cyclictest3838935-21tr20:44:255
364557099113,7cyclictest3804034-21expr20:29:165
364557099113,7cyclictest3795562-21cut20:24:215
364557099113,7cyclictest3675747-21cut19:19:245
364557099112,4cyclictest3721308-21cut19:44:215
3645570991110,1cyclictest0-21swapper/521:00:115
364557099110,4cyclictest3735884-21taskset19:54:005
364557099110,2cyclictest0-21swapper/523:39:595
364556699119,2cyclictest4145877-21kworker/u16:4+flush-8:023:29:254
364556699118,2cyclictest3678959-21fschecks_count19:24:194
3645566991110,1cyclictest0-21swapper/420:58:214
364557799105,4cyclictest4094443-21ntpq22:34:307
364557299108,2cyclictest86-21ksoftirqd/621:52:526
364557299108,2cyclictest86-21ksoftirqd/620:04:256
364557299108,2cyclictest86-21ksoftirqd/600:05:556
364557299107,2cyclictest0-21swapper/619:44:316
364557299107,2cyclictest0-21swapper/619:24:246
364557299100,9cyclictest3788200-21kthreadcore20:19:236
364557299100,7cyclictest0-21swapper/622:38:136
364557099107,2cyclictest0-21swapper/520:04:195
364557099103,6cyclictest3749211-21kthreadcore19:59:225
364557099102,3cyclictest3826860-21grep20:39:235
364557099102,3cyclictest3679492-21irqcore19:24:225
364557099101,3cyclictest3781267-21tr20:14:235
364557099100,4cyclictest4143535-21taskset22:54:545
364557099100,4cyclictest3927835-21chrt21:28:235
364557099100,4cyclictest3817425-21cut20:34:225
364557099100,3cyclictest157788-21updatedb00:23:595
364557099100,3cyclictest0-21swapper/523:53:205
364557099100,2cyclictest0-21swapper/521:13:225
364557099100,2cyclictest0-21swapper/520:54:235
364557099100,2cyclictest0-21swapper/520:09:335
364556699108,2cyclictest3940431-21kworker/u16:4+events_unbound21:45:144
364556699108,2cyclictest3716001-21kworker/u16:1+flush-8:019:44:204
364556699108,2cyclictest3646301-21kworker/u16:2+flush-8:019:49:194
364556699100,9cyclictest0-21swapper/420:04:194
36455779994,4cyclictest182946-21ls00:34:167
36455729997,2cyclictest86-21ksoftirqd/623:54:516
36455729997,2cyclictest86-21ksoftirqd/623:50:016
36455729997,2cyclictest86-21ksoftirqd/623:34:346
36455729997,2cyclictest86-21ksoftirqd/623:09:326
36455729997,2cyclictest86-21ksoftirqd/622:54:186
36455729997,2cyclictest86-21ksoftirqd/622:53:216
36455729997,2cyclictest86-21ksoftirqd/622:39:106
36455729997,2cyclictest86-21ksoftirqd/622:14:476
36455729997,2cyclictest86-21ksoftirqd/621:56:166
36455729997,2cyclictest86-21ksoftirqd/621:29:106
36455729997,2cyclictest86-21ksoftirqd/621:15:316
36455729997,2cyclictest86-21ksoftirqd/600:17:006
36455729997,2cyclictest3940431-21kworker/u16:4+flush-8:022:24:136
36455729997,1cyclictest0-21swapper/619:39:316
36455729996,2cyclictest86-21ksoftirqd/622:59:066
36455729996,2cyclictest3732796-21cut19:49:246
36455729995,3cyclictest157788-21updatedb00:24:046
36455729994,4cyclictest3766103-21cat20:09:196
36455729990,8cyclictest3816320-21grep20:34:216
36455729990,8cyclictest3783078-21grep20:14:256
36455729990,6cyclictest0-21swapper/600:30:296
36455729990,2cyclictest3692382-21grep19:29:236
36455709993,5cyclictest3736514-21cpuspeed_turbos19:54:165
36455709993,5cyclictest3736514-21cpuspeed_turbos19:54:165
36455709990,8cyclictest0-21swapper/521:39:125
36455709990,4cyclictest95713-21chrt23:56:015
36455709990,4cyclictest4180339-21chrt23:10:575
36455709990,4cyclictest4157062-21chrt23:02:405
36455709990,4cyclictest3939401-21chrt21:32:245
36455709990,4cyclictest3879763-21taskset21:06:515
36455709990,4cyclictest3654913-21taskset19:13:145
36455709990,4cyclictest34625-21chrt23:29:565
36455709990,4cyclictest0-21swapper/522:30:085
36455709990,3cyclictest4059483-21chrt22:20:485
36455709990,3cyclictest4023564-21taskset22:06:305
36455709990,3cyclictest0-21swapper/523:59:465
36455709990,2cyclictest0-21swapper/523:37:165
36455709990,2cyclictest0-21swapper/523:19:475
36455709990,2cyclictest0-21swapper/522:39:285
36455709990,2cyclictest0-21swapper/500:24:165
36455709990,2cyclictest0-21swapper/500:17:175
36455669997,2cyclictest4095245-21kworker/u16:1+flush-8:022:39:574
36455729986,2cyclictest86-21ksoftirqd/623:39:156
36455729986,2cyclictest86-21ksoftirqd/623:32:576
36455729986,2cyclictest86-21ksoftirqd/623:15:036
36455729986,2cyclictest86-21ksoftirqd/622:05:556
36455729986,2cyclictest86-21ksoftirqd/621:42:146
36455729986,2cyclictest86-21ksoftirqd/621:26:316
36455729986,2cyclictest86-21ksoftirqd/600:10:416
36455729985,2cyclictest3812513-21users20:29:336
36455729983,4cyclictest3736849-21cut19:54:186
36455729983,4cyclictest3736849-21cut19:54:186
36455729980,5cyclictest0-21swapper/620:59:356
36455729980,1cyclictest0-21swapper/619:14:046
36455709981,1cyclictest201rcu_preempt22:24:425
36455709980,4cyclictest3987432-21chrt21:51:475
36455709980,4cyclictest3850969-21chrt20:50:495
36455709980,4cyclictest13146-21chrt23:24:115
36455709980,4cyclictest13146-21chrt23:24:115
36455709980,4cyclictest125381-21taskset00:09:235
36455709980,3cyclictest4048494-21chrt22:17:525
36455709980,2cyclictest0-21swapper/522:50:045
36455709980,2cyclictest0-21swapper/522:34:195
36455709980,2cyclictest0-21swapper/522:00:575
36455709980,2cyclictest0-21swapper/521:54:235
36455709980,2cyclictest0-21swapper/500:34:525
36455669986,2cyclictest3940431-21kworker/u16:4+flush-8:021:54:214
36455669985,2cyclictest3870113-21kworker/u16:1+events_unbound21:04:174
36455669984,3cyclictest3815376-21kthreadcore20:34:214
36455669983,4cyclictest3737952-21cut19:54:214
36455669983,4cyclictest3737952-21cut19:54:214
36455669983,4cyclictest3677413-21timerandwakeup19:19:314
36455729974,2cyclictest3822834-21/usr/sbin/munin20:39:176
36455729970,6cyclictest40833942sleep622:30:196
36455669975,2cyclictest3870113-21kworker/u16:1+events_unbound22:09:284
36455669974,2cyclictest4073320-21kworker/u16:2+flush-8:022:54:084
36455669973,3cyclictest3823861-21cut20:39:214
36455669973,3cyclictest3784964-21expr20:19:174
36455669970,6cyclictest3794790-21tune2fs20:24:184
36455729960,6cyclictest0-21swapper/621:04:246
36455729960,5cyclictest0-21swapper/620:54:176
36455669951,1cyclictest0-21swapper/419:09:214
36455669950,4cyclictest3850901-21chrt20:49:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional