You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 01:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Apr 17, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6257772980,1sleep7625776-21grep21:19:517
10909422940,1sleep40-21swapper/400:30:134
10909422940,1sleep40-21swapper/400:30:134
36755025343,7sleep40-21swapper/419:09:214
36755025343,7sleep40-21swapper/419:09:214
36788599420,40cyclictest988949-21latency_hist23:49:517
36728624232,7sleep50-21swapper/519:05:375
36728624232,7sleep50-21swapper/519:05:375
367872994038,2cyclictest649475-21kworker/u16:3+flush-8:021:39:515
3673732405,30sleep70-21swapper/719:06:517
3673732405,30sleep70-21swapper/719:06:517
367872993937,2cyclictest445376-21kworker/u16:0+flush-8:020:14:515
367872993533,2cyclictest477274-21kworker/u16:1+flush-8:022:09:305
367885993428,5cyclictest572709-21latency_hist20:54:517
367872993230,2cyclictest723143-21kworker/u16:5+events_unbound22:49:305
36751423222,7sleep60-21swapper/619:08:516
36751423222,7sleep60-21swapper/619:08:516
367872993129,2cyclictest477274-21kworker/u16:1+events_unbound22:19:465
367872993128,3cyclictest611250-21kworker/u16:4+flush-8:021:24:515
367885993029,0cyclictest0-21swapper/723:54:587
367885993029,0cyclictest0-21swapper/722:25:067
367872993028,2cyclictest723143-21kworker/u16:5+events_unbound22:25:145
8050292280,1chrt805030-21sh22:30:277
367872992826,2cyclictest592262-21kworker/u16:3+flush-8:021:15:015
367872992826,2cyclictest314801-21kworker/u16:3+events_unbound19:10:145
367885992722,4cyclictest635-21systemd-journal21:28:117
367872992725,2cyclictest952064-21kworker/u16:2+flush-8:023:36:015
367872992724,2cyclictest850102-21kworker/u16:1+events_unbound23:09:535
367872992724,2cyclictest850102-21kworker/u16:1+events_unbound23:09:535
367872992624,2cyclictest850102-21kworker/u16:1+flush-8:022:55:265
367872992624,2cyclictest625813-21kworker/u16:0+events_unbound21:41:025
367872992624,2cyclictest625813-21kworker/u16:0+events_unbound21:41:025
367872992624,2cyclictest572384-21kworker/u16:3+flush-8:020:55:055
367872992624,2cyclictest534549-21kworker/u16:0+events_unbound20:45:055
367872992623,2cyclictest445376-21kworker/u16:0+flush-8:020:04:525
367885992524,0cyclictest0-21swapper/721:40:187
367885992524,0cyclictest0-21swapper/721:40:187
367885992524,0cyclictest0-21swapper/720:00:067
367885992520,4cyclictest524861-21latency_hist20:29:517
367872992523,2cyclictest496462-21kworker/u16:2+events_unbound20:15:145
367872992422,2cyclictest952064-21kworker/u16:2+flush-8:023:50:415
367872992422,2cyclictest952064-21kworker/u16:2+flush-8:023:50:415
367872992422,2cyclictest891501-21kworker/u16:2+flush-8:023:15:535
367872992422,2cyclictest339041-21kworker/u16:2+flush-8:019:34:515
367872992422,2cyclictest339041-21kworker/u16:2+flush-8:019:34:515
367872992421,3cyclictest417489-21kworker/u16:4+flush-8:019:35:155
7096372230,1chrt709638-21sh21:53:097
367885992322,0cyclictest0-21swapper/722:20:027
367885992322,0cyclictest0-21swapper/722:00:507
367872992321,2cyclictest850102-21kworker/u16:1+flush-8:023:00:315
367872992321,2cyclictest662430-21kworker/u16:2+events_unbound21:59:345
367872992321,2cyclictest477274-21kworker/u16:1+flush-8:021:52:465
367872992321,2cyclictest1002749-21kworker/u16:3+flush-8:000:23:185
367872992320,2cyclictest964768-21kworker/u16:1+flush-8:000:29:565
367872992320,2cyclictest964768-21kworker/u16:1+flush-8:000:29:565
367885992216,5cyclictest438624-21latency_hist19:44:527
36788599220,21cyclictest1704-21dockerd22:46:427
36788599220,20cyclictest866987-21ssh22:58:057
367872992220,2cyclictest964768-21kworker/u16:1+flush-8:000:05:225
367872992220,2cyclictest950296-21kworker/u16:1+events_unbound23:33:015
367872992219,2cyclictest477274-21kworker/u16:1+events_unbound22:00:035
367885992120,0cyclictest0-21swapper/721:34:317
367885992120,0cyclictest0-21swapper/719:14:477
367877992119,2cyclictest964768-21kworker/u16:1+flush-8:000:05:166
367872992119,2cyclictest780740-21kworker/u16:0+flush-8:022:21:065
367872992119,2cyclictest625813-21kworker/u16:0+events_unbound21:32:015
367872992119,2cyclictest592262-21kworker/u16:3+flush-8:021:13:015
367872992119,2cyclictest1002749-21kworker/u16:3+events_unbound00:25:145
367885992019,0cyclictest0-21swapper/723:00:217
367885992018,1cyclictest1023105-21sed00:00:507
367885992018,1cyclictest0-21swapper/700:30:577
367885992018,1cyclictest0-21swapper/700:30:577
367885992017,2cyclictest1046470-21ntpq00:10:207
367885992015,4cyclictest563121-21latency_hist20:49:517
36788599200,18cyclictest582278-21latency_hist20:59:517
367872992018,2cyclictest964768-21kworker/u16:1+flush-8:000:39:105
367872992018,2cyclictest935640-21kworker/u16:4+flush-8:023:55:065
367872992018,2cyclictest850102-21kworker/u16:1+flush-8:023:08:225
367872992018,2cyclictest850102-21kworker/u16:1+flush-8:023:08:225
367872992018,2cyclictest841915-21kworker/u16:0+flush-8:023:20:495
367872992018,2cyclictest477274-21kworker/u16:1+flush-8:022:11:225
367872991917,2cyclictest935640-21kworker/u16:4+flush-8:000:03:095
367872991917,2cyclictest649475-21kworker/u16:3+flush-8:021:29:515
367872991917,2cyclictest477274-21kworker/u16:1+events_unbound22:29:535
367872991917,2cyclictest1059445-21kworker/u16:2+events_unbound00:17:015
367870991912,5cyclictest0-21swapper/421:45:404
367885991817,0cyclictest0-21swapper/722:19:347
367885991817,0cyclictest0-21swapper/722:10:057
367885991814,3cyclictest1234-21snmpd23:35:577
367885991814,2cyclictest0-21swapper/719:15:157
36788599180,17cyclictest0-21swapper/722:40:147
367872991816,2cyclictest964768-21kworker/u16:1+flush-8:023:44:335
367872991816,2cyclictest534549-21kworker/u16:0+flush-8:020:40:155
367872991814,3cyclictest1025360-21kworker/u16:2+flush-8:000:10:335
367885991716,0cyclictest0-21swapper/723:20:027
367885991716,0cyclictest0-21swapper/721:11:517
367885991715,1cyclictest0-21swapper/719:25:147
36788599170,15cyclictest697382-21sh21:47:527
367872991715,2cyclictest696423-21kworker/u16:3+flush-8:021:48:305
367872991715,2cyclictest3844725-21kworker/u16:1+events_unbound19:29:295
36787099170,14cyclictest0-21swapper/422:38:014
367885991615,0cyclictest0-21swapper/719:35:117
367885991612,3cyclictest736175-21ssh22:05:077
36787799160,15cyclictest917329-21expr23:20:046
367872991615,1cyclictest534549-21kworker/u16:0+events_unbound21:03:335
367872991614,2cyclictest841915-21kworker/u16:0+flush-8:023:25:165
367872991614,2cyclictest795484-21kworker/u16:2+flush-8:022:41:145
367872991614,2cyclictest795484-21kworker/u16:2+events_unbound22:52:225
367870991613,2cyclictest784208-21expr22:25:054
36787099160,0cyclictest0-21swapper/400:02:224
367885991514,0cyclictest0-21swapper/700:29:307
367885991513,1cyclictest901201-21ssh23:10:167
367885991513,1cyclictest901201-21ssh23:10:167
36788599150,13cyclictest501038-21grep20:15:097
36787299150,1cyclictest525770-21diskstats20:30:055
36787099150,1cyclictest0-21swapper/421:55:274
367885991413,0cyclictest0-21swapper/721:36:077
367885991412,1cyclictest1028585-21kthreadcore00:05:107
367885991412,1cyclictest0-21swapper/719:30:067
367885991412,1cyclictest0-21swapper/719:30:067
367885991411,2cyclictest1098998-21fschecks_count00:35:047
36788599140,1cyclictest0-21swapper/723:15:137
367877991413,1cyclictest0-21swapper/623:42:366
367877991413,1cyclictest0-21swapper/622:18:446
367877991413,1cyclictest0-21swapper/622:08:296
367877991413,1cyclictest0-21swapper/600:02:096
36787799140,1cyclictest0-21swapper/622:46:296
36787799140,1cyclictest0-21swapper/621:17:536
36787799140,14cyclictest0-21swapper/623:02:536
367872991413,1cyclictest0-21swapper/522:39:035
367872991412,2cyclictest391077-21kworker/u16:0+events_unbound19:20:065
367870991413,1cyclictest0-21swapper/423:43:264
367870991413,1cyclictest0-21swapper/422:52:214
367870991413,1cyclictest0-21swapper/400:29:474
36787099140,14cyclictest0-21swapper/421:17:464
36787099140,11cyclictest0-21swapper/420:04:274
36788599139,3cyclictest1234-21snmpd21:00:137
36788599139,3cyclictest1234-21snmpd20:31:467
36788599137,5cyclictest6382-21gvfs-afc-volume20:40:127
36787799139,3cyclictest487626-21cat20:10:046
36787799138,4cyclictest893479-21cat23:10:066
36787799138,4cyclictest893479-21cat23:10:066
367877991312,1cyclictest0-21swapper/622:31:026
367877991312,1cyclictest0-21swapper/621:47:406
367877991312,1cyclictest0-21swapper/621:26:526
36787799130,13cyclictest0-21swapper/621:37:076
367872991311,2cyclictest314801-21kworker/u16:3+flush-8:019:50:175
367870991312,1cyclictest0-21swapper/423:22:284
367870991312,1cyclictest0-21swapper/419:10:414
367870991311,2cyclictest0-21swapper/420:58:414
36787099130,3cyclictest658647-21latency21:30:124
36787099130,13cyclictest0-21swapper/422:14:504
36788599129,2cyclictest1234-21snmpd23:34:067
36788599128,3cyclictest1234-21snmpd23:26:597
36788599128,3cyclictest1234-21snmpd21:56:127
36788599128,3cyclictest1234-21snmpd19:58:487
36788599126,5cyclictest6382-21gvfs-afc-volume23:52:277
36788599126,5cyclictest6382-21gvfs-afc-volume23:52:277
36788599125,6cyclictest6101-21gmain22:51:137
367885991210,1cyclictest0-21swapper/722:35:117
36787799129,2cyclictest86-21ksoftirqd/621:00:006
36787799127,4cyclictest467757-21/usr/sbin/munin20:00:146
367877991211,1cyclictest0-21swapper/623:37:036
367877991211,1cyclictest0-21swapper/621:58:056
36787799120,11cyclictest0-21swapper/619:49:546
367872991210,2cyclictest477274-21kworker/u16:1+flush-8:020:35:075
36787099124,7cyclictest961816-21head23:35:174
36787099122,4cyclictest942513-21kthreadcore23:30:064
367870991211,1cyclictest0-21swapper/423:05:464
367870991211,1cyclictest0-21swapper/423:05:464
367870991211,1cyclictest0-21swapper/421:35:254
36787099120,12cyclictest0-21swapper/420:47:394
36787099120,12cyclictest0-21swapper/420:36:274
36787099120,12cyclictest0-21swapper/419:30:434
36787099120,12cyclictest0-21swapper/419:30:434
36788599119,1cyclictest0-21swapper/720:20:047
36788599118,2cyclictest1234-21snmpd20:35:347
36788599118,2cyclictest0-21swapper/723:40:107
36788599118,2cyclictest0-21swapper/700:15:217
36788599117,3cyclictest1234-21snmpd20:13:097
36788599117,3cyclictest1234-21snmpd19:20:207
36788599116,4cyclictest447251-21ntpq19:45:167
36788599114,6cyclictest6382-21gvfs-afc-volume19:50:097
36788599113,7cyclictest5975-21gmain20:05:137
36788599110,10cyclictest1062508-21cat00:20:037
36787799117,3cyclictest905558-21cat23:15:066
36787799117,3cyclictest791947-21sed22:25:146
367877991110,1cyclictest0-21swapper/621:08:346
367877991110,1cyclictest0-21swapper/620:56:456
367877991110,1cyclictest0-21swapper/620:20:586
367877991110,1cyclictest0-21swapper/619:30:316
367877991110,1cyclictest0-21swapper/619:30:316
36787799110,11cyclictest0-21swapper/620:32:006
36787299119,2cyclictest964768-21kworker/u16:1+events_unbound23:46:185
36787299117,3cyclictest593049-21cat21:05:075
36787099117,3cyclictest978162-21cat23:45:054
36787099117,3cyclictest526048-21cat20:30:074
36787099113,7cyclictest861957-21cut22:55:124
36787099113,7cyclictest607800-21cut21:10:114
36787099113,7cyclictest588201-21cut21:00:084
36787099113,3cyclictest707641-21sendmail_mailtr21:50:184
36787099113,3cyclictest518946-21cut20:25:084
36787099113,3cyclictest408831-21netstat19:25:124
36787099112,4cyclictest992540-21grep23:50:114
36787099112,4cyclictest992540-21grep23:50:114
36787099112,4cyclictest894749-21kthreadcore23:10:084
36787099112,4cyclictest894749-21kthreadcore23:10:084
36787099112,4cyclictest431228-21cut19:40:094
367870991110,1cyclictest0-21swapper/421:25:584
367870991110,1cyclictest0-21swapper/421:09:344
367870991110,1cyclictest0-21swapper/420:16:354
367870991110,1cyclictest0-21swapper/419:46:384
36787099110,4cyclictest841876-21taskset22:46:274
36787099110,3cyclictest680442-21kthreadcore21:40:114
36787099110,3cyclictest680442-21kthreadcore21:40:114
36788599108,1cyclictest0-21swapper/723:05:177
36788599108,1cyclictest0-21swapper/723:05:177
36788599107,2cyclictest0-21swapper/721:24:007
36787799108,2cyclictest534549-21kworker/u16:0+events_unbound20:40:066
36787799108,1cyclictest497059-21fschecks_count20:15:046
36787799107,2cyclictest371931-21kthreadcore19:10:096
36787799106,3cyclictest929237-21cpuspeed_turbos23:25:036
36787799106,3cyclictest858760-21grep22:55:106
36787799106,3cyclictest727041-21cat22:00:106
36787799104,5cyclictest0-21swapper/622:40:096
36787799104,5cyclictest0-21swapper/622:20:086
36787799104,5cyclictest0-21swapper/621:20:116
36787799100,9cyclictest852415-21latency22:50:136
36787799100,9cyclictest535272-21cstates20:35:046
36787799100,9cyclictest485488-21ntpq20:05:136
36787799100,9cyclictest389728-21ntpq19:15:146
36787799100,9cyclictest0-21swapper/621:43:346
36787799100,9cyclictest0-21swapper/621:43:346
36787799100,4cyclictest1084139-21chrt00:26:386
36787799100,3cyclictest557358-21kthreadcore20:45:076
36787799100,2cyclictest443254-21cut19:45:116
36787799100,1cyclictest0-21swapper/623:45:086
36787299109,1cyclictest0-21swapper/520:53:255
36787299106,3cyclictest468534-21cat20:00:065
36787299105,4cyclictest429405-21cpu19:40:035
36787099104,5cyclictest0-21swapper/422:40:094
36787099103,6cyclictest870761-21cut23:00:084
36787099103,6cyclictest545241-21sed20:40:084
36787099103,6cyclictest391654-21fschecks_count19:20:054
36787099103,4cyclictest906394-21cut23:15:084
36787099103,3cyclictest730476-21grep22:00:124
36787099102,4cyclictest796096-21grep22:30:044
36787099102,4cyclictest420584-21iwlist19:35:064
36787099102,3cyclictest779525-21cut22:20:124
36787099102,3cyclictest737316-21cat22:05:084
36787099102,3cyclictest479005-21kthreadcore20:05:084
36787099102,3cyclictest452899-21kthreadcore19:50:104
36787099102,3cyclictest384947-21kthreadcore19:15:094
36787099101,4cyclictest762732-21tr22:15:094
36787099100,4cyclictest636304-21chrt21:21:564
36787099100,4cyclictest565475-21cut20:50:094
36787099100,4cyclictest488258-21cut20:10:064
3678859994,4cyclictest597762-21cut21:05:127
3678779997,2cyclictest86-21ksoftirqd/622:35:496
3678779997,2cyclictest86-21ksoftirqd/600:19:576
3678779997,2cyclictest86-21ksoftirqd/600:18:096
3678779997,2cyclictest86-21ksoftirqd/600:10:396
3678779995,3cyclictest941586-21expr23:30:016
3678779995,3cyclictest462781-21cut19:55:106
3678779990,9cyclictest0-21swapper/619:40:096
3678779990,8cyclictest880730-21ls23:05:036
3678779990,8cyclictest880730-21ls23:05:036
3678779990,8cyclictest749639-21kthreadcore22:10:096
3678779990,8cyclictest602870-21irqcore21:10:076
3678779990,3cyclictest993295-21cat23:50:126
3678779990,3cyclictest993295-21cat23:50:126
3678779990,3cyclictest651315-21cut21:30:076
3678779990,3cyclictest516117-21cstates20:25:036
3678779990,2cyclictest0-21swapper/623:54:536
3678709990,4cyclictest929289-21expr23:25:034
3678709990,4cyclictest515144-21chrt20:22:514
3678709990,4cyclictest458397-21tr19:55:034
3678709990,4cyclictest1107824-21chrt00:35:424
3678709990,4cyclictest1072494-21taskset00:22:274
3678709990,4cyclictest1059562-21taskset00:16:024
3678709990,4cyclictest1046370-21taskset00:10:174
3678779986,2cyclictest86-21ksoftirqd/600:35:516
3678779986,2cyclictest86-21ksoftirqd/600:33:346
3678779986,2cyclictest86-21ksoftirqd/600:33:346
3678779980,7cyclictest0-21swapper/619:25:026
3678779980,3cyclictest702416-21tr21:50:106
3678729986,2cyclictest477274-21kworker/u16:1+flush-8:020:29:465
3678729985,3cyclictest339041-21kworker/u16:2+flush-8:019:55:175
3678729983,4cyclictest384513-21cut19:15:085
3678709981,2cyclictest1025732-21chrt00:04:564
3678709980,3cyclictest1004993-21chrt23:55:114
3678779975,1cyclictest0-21swapper/619:35:036
3678779975,1cyclictest0-21swapper/619:20:096
3678779973,3cyclictest563978-21expr20:50:046
3678729972,4cyclictest440143-21cut19:45:095
3678729950,4cyclictest512155-21chrt20:20:125
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional