You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 11:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sun Mar 22, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22425211995,19sleep30-21swapper/319:05:063
24133211794,18sleep00-21swapper/019:08:550
23436210785,17sleep20-21swapper/219:05:212
2344529786,6sleep10-21swapper/119:05:281
153282880,0sleep10-21swapper/120:05:201
273122820,0sleep30-21swapper/321:30:003
189122340,1sleep123-21ksoftirqd/120:15:131
163522260,1sleep216351-21timerwakeupswit21:51:042
121992210,0sleep20-21swapper/222:20:222
2424699200,18cyclictest207150irq/24-eth122:30:111
2424599190,4cyclictest0-21swapper/023:22:050
24247991815,2cyclictest26786-21kworker/u8:221:46:052
2424599183,2cyclictest0-21swapper/020:41:040
2424599182,2cyclictest0-21swapper/019:14:010
2424599180,4cyclictest0-21swapper/023:56:040
2424599180,4cyclictest0-21swapper/000:19:040
24248991710,4cyclictest18524-21ssh21:54:133
24247991714,2cyclictest3205-21kworker/u8:219:59:042
24247991714,2cyclictest3165-21kworker/u8:320:57:042
2424599172,2cyclictest0-21swapper/023:04:040
2424599172,2cyclictest0-21swapper/000:32:040
2424599171,2cyclictest0-21swapper/019:39:040
2424599171,14cyclictest0-21swapper/000:14:300
2424599170,3cyclictest0-21swapper/022:57:040
2424599170,3cyclictest0-21swapper/000:28:050
2424599170,3cyclictest0-21swapper/000:28:050
24248991613,2cyclictest32105-21kworker/u8:021:35:043
24248991613,2cyclictest19831-21kworker/u8:200:14:043
24248991613,2cyclictest17286-21kworker/u8:023:02:043
24248991611,3cyclictest26153-21ssh22:35:173
24248991611,3cyclictest23228-21ssh23:40:113
2424899160,11cyclictest0-21swapper/322:40:043
24247991613,2cyclictest6802-21kworker/u8:121:55:042
24247991613,2cyclictest31542-21kworker/u8:122:09:032
24247991613,2cyclictest26036-21kworker/u8:119:35:042
24247991613,2cyclictest23922-21kworker/u8:219:19:042
24247991613,2cyclictest13343-21kworker/u8:021:23:042
24247991613,2cyclictest12489-21kworker/u8:020:31:042
24247991613,2cyclictest12489-21kworker/u8:020:11:042
2424799160,2cyclictest0-21swapper/200:10:002
2424699161,13cyclictest0-21swapper/123:36:021
2424699160,14cyclictest0-21swapper/123:09:061
2424599162,2cyclictest0-21swapper/023:44:050
2424599162,2cyclictest0-21swapper/020:51:040
2424599162,2cyclictest0-21swapper/020:33:040
2424599162,2cyclictest0-21swapper/020:28:040
2424599162,12cyclictest0-21swapper/022:00:040
2424599161,2cyclictest0-21swapper/020:10:040
2424599161,2cyclictest0-21swapper/000:22:040
2424599161,2cyclictest0-21swapper/000:22:030
2424899159,5cyclictest0-21swapper/321:45:043
24248991512,2cyclictest3267-21kworker/u8:122:47:043
24248991512,2cyclictest28138-21kworker/u8:120:48:043
24248991510,3cyclictest17873-21cut21:20:003
24247991512,2cyclictest5340-21kworker/u8:123:56:042
24247991512,2cyclictest3267-21kworker/u8:122:52:042
24247991512,2cyclictest31542-21kworker/u8:122:34:032
24247991512,2cyclictest30563-21kworker/u8:123:27:042
24247991512,2cyclictest3039-21kworker/u8:023:22:042
24247991512,2cyclictest30143-21kworker/u8:223:48:032
24247991512,2cyclictest28280-21kworker/u8:000:19:042
24247991512,2cyclictest26786-21kworker/u8:221:43:032
24247991512,2cyclictest24555-21kworker/u8:223:17:042
24247991512,2cyclictest17286-21kworker/u8:023:03:042
24247991512,2cyclictest16807-21kworker/u8:023:54:042
24247991512,2cyclictest16807-21kworker/u8:023:33:042
24247991512,2cyclictest1631-21kworker/u8:100:36:042
24247991512,2cyclictest1631-21kworker/u8:100:28:052
24247991512,2cyclictest1631-21kworker/u8:100:28:042
24247991512,2cyclictest12489-21kworker/u8:020:01:042
2424799150,13cyclictest20336-21cron22:30:002
2424699151,12cyclictest27243-21memory19:15:161
2424699151,12cyclictest25726-21ssh23:41:531
2424699151,12cyclictest12031-21sh23:28:021
24246991510,3cyclictest0-21swapper/122:04:221
2424699150,3cyclictest0-21swapper/121:10:311
2424699150,13cyclictest8082-21diskmemload22:19:281
2424599152,2cyclictest0-21swapper/022:44:010
2424599151,2cyclictest0-21swapper/023:09:040
2424599151,2cyclictest0-21swapper/020:46:050
2424599151,12cyclictest11-21rcuc/022:25:140
2424599150,2cyclictest0-21swapper/020:09:040
24248991411,2cyclictest7923-21kworker/u8:121:33:043
24248991411,2cyclictest3267-21kworker/u8:123:06:043
24248991411,2cyclictest22480-21kworker/u8:222:04:043
24248991411,2cyclictest16807-21kworker/u8:023:37:043
2424899140,9cyclictest0-21swapper/320:26:043
2424899140,3cyclictest14877-21dpkg00:05:113
2424899140,12cyclictest20448-21apt-get20:20:113
24247991411,2cyclictest5940-21kworker/u8:319:46:042
24247991411,2cyclictest3267-21kworker/u8:122:48:012
24247991411,2cyclictest30014-21kworker/u8:019:32:042
24247991411,2cyclictest28280-21kworker/u8:000:33:042
24247991411,2cyclictest26786-21kworker/u8:221:38:042
24247991411,2cyclictest23922-21kworker/u8:219:14:012
24247991411,2cyclictest22258-21kworker/u8:123:40:042
24247991411,2cyclictest12489-21kworker/u8:020:41:042
24247991411,2cyclictest12388-21kworker/u8:022:11:042
24247991411,2cyclictest0-21swapper/222:55:142
24247991410,2cyclictest0-21swapper/222:41:142
2424799140,12cyclictest0-21swapper/223:09:522
2424699149,3cyclictest27342-21ssh00:17:331
24246991411,2cyclictest11103-21apt-get22:20:121
24246991411,2cyclictest0-21swapper/123:15:181
2424699140,3cyclictest4895-21ssh00:27:541
2424699140,3cyclictest4895-21ssh00:27:531
2424699140,3cyclictest13652-21ssh21:49:061
2424699140,2cyclictest0-21swapper/100:34:231
2424699140,12cyclictest30245-21apt-get22:40:101
2424699140,12cyclictest29009-21ssh23:11:331
2424699140,12cyclictest12082-21latency_hist22:55:001
2424699140,12cyclictest0-21swapper/121:44:421
2424699140,12cyclictest0-21swapper/121:20:111
24245991411,2cyclictest2779-21ssh23:51:500
24245991411,2cyclictest0-21swapper/019:40:180
2424599140,3cyclictest0-21swapper/021:19:280
2424599140,2cyclictest0-21swapper/020:35:120
2424599140,2cyclictest0-21swapper/000:10:000
2424599140,13cyclictest0-21swapper/021:50:300
2424599140,13cyclictest0-21swapper/021:28:000
2424599140,12cyclictest0-21swapper/021:40:400
36572130,2sleep00-21swapper/022:11:350
24362130,2sleep30-21swapper/323:51:183
2424899138,3cyclictest26727-21ssh23:10:103
24248991310,2cyclictest3205-21kworker/u8:219:56:043
24248991310,2cyclictest31542-21kworker/u8:122:10:013
24248991310,2cyclictest28138-21kworker/u8:120:39:043
24248991310,2cyclictest0-21swapper/322:25:183
2424899130,2cyclictest5720-21latency21:40:163
2424899130,2cyclictest0-21swapper/320:30:143
2424899130,2cyclictest0-21swapper/300:20:163
2424899130,2cyclictest0-21swapper/300:20:163
2424899130,11cyclictest8082-21diskmemload22:15:113
24247991310,2cyclictest12489-21kworker/u8:020:29:042
24247991310,2cyclictest12388-21kworker/u8:022:00:042
24247991310,2cyclictest0-21swapper/221:11:502
24247991310,2cyclictest0-21swapper/219:50:172
24247991310,2cyclictest0-21swapper/219:25:052
24247991310,2cyclictest0-21swapper/200:21:052
24247991310,2cyclictest0-21swapper/200:21:052
2424799130,2cyclictest0-21swapper/223:35:012
2424799130,2cyclictest0-21swapper/200:00:112
2424799130,12cyclictest0-21swapper/221:30:492
2424799130,12cyclictest0-21swapper/221:17:292
2424699139,2cyclictest0-21swapper/121:26:021
2424699138,3cyclictest0-21swapper/120:50:171
2424699132,6cyclictest8082-21diskmemload22:00:011
2424699131,6cyclictest0-21swapper/121:00:001
2424699131,3cyclictest0-21swapper/121:00:131
24246991310,2cyclictest3127-21nscd21:33:551
24246991310,2cyclictest15431-21fschecks_time00:05:141
24246991310,2cyclictest0-21swapper/123:46:031
24246991310,2cyclictest0-21swapper/123:02:461
24246991310,2cyclictest0-21swapper/122:26:161
24246991310,2cyclictest0-21swapper/121:51:061
24246991310,2cyclictest0-21swapper/121:18:261
24246991310,2cyclictest0-21swapper/120:35:141
24246991310,2cyclictest0-21swapper/119:25:141
24246991310,2cyclictest0-21swapper/100:35:131
24246991310,2cyclictest0-21swapper/100:20:171
24246991310,2cyclictest0-21swapper/100:20:171
2424699130,2cyclictest29029-21perl20:40:101
2424699130,2cyclictest14860-21ssh23:30:361
2424699130,2cyclictest0-21swapper/123:56:561
2424699130,2cyclictest0-21swapper/100:10:071
2424699130,12cyclictest0-21swapper/122:46:471
2424699130,11cyclictest0-21swapper/121:05:511
2424599132,2cyclictest0-21swapper/019:32:040
2424599131,2cyclictest12-21rcu_preempt19:50:160
24245991310,2cyclictest0-21swapper/023:45:180
24245991310,2cyclictest0-21swapper/022:48:290
24245991310,2cyclictest0-21swapper/022:34:100
24245991310,2cyclictest0-21swapper/021:30:200
24245991310,2cyclictest0-21swapper/020:15:150
2424599130,2cyclictest8082-21diskmemload21:56:400
2424599130,2cyclictest0-21swapper/023:26:030
2424599130,2cyclictest0-21swapper/023:16:200
2424599130,2cyclictest0-21swapper/021:45:300
2424599130,2cyclictest0-21swapper/020:23:040
2424599130,12cyclictest0-21swapper/022:36:400
2424599130,12cyclictest0-21swapper/022:07:400
125842130,2sleep08082-21diskmemload22:20:560
316672120,1sleep0101ktimersoftd/019:26:010
2424899129,2cyclictest7923-21kworker/u8:121:10:043
2424899129,2cyclictest3267-21kworker/u8:122:58:043
2424899129,2cyclictest3205-21kworker/u8:219:51:043
2424899129,2cyclictest18172-21kworker/u8:019:15:043
2424899129,2cyclictest1631-21kworker/u8:100:29:043
2424899129,2cyclictest1631-21kworker/u8:100:29:043
2424899129,2cyclictest0-21swapper/321:55:213
2424899129,2cyclictest0-21swapper/319:35:303
2424899129,2cyclictest0-21swapper/300:32:313
2424899129,2cyclictest0-21swapper/300:04:413
2424899122,7cyclictest0-21swapper/319:24:593
2424899120,11cyclictest0-21swapper/322:34:513
2424899120,11cyclictest0-21swapper/320:05:133
2424899120,11cyclictest0-21swapper/300:16:023
2424899120,10cyclictest8082-21diskmemload23:30:113
2424899120,10cyclictest11516-21ssh22:54:163
2424799129,2cyclictest3165-21kworker/u8:321:05:042
2424799129,2cyclictest28138-21kworker/u8:120:46:052
2424799129,2cyclictest12489-21kworker/u8:020:51:042
2424799129,2cyclictest10053-21kworker/u8:120:05:042
2424799129,2cyclictest0-21swapper/222:35:112
2424799129,2cyclictest0-21swapper/200:05:252
2424799120,2cyclictest0-21swapper/223:14:192
2424799120,2cyclictest0-21swapper/221:25:112
2424799120,11cyclictest0-21swapper/222:17:202
2424799120,11cyclictest0-21swapper/220:15:162
2424699129,2cyclictest0-21swapper/123:20:261
2424699129,2cyclictest0-21swapper/122:05:141
2424699129,2cyclictest0-21swapper/121:35:121
2424699129,2cyclictest0-21swapper/120:25:151
2424699129,2cyclictest0-21swapper/120:01:031
2424699122,7cyclictest0-21swapper/120:22:591
2424699122,5cyclictest0-21swapper/119:55:001
2424699121,3cyclictest0-21swapper/119:45:151
2424699121,3cyclictest0-21swapper/119:20:171
24246991210,1cyclictest0-21swapper/122:11:561
2424699120,3cyclictest4574-21cpuspeed_turbos19:40:121
2424699120,2cyclictest0-21swapper/122:55:261
2424699120,11cyclictest0-21swapper/123:50:031
2424699120,11cyclictest0-21swapper/122:35:221
2424699120,11cyclictest0-21swapper/120:10:141
2424699120,11cyclictest0-21swapper/119:36:021
2424699120,11cyclictest0-21swapper/100:01:571
2424699120,10cyclictest0-21swapper/119:30:191
2424599129,2cyclictest8082-21diskmemload00:00:040
2424599129,2cyclictest0-21swapper/023:10:050
2424599128,3cyclictest9-21ksoftirqd/019:55:110
2424599127,3cyclictest8089-21fschecks_time22:50:150
2424599127,3cyclictest598-21cut21:35:130
2424599121,2cyclictest0-21swapper/021:05:040
2424599120,2cyclictest0-21swapper/023:34:340
2424599120,11cyclictest0-21swapper/023:35:070
2424599120,11cyclictest0-21swapper/022:15:360
2424599120,11cyclictest0-21swapper/021:21:230
2424599120,11cyclictest0-21swapper/021:10:240
2424599120,11cyclictest0-21swapper/000:35:160
282492110,2sleep00-21swapper/019:19:570
2424899118,2cyclictest32593-21kworker/u8:220:59:043
2424899118,2cyclictest3205-21kworker/u8:219:41:043
2424899118,2cyclictest12388-21kworker/u8:022:20:013
2424899118,2cyclictest0-21swapper/320:50:123
2424899117,3cyclictest7963-21ssh23:57:133
2424899116,3cyclictest31224-21ssh23:48:023
2424899112,6cyclictest0-21swapper/321:02:593
2424899112,6cyclictest0-21swapper/300:36:593
2424899110,9cyclictest8082-21diskmemload23:20:403
2424899110,2cyclictest0-21swapper/322:05:503
2424899110,2cyclictest0-21swapper/321:20:113
2424899110,2cyclictest0-21swapper/319:31:033
2424899110,10cyclictest0-21swapper/323:25:413
2424699116,3cyclictest25305-21needreboot19:10:171
2424899107,2cyclictest3165-21kworker/u8:321:07:043
2424899107,2cyclictest12489-21kworker/u8:020:19:043
2424899105,3cyclictest24781-21sed19:10:133
2424899100,2cyclictest0-21swapper/323:16:193
2424799107,2cyclictest12489-21kworker/u8:020:23:042
2424699102,5cyclictest0-21swapper/119:54:591
2424699100,8cyclictest24799-21df_abs20:30:131
2424699100,8cyclictest0-21swapper/120:45:111
2424599108,1cyclictest0-21swapper/021:02:430
2424599107,2cyclictest0-21swapper/020:55:120
2424599107,2cyclictest0-21swapper/019:45:120
242489996,2cyclictest28138-21kworker/u8:120:40:043
242489994,3cyclictest6339-21aten2.4_r3power19:45:113
242489994,3cyclictest30300-21http19:25:003
242489994,3cyclictest17061-21kernelversion20:10:163
242489994,3cyclictest13223-21grep20:00:173
242459994,3cyclictest29351-21tail19:20:160
242459994,3cyclictest12892-21fschecks_time20:00:150
242479985,2cyclictest0-21swapper/220:36:082
242479983,3cyclictest5844-21taskset21:02:102
242479983,3cyclictest3127-21nscd19:40:142
242479983,3cyclictest28545-21cut19:20:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional